Airflow
Last updated
, generated by Sumble
Explore more → **Airflow**
What is Airflow?
Apache Airflow is a platform to programmatically author, schedule and monitor workflows. Airflow is commonly used to create and manage complex data pipelines, automating tasks like data extraction, transformation, and loading (ETL).
What other technologies are related to Airflow?
Airflow Competitor Technologies
Luigi
Luigi is a Python-based workflow management tool that competes with Airflow in scheduling and executing complex pipelines.
Dagster
Dagster is a data orchestration platform that competes with Airflow in defining and executing data workflows.
Prefect
Prefect is a workflow orchestration platform that competes with Airflow in managing and monitoring data pipelines.
Azkaban
Azkaban is a batch workflow job scheduler created at LinkedIn, it is a competitor of Airflow for the execution of ETL and data pipelines.
GCP Cloud Composer
GCP Cloud Composer is a managed Airflow service that can be considered both a complement (as it's Airflow) and a competitor (as an alternative deployment strategy).
Number of organizations that mention technology
ⓘ Tap on a tech to explore matching organizations
Airflow Complementary Technologies
Spark
Spark is a distributed processing engine often used for data transformation tasks within Airflow DAGs.
DBT
DBT is a transformation tool that can be orchestrated by Airflow for managing data pipelines in the data warehouse.
Snowflake
Snowflake is a cloud-based data warehouse that can be a target for Airflow-orchestrated data pipelines.
Number of organizations that mention technology
ⓘ Tap on a tech to explore matching organizations
Which job functions commonly mention Airflow?
Analytics Engineer
21.2% of all Analytics Engineer jobs mention Airflow
View 3.1k
jobs on Sumble
Data Engineer
17.8% of all Data Engineer jobs mention Airflow
View 50.8k
jobs on Sumble
Software Engineer
1.6% of all Software Engineer jobs mention Airflow
View 79.6k
jobs on Sumble
Engineer
0.9% of all Engineer jobs mention Airflow
View 83.9k
jobs on Sumble
Engineering & R&D
0.8% of all Engineering & R&D jobs mention Airflow
View 84.2k
jobs on Sumble
6% of Data Infrastructure Migration projects involve Airflow
Microsoft
Principal Software Engineer
To develop a scalable cloud data warehouse that powers SQL analytics in Azure compute, utilizing technologies such as Azure Data Lake and Microsoft Fabric.
Read more ↗
Siemens
IT Solution Expert for SAP HCM Integration (m/f/d)
To integrate Workday with multiple SAP HCM systems using integration platforms like ShapeIn to streamline HR processes.
Read more ↗
Amazon
Applied Scientist, Q Developer Code Agent Science
Developing services that leverage generative AI and foundation models to improve the experience of developers using AWS tools and services.
Read more ↗
Walmart
(USA) Senior Manager, Automation Engineering - Data Engineer
To develop scalable data architectures and real-time data pipelines using technologies like Apache Airflow, Google Cloud Platform, and BigQuery to support AI/ML analytics.
Read more ↗
NHS
Deputy Head of Design & Delivery
To enhance and configure the Epic electronic patient record system to improve clinical outcomes and operational efficiency.
Read more ↗
Which organizations are mentioning Airflow?
Summary powered by 
Sumble
Sumble Find the right accounts, contact, message, and time to sell
Whether you're looking to get your foot in the door, find the right person to talk to, or close the deal — accurate, detailed, trustworthy, and timely information about the organization you're selling to is invaluable.
Use Sumble to: