We've just released Apache Airflow 2.4.3 🎉
📦 PyPI: pypi.org/project/apache
📚 Docs: airflow.apache.org/docs/apache-ai
🛠 Release Notes: airflow.apache.org/docs/apache-ai
🐳 Docker Image: "docker pull apache/airflow:2.4.3"
Thanks to all the contributors who made this possible.
Follow
Click to Follow ApacheAirflow
Apache Airflow
@ApacheAirflow
Airflow is a workflow scheduler.
Also on fosstodon.org/@airflow
airflow.apache.orgJoined April 2016
Apache Airflow’s Tweets
The first London meet-up talk, from , just started! Thanks to for hosting the event this night
5
11
London meet-up at , first talk from about what's new on Airflow 2.4 and datasets
4
9
Agenda:
Talk #1: Dynamic Task Mapping and Datasets by (Director of Engineering @ | Committer & PMC Member of Apache Airflow)
Talk #2: Astro SDK: a new experience to building workflows
Speaker: (Staff Software Engineer @ )
3
5
Show this thread
Have you RSVP'd yet? Last chance to attend the London meetup @
#airflow #ApacheAirflow #meetups #London #DataEngineering
2
4
7
Show this thread
PSA: Version 6.0 of the AWS provider has removed the "Amazon S3" connection type; please edit it (in place) to use the "Amazon Web Services" type.
Nothing else will change, but we've tidied up a long standing "duplication"
(See github.com/apache/airflow if you are curious)
4
7
Woah, another in-person meetup!! This time at offices in Bangalore at 10 am
Agenda is out, RSVP now!!
3
8
Save the date for our next in-person meetup in London !!
Let's meet at the beautiful offices for an evening of great talks with Pizza, drinks and swags.
#airflow #dataengeering #Meetup
6
6
We've just released Apache Airflow 2.4.2 🎉
📦 PyPI: pypi.org/project/apache
📚 Docs: airflow.apache.org/docs/apache-ai
🛠 Release Notes: airflow.apache.org/docs/apache-ai
🐳 Docker Image: "docker pull apache/airflow:2.4.2"
Thanks to all the contributors who made this possible.
2
25
We've just released Apache Airflow Helm chart 1.7.0 🎉
📦 ArtifactHub: artifacthub.io/packages/helm/
📚 Docs: airflow.apache.org/docs/helm-char
🛠️ Release Notes: airflow.apache.org/docs/helm-char
Thanks to all the contributors who made this possible.
6
28
With #Airflow 2.4, you can break down big, monolithic pipelines—in which long-running tasks delay the completion of time-sensitive ones—into “#micropipelines” you can use to tune your #data ecosystem and make critical data products available on time.
6
10
I've released a testing tool for called `dagcheck`. It's a testing framework that lets you specify 'DAG invariants', and it will verify them without having to run your full DAG.
More: pypi.org/project/dagche
2
6
28
Just out of passion to share my learning(s) with others, wrote my first article on Medium regarding .
💠 Link : lnkd.in/dk4kHbxX
#apacheairflow #dataengineering #dataorchestration #python #pythonprogramming #apache #dataengineer #medium
2
11
Replying to
There is a lot of energy in the community. Super excited to try out the new features on data-aware scheduling.
2
10
Our move from Argo to Airflow is giving us almost a 10x productivity gain. Not in authoring DAGs but in running/maintaining our pipelines.
6
8
51
We've just released Apache Airflow 2.4.1 🎉
📦 PyPI: pypi.org/project/apache
📚 Docs: airflow.apache.org/docs/apache-ai
🛠 Release Notes: airflow.apache.org/docs/apache-ai
🐳 Docker Image: "docker pull apache/airflow:2.4.1"
Thanks to all the contributors who made this possible.
8
32
"some people say their life changed when they find Jesus, my life changed when I found " - Thiago Baldim at #dataengbytes #dataengbytes22
2
3
10
The new #DataDriven scheduling functionality in #Airflow 2.4 eliminates a lot of complexity and toil. See how we're applying this useful feature.
2
4
Airflow PMC welcomes Pierre Jeambrun as the newest Airflow Committer, and Tzu-ping Chung and Daniel Standish as new PMC members.
Thanks for all your hard work on Airflow!
Very, very well deserved!
Congratulations 🚀🚀
GIF
2
15
Learn how to set up Celery, Flower, & RabbitMQ for in a Medium article by Mukesh Kumar and Hiren Rupchandani!
2
5
This is a game changer, this is the future of DAG scheduling ! 🚀
More details in airflow.apache.org/blog/airflow-2
#airflow
Quote Tweet
We've just released Apache Airflow 2.4.0 
PyPI: pypi.org/project/apache
Docs: airflow.apache.org/docs/apache-ai
Release Notes: airflow.apache.org/docs/apache-ai
Docker Image: "docker pull apache/airflow:2.4.0"
Thanks to all the contributors who made this possible.
PyPI: pypi.org/project/apache
Docs: airflow.apache.org/docs/apache-ai
Release Notes: airflow.apache.org/docs/apache-ai
Docker Image: "docker pull apache/airflow:2.4.0"
Thanks to all the contributors who made this possible.
8
22
We've just released Apache Airflow 2.4.0 🎉
📦 PyPI: pypi.org/project/apache
📚 Docs: airflow.apache.org/docs/apache-ai
🛠 Release Notes: airflow.apache.org/docs/apache-ai
🐳 Docker Image: "docker pull apache/airflow:2.4.0"
Thanks to all the contributors who made this possible.
1
19
66
We're excited to announce the new whylogs Airflow provider! Learn how you can use , the open standard for #DataLogging, and to make your workflow more responsible, scalable, and efficient.
Read the blog 👉 bit.ly/3eR7ipZ
#ApacheAirflow
1
7
📣📢 Looking forward to . and I are giving a workshop on “Getting Started with ” on Saturday
1
5
9
I'm excited to talk about 's Deferrable Operators and how you can save tons of money using it! at Open Source Summit Europe 2022 from #ossummit
1
6
18
📽️If you missed the #ApacheAirflow Community Meetup led by Faizan Qazi, don't worry! Watch it now: youtu.be/Ej2Nl4sNstw 👀 & let us know what you think!
If you want to present at next Airflow meetup, fill out bit.ly/3lhp1aR & win some amazing swag! 🚀🤓
3
9
We've just released Apache Airflow 2.3.4 🎉
📦 PyPI: pypi.org/project/apache
📚 Docs: airflow.apache.org/docs/apache-ai
🛠 Release Notes: airflow.apache.org/docs/apache-ai
🐳 Docker Image: "docker pull apache/airflow:2.3.4"
Thanks to all the contributors who made this possible.
10
44
📢One day left! "Using Plugins for Webserver" by Faizan Qazi, Technical Analyst at Blue Altair Inc. Register now 👉 bit.ly/3cZO3cH 🤓 #ApacheAirflow
6
11
📢 Are you ready for the next #ApacheAirflow Community Meetup? Join us to learn with Faizan Qazi how to use the extensibility of Airflow to customize the User Interface as per certain requirements.💡🤓 Register here: bit.ly/3cZO3cH
1
10
We've just released Apache Airflow 2.3.3 🎉
📦 PyPI: pypi.org/project/apache
📚 Docs: airflow.apache.org/docs/apache-ai
🛠 Release Notes: airflow.apache.org/docs/apache-ai
🐳 Docker Image: "docker pull apache/airflow:2.3.3"
Thanks to all the contributors who made this possible.
12
46
⏰The #ApacheAirflow Community Meetup is starting now! Find out how to integrate Selenium scrapers into Airflow to allow all the features that #Airflow provides to orchestrate your tasks. Get the joining details here: bit.ly/3NCUXC4🤓
1
10
📢One day left! Title: #Airflow + Selenium: the perfect toolkit for web scraping by from moonshot.partners Register now 👉 bit.ly/3NCUXC4 🤓 #ApacheAirflow
3
11
👀 Don't miss the #ApacheAirflow Community Meetup! will demonstrate real use cases, showing #Airflow dag runs, browser simulations, and scraper results stored in bigquery. Save your spot now 👉 bit.ly/3NCUXC4 🤓
4
12
📢 Are you ready for the next #ApacheAirflow Community Meetup? Join us to learn with how to use some developed features such as scrapers queueing, error tolerance, scrapers enrichment, browser simulations and more.💡🤓 Register here:
6
15
We’ve just released Apache Airflow 2.3.2
📦 PyPI: pypi.org/project/apache
📚 Docs: airflow.apache.org/docs/apache-ai
🛠️ Release notes:
airflow.apache.org/docs/apache-ai
🚢 Docker Image: "docker pull apache/airflow:2.3.2"
🚏 Constraints:
github.com/apache/airflow
8
24
Airflow PMC welcomes Ping Zhang () as the newest Airflow Committer. 🎉🎉🎉
Congratulations Ping, well deserved 🚀🚀
GIF
read image description
ALT
2
2
8
#AirflowSummit is coming to an end, do not miss this last day session "Ingesting Game Telemetry in near Real-time dynamically into Redshift with Airflow (WB Games)" by Karthik Kadiyam
Starting now:
2
7
#AirflowSummit is coming to an end, do not miss this last day workshop "TFX on Airflow with delegation of processing to third party services" by & Paul Balm
Starting now: airflowsummit.org
4
8