Automating your data workloads is essential in today's mission critical data driven businesses but what is the best way to do it? There are two basic choices: job schedulers and data orchestrators. I'll explain what they are, review some examples, and explain when to use each.
Support me on Patreon
https://www.patreon.com/bePatron?u=63...
Slides available here:
https://github.com/bcafferky/shared/b...
Video about Airflow
• Apache Airflow Architecture 101
Playlist on Azure Automation
https://studio.youtube.com/playlist/P...