ETL Batch pipeline with Cloud Storage, Cloud Run and BigQuery orchestrated by Airflow/Cloud Composer
This video shows a complete use case with an ETL Batch Pipeline deployed on Google Cloud.
This pipeline stages are :
Extract : Cloud Storage
Transform : Cloud Run
Load : BigQuery
Everything is orchestrated by Cloud Composer and Apache Airflow.
The CI CD part is done with Cloud Build.
#googlecloud #airflow #CloudComposer #ETL #CloudRun #CloudStorage #BigQuery
▸ Medium : / etl-batch-pipeline-with-cloud-storage-clou...
▸ Github : https://github.com/tosun-si/teams-lea...
▸ LinkedIn : https://www.linkedin.com/posts/mazlum...
▸ Twitter : https://twitter.com/MazlumTosun3/stat...
Feel free to subscribe to the channel and click on the bell 🔔 to receive notifications for the next videos.
📲 Follow me on social networks :
▸ Articles : / mazlum.tosun
▸ X : / mazlumtosun3
▸ LinkedIn : / mazlum-tosun-900b1812
▸ WhatsApp : https://whatsapp.com/channel/0029VaCj...
