CI CD with Dataflow on Google Cloud
This video shows full examples of CI CD pipelines with Dataflow.
It shows previous approaches (before) and the recommended approach (today) with Dataflow Flex Template.
CI CD pipelines are presented with different CI CD tools :
Cloud Build
Gitlab CI
Github Actions
Dagger IO
Little detail 🤒 : the executions of Dataflow jobs didn't work for a temporary Compute Engine availability issue in the 𝐞𝐮𝐫𝐨𝐩𝐞-𝐰𝐞𝐬𝐭𝟏 region.
▸ Github Dataflow Java :
https://github.com/tosun-si/dataflow-...
▸ Github Dataflow Python :
https://github.com/tosun-si/dataflow-...
▸ Article Medium Dataflow Java : / ci-cd-for-dataflow-java-with-flex-template...
▸ LinkedIn : https://www.linkedin.com/posts/mazlum...
▸ X : https://x.com/MazlumTosun3/status/175...
▸ Slides : https://docs.google.com/presentation/...
#GoogleCloud #Dataflow #ApacheBeam #CICD #FlexTemplate #CloudBuild #GitlabCI #GithubActions #Dagger #Terraform
Feel free to subscribe to the channel and click on the bell 🔔 to receive notifications for the next videos.
📲 Follow me on social networks :
▸ Articles : / mazlum.tosun
▸ X : / mazlumtosun3
▸ LinkedIn : / mazlum-tosun-900b1812
▸ WhatsApp : https://whatsapp.com/channel/0029VaCj...
