Build THIS real-time Change Data Capture Pipeline!

Опубликовано: 18 Ноябрь 2024
на канале: FEWV

112

Hi everyone, In this video, I am going to show you how to build a scalable CDC solution using AWS S3, Glue, and Lambda.

Documentation: https://fewv.dev/lessons/build-real-t...
GitHub Repository:
Thank you for watching! ✨

If you have any queries, please ask me in the comment section below, I'll be happy to help ☺️
Or
Join the discord server: / discord

Topics:
0:00 Intro
0:16 What and Why CDC?
1:00 Architecture Overview
2:45 Prerequisites
3:10 Create RDS instance
7:14 Create S3 buckets
9:27 Create Source Endpoint for DMS
11:11 Create IAM role for DMS
12:11 Create Target endpoint
13:28 Create Replication Instance
17:24 Create DB on MySQL Workbench
19:40 Create DMS Task
22:18 Solving a Mistake
24:30 Create IAM role for Lambda
25:40 Create Lambda function
28:24 Create IAM role for Glue Job
29:30 Create Glue Job Function
31:31 Trigger Lambda function
33:21 Outro