In this episode, we continue chating with Ben Smith, a developer advocate at AWS.
We talk about the advanced patterns Ben has developed through hands-on experience and experimentation with step functions. These patterns, used widely by organizations on a daily basis, include handling large lambda functions, REST CRUD API using step functions, Saga and Circuit Breaker patterns for error management, and leveraging step functions for choosing the right compute resources.
The discussion covers dynamic parallelism with the map state and distributed map state for handling up to 10,000 parallel executions, showcasing real-world applications and optimizations.
Ben also shares tips for efficient state management and the value of learning through building and iterating on solutions.
The conversation highlights several serverless architectures, demonstrating how step functions facilitate complex workflows, handle errors gracefully, and optimize costs and computing resources.
Table of contents:
00:00 Welcome to the World of Step Functions with Ben Smith
01:27 Diving Deep into Step Function Patterns
02:13 Exploring the REST CRUD API Pattern
10:53 The Saga and Circuit Breaker Patterns: Managing Errors in Step Functions
16:30 Choosing the Right Compute: Lambda vs. Containers
21:18 Exploring Advanced Step Functions
22:21 Parallel Processing with Step Functions
24:34 Introducing the Data Preserver Pattern
25:26 Dynamic Parallelism and Map State
29:52 Optimizing with the Distributed Map State
31:13 Real-world Application: GIF Generator
33:46 Leveraging Distributed Map State for Data Analytics
36:28 The Evolution of Building and Learning
39:00 Wrapping Up and Looking Forward
Watch the full playlist: • ⚙️ AWS Step Functions
Find Ben in the internet
Ben on Twitter: / benjamin_l_s
Ben on LinkedIn: / bensmithportfolio
Links mentioned in this video:
Talking with Ben about Cost Optimization of Step Functions: • Mastering AWS Step Functions: Cost An...
What is Serverlesspresso?: • Serverlesspresso - A demo using Event...
Ben re:Invent 2023 talk: • AWS re:Invent 2023 - Advanced serverl...
#foobar #serverless
#foobar #serverless
⭐ SUBSCRIBE TO THIS CHANNEL: http://bit.ly/foobar-youtube
⭐SHARE THIS VIDEO: • Advanced Step Functions Patterns with...
☆☆ FOLLOW ME ONLINE ☆☆
🐦 Twitter: / mavi888uy
🖇️ Linkedin: / marciavillalba
📺 AWS Spanish Youtube Channel: https://bit.ly/aws-esp-yt
📷 Instagram: foobar_codes
📚 All my Serverless Courses: https://marcia.dev/courses/
✍️ My blog - https://blog.marcia.dev
☆☆ ABOUT FOOBAR ☆☆
In this channel, you can find mostly coding tutorials related to cloud and serverless.
In addition, I like also talking about architecture, software design, motivation, and leadership.
There is a new video every Thursday, so stay tuned :)
🎥 Recording equipment: https://blog.marcia.dev/my-recording-...
📚 My favorite books: https://blog.marcia.dev/my-books-reco...