Building Data Platforms with Event-Driven Architecture and Orchestration - Sepehr Mohammadi 

This talk proposes an integration of Event-Driven Architecture (EDA) with AWS Step Functions to orchestrate ETL pipelines, offering a dynamic, scalable, and efficient solution to data processing workflow management challenges. By leveraging the inherent advantages of EDA - such as loose coupling and asynchronous communication - in conjunction with the managed orchestration service provided by Step Functions, we demonstrate how complex data workflows can be simplified, automated, and made more resilient to changes and failures. Attendees will gain insights into the architectural principles, practical implementation strategies, and real-world applications of combining these technologies to enhance their ETL processes.

Наука