On day 5 of Dagster Launch Week, Pedram Navid (Head of Data Engineering and Developer Relations at Dagster Labs) shared details on Embedded ELT - a demonstration of how embedded libraries in the orchestration layer can oftentimes eliminate the need for more heavyweight 3rd party SaaS tools which complicate your tech stack and add to your cloud costs.
Read the blogpost on Embedded ELT here: dagster.io/blog/dagster-embed...
00:00 Intro and the Data Engineering Lifecycle
01:27 Types of Data Ingestion
02:47 Three bad choices for data ingestion
04:01 What is so difficult about ingestion?
08:20 Why is embedded ELT the answer?
10:40 Demo of embedded ELT
14:50 Wrap up
Try Dagster today with a 30-day free trial: dagster.io/lp/dagster-cloud-t...
29 июл 2024