Develop locally and ship to production confidently with Dagster, Evidence, and MotherDuck. Transitioning from local development to production can sometimes be difficult when building data pipelines. Fear not: Dagster and MotherDuck deliver a masterclass and demo on developing locally and shipping to production with confidence!
Alex Monahan, Forward Deployed Engineer at MotherDuck, and Colton Padden, Data Engineer & Developer Advocate at Dagster Labs, show us how to aggregate our data in the cloud with MotherDuck's managed offering of DuckDB and then persist this data to a local, in-memory instance of our DB within Dagster for follow-up processing.
GitHub repo for the demo:
github.com/dagster-io/devrel-...
@dagsterio is the cloud-native orchestrator for the whole development lifecycle, with integrated lineage and observability, a declarative programming model, and best-in-class testability. Learn more about how to get started for free at dagster.io/.
@motherduckdb is the data warehouse and SQL analytics platform that's bringing DuckDB to the cloud. Start for free at motherduck.com/product/.
21 апр 2024
