System Design - Run DBT workload on Cloud Composer 2 

Glad you found it useful Rahul 👍

Hey Kumar, can you explain what issues you were facing? The pip install is done outside of composer on a separate docker build, which is independent of composer. So it’s no different to if you just do it on a blank Python virtual env, if you can explain which step you got stuck I can help

Hi there, git isn’t directed integrated with composer. The way it works is you deploy DBT by packaging it in a docker container and push it to Artifact Registry (in the past GCR) then you pull the image when the dag runs (image is cached between runs if you don’t use :latest but a specific version of the tagged image). Composer will automatically get access to the image sorted in Artifact Registry if it’s in the same GCP project.