What are some of the common data lineage tools ? I am a newbie to data engineering , if you use DBT for a project isnt it quite easy to see data lineage . also can you find the data lineage from an airflow DAG graph
I have previously used IBM Metadata Workbench it works with Datastage. I think with Airflow, you will not be able to get the column level details and their transformations from source to target. You will only know the dependencies. (Let me know if I am wrong here).