Suppose there is a configuration table created in fabric warehouse which stores the connection details of a sampledb stored in azure sql and some other datasets too. I want to load the tables from sampledb to a new fabric warehouse on the basis of metadata stored in configuration table. Will you be to explain this in a video. It would be very helpful. I am working on it too but getting stuck as at copydata source pane when I am trying to preview data, it is saying server endpoint’s format is invalid.
I am most likely going to create a video on configurable pipelines in up coming weeks. I usually use configuration files like JSON files as my pipeline configuration since JSON format is very native to Data Factory, easier to add to version control like git, and gives more options compared to database tables. However, the process is more or less the same whether you use configuration tables or files what comes to the pipeline itself.
