Azure Data Factory | Copy multiple tables in Bulk with Lookup & ForEach 

I really really like how you guide step by step like this, it is quite easy to understand. You are the best “trainner” I’ve seen, really appreciated for your time on creating those useful videos.

Cannot thank you enough for your incredibly well laid out, thorough explanations. The world needs more folks like you :)

You're the best Adam! Thanks for all the help, been watching your tutorials on ADF and they're very helpful. Keep them coming!

Thank you Adam! I had been trying to follow some other written content to do exactly what you showed with no success. Your precise steps and explanation of the process were so helpful. I am successful now.

Thank you, Adam. I rewatch this video at least twice a year, Thank you for all you do.

Excellent, Excellent video. This has truly cemented the concepts and processes you are explaining in my brain. You are awesome, Adam!

What a wonderful content you have place in social media.. What a world class personality you... People certainly fall in love with your teaching..

Your videos are great. This is the best channel on RU-vid platform to learn about ADF. THANKS 🙏😊

Videos are very much clear to the people who would like to learn and practice.Thanks alot.your hard work is appreciated.

You are the example for how teaching should be. Just awesome 👍

Brilliant teaching style Adam. Very watchable. I particularly like how you explain the background. I've subscribed and will watch more of your videos.

Awesome explanation, the way you teach assuming in layman terms is pretty great, thanks!!

You have depth knowledge in every service. I learn from scratch using your channel. Keep posting Thanks you and God bless you.

Adam, thanks for all your great video's! I appreciate your work very much! Keep up your great work!

The way you explain is super Adam. Really nice

Thank you Adam!! These videos are really very helpful and builds the foundation to understand ADF.

Brilliant tutorial. Easy to follow and it all works like a charm. Thank you!!

I am a beginner in Azure Data Engineering and you made it simple to learn all the tactics.. thanks

Incredibly simplified to learn. .. Great!!

Hi Adam Ur videos are just too brilliant. This is subscription I wouldn’t mind paying to support. Ur lessons are invaluable to learning.

This video was really helpful! you have leveled up my Azure skills, Thank you sir, you have gained another subscriber

Very professionally demonstrated and very clear to understand. Thank you very much

Amazing video. Complex topic perfectly explained. Thank you Adam

Wow! What Great video, very easy way step by step tutorials and explanations. Well done!

Great and simple walk through, good job Adam

Fantastic clear-cut explanation. Nice job!

THANK YOU SO MUCH for this! The step-by-step really helped with what I needed to do.

You are a legend. Next level editing and explanation

Thank you so much for the clear and nice explanation, I am new to ADF and learning a lot from your channel

it was so perfect , I was able to follow and copy data in first attempt .thanks

Your videos are awesome man. Gave me a firm grasp and encouraged me to get an azure subscription and play around some more.

I was looking for this video. Thanks for making this. It helps a lot. Thanks again.

Thanks Adam, your tutorials are very useful, hope to see more in the future

Thank you! It's under appreciated how important it is to name things something other than "demoDataset", but it makes a big difference both for understanding concepts, and maintainability.

Great video, easy to follow and to the point, really helped me to quickly get up a running with data factory.

your skills are in the tops thanks, love to see your channel grow

fantastic video Adam!! Really helpful to understand the parametrisation in ADF.

Adam you are just awesome man! The way you are teaching is excellent. Keep it up.. you are the best...

Amazingly simple and informative!

Thanks Adam, I'm waiting like this video on ADF, Please do regularly...

Awsome adam there cant be a way to explain better than this

Thank you! I really appreciate all you share, it truly helps me

Very well explained. Thank you so much!

Thanks Adam, amazing workshop, very clear and easy to follow, thanks for helping, i am wiser now :)

You are awesome Adam. Thank you so much for detailed explanation.

It is extremely hard to find information online about this topic. Thank you for making it easy!

Wow this was explained so well. Thank you!!!

Great session!! Thanks Adam.

These tutorials are so useful!

Great content, easy to follow!!

You're awesome Adam, thanks for such a great tutorial. I also tweeted this video. Thanks.!!

Excellent video and knowledge sharing. Great Job!

very simple yet powerful explanation

Adam, You are the best!. Thanks man!

You are a very good teacher.

Thank you so much for this. It helped a lot

Great Explanation !!!!

Very interesting video Adam. I found quite enlightening your idea of storing metadata. probably it could be maintained separately tracking last record loaded so we could use it as an input for delta loads through queries instead of reloading the full table on each run.

Thank you so much for sharing these valued knowledge. It's very helpful for me.

You are really best Adam! Your tutorial helped me a lot. Thanks

Awesome Adam!! you are the best. Thank you so much

Awesome. Thank you so much Adam!

👍👍👍 very good explanation.. 👍👍.

It is really cool that you make it so simple :)

Thank You so much.... Very good explanation, Just Awesome

Realy great stuff sir.this what am looking in youtube

Really helpful! you made it very easy!

Very nice video with good explanation.

Thanks for your awesome video, it helped me out a great deal

You are very good 👍 explained well thanks 😊

Thanks, this is beautiful.

Thanks Adam! very clear!

Thank you Adam, Very much informatics video

amazing work. thanks.

Fine tutorial. Thanks.

Thank you! well done.

dzieki! bardzo pomocne filmy!

Very well explained & succinct. One request - if possible create a video for loading ADW (Synapse) data-warehouse by ADF

Good one adam sir .

Thanks for the vidoes. I am letting the adds runs till the end :)

Excellent!!!!!

Hi Adam, very nice work this, I made this for a client of mine and found out one important thing: within the For each not all blocks are executed as if they are working together atomically. What I mean is that if you start two thinks in parallel using the For Each block and within the for each block you have two blocks - say block A and B - connected using parameters (item()) within these blocks say X and Y. Block A starting with item X will not necessarily be using the item X in block B although connected! So I want to suggest one extra advice to use only one block in a For Each block at max if using parameterazed block within or if you need more than one block start a separate pipeline within the For Each block which will have the multiple blocks. These pipelines will be started as separate childs and to the work in the correct order. With kind regards, Jeroen

Hi Adam, I really appreciate you video. Thanks for your videos! I hope you can also create a video for ODBC as data source.

Very good and clear..

great teacher

Hey, one thing about English - please guys correct me if I am wrong, but I am pretty sure what I am talking about - you shouldn't say inside a sentence "how does it work", but "what it works". Despite that, the content is awesome!

Greate one!

Thank you for your great videos, they have been super helpful. I'm working on a proof of concept similar to this video, however it's SQL to Azure SQL. Any links or references you can offer to help me with parameterizing the Azure SQL sink side?

thanks for the video

Hey Adam, awesome work and explanation! Do you have another video explaining how to deal with massive data copies from tables in bulk using ADF and that may resolve issues with maximum data or rows of data? Can you make a video with a demo explaining how to deal with this kind of scenarios that you mentioned that's the story for another day? Thanks a lot in advance!! =D

BRILLIANT

Very Good

Hey Adam. Great video! Two questions regarding the pipeline itself. 1. How do we approach Source Version Control of the pipeline? In SSIS we could export a package and commit to Git or use TFS. How do we approach versioning in Azure? 2. What is the approach to deploy this pipeline in upper environment? Assuming that this pipeline was created in dev, how do I approach deployment in i.e. UAT?

Thank you.

Amazing explanation Adam! Thank you for this! qq- Can the For Each activity run things concurrently? i.e. in this example, can it pass the 3 table_name, schema_name values to the Copy Data activity at the same time?

Hi Adam, this is awesome session. One question: Where in Azure documentation I can find the information regarding all possible output variable of a given activity e.g. when you were explaining about lookup activity, you talked about the property "firstrow". Where can I find such properties supported by all activities in Azure documentation ?

Thanks!

Hi Adam, thanks for the video! I am wondering if it is possible specify just one row from the table by id and copy it? Thanks in advance!

Thanks for your great video. Is there any limitation in terms of a number of tables, or table size when we use copy multiple in bulk according to your experience?

awesome