Hi Mr. K, thank for wonderful explanation on this end to end project. I am trying to replicate the same in my on-premise system but getting the below error while creating the linked service using the credentials. Here is the error message Cannot connect to SQL Database. Please contact SQL server team for further support. Server: 'localhost', Database: 'AdventureWorksLT2017', User: 'Bnasa'. Check the linked service configuration is correct, and make sure the SQL Database firewall allows the integration runtime to access. A connection was successfully established with the server, but then an error occurred during the login process. (provider: Shared Memory Provider, error: 0 - No process is on the other end of the pipe.) No process is on the other end of the pipe requesting you to please share the steps on how to resolve this issue.

Mr K, This is a top notch content! but, I have been avoiding azure for 5 years and I think I should avoid it more. why they make the process too repetitive? I am a Fan of AWS and I can accomplish the same pipeline in a few line of code with some python knowledge. But your tutoring is exceptional. I 've subscribed!

Thank you very much

Thank you once again for this end-to-end project

Thank you mr K for creating this wonderful end-to-end fabric project. Your way of explaining concepts and approaches to the project was straight to the point and very insightful. Big Thank you! I look forward to viewing and learning more through your future projects!!!

Amazing Project!

Very useful, thanks!

This is my first tutorial playlist which i saw and neither I got bored nor did i left it watching half. Excellent Sir and had a pleasure watching and learning from it. 👍

Excellent demo! Thanks

Can we use ci/cd pipeline in service now??

What if we want to take both? Changes in the same file..

This is great! Thank you!🙏🏻

Hi, Help me resolve this error while creating linked service for sql server in ADF Cannot connect to SQL Database. Please contact SQL server team for further support. Server: 'localhost', Database: 'AdventureWorksLT2022', User: 'rithica'. Check the linked service configuration is correct, and make sure the SQL Database firewall allows the integration runtime to access. The system could not find the environment option that was entered

Thanks for your content! Love it

Good work. It really helps to start journey on azure data enginner

Fantastic tutorial.. Thank you Mr K

I had saw complete playlist, I have a question: 1. What are the packages you have used in your project?

Awesome

Excellent explanation. Is it mandatory to deploy only to live folder? Can we deploy all the notebooks to /Shared Folder inside databricks workspace

When u have unique ideas then how does. It take as a new record with same id?

It will be really helpful..for new learner who are completely new in Febric..Thankyou.

Good content and Great demo based walk through.

Hi Mr. K, Can you please make the video on how Realtime projects work on below - ADF pipelines for feature/branch, dev, qa, prod & their linked services & datasets for all 4 environments - when we attach the DBK notebook in adf pipeline do we have same 4 environments in DBK as well? If yes please include that one as well - Shared- Self Hosted Integration runtime (can we include same IR for all 4 env in adf)

Thanks for projects, including each and every aspects of azure cloud service; but i am getting error upon running stored procedure trigger though I have given access of storage to pipeline workspace; can you please tell how I can resolve it; error message = { "errorCode": "2011", "message": "Cannot find the CREDENTIAL '*************synapse.dfs.core.windows.net/goldlayer/lakehouse/gold_layer/IOT_gold/', because it does not exist or you do not have permission.", "failureType": "UserError", "target": "Stored procedure_create_gold_table_views", "details": [] } I tried it in many but couldn't resolve. waiting for answer 2:31:44

You are truly a Gem Bro. Appreciate to explain the whole process in simplest terms and right way. Now I can start with a new real time project.

great work

crack!

why we are not doing DP-900 which make more sense for data engineer ?

Can we have the YAML Files?

You deserve much more views and likes. excellent way of teaching. Can't thank you enough.

Mr. K, you are an amazing tutor. Thank you for your efforts for creating this series.

can we create a custom role on top of a resource group ?

Hello sir From which repository you picked the data of sales , can u please mention the link of the data set

You just nailed it, excellent info. Clealy explained platforms capabilities briefly. 👌

Need help! I’m facing this error when I’m trying to link sql server “Cannot connect to SQL Database. Please contact SQL server team for further support. Server: 'DESKTOP-JDIEJN9\SQLEXPRESS', Database: 'AdventureWorks2017', User: 'sky. Check the linked service configuration is correct, and make sure the SQL Database firewall allows the integration runtime to access. A connection was successfully established with the server, but then an error occurred during the login process. (provider: SSL Provider, error: 0 - The certificate chain was issued by an authority that is not trusted.) The certificate chain was issued by an authority that is not trusted”

Interesting video, thanks to author. But very unusful is that there is no link to real files with solution. As nobody will retype YAML and Powershell code from sceen, it makes video mostly useless for people who search real practical solution.

Am not seeing connectors under General

hacker hai bhai hacker industry level real time need multiple time practice

Your content was really awesome and no channel in the youtube has crystal clear explanation.Could you post any real time project related to streaming data and batch processing which was asking during interviews

Hi Sir,It was really awesome with the content you posted in the youtube wrt data engineering.Sir if possible could you post one project related to streaming data and batch processing data used in real time

Hats off to your patience and the detailed explanation of end to end pipeline , even the paid content courses will not give you this level of explanation ..grateful and thankful for this amazing end to end project video

Hi, im getting this error when i run the model cell "{"response":"{\"error\":{\"code\":\"PermissionDeni..." response: ""{\"error\":{\"code\":\"PermissionDenied\",\"message\": \"Principal does not have access to API/Operation.\"}}"" status: "{"protocolVersion":{"protocol":"HTTP","major":1,"m..." protocolVersion: "{"protocol":"HTTP","major":1,"minor":1}" protocol: ""HTTP"" major: "1" minor: "1" statusCode: "401" reasonPhrase: ""Unauthorized""

How to create incremental pipeline to copy the data from sql server to adls, what will be the solution for this? For the video the data was static

An Azure Managed Identity is a special type of service principle. When enabled, it is directly tied to the resource. The service principle of the managed identity can be used in the same auth flow, except instead of client secrets or certificates they are automatically created, including the credentials, so no one knows them.

Can the entire project be done by using the free subscription of Azure?

Excellent..!

Khool