Azure Synapse is an enterprise analytics service that accelerates time to insight across data warehouses and big data systems. Azure Synapse brings together the best of SQL technologies used in enterprise data warehousing, Spark technologies used for big data, Pipelines for data integration and ETL/ELT, and deep integration with other Azure services such as Power BI, CosmosDB, and AzureML.
Hi, I'm trying to set up a mirrored SqlServer database, but I'm getting this error: Unable to retrieve SQL Server managed identities. You can not mirror SQL Database with the managed identity across tenants. Please switch to a different SQL Database. Is it not possible to mirror a sqlServer database from another Azure tenant?
Thanks so much Scott, is there any way to select these tables programmatically using PowerShell or API or other tools? Selecting it manually, specially from D365 FinOps is a heavy task and takes a lot of time, there was a bug few months ago that Unlink the FinOps as I reported to Microsoft and I had to repeat a big process again, Thanks is advance
This looks nice. Wait for it to become available in all tenants to test it out. We need shared cluster/concurrent spark session in pipelines There are scenarios where we need to do a lot of very lightweight operations like pulling data from APIs, Databases, etc which barely need 2 core and 4GB memory but they need to run every 15 mins Right now, all we can do is run it in a 8core 64GB node, of course small node is there but it takes 3mins to start. Hope to see a solution to this problems.
please add support to sparkR... this extension is the only thing allowing to actually use fabric notebooks (how would you expect to write code without an autocompleter on the platform?) and R is an important piece for many
The Native Execution Engine is embedded as part of Microsoft Fabric www.microsoft.com/en-us/microsoft-fabric and there are no plans to add it to Synapse.
Thank you for your feedback. Copilot in Fabric is powered by LLMs that are currently only deployed to US and EU. We are aware of the data sovereignty concern and actively expanding our deployment to more Geo regions. You can always check this link to get the latest info. learn.microsoft.com/en-us/fabric/get-started/copilot-fabric-overview#available-regions
Hello sir, Thank you so much providing these productive videos. Today, I faced a challenge, and the solution I couldn't find elsewhere. That is How to Extract data from SAP Hana Cloud to Microsoft Fabric (cloud to cloud connectivity). Could you please help me here?
status "running" just says that the vCore "did something", right? But there is no way to tell if the cores were running at 1% or at 100% load, correct?
Yes, you are right. The resource utilization chart currently only indicates that the vCore is running and does not indicate CPU or memory utilization. What kind of information are you specifically looking for?
Great explanation , If we will do any changes in dataset which is in our local pc how would it reflect the data changes in kql do we have to establish any bridge like Integration run time/Virtual/Cloud gateway ?
Hey while working with parquet files ive noticed depending on sql query complexity it may occur that running the exact same SQL query multiple times for the exact same parquet file, it may result in different results - has anyone ever noticed that same behavior before?
Thanks for this video, i am currently using the notebook activity in Fabric Pipelines. My notebook is mature now and it runs very well. I was thinking of gathering the code in the notebook into a job definition, for the sake of saving execution time in the notebook. Would replacing a notebook by a job definition makes the code execution faster? Another question would be about job descriptions themselves, if you have defined some helper functions in the notebook, can i move them to a side job definition that is being called from the main job definition? if yes then how? Thanks
Hi, Good Morning!, I have to convert the existing SQL server stored procedure into fabric environment, In my stored procedures there are CURSOR commands but fabric doesnt support CURSOR commands, in this case how do I proceede, is there any alternative.
Is there a way to perform Lifecycle Management policy on the Dataverse using Synapse Link? Want to pull all data from Dataverse to the Datalake the way Synapse Link does but delete old data in the Dataverse but still retain it in the Data lake. I want the data in the data lake to run through the Azure Lifecycle management policy so that it ends up in the cooler tiers to save cost but still be reportable for PowerBi using serverless sql.
hello @amit When I follow the steps, in power BI I see the "Trial" option as disabled adn by default it has selected my "Pro" licence. However on top it shows me "PPU trial: 59 days left". Is that how it is uspposed to be? Further as I proceed, and try to create Lakehouse, it gives me a message asking to upgrade to free Fabric tiral capacity.
Unfortunately, the audio is very bad, and also the screen resolution of these recordings makes it very difficult to read - the occasional zooming in just makes it confusing. It's a pity as the content is pretty good - perhaps include the example files so people can try this themselves. This series could really use an Editor to make sure the content is uniformly presented.
maybe there are questions: what does the burndown do? The smoothing takes place always, I mean at least for specific activities, right? When the capacity is turned off, and activities are smoothed, during the off period of the capacity, the capacity is still charged, right?
Thanks for sharing. Why the copilot is not incorporating SynaspeML code instead of scitki-learn library? Once the data volume becomes large, scit-kit learn library will not work efficiently the way it needs to be, at the end the DataFrame is based on pandas not Apache DataFrame. Any suggestions on that?
Excellent question. We're working on improving our integration and native awareness of Fabric capable libraries such as SynapseML and you will continue to see those improvements emerge as Copilot progresses this year. Watch this space!
Clarification: we were planning to switch to the Microsoft Fabric www.youtube.com/@MicrosoftFabric channel, but we have finally decided to stay here. We will continue delivering more content for our nearly 13k loyal viewers. Thank you!
I like this style of demo breakdown where we're not treated like morons :) We can all read the microsoft learn website. Here we dig into each section. From this along I feel I am able to get work done. Thank you
I tried fabric last summer when it came out and deemed it a beta at that point. Now its a year on, why should I move from azure synapse and power bi to fabric?