No video :(

Mirroring Snowflake in Fabric Supercharged Analytics at No Extra Costs

Подписаться 48 тыс.

Просмотров 2 тыс.

50% 1

Microsoft Fabric offers an end-to-end SaaS analytics solution; however, the world is using all kinds of data sources in its implementation. Mirroring is a new functionality in Fabric that allows customers to keep their data wherever they are, but then they can use Fabric analytics solutions with the same speed and performance as if their data were in Fabric. Best of all, this won’t cost extra. If you wonder what it is and how it works, read this article.
Read my article about it here: radacad.com/mi...

Опубликовано:

18 авг 2024

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист

Посмотреть позже

Комментарии : 21

@ginameronek8068 3 месяца назад

A deceptively simple demo of something that is bound to fundamentally boost adoption of Fabric. I'm thinking of all the pain points this eliminates, from data plumbing side to being able to reassure users that the data is available. Excellent to see the querying info on the Snowflake side as proof too, will be interesting to see what the admin side of this looks like over time within Fabric.

@RADACAD 3 месяца назад

Thanks Gina! Good to see you here. Indeed this feature makes a difference

@Nalaka-Wanniarachchi 4 месяца назад

A Game changer .Nice explanation Reza. By this approach SF can serve as a storage layer and for compute,etc customers can use Fabric..

@RADACAD 4 месяца назад

Yes, you are right. Customers can keep their data in Snowflake and still leverage the powerful analytical features of Fabric.

@DavidWilsonNZ 4 месяца назад

Hey there Reza... You've made a comment in this video about Direct Query being slow... and yes - that was my perception. Last Friday I loaded 45M rows into a table in Snowflake and connected to it with with a Published Power BI report via DQ. I've been completely below away by the outstanding performance when producing a Matrix visual across 9 months of data. IN my view - with this example the outstanding performance of Direct Query completely and utterly out weighs the benefits of refreshing the data on a regular basis. The refresh alone is 40+ minutes... and will only grow every month. Yes I could use incremental refresh - but why when the DQ performance is so outstandingly fantastic.

@RADACAD 4 месяца назад

Hi David That is interesting indeed, I haven't seen DirectQuery performing fast unless a good database table optimization is done on the data source, maybe that is the case? some column store clustered indexing etc on the source?

@DavidWilsonNZ 4 месяца назад

@@RADACAD No tuning has been done at all. I did create a view with a select *, cast( to numeric for one column) from db.schema.table The data has been loaded from csv files from Azure BLOB storage. Very stunning, happy to do a demo for you..

@DavidWilsonNZ 4 месяца назад

@@RADACAD No special treatment or optimisation anywhere. And the warehouse within snowflake is a small one.

@bladerunnerisback 4 месяца назад

Thanks for the video! We use Snowflake and can't wait to start testing it. Next great thing will be Direct Lake in Power BI desktop

@RADACAD 4 месяца назад

You're welcome. Let me know your experience with it.

@johansantacruz6464 4 месяца назад

Thanks for this update!

@RADACAD 4 месяца назад

You're welcome!👊👊

@fr1sket363 3 месяца назад

They still have a few bugs to work out, i think larger snowflake databases seems to have some issues with mirroring, i've raised these through a support ticket and they are currently with the product team. I'm a little disappointed as i can really use this feature now, i hope it's fixed soon.

@tahmidyusuf6674 4 месяца назад

Hi Reza, thanks for the information. I’ve checked in my P1 capacity (in Australia) and Mirroring options haven’t been available yet. Moreover, will it be possible to access through snowflake SSO login?

@RADACAD 4 месяца назад

That is strange. Because Australia supports the mirroring based on this link: learn.microsoft.com/en-us/fabric/database/mirrored-database/snowflake-limitations If by Snowflake SSO you mean users to be able to access the part of data in Snowflake that they are authorized to see (the security to flows through from Snowflake into Fabric); that is not possible at the moment. the security rules have to be re-created in Fabric. But if you mean that we use Snowflake user account to set up the mirroring as a stored credentials, it is possible, like what I showed in this video

@gauravdevgan79 2 месяца назад

Hi, where is the snowflake environment for this demo. Is the snowflake environment hosted in aws or azure? does it work across cloud?

@RADACAD 2 месяца назад

It won't matter what Snowflake environment for Mirroring It uses the APIs and CDC for it

@eekshitchawla3637 2 месяца назад

Hey Reza, can you please suggest if there's a way to mirror data from Athena and BigQuery, need an urgent solution for optimising the cost

@RADACAD Месяц назад

At the moment Mirroring is only possible for 3 sources (Snowflake, Azure SQL DB, and Azure cosmos db). for other sources, you have to develop the data integration using Data Pipelines and Dataflows yourself.