Тёмный

Synapse Analytics - Querying Delta Lake with Serverless SQL Pools 

Advancing Analytics
Подписаться 32 тыс.
Просмотров 15 тыс.
50% 1

Back in the dawn of time, when the Azure Synapse Analytics preview first came out, we talked a lot about how great Serverless would be when it could query delta. It's taken longer than we thought, but we can finally query delta tables using the whizzy, super fast tool... but how efficient is it?
In this video, Simon delves into the preview delta functionality, looking at some common tasks when querying Delta and seeing what holes still exist in the preview.
More info is available on the preview here: docs.microsoft.com/en-us/azur...
As always, don't forget to like & subscribe - and let us know what you think!

Опубликовано:

 

6 авг 2024

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 17   
@drummerboi4eva
@drummerboi4eva 2 года назад
nice video, clearly explains the value of serverless sql pools
@EngineerNick
@EngineerNick Год назад
Thankyou for the video :) I was super excited to try this feature, but turns out you cant do time travel queries from the SQL serverless ;( For me that really makes me question if delta is worth the extra complexity in synapse.
@madhur6504
@madhur6504 3 года назад
Hi Simon,Could you please advise if we should configure gateway when we are loading data from azure synapse (in cloud)
@lukasu-ski4325
@lukasu-ski4325 2 года назад
gateway between what? Synapse and ...? If you have an ADLS then just create a linked service.
@colinrippey1723
@colinrippey1723 3 года назад
Hi Simon, want to say again all of your videos are brilliant! Do you know if Synapse will add support for Delta ZOrdering and/or bloomfilter indexes? If Synapse does add support do you think that SQL On Demand will also make use of these additional Delta on disk artifacts?
@bolisettysunil
@bolisettysunil 3 года назад
Hi @Simon - I have question, do you know if querying Delta Lake files using Synapse Analytics serverless sql pool is supported ?
@lukasu-ski4325
@lukasu-ski4325 2 года назад
Isn't it what he shows in the video?
@crazybauns
@crazybauns 3 года назад
hi Simon, can we use delta tables as source for SSAS? i want to build a tabular model but cant connect to delta tables Can this be done?
@lukasu-ski4325
@lukasu-ski4325 2 года назад
Maybe you could create views or external tables using Synapse serverless and build AAS on top of it? It wouldn't be so expensive I suppose.
@darryll127
@darryll127 3 года назад
How is this working or going to work with the Unity Catalog instead of reading from the Lake w/o it? Is the answer Delta Sharing? Or something else?
@AdvancingAnalytics
@AdvancingAnalytics 3 года назад
Hey Darryll! No sight yet of how Synapse will be able to integrate with Unity Catalog, Delta sharing could be an option, further things with Purview might be, fairly up in the air right now! Si
@msr_atpeace
@msr_atpeace 2 года назад
hi simon , could you please explain about the creation of delta table / files which is generated from delta files by applying some sql over it.
@ManishSingh-if9nj
@ManishSingh-if9nj 2 года назад
Hi Pal ..Thanks for such a informative video ..We are using serverless pool in Synapse platform ..Cost was one of the reason to choose serverless pool ..Now realizing it has got lot of limitation .1 Dynamic data masking not possible with serverless 2. all prebuild DMV you cant run on serverless ..3. Can't run script to do Workload Management ..Do you have any suggestion ..
@sashankpappu2773
@sashankpappu2773 2 года назад
That should be controlled and not be to considered beyond silver zone . This way we ignore those columns by being exposed
@AndreasBergstedt
@AndreasBergstedt 3 года назад
1st again :)
Далее
Azure Synapse Analytics - Lake Database Map Tool
20:46
I Built 3 SECRET Rooms In School!
33:34
Просмотров 13 млн
Наташа Кампуш. 3096 дней в плену.
00:58
Я НЕ ОЖИДАЛ ЭТОГО!!! #Shorts #Глент
00:19
Databricks, Delta Lake and You
48:02
Просмотров 19 тыс.
Synapse Espresso: Introduction to Delta Tables
10:55
Просмотров 13 тыс.
Synapse Espresso: When to use Serverless SQL Pools!
7:26
I Built 3 SECRET Rooms In School!
33:34
Просмотров 13 млн