Тёмный

Explaining what a Lakehouse is! 

Guy in a Cube
Подписаться 454 тыс.
Просмотров 37 тыс.
50% 1

You've probably heard the term lakehouse with various services like Azure Synapse Analytics. But what actually is a lakehouse? And why is it different from a data warehouse?
📢 Become a member: guyinacu.be/me...
*******************
Want to take your Power BI skills to the next level? We have training courses available to help you with your journey.
🎓 Guy in a Cube courses: guyinacu.be/co...
*******************
LET'S CONNECT!
*******************
-- / guyinacube
-- / awsaxton
-- / patrickdba
-- / guyinacube
-- / guyinacube
-- guyinacube.com
**Gear**
🛠 Check out my Tools page - guyinacube.com...
#PowerBI #GuyInACube

Опубликовано:

 

28 сен 2024

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 38   
@esteban-alvino
@esteban-alvino 6 месяцев назад
It's a very nice talk with a lot of energy. That is contagion; it draws a smile from me. Thanks guys
@brianengelbrechtandersen9435
We have been using Data Lakehouse mostly with sql serverless for around a year now and it works very well for our customers.. We have to think differently when designing the ETL/ELT but basically we still end up with a snowflake schema and great performance. However, it requires a tool like Power Bi premium for caching data bc of the rather slow and unpredictiable latency from the serverless.
@dagg497
@dagg497 5 месяцев назад
Yup we lost the fast data retention of an SQL server and instead have to deal with parquet file conversions..
@lausmaja
@lausmaja 10 месяцев назад
Great overview guys. Love it!
@definitelynorandomvideos24
@definitelynorandomvideos24 Год назад
Great Video, at my company we are currently trying to identify which architecture is the best to unify the many data silos we have. Looks like I can show a possible solution ;)
@johnnyw5627
@johnnyw5627 Год назад
When the Data Warehouse and the Data Lake went out for a few beers... was it in Belgium?
@jamieclarke2694
@jamieclarke2694 Год назад
Where else? 😅
@spilledgraphics
@spilledgraphics Год назад
where does the concept of datamarts (not Power BI datamarts) fit into this combo of data lakehouse?
@WilliamRockseo
@WilliamRockseo 11 месяцев назад
Amazing information, Thank You
@matheww9944
@matheww9944 Год назад
Was that you Patrick on the "Power BI Update - October 2022" ? :)
@7anishok390
@7anishok390 Год назад
Hi Please help me. I have created an external table in the synapse lake database, Now I like to load the records from the external table into the dedicated SQL pool table. Please advice on the procedure.
@SetYourBarTo10
@SetYourBarTo10 Год назад
I wonder if the increase in remote work impacted naming conventions? …data lakes…data streams…lake house…I am started to feel like someone has a better view while they work.
@Cero_GT
@Cero_GT Год назад
Neat. We’ve been taking this approach for a couple years now but didn’t give it a fancy name.
@dagg497
@dagg497 5 месяцев назад
Yeah Fabric is nothing new to me... Data factory and Synapse existed 3years ago.. Sem-structured data storage alternatives as well and Apache Spark and Cosmos DB
@kevinruckstuhl2378
@kevinruckstuhl2378 Год назад
More like data swamp
@dagg497
@dagg497 5 месяцев назад
Yeah. I liked Storage Blobs, Data Factory into a Synappse or Azure SQL Database. Lakehouse and parquet is very dependant on a coded scala/python framework and makes every step 10x more confusing and code dependant. We are back to SSIS 2005 and have to code an ETL framework in C+ or instead of working in BI moving into fullstack coding instead..
@MichaelGreen831
@MichaelGreen831 6 месяцев назад
I would have loved to hear the problem DW has that DL and DLH solves. I only heard “large” data in contrast to DW historical data.
@dagg497
@dagg497 5 месяцев назад
Personally i don't like DLH all that much due to the slow loading of new data into parquet and the fact you read files instead of SQL tables with history. Who would've known merging 10'000parquet files would be slower than an RDB database?
@rohansrivastwa827
@rohansrivastwa827 Год назад
Can your audio be more clear with less base and noise?
@Al-vl3tp
@Al-vl3tp Год назад
Yes, we are building a data lake house with the structured data transformed pointing to redshift and all of the unstructured data pointing to the S3 buckets. But the data scientists can't query the data in Athena and point the data to Power BI for analytics and data visualizations.
@Expateer
@Expateer 5 месяцев назад
Q: What happens to all those BI reports with their virtual schemas when the "Silver Layer" data structure changes?
@brianxyz
@brianxyz Год назад
What is a Databrick? TIA
@benhalicki9749
@benhalicki9749 Год назад
Microsoft implementation of Apache Spark. Connects to the data lake etc but for in memory, clustered computing. Geared towards big data analytics.
@martiruda
@martiruda Год назад
funny this is called data constelation, someone added lakehouse just to sell training courses I bet.
@juliangimbel1583
@juliangimbel1583 Год назад
Great video, but using the Azure machine learning icon for the data lake is confusing for me 😅
@osPA78
@osPA78 Год назад
We are looking to implement a DW, DL, and/or DLH where I work so I am looking EXTREMELY FORWARD to those videos. Thank you!!!
@nourlchann
@nourlchann 7 месяцев назад
Patrick really likes data LMAOOO
@simon2093
@simon2093 Год назад
Yep, now building out a company wide lakehouse - early days at the moment. But this thing is nuts fantastic. Especially loving delta tables.
@dagg497
@dagg497 5 месяцев назад
I hate Delta parquet.. 😂 Convert files upon stahing, build delta logic and shit.. Then everything sucks when handling upserts and deletion.
@shilpapathi
@shilpapathi Год назад
Great content and engaging, worth every minute.
@beverlywesterkamm-wallrauc5808
@beverlywesterkamm-wallrauc5808 2 месяца назад
This is exactly what we use. It is great for ad hoc analysis as well.
@mwaltercpa
@mwaltercpa Год назад
Chris Wagner is pointing us toward Synapse Analytics, I got a book and would love to also watch GIAC videos!
@kurrysamir
@kurrysamir Год назад
Great content as always! Awaiting the slowed down version with some hands!!
@premcst
@premcst Год назад
Waiting for the slow downed version Patrick !!
@Milhouse77BS
@Milhouse77BS Год назад
But... what about...a...: "Lake Database" :)
@minathanh7072
@minathanh7072 Год назад
Great video, thank you!!!
@surfh3r0
@surfh3r0 Год назад
interesting! thanks!
@1yyymmmddd
@1yyymmmddd Год назад
Data warehouses are dead, aren't they?
Далее
What is this delta lake thing?
6:58
Просмотров 59 тыс.
Barno
00:22
Просмотров 569 тыс.
Watermelon magic box! #shorts by Leisi Crazy
00:20
"Когти льва" Анатолий МАЛЕЦ
53:01
TEAM SPIRIT: НОВЫЙ СОСТАВ. SEASON 24-25
01:31
Why a Data Lakehouse Architecture
8:02
Просмотров 60 тыс.
Understanding OneLake within Microsoft Fabric
10:29
Просмотров 73 тыс.
Data Lakehouse: An Introduction
25:00
Просмотров 20 тыс.
Microsoft Fabric Lakehouse
16:39
Просмотров 16 тыс.
What does Microsoft Fabric mean for Power BI?
5:56
Просмотров 81 тыс.
Advancing Fabric - Lakehouse vs Warehouse
14:22
Просмотров 25 тыс.
Barno
00:22
Просмотров 569 тыс.