Why is Vertipaq so fast? Part 2: Columnar database

Подписаться 138 тыс.

Просмотров 9 тыс.

50% 1

Why is Vertipaq so fast and what does it mean that it is a columnar database?
In this video, we will go through what it means that Vertipaq is a columnar database and why performance is so good.
In previous video we cover data compression:
When we import data in Power BI, the Vertipaq database will try with a series of algorithms, to compress the data as much as possible and the best way possible so it is easy and fast to query it with DAX.
In a previous video, • What is Vertipaq and h... we walked through the main known things that Vertipaq does to compress the data. Here are the methods used, not necessary in that order:
1. Dictionary or Hash compression: It creates a dictionary for the columns stored as strings (text)
2. Value encoding: It will codify the columns stored as numbers to make them as small as possible
3. Run Length Encoding (RLE): Values that are the same in consecutive rows will be stored as a single data value and counted.
After you have seen this video, I recommend you to go back to the video I did on Monday where I go through a specific case on a google analytics report.
• Analyze memory usage i...
Looking for a download file? Go to our Download Center: curbal.com/don...
SUBSCRIBE to learn more about Power and Excel BI!
/ @curbalen
Our PLAYLISTS:
Join our DAX Fridays! Series: goo.gl/FtUWUX
Power BI dashboards for beginners: goo.gl/9YzyDP
Power BI Tips & Tricks: goo.gl/H6kUbP
Power Bi and Google Analytics: goo.gl/ZNsY8l
ABOUT CURBAL:
Website: www.curbal.com
Contact us: www.curbal.com/...
************
************
QUESTIONS? COMMENTS? SUGGESTIONS? You’ll find me here:
► Linkedin: goo.gl/3VW6Ky
► Twitter: @curbalen, @ruthpozuelo
► Google +: goo.gl/rvIBDP
► Facebook: goo.gl/bME2sB
#SUBSCRIBE #CURBAL
#DAXFRIDAYS #CURBAL #DAX #POWERBI #MVP

Опубликовано:

1 окт 2024

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист

Посмотреть позже

Комментарии : 17

@EminUzunN 6 лет назад

Di di di di :) when you have bigger table then it becomes an issue :) Did you start to get drama lectures? It was amazing ;)

@CurbalEN 6 лет назад

This is made for bigger tables, really powerful stuff! I am practicing ;) /Ruth

@rrrprogram8667 6 лет назад

Naive question.... Logically columnar database looks first choice of database... Then why in first place did we have row database.... All the database should have been column database from first... Why did they go for row database

@CurbalEN 6 лет назад

I am not an expert in this so this is my understanding, if anyone else is more versed in databases, please chip in :) Ok, columnar databases are fairly new technology developed to cope with the higher data loads in modern times. I believe there were developed by MIT and Microsoft adopted the technology a few years back. As you saw in the video, columnar databases are faster for querying but for write operations (INSERT/ UPDATE) they can be slower since writing to a row requires seeking to each column for an insert or multi-column update. So row databases are still used to stored data and columnar to query it. Hope this helps! /Ruth

@SaiKumar-rg9jt 6 лет назад

Hi clurbal, nice video, I created Tabular Model and then used in powerbi desktop. After I using the table visualzation in powerbi desktop. I getting error like could not the data for the visuals. But if I use matrix it is working fine. My client requirement is table visualzation only. Why I getting this error. Can you please help me out?

@CurbalEN 6 лет назад

Hi Sai, More details are needed to troubleshoot your problem. Please post the details in the power bi community to get more help :) /Ruth

@prashantiyer7 4 года назад

Why will it not take ship name column for consideration, it also has the record for Quick stop.?

@andrewstennett5769 4 года назад

Very easy to understand. Thanks so much

@onyekaekweh8681 3 года назад

Hello, one quick question. Is vertipaq automatically installed in Power BI or it has to be purchased separately? And it the compression of document done manually or the engine does it automatically?

@CurbalEN 3 года назад

Hi, It comes with the product and the engine does everything:)

@rrrprogram8667 6 лет назад

Another good video

@CurbalEN 6 лет назад

Thanks :) /Ruth