27. Vacuum Command in Delta Table

Подписаться 18 тыс.

Просмотров 8 тыс.

50% 1

Follow me on Linkedin
/ bhawna-bedi-540398102
Instagram
bedi_foreve...
Vacuum a Delta table (Delta Lake on Databricks)
Vaccum Removes the files no longer referenced by a Delta table(Clean up files associated with a table)
You can remove files no longer referenced by a Delta table and are older than the retention threshold by running the vacuum command on the table.
Vacuum is not triggered automatically.
The default retention threshold for the files is 7 days.
Vacuum deletes only data files, not log files.
Log files are deleted automatically and asynchronously after checkpoint operations.
The default retention period of log files is 30 days, configurable through the delta.logRetentionDuration property
Data-bricks hands on tutorials
• Databricks hands on tu...
Azure Event Hubs
• Azure Event Hubs
Azure Data Factory Interview Question
• Azure Data Factory Int...
SQL leet code Questions
• SQL Interview Question...
Azure Synapse tutorials
• Azure Synapse Analytic...
Azure Event Grid
• Event Grid
Azure Data factory CI-CD
• CI-CD in Azure Data Fa...
Azure Basics
• Azure Basics
Data Bricks interview questions
• DataBricks Interview Q...

Наука

Опубликовано:

6 июл 2024

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист

Посмотреть позже

Комментарии : 14

@aritrachatterjee8292 2 года назад

Excellent for giving such a clear understanding of the detailed concepts of Databricks

@sankarkolagani9239 2 года назад

Excellent. I am referring to all your videos, very nice and detailed explanation of concepts. Thank you.

@samk_jg Год назад

Outstanding!!👋

@saikumarjakki3802 Месяц назад

if the vaccum cmd only del the data file and not del the transaction logs then when reading the file using deltalog i will through error for that particular version and cause issue by default it will take the latest version but what if we want read all the version then it will cause issue right . how to del the transaction logs as well for that particular version . can u pls explain it.

@CoopmanGreg Год назад

Very good.

@shalushalini3392 Год назад

Thank You For the details, I have 2 question related to the same. 1. What if the table is very old and no operation has been done recently, Will VACCUM delete all the version files except 1 ? 2. While doing truncate table will it delete older data version and If VACCUM required if we are doing truncate or drop reload the tables

@chaitanyan2725 6 месяцев назад

After deleting the version we can't restore the deleted version file ?? My question was what is vacuum start version & Vacuum end Version. we can recover deleted version file using the vacuum versions???