Say goodbye to messy JSON headaches with VARIANT

Подписаться 110 тыс.

Просмотров 2,5 тыс.

50% 1

Try it out today on Databricks: docs.databricks.com/en/semi-s...
Read more about it on our blog: www.databricks.com/blog/intro...
If you're curious about the implementation check out the talk: • Variant Data Type - Ma...
Or read about it on GitHub: github.com/apache/spark/blob/...

Наука

Опубликовано:

23 июн 2024

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист

Посмотреть позже

Комментарии : 14

@afrikaniz3d 4 дня назад

Only note for these videos, since they're not Shorts, ia that it would be more beneficial to use the full wide (1920 x 1080) format, so it's more readable at all resolutions.

@Databricks 3 дня назад

I completely hear you, trying to figure out the best way to film for multiple platforms at once when some define 'short' as

@TheDataArchitect 4 дня назад

That's awesome.

@matthiasmueller9340 4 дня назад

How can I specify the required runtime version when using serverless sql warehouse?

@Databricks 4 дня назад

Variant types will be coming to serverless early/mid July, no need to select a runtime - Holly

@gravenguan 3 дня назад

How did parse_json handle schema evolution and from my kowledge, prod table do not recommend parse schema on the fly, it's more safer to define schema first

@Databricks 3 дня назад

I agree, but with a lot of JSON data you don't know the schema upfront and so can't define it. It's worth noting this is different from inferring the schema which looks at the first 1000 rows and is brittle to upstream changes - Holly

@gravenguan 3 дня назад

@@Databricks We used parse_json for dev and exploration purposes as well, thank for the clarification

@Databricks 3 дня назад

@@gravenguan No worries! Hope this clarifies for other users too

@TheDataArchitect 3 дня назад

Who's the speaker?

@Databricks 3 дня назад

Holly Smith - FYI it's also me in the comments for my videos so fire away with any technical follow on questions - Holly

@TheDataArchitect 2 дня назад

@@Databricks Awesome thanks

@nagendrasrinivas-cj7sr 3 дня назад

this is clearly copied from snowflake

@Databricks 3 дня назад

Variants in their various forms have been around for many decades. We're big fans of open source so anyone can use the implementation in other projects or products.