Тёмный

Data Scans and AI for Data Catalogs/Fabrics (Dataplex & GPT) 

Nodematic Tutorials
Подписаться 3,3 тыс.
Просмотров 431
50% 1

Learn how to leverage metadata at scale using Google Cloud's Dataplex, AI, and automation for data discovery, search, control, and management. In this hands-on tutorial, we dive deep into the world of metadata management using Dataplex, while also exploring how generative AI can help automate metadata creation and enhance data discovery.
Free Trial Diagram Tool: softwaresim.com/pricing/ ("RU-vid24" for 25% Off)
GitHub Repository: github.com/nodematiclabs/gena...
If you are a cloud, DevOps, or software engineer you’ll probably find our wide range of RU-vid tutorials, demonstrations, and walkthroughs useful - please consider subscribing to support the channel.
0:00 Conceptual Overview
1:11 Data Fabric Overview
3:21 Code Review
5:54 Console Walkthrough

Наука

Опубликовано:

 

28 июл 2024

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 2   
@tnabizade
@tnabizade 7 месяцев назад
Fantastic video. So that makes sense if you have metadata generated by the applications and data transformers available in the analytical data layer. How can we address the problem space, when there is not metadata generated, but(1) there are exposures on top of the data assets on reporting/visualisation tools with some context / business case explanation/metric? Can we marry those two sources to get metadata, at least for review purposes?
@nodematic
@nodematic 7 месяцев назад
It's great to hear that you found the video interesting! For situations where metadata is not explicitly generated by applications or data transformers, but there is contextual information available from reporting or visualization tools, yes, you can marry the disparate metadata sources as long as the metadata is exposed in those external tools through some sort of interface or API. Dataplex is agnostic to the source and structure of metadata, so you'd just need some sort of metadata ETL pipeline to extract and then load that metadata (possibly with transformations and NLP/GenAI/etc.). I don't believe there are any tools that do this in a turnkey way - you're probably writing Python, optionally through some pipelining framework (e.g., PySpark or Beam).
Далее
Получилось у Миланы?😂
00:13
Просмотров 1,9 млн
Google's DOCUMENT AI - Gain CONTROL of your PDF docs!
9:21
What are AI Agents?
12:29
Просмотров 87 тыс.
Create Training Data for Finetuning LLMs
22:29
What is Data Catalog?
3:25
Просмотров 29 тыс.
How to Use ChatGPT as a Financial Analyst
5:19
Просмотров 3,1 тыс.
Google Releases AI AGENT BUILDER! 🤖 Worth The Wait?
34:21
7 AI Tools That WILL Make You RICH
12:48
Просмотров 2,4 млн