Data Pipelines Explained

Подписаться 775 тыс.

Просмотров 139 тыс.

50% 1

Learn more about Data Pipelines → ibm.biz/BdPEPM
Data is a lot like water; it often needs to be refined as it travels between a source and its final destination. That’s where data pipelines come in - they merge, filter, and summarize raw data, providing the end user with a clean product to analyze. Luv Aggarwal, a Data Solution Engineer at IBM, explains how several processes often embedded within data pipelines - like ETL, replication, virtualization, machine learning, and batch processing - help generate actionable business intelligence.
Get started with IBM Cloud free of charge → ibm.biz/BdPEPS
Subscribe to see more videos like this in the future → ibm.biz/subscribe-now
#Data #DataPipelines #DataAnalyses #DataIntegration #BusinessIntelligence #ETL

Опубликовано:

15 июн 2022

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист

Посмотреть позже

Комментарии : 60

@Geeee33 Год назад

Now that's one of the best explanations with the simplest examples for data pipelines! Thank you

@vishalk02 2 года назад

Explained simply & effectively. I would like to see more elaborate content on big data & data science fields.

@balakrishnanr7149 Год назад

Very precise explanations with simple examples. 👏👏👏

@victorgromov1548 Год назад

Great explanation with easy to follow examples!

@well9851 Год назад

Greatly explained. Easy to understand and clearly.

@emrepiristine7967 11 месяцев назад

Thank you very much, it was the most explanatory and beautifully explained video I've ever watched.

@saikiranmahajan5981 Год назад

Awesome Luv! You made it simple for the Sales guys.

@peterluo1776 Год назад

This is some good work. Well done. Thanks for sharing 👍

@ChanceMinus Год назад

Thank you. Extremely helpful.

@Flankymanga 2 года назад

I would like to know how the Data Virtualization works. At first i thought that it is just "faking" a real data source in order to test data pipeline configuration?

@Manav-zo9bn Год назад

such a Quality content . Very well explained

@LeonidAndrianov Год назад

Nice analogy and explanation!

@keviin077 Год назад

Thanks for the amazing explanation

@alexpishvanov736 2 года назад

I think, Data Virtualization would be a great topic for the next educational video from this instructor.

@carsonmasterson 2 года назад

Hey Alex -- check this out: ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-2XB4UaBIvNI.html

@1apocalyps Год назад

Yes I agree. When I hear virtualization, I get locked into is it based off data models, Is it "place holder data"? I'm assuming we have no information about the data without the transformations

@davidallyn1818 6 месяцев назад

Beautiful tutorial!!

@harshalh3513 Год назад

Greatly explained , would be more great if you could explain a few more processes to build pipelines in a breif

@alaad1009 9 месяцев назад

Excellent analogy

@user-uh6vk2zl1k Год назад

This is excellent!

@msbthedataengineer 2 года назад

Good Explanation!!.....

@suck-myballs1152 Месяц назад

I love these IBM videos. No organizations simplifies things the way they do.

@hasanmougharbel8030 Год назад

Hey dear, god bless your efforts in this channel. I have a general enquiry as a new sql learner. How could i create a pipeline to extract and load data from existing accounting program into our SQL server instances. How can i know if the export mechanism in the software permits me to undertake this extraction process, and how can i know if an application have an api? Thanks for taking care of my enquires. Looking forward to gain more knowledge from you

@surabhijagadish5210 2 месяца назад

Awesome explaination.

@Eyenn_n Год назад

Awesome video!

@uwalakab 2 года назад

Great analogy. 👍🏿👍🏿👍🏿

@dabdoube92 2 года назад

@Trendykid 11 месяцев назад

Cant wait for data virtualization video.

@f-alzahraa_Ahmed Год назад

thanks, realy usful

@claudiusdsouza2379 Год назад

well explained

@obiradaniel7391 2 года назад

Nice video, just when you think you have heard it all, here comes "Data Virtualization". If possible that could be elaborated more.

@kikitauer 2 года назад

My company uses data virtualization when rendering a final picture from our car configurator. It doesn't physically download the pictures, it just calls for the chosen color, wheels, accessories interiors etc and caches them - stores them in the temporary storage.

@pritamdaware9674 Год назад

Does this technology use all automobile industry?

@aniruddhabhosale6715 5 месяцев назад

Explained really well .👊🔥💖✨💯

@chuachua-hj9zd 9 месяцев назад

Very good example quote using examples

@babasahebmane3473 Год назад

Well explained

@explorertribe Год назад

Data virtualization is something looks interesting

@jpmccrossan6807 День назад

Wonderful video and explanation- I'm just trying to work out, if he's writing on glass, how is he able to write backwards so well- for us to view it as 'non reversed'. *Edit: Got it- flipped video :)*

@pudgewars6447 2 года назад

I would like to know how does your screen board work? Are you writing iin inverted xd?

@Lilwar195 2 года назад

I believe they are writing normally but the video is inverted post production

@Tordekh 4 месяца назад

ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-wCOuu0-o5YI.html Lightboard videos

@evanshlom1 2 года назад

I WILL IMPLEMENT STREAMING MACHINE LEARNING AT WORK VERY SOON

@dxwallace55 Месяц назад

Off topic, but how are you typing backwards/reverse?

@Helloimtheshiieet 9 месяцев назад

In a roundabout way this is why ERP systems are so popular

@vansf3433 Год назад

Your l English language is ambiguous because streaming data and transforming data are 2 different process. Streaming data is to make it concise or compacted, while transforming data can be changing it into another form to make it suitable for a certain purpose

@splashoui3760 8 месяцев назад

How this kind of videos are made? Typing to the screen and it shows up on camera? What is the tech behind this?

@IBMTechnology 8 месяцев назад

See ibm.biz/write-backwards

@splashoui3760 8 месяцев назад

Thanks!@@IBMTechnology

@faisalk.7520 Год назад

How was this video made? How are the words not backwards lmao. This is crazy

@IBMTechnology Год назад

Search on "lightboard videos"

@rohannair4039 6 месяцев назад

how is he writing in reverse

@user-xx1sw1dj9o 8 месяцев назад

yooo i just relaized this man just wrote all those letters and words backwards so we can see it normally....... right ? or is this some camera trick

@IBMTechnology 8 месяцев назад

See ibm.biz/write-backwards

@ScriptureFirst Год назад

Whiteboards suck. Spring for the full blown motion graphic. Too slow (even at 2x) didn’t finish

@samwelemmanuel7976 8 месяцев назад

My only question is why do they always ask lefties to do these videos?

@IBMTechnology 8 месяцев назад

See ibm.biz/write-backwards --they're actually righties.

@dharanik7530 10 месяцев назад

worst experience guy

@vansf3433 Год назад

Your explaining chart is nonsense because you do not need to clean water from a lake or river for agricultural activities

@temitopekade590 Месяц назад

Appreciate efforts. This explanation is basic and it does not mean there are no other use cases like the agriculture you mentioned. He is talking obout end use of water in this case. Majority of us understood this. Be more positive!