Тёмный

AWS Data Engineer Project | Building a Data Pipeline on AWS 

learn by doing it
Подписаться 23 тыс.
Просмотров 6 тыс.
50% 1

Опубликовано:

 

30 сен 2024

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 26   
@kunalnathjogi521
@kunalnathjogi521 19 часов назад
thanks brother
@idontevenuseyoutubebro
@idontevenuseyoutubebro 22 дня назад
if we want to convert from json/csv to parquet same procedure just seleect different conversion type?
@learnbydoingit
@learnbydoingit 22 дня назад
Yes
@mukkaraganeshkumar2251
@mukkaraganeshkumar2251 6 месяцев назад
Thank you very much for your videos it's very helpful for me, Can you please let me know that aws glue will be charged even if we are using a free tier account
@harini2933
@harini2933 6 месяцев назад
Hi, Your videos are easy to understand and learn. Thanks a lot for posting Please make some more videos on Azure,SQL,PowerBi and PySpark 🙂
@Anna_Tamil
@Anna_Tamil Месяц назад
Hi bro can you make video for step function
@mandadiashok
@mandadiashok 6 месяцев назад
Hi Sir, I have watched your videos; it's very help full. I have a quick question, why we need go for lambda to trigger the job, we have option on glue event trigger right? Any specific reason behind this. Thanks.
@learnbydoingit
@learnbydoingit 6 месяцев назад
There are multiple ways of doing .
@BOSS-AI-20
@BOSS-AI-20 Месяц назад
8:08 why you create new role for lambda function ? why don't you use previous IAM role that you created for Glue in which you attach all policies for Glue, lambda and S3 ?
@learnbydoingit
@learnbydoingit Месяц назад
U can use the existing one also
@BOSS-AI-20
@BOSS-AI-20 Месяц назад
@@learnbydoingit Thanks
@chitrarekhatiwari6629
@chitrarekhatiwari6629 7 месяцев назад
Thank you so much for this video
@learnbydoingit
@learnbydoingit 7 месяцев назад
Welcome
@deepanshuaggarwal7042
@deepanshuaggarwal7042 2 месяца назад
We are directly writing code in AWS lambda. But how companies manage it means can we use github sync here so that we can maintain code changes history also?
@learnbydoingit
@learnbydoingit 2 месяца назад
Yes we use GitHub also
@deepanshuaggarwal7042
@deepanshuaggarwal7042 2 месяца назад
@learnbydoingit do you have any video how we can push code from github to lambda ?
@pranjuyadav9571
@pranjuyadav9571 2 месяца назад
I got error in cloudwatch log. In log streams it is saying- " The specified log group does not exist" What is means ??
@ravitejakavati1282
@ravitejakavati1282 6 месяцев назад
Thanks alot for the video. Very helpful . looking for some more practical projects. Can you please provide your mail id for contacting you.. Thanks..
@therestfulmedia363
@therestfulmedia363 7 месяцев назад
We are eagerly waiting your videos sir…! How many total videos will this playlist have ? Any idea
@learnbydoingit
@learnbydoingit 7 месяцев назад
Will cover complete hope u have completed previous video already
@kalakritibysanskriti
@kalakritibysanskriti 7 месяцев назад
Thanks
@kakasahebrakde3981
@kakasahebrakde3981 7 месяцев назад
Please make video on redshirt
@learnbydoingit
@learnbydoingit 7 месяцев назад
Will do that we are going from basic to advance
@kakasahebrakde3981
@kakasahebrakde3981 7 месяцев назад
Okay
@praveerpratap5278
@praveerpratap5278 7 месяцев назад
Hi , I have a doubt I wanted to make a project related to weather data which is in csv file , I accessed the data from csv file using kafka from producer to consumer that I have done. But after that I wanted to put that data into s3 then wanted to so transformation into data like preprocessing using pyspark then store into another s3 bucket and do the Visualization of that weather data or may try ML for forecasting how can I do that using aws and also want to automate whole process. Can anyone help me out.
@learnbydoingit
@learnbydoingit 7 месяцев назад
Use databricks
Далее
Top AWS Services A Data Engineer Should Know
13:11
Просмотров 167 тыс.
DAXSHAT!!! Avaz Oxun sahnada yeg'lab yubordi
10:46
Просмотров 469 тыс.
11 ming dollarlik uzum
00:43
Просмотров 1,3 млн
Real Time AWS Data Engineer Project
17:29
Просмотров 8 тыс.
AWS Data Engineer Project | AWS Glue |  ETL in AWS
17:58