Тёмный

What Does a Data Engineer Do? Explained Simply 

Darshil Parmar
Подписаться 136 тыс.
Просмотров 13 тыс.
50% 1

Combo Package Python + SQL + Data warehouse (Snowflake) + Apache Spark: com.rpy.club/pdp/yYnEMzLOX?pl...
USE CODE: COMBO50 for 50% off
Learn more about courses here - datavidhya.com/courses
The Data Engineering market is going to cross the $100 Billion mark by 2028, this is the best time to learn about data engineering and start your career, in this video we will understand what a data engineer really do and skills required for data engineering
👦🏻 My Linkedin - / darshil-parmar
📷 Instagram - / datawithdarshil
🎯Twitter - / parmardarshil07
🌟 Please leave a LIKE ❤️ and SUBSCRIBE for more AMAZING content! 🌟
3 Books You Should Read
📈Principles: Life and Work: amzn.to/3HQJDyP
👀Deep Work: amzn.to/3IParkk
💼Rework: amzn.to/3HW981O
Tech I use every day
💻MacBook Pro M1: amzn.to/3CiFVwC
📺LG 22 Inch Monitor: amzn.to/3zk0Dts
🎥Sony ZV1: amzn.to/3hRpSMJ
🎙Maono AU-A04: amzn.to/3Bnu53n
⽴Tripod Stand: amzn.to/3tA7hu7
🔅Osaka Ring Light and Stand: amzn.to/3MtLAEG
🎧Sony WH-1000XM4 Headphone: amzn.to/3sM4sXS
🖱Zebronics Zeb-War Keyboard and Mouse: amzn.to/3zeF1yq
💺CELLBELL C104 Office Chair: amzn.to/3IRpiL2
👉Data Engineering Complete Roadmap: • Data Engineer Complete...
👉Data Engineering Project Series: • Data Engineering Proje...
👉Become Full-Time Freelancer: • Best Freelancer Series...
👉Data With Darshil Podcast: • Podcast Series - Data ...
✨ Tags ✨
✨ Hashtags ✨

Опубликовано:

 

18 май 2024

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 72   
@worldtour666
@worldtour666 18 дней назад
Hi Darshil, Please make a series on AWS cloud server less API and datalake development using python. Where glue jobs should be developed using pyapark, source data must be fetched from msk connectors, upload data in s3, create Iam users, using AWS boto3, unit testing using moto3. Maintain db and tables in lakeformation using lf-tags. Athena automation for visualization. Please make series complete based on programming automation
@pavanparvathanenii4471
@pavanparvathanenii4471 Месяц назад
Wow you explained my job in just 10 to 11 mins in a smoother way. Much appreciated Darshil❤
@DarshilParmar
@DarshilParmar Месяц назад
Glad to hear that
@adilmajeed8439
@adilmajeed8439 Месяц назад
Some complex project on Microsoft Fabric ...
@rishabhrai9282
@rishabhrai9282 9 дней назад
More end to end basic to complex projects using Microsoft Azure Services
@ShyamDeepak-sp1dx
@ShyamDeepak-sp1dx Месяц назад
is this course availabe on web OR app ? Is course can be accessible anywhere ?
@tenet7846
@tenet7846 18 дней назад
Hii darshil may i know please Whas is the duration of apache spark +databricks course??
@dhanushtharun8190
@dhanushtharun8190 23 дня назад
Hey bro books vs online tutorial/udemy course which one is best for beginners to intermediate ❤
@ARACON_DATA_0605
@ARACON_DATA_0605 21 день назад
How to collect data generated from survey websites and derive insights??
@divyeshpatel2463
@divyeshpatel2463 28 дней назад
Can you recommend books on python, sql and linux?
@davebatista8636
@davebatista8636 27 дней назад
aaj sabse pehle is channel ki main main saari videos dekhunga....
@DarshilParmar
@DarshilParmar Месяц назад
hit that LIKE button and let me know what do you want to see next?
@tenet7846
@tenet7846 18 дней назад
Hii darshil may i know please Whas is the duration of apache spark +databricks course??
@sanafondu7743
@sanafondu7743 6 дней назад
I want to join on discord, can you please share invite, older invite seems to be expired
@haripriyap517
@haripriyap517 28 дней назад
I've got aws dva certificate 1 year back, but I didn't worked/practiced on aws. And am planning to switch product based company. Please guide me where to start my learning.
@techtricks1052
@techtricks1052 Месяц назад
this is a good video
@SagarKumar-lf5dg
@SagarKumar-lf5dg 24 дня назад
Hello Darshil Sir, Is it possible to switch career from one domain to another domain. Currently I am in Accenture but want to change my career to another domain...could you please guide me
@PrathameshMawlankar
@PrathameshMawlankar Месяц назад
Hi great information shared as always. Btw did you start taking protein shake and working out? Just curious since you are looking more buffed
@DarshilParmar
@DarshilParmar Месяц назад
Haha I am working out from last 3 years but most of the time I wear long sleeves this tshirt is tight so it makes me look buff
@BishanTamang-rk5ji
@BishanTamang-rk5ji Месяц назад
Love you Brother ❤️
@DarshilParmar
@DarshilParmar Месяц назад
Thank you
@rohittyagi3065
@rohittyagi3065 Месяц назад
great
@vaibhavarora9458
@vaibhavarora9458 18 дней назад
Hi Darshil, I am from a non technical background having BCom(Hons) degree and right now I am having almost 3 years of experience as Data Analyst with skill set of SQL, Power BI and Python (still learning). I have recently left my job and looking for new opportunities for Data Analyst. Also am aspiring for a Data Engineer role in future. I am thinking to get the job first in Data Analyst role and then I'll start learning for Data Engineer. Is this a good way to follow or shall I start preparing immediately for Data Engineer?
@user-gt9vb6xt9d
@user-gt9vb6xt9d Месяц назад
hey darshil is there any way I can get a discount on your 4 course combo as I am a student so it is difficult for me to pay the full fee.Thanks
@DarshilParmar
@DarshilParmar Месяц назад
Please email me at info@datavidhya.com
@keshavgupta6150
@keshavgupta6150 Месяц назад
Great video but next time decrease background music or remove it
@rudroroy1054
@rudroroy1054 Месяц назад
I am curious what is the difference between a data engineer and a business intelligence developer?
@DarshilParmar
@DarshilParmar Месяц назад
www.linkedin.com/posts/darshil-parmar_dataengineer-datascience-dataanalyst-activity-7196031026966495232-gzE3?
@Theparagable
@Theparagable 25 дней назад
I am targeting data engineer role. I have aws solutions architect associate. Lack good grasp over python and sql. Shall I focus on python, sql first or go for aws data engineer associate and databricks cert?
@navneetkummar4811
@navneetkummar4811 14 дней назад
Go with Python and SQL first
@Theparagable
@Theparagable 11 дней назад
@@navneetkummar4811 thank you
@BabeRose6
@BabeRose6 Месяц назад
Hey there, am new to your channel & your study info on Data Engineer and the motivation you give is really appreciated⭐ One clarity/query plz which one is suggestible to set as a career is it Data Analyst or Data Engineer (Azure) plz suggest...
@DarshilParmar
@DarshilParmar Месяц назад
Starting with analyst is much easier than engineering
@subratparida5647
@subratparida5647 22 дня назад
Hey bro; for data scraping selenium is a good option or not
@DarshilParmar
@DarshilParmar 22 дня назад
No, lot of website have bot protection now, not worth doing
@subratparida5647
@subratparida5647 21 день назад
Then what is the good suggestion for web scraping
@DarshilParmar
@DarshilParmar 21 день назад
@@subratparida5647 No web scraping go something else like data analyst/engineer or SDE
@subratparida5647
@subratparida5647 21 день назад
@@DarshilParmar Thank you for your suggestion 😀
@DurgaPrasad-go4gm
@DurgaPrasad-go4gm Месяц назад
Hi sir i have applied for many companies by watching your videos and doing your projects and making changes but donk know where I am lacking behind
@DurgaPrasad-go4gm
@DurgaPrasad-go4gm Месяц назад
drive.google.com/file/d/1hVVoqvitd2wCSFv44f2aVWew2Cbgpg6-/view?usp=drivesdk
@DarshilParmar
@DarshilParmar Месяц назад
Check resume and portfolio projects they are very important
@DurgaPrasad-go4gm
@DurgaPrasad-go4gm Месяц назад
@@DarshilParmar drive.google.com/file/d/1hVVoqvitd2wCSFv44f2aVWew2Cbgpg6-/view?usp=drivesdk
@DurgaPrasad-go4gm
@DurgaPrasad-go4gm Месяц назад
@@DarshilParmar here's my resume sir drive.google.com/file/d/1hVVoqvitd2wCSFv44f2aVWew2Cbgpg6-/view?usp=drivesdk
@DurgaPrasad-go4gm
@DurgaPrasad-go4gm Месяц назад
drive.google.com/file/d/1hVVoqvitd2wCSFv44f2aVWew2Cbgpg6-/view?usp=drivesdk
@Tranics1
@Tranics1 Месяц назад
1view love from Lucknow brother ❤
@DarshilParmar
@DarshilParmar Месяц назад
Thank you!
@niladripramanik8362
@niladripramanik8362 Месяц назад
Hey Darshil I have been in Data engineering field for 1.5 yrs, Is there any research opportunity/ scope in data engineering?
@sunilKumar-ci9vn
@sunilKumar-ci9vn Месяц назад
How you got your 1st job as fresher.?
@Rhly001
@Rhly001 27 дней назад
Hey can you please tell me how you got started with this field.. I'm currently in college and been studying ML/DL mostly but now I'd like to expand my domain.. Is it even worth it and if so then how to I go about it.. Will really appreciate if you take some time and give an in depth response
@niladripramanik8362
@niladripramanik8362 27 дней назад
@@sunilKumar-ci9vn hi it was campus placement only. But the role in company was data engg
@niladripramanik8362
@niladripramanik8362 27 дней назад
@@Rhly001 see if u r already doing Ai ml for a long time, i suggest not to spent time in data engg. But if u want to then sql (all joins and when to use them, then group by , combination of group by and joins, self join, once done with these then windowing functions) - practice from leetcode 50 basic sqls... Python only upto lists.. shell scripting to automate.. Here , mostly u will work on sql only. Python+shell scripting to automate tasks.
@niladripramanik8362
@niladripramanik8362 27 дней назад
​@@Rhly001 bhai youtube is pathetic it's deleting my reply
@shashankpatel634
@shashankpatel634 Месяц назад
Bro... I got all the skills which are you mention in your thumbnail... I will finish my final semester exam in first week of june... And still unplaced... Entry level job pe bhi 3-4years ka experience maang rhe h🙃😭
@DarshilParmar
@DarshilParmar Месяц назад
Try Data Analyst position or get internship
@prathamgupta9256
@prathamgupta9256 28 дней назад
R uh stay in Mumbai ?
@viraj_kadam
@viraj_kadam 28 дней назад
​@@prathamgupta9256 same here mumbai
@divyeshpatel2463
@divyeshpatel2463 29 дней назад
Sir what is the duration of your zero to data engineering course ?
@DarshilParmar
@DarshilParmar 29 дней назад
Recorded content around 50hours for 4 courses with lifetime access, more will be released soon
@shiv8578
@shiv8578 Месяц назад
Who edits your videos
@DarshilParmar
@DarshilParmar Месяц назад
I hired new editor, what happend?
@shiv8578
@shiv8578 Месяц назад
They are good, i mean how they use exact flow diagrams , are they teach persons? Or you have to collaborate with them to make it happen?
@dhanasekarank1743
@dhanasekarank1743 Месяц назад
Bro do you know dbt ?
@DarshilParmar
@DarshilParmar Месяц назад
Yes
@dhanasekarank1743
@dhanasekarank1743 Месяц назад
@@DarshilParmar thank bro, I am runing the dbt models with databricks and I want to know the running time(I am able to see the running time in VS code) but I want see the running time and bytes consumption in databricks for each models. Is this possible bro?
@mayankkrsingh-zq1vj
@mayankkrsingh-zq1vj Месяц назад
I want to connect with you for discount offer? is it possible?
@DarshilParmar
@DarshilParmar Месяц назад
Please email me at info@datavidhya.com
@__nda_channel
@__nda_channel 29 дней назад
Data engineering is not what I think But you are exactly what I thought You keep milking the topic data engineering rather than telling something else on data engineering
@DarshilParmar
@DarshilParmar 29 дней назад
Bro, I have 8 projects on the channel, 130+ videos My goal is to target just beginners and fresh to get started, there is no point in going on advanced level stuff because that won't work in this case 10min series to explain Spark, Airflow, Snowflake Videos on new trends End To End Projects Tutorials there are many things, I need to keep balance between different target audience so that everyone can understand different parts
Далее
Обзор ЛЮКС вагона в поезде
01:00
Просмотров 638 тыс.
OMG! Bei der Hochzeit betrogen 😨 #tricks
00:43
Просмотров 1,7 млн
small vs big hoop #tiktok
00:12
Просмотров 3,3 млн
The Harsh Reality of Being a Data Analyst
7:39
Просмотров 543 тыс.
The Harsh Reality of Being a Data Engineer
14:21
Просмотров 216 тыс.
Learn Apache Spark in 10 Minutes | Step by Step Guide
10:47
Обзор ЛЮКС вагона в поезде
01:00
Просмотров 638 тыс.