What Does a Data Engineer Do? Explained Simply

Подписаться 153 тыс.

Просмотров 22 тыс.

50% 1

Combo Package Python + SQL + Data warehouse (Snowflake) + Apache Spark: com.rpy.club/p...
USE CODE: COMBO50 for 50% off
Learn more about courses here - datavidhya.com...
The Data Engineering market is going to cross the $100 Billion mark by 2028, this is the best time to learn about data engineering and start your career, in this video we will understand what a data engineer really do and skills required for data engineering
👦🏻 My Linkedin - / darshil-parmar
📷 Instagram - / datawithdarshil
🎯Twitter - / parmardarshil07
🌟 Please leave a LIKE ❤️ and SUBSCRIBE for more AMAZING content! 🌟
3 Books You Should Read
📈Principles: Life and Work: amzn.to/3HQJDyP
👀Deep Work: amzn.to/3IParkk
💼Rework: amzn.to/3HW981O
Tech I use every day
💻MacBook Pro M1: amzn.to/3CiFVwC
📺LG 22 Inch Monitor: amzn.to/3zk0Dts
🎥Sony ZV1: amzn.to/3hRpSMJ
🎙Maono AU-A04: amzn.to/3Bnu53n
⽴Tripod Stand: amzn.to/3tA7hu7
🔅Osaka Ring Light and Stand: amzn.to/3MtLAEG
🎧Sony WH-1000XM4 Headphone: amzn.to/3sM4sXS
🖱Zebronics Zeb-War Keyboard and Mouse: amzn.to/3zeF1yq
💺CELLBELL C104 Office Chair: amzn.to/3IRpiL2
👉Data Engineering Complete Roadmap: • Data Engineer Complete...
👉Data Engineering Project Series: • Data Engineering Proje...
👉Become Full-Time Freelancer: • Best Freelancer Series...
👉Data With Darshil Podcast: • Podcast Series - Data ...
✨ Tags ✨
✨ Hashtags ✨

Опубликовано:

27 сен 2024

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист

Посмотреть позже

Комментарии : 77

@pavanparvathanenii4471 4 месяца назад

Wow you explained my job in just 10 to 11 mins in a smoother way. Much appreciated Darshil❤

@DarshilParmar 4 месяца назад

Glad to hear that

@waynelast1685 21 день назад

Difference between Synapse and Fabric?

@worldtour666 3 месяца назад

Hi Darshil, Please make a series on AWS cloud server less API and datalake development using python. Where glue jobs should be developed using pyapark, source data must be fetched from msk connectors, upload data in s3, create Iam users, using AWS boto3, unit testing using moto3. Maintain db and tables in lakeformation using lf-tags. Athena automation for visualization. Please make series complete based on programming automation

@davebatista8636 4 месяца назад

aaj sabse pehle is channel ki main main saari videos dekhunga....

@adilmajeed8439 4 месяца назад

Some complex project on Microsoft Fabric ...

@ARACON_DATA_0605 4 месяца назад

How to collect data generated from survey websites and derive insights??

@dhanushtharun8190 4 месяца назад

Hey bro books vs online tutorial/udemy course which one is best for beginners to intermediate ❤

@tenet7846 3 месяца назад

Hii darshil may i know please Whas is the duration of apache spark +databricks course??

@BishanTamang-rk5ji 4 месяца назад

Love you Brother ❤️

@DarshilParmar 4 месяца назад

Thank you

@keshavgupta6150 4 месяца назад

Great video but next time decrease background music or remove it

@DurgaPrasad-go4gm 4 месяца назад

Hi sir i have applied for many companies by watching your videos and doing your projects and making changes but donk know where I am lacking behind

@DurgaPrasad-go4gm 4 месяца назад

drive.google.com/file/d/1hVVoqvitd2wCSFv44f2aVWew2Cbgpg6-/view?usp=drivesdk

@DarshilParmar 4 месяца назад

Check resume and portfolio projects they are very important

@DurgaPrasad-go4gm 4 месяца назад

@@DarshilParmar drive.google.com/file/d/1hVVoqvitd2wCSFv44f2aVWew2Cbgpg6-/view?usp=drivesdk

@DurgaPrasad-go4gm 4 месяца назад

@@DarshilParmar here's my resume sir drive.google.com/file/d/1hVVoqvitd2wCSFv44f2aVWew2Cbgpg6-/view?usp=drivesdk

@DurgaPrasad-go4gm 4 месяца назад

drive.google.com/file/d/1hVVoqvitd2wCSFv44f2aVWew2Cbgpg6-/view?usp=drivesdk

@divyeshpatel2463 4 месяца назад

Can you recommend books on python, sql and linux?

@haripriyap517 4 месяца назад

I've got aws dva certificate 1 year back, but I didn't worked/practiced on aws. And am planning to switch product based company. Please guide me where to start my learning.

@SagarKumar-lf5dg 4 месяца назад

Hello Darshil Sir, Is it possible to switch career from one domain to another domain. Currently I am in Accenture but want to change my career to another domain...could you please guide me

@PrathameshMawlankar 4 месяца назад

Hi great information shared as always. Btw did you start taking protein shake and working out? Just curious since you are looking more buffed

@DarshilParmar 4 месяца назад

Haha I am working out from last 3 years but most of the time I wear long sleeves this tshirt is tight so it makes me look buff

@rudroroy1054 4 месяца назад

I am curious what is the difference between a data engineer and a business intelligence developer?

@DarshilParmar 4 месяца назад

www.linkedin.com/posts/darshil-parmar_dataengineer-datascience-dataanalyst-activity-7196031026966495232-gzE3?

@techtricks1052 4 месяца назад

this is a good video

@shashankpatel634 4 месяца назад

Bro... I got all the skills which are you mention in your thumbnail... I will finish my final semester exam in first week of june... And still unplaced... Entry level job pe bhi 3-4years ka experience maang rhe h🙃😭

@DarshilParmar 4 месяца назад

Try Data Analyst position or get internship

@prathamgupta9256 4 месяца назад

R uh stay in Mumbai ?

@viraj_kadam 4 месяца назад

@@prathamgupta9256 same here mumbai

@sindhujareddy4659 2 месяца назад

Combo Package Python + SQL + Data warehouse (Snowflake) + Apache Spark how much is this course cost in India

@DarshilParmar 2 месяца назад

You can try India VPN for that

@paragvade 4 месяца назад

I am targeting data engineer role. I have aws solutions architect associate. Lack good grasp over python and sql. Shall I focus on python, sql first or go for aws data engineer associate and databricks cert?

@navneetkummar4811 3 месяца назад

Go with Python and SQL first

@paragvade 3 месяца назад

@@navneetkummar4811 thank you

@MuhammadTalhaImran 4 месяца назад

hey darshil is there any way I can get a discount on your 4 course combo as I am a student so it is difficult for me to pay the full fee.Thanks

@DarshilParmar 4 месяца назад

Please email me at info@datavidhya.com

@subratparida5647 4 месяца назад

Hey bro; for data scraping selenium is a good option or not

@DarshilParmar 4 месяца назад

No, lot of website have bot protection now, not worth doing

@subratparida5647 4 месяца назад

Then what is the good suggestion for web scraping

@DarshilParmar 4 месяца назад

@@subratparida5647 No web scraping go something else like data analyst/engineer or SDE

@subratparida5647 4 месяца назад

@@DarshilParmar Thank you for your suggestion 😀

@shiv8578 4 месяца назад

Who edits your videos

@DarshilParmar 4 месяца назад

I hired new editor, what happend?

@shiv8578 4 месяца назад

They are good, i mean how they use exact flow diagrams , are they teach persons? Or you have to collaborate with them to make it happen?

@DarshilParmar 4 месяца назад

hit that LIKE button and let me know what do you want to see next?

@tenet7846 3 месяца назад

Hii darshil may i know please Whas is the duration of apache spark +databricks course??

@sanafondu7743 3 месяца назад

I want to join on discord, can you please share invite, older invite seems to be expired

@dhanasekarank1743 4 месяца назад

Bro do you know dbt ?

@DarshilParmar 4 месяца назад

Yes

@dhanasekarank1743 4 месяца назад

@@DarshilParmar thank bro, I am runing the dbt models with databricks and I want to know the running time(I am able to see the running time in VS code) but I want see the running time and bytes consumption in databricks for each models. Is this possible bro?

@__nda_channel 4 месяца назад

Data engineering is not what I think But you are exactly what I thought You keep milking the topic data engineering rather than telling something else on data engineering

@DarshilParmar 4 месяца назад

Bro, I have 8 projects on the channel, 130+ videos My goal is to target just beginners and fresh to get started, there is no point in going on advanced level stuff because that won't work in this case 10min series to explain Spark, Airflow, Snowflake Videos on new trends End To End Projects Tutorials there are many things, I need to keep balance between different target audience so that everyone can understand different parts

@mayankkrsingh-zq1vj 4 месяца назад

I want to connect with you for discount offer? is it possible?

@DarshilParmar 4 месяца назад

Please email me at info@datavidhya.com

@rishabhrai9282 3 месяца назад

More end to end basic to complex projects using Microsoft Azure Services

@vaibhavarora9458 3 месяца назад

Hi Darshil, I am from a non technical background having BCom(Hons) degree and right now I am having almost 3 years of experience as Data Analyst with skill set of SQL, Power BI and Python (still learning). I have recently left my job and looking for new opportunities for Data Analyst. Also am aspiring for a Data Engineer role in future. I am thinking to get the job first in Data Analyst role and then I'll start learning for Data Engineer. Is this a good way to follow or shall I start preparing immediately for Data Engineer?

@tusharlambat887 Месяц назад

In 2024 : what pays more and has good job vacancies data anlyst or data engineering

@waynelast1685 21 день назад

4:56 what is purpose of Snowflake?

@ShyamDeepak-sp1dx 4 месяца назад

is this course availabe on web OR app ? Is course can be accessible anywhere ?

@divyeshpatel2463 4 месяца назад

Sir what is the duration of your zero to data engineering course ?

@DarshilParmar 4 месяца назад

Recorded content around 50hours for 4 courses with lifetime access, more will be released soon

@Tranics1 4 месяца назад

1view love from Lucknow brother ❤

@DarshilParmar 4 месяца назад

Thank you!

@rohittyagi3065 4 месяца назад

great

@niladripramanik8362 4 месяца назад

Hey Darshil I have been in Data engineering field for 1.5 yrs, Is there any research opportunity/ scope in data engineering?

@sunilKumar-ci9vn 4 месяца назад

How you got your 1st job as fresher.?

@Rhly001 4 месяца назад

Hey can you please tell me how you got started with this field.. I'm currently in college and been studying ML/DL mostly but now I'd like to expand my domain.. Is it even worth it and if so then how to I go about it.. Will really appreciate if you take some time and give an in depth response

@niladripramanik8362 4 месяца назад

@@sunilKumar-ci9vn hi it was campus placement only. But the role in company was data engg

@niladripramanik8362 4 месяца назад

@@Rhly001 see if u r already doing Ai ml for a long time, i suggest not to spent time in data engg. But if u want to then sql (all joins and when to use them, then group by , combination of group by and joins, self join, once done with these then windowing functions) - practice from leetcode 50 basic sqls... Python only upto lists.. shell scripting to automate.. Here , mostly u will work on sql only. Python+shell scripting to automate tasks.

@niladripramanik8362 4 месяца назад

@@Rhly001 bhai youtube is pathetic it's deleting my reply

@BabeRose6 4 месяца назад

Hey there, am new to your channel & your study info on Data Engineer and the motivation you give is really appreciated⭐ One clarity/query plz which one is suggestible to set as a career is it Data Analyst or Data Engineer (Azure) plz suggest...

@DarshilParmar 4 месяца назад

Starting with analyst is much easier than engineering