How I Would Learn Data Engineering 2024 (If I could start over)

Подписаться 137 тыс.

Просмотров 206 тыс.

50% 1

Join Course Python for Data Engineering - datavidhya.com/courses
Learn how to become a data engineering expert in 2023 with this comprehensive guide. From understanding the basics to mastering advanced techniques, this video covers everything you need to know to excel in the field.
Whether you're just starting out or looking to refresh your skills, this tutorial is a must-watch for anyone interested in data engineering. Don't miss out on the opportunity to take your career to the next level - watch now and start your journey to becoming a top data engineer today!
Complete Data Engineering Roadmap 2023 - docs.google.com/document/d/1M...
Join Data With Darshil Discord Server: / discord
Timestamps
0:00 Introduction (very important)
2:28 Section 1 - Getting into Data Engineering
5:08 Section 2 - Building a strong foundation
10:14 Section 3 - Modern Data Stack and Advance skills
12:30 Learn Data Engineering + Projects
📷 Instagram - / darshilparmarr
🎯Twitter - / parmardarshil07
👦🏻 My Linkedin - / darshil-parmar
🌟 Please leave a LIKE ❤️ and SUBSCRIBE for more AMAZING content! 🌟
3 Books You Should Read
📈Principles: Life and Work: amzn.to/3HQJDyP
👀Deep Work: amzn.to/3IParkk
💼Rework: amzn.to/3HW981O
Tech I use every day
💻MacBook Pro M1: amzn.to/3CiFVwC
📺LG 22 Inch Monitor: amzn.to/3zk0Dts
🎥Sony ZV1: amzn.to/3hRpSMJ
🎙Maono AU-A04: amzn.to/3Bnu53n
⽴Tripod Stand: amzn.to/3tA7hu7
🔅Osaka Ring Light and Stand: amzn.to/3MtLAEG
🎧Sony WH-1000XM4 Headphone: amzn.to/3sM4sXS
🖱Zebronics Zeb-War Keyboard and Mouse: amzn.to/3zeF1yq
💺CELLBELL C104 Office Chair: amzn.to/3IRpiL2
👉Data Engineering Complete Roadmap: • Data Engineer Complete...
👉Data Engineering Project Series: • Data Engineering Proje...
👉Become Full-Time Freelancer: • Best Freelancer Series...
👉Data With Darshil Podcast: • Podcast Series - Data ...
✨ Tags ✨
how to become data engineer in 2023, data engineering projects for free, path to learn data engineering, big data engineer for beginner, data science vs data engineer
✨ Hashtags ✨
#dataengineer #bigdata #2023

Опубликовано:

25 июн 2024

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист

Посмотреть позже

Комментарии : 357

@DarshilParmar Год назад

More projects are coming so make sure to hit LIKE button

@dhwanimehta4634 Год назад

Thank you Darshil your content has helped me a lot. I am very grateful to you.

@ilma300 Год назад

Thanku brother. I want to become data engineer but I have no money for fee. Mostly people give m suggestions but I didn't understand. But now I'm understand. God bless u

@kuldeep4331 Год назад

Very helpful as always 😊 darshil. waiting for the projects

@shalalayusifli9734 Год назад

Thank you for great video! :) Very helpful

@rameezkhan4929 Год назад

Hi thanks for the detailed roadmap. Will you please suggest and paid course for data engineering. I want switch into it from non it my age is 27 and i m doing BCA from second year

@baocao2492 Год назад

For anyone looking for a summary: - Section 1: Build CS Foundation, SQL - Section 2: Dataware house, data processing frameworks, cloud platforms,

@guitarsz Год назад

Oh my gosh Darshil! THANK YOU SO MUCH for the roadmap you posted. That is incredible and so generous. Thank you again for the great, detail and comprehensive video.

@Mariahemariaho Год назад

Great video, no irrelevant content or filler sentences. I have been studying on data engineering field for a while and I found that all information are very useful and including brief explanation about subjects. Thanks a lot for it.

@djgulston Год назад

Thank you, Darshil! This is very helpful. You are a huge help!

@rajan_pawar Год назад

Bro literally find it useful, definitely going to follow this roadmap! Thanks a lot :)

@shaguar6439 Год назад

Graduated for DE, tried doing my own thing after Uni, sales.. Gearing back to break into DE. Need a big refresher, it’s been almost 2 years now. Thank you so much 🙏🏽 Good luck all of u Gs

@jisookim9719 Год назад

Literally so clear, im a bioinformatics student who’s trying to transition into data engineering. This makes it less intimidating and now i know where to start

@ashishkumar-nx6nv 11 месяцев назад

Extremely helpful content. For last one year I was trying to create a roadmap but wasn't able to get a clear picture. Appreciate the work very nicely present without extra jargons. ❤❤

@carlo6195 Год назад

Thank you, Darshil! Concise and very clear.

@DarshilParmar Год назад

Glad it was helpful!

@vishruth1997 Год назад

Thanks a lot Darshil , as for someone who might be new or even for someone who have intermidiate skills in data science stack , this video is such a boon and makes less intimidating in the learning process. Hands down one of the best data engineering roadmaps i have seen .

@romanchirkov5441 Год назад

Wow, being a Product Analyst in the industry since 2020, the level of {value / time} metric here is just phenomenal. Thank you!

@gavinkalaher7314 Год назад

Great video Darshil, very consise and informative. I've downloaded the roadmap, many thanks. Subbed!

@DarshilParmar Год назад

Awesome, thank you!

@sumedhpatil Год назад

Thanks a lot Darshil,what an explanation

@vinisharma3459 Год назад

Such a great explanation, thank you so much. 😊

@InglesConConfianza 7 месяцев назад

GREAT resource! Thank you.

@abundantlife4973 Год назад

Thank u so much darshil... I'm speachless 😇

@luisornelas450 4 месяца назад

Thank you! Exactly what I need to have an idea where to start.

@sagarmoysarkar3837 Год назад

Awesome roadmap and thanks for making great content... really appreciate it 🙏

@DarshilParmar Год назад

My pleasure!

@mohammedlashin9517 Год назад

Thanks a lot Darshil for this amazing and detailed video 🙏 You sorted all the details in a very easy way which encourages anyone to start over. Thanks again brother ❤️

@blockafter Год назад

Thank you for the great content, Darshil!

@DarshilParmar Год назад

My pleasure!

@SurajYadav-bc5id 10 месяцев назад

Thanks a ton brother for simplifying the path as much for a beginner. Now this data engineering feels less overwhelming to me. And I feel I can easily start, have clear and concise picture. Everyone you see on internet lists each and every tool and technology as if a 4 year engineering course, like telling you to learn almost everything as a beginner. Even asking to learn legacy tools which hardly used in modern day, these are just burden on a beginner. We can learn fewer technologies build few projects and can call ourselves a data engineer and then we can build upon that. Thanks again❤

@msnrao123 10 месяцев назад

Second with you

@shivsuthar2291 Год назад

Thank Darshil. This is very helpful

@revanthsrirangaraju8863 Год назад

Thank you, you're video was very helpful 💯

@machhindrasmathematics2551 Год назад

Thank you Darshil for the Direction...

@gourabguha3167 Год назад

Thank you for the awesome video!!

@muthupriyadharshinim9033 9 месяцев назад

Thank you so much for making this. Very helpful.

@Kshashank427 Месяц назад

Dil se shukriya, very clear now

@mahteenbash Год назад

This was actually very helpful. Cleared so many things in my mind about the different technologies. thank you.

@DarshilParmar Год назад

Glad it was helpful!

@silvertechnolo3958 11 месяцев назад

This is the most helpful video, all the other videos make it sound like I have to learn every single framework and do so much. I am A computer Engineer graduate, I think I will start at Data warehouse and pi spark since I am very comfortable with Python and Java (and C but that's just hardware stuff)

@user-en1eh5ux7d 10 месяцев назад

This video is so helpful. Thank you.

@hameedma2829 Год назад

It was great and worthwhile to watch the amazing video on data engineering and right path suggested

@pushkarratnaparkhi2205 Год назад

Thanks a lot for making it super easy for us.

@thenewuser3100 Год назад

Thanks for the wonderful job u doing ..

@beloyalroyal Год назад

Thank you so much for perfect roadmap God bless

@princeagbebo4374 11 месяцев назад

Thanks! This is really helpful

@vamsikrishnaaliveli938 Год назад

Thank you so much by clearing the way to data engineering

@saiabhinay1064 Год назад

Awsome explination. Keep Going!

@eduardofreitas2158 Год назад

I am a person who avoids roadmaps and "cookbooks", because I believe there's a different path for everyone. So I consult data engineers colleagues and read articles to get recommendations and I take only what interests me. And I got to be honest with you, that's the best and most real roadmap I've seen. You spoke about all tools I've seen in the market and books I've been reading, so thank you. I'm really glad to be here. That's a great channel!

@DarshilParmar Год назад

Thanks man means a lot

@ravitejachilakamarthi1017 10 месяцев назад

Amazing video on where, what and how to start if you are looking to pursue a career in data engineering. Thank you.

@user-yv1le4jg3d 10 месяцев назад

Great concise and informative

@k.h.p.9862 11 месяцев назад

Thank you for this insightful video.

@WadieGamer 3 месяца назад

Well explained, thanks for this.

@vivekhadoop3359 Год назад

Really appreciate bro. thanks for guiding professional like us since its almost 10 year i m into software development lifecycle and there is no as such carrier as well salary growth. so wanted to shift my carrier in data engineering and your videos will really help me to move in that direction. I hope u also provide practical project video which will bost our handson skill while working in real time projects

@vinodgujja4268 Год назад

Thanks!

@bhumikalalchandani321 Год назад

Thanks darshil for useful insights

@DarshilParmar Год назад

Welcome!

@samikshachoudhary5597 Год назад

Great video very helpfull, Thank You so much for your efforts 🙏🧿

@vishnuvardhan9082 10 месяцев назад

Lovd it. Much helpful.

@stephencallahan3390 7 месяцев назад

Thank you!

@rayanskingdom6029 11 месяцев назад

Great delivery of information 👌👍 Only thing is looking at amount of information you share, please take small pauses so that the listener is able to grasp it 😊

@thedailyepochs338 11 месяцев назад

Awesome work

@sravsclassic4369 5 месяцев назад

best road map, very clearly explained

@vedantwankar7332 8 месяцев назад

You made it so easy to understand.....kudos to you brother😇😇

@mzug9 Месяц назад

Thank you

@DonnyLp03 11 месяцев назад

I agree that building a good foundation of fundamentals is important.

@jaekim1717 10 месяцев назад

Thank you very much. was simple explanation but this is best

@animalbubble4487 8 месяцев назад

Excellent video , you just broke it down for me and i will start my data Engineering journey now ..Thank you ... Honestly this is the best and simplist videoo you will see on youtube

@DarshilParmar 8 месяцев назад

Glad it was helpful!

@pedja2518 Год назад

Great content!

@DarshilParmar Год назад

Thank you

@SharmanjoshiBlog Год назад

Very Nice being and doing fabulous work .

@user-gg7ud9zt9f Год назад

Hi Darshil, I am an analyst with 8+ years experience who started career after a data science certification. Due to lack of programming skills I tried to escape core tech jobs and kept dabbling with tools based jobs and learnt several tools but was never consistent. After much self retrospection and with the help of a mentor like friend I have decided to dig deeper into Data engineering concepts so that I can be a better analyst. I searched about some DE concepts and happened to get your uber project video in the suggestions, must agree that have become a fan of you from the very first minute (bande me kuch baat hai), here I am on your 4th video and I know I hit one of the gold mine in this area. I would love to catch up with you, share and learn more in this Data world. Finally, yes I agree your approach of learning and your choice of tools and platforms are excellent, I suggest the same to everyone... hopefully this comment finds you and we can catch up soon.

@DarshilParmar Год назад

Welcome to channel, as you go deep, you'll find more goldmine that will help you to learn many things

@altunbikubra 10 месяцев назад

great video! overall, not too specific and general depiction of the pathway. Thank you very much!

@user-uq8dc6vs6z 3 месяца назад

Thank you so much

@girijavarma5271 Год назад

thank you so much 😇

@vishnuinsane Год назад

Thanks Dharsil.. it’s awesome Map to Hit the CV’s

@DarshilParmar Год назад

All the best

@nikhilchintalapudi4932 Год назад

Idk if it's just me, but my current work as a data engineer requires me to learn a lot of dev ops principles (cloudformation/templates/helm) and networking principles (VPC/subnets/security groups). I learned python and a couple other tools like dbt, airflow, etc and came from a heavy SQL background (snowflake, sql server, ssis). Having to learn this other stuff while also getting better at python, spark, and the main parts of data engineering came as a big surprise to me.

@HeavensMeat 10 месяцев назад

Any good sources to learn those?

@nikhilchintalapudi4932 10 месяцев назад

@@HeavensMeat nothing too great tbh, I used acloudguru which helped conceptually with some of the basic stuff but I found no good substitute for learning on the job/practicing with small projects and deployments in a personal account.

@JungleEd17 7 месяцев назад

I've been doing infrastructure for DE for a year. In addition they have a devops team for pipeline deployment from github. So most just need to know which branch to push to. Is it a small team?

@muktakjain8268 Год назад

THANKYOU SOO MUCH SIR

@Ganeshay-996 Год назад

Finally I got it best roadmap

@aksharpatel17 10 месяцев назад

I will come here again after following this roadmap and getting job in data engineering as a fresher

@makampooja6767 Год назад

You are simply superb and life saver

@kunalbedre5727 Год назад

Clear 😊

@madhusudhanaerappareddy856 5 месяцев назад

Darshil - I'm Business Intelligence Manager who is looking to become a data engineer, as many of our friends in comments mentioned this is the best road map they could get to become data engineer, I totally agree with them. This is the best video or content I would say which helped me to understand where to start, I would say at this point you are my mentor and I would do everything you said to become data engineer. Also, I noticed "5. Big Data Fundamentals" topic / notes is missing in the notes you uploaded to google drive. Can you please update the list to add Bigdata Fundamentals to it. So, it is easy to get to the course material following the link. Thanks! and more love from USA.

@NitinSai2909 Год назад

very helpful video

@ishikadabare5567 10 месяцев назад

Thank-you, can you frame a course covering basics and intermediates?

@hellbent2001 Год назад

Where can I get that roadmap notebook you shared at the end of video.

@hunk6890 Месяц назад

Hey Darshil , you have created very helpful video. I was frustrated because I wanted to become data engineer but dont know exact roadmap and there was lot of confusion to what I should learn first. I am with 8 years of experience as Database Developer and wasnt sure what roadmap I should follow let me share my current skillsets RDBMS(Oracle , Postgres) - Expert Python - Good Linux - Worked on Linux machines Data Warehouse - Didnt work but have theorotical knowledge DW tool like Snowflake or AWS Redshift - Need to learn Batch processing , Realtime processing - Need to learn Cloud - Have learned few AWS services like EC2 , EFS , EBS , RDS etc. Project - Have not done any so far. Now based on my current skillsets please guide me where I should focus now ?

@ankandatta4352 Год назад

Currently working with dbt. What are the options going forward??

@AkshayKumar-GG Год назад

is there any upper hand for data analyst while transitioning and giving interviews for DE role?

@MrBhardwaj03 Год назад

Where I can find the doc file you showed at the end of the video?

@Jsmbpj Год назад

I am fresher and what would you suggest- Azure or Snowflake with AWS?

@shashankreddysai Год назад

Top notch content

@LinhPham-hc4ok 6 месяцев назад

thank you

@avinash7003 Год назад

What are the softwares required for data engineer

@imranahmed-ri7iz Год назад

It’s a great explanation Darshil.. now I have a clear path to go for preparations. One doubt, what about Hadoop ecosystem? Is it not necessary to learn??

@DarshilParmar Год назад

Most of the companies are focusing on spark so not really, if you want then you can explore the basics and move on

@abhishekkadam3891 Год назад

Hi darshil , how much level of coding needed for a daga engineering

@shaikusman536 Год назад

Awsome ROAD MAP==> Data Engineer......thanks a ton Darshil for your sincere effrorts.......

@DarshilParmar Год назад

Thanks a ton

@anonymousgal100 Год назад

@@DarshilParmar At what point of learning journey, I should start applying for job/internship if would like to switch career from web developer to data engineer?

@Icelander00 Год назад

Thanks

@mosman260 11 месяцев назад

Do you recomend learning all 3 or just 1 progam lanugange?

@jerome8471 Год назад

Is the CS50P preferred since it focuses on python?

@rohankabadi389 Год назад

Darshil i have a question for you, I am a chef and i have to prior tech knowledge i am thinking of making a career change into data engineering. Would it be possible for me to get a job later without a CS degree?

@riyadhchowdhury5842 Год назад

I am completely new in data engineering.

@khushbooagarwal6172 Год назад

Please share the link of databrics training.. the training sessions on databricks academy has lab sessions and I found that they are not in sync with course material. Can you please help me with this?

@keneugene7714 Год назад

this is great

@AshishKumar-th8by Год назад

In the sheet that you shared, you mentioned about your project-01, should I do that before I get started with Big data tutorials as it is mentioned early there?

@DarshilParmar Год назад

Yes

@strength4147 Год назад

Hi, great video! Helps me out a lot and thanks for the free road map. I just have one question related to data engineering: Is math highly needed subject to succeed as a data engineer? Is a lot of math involved in the day to day work as a data engineer? Thank you!

@azimhaque6437 Год назад

No math isn't much required for being a DATA ENIGEER, math is more important for being a Data Scientist

@focus1007 6 месяцев назад

Subscribed 😍just found your channel and its helpful

@mohamedfyrose409 Год назад

Your contents never disappoints. Thanks for an another awesome material

@DarshilParmar Год назад

Thank you for the support

@osmanazeez2641 Год назад

Thank you darshil for the amazing content but I will like to know your opinion on the cousera's meta database engineering professional certificate and also the IBM data engineering certificate

@DarshilParmar Год назад

Hi Thank you! Here is the thing, all of these compnay have their courses for DE Google, Azure, Amazon, IBM, Meta All of them teach data engineering using their product and services, so if you do IBM you will learn Data Engineering + How to perform DE using IBM services. In my opinion, Meta, GCP and Azure is good as their cloud skills are good to have. Try auditing the course and see if you like it then continue, I have done GCP one and it is good

@rupavanduri5908 Год назад

God bless you, you are my inspiration to learn things by waking in morning and spend time to learn. Delighted with your words .

@anyanensomahdoris7833 8 месяцев назад

Thank you so much for this video Am in the university and will be completing May-June 2024. I will like to take this data engineering paths and will need your support Please help me to start from beginning to finish