The Harsh Reality of Being a Data Engineer

Подписаться 236 тыс.

Просмотров 32 тыс.

50% 1

Download Python ebook (free) 👉🏼 clickhubspot.com/bbd
In this video, we are discussing the harsh reality of being a data engineer, the good, the bad and the ugly. Wait till the end of the video and share your thoughts in comments. Anything surprising to you?
Learn more about AWS Startups GenAI Day - Watch the GenAI Webinar on-demand 👉🏼 rmbrnd.com/AWS-GenAI
Virtual product placement by Rembrand 👉🏼 www.rembrand.com
WATCH THESE VIDEOS NEXT
My Self-Taught Data Science Journey: • My Data Science Journe...
How I Would Learn Data Science in 2023: • How I Would Learn Data...
Harsh Reality of Being a Data Scientist? • The Harsh Reality of B...
Try AI for coding & data analysis:
🏅 Julius AI for data analysis 👉🏼 julius.ai/?via=Sundas
~~~ CERTIFICATES & COURSES ~~~
Data Scientist
📊 Data Science Certificate 👉🏼 imp.i384100.net/DataScienceCert
🏅 Data Science Bootcamp 👉🏼 bit.ly/data-scientist-bootcamp
🌍 Data Scientist Bootcamp 👉🏼 bit.ly/data-scientist-bootcamp
Data Analyst
🏅 Google Data Analytics Certificate 👉🏼 imp.i384100.net/GoogleDataCert
🏅🏅 Google Advanced Data Analytics Certificate 👉🏼 imp.i384100.net/advanced-data...
⚡ IBM Data Analytics Certificate 👉🏼 imp.i384100.net/ibm-data-analyst
📊 Microsoft BI Data Analyst Certificate 👉🏼 imp.i384100.net/msft-dataanalyst
📑 Cyber Security Analyst 👉🏼 imp.i384100.net/cybersecurity
🐍 Meta Marketing Analytics Certificate 👉🏼 imp.i384100.net/meta-analytics
Data Engineer
📊 Meta Data Engineer Certificate 👉🏼 imp.i384100.net/meta-dataengineer
⚡ IBM Data Engineer 👉🏼 imp.i384100.net/data-engineer
Python
🐍 Python for Everybody 👉🏼 imp.i384100.net/PythonSpec
⚡ Python for Data Science 👉🏼 bit.ly/python-data-science-ml
📑 Python for Data Visualization 👉🏼 bit.ly/python-data-viz
🏅 Python Pandas 👉🏼 bit.ly/python-pandas-data-ana...
SQL
⚡ SQL Basics for Data Science 👉🏼 imp.i384100.net/SQLforDS
🏅 SQL Bootcamp 👉🏼 bit.ly/sql-bootcamps
Machine Learning
🏅 Machine Learning Bootcamp 👉🏼 bit.ly/machine-learning-atoz
⚙️ Machine Learning Specialization 👉🏼 imp.i384100.net/ML
⚡ Deep Learning 👉🏼 imp.i384100.net/deeplearning
⚙️ AI Engineer Certificate imp.i384100.net/AI
Statistics
⚙️ Statistics for Data Analysis 👉🏼 bit.ly/statistics-data-scienc
📑 Intro to Statistics 👉🏼 imp.i384100.net/Stats
EXCEL
🎨 Excel for Data Analysis 👉🏼 imp.i384100.net/Excel
✍️ IBM Data Analysis in Excel & R Certificate 👉🏼 bit.ly/data-scientist-bootcamp
🌍 ALL COURSES 👉🏼 kit.co/SundasKhalid
🏅 Practice Coding Interviews 👉🏼 www.stratascratch.com/?via=su...
~~~~~~~~~~~~~~~~~~~~~~~~~~~
MY FAVORITE TOOLS
📚 Read Books FAST on Shortform 👉🏼 www.shortform.com/sundas
✍️ Coursera Plus 7 day free trial 👉🏼 imp.i384100.net/CourseraPlus
🏅 Practice Coding Interviews 👉🏼 www.stratascratch.com/?via=su...
🏅 Julius AI for data analysis 👉🏼 julius.ai/?via=Sundas
✍️ Get 20% HubSpot Discount 👉🏼 hubspot.sjv.io/c/3311887/1863...
SUBSCRIBE FOR MORE VIDEOS
ru-vid.com?...
BINGE THESE PLAYLISTS NEXT
Starting in Data Science: • Starting in Data Science
Learn SQL: • Learn SQL
The Tech Lounge: • The Tech Lounge
ABOUT ME
I'm Sundas. I'm a self-taught data scientist from a non-tech background, currently at a FAANG company. I have been in the industry for +10 years spread across two big tech companies. On this channel, I share tips for people interested in entering data science with the goal to democratize knowledge and make complicated topics digestible for everyone. Learn more at sundaskhalid.com All opinions are mine!
PS. Some of the links included are affiliate links and help me keep this channel going. Thanks for the support.
Business inquiries: info@careerpy.com

Наука

Опубликовано:

10 июл 2024

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист

Посмотреть позже

Комментарии : 55

@SundasKhalid 7 месяцев назад

Thanks for watching! You can download the Python ebook (free) 👉🏼 clickhubspot.com/bbd

@hegerwalter 7 месяцев назад

Well, everything new requires you to figure out your path. I studied to be a mathematician but needed to find a job. Salaries in programming supported a more affluent lifestyle, so just a few classes in CS helped get my foot in the door. I think that the guy who wrote a violent race car game had a history Ph. D. I was reading about a philosopher who worked as a glass lens grinder, who died from cumulatively inhaling glass fibers in his 30s. Like everything else, you might need to change careers or job titles. Being a Data Engineer and knowing programming will get you further.

@AchuVlogs 2 месяца назад

Im a data engineer with 4 years experience. Harsh reality of being a data engineer is: - 5% building new pipelines - 15% automating the pipelines - 20% adding data quality checks to the pipelines And 98% of the time fixing bugs in OLD pipelines. For people who like building new products, this is not the right role. Because most of the time you're only firefighting. And since you work in backend, you don't get much recognition.

@xinpengliu461 Месяц назад

Exactly agreed

@aarnavchauhan4788 19 дней назад

Can you please guide me with a roadmap for getting into data engineering if I am from a college with good on campus placements, and whether I should learn data engineering in college instead of other conventional paths like say web development.

@vishnuvrv 7 месяцев назад

There are two types of data engineers: Software Engineers who are also data engineers and ETL engineers. If you are an ETL engineer (building pipelines using python and SQL) then you are just considered a glorified data analyst and your pay always be less than SE. My advice for them is to take the next step and become a cloud engineer (snowflake, Azure, AWS) and see your pay increase significantly.

@angelsub9184 6 месяцев назад

Sir, are you advising DE with ETL engineer to take cloud engineer course or take Software Engineer bootcamp? Which one is better?

@sabyasachi426 6 месяцев назад

Insightfull

@LOFI_WORLD_SONG 6 месяцев назад

Hello sir. I don't want to code , programm like dev team. But I can work in cloud. Where should I go. DE or devops one. Please help

@jean4j_ 5 месяцев назад

Yes! There are technical DE and BI DE. Two different types of DE. Totally different culture and minset.

@mitchtherighteous 5 месяцев назад

The real question is how to get the education without wracking up stupid provider bills

@abidrahim7607 3 месяца назад

Thank you for putting this out, appreciate it! 🙌🏼

@abiola4710 7 месяцев назад

The roles of a software engineer and data engineer are totally different, even though they might use related tech stacks. Also a data scientist can't take the role of a data engineer because, apart from being technical, a data engineer is expected to communicate with stakeholders and build solutions that turn data into insigts/revenue; data scientists suck at this. So a good data engineer should be able to do the work of a data analysts effectively. According to a Gartner report, 80% of data science projects fail. The number reason is: Lack of understanding of business context and user needs.

@max1232 7 месяцев назад

just got an internship as a data engineer(while at college) for the city of ottawa(only 1 spot btw)...wont have done it without you. Appreciate you..

@rangho10 2 дня назад

The aspect you might not have covered is that as most Data Engineers progress, they don't remain DEs but more so SREs and System Software Engineers, or systems architect as since they have a clear idea of how the information (data) is flowing, they have a clear idea of the system flow.

@SantoshKumarsp57 6 месяцев назад

Hi Sundas, I am a bit confused. You are initially saying that SEs can do DEs role and also, with advancements in AI and possible taking over core SE's role, even they would do DE's role. Then, at the end, you are saying that DE's role will still be in demand?

@jean4j_ 5 месяцев назад

Not everybody agrees with this (especially juniors) but Data Engineering is a subset of Software Engineering. There are two types of DE: - software oriented DE - BI oriented DE DE is SWE. Be very good in software engineering with a focus on Big Data. You will able to switch roles easily.

@omotayosawyer9535 2 месяца назад

stressing on the point of a software engineer being able to do what a data engineer does is absolutely correct. I work as a data analyst and in one of my previous roles, the software engineer was pretty much the data engineer completing all the data engineering task.

@joelkanamugire6400 7 месяцев назад

I have been working as a Data Engineer for 3 years and I think it depends on companies and how they define their data engineers. I always find myself building data pipelines, API design, Web applications, Data Encryption and Database Security

@LOFI_WORLD_SONG 6 месяцев назад

Do you code ? Or program from scratch?

@jayasingh7810 5 месяцев назад

Hey, where do u work?

@yousefosman4558 7 месяцев назад

i was confused about that thank you i will focus on data science then i will convert to data engineer because i don't see a particular road map for data engineer

@prar_th_.2364 7 месяцев назад

Hi I'm a high school senior right now and I want to pursue a career in data science job family..... specifically AIML.....it would be wonderful if you could do a video on AIMl because I feel like there isn't much on the internet about the same

@moinzajam5117 7 месяцев назад

Ma'am I m confused between data engineer or data scientist, which one should I choose , kindly suggest me

@yogajyothisomu2908 3 месяца назад

Data science or data enginering which is better based on opportunites as a freshers?

@j.amethyst5685 3 месяца назад

Great review, but i cant agree career growth. From Data Engineer you become a solutions architect. Or bridge being a DE to the next sensible path.

@harshitagarwal7475 6 месяцев назад

Hi Sundas, i m writing this comment to share with you that i got fresher job as a Data Engineer in one of the startups. I believe if u have the knowledge of tech stack required for the role, u can get hired. In btw, i have worked as data science intern for 3 months before(as it is considered hot topic in the field of tech and i went for it initially but coudnt find good pay jobs for it).

@DaRedT 7 месяцев назад

thank you very much 👍👏

@user-mu4uw2sr3g Месяц назад

Hello everyone! I'm considering a transition from a Scala software engineer to a Scala data engineer. I've found that being a Scala dev is very challenging for me , but I'm not ready to give up on Scala just yet. Can anyone share insights on whether working as Scala Data engineer (Sql ,Spark) might be a smoother path for me? Appreciate any advice!

@mohammedabdulla1496 7 месяцев назад

Nice, I came to know that data engineers paid lesser than the average software engineer Felt sad 😔

@sergiocarmona7238 6 месяцев назад

Im agree with all except number 2 software engineer can make easily DE work?, i think no, many DE were DBAs in the past. DBA is complete different skill to software engineering. 3. i think there is growing for DE you can skill up into machine learning engineer more easily than other roles.

@kimblevuo 5 месяцев назад

Just started Data Analysist course few weeks ago.

@mura685 Месяц назад

How is it going so far?

@kazerdira4704 День назад

I am interested in this field i come from mobile developpement (coding) , i still dont understand , you are dealing with data and SQL ? And little of python , ? If anyone know a course to buy or path to follow please help me

@Tayyaba-Zahid 7 месяцев назад

Sundas name is very unique for me 💕

@rockshankar 5 месяцев назад

seems you went with your default thumbnail :D

@SundasKhalid 5 месяцев назад

sadly yes 😭

@shobhitagnihotri416 7 месяцев назад

AWS beta certification for data engineer , Please talk about it.

@nitcooksgf 7 месяцев назад

Yes I also want to know about this

@kevinrobbs9717 5 месяцев назад

I’m a Database Administrator/ Network Administrator/ Full Stack Developer making 60k…. I would love 155k damn!

@christophergreen3809 3 месяца назад

Even I make less than a developer, it's still a helluva lot better than my customer service job!

@dotpy7928 5 месяцев назад

Through the whole video I was really concerned she will accidentally cut me with her fingers...............

@wendykgosi149 7 месяцев назад

Lol my gosh there are so many harsh realities why would anyone wanna pursue this.

@junaidamin 7 месяцев назад

Please make sundas khaild Urdu/hindi channel for south asia audience specially Pakistani audience

@AchampetaEshwar 19 дней назад

Instead of making this useless video why don't you try to make something useful like the ROad map or path to become a data engineer and courses to learn