Тёмный
Darshil Parmar
Darshil Parmar
Darshil Parmar
Подписаться
Freelance Data Engineer and Solution Architect.

I love learning about technology and teaching thing I know to other people. The goal of creating this channel was to teach everything I know to the world, I have spent most of my time learning things online and I want to share all my learning on this youtube channel.

I will be posting content related to data engineering, architecting systems, data science, machine learning, and interview preparation.

Happy Learning :)
How I Got 60LPA Remote Job as Data Engineer
10:23
3 месяца назад
Best Data Engineering Books for Beginners
7:26
11 месяцев назад
How Dream 11 Process 7TB of Data Daily?
9:39
11 месяцев назад
Комментарии
@bhagwatdhavale6091
@bhagwatdhavale6091 4 часа назад
unable to create cluster , its not creating , dont know why its not creating
@prabhatshukla589
@prabhatshukla589 18 часов назад
Itani Moti book kaise padhenge yaar :)
@DarshilParmar
@DarshilParmar 5 часов назад
Ek din me thodi padhini hai, 6 month 1 book roj 10 pages ho jaega?
@cloudguru3018
@cloudguru3018 19 часов назад
You forgot to put cybersecurity on your skillset list.
@RohanPaul96
@RohanPaul96 День назад
Why not transformation done in azure adf instead azure databricks?
@DarshilParmar
@DarshilParmar День назад
If I did that would you learn Databricks? This project is for learning technology
@akshaykale569
@akshaykale569 День назад
mage_ai is so slow, I'm stuck here
@krantikumarm2705
@krantikumarm2705 День назад
not getting access google cloud
@prachideokar7639
@prachideokar7639 День назад
I didn't understand from where we get the configuration things from github repo
@rajanthakur6586
@rajanthakur6586 День назад
can you provide me your s3 bucket url of ipl analysis so i can use in my project, because i donot have aws account
@krantikumarm2705
@krantikumarm2705 2 дня назад
can we put this project on resume?
@kshitizghiya9910
@kshitizghiya9910 2 дня назад
I COMPLETED ENTIRE PROJECT. EXCITED TO LEARN MORE..
@digivion4381
@digivion4381 2 дня назад
Связка отличная, респект автору!
@anandukrishnan3054
@anandukrishnan3054 2 дня назад
On what compute service the python code runs?
@dhrudeepthakkar954
@dhrudeepthakkar954 3 дня назад
good overview of the book
@Guest-qn9so
@Guest-qn9so 3 дня назад
@DarshilParmar I am getting error while executing lambda. "errorMessage": "The specified path: s3://abc-de-on-youtube-cleaned-useast1/youtube/, does not match the existing Glue catalog table path: s3://abc-de-on-youtube-raw-useast1-dev/youtube/raw_statistics_reference_data/", "errorType": "InvalidArgumentValue",
@kaushittejwani1218
@kaushittejwani1218 3 дня назад
i am bacoming a adata enginner
@prasadbbd3525
@prasadbbd3525 4 дня назад
Good one, covering the overview of DE
@nandubindu2566
@nandubindu2566 4 дня назад
Very helpful . Thank you
@the_gamer2416
@the_gamer2416 4 дня назад
Bhai tujhe hindi m bolne m koi prblm h ..
@DarshilParmar
@DarshilParmar 4 дня назад
nahi par mera audiance 60% international hai toh english me bolta hu aur mera hindi Mumbai wala tapori jaisa hai Aur data engineering me ho toh English aana important hai kyu ki sari cheeze english me he hai
@the_gamer2416
@the_gamer2416 4 дня назад
@@DarshilParmar bhai ek humble request h.. Hindi m bhi video bna loo.. Mujhe english m starting m samjhne m problem hota h.. Aur tapori type lang chalega koi dikkat nhi h.. M bhi delhi se hu.. Yaha pr sab chalta h
@user-fz4to7bd6k
@user-fz4to7bd6k 4 дня назад
I watched this video till the end!
@user-fz4to7bd6k
@user-fz4to7bd6k 4 дня назад
I am going to become a data engineer!
@bombay_8368
@bombay_8368 4 дня назад
Can I use this same path to become a Database engineer as well? I'm assuming yes
@dhruvingandhi1114
@dhruvingandhi1114 4 дня назад
Great efforts!!!
@user-pk8wi3of6t
@user-pk8wi3of6t 5 дней назад
Sir Please courier all three books in my address. I have no money to buy it. Address: hazaribag, jharkhand 825301
@kantabenparmar-cp2yl
@kantabenparmar-cp2yl 5 дней назад
Mere Bhai ka naam darshil hai
@kantabenparmar-cp2yl
@kantabenparmar-cp2yl 5 дней назад
Mere Bhai
@ishwarsinggirase-lc9lk
@ishwarsinggirase-lc9lk 5 дней назад
But the question is there are no openings for freshers in data engineering
@shashankgupta3549
@shashankgupta3549 5 дней назад
Thanks Bhai, I was able to crack an Interview thanks to this tutorial!
@DarshilParmar
@DarshilParmar 5 дней назад
Congratulations mate!
@RaghulS-nl6wx
@RaghulS-nl6wx 6 дней назад
i am gonna take exam in 25 days
@danieldmello6485
@danieldmello6485 6 дней назад
Can a person from non it background become data engineer @darshan
@RanjithSenthilKumar-pw5gq
@RanjithSenthilKumar-pw5gq 6 дней назад
Im data engineerof top MNC and im from 2026 !
@hallbergpartick4929
@hallbergpartick4929 6 дней назад
Thanks for sharing! I cleared the DP-203 exam with a score of 890. I also found Skill-cert-pro practice sets to be really helpful and closely aligned with the actual exam. Scoring around 85% from their sets was a solid indicator of readiness. Their detailed explanations were invaluable for understanding concepts. the instructor notes they provide are a fantastic resource for last-minute study sessions. Being familiar with topics like data lake storage, SQL databases, and implementing logging and alerting mechanisms is crucial as most questions seem to come from these areas. Good preparation and dedication are key to success in this certification.
@rk-ej9ep
@rk-ej9ep 6 дней назад
Nice explanation..plz do series on spark.
@DarshilParmar
@DarshilParmar 6 дней назад
I have a course on Spark, please check description
@invincibleindian7173
@invincibleindian7173 7 дней назад
Suggest a platform to learn all the topics you have mentioned
@tushardhurandhar1078
@tushardhurandhar1078 7 дней назад
I am gonna become data engineer
@estebandiaz4405
@estebandiaz4405 7 дней назад
I'm stuck on the 'db-dtypes' error, installed the package accordingly but still getting the same issue.
@PythonWithPawan
@PythonWithPawan 7 дней назад
Can you do similar kind of project in Azure.😊
@mogleymogley9587
@mogleymogley9587 7 дней назад
A MUST SAVE VIDEO ✅✅✅
@studybiz5515
@studybiz5515 7 дней назад
How to start freelance
@safkaify7875
@safkaify7875 7 дней назад
Well spoken, short with all the needed information. Good presentation. I would recommend NOT TO INCLUDE background music as it is, in my opinion, quite a distraction and annoying.
@AbdulkhamidNasriddinov
@AbdulkhamidNasriddinov 7 дней назад
pronunciation😁
@beratsalihcinar7686
@beratsalihcinar7686 7 дней назад
you're the best
@tesseract_d
@tesseract_d 7 дней назад
Thanks Darshil this was very imformative and a Good learning Project journey for me as Data Engineer! Kudos please keep posting such Projects!
@jayadevvasudevan4870
@jayadevvasudevan4870 8 дней назад
Love this video. Can you create a video on obsidian thank you!
@m.abdullahmansoor4925
@m.abdullahmansoor4925 8 дней назад
Thank u so much bro I copy pasted all of your video content and eventually got the best project in the class. ❤️
@PSA134
@PSA134 8 дней назад
hi bro , aws or GCP .. want to become a data engineer , learning pyspark..
@RaghulS-nl6wx
@RaghulS-nl6wx 8 дней назад
Anyone in 2024 took the Cloud Academy course and cracked the DP 203 exam I am in mind of taking the cloud academy course is it good for preparing through it someone plz
@thepakcolapcar
@thepakcolapcar 8 дней назад
Hello @darshil I do see there an couple of comments below mentioning 403 error. I am getting same execution error as pasted below. Any idea what must be missing and steps to follow that could help resolve below execption? Thanks ExecutionError: An error occurred while calling o393.mount. : Operation failed: "This request is not authorized to perform this operation.", 403, HEAD, [MY-STORAGE-ACC].dfs.core.windows.net/poc-research/?upn=false&action=getAccessControl&timeout=90
@silhouettejadeite2274
@silhouettejadeite2274 8 дней назад
Thankyou so much bro. I was just so confused looking at all the videos out there. Now I won't have to brainstorm this heavily.
@ericking4514
@ericking4514 8 дней назад
nice job - short, to the point, great info. I really appreciate you sharing this. will like and subscribe.
@farlazaro
@farlazaro 8 дней назад
hi Darshil, thanks for your had work on doing these projects. I've learned so much! However, I have an issue: everytime I pass the dataframes to dictionary format, Mage restarts the kernel. It says that my memory is overloaded. I went ahead and increased my VM to e2-standard-8, and it still crashes. I went ahead and created a Data Exporter, and when I hit save or create, I don't see it in my files or in the tree. Any idea what the problem could be?
@VinodPolinati
@VinodPolinati 4 дня назад
hey man same error here did you solve it?
@farlazaro
@farlazaro 3 дня назад
@@VinodPolinati sorry, nothing. I deleted my cached files and reinstalled chrome and nothing.. not sure what is the issue
@HarshThakran101
@HarshThakran101 39 минут назад
Same is happening with me, dont know what is wrong