Тёмный

Data Architects Vs Data Engineers - Is There A Difference? 

Seattle Data Guy
Подписаться 96 тыс.
Просмотров 12 тыс.
50% 1

Data architects vs data engineers.
I get asked this question a lot.
Perhaps people just want to know what the salary difference is between data architects vs data engineers.
or maybe the skills.
So I finally put together a video on the topic.
If you enjoyed this video, check out some of my other top videos.
Top Courses To Become A Data Engineer
• Top Courses To Become ...
What Is The Modern Data Stack - Intro To Data Infrastructure Part 1
• What Is The Modern Dat...
If you would like to learn more about data engineering, then check out Googles GCP certificate
bit.ly/3NQVn7V
If you'd like to read up on my updates about the data field, then you can sign up for our newsletter here.
seattledataguy.substack.com/​​
Or check out my blog
www.theseattledataguy.com/
And if you want to support the channel, then you can become a paid member of my newsletter
seattledataguy.substack.com/s...
Tags: Data engineering projects, Data engineer project ideas, data project sources, data analytics project sources, data project portfolio
_____________________________________________________________
Subscribe: / @seattledataguy
_____________________________________________________________
About me:
I have spent my career focused on all forms of data. I have focused on developing algorithms to detect fraud, reduce patient readmission and redesign insurance provider policy to help reduce the overall cost of healthcare. I have also helped develop analytics for marketing and IT operations in order to optimize limited resources such as employees and budget. I privately consult on data science and engineering problems both solo as well as with a company called Acheron Analytics. I have experience both working hands-on with technical problems as well as helping leadership teams develop strategies to maximize their data.
*I do participate in affiliate programs, if a link has an "*" by it, then I may receive a small portion of the proceeds at no extra cost to you.

Развлечения

Опубликовано:

 

21 сен 2023

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 21   
@chasedoe2594
@chasedoe2594 10 месяцев назад
For me, I has been forced by the project to be defacto data architect. I was Lead Data Engineer but we were implement our cloud data platform project and at the time I am the only senior DE, the rest of my team is all junior. So the job just force me to be an architect. Now my position still called DE but I rarely built pipeline myself. I am more like a team lead + architect role most of the time design the high lv solution, do some POC, give consultation to the juniors and a lot of meetings!
@tomastruchly9484
@tomastruchly9484 10 месяцев назад
Yeah as Lead Data Engineer I am trying to avoid this reclassification as I really love not only to design, but also to develop the stuff
@personalbranddata
@personalbranddata 10 месяцев назад
In my opinion that's how someone ought to become a data architect. You should be a senior (or lead) data engineer first. When hiring someone as a data architect who hasn't worked as a data engineer himself you might end up with the architect taking decisions that aren't aligned with the needs of the engineers which slows down the entire project. Software architects aren't data architects.
@LoveisHell85
@LoveisHell85 10 месяцев назад
Thanks for not showing ads. You’re the best
@SeattleDataGuy
@SeattleDataGuy 10 месяцев назад
I don't have complete control of that. Googles new rules now state that they can show ads whenever they want and if you chose not to collect the youtube payout then they'll just take all of it.
@RetaxChennai
@RetaxChennai 5 месяцев назад
Great video! Thanks a lot
@mrpolyglottobe1358
@mrpolyglottobe1358 10 месяцев назад
Are data architect role meant for someone who has vast experienced in building data pipelines? i've seen a company hired junior to do data architect work despite lacking experiences as data engineer which i think kinda weird.
@miguelfernandes6533
@miguelfernandes6533 10 месяцев назад
By the way what is the song in the end of the video?
@AlexMar-r
@AlexMar-r 8 месяцев назад
Hey mang , love your channel , I been working as a Data analyst in financial services for the past year . I have no rush to become data engineer but if it happens happens , which Course would you recommend That covers most of the skills A data engender needs ? Thanks 🙏 .
@anhquan5628
@anhquan5628 10 месяцев назад
Should I study IBM's data engineer certificate or study each cloud, SQL, python, ... certificate on cousera? Everyone give me advice. I learned basic C, Python and SQL in college.
@pulicinetroll7417
@pulicinetroll7417 9 месяцев назад
Hi, I am thinking of transitioning into tech from a mechanical engineering career. Would you recommend any graduate degree to get into data engineering?
@princysingh1398
@princysingh1398 4 месяца назад
Thanks a lot
@SeattleDataGuy
@SeattleDataGuy 4 месяца назад
Happy to help
@ivanooo117
@ivanooo117 10 месяцев назад
Thanks, Ben! Would you make a video about data quality? I found myself recently using a library called Great Expectations to test the quality of data produced by my pipelines. Also a video about data catalogs would be cool. Would be great to hear your thoughts on these topics!
@SeattleDataGuy
@SeattleDataGuy 9 месяцев назад
Great suggestion! I actually am working on an article on the topic so it might be a good idea to make a video part as well!
@mariobroselli3642
@mariobroselli3642 4 месяца назад
Is there a Software Developer for architecture?
@Cadet1249
@Cadet1249 9 месяцев назад
Do data engineers always focus on pipelines for data analytics? Or is there a role more geared to improving/automating data business processes and the business’s overall data infrastructure?
@samilaine7075
@samilaine7075 7 месяцев назад
Widely educated and experienced data architects and data-focused enterprise architects tend to focus more on improving and automating data business processes. Enterprise architect might collect information, draft blueprints, and manage changes to a) business architecture, b) data architecture, c) application architecture, d) technology architecture. Examples of blueprints might be a) business process and task workflow models, b) data asset to system mappings and concept models, c) data platform reference model and data warehouse implementation architecture, d) technology standards handbook and datawarehouse technology architectures. When I have done these, its typical that you have or it is useful to mix a few levels together. For example, bundle application architecture and technology architecture to a same blueprint or business and data architecture. In practice, the same Visio- or ppt-diagram includes application level items (Dynamics CRM, Azure data lake, PowerBI reports) and technologies (REST API between CRM and Azure, MS Stack as enterprise standard, DAX syntax in reports etC). Or combine business process items (sales, contracting, customer service, etc) to data layer (entities like consumer customer, sales product, service contract etc) to map their relations. Depending on the skills and background of the architect, they might work more on strategic level focusing on high level resources, policies and practices or more on operational and technical level like modeling logical data models and gathering detailed requirements for software projects. According to my experience, data engineers do not really work directly with business, draft business blueprints and take part of organizational implementation tasks - business layer. Unless organization quite a small and the same person has to be enterprise architect, data engineer and data analyst at the same time. In general, data engineers are most likely not expected to design business processes or strategies, for example.
@joaovitorrabelo7175
@joaovitorrabelo7175 10 месяцев назад
Great video Ben! This is an important analysis that we must do consistently as Data professionals, to clearly understand what our responsibilities are! Yesterday I was reading Oreilly's book - Fundamentals of Data Engineering - and as you shared It seems that the Data Architect is closer to the business than the Data Engineer. And if we clearly understand the difference between the two roles it will be more productive for both. I'm currently working as a Data engineer, but I'm trying to thriller a path to becoming a Data Architect. Thanks for sharing your thoughts
@nitinjain7228
@nitinjain7228 9 месяцев назад
Can you suggest where I can learn Data Engineering courses?
@SeattleDataGuy
@SeattleDataGuy 9 месяцев назад
Yeah! I actually have a video on this, the courses are still relevant - ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-kW8_l57w74g.html
Далее
Поём вместе с CLEXXD🥵 | WICSUR #shorts
01:00
🎙СТРИМ на 4 МИЛЛИОНА🍋
3:12:45
Просмотров 1,3 млн
Data Connection in 10min
9:23
Просмотров 2 тыс.
Data Architecture vs. Data Engineering Deep Dive
33:56
Просмотров 3,6 тыс.
The Harsh Reality of Being a Data Engineer
14:21
Просмотров 225 тыс.
ускорил очередь на кассе
1:00
Просмотров 2,5 млн
Пранк над Махачевым🥶
0:19
Просмотров 11 млн