If you guys want to learn more about data engineering, then sign up for my newsletter here seattledataguy.substack.com/ or join the discord here discord.gg/2yRJq7Eg3k
The explanation is interesting, I immediately subscribed. I want to try something, which is transforming SQL to NoSQL, do you think that is interesting and still within the realm of data engineering? Is it possible to use a hybrid of SQL and NoSQL data? And is it possible to implement the CDC approach in transforming SQL to NoSQL?
Is it necessary to implement CDC when transferring data from source systems to the data lake? Alternatively, does CDC play a role specifically when working with the data warehouse? Or does its implementation depend solely on the business requirements?
Really good info and I am always glad to see MySQL and Postgres being used in a company/work use as the bigger budget names seem to always take the light. Now to the important part....whats the cats name @6:55
It's generally just good practice to read from a replica database when pulling data from analytics because yes, ther is always a risk that whether you're pulling from tables or the WAL that the operational system may be impacted. Also here is a great video talking about the WAL very in depth ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-wI4hKwl1Cn4.html
Hi! Thanks for your videos,they are unimaginably helpful! Can you please make a video on how to transition from junior data engineer to junior machine learning engineer(jr.MLE) or just MLE? Thanks!!
