Hi , Welcome to my channel. In my this channel , you can get videos related to Cloud Data Engineering techstack like AWS, Snowflake, Big Data Frameworks etc. Hope my this channel will help you in boosting concepts. Enjoy the subject and my videos. Thank You. Have a great day.
Hi Can you pls make a seperate youtube playlist consolidating all snowflake concepts into one ??? I need to go through all snowflake concepts at once..
Hi @rahul2506, all my Snowflake videos are available in below link in organised manner-- doc.clickup.com/37466271/d/h/13qc4z-104/d4346819bd8d510 Hope this will be helpful to you
@@KnowledgeAmplifier1 thanks man. Also a request, if any new snowflake video comes up, do update this doc as well so that, we can refer this as one shot.
Hi all !! I got an issue here , suppose I have 25 millions of records in DynamoDB , I want to store all the data from there to MariaDB after some transformation using python , but fetching data from DynamoDB using boto3 is very slower like 27k records in an hour, any one knows efficient way , Thank you in advance .
I wish to read data Realtime from Snowflake, Would you please elaborate what could be the possible options? If possible what are the pros and cons of the approaches. I wish to avoid the use stream, if possible since it will require using tasks which have to be triggered every few minutes rather than triggering as soon the data is available. Also, if we use external share along with it, multiple files will be created.
@karangupta_DE, for a business use case, RAG is generally better for dynamic environments where up-to-date, real-time information is essential. It efficiently retrieves and uses external knowledge without frequent retraining. Fine-tuning, on the other hand, is ideal when you need high accuracy in domain-specific tasks and want to customize the model’s behavior or writing style. However, it requires more resources and becomes static over time. If your use case involves dynamic data and cost efficiency, RAG is a better fit. For specialized, static tasks, fine-tuning excels.
Find a path between any two given points in image using 4, 8, and m path process Can anyone tell me how to do this question?? And also Any other option than Matlab ?? Free ??
@venugopal-nc3nz, both Snowflake and Databricks have their strengths, and the choice depends on your specific use case. If you're someone who enjoys working with SQL and wants a platform that simplifies data management, Snowflake is a fantastic option. It's incredibly easy to use, and with Snowflake’s latest additions (Snowpark), even those familiar with PySpark will find it versatile. Plus, if you're diving into machine learning or LLMs, Snowflake allows you to do this directly with SQL using Snowflake Cortex functions-no need for complex setups, making the process much smoother. So personally I have preference on Snowflake ..
You have covered many in depth concepts of Kafka. I couldn't find how transaction is processed . Could you please create a video how to handle transactions in kafka
@dharmmaurya-n7c, can you please be more clear what you want to see as practical? I have already explained the theory in-depth in the previous video, so this video is about practical implementation, not sure whether you checked that before this video or not, the link is available in the description box, sharing here too, for your reference -- ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-QTi_oQhxARs.htmlsi=u2OnTPSeT1_JGX8t Please let me know if you are expecting something else ..
Thank you for the good lecture. I have a question, so I leave a comment. I understood that if the electron absorbs energy (from + potential to - potential), the metal is cooled, and if the electron emits energy (from - potential to + potential), the metal is heated up. But in another lecture, saying that when the electron in metal absorbs energy(from + potential to - potential), the thermal energy of the metal(containing the energy absorbed electron) gets heated up. (ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-PccE4WcfnAw.htmlsi=8B_ukyIvy5iFDocn) It's the opposite of the lecture content, and I want to know which is right. If possible, please give me some advice.
@karangupta_DE, here is a video on RAG on Snowflake -- ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-EZnmuerbKb8.htmlsi=blv7mVBBoeZpy_3Y Hope it will be helpful to you!!
If you're working with text data, then yes, @Aman-lv2ee! 🎯 For other unstructured formats like audio, video, or images, Snowflake doesn't yet offer the full range of capabilities that AWS provides for Generative AI.
Excellent content, to the point! Basically it boils down to, are we processing snapshot/ state of the transaction/ already aggregated data Vs events that are occuring at the source on a particular entity and are flowing as then happen. SQS for the former and Kafka for the latter.