Thank you for this informative video. It shows me how to improve my CSV management skills. Are you planning to make a playlist for Snowflake Native Application development? 🤯 How can we contact you?
Thanks for your note.... the native application development is released recently.. and I need to educate the real use case and implementation and will make a plan. you can reach out to me over instagram (instagram.com/learn_dataengineering/)
Glad I found your channel. Thanks much for your time helping many with hands-on explanation. I'd like to know the future of snowflake career,Is it a good option in future too? To my knowledge, it is not much in market as of now in India (sorry if I'm wrong)
I tried using parse_header = TRUE, but it was failing with the following issue. Error: Error with CSV header: empty string in the header is not allowed File '2023_Tx_raw_counts.csv' Row 0 starts at line 0, column Note :- The file contains a header row with 3000 columns, including "","EMP_ID", "EMP_NAME", "EMP_NUMBER", "EMP_CITY",.......................................... ---> So the error indicates that there is an issue with the header in the file. column1 is an empty string [""] in the header, which causes the error. Can you try to resolve this issue? If necessary, we can ignore column 1 because it is just an index column.
This is a great video. Thank you. Another limitation is name of the file in stage location . If the name of the file is numeric example: 1234_ABC.csv then it throws error. Can you please confirm.thanks
strange... never got any error.. but will try if that works or does not work... but I personally have processed lot of json files that has data-timestamp as file name.. and it worked well without any issue.. can you tell me what kind of issue you are getting...
Here you go.. www.udemy.com/course/automatic-data-ingestion-using-snowflake-snowpark-python-api/?couponCode=DES100 (valid only until 1st week of Sep-2023)
For different date format and time format may be you can try configuring that within the file format like how we do it for copy statement and then check if it supports for infer schema, my guess is it would then infer it properly
Thanks for your note, if you have tried that.. pls share your result.. as per the snowflake documentation (Aug-2023), custom date formats are not supported, that means schema infer will treat them as text instead of data and timestamp.
here is the link (the code is published and www.udemy.com/course/automatic-data-ingestion-using-snowflake-snowpark-python-api/?couponCode=DES100 (valid only until 1st week of Sep-2023)
