Cloud & AI Analytics provides tutorials, lectures and guidance on the technology and certifications in popular Cloud Platforms like Google Cloud Platform, Microsoft Azure and AWS . We have a vision of making cloud education accessible to every student for free.
By subscribing to this channel, you will never miss out on high quality videos on trending topics in the areas of Cloud Platforms, Big Data ecosystem, Data Engineering, Data Science, Kubernetes, Docker, Databricks, Machine Learning, Apache Spark, Python, PySpark, DevOps, SQL and many more.
We also help students/professionals in interview preparation. Please reach us without any hesitation.
You can join our WhatsApp group and Telegram group to discuss and get yourself ready for interview. Stay Updated with all Material on GitHub
Please Share, Subscribe and Support us.
If You want to connect with me, connect on LinkedIn
This is very helpful. Could you point me a video or create one on how to upgrade data fusion ? There are pipelines connected. How to do it safely. This video is very helpful.
Thanks for focusing on documentation and detailed breakdown of exam topics. I've just passed the exam and I recommend anybody who starts - please read the documentation carefully, as they will test your deep knowledge and understanding of the topics.
I am unable to create a GCP Composer environment. After around 45 minutes it shows the error "Some of the GKE pods failed to become healthy". I have configured the setting and given the necessary access. I am using composer-2.7.0-airflow-2.7.3. But it failed to create the environment. Can you please help with this? Thanks.
hello bro, i have defined schema in bigquery and i have a dataframe without column name, have millions of rows. i am unable to upload that dataframe in bigquery. can you make a video on that or help me out. thanks
You explained how to recover object form a bucket. Can you also explain with deom if its possible to recover an entire bucket is its deleted accidentally.
No buckets are deleted permanently. In order not to delete accidentally we are enforcing bucket retention policies on cloud storage bucket. Hope it helps
too hurry not able to understand it as you are switching tabs and doing all the things and not mentioning where you are writing the code. The course should be designed so that even beginner should be able to understand it. please make a pin to pin point to point explanation video so that everyone can understand it. Thanks in advance ❤
Thanks for your videos, I find them helpful. I could get the message published by a python script to pub/sub, updated to the data column in a big query table, by simply creating a subscription that writes to Big Query (to the same topic) without using Dataflow. Since pub sub is schema less, it is receiving whatever schema is published by the python script. My question is , is there a way to update a big query table using the same schema received in pub/sub?
Hi, Thanks for the great informative video. can you explain the flow if the data source is from a Rest API. Can we have a dataflow configured to extract from a Rest API to big query with dataflow without having cloud functions or Apache beam scripts involved? Thanks a lot in advance..
What is your background sir. i am a datawarehouse developer and not much knowledge on data science. How to learn data science, ml and vertex ai. Could you please share all training documents
Hey bro. Thanks for the video. I have a ETL process running on VM, using docker and Kafka. And the data is getting stored in big query, as soon as I run the producer and consumer manually. I wanted to use cloud compose to automate this (like whenever I login to my VM the etl process starts automatically), but I couldn’t. Can you tell me if it’s possible to do this with dataflow? I am having trouble setting it up.
You mentioned that you can complete it in 10 days, but the description days 6 months of hand on experience. Can you explain this pls? I am working to complete the course in a months time.
Its an expectation set by Snowflake team but if you have already worked on other DW services like Bigquery, Synapse analytics and Redshift it will be very easy to pickup Snowflake and clear it in your very first attempt.
@@cloudaianalytics6242 I have worked on TSQL and have no prior working knowledge of snowflake. I am learning on my own from snowflake website learning track. Will I be able to crack the exam in 1 month?
@@cloudaianalytics6242 Is 6months of hands on experience required to attempt this test, I do have knowledge on data warehouses but did not work on DW services Bigquery, Synapse analytics and Redshift etc
I am getting below error while trying to run dataflow job: import apache_beam as beam ModuleNotFoundError: No module named 'apache_beam' on both cloud sdk and cloud shell, wheras apache_beam is installed
hii, i need to create a GCP dataflow pipeline using Java. This pipeline should take file in GCS bucket as input and write the data into Bigtable. how to create it please help .
