Create a Streaming Data Lake on Cloud Storage: Challenge Lab  

👍🏻

Glad you like the video keep supporting✌️

👍🏻👍🏻

what issue are you facing will you please share the error screenshot on telegram ?

Actually earlier the lab was working fine but now after creating the app sometimes it not recognise the step that why I added sleep

Okok I see!! Btw it worked perfectly fine after removing the sleep command !! ❤️❤️

Congratulations 👏

What error are you getting ?

1st thing do perform the lab in us-east1 zone 2nd as I explain in the video we have to wait for output like as worker as started the zone but now it's will not give that output because they updated the lab recently 3rd after waiting for 10-15 minutes just do to dataflow and check is there any job is running if yes then just again wait for 5 minutes and refersh the page and check is that job is still running for 5 minutes or not if yes then congratulation you are done with the lab just go and check the score if job is failed then wait for sometime and perform the lab NOTE:- After update we have to just check is job is running or not if job is running then just simply check the score I hope this will helps you

Run one command at a time

@@quick_lab ok means form beginning one by one ?

What is region for you ??

@@quick_lab everytime region is coming different one there was west and from now it's showing east

export TOPIC_ID=topic1 export REGION=us-central1 export MESSAGE="Hello!" AE_REGION=us-central PROJECT_ID=$(gcloud config get-value project) export BUCKET_NAME="${PROJECT_ID}-bucket" gcloud services disable dataflow.googleapis.com gcloud services enable dataflow.googleapis.com gsutil mb -c standard -l $REGION gs://$BUCKET_NAME #gsutil mb gs://$BUCKET_NAME gcloud pubsub topics create $TOPIC_ID gcloud app create --region=$AE_REGION gcloud scheduler jobs create pubsub quicklab --schedule="* * * * *" \ --topic=$TOPIC_ID --message-body="$MESSAGE" gcloud scheduler jobs run quicklab #--------------------------------------------------------- git clone github.com/GoogleCloudPlatform/java-docs-samples.git cd java-docs-samples/pubsub/streaming-analytics mvn compile exec:java \ -Dexec.mainClass=com.examples.pubsub.streaming.PubSubToGcs \ -Dexec.cleanupDaemonThreads=false \ -Dexec.args=" \ --project=$PROJECT_ID \ --region=$REGION \ --inputTopic=projects/$PROJECT_ID/topics/$TOPIC_ID \ --output=gs://$BUCKET_NAME/samples/output \ --runner=DataflowRunner \ --windowSize=2"

Just ran one command at a time

ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-s-psIayBLg8.html sorry for the delay but lab will not take time to complete I hope you like it

What error are facing on those task?

​@@quick_labIn Task 2 error is please create the cloud scheduler job to publish messages Task 4 error is please run a dataflow pipeline job with required configuration

Same error

@@parimal2210 re run the commands for task 2 and 4

Just do one thing, run one command at a time

Just go to your data flow and just check what error are you getting on your pipeline if you are getting error like zone is not available. Do let me know.

@@quick_lab In Task 2 error is please create the cloud scheduler job to publish messages Task 4 error is please run a dataflow pipeline job with required configuration

Instead of running all the commands just run one command at a time

@@quick_lab ok

Congratulations

Do one thing run one command at a time do not turn all the commands

then it will complete

Yes you can instead of use it us-central-1 use us-central

This lab is broken kindly reach out to chat support and ask then to fix it

Do one thing, just run one command at a time and make sure that you have to just use only US east 1 region

@@quick_lab still Task-2 not checked ..I tried this already

export TOPIC_ID=topic1 export REGION=us-central1 export MESSAGE="Hello!" AE_REGION=us-central PROJECT_ID=$(gcloud config get-value project) export BUCKET_NAME="${PROJECT_ID}-bucket" gcloud services disable dataflow.googleapis.com gcloud services enable dataflow.googleapis.com gsutil mb -c standard -l $REGION gs://$BUCKET_NAME #gsutil mb gs://$BUCKET_NAME gcloud pubsub topics create $TOPIC_ID gcloud app create --region=$AE_REGION gcloud scheduler jobs create pubsub quicklab --schedule="* * * * *" \ --topic=$TOPIC_ID --message-body="$MESSAGE" gcloud scheduler jobs run quicklab #--------------------------------------------------------- git clone github.com/GoogleCloudPlatform/java-docs-samples.git cd java-docs-samples/pubsub/streaming-analytics mvn compile exec:java \ -Dexec.mainClass=com.examples.pubsub.streaming.PubSubToGcs \ -Dexec.cleanupDaemonThreads=false \ -Dexec.args=" \ --project=$PROJECT_ID \ --region=$REGION \ --inputTopic=projects/$PROJECT_ID/topics/$TOPIC_ID \ --output=gs://$BUCKET_NAME/samples/output \ --runner=DataflowRunner \ --windowSize=2" Try this just changes values according

@@quick_lab Thanks buddy ...Last try from my side

​@@quick_lab Can you complete this lab if i give you my id and password

When you are performing this lab, make sure that the region is not set to us-central1 because for now this region is having issues. If you get a region, just restart the lab and use a different region.

@@quick_lab i tried it that way too...still it is not working....it's better you have to upload video that way also.

@@quick_lab on while searching the video for this lab..this video is the only video we got for the same. That's the reason I told you so.

Do one thing run one command at a time

@@quick_lab thank you for help yauuup it worked 👍👍

@@sachinchadotara3532 bhai kaese kiya plzz bta do maine ek ek krke bhi try kr liya last command mai failed bta rha hai ek baar plzzz bta do bhai pllz

Instead of running all the command just run one command at a time

@@quick_lab not working that way also

Do one thing run 1 command at a time do not run all the commands okay

I just tested the lab and it’s working fine for me. Will it be possible for you? Will you share the screenshot on telegram?

Do one thing instead of running all command, just simply run, one command at a time

Run one command at a time buddy

What it your region??

@@quick_lab us-central1

A quick Note : For ARC110, If you are getting us-central1 as your region in lab instructions Then while creating App Engine, keep region as us-central not us-central1 Its a trick. Kindly run one command at a time okay and if you get a region like us east 4 the restart the lab again because that region having issue After all this if you still faced the issue kindly let me know

Now how to resolve the issue?

gcloud app delete--region=$REGION Did you join the telegram group?

t.me/Quicklabchat/80258 just tested the lab and it’s working perfectly fine kindly i request you please watch the video carefully and then perform if possible please share the error screenshot on telegram

This is the issue from qwicklab site. Please reach out to them and let them know.

Kindly share error screenshot on telegram

@@quick_lab same problem task 2 not completing

@@quick_lab can you please this task ..i give you my id and pass

Just share the error screenshot on telegram buddy and let us know the region

@@quick_lab done i have complete the Lab Finally after 9 attempt

I just test this lab and it’s working fine. I request you please perform the lab again

@@quick_lab yes it is working fine now, thankyou sir

Welcome 🤗

@@kamranliaquatali9459 hy i m not able to complete task 2 and task 4 can u please tell me how to done it? please

Just run one command at a time

This issue from qwiklabs side buddy kindly reach out to then and then to fix it