Today in this video we will learn about how to stop search engines from crawling and listing your website. For most websites, search engines are the biggest source of traffic. You may ask, why would anyone want to block search engines?
When starting out, a lot of people don’t know how to create a local development environment or a staging site. If you’re developing your website live on a publicly accessible domain name, then you likely don’t want Google to index your under construction or maintenance mode page.
How to stop Search Engines from crawling and listing your website?
Follow this simple process to stop all Search engines from crawling and listing your website
step::1 Create a Robots.txt file inside public_html of your cPanel
step::2 Edit this rule inside robots.txt file
step::3 You can disallow all search engines from crawling your website with this command:
--------------------------
User-agent: *
Disallow: /
--------------------------
You have to edit this rule inside robots.txt file
Watch the video carefully to stop Search Engines from crawling your website
For more information about Redserverhost Hosting and the services we provide see here:
redserverhost.com
👉Don't Forget! SUBSCRIBE for more interesting Tips!
If you enjoyed this video, please consider following us on Facebook and Twitter.
Facebook Page- / redserverhost
Twitter Page- / redserverhost.com
Thanks for watching my Video. Please Like Share and Subscribe to My Channel
15 сен 2024