How to Get Rid of the Search Bot
Search engines such as Google, Bing and Yahoo! use a technology called bots to index websites. The bots scan and crawl the content of your Web pages and use this information to determine your website ranking in the search engine. This process is done automatically by the search engines. You can block the search bots from accessing your site if your site is private and you don’t want it to be indexed in the search engines.
Instructions
-
-
1
Click “Start,” “All Programs,” “Accessories” and “Notepad.”
-
2
Type the following text into the Notepad document:
“User-agent: *
Disallow: /” -
-
3
Click “File” and then “Save As” from the top menu.
-
4
Type “robots.txt” in the name field and click “Save.”
-
5
Locate the "robots.txt" file on your computer, right-click it and select “Copy.”
-
6
Launch an FTP program to access your website.
-
7
Click inside the root folder of your website files, right-click it and select “Paste.”
-
1