How to Get Crawled by MetaCrawler

MetaCrawler searches other search engines and compiles all search results as a single list.

Internet search engines, such as Yahoo! and Google, use software spiders that visit a Web page, return the information to the search engine and add the website to its searchable index. Some search engines, called metacrawlers, do not spider Web pages themselves. A metacrawler searches multiple search engines and presents all search results as a single page. MetaCrawler, the oldest crawler on the Net, began in 1995 at the University of Washington. To have your website appear in MetaCrawler's search results, submit the website to Google.

Instructions

Submitting a URL to Google

1. At the Google home page, click the "About Google" link to go to Google's corporate information page.

2. On the corporate information page, look for the "Our Solutions for Site Owners" section and click the "Grow Your Audience" link.

3. On the next page, click the "Add Your URL" Link. You'll find this in the "Web" section.

4. Type or paste your website address into the URL box. Google prefers individual website submissions to mass URL submissions by software bots, so type in the squiggly letters into the box provided to confirm you're a person not a computer. Click the "Add URL" button to finish. Google spiders the Web continuously, but even so, it may take several days for the Google spider to find your website.

Tips & Warnings

• Increase your chance of MetaCrawler finding your site by submitting your URL to Yahoo! as well as Google.

• Broken links interfere with Google's ability to spider a page, so make sure all site links work before you submit your URL.

References

• McCourty, R. (2004). Search Engines: An Introduction
• Sherman, C. (2005). Metacrawlers and Metaseach Engines.
• Google. (n.d.). Add Your URL to Google
• Our Picks. (2011). 10 Things You Should Know Before Submitting Your Site to Google.