For site owners

AskRobots is an independent search engine with its own crawler. These tools show how it sees your site, and let you tell it what to read.

Is this page in AskRobots?

• Add a pageMissing something? It's searchable in seconds.
• Test robots.txtWhether our crawler may read an address, and the rule that decides.
• Page statusWhat we know about a page: in the index or not, and when we read it.
• About the crawlerHow AskRobotsBot behaves, how to recognise it, block it or slow it.

Your site

Prove a site is yours with a file, a meta tag or a DNS record, and you get its report (pages in the index, crawl problems, robots.txt, links, the searches that brought people), and can ask us to read pages again, take a sitemap, or review a removal.

Good to know

• A proof lasts 30 days; check again to renew it. A whole domain (proved with DNS) covers all its sites.
• Proving a site on search.askrobots.com's own webmaster page doesn't carry over to these pages, or the other way round.
• The report counts visits from our results (clicks). We don't record yet how often your site was shown without a click.
• The quickest way to keep pages out is robots.txt: it always works and needs no contact with us (how).