Test a complete website for OnPage SEO factors.
Crawl thousands of pages, find missing content, technical errors and much more ..
crawl up to 10.000 pages of one domain!
you will receive an email when the crawl is done
depending on the response time of your server this can take several hours
but you can check
the progress here
why should you
crawl your website
YOUR EMAIL (cause you need to know when the crawl is done)
ONLY CRAWL THIS DIRECTORYS (one per line)
DON'T CRAWL THIS DIRECTORYS (one per line)
IGNORE THE FOLLOWING GET PARAMS (csv)
NUMBER OF PAGES TO CRAWL (10000 max.)
Google Mode (Obey noindex and canonical tags)
Obey robots.txt rules for the choosen user agent
Don't crawl sites with dynamic parameters like