Discover how Google and bots crawl your website.
Detect and fix crawl errors, optimize your crawl budget.
Profit from a better natural SEO and more organic search.
Nothing to install ! Upload your logs and let SpiderLog do the magic.
Check your daily reports and monitor your crawl. Detect errors and unexpected/wasted crawl.
Improve your crawl by removing bad links and restructing your website.
Profit from a better natural SEO and much more organic traffic.
Get a true insight on what happens on your website :
SpiderLog extracts a lot of metrics about crawlers from your logs.
Use this usefull information to restructure your website and improve the crawl.
Having a big crawl budget and a high crawl rate is not enough.
What If Google crawls a lot of pages, but only irrelevant pages ?
Identify the uncrawled and overcrawled pages by comparing the Google crawl with the sitemap or custom list of URLs.
Identify quickly inactives pages : crawled page which doesn't get organic traffic.
Page speed is not only a ranking factor, it is also important to keep your visitor on your website.
Most web server can log request execution time by just editing the log format directive.
SpiderLog extracts the page speed so you can view the average and historic of execution time for each page and tags.
You can retrieve and filter data by HTTP status code and error code.
You can not only view crawl error, but also identify the sources of the error in the referrers page.
This way you can identify and remove bad links and invalid pages very quickly.
That's not all, SpiderLog include a lot of others features :
And more to discover ! SpiderLog is in active developpement. We listen carefully to our customers and continue to add useful features.
The service is suspended for an indefinite period of time
Need more information or a custom solution ? Contact us to learn more : firstname.lastname@example.org.