London Web Factory

SEO Spider Articles

Practical notes on SEO Spider.

Upgrading

Use this guide when installing a newer release over an older copy of LWF SEO Spider.

Learn more

Troubleshooting

This guide covers common installation, browser, crawl, result and registration problems in LWF SEO Spider.

Learn more

Responsible Crawling

LWF SEO Spider is designed for SEO, accessibility, content, quality-assurance and technical analysis. Use it only where you have a lawful and reasonable basis to send crawl requests.

Learn more

How the Crawler Works

This guide explains how LWF SEO Spider discovers, requests and records URLs. It is intended to make the figures in Crawl Results reproducible and easier to interpret. For the calculation rules behind link columns, see How Link Metrics Are Calculated. For a field-by-field reference, see Result Variables and Column Glossary.

Learn more

Responsible Crawling

LWF SEO Spider is designed for SEO, accessibility, content, quality-assurance and technical analysis. Use it only where you have a lawful and reasonable basis to send crawl requests.

Learn more

How the Crawler Works

This guide explains how LWF SEO Spider discovers, requests and records URLs. It is intended to make the figures in Crawl Results reproducible and easier to interpret. For the calculation rules behind link columns, see How Link Metrics Are Calculated. For a field-by-field reference, see Result Variables and Column Glossary.

Learn more

Crawl Results and URL Details

The Crawl Results tab is where crawled data appears while a crawl is running and after it finishes. The table combines raw observations, such as HTTP Status Code, with derived classifications, such as Indexability Status and Canonical Status. The complete calculation reference is Result Variables and Column Glossary.

Learn more