London Web Factory

SEO Spider Articles

Practical notes on SEO Spider.

Installation

This guide is for people installing the desktop application from a published London Web Factory download.

Learn more

LWF SEO Spider: Crawling a Website

The crawler loads HTML pages in a visible Chromium-based crawl window and extracts data from the rendered DOM after JavaScript has run. Same-host assets are requested directly so their response data can also appear in results. This page explains how to operate a crawl. For the complete discovery and calculation rules, see How the Crawler Works.

Learn more

Settings, Local Data and Exports

LWF SEO Spider stores settings and crawl data locally on the computer running the app. The files are placed under Electron's per-user application data directory for LWF SEO Spider. The exact parent path varies by operating system and user account.

Learn more

Result Variables and Column Glossary

This reference explains where each value comes from, how derived values are calculated, and what the value does and does not prove. The current Internal Links table contains seven column groups in this order: Page, Content, Structure, Links, Directives, Response and Technical. For the end-to-end collection process, see How the Crawler Works. Link counting has additional examples in How Link Metrics Are Calculated.

Learn more