Methodology v1.1

Measure first. Explain second.

The scanner gathers observable website facts with deterministic checks. AI, when enabled, summarizes those findings but does not decide whether a technical check passed.

Crawl scope

The free MVP crawls up to 10 same-domain pages with a maximum configured crawl depth of 2. It also checks the root robots.txt and an advertised or default sitemap.xml.

Areas scored

The report scores SEO, technical health, performance, content, security and accessibility. Critical findings have the largest deduction, followed by high, medium and low severity findings. The overall score is weighted toward SEO, technical health and performance.

Current checks

Checks include response errors, noindex directives, page titles, meta descriptions, heading structure, canonical declarations, mobile viewport, XML sitemap, robots directives, potential thin content, image alternative text, accessible form names, document language, HTTPS and HTTP-to-HTTPS redirects, mixed content, security headers, structured data, Open Graph metadata and basic response speed. When configured, Google PageSpeed Insights adds mobile Lighthouse measurements.

AI recommendations

If an OpenAI API key is enabled, only structured audit facts are sent to generate a short executive summary. The underlying pass/fail checks and scores remain deterministic. Without an AI key, the same report uses a local rule-based summary.

About the SEOPert crawler

Audits are fetched by a crawler that identifies itself with the user agent SEOPertBot/1.0 and a link to this page. It only runs when a person submits a website, requests at most 10 pages plus robots.txt and the sitemap, fetches pages one at a time, and never submits forms or logs in. Links to files such as PDFs and images are skipped.

Website owners who do not want to be audited can block SEOPertBot at their firewall or in robots.txt. Because each audit is a one-off request made on behalf of a person rather than a search index, contact hello@seopert.com if you would like your domain excluded entirely.

Limits

This scanner does not replace Search Console, a full accessibility evaluation, penetration testing, legal review, analytics, a backlink database or a complete enterprise crawler. JavaScript-rendered content may not be visible to this PHP crawler. Scores should be treated as prioritization aids, not guarantees.