CRAWL AND DIAGNOSE

Technical SEO audit

Crawl up to 100 pages to find indexability, metadata, heading, linking, response, and content issues with a practical technical SEO audit.

✓ No credit card required ✓ High-performance crawler ✓ 5 free checks daily

Run a focused crawl that explains what is wrong at page level. The audit follows robots and sitemap discovery, records response evidence, and groups issues into an actionable report.

CAPABILITIES

What you can do

Indexability checks

Review status codes, robots directives, canonical signals, and crawl access across discovered pages.

Metadata review

Find missing, weak, or duplicated page titles and descriptions without inspecting pages manually.

Page structure

Check headings, word count, internal links, and basic content signals for every crawled URL.

Stored audit history

Keep audit results with the project so fixes can be reviewed against later crawls.

WORKFLOW

From data to action

  1. 1

    Discover

    Start from the homepage, robots.txt, and available sitemap URLs.

  2. 2

    Crawl

    Inspect up to 100 same-site pages within the free operating limit.

  3. 3

    Fix

    Open grouped issues and page evidence instead of working from a single opaque score.

COMMON TASKS

Run a robots-aware technical SEO crawl with page-level evidence

The audit is built for small websites and focused checks where exact URLs, issue counts, and crawl diagnostics matter more than a decorative score.

Crawl up to 100 pages for technical SEO issues

Discover URLs from the homepage, internal links, robots.txt, and sitemap files while staying within the configured page limit.

Find duplicate titles and meta descriptions

Group repeated metadata across crawled pages and retain the affected URL evidence in the audit history.

Diagnose robots-blocked and failed URLs

See discovered, fetched, blocked, failed, redirected, and page-limit counts separately from on-page issues.

Audit canonical tags and link hierarchy consistency

Verify that all pages define self-referential or intended canonical URLs and prevent canonical mismatches across HTTPS and trailing slash variations.

Detect thin content, broken 404 links, and missing alt attributes

Identify pages below 200 words, broken internal hyperlinks, and images lacking descriptive alt text across the crawl.

SPECIFIC QUESTIONS

Questions this workflow answers

Does the technical SEO crawler respect robots.txt?

Yes. It prefers rules for SerpOrbitBot, falls back to the wildcard group, supports Allow, Disallow, wildcards and end anchors, and excludes blocked URLs from fetching.

What does the free technical SEO audit check?

It reviews response status, titles, descriptions, H1s, canonical tags, robots directives, language, image alt text, thin content, duplicate metadata, and crawl diagnostics.

How does the crawler avoid duplicate tracking URLs?

Discovered URLs are normalized by removing fragments and common tracking parameters, sorting query parameters, and deduplicating before queueing.

Why are duplicate title tags and meta descriptions bad for SEO?

Duplicate metadata forces search engines to guess which page is most relevant for a given topic, diluting keyword focus and frequently resulting in lower organic CTR or incorrect snippet generation.

How does heading structure (H1, H2, H3) affect technical SEO?

A logical heading hierarchy provides clear semantic structure for search bots and assistive tech. Every indexable page should feature exactly one distinct H1 followed by structured H2/H3 subheadings reflecting core topic entities.

OUTCOME

A page-level technical backlog grounded in crawl evidence rather than generic recommendations.

Create a project