The Screaming Frog SEO Spider is a website crawler that helps you improve onsite SEO by auditing for common SEO issues.
Download & crawl 500 URLs for free. No sign-up required, no time limit. Identifies 300+ SEO issues across technical, on-page, performance and content dimensions.
v21.0AI API Integration · Accessibility · Email Notifications
v20.0Custom JS Snippets · Mobile Usability · Carbon Footprint
v19.0UI Refresh · Segments · 3D Visualizations
What can you do with the SEO Spider?
Identify over 300 SEO issues, warnings and opportunities to improve SEO, website health and user experience.
Find Broken Links
Crawl a website and find broken links (404s) and server errors. Export source URLs for developer handoff.
Audit Redirects
Find temporary and permanent redirects, identify redirect chains and loops, or upload a URL list for migration auditing.
Analyse Page Titles & Meta Data
Identify titles and descriptions that are too long, short, missing or duplicated across your site.
Discover Duplicate Content
Find exact duplicate URLs via MD5 hash, partial duplicates in titles and headings, and low content pages.
Extract Data with XPath
Collect any data from page HTML using CSS Path, XPath or regex — prices, SKUs, social meta tags and more.
Review Robots & Directives
View URLs blocked by robots.txt, meta robots or X-Robots-Tag noindex/nofollow, plus canonicals and hreflang.
Generate XML Sitemaps
Quickly create XML and Image XML Sitemaps with full control over URLs, last modified, priority and change frequency.
Integrate with GA, GSC & PSI
Connect Google Analytics 4, Search Console and PageSpeed Insights APIs to enrich all crawled URLs.
Crawl JavaScript Websites
Render pages using the built-in Chromium WRS to crawl dynamic sites — Angular, React and Vue.js supported.
Visualise Site Architecture
Evaluate internal linking with interactive force-directed diagrams, tree graphs and 3D site visualisations.
Schedule Audits
Schedule crawls at chosen intervals and auto export to any location including Google Sheets, or run via command line.
Compare Crawls & Staging
Track SEO issue progress between crawls and compare staging against production with advanced URL Mapping.
300+ issues across every SEO dimension
Technical
Broken links & 404 errors
Redirect chains & loops
Blocked resources (robots.txt)
HTTPS / mixed content
Hreflang & internationalisation
Pagination (rel=next/prev)
On-Page SEO
Page titles & meta descriptions
H1, H2 and heading structure
Canonical tags & noindex
Duplicate & near-duplicate content
Thin / low-content pages
Structured data & schema.org
Performance & UX
Core Web Vitals (PSI/Lighthouse)
Mobile usability auditing
Carbon footprint & rating
AMP validation
Accessibility auditing
Image optimisation & alt text
Analysis & AI
Internal linking & anchor text
N-grams content analysis
Semantic similarity analysis
Content cluster visualisation
Crawl comparison & tracking
AI content generation (OpenAI/Gemini)
What SEO experts say
★★★★★
"Out of the myriad of tools we use at iPullRank I can definitively say that I only use the Screaming Frog SEO Spider every single day. It's incredibly feature-rich, rapidly improving and I regularly find a new use case."
★★★★★
"The Screaming Frog SEO Spider is my 'go to' tool for initial SEO audits and quick validations: powerful, flexible and low-cost. I couldn't recommend it more."
★★★★★
"I've tested nearly every SEO tool on the market, but I can't think of any I use more often than Screaming Frog. To me, it's the Swiss Army Knife of SEO Tools."
★★★★★
"The Screaming Frog SEO Crawler is one of the essential tools I turn to when performing a site audit. It saves time when I want to analyze the structure of a site."
// Deep technical SEO guide · 2026
Screaming Frog SEO Spider: the desktop crawler that exposes deep technical defects
Screaming Frog SEO Spider is the desktop crawler technical SEOs reach for when surface-level audits are not enough. The screaming frog seo spider parses raw HTML and rendered DOM side by side, validates canonicals against indexable status, checks every hreflang return-tag pair for reciprocity, flags mixed-content warnings on HTTPS pages, and surfaces soft-404 patterns that cloud platforms routinely miss. Each crawl produces an inventory of exactly what Googlebot would see, with 300+ distinct issue checks layered over the response.
The free tier covers 500 URLs per session without sign-up, the Pro licence lifts the cap and unlocks JavaScript rendering through a bundled Chromium WRS, and version 24 — released 19 May 2026 — adds Model Context Protocol (MCP) support so the engine can be driven from Claude, Cursor or LM Studio. This guide explains what is screaming frog at the engine level, how seo screaming frog catches the structural problems that block indexation, where screaming frog pricing lands in 2026, and how to use screaming frog to improve on page seo across Mac and Windows installs.
Quick answer: screaming frog free crawls 500 URLs without sign-up and runs the same 300+ technical checks as the paid build — canonicals, hreflang return tags, structured-data validation, mixed-content, soft-404 detection and orphan-page reports all included.
Under the hood
What is Screaming Frog and what the engine actually inspects
What is screaming frog, in technical terms: a desktop crawler that issues real HTTP requests, parses both raw HTML and the rendered DOM, follows canonical chains end-to-end, walks every hreflang cluster looking for missing return tags, validates inline JSON-LD against schema.org and Google rich-result rules, and writes every result to a local database you fully control. Because it runs on your machine — Mac, Windows or Linux — crawl data never leaves your laptop, and the only ceiling is the RAM you allocate.
The screaming frog seo tool surfaces 300+ technical defects per crawl: orphan pages absent from internal linking, soft-404s where the server returns 200 but the body is empty, redirect chains longer than two hops, mixed-content warnings on HTTPS templates, non-self-referencing canonicals, broken hreflang reciprocity, missing alternate links, structured-data validation errors, oversized HTML, slow Time to First Byte and dozens more. Seo screaming frog effectively replaces a sitemap generator, a redirect mapper, a schema validator, a hreflang cluster checker and a log-file analyser in one binary — the on-disk source of truth for what search engines actually see when they render the page.
300+SEO issues reported
v24.0May 2026
500 URLsFree tier
3 OSMac/Win/Linux
Version 24 · May 2026
Screaming Frog SEO Spider features built for technical audits
The v24 release on 19 May 2026 sharpened the technical edge that defines the screaming frog seo spider features set. Three additions changed how deep audits get run.
MCP integration
Drive the crawler from Claude, Cursor or LM Studio via Model Context Protocol. Ask the LLM to crawl, diff schema markup, summarise hreflang errors and export the offending URLs — all without touching the UI.
Auto Compare Crawls
Scheduled audits now diff against the previous run automatically. Regression reports land in your inbox with a delta on every technical metric — new canonical conflicts, new orphan pages, new hreflang return-tag errors.
Find Uncrawlable Links
Flags JS-only links the rendering engine cannot follow, plus malformed URLs like hppts://example.com. The spider catches when a Vue.js route returns 200 but renders zero indexable content — a classic soft-404 trap.
Deeper inspection layers: the screaming frog seo tool ships JavaScript rendering through a bundled Chromium WRS for React, Angular, Vue and Next.js sites, raw-vs-rendered DOM diff to spot mobile/desktop rendering gaps, and custom extraction with XPath, CSS Path or regex for pulling any DOM node into its own column.
A built-in structured-data validator verifies JSON-LD, Microdata and RDFa against schema.org and Google rich-result rules, while the companion log file analyser ingests raw server logs to map Googlebot's actual crawl path against your sitemap — the only reliable way to spot crawl-budget waste.
Pricing
Screaming Frog pricing for serious technical audits
Screaming frog pricing is unchanged since 2017 — a flat £199 per year for the Pro licence, free for crawls up to 500 URLs. Both builds run the same 300+ technical checks; the paid tier removes the URL cap and unlocks the integrations a deep technical audit actually needs.
Free forever
£0/yr · no sign-up
Screaming Frog Free
Crawl up to 500 URLs per session
Full canonical, hreflang & redirect-chain reports
Structured-data validation (JSON-LD, Microdata)
XML sitemap generator with lastmod control
Native Mac, Windows, Linux builds
No trial countdown, no expiration
Pro licence
£199/yr · ~$250 USD
Screaming Frog Paid
Unlimited URLs per crawl
JavaScript rendering via Chromium WRS
Custom extraction with XPath, CSS Path, regex
GA4, Search Console, PageSpeed, Ahrefs APIs
Scheduled crawls with Auto Compare diffs
1 licence covers 2 machines (Mac + Windows)
Cross-platform
Screaming Frog on Mac vs Windows for deep crawls
The screaming frog seo spider ships native binaries for Mac, Windows and Linux. Feature parity is exact across the 300+ technical checks; what differs between platforms is install path, default memory ceiling and how comfortably each can render a million-URL JavaScript site.
Screaming Frog on MacUniversal binary · M1 → Tahoe
The macOS build runs as a notarised universal binary on Ventura (13) through Sequoia (15) and macOS Tahoe (26). Apple Silicon shines on JS-rendered audits — an M3 Pro processes a 100k-URL Next.js crawl in roughly half the wall-clock time of a comparable Intel Core i9, because the bundled Chromium WRS scales linearly with available performance cores.
Memory defaults to 2 GB; for deep technical crawls on enterprise sites raise it under Configuration → System → Memory Allocation. The app installs to /Applications/Screaming Frog SEO Spider.app and stores its database under ~/Library/Application Support/Screaming Frog SEO Spider/.
Screaming Frog on Windows64-bit Win 10 & Win 11
The Windows build targets 10 and 11 (64-bit only). Workstations with 32 GB RAM routinely push the allocation to 16 GB inside Configuration → System → Memory, making Windows the comfortable choice for million-URL crawls where database mode keeps the on-disk index fast.
The installer writes to C:\Program Files (x86)\Screaming Frog SEO Spider\ and the database lives under %APPDATA%\Screaming Frog SEO Spider\. No technical-audit feature is platform-locked — canonicals, hreflang validation, log analysis and schema validation behave identically on Mac and Windows.
vs the alternatives
Screaming Frog vs Ahrefs, SEMrush, SE Ranking, DeepCrawl
The most common comparison searches are screaming frog vs ahrefs, ahrefs vs screaming frog and screaming frog vs semrush — but they are not really competing in the same lane. Most agencies run both a crawler and a research platform side-by-side.
vs Ahrefs
Is ahrefs like screaming frog? No.Ahrefs is a cloud SEO platform built on its own backlink index, keyword database and rank tracker. The Ahrefs Site Audit is the closest comparable feature, but it runs on Ahrefs servers and caps audits by URL quota. Screaming frog has no research component — it crawls only, but does so without quotas.
vs SEMrush
Same lane only at audit levelScreaming frog vs semrush — SEMrush's Site Audit competes only on the crawl side; the broader SEMrush platform covers keyword research, competitor analysis and PPC that screaming frog does not touch.
vs SE Ranking
Cheaper cloud platform, not a crawlerSe ranking vs screaming frog — SE Ranking is the budget alternative to Ahrefs and Semrush, also cloud-based, also offering a Site Audit that competes with the crawl-only seo screaming frog. The trade-off is the same: cloud limits and quota vs unlimited local crawls.
vs DeepCrawl
Closest in scope, enterprise pricingScreaming frog vs deepcrawl (now Lumar) is the only true head-to-head. DeepCrawl is a cloud enterprise crawler with unlimited URLs, scheduled audits and team workflows. The screaming frog alternative case for DeepCrawl is strongest at the 1M+ URL scale; below that, the desktop tool is faster and cheaper per crawl.
Five-pass audit workflow
How to use Screaming Frog to improve on page SEO
How to use screaming frog to improve on page seo comes down to a five-pass workflow that fits inside a single afternoon for most mid-sized sites.
Start with a JS-rendered crawl
Set Configuration → Spider → Rendering → JavaScript, then crawl the production domain. JS rendering catches dynamic content that plain HTML crawls miss.
Triage the top three issue categories
Open Reports → Crawl Overview. Usually: missing meta descriptions, duplicate titles, broken internal links. Export each list, fix in CMS, re-crawl staging to verify.
Connect Search Console & GA4
Configuration → API Access. Overlay impressions, CTR and traffic on every crawled URL so you prioritise rewrites where they actually move the needle.
Generate & submit XML sitemap
Sitemaps → XML Sitemap. Build from your clean crawl, exclude redirected and 404 URLs, submit to Search Console.
Schedule weekly Auto Compare
Set a weekly scheduled crawl with Auto Compare enabled. New issues surface in your inbox the day they appear — works identically on Mac and Windows.
This is the workflow that turns a 60-minute crawl into a measurable rankings move. Hit the Download button below to grab the latest build for Mac, Windows or Linux.
Screaming Frog
Download & crawl 500 URLs for free
The industry's most trusted website crawler. No sign-up required. Available for Windows, macOS and Linux.
Yes. Screaming Frog SEO Spider is completely free to download and use. No sign-up, no registration and no time limit. The tool crawls up to 500 URLs and includes all core SEO audit features out of the box.
Screaming Frog SEO Spider crawls up to 500 URLs per session. This is sufficient for auditing small websites, testing specific site sections, or running targeted technical SEO audits. No payment or sign-up required.
Screaming Frog SEO Spider runs on Windows, macOS and Linux. From version 24, native Arm64 Linux is supported. It is a 64-bit application and a single download covers all three platforms.
Version 24.0 (released May 19, 2026) introduced MCP (Model Context Protocol) integration for AI tools, Auto Compare Crawls, crawl change email notifications with attachment exports, uncrawlable link detection, a usage statistics dashboard, and native Arm64 Linux support.
Yes. Screaming Frog includes a built-in Chromium-based Web Rendering Service (WRS) that crawls JavaScript-rendered sites built with React, Angular, Vue.js, Next.js and other frameworks. JavaScript rendering can be toggled per crawl.
Yes. Screaming Frog integrates with Google Analytics 4, Google Search Console and PageSpeed Insights APIs, enriching crawl data with traffic, impressions, click-through rates and Core Web Vitals for every crawled URL.