Skip to content

Crawlmark Scanning Criteria

The complete reference for every check Crawlmark performs, how results are scored, and why each signal matters. Version 1.0.0 - last updated 2026-04-05.

What Crawlmark measures

Every scan produces two independent scores and a stance classification.

Open Score (0–100)

How well the site serves AI crawlers. Weighted across four layers: crawl access, renderability, structured data, and advanced signals.

Blocking Score (0–100)

How effectively the site blocks AI crawlers. Calculated from agent-level robots.txt rules, llms.txt presence, and WAF detection.

Stance

OPEN / MIXED / BLOCKING / UNKNOWN - derived from the ratio of blocked to total known AI agents in robots.txt.

Per-check statuses

Each check returns pass, warn, fail, info, or skip. Only pass/warn/fail contribute to scores.