crawlability

Roxy SEO: an open-source agent skill and PI extension for SEO, AEO, GEO, AI search visibility, technical audits, structured data, and content strategy.

Ruby sitemap generator for Rails apps with deterministic XML, validation, and IndexNow/Search Console pinging

Universal Agent Skill for safely preparing, auditing, launching, and troubleshooting any public website for search-engine discovery, crawlability, indexing, Schema.org site identity, Google Search Console, and Bing Webmaster Tools.

AI Search Readiness & Web Discoverability Toolkit — Analyze how well websites are prepared for AI-powered search engines

A framework-agnostic reference for handling faceted navigation without wrecking crawl budget: a five-tier classifier (index / canonicalize / noindex / robots-block) driven by one facet registry, with sitemap, robots.txt, and parameter normalization.

Ruby sitemap crawler for Rails SEO audits with metadata, JSON-LD, uniqueness, link checks, and structured issues

Description: Technical SEO audit checklist and report template for crawlability, indexing, sitemap, robots.txt, PageSpeed, Core Web Vitals, schema and website health.

Inspect crawler-facing HTTP, indexability, sitemap, structured-data and migration evidence from inside WordPress.

llms.txt validator CLI and GitHub Action for AI visibility, GEO/AEO, AI SEO, sitemap/robots alignment, and AI crawler readiness.

Google Search Console indexing checklist for crawlability, sitemap, robots.txt, canonical tags, noindex issues, redirects, 404 errors and technical SEO fixes.

Local-only robots.txt and sitemap.xml validation for AI coding agents

Audit robots.txt and sitemap XML for crawlability, sitemap discovery, blocked important paths, broken URL limits, and SEO-safe indexing basics.

Deterministic CI for technical SEO. Prove that sitemaps, canonicals, robots directives, redirects, internal links, hreflang, and indexability signals agree before deployment.

Test what machines can read from your website before you ship.

A practical technical SEO audit checklist for crawlability, indexability, canonicalization, redirects, sitemaps, status codes, site architecture, performance, and technical validation.

Google robotstxt: Reference parser/matcher robots.txt, близкий к поведению Googlebot.