Skip to content

DOCS-1879 - Remove the unused tag taxonomy - #7133

Open
kimsauce wants to merge 5 commits into
mainfrom
DOCS-1879
Open

DOCS-1879 - Remove the unused tag taxonomy#7133
kimsauce wants to merge 5 commits into
mainfrom
DOCS-1879

Conversation

@kimsauce

Copy link
Copy Markdown
Collaborator

Purpose of this pull request

This pull request removes the unused Docusaurus tag taxonomy sitewide. GA4 shows the ~120 auto-generated /help/docs/tags/* pages get almost no organic traffic and no established reader benefit, while costing ongoing upkeep (drift against keywords:, another thin crawl-surface URL per tag). See DOCS-1879 for the full rationale, including verified GA4 numbers and technical findings.

Five commits, one per batch:

  1. 93 C2C source docs (docs/send-data/hosted-collectors/cloud-to-cloud-integration-framework/): tags: renamed to keywords:, values unchanged.
  2. zip-tools.md: tags: removed (no existing keywords: field, single value not worth preserving).
  3. Style guide + 2 scaffold templates: tags: guidance removed/deprecated so contributors don't reintroduce it; templates renamed to keywords: to keep new docs consistent with (1).
  4. Claude Code tooling (2 skills + /app-doc command): same treatment, so the doc-creation slash commands match the updated templates.
  5. robots.txt + sitemap config: removed the now-obsolete Disallow: /tags/* / Disallow: /*?tags= rules and the /tags/** sitemap-ignore entry.

Verified with a clean local yarn build: zero docs-tags-* route artifacts generated, confirming the docs plugin stops generating tag routes once no doc has tags: frontmatter (there's no config flag for this — route generation is driven purely by frontmatter presence).

Not in this repo, flagged separately: the Algolia Crawler Admin's exclusionPatterns has two now-obsolete tag-related entries (harmless no-ops, not blocking) to remove manually in the Algolia dashboard.

Select the type of change

  • Site and Tools - .clabot, version updates, maintenance, dependencies, new packages for the site (Docusaurus, Gatsby, React, etc.)
  • Minor Changes - Typos, formatting, slight revisions
  • Update Content - Revisions, updating sections
  • New Content - New features, sections, pages, tutorials

Ticket (if applicable)

https://sumologic.atlassian.net/browse/DOCS-1879

🤖 Generated with Claude Code

kimsauce and others added 5 commits September 10, 2026 23:13
Rename the tags: frontmatter to keywords: across all Cloud-to-Cloud
source docs, preserving the existing values. GA4 shows the generated
/help/docs/tags/* pages get ~99.7% bot traffic and 17 organic views
total over 90 days, no SEO/GEO value, so the tags feature itself is
being retired sitewide. The terms are still useful for search, so
they move into keywords: instead of being dropped.

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
Drop the unused tags: [cloud soar integrations] frontmatter. Unlike
the C2C source docs, this page had no pre-existing keywords: field
and the single tag value isn't worth introducing one for, so it's
just removed. Also includes an incidental trailing-whitespace fix on
the Password bullet.

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
Remove tags: from the style guide's example frontmatter and the two
scaffold templates (app-template-v2, c2c-source), renaming it to
keywords: in the templates so new docs keep the same search terms
without generating a tag page. Mark tags: as deprecated in the style
guide's frontmatter parameter table so it isn't reintroduced.

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
Remove tags: from the docusaurus and sumo-style skill frontmatter
examples, and rename tags to keywords in app-doc.md's required
substitutions, checklist, and worked example so the /app-doc command
matches the updated app-template-v2.md scaffold.

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
…p config

Drop the Disallow: /tags/* and Disallow: /*?tags= rules from
robots.txt, and /tags/** from the sitemap ignorePatterns, now that no
tag routes exist to disallow or ignore.

Note: this repo's robots.txt is served at /help/robots.txt, not the
production domain root (https://www.sumologic.com/robots.txt, a
separate WordPress-managed file that never included these rules), so
this was cleanup rather than a fix to something that was blocking
crawlers in production.

The Algolia Crawler Admin's exclusionPatterns (external, not in this
repo) also has two tags-related entries that are now no-ops; flagged
separately for manual removal there.

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
@kimsauce kimsauce self-assigned this Sep 11, 2026
@cla-bot cla-bot Bot added the cla-signed Contributor approved, listed in .clabot file label Sep 11, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

cla-signed Contributor approved, listed in .clabot file

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant