Skip to content

Align GitHub Action with CTRF 0.5.0 and report identity - #332

Merged
Ma11hewThomas merged 10 commits into
mainfrom
upgrade-ctrf-0.4.0
Oct 11, 2026
Merged

Ma11hewThomas merged 10 commits into
mainfrom
upgrade-ctrf-0.4.0

Conversation

@Ma11hewThomas

@Ma11hewThomas Ma11hewThomas commented Oct 4, 2026 •

Copy link
Copy Markdown
Contributor

Update the Action to CTRF 0.5.0 and the latest AI, JUnit, Teams and Handlebars helper releases. Refresh dependencies and tooling, retaining the existing Slack version and Node 24 runtime requirement. Prepare version 1.3.1.

Keep historical test matching unchanged: comparisons continue to use test names, including metrics and added/removed tests. Adding test IDs does not reset historical metrics. Defer ID-based matching until a migration strategy preserves existing history.

Preserve test, execution and attempt IDs while giving changed, merged and grouped report artifacts fresh IDs. Preserve shared explicit run IDs and remove ambiguous shard labels from merged reports. Generated conforming reports use specification 0.2.0; legacy inputs retain compatibility handling.

Rebuild the committed Action bundle with all six CTRF schemas. Adapt updated artifact SDK IDs safely and fix bundled CommonJS global collisions. Keep the README focused on existing usage.

Validation:

  • Node 24: type checks, Biome checks, 127 tests and coverage pass. Badge generation completed with network access after sandbox DNS failed; packaging and built Action syntax checks pass.
  • Five name-matching regression cases cover name-only history, newly added test IDs, legacy ID migration, changing legacy IDs and different logical IDs with the same name.
  • Historical insights source matches the PR base byte-for-byte. Real old/new JUnit conversion retains history without false additions/removals.
  • Actual built Action processes CTRF and JUnit files, preserving identities and grouped results.
  • Dependency refresh previously verified with clean install/full checks, zero full and production audit findings, and registry signature verification; this follow-up changes no dependencies.
  • Packaged schemas match installed CTRF byte-for-byte; current schema matches the authoritative specification.
  • git diff --check passes.

@github-actions

github-actions Bot commented Oct 4, 2026

Copy link
Copy Markdown

action-test: Run #200

Tests 📝 Passed ✅ Failed ❌ Skipped ⏭️ Pending ⏳ Other ❓ Flaky 🍂 Duration ⏱️
114 114 0 0 0 0 0 1.7s

🎉 All tests passed!

Github Test Reporter by CTRF 💚

@Ma11hewThomas Ma11hewThomas changed the title Upgrade CTRF to 0.4.0 and fix npm audit findings Upgrade CTRF to 0.4.0 and correct generated report versions Oct 4, 2026
@github-actions

github-actions Bot commented Oct 4, 2026

Copy link
Copy Markdown

action-test: Run #202

Tests 📝 Passed ✅ Failed ❌ Skipped ⏭️ Pending ⏳ Other ❓ Flaky 🍂 Duration ⏱️
120 120 0 0 0 0 0 1.9s

🎉 All tests passed!

Github Test Reporter by CTRF 💚

@github-actions

github-actions Bot commented Oct 4, 2026

Copy link
Copy Markdown

action-test: Run #204

Tests 📝 Passed ✅ Failed ❌ Skipped ⏭️ Pending ⏳ Other ❓ Flaky 🍂 Duration ⏱️
120 120 0 0 0 0 0 2.1s

🎉 All tests passed!

Github Test Reporter by CTRF 💚

@github-actions

github-actions Bot commented Oct 4, 2026

Copy link
Copy Markdown

action-test: Run #206

Tests 📝 Passed ✅ Failed ❌ Skipped ⏭️ Pending ⏳ Other ❓ Flaky 🍂 Duration ⏱️
120 120 0 0 0 0 0 2.1s

🎉 All tests passed!

Github Test Reporter by CTRF 💚

@github-actions

github-actions Bot commented Oct 4, 2026

Copy link
Copy Markdown

action-test: Run #208

Tests 📝 Passed ✅ Failed ❌ Skipped ⏭️ Pending ⏳ Other ❓ Flaky 🍂 Duration ⏱️
120 120 0 0 0 0 0 2.1s

🎉 All tests passed!

Github Test Reporter by CTRF 💚

@Ma11hewThomas Ma11hewThomas changed the title Upgrade CTRF to 0.4.0 and correct generated report versions Align GitHub Action with CTRF 0.5.0 and report identity Oct 11, 2026
@github-actions

Copy link
Copy Markdown

action-test: Run #217

Tests 📝 Passed ✅ Failed ❌ Skipped ⏭️ Pending ⏳ Other ❓ Flaky 🍂 Duration ⏱️
123 123 0 0 0 0 0 1.9s

🎉 All tests passed!

Github Test Reporter by CTRF 💚

@github-actions

Copy link
Copy Markdown

action-test: Run #219

Tests 📝 Passed ✅ Failed ❌ Skipped ⏭️ Pending ⏳ Other ❓ Flaky 🍂 Duration ⏱️
127 127 0 0 0 0 0 2.2s

🎉 All tests passed!

Github Test Reporter by CTRF 💚

@Ma11hewThomas
Ma11hewThomas merged commit 78d9543 into main Oct 11, 2026
42 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant