Skip to content

ci: run release tests serially - #296

Merged
ChristopherPHolder merged 1 commit into
mainfrom
ci/serial-release-tests
Oct 23, 2026
Merged

ChristopherPHolder merged 1 commit into
mainfrom
ci/serial-release-tests

Conversation

@ChristopherPHolder

Copy link
Copy Markdown
Collaborator

Summary

The release workflow's test step fails on main (see the last two release runs) in nx-plugin:test and nx-plugin-integration:test with no useful error output, while the same tests pass in the ci workflow for every PR.

Cause: the cli-e2e global setup runs npm install -D @push-based/user-flow@1.0.0 from the local verdaccio registry at the workspace root, and uninstalls it on teardown. The nx-plugin tests shell out to npx @push-based/user-flow. The ci workflow runs tests with --parallel=false, so these never overlap. The release workflow runs nx run-many -t test with default parallelism, so the workspace node_modules gets rewritten while the nx-plugin tests are executing, and their npx calls die silently.

Verified on a throwaway diagnostic PR (#295) that the published CLI and nx-plugin:test both behave correctly on the runner with the release workflow's setup-node configuration when run serially.

Change

Add --parallel=false to the release workflow's test step, matching ci.yml.

The cli-e2e global setup installs and later uninstalls @push-based/user-flow
at the workspace root from the local verdaccio registry. The nx-plugin tests
shell out to npx @push-based/user-flow. With the default Nx parallelism in
the release workflow those tasks overlap, the workspace node_modules is
rewritten mid-test, and the nx-plugin tests fail with no useful output.

The ci workflow already runs tests with --parallel=false, which is why the
same tests pass there. Align the release workflow with it.
@github-actions

Copy link
Copy Markdown

❗❗❗ report generated by this PR ❗❗❗

☕ Order Coffee ☕

Date/Time: 2026-10-23 21:28

Step Name Gather Mode Performance Accessibility Best Practices Seo Agentic Browsing
🧭 Navigate to coffee cart navigation 78 93 100 83 50
☕ Select coffee timespan 17/17 - 8/8 - -
✔ Coffee selected snapshot Ø 1/1 16/18 4/4 3/5 1/3
🛒 Checkout order timespan 19/19 - 8/8 - -
🧾 Order checked out snapshot Ø 1/1 19/20 4/4 3/5 1/3
💌 Submit order timespan 18/18 - 8/8 - -
📧 Order submitted snapshot Ø 1/1 20/22 4/4 3/5 1/3
🧭 Navigate to github navigation 89 92 100 83 50

@github-actions

Copy link
Copy Markdown

☕ Order Coffee ☕

Date/Time: 2026-10-23 21:28

Step Name Gather Mode Performance Accessibility Best Practices Seo Agentic Browsing
🧭 Navigate to coffee cart navigation 93 93 100 83 50
☕ Select coffee timespan 17/17 - 8/8 - -
✔ Coffee selected snapshot Ø 1/1 16/18 4/4 3/5 1/3
🛒 Checkout order timespan 19/19 - 8/8 - -
🧾 Order checked out snapshot Ø 1/1 19/20 4/4 3/5 1/3
💌 Submit order timespan 18/18 - 8/8 - -
📧 Order submitted snapshot Ø 1/1 20/22 4/4 3/5 1/3
🧭 Navigate to github navigation 96 92 100 83 50

@ChristopherPHolder
ChristopherPHolder merged commit 3758889 into main Oct 23, 2026
3 checks passed
@ChristopherPHolder
ChristopherPHolder deleted the ci/serial-release-tests branch October 23, 2026 21:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant