Skip to content

fix(release): isolate flaky SDK publication probes - #3117

Open
antonvishal wants to merge 1 commit into
browserbase:mainfrom
antonvishal:vishal/fix-release-probe-flake
Open

antonvishal wants to merge 1 commit into
browserbase:mainfrom
antonvishal:vishal/fix-release-probe-flake

Conversation

@antonvishal

@antonvishal antonvishal commented Oct 6, 2026 •

Copy link
Copy Markdown
Contributor

Why

A pre-existing release test flake is blocking the Grok Build PR, #2876. Its 20 ms deadline probe shares an HTTP server and request counter with a later 503 assertion, so a late aborted request can inflate that assertion. Failing CI run.

What

Give 404-then-200 publication, immediate 503 rejection, and persistent-404 deadline expiry independent tests and servers. Assert the SDK request paths, exactly one 503 request, and an actual 404 retry before expiry. Advance only Date.now for the deadline case, keeping real HTTP requests and network timers. The existing stalled-request test remains; production code is unchanged.

How

Validated 154 root unit tests, 20 runs of the four HTTP scenarios totaling 80 test executions, tooling typecheck, formatting, and lint.


Summary by cubic

Fixes a flaky release test by giving each SDK publication probe its own HTTP server and request counter, so a late aborted request from one scenario no longer inflates the 503 assertion's request count in scoped-release.test.ts.

  • Splits the shared 404-then-200 publication, immediate-503 rejection, and deadline-expiry scenarios into separate tests.
  • Asserts exact request paths, exactly one 503 request, and an actual 404 retry before expiry.
  • Mocks only Date.now for the deadline case, keeping real HTTP requests and network timers.
  • Leaves production code unchanged.

Written for commit ed36d23. Summary will update on new commits.

Review in cubic

@changeset-bot

changeset-bot Bot commented Oct 6, 2026

Copy link
Copy Markdown

⚠️ No Changeset found

Latest commit: ed36d23

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

This PR includes no changesets

When changesets are added to this PR, you'll see the packages that this PR includes changesets for and the associated semver types

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR

@github-actions

github-actions Bot commented Oct 6, 2026

Copy link
Copy Markdown
Contributor

This PR is from an external contributor and must be approved by a stagehand team member with write access before CI can run.
Approving the latest commit mirrors it into an internal PR owned by the approver.
If new commits are pushed later, the internal PR stays open but is marked stale until someone approves the latest external commit and refreshes it.

@github-actions github-actions Bot added external-contributor Tracks PRs mirrored from external contributor forks. external-contributor:awaiting-approval Waiting for a stagehand team member to approve the latest external commit. labels Oct 6, 2026
@antonvishal
antonvishal marked this pull request as ready for review October 6, 2026 10:54

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

external-contributor:awaiting-approval Waiting for a stagehand team member to approve the latest external commit. external-contributor Tracks PRs mirrored from external contributor forks.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant