Repository navigation
[improve][ci] Reduce disk usage and extend Broker Group 1 timeout in Pulsar CI - #27196
Merged
Merged
Conversation
…Pulsar CI Some GitHub runners have less disk space and fewer CPUs. - Increase the BROKER_GROUP_1 unit test timeout from the default 60 to 70 minutes - Clean disk for the BACKWARDS_COMPAT integration test group, using the default mode with a 30GB threshold - Delete the build outputs tar and the downloaded Docker image archives in the same step where they are extracted or loaded Assisted-by: Claude Code (claude-opus-5-5)
lhotari
requested review from
Denovo1998,
Technoboy-,
codelipenghui,
dao-jun,
merlimat and
nodece
October 29, 2026 12:50
Technoboy-
approved these changes
Oct 29, 2026
Denovo1998
approved these changes
Oct 29, 2026
dao-jun
approved these changes
Oct 29, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Motivation
Some GitHub runners have less disk space and fewer CPUs than others. As with #26558, one goal is to make Pulsar CI work on smaller runners.
BROKER_GROUP_1can go over the default 60-minute job timeout.BACKWARDS_COMPATintegration test group pulls several olderapachepulsar/pulsarimages in addition to the java-test-image, so it can run out of disk space on runners with less free disk.gradle-build-outputs.tarand Docker image archives on disk after extracting or loading them. This wastes disk space for the rest of the job.Modifications
BROKER_GROUP_1unit test timeout to 70 minutes, 10 minutes more than the default of 60.clean-diskaction for theBACKWARDS_COMPATintegration test group. It uses the default mode withclean-threshold-gb: '30', notfullmode. The action does nothing if 30 GB or more is free. Otherwise it removes/usr/local/lib/androidand then/opt/ghcuntil the threshold is met, and falls back to cleaning apt state.gradle-build-outputs.tarin the same step that extracts it, in every job. Remove the downloaded Docker image archive in the same step that loads it, in the integration test and system test jobs. Each step stops at the first failing command, so the archive is only removed after a successful extract or load.Verifying this change
This change is a trivial rework / code cleanup without any test coverage.
Does this pull request potentially affect one of the following parts:
If the box was checked, please highlight the changes