Skip to content

GitHub action builds do not submit status to CDash dashboard #5516

Open
Open
GitHub action builds do not submit status to CDash dashboard#5516
Labels
type:InfrastructureInfrastructure/ecosystem related changes, such as CMake or buildbots
Milestone
Backlog -- Will be considered for future releases

Description

@dzenanz
dzenanz
opened on Sep 5, 2025

Taking example from today, PR #5512, only 8 builds appear on the dashboard. 7 have PR number in the name, and all 8 have branch name:
Image

Most important in this case was that information for the failing build, macOS-x86_64-rosetta, do not appear on the dashboard, despite the log claiming it was submitted.

It looks like only the Azure builds appear on CDash.

Activity

  1. dzenanz
    added
    type:InfrastructureInfrastructure/ecosystem related changes, such as CMake or buildbots
    on Sep 5, 2025

  2. zackgalbreath commented on Sep 5, 2025

    @zackgalbreath
    zackgalbreath
    on Sep 5, 2025
    Contributor

    I took a closer look on the server hosting open.cdash.org and I found two parsed Test.xml files for the build macOS-Build17495990688-vtksysConfigureFix. The build with the failing test occurred first (at 15:16 UTC), and then the building with 100% passing tests occurred about an hour later (at 16:37 UTC).

    CDash has a feature that allows us to automatically replace faulty build contents (i.e. in the case of a retry). I'm not 100% sure, but I believe that's what occurred here.

  3. dzenanz commented on Sep 5, 2025

    @dzenanz
    dzenanz
    on Sep 5, 2025
    MemberAuthor

    It is probably the other build from that group, macOS-Python, overwriting the result.

  4. dzenanz commented on Sep 10, 2025

    @dzenanz
    dzenanz
    on Sep 10, 2025
    MemberAuthor

    Here is log tail for PR 5518:

    2025-09-10T02:29:56.0595870Z Total Test time (real) = 459.46 sec
2025-09-10T02:29:56.0595880Z 
2025-09-10T02:29:56.0595930Z The following tests FAILED:
2025-09-10T02:29:56.0596170Z 	808 - itkFFTConvolutionImageFilterStreamingValidTest (Failed) ITKConvolution
2025-09-10T02:29:56.2044550Z SetCTestConfiguration:BuildDirectory:/Users/runner/work/ITK/ITK/build
2025-09-10T02:29:56.2044720Z SetCTestConfiguration:SourceDirectory:/Users/runner/work/ITK/ITK
2025-09-10T02:29:56.2044870Z SetCTestConfigurationFromCMakeVariable:DropMethod:CTEST_DROP_METHOD
2025-09-10T02:29:56.2044960Z SetCTestConfiguration:DropMethod:https
2025-09-10T02:29:56.2045090Z SetCTestConfigurationFromCMakeVariable:DropSite:CTEST_DROP_SITE
2025-09-10T02:29:56.2045410Z SetCTestConfiguration:DropSite:open.cdash.org
2025-09-10T02:29:56.2045580Z SetCTestConfigurationFromCMakeVariable:DropLocation:CTEST_DROP_LOCATION
2025-09-10T02:29:56.2045710Z SetCTestConfiguration:DropLocation:/submit.php?project=Insight
2025-09-10T02:29:56.2045830Z 	Add file: /Users/runner/work/ITK/ITK/ITK-dashboard/dashboard.cmake
2025-09-10T02:29:56.2048310Z 	Add file: /Users/runner/work/ITK/ITK/ITK-dashboard/itk_common.cmake
2025-09-10T02:29:56.2069250Z Submit files
2025-09-10T02:29:56.2069400Z    SubmitURL: https://open.cdash.org/submit.php?project=Insight
2025-09-10T02:29:56.2228580Z   Set CURLOPT_SSLVERSION to CURL_SSLVERSION_TLSv1_2
2025-09-10T02:29:56.2228950Z   Set CURLOPT_SSL_VERIFYPEER to on
2025-09-10T02:29:56.2237820Z    Upload file: /Users/runner/work/ITK/ITK/build/Testing/20250910-0136/Update.xml to https://open.cdash.org/submit.php?project=Insight&FileName=GitHub.InsightSoftwareConsortium%2FITK___macOS-Build17600395484-topic-fix-imagetovtkimage___20250910-0136-Experimental___XML___Update.xml&build=macOS-Build17600395484-topic-fix-imagetovtkimage&site=GitHub.InsightSoftwareConsortium%2FITK&stamp=20250910-0136-Experimental&MD5=f5ec00571e6528d6f6646c59bd6fc1ee Size: 618
2025-09-10T02:29:56.6282100Z    Uploaded: /Users/runner/work/ITK/ITK/build/Testing/20250910-0136/Update.xml
2025-09-10T02:29:56.6283040Z   Set CURLOPT_SSLVERSION to CURL_SSLVERSION_TLSv1_2
2025-09-10T02:29:56.6283620Z   Set CURLOPT_SSL_VERIFYPEER to on
2025-09-10T02:29:56.6307430Z    Upload file: /Users/runner/work/ITK/ITK/build/Testing/20250910-0136/Configure.xml to https://open.cdash.org/submit.php?project=Insight&FileName=GitHub.InsightSoftwareConsortium%2FITK___macOS-Build17600395484-topic-fix-imagetovtkimage___20250910-0136-Experimental___XML___Configure.xml&build=macOS-Build17600395484-topic-fix-imagetovtkimage&site=GitHub.InsightSoftwareConsortium%2FITK&stamp=20250910-0136-Experimental&MD5=e4dd642a79a7b328265c12fb2cc62ec1 Size: 45678
2025-09-10T02:29:57.1277810Z    Uploaded: /Users/runner/work/ITK/ITK/build/Testing/20250910-0136/Configure.xml
2025-09-10T02:29:57.1278820Z   Set CURLOPT_SSLVERSION to CURL_SSLVERSION_TLSv1_2
2025-09-10T02:29:57.1279420Z   Set CURLOPT_SSL_VERIFYPEER to on
2025-09-10T02:29:57.1286560Z    Upload file: /Users/runner/work/ITK/ITK/build/Testing/20250910-0136/Build.xml to https://open.cdash.org/submit.php?project=Insight&FileName=GitHub.InsightSoftwareConsortium%2FITK___macOS-Build17600395484-topic-fix-imagetovtkimage___20250910-0136-Experimental___XML___Build.xml&build=macOS-Build17600395484-topic-fix-imagetovtkimage&site=GitHub.InsightSoftwareConsortium%2FITK&stamp=20250910-0136-Experimental&MD5=b9403263987fc524337fb54f31266bcd Size: 1169
2025-09-10T02:29:57.5027900Z    Uploaded: /Users/runner/work/ITK/ITK/build/Testing/20250910-0136/Build.xml
2025-09-10T02:29:57.5028540Z   Set CURLOPT_SSLVERSION to CURL_SSLVERSION_TLSv1_2
2025-09-10T02:29:57.5029240Z   Set CURLOPT_SSL_VERIFYPEER to on
2025-09-10T02:29:57.5183810Z    Upload file: /Users/runner/work/ITK/ITK/build/Testing/20250910-0136/Test.xml to https://open.cdash.org/submit.php?project=Insight&FileName=GitHub.InsightSoftwareConsortium%2FITK___macOS-Build17600395484-topic-fix-imagetovtkimage___20250910-0136-Experimental___XML___Test.xml&build=macOS-Build17600395484-topic-fix-imagetovtkimage&site=GitHub.InsightSoftwareConsortium%2FITK&stamp=20250910-0136-Experimental&MD5=d101c40c9672153fff063f26f2c583e2 Size: 6985202
2025-09-10T02:29:58.7708930Z    Uploaded: /Users/runner/work/ITK/ITK/build/Testing/20250910-0136/Test.xml
2025-09-10T02:29:58.7711620Z   Set CURLOPT_SSLVERSION to CURL_SSLVERSION_TLSv1_2
2025-09-10T02:29:58.7712510Z   Set CURLOPT_SSL_VERIFYPEER to on
2025-09-10T02:29:58.7722540Z    Upload file: /Users/runner/work/ITK/ITK/build/Testing/20250910-0136/Notes.xml to https://open.cdash.org/submit.php?project=Insight&FileName=GitHub.InsightSoftwareConsortium%2FITK___macOS-Build17600395484-topic-fix-imagetovtkimage___20250910-0136-Experimental___XML___Notes.xml&build=macOS-Build17600395484-topic-fix-imagetovtkimage&site=GitHub.InsightSoftwareConsortium%2FITK&stamp=20250910-0136-Experimental&MD5=c143e5be650106e7d62c517bb3068701 Size: 18166
2025-09-10T02:29:59.1936620Z    Uploaded: /Users/runner/work/ITK/ITK/build/Testing/20250910-0136/Notes.xml
2025-09-10T02:29:59.1937590Z   Set CURLOPT_SSLVERSION to CURL_SSLVERSION_TLSv1_2
2025-09-10T02:29:59.1938190Z   Set CURLOPT_SSL_VERIFYPEER to on
2025-09-10T02:29:59.1981460Z    Upload file: /Users/runner/work/ITK/ITK/build/Testing/20250910-0136/Done.xml to https://open.cdash.org/submit.php?project=Insight&FileName=GitHub.InsightSoftwareConsortium%2FITK___macOS-Build17600395484-topic-fix-imagetovtkimage___20250910-0136-Experimental___XML___Done.xml&build=macOS-Build17600395484-topic-fix-imagetovtkimage&site=GitHub.InsightSoftwareConsortium%2FITK&stamp=20250910-0136-Experimental&MD5=69bcce377c2e43f63a4ded0ea108147b Size: 108
2025-09-10T02:29:59.5667450Z    Uploaded: /Users/runner/work/ITK/ITK/build/Testing/20250910-0136/Done.xml
2025-09-10T02:29:59.5668760Z    Submission successful
2025-09-10T02:29:59.5704850Z CMake Warning at /Users/runner/work/ITK/ITK/ITK-dashboard/itk_common.cmake:502 (message):
2025-09-10T02:29:59.5706520Z   test_return did not complete without warnings, errors, or failures.
2025-09-10T02:29:59.5707590Z Call Stack (most recent call first):
2025-09-10T02:29:59.5709310Z   /Users/runner/work/ITK/ITK/ITK-dashboard/github_actions_dashboard.cmake:89 (include)
2025-09-10T02:29:59.5710890Z   /Users/runner/work/ITK/ITK/ITK-dashboard/dashboard.cmake:11 (include)
2025-09-10T02:29:59.5711770Z 
2025-09-10T02:29:59.5711800Z 
2025-09-10T02:29:59.5712520Z CMake Error at /Users/runner/work/ITK/ITK/ITK-dashboard/itk_common.cmake:508 (message):
2025-09-10T02:29:59.5714100Z   ci_completed_successfully did not complete without warnings, errors, or
2025-09-10T02:29:59.5715150Z   failures.
2025-09-10T02:29:59.5715710Z Call Stack (most recent call first):
2025-09-10T02:29:59.5716930Z   /Users/runner/work/ITK/ITK/ITK-dashboard/github_actions_dashboard.cmake:89 (include)
2025-09-10T02:29:59.5718560Z   /Users/runner/work/ITK/ITK/ITK-dashboard/dashboard.cmake:11 (include)
2025-09-10T02:29:59.5719410Z 
2025-09-10T02:29:59.5719420Z 
2025-09-10T02:29:59.5968590Z ##[error]Process completed with exit code 255.
2025-09-10T02:29:59.6222100Z Post job cleanup.
2025-09-10T02:30:00.0099500Z [command]/opt/homebrew/bin/git version
2025-09-10T02:30:00.0386360Z git version 2.51.0
2025-09-10T02:30:00.0448330Z Copying '/Users/runner/.gitconfig' to '/Users/runner/work/_temp/2ed409e4-989f-4004-ba08-86abf4d82c42/.gitconfig'
2025-09-10T02:30:00.0449130Z Temporarily overriding HOME='/Users/runner/work/_temp/2ed409e4-989f-4004-ba08-86abf4d82c42' before making global git config changes
2025-09-10T02:30:00.0449850Z Adding repository directory to the temporary git global config as a safe directory
2025-09-10T02:30:00.0450440Z [command]/opt/homebrew/bin/git config --global --add safe.directory /Users/runner/work/ITK/ITK
2025-09-10T02:30:00.0540730Z [command]/opt/homebrew/bin/git config --local --name-only --get-regexp core\.sshCommand
2025-09-10T02:30:00.0706790Z [command]/opt/homebrew/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :"
2025-09-10T02:30:00.1474310Z [command]/opt/homebrew/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader
2025-09-10T02:30:00.1523720Z http.https://github.com/.extraheader
2025-09-10T02:30:00.1533020Z [command]/opt/homebrew/bin/git config --local --unset-all http.https://github.com/.extraheader
2025-09-10T02:30:00.1591090Z [command]/opt/homebrew/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :"
2025-09-10T02:30:00.2267490Z Cleaning up orphan processes

  5. hjmjohnson commented on Apr 15, 2026

    @hjmjohnson
    hjmjohnson
    on Apr 15, 2026
    Member

    Related Discourse discussions:

  6. hjmjohnson
    added this to the Backlog -- Will be considered for future releases milestone on Sep 23, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    type:InfrastructureInfrastructure/ecosystem related changes, such as CMake or buildbots

    Type

    No type

    Projects

    No projects

      Milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions