Skip to content

feat(ui): export evaluation reports with Nitro - #45

Merged
lulu0119 merged 4 commits into
mainfrom
lulu0119/feat/nitro-static-report-export
Nov 14, 2026
Merged

lulu0119 merged 4 commits into
mainfrom
lulu0119/feat/nitro-static-report-export

Conversation

@lulu0119

Copy link
Copy Markdown
Member

Fixes #44.

Publish completed evaluations as a read-only Viewer site. Reviewers can open a link to a run, case, or comparison and inspect results and evidence from a static HTTP host. Nitro prerenders report data and copies the existing Viewer assets.

CLI changes

Command Before After Caller action
Static export Not available vieval report export .vieval/reports --output report-site Install @vieval/ui from this revision alongside vieval, use Node.js 22.22 or later to export, and serve the output directory over HTTP.
vieval report export .vieval/reports --output report-site

With no report roots, the command reads .vieval/reports from the current directory or next to --config <path>. Use a new output directory. Repeat --run <runKey> to limit the export to specific completed runs. Run attachments are included by default. --include-evidence includes linked external evidence, and repeatable --evidence-root <dir> adds allowed evidence directories.

The command prints the count and destination followed by the omitted-file count. Example from the CLI smoke test, with the temporary directory abbreviated:

Exported 1 run(s) to <temporary directory>/site
Omitted files: 0

Vieval CLI dispatch · Export command

Report file and viewer API changes

No report file or viewer API changes. Existing run files and HTTP routes keep their contracts. Static export adds a separate site directory.

Output Before After Caller action
Static site Not available index.html, report/catalog.json (version 1), per-run data in report/run/<index>.json and report/comparison/<index>.json, optional raw telemetry under report/otel/, and copied files under files/ Deploy the generated directory as a unit.

Static file layout · Viewer HTTP contract

Package exports

Surface Before After Caller action
@vieval/ui Not available exportReport({ reportRoots: ['.vieval/reports'], output: 'report-site' }) returns { omittedFiles, output, runKeys } Use the new export for programmatic publishing.
vieval/cli Not available import type { ExportReportOptions, ExportReportResult } from 'vieval/cli'. ViewerModule gains an optional exportReport method. Optional adoption.
vieval/cli helper importViewer(baseDirectory, packageName?) importViewer(baseDirectory, packageName?, command?), with '--with-viewer' as the default command label for a missing package Existing calls work as before.

No public APIs were removed and no migration is required. Viewer entry point · New CLI types · Previous helper · Updated helper

Validation

  • pnpm run build:packages, pnpm typecheck, and pnpm lint passed. Lint reported two existing warnings.
  • pnpm test:run passed all 717 tests across 89 files. Export integration tests
  • The built CLI exported the archived OSWorld fixture. Verified that the output contained the Viewer shell, catalog, run JSON, and comparison JSON.

Base cf36c69063ede7ccbd64fc863679159ba1782d1f. Head 76b23c5f57d00e29726c532a7fb9964a1ce134d4.

@github-actions

github-actions Bot commented Nov 14, 2026 •

Copy link
Copy Markdown

Deploy to Cloudflare Workers (Preview) for docs ready.

Name Link
Latest deploy log https://github.com/vieval-dev/vieval/actions/runs/43611854792
Deploy Preview https://f5a0d5f5-vieval-docs.moeru-ai.workers.dev
Pull Request Preview https://pr-45-vieval-docs.moeru-ai.workers.dev

@lulu0119
lulu0119 marked this pull request as ready for review November 14, 2026 15:46
@lulu0119
lulu0119 merged commit bac53c0 into main Nov 14, 2026
5 checks passed
@lulu0119
lulu0119 deleted the lulu0119/feat/nitro-static-report-export branch November 14, 2026 15:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

feat: share read-only evaluation reports by link

1 participant