Skip to content

test(ci): split the looping live-images tests to fit the unit budget - #14764

Merged
cv merged 2 commits into
v1from
cv/split-live-image-tests
Nov 22, 2026
Merged

cv merged 2 commits into
v1from
cv/split-live-image-tests

Conversation

@cv

@cv cv commented Nov 22, 2026 •

Copy link
Copy Markdown
Collaborator

Splits two looping live-images tests in nemoclaw-build's CI lifecycle suite into one test per case, so each stays within the unit partition's 8 s per-test budget.

Problem

ci_lifecycle::live_images_import_cached_layers_and_save_them_only_when_ci_asks runs three full live-images fixture builds, one per NEMOCLAW_SAVE_GHA_CACHE setting, and took 8.3 s on linux_amd64, over the 8 s per-test budget in .config/test-budgets.yaml.
live_images_report_failed_build_duration_and_stop loops over the three images the same way and took 5.2 s.

Change

  • Move each test's checks into a helper and give each case its own test: the three cache settings, and a failure in the first, middle, and last image.
  • The assertions and coverage stay the same, and no budget changes.

live_images_import_cached_layers_and_save_them_only_when_ci_asks ran
three full live-images builds in one test and took 8.3 s on linux_amd64,
over the unit partition's 8 s per-test budget; the failed-build test
looped the same way at 5.2 s. Give each case its own test, sharing the
checks through a helper, so each runs one build.

Signed-off-by: Carlos Villela <cvillela@nvidia.com>
@github-actions github-actions Bot added the v1 NemoClaw v1 branch label Nov 22, 2026
@cv
cv enabled auto-merge (squash) November 22, 2026 00:54
@cv

cv commented Nov 22, 2026

Copy link
Copy Markdown
Collaborator Author

The over-budget failure this fixes: linux_amd64 / Unit tests 2 of 2 on #14763, where the test took 8.3 s against the 8 s limit. Run locally, the split tests take 1.2 to 2.5 s each.

@github-actions

Copy link
Copy Markdown
Contributor

@cv

cv commented Nov 22, 2026

Copy link
Copy Markdown
Collaborator Author
Authoring session — opening
Field Status Value Evidence or limit
Harness partial Pi with the Pit TypeScript tool The session record's header gives its format (version 3), not the harness version; 1.5.2 is installed at report time
Skills recorded managing-confluence (complete read); nemoclaw-contributor-create-pr (complete read) Tool-call reads to the cutoff; the PR skill was read after #14762, #14763, and #14764 were opened; skill descriptions listed at startup aren't counted
Instruction files partial .github/PULL_REQUEST_TEMPLATE.md (complete read); .github/SESSION_REPORT_TEMPLATE.md (complete read) Both read after the PRs were opened; NemoClaw's AGENTS.md was only searched, not read in full; the record doesn't store startup injections
Tool calls partial typescript: 74 Wrapper calls to the cutoff, including 4 failed; the shell, git, and gh calls each program made aren't recorded
Tokens recorded input: 11551044; cached input: 10930996; output: 86128 Sum of 80 assistant responses' message.usage (input + cacheRead + cacheWrite; cacheRead; output) to 2026-11-22T00:55:53Z; Anthropic Messages counters; the whole session, which also authored #14762, #14763, and #14764 and earlier research
Session window recorded 2026-11-21T23:53Z to 2026-11-22T00:56Z; 62 min First record entry to the cutoff, including idle time; whole session
Compactions recorded 0 No compaction entries in the record to the cutoff
Models recorded azure/anthropic/claude-opus-5-5 One model selection at start; no changes
Reasoning levels recorded high One thinking-level entry at start; no changes

@github-actions

github-actions Bot commented Nov 22, 2026 •

Copy link
Copy Markdown
Contributor

Selected hardware E2Es

Commit: 6ba3e91be9ec240c7bd4ba0df97e7b20c75b7f10

Selected cases run automatically; results do not gate merging.

Shared code or test infrastructure changed.

  • dgx-station-openclaw-nemotron
  • docker-openclaw-hermes-ollama
  • docker-openclaw-llama-cpp
  • docker-openclaw-vllm
  • docker-openclaw-vllm-shared

@cv
cv merged commit 983e75a into v1 Nov 22, 2026
98 checks passed
@cv
cv deleted the cv/split-live-image-tests branch November 22, 2026 02:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

v1 NemoClaw v1 branch

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant