Skip to content

Test job refactor prototyping - #41502

Draft
David Bennett (dkbennett) wants to merge 2 commits into
masterfrom
user/dkbennett/testoptimization
Draft

Test job refactor prototyping#41502
David Bennett (dkbennett) wants to merge 2 commits into
masterfrom
user/dkbennett/testoptimization

Conversation

@dkbennett

Copy link
Copy Markdown
Member

Summary of the Pull Request

Just some prototyping test job for more efficient CI nothing to see here

PR Checklist

  • Closes: Link to issue #xxx
  • Communication: I've discussed this with core contributors already. If work hasn't been agreed, this work might be rejected
  • Tests: Added/updated if needed and all pass
  • Localization: All end user facing strings can be localized
  • Dev docs: Added/updated if needed
  • Documentation updated: If checked, please file a pull request on our docs repo and link it here: #xxx

Detailed Description of the Pull Request / Additional comments

Validation Steps Performed

Copilot AI lite review requested due to automatic review settings September 2, 2026 00:04

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🔵 Needs a closer look

It changes CI test selection/sharding and pipeline orchestration logic in ways that require human validation of coverage and runtime behavior across images/suites.

Pull request overview

Refactors CloudTest map/group generation and Azure Pipelines test orchestration to prototype more efficient CI by parameterizing artifact providers/build-file copies and sharding WSL2 test execution into smaller suites.

Changes:

  • Replace hardcoded CloudTest providers and BuildFiles entries with CMake-generated conditional blocks (e.g., package artifact + optional test packages/unit tests/test data).
  • Add new WSL2 sharded CloudTest suites (unit, e2e shard 1, e2e shard 2) via TAEF /select filters.
  • Update Azure Pipelines templates to iterate over richer test_suites objects and route to the correct CloudTest map path/display name.
File summaries
File Description
cloudtest/TestMap.xml.in Replaces fixed provider blocks with injected ${PACKAGE_ARTIFACT_PROVIDER} / ${TEST_PACKAGES_PROVIDER}.
cloudtest/TestGroup.xml.in Replaces fixed file-copy steps and UnitTests args with injected ${...} blocks/arguments.
cloudtest/CMakeLists.txt Generates conditional provider/build-file fragments and defines sharded WSL2 filters/suites.
.pipelines/test-stage.yml Replaces versions list with structured test_suites and updates job matrix/run conditions.
.pipelines/test-job.yml Renames/extends template parameters and updates CloudTest map path/display naming.
Review details
  • Files reviewed: 5/5 changed files
  • Comments generated: 0
  • Review effort level: Lite

💡 Add a code-review agent skill or configure MCP servers for context-aware, tailored reviews. Learn more in the docs.

Copilot AI review requested due to automatic review settings September 2, 2026 17:58

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🔵 Needs a closer look

It refactors CI/CloudTest job generation and test suite sharding in ways that could silently change what artifacts are fetched and which tests execute, so it needs human validation in CI.

Review details
  • Files reviewed: 5/5 changed files
  • Comments generated: 0 new
  • Review effort level: Lite

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants