Skip to content

Run the Linux CI jobs on OSDC runners - #3868

Draft
huydhn wants to merge 3 commits into
masterfrom
osdc/ci-runners
Draft

huydhn wants to merge 3 commits into
masterfrom
osdc/ci-runners

Conversation

@huydhn

@huydhn huydhn commented Oct 3, 2026

Copy link
Copy Markdown

These jobs are hand-rolled copies of test-infra's linux_job rather than callers of it, so this maps the labels directly, per pytorch/pytorch .github/arc.yaml:

before after
linux.4xlarge mt-l-x86iavx512-16-128
linux.12xlarge mt-l-x86iavx512-48-384
linux.g4dn.12xlarge.nvidia.gpu mt-l-x86iavx512-45-172-t4-4

Each job also opened with:

sudo rm -rfv "${GITHUB_WORKSPACE}"
mkdir -p "${GITHUB_WORKSPACE}"

On OSDC the workspace is a bind mount, so removing the directory detaches it and every later step fails with getcwd: cannot access parent directories. Clearing the contents keeps the inode — what test-infra's own templates do since pytorch/test-infra#8789.

gpu-hvd-tests.yml is deliberately left alone: linux.8xlarge.nvidia.gpu has no entry in arc.yaml, so there is no mapping to make and guessing a GPU model would change what the job tests.

Authored with Claude Code.

These jobs are hand-rolled copies of test-infra's linux_job rather than
callers of it, so this maps the labels directly, per pytorch/pytorch's
.github/arc.yaml:

  linux.4xlarge                  -> mt-l-x86iavx512-16-128
  linux.12xlarge                 -> mt-l-x86iavx512-48-384
  linux.g4dn.12xlarge.nvidia.gpu -> mt-l-x86iavx512-45-172-t4-4

Each of those jobs also opened with

    sudo rm -rfv "${GITHUB_WORKSPACE}"
    mkdir -p "${GITHUB_WORKSPACE}"

On OSDC the workspace is a bind mount, so removing the directory detaches it
and every later step fails with "getcwd: cannot access parent directories".
Clearing the contents keeps the inode, which is what test-infra's own
templates do after pytorch/test-infra#8789.

gpu-hvd-tests.yml is left alone: linux.8xlarge.nvidia.gpu has no entry in
arc.yaml, so there is no mapping to make, and guessing a GPU model is not the
same job.

Authored with Claude Code.
@github-actions github-actions Bot added the ci CI label Oct 3, 2026
huydhn added 2 commits October 7, 2026 15:23
Each job gets a fresh pod, and GITHUB_WORKSPACE lives on an emptyDir volume
created with it (verified: the workflow pod's 'work' volume is emptyDir, and
runners are one job per pod). So the workspace is already empty at job start
and there is nothing to clear.

The step existed because the EC2 runners were reused across jobs and left
stale content behind. gpu-hvd-tests.yml and mps-tests.yml keep theirs --
they are still on EC2.

Authored with Claude Code.
linux.8xlarge.nvidia.gpu -> mt-l-x86iavx512-45-172-t4-4, the label gpu-tests
already uses in this PR. No OSDC label carries exactly two GPUs, and this
suite runs 'run_gpu_tests.sh 2 hvd', so the 4x T4 pod is the fit that keeps
the test as-is: it asks for two of four. The GPU model changes M60 -> T4,
which is unavoidable here.

Drops the workspace cleanup for the same reason as the other jobs: the pod
is ephemeral and GITHUB_WORKSPACE is an emptyDir, so it starts empty.

Authored with Claude Code.

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ci CI

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant