Skip to content

ci: Address tight disk space on GHA runners #4974

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
lgritz merged 2 commits into from
Dec 6, 2025
Merged

ci: Address tight disk space on GHA runners #4974

lgritz merged 2 commits into from
Dec 6, 2025

Conversation

@lgritz
Copy link
Collaborator

@lgritz lgritz commented Dec 5, 2025

  • Mount the host's root under /host/root so it's visible in the containers.
  • Remove stuff we don't need to free lots of disk space.
  • While we're at it, arrange for the commands (copied from OSL) that allow the containers to see a CPU, when available.

This is freeing 20+ GB!

@lgritz lgritz requested a review from jfpanisset December 5, 2025 23:15
@lgritz
ci: Address tight disk space on GHA runners
1e46354 
- Mount the host's root under /host/root so it's visible in the
  containers.
- Remove stuff we don't need to free lots of disk space.
- While we're at it, arrange for the commands (copied from OSL) that
  allow the containers to see a CPU, when available.

Signed-off-by: Larry Gritz <lg@larrygritz.com>
jfpanisset
jfpanisset approved these changes Dec 5, 2025
View reviewed changes
Copy link

@jfpanisset jfpanisset left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, hope it works for you!

.github/workflows/build-steps.yml
image: ${{ inputs.container }}
volumes: ${{ fromJson( inputs.container_volumes ) }}
options: -v /:/host/root ${{ (contains(inputs.runner, 'gpu') && '-e NVIDIA_DRIVER_CAPABILITIES=compute,graphics,utility --gpus all') || '-e A=x' }}
# Extra options:
Copy link

@jfpanisset jfpanisset Dec 5, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Not used this conditional syntax before, I'm guessing that the || '-e A=x' part just sets an innocuous env var A=x since you can't have an empty "else" part of the conditional?

Copy link
Collaborator Author

@lgritz lgritz Dec 6, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think so. That part is just ported from OSL and is what I needed to make it work.

@jfpanisset
Copy link

jfpanisset commented Dec 5, 2025

Also note that on a system where the container image store is on a different filesystem than the root filesystem, running df -h . will show the amount of space on that device, whereas df -h /host/root will show the space on the root filesystem.

Of course we only care about freeing up disk space on the same filesystem as where the container image is stored, and this is a Ubuntu GHA runner specific hack anyway.

@lgritz
wip
a916e51 
Signed-off-by: Larry Gritz <lg@larrygritz.com>
@lgritz
Copy link
Collaborator Author

lgritz commented Dec 6, 2025

I think they're the same, but I fixed anyway.

@lgritz lgritz added the build / testing / port / CI Affecting the build system, tests, platform support, porting, or continuous integration. label Dec 6, 2025
@lgritz lgritz merged commit 2d5e442 into AcademySoftwareFoundation:main Dec 6, 2025
32 checks passed
@lgritz lgritz mentioned this pull request Dec 6, 2025
Merged
5 tasks
@jfpanisset
Copy link

jfpanisset commented Dec 7, 2025

I was able to shave around 1.3GB from the images and have re-released ci-oiio 2024.5 / 2025.4 / 2026.2 and here are the results:

                Before   Before    After    After
                Docker   On Disk    Docker    On Disk
                Hub                          Hub
- 2024.5 5.46GB / 12.5GB -> 4.09GB / 11.0GB
- 2025.4 5.67GB / 13.0GB -> 4.19GB / 11.4GB
- 2026.2 7.01GB / 15.6GB -> 5.32GB / 13.8GB

This should hopefully allow the ci-oiio:2026 image to get pulled an expanded on a free runner with 14GB of free disk space.

@lgritz
Copy link
Collaborator Author

lgritz commented Dec 7, 2025

Thanks, @jfpanisset. I believe I will need the same for ci-osl

@jfpanisset
Copy link

jfpanisset commented Dec 7, 2025

All 2024.5 / 2025.4 / 2026.2 images have been re-released with the spurious Conan download cache purged.

@lgritz lgritz deleted the lg-disk branch December 17, 2025 07:18
lgritz added a commit to lgritz/OpenImageIO that referenced this pull request Dec 17, 2025
@lgritz
ci: Address tight disk space on GHA runners (AcademySoftwareFoundatio…
8ccec59 
…n#4974)

- Mount the host's root under /host/root so it's visible in the
containers.
- Remove stuff we don't need to free lots of disk space.
- While we're at it, arrange for the commands (copied from OSL) that
allow the containers to see a CPU, when available.

This is freeing 20+ GB!

---------

Signed-off-by: Larry Gritz <lg@larrygritz.com>
lgritz added a commit to lgritz/OpenImageIO that referenced this pull request Dec 31, 2025
@lgritz
ci: Address tight disk space on GHA runners (AcademySoftwareFoundatio…
5e545c9 
…n#4974)

- Mount the host's root under /host/root so it's visible in the
containers.
- Remove stuff we don't need to free lots of disk space.
- While we're at it, arrange for the commands (copied from OSL) that
allow the containers to see a CPU, when available.

This is freeing 20+ GB!

---------

Signed-off-by: Larry Gritz <lg@larrygritz.com>
lgritz added a commit to lgritz/OpenImageIO that referenced this pull request Dec 31, 2025
@lgritz
ci: Address tight disk space on GHA runners (AcademySoftwareFoundatio…
27a556a 
…n#4974)

- Mount the host's root under /host/root so it's visible in the
containers.
- Remove stuff we don't need to free lots of disk space.
- While we're at it, arrange for the commands (copied from OSL) that
allow the containers to see a CPU, when available.

This is freeing 20+ GB!

---------

Signed-off-by: Larry Gritz <lg@larrygritz.com>
lgritz added a commit to lgritz/OpenImageIO that referenced this pull request Dec 31, 2025
@lgritz
ci: Address tight disk space on GHA runners (AcademySoftwareFoundatio…
6aede37 
…n#4974)

- Mount the host's root under /host/root so it's visible in the
containers.
- Remove stuff we don't need to free lots of disk space.
- While we're at it, arrange for the commands (copied from OSL) that
allow the containers to see a CPU, when available.

This is freeing 20+ GB!

---------

Signed-off-by: Larry Gritz <lg@larrygritz.com>
lgritz added a commit to lgritz/OpenImageIO that referenced this pull request Dec 31, 2025
@lgritz
ci: Address tight disk space on GHA runners (AcademySoftwareFoundatio…
39e29c1 
…n#4974)

- Mount the host's root under /host/root so it's visible in the
containers.
- Remove stuff we don't need to free lots of disk space.
- While we're at it, arrange for the commands (copied from OSL) that
allow the containers to see a CPU, when available.

This is freeing 20+ GB!

---------

Signed-off-by: Larry Gritz <lg@larrygritz.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

1 more reviewer

@jfpanisset jfpanisset jfpanisset approved these changes

Reviewers whose approvals may not affect merge requirements

Assignees

No one assigned

Labels

build / testing / port / CI Affecting the build system, tests, platform support, porting, or continuous integration.

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@lgritz @jfpanisset