Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add ray to the base image #1067

Open
wants to merge 6 commits into
base: main
Choose a base branch
from
Open

Add ray to the base image #1067

wants to merge 6 commits into from

Conversation

yhtang
Copy link
Collaborator

@yhtang yhtang commented Sep 27, 2024

Installs Ray on the base image to make our containers deployable as Ray workers, so that users can distribute JAX computation to GPU nodes as Ray remote functions.

Replaces #750, which is on Chase's fork and is not able to run CI.

Closes #750.

@yhtang yhtang requested review from olupton and DwarKapex September 27, 2024 16:46
@yhtang yhtang self-assigned this Sep 27, 2024
@nouiz
Copy link
Collaborator

nouiz commented Sep 27, 2024

What is the extra container size?

@yhtang
Copy link
Collaborator Author

yhtang commented Oct 8, 2024

What is the extra container size?

It adds about 70 MB to the compressed size of the image.

Inspecting image: ghcr.io/nvidia/jax-toolbox-internal:11074498143-jax-amd64
amd64 manifest digest: sha256:baff41a793d6fc0312cf8ec8389d2c9ae1fe562e6c49b4219e3dcf7e297d8d1b
Compressed size of image ghcr.io/nvidia/jax-toolbox-internal:11074498143-jax-amd64: 6.49304e+09 bytes
----------------------------------------
Inspecting image: ghcr.io/nvidia/jax-toolbox-internal:11232636645-jax-amd64
amd64 manifest digest: sha256:80e0bdb2560fd1f9c73342b7d2cc1d50d6b30cb056ff0d7ea93a5ad79f920966
Compressed size of image ghcr.io/nvidia/jax-toolbox-internal:11232636645-jax-amd64: 6.42759e+09 bytes

@yhtang
Copy link
Collaborator Author

yhtang commented Oct 10, 2024

If no objection, I'll go ahead and merge this PR by the end of this week 😁

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants