Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Compatible Tensorrt version for Jetpack 5.1.2 and CUDA 12.2 #4300

Open
mfatih7 opened this issue Dec 24, 2024 · 0 comments
Open

Compatible Tensorrt version for Jetpack 5.1.2 and CUDA 12.2 #4300

mfatih7 opened this issue Dec 24, 2024 · 0 comments

Comments

@mfatih7
Copy link

mfatih7 commented Dec 24, 2024

Hello

We have Jetpack 5.1.2 installed on our Xavier Dev Board.
We tried to update its default CUDA 11.4 to CUDA 11.8 using the script below from NVIDIA download

wget https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2004/arm64/cuda-keyring_1.0-1_all.deb
sudo dpkg -i cuda-keyring_1.0-1_all.deb
sudo apt-get update
sudo apt-get -y install cuda

Eventhough we want to update to CUDA11.8 the script installs CUDA12.2.

Then we built .whl files for torch and torchvision from source for CUDA12.2 using gcc11.
We installed the built .whl files into our Python 3.8 environment.
We can make training/inference on our Xavier Board using the Python environment successfully.
Moreover, we installed onnxruntime 1.18.0 from the link provided from Jetson Zoo and made inference succcesfully.

After that, we tried to build tensorrt from source according to the documentation in tensorrt github.
There are 2 options for getting the libraries for build: TensorRT GA or docker.

For TensorRT GA, there is no compatible version for CUDA12.2 in tonsorrt download page.
Tensorrt 8 versions do not support CUDA versions newer than CUDA 11.8.
Tensorrt 10 versions do not support CUDA versions older than CUDA 12.4.
We do not observe a compatible TensorRT GA for aarch64 architecture and CUDA12.2.

For docker, we do not also observe any compatible versions for CUDA12.2.

Is it impossible to use tensorrt with CUDA12.2 built on Jetpack 5.1.2?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant