-
-
Notifications
You must be signed in to change notification settings - Fork 66
Windows Nvidia TensorRT Support
Benjamin Paine edited this page Nov 8, 2023
·
1 revision
In order to use Nvidia TensorRT on Windows, some additional steps must be taken. This is temporary (hopefully) as TensorRT support for Windows is very new.
You will be asked to add a number of directories to your PATH. On windows, the easiest way to reach it is:
- Open the start menu and begin typing "Environment". You will see an option that says "Edit the system environment variables," click this.
- In the bottom-right-hand corner of the System Properties window, click "Environment Variables."
- Under your user, click the "Path" variable and then click "Edit".
- Add a new entry pointing to the requested path.
Before downloading anything, you will need to make an account with Nvidia and Join the Nvidia Developer Program.
Once that is complete, download the following packages and install them anywhere to your system.
-
Install CUDA, add
/bin
to PATH -
Install CUDNN, add
/lib
to PATH -
Install TensorRT, add
/lib
to PATH. If you are creating your own environment, you should also usepip
to installpython/tensorrt-8.*-cp310-none-win_amd64.whl
from this directory. - If you are creating your own environment, now run
pip install enfugue[tensorrt]