Docker image

[SehajDxstiny]

could anyone tell how much time would it take to release the docker image?

[juney-nvidia]

"how much time would it take to release the docker image?"
Do you mean how much time it takes to build the docker image?

[SehajDxstiny]

No. "TensorRT-LLM must be built from source, instructions can be found here. An image of a Docker container with TensorRT-LLM and its Triton Inference Server Backend will be made available soon"

i mean this, when would this be released?

[jdemouth-nvidia]

Hi @SehajDxstiny ,

Thanks for the clarification. We expect the first container for TensorRT-LLM and its Triton Inference Server Backend to be released before the end of the month. We'll keep you posted when it's released.

Thanks,
Julien

[SehajDxstiny]

thank you.

[Bhuvanesh09]

@jdemouth-nvidia Any updates on this?

[w32zhong]

@jdemouth-nvidia any updates on this?

[ivanbaldo]

Where is the container image then?

[helloyongyang]

???

[yotamraz]

???

[Isaac4real]

??