You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
This model appears to have significant potential. Additionally, if its integration process is similar to previous Llama 3.x models, can you confirm whether it would be compatible with the existing setup?
The text was updated successfully, but these errors were encountered:
Hi @FernandoDorado ,we've evaluted this model with latest code base on main branch and it could be ran succesfully. We'll add it to support model list once we finished more testing.
Hello!
Would it be possible to update the existing examples to incorporate deployment of the following model via tensorrt-llm?
https://huggingface.co/meta-llama/Llama-3.3-70B-Instruct
This model appears to have significant potential. Additionally, if its integration process is similar to previous Llama 3.x models, can you confirm whether it would be compatible with the existing setup?
The text was updated successfully, but these errors were encountered: