Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support for LLaMa3.3 #2567

Open
FernandoDorado opened this issue Dec 11, 2024 · 2 comments
Open

Support for LLaMa3.3 #2567

FernandoDorado opened this issue Dec 11, 2024 · 2 comments
Labels
triaged Issue has been triaged by maintainers

Comments

@FernandoDorado
Copy link

Hello!

Would it be possible to update the existing examples to incorporate deployment of the following model via tensorrt-llm?
https://huggingface.co/meta-llama/Llama-3.3-70B-Instruct

This model appears to have significant potential. Additionally, if its integration process is similar to previous Llama 3.x models, can you confirm whether it would be compatible with the existing setup?

@nv-guomingz
Copy link
Collaborator

@AdamzNV @laikhtewari

@nv-guomingz
Copy link
Collaborator

Hi @FernandoDorado ,we've evaluted this model with latest code base on main branch and it could be ran succesfully. We'll add it to support model list once we finished more testing.

@nv-guomingz nv-guomingz added the triaged Issue has been triaged by maintainers label Dec 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
triaged Issue has been triaged by maintainers
Projects
None yet
Development

No branches or pull requests

2 participants