Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Frontend] Allow the user to switch model and continue session #4605

Open
enyst opened this issue Oct 29, 2024 · 0 comments
Open

[Frontend] Allow the user to switch model and continue session #4605

enyst opened this issue Oct 29, 2024 · 0 comments
Labels
enhancement New feature or request frontend Related to frontend

Comments

@enyst
Copy link
Collaborator

enyst commented Oct 29, 2024

What problem or use case are you trying to solve?

Allow the user to switch the model without necessarily starting a new session.

Do you have thoughts on the technical implementation?

I'm not sure why we wouldn't allow switching model. There's no reason in the backend why switching model wouldn't just work, I don't think. If I recall correctly, this used to work with the UI too. I'll note that the user will lose history if we force a new session. Why not let them try a better/different model for their current project?

To be sure, there are settings which have to trigger a runtime reload, which we might call new session, but model/base url/api key are not. In fact, I think all LLMConfig settings would work just fine, backend-wise, in the same session.

@enyst enyst added enhancement New feature or request frontend Related to frontend labels Oct 29, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request frontend Related to frontend
Projects
None yet
Development

No branches or pull requests

1 participant