Skip to content

Commit

Permalink
feat: Support mistral-large fp16 and awq (#9)
Browse files Browse the repository at this point in the history
  • Loading branch information
rickzx authored Aug 1, 2024
1 parent c59bd02 commit 0793aff
Show file tree
Hide file tree
Showing 167 changed files with 5,658 additions and 0 deletions.
16 changes: 16 additions & 0 deletions bentoml/bentos/mistral/large-123b-instruct-awq-4bit-ec0c/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,16 @@
# mistral:large-123b-instruct-awq-4bit-ec0c

[![pypi_status](https://img.shields.io/badge/BentoML-1.3.0-informational)](https://pypi.org/project/BentoML)
[![documentation_status](https://readthedocs.org/projects/bentoml/badge/?version=latest)](https://docs.bentoml.com/)
[![join_slack](https://badgen.net/badge/Join/BentoML%20Slack/cyan?icon=slack)](https://l.bentoml.com/join-slack-swagger)
[![BentoML GitHub Repo](https://img.shields.io/github/stars/bentoml/bentoml?style=social)](https://github.com/bentoml/BentoML)
[![Twitter Follow](https://img.shields.io/twitter/follow/bentomlai?label=Follow%20BentoML&style=social)](https://twitter.com/bentomlai)

This is a Machine Learning Service created with BentoML.

## Help

* [📖 Documentation](https://docs.bentoml.com/en/latest/): Learn how to use BentoML.
* [💬 Community](https://l.bentoml.com/join-slack-swagger): Join the BentoML Slack community.
* [🐛 GitHub Issues](https://github.com/bentoml/BentoML/issues): Report bugs and feature requests.
* Tip: you can also [customize this README](https://docs.bentoml.com/en/latest/concepts/bento.html#description).
Loading

0 comments on commit 0793aff

Please sign in to comment.