Skip to content

Commit

Permalink
fix: typo
Browse files Browse the repository at this point in the history
  • Loading branch information
bojiang committed Oct 31, 2024
1 parent 8ca48a8 commit 0055761
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion src/vllm-chat/service.py
Original file line number Diff line number Diff line change
Expand Up @@ -83,7 +83,7 @@ async def catch_all(full_path: str):
@bentoml.service(**SERVICE_CONFIG)
class VLLM:
model_id = ENGINE_CONFIG["model"]
model = bentoml.models.HuggingFaceModel(model_name)
model = bentoml.models.HuggingFaceModel(model_id)

def __init__(self) -> None:
from vllm import AsyncEngineArgs, AsyncLLMEngine
Expand Down

0 comments on commit 0055761

Please sign in to comment.