v0.1.1

What's Changed

• Fix macos CI by @aniketmaurya in #62
• batched streaming by @aniketmaurya in #55
• fix: broken pipes caused inference worker to fail by @aniketmaurya in #61
• fix: default unbatch always generator by @aniketmaurya in #68
• document streaming by @aniketmaurya in #49
• document accelerator=auto by @aniketmaurya in #64
• document batching by @aniketmaurya in #65
• allow timeout disable by @aniketmaurya in #63
• Add devices auto by @lantiga in #69
• add license info by @aniketmaurya in #74
• allow to set mps accelerator explicitly by @aniketmaurya in #73
• add readme improvements by @aniketmaurya in #70
• decouple decode_request from get_batch_from_uid by @aniketmaurya in #79
• fix cuda forking error by @aniketmaurya in #77
• feat: Support multipart & url-encoded form bodies by @andyland in #80
• Let the user know when "setup" has completed... by @williamFalcon in #82
• format encoded response by @aniketmaurya in #85
• [pre-commit.ci] pre-commit suggestions by @pre-commit-ci in #78
• improve logging by @aniketmaurya in #87
• Update server.py by @williamFalcon in #89
• removes /stream-predict endpoint and standardizes to /predict by @aniketmaurya in #93
• validate port by @aniketmaurya in #92
• Bump version since litserve is different from the last released version by @rasbt in #94
• Add Stream API Example by @rasbt in #95
• add openai spec v0 by @aniketmaurya in #76
• Exclude markdown files from pre-commit formatter by @rasbt in #96
• fix summary tag by @aniketmaurya in #97
• add client detail to streaming document by @aniketmaurya in #98
• Fix installation instructions for case sensitive file systems by @rasbt in #102
• Improve docs for OpenAI spec by @lantiga in #100
• add newline while streaming JSON objects by @aniketmaurya in #105
• fix pipe reuse by @aniketmaurya in #108
• add openai streaming by @aniketmaurya in #101
• Add real docs! by @williamFalcon in #114
• feat: Update OpenAI spec to include image url in message content by @bhimrazy in #113
• feat: Update OpenAI spec to include support for tools by @bhimrazy in #119
• inject context to share/log values across LitAPI methods by @aniketmaurya in #118
• Track device automatically by @aniketmaurya in #123
• fix: kill process by @bhimrazy in #124
• [pre-commit.ci] pre-commit suggestions by @pre-commit-ci in #125
• pre-populate context with OpenAISpec by @aniketmaurya in #126
• Bump version for new release by @rasbt in #127

New Contributors

• @andyland made their first contribution in #80
• @pre-commit-ci made their first contribution in #78
• @rasbt made their first contribution in #94
• @bhimrazy made their first contribution in #113

Full Changelog: v0.1.0...v0.1.1