Skip to content

Pull requests: openvinotoolkit/openvino.genai

New pull request New
32 Open 1,091 Closed
32 Open 1,091 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Add export command for compressed VLMs category: sampling Sampling / Decoding algorithms
#1218 opened Nov 17, 2024 by nikita-savelyevv Loading…
Move beam search in case of chat scenario to sampler.cpp category: continuous batching Continuous batching category: LLM LLM pipeline (stateful, static) category: sampling Sampling / Decoding algorithms category: visual language Visual language pipeline
#1215 opened Nov 14, 2024 by sbalandi Loading… 2025.0
@ilya-lavrenov @Wovchena
20
Added chat template to CLI. category: WWB PR changes WWB
#1208 opened Nov 13, 2024 by andreyanufr • Draft
[CPU] Change kvcache default type of PagedAttention to u8 for CPU plugin category: continuous batching Continuous batching category: GHA CI based on Github actions category: sampling Sampling / Decoding algorithms
#1206 opened Nov 13, 2024 by luo-cheng2021 • Draft 2025.0
3
Whisper pipeline: filter non segment perf metrics category: GenAI C++ API Changes in GenAI C++ public headers category: Python API Python API for GenAI category: sampling Sampling / Decoding algorithms category: whisper Whisper pipeline
#1203 opened Nov 12, 2024 by as-suvorov Loading… 2025.0
@ilya-lavrenov @Wovchena
6
Test master logits category: LLM LLM pipeline (stateful, static) category: samples GenAI samples category: sampling Sampling / Decoding algorithms do_not_merge do_not_review
#1201 opened Nov 12, 2024 by Wovchena • Draft
StaticLLMPipeline: Optimize kvcache copy category: LLM LLM pipeline (stateful, static) category: sampling Sampling / Decoding algorithms
#1199 opened Nov 12, 2024 by yviansu Loading…
[JS] Add GenAI Node.js bindings category: cmake / build Cmake scripts category: samples GenAI samples category: sampling Sampling / Decoding algorithms do_not_merge
#1193 opened Nov 11, 2024 by vishniakov-nikolai • Draft
3 tasks
ONNX <= 1.17.0 category: sampling Sampling / Decoding algorithms
#1183 opened Nov 11, 2024 by ilya-lavrenov Loading… 2025.0
@Wovchena
Added basic git based code checks #663 category: GHA CI based on Github actions category: sampling Sampling / Decoding algorithms
#1181 opened Nov 9, 2024 by rishik-ashili Loading…
2
Fixed passing of generation config params to VLM generate. bug Something isn't working category: GenAI C++ API Changes in GenAI C++ public headers category: LLM LLM pipeline (stateful, static) category: Python API Python API for GenAI category: sampling Sampling / Decoding algorithms category: text to image Text 2 image pipeline category: visual language Visual language pipeline category: whisper Whisper pipeline
#1180 opened Nov 8, 2024 by popovaan Loading… 2025.0
@ilya-lavrenov
16
Update Python VLM example in README category: sampling Sampling / Decoding algorithms
#1178 opened Nov 8, 2024 by helena-intel Loading…
6
StaticLLMPipeline: Optimize V-tensors layout category: cmake / build Cmake scripts category: LLM LLM pipeline (stateful, static) category: NPU
#1177 opened Nov 8, 2024 by TolyaTalamanov Loading…
14
[Speculative decoding] Alignment Speculative decoding vs Continuous batching results with many requests category: speculative decoding Speculative decoding
#1171 opened Nov 7, 2024 by iefode Loading… 2025.0
@ilya-lavrenov
1
Preserve default config for LLM samples category: samples GenAI samples category: sampling Sampling / Decoding algorithms
#1152 opened Nov 6, 2024 by Wovchena Loading…
2
Add GPU FP16 overflow fix category: WWB PR changes WWB do_not_merge
#1120 opened Nov 1, 2024 by AlexKoff88 • Draft
@ilya-lavrenov
4
Verify chatglm3 6b category: GHA CI based on Github actions category: sampling Sampling / Decoding algorithms category: tokenizers Tokenizer class or submodule update
#1119 opened Oct 31, 2024 by Aniruddha521 Loading…
1
20
StaticLLMPipeline: Enable chat test category: sampling Sampling / Decoding algorithms
#1117 opened Oct 31, 2024 by TolyaTalamanov Loading…
@Wovchena
4
StaticLLMPipeline: Use set_tensor for kvcache model category: LLM LLM pipeline (stateful, static)
#1106 opened Oct 30, 2024 by TolyaTalamanov • Draft
@dmatveev
4
Corrected performance data when batch size is greater than 1 category: sampling Sampling / Decoding algorithms do_not_merge
#1100 opened Oct 29, 2024 by wgzintel • Draft
@pavel-esir @Wovchena
6
[WWB]: Add support for VisualLanguage models category: sampling Sampling / Decoding algorithms category: WWB PR changes WWB
#1086 opened Oct 28, 2024 by AlexKoff88 • Draft
@andreyanufr
[CB] Speculative decoding benchmarking category: LLM LLM pipeline (stateful, static) category: samples GenAI samples category: sampling Sampling / Decoding algorithms category: speculative decoding Speculative decoding
#1037 opened Oct 21, 2024 by iefode • Draft
Grouped source files in GenAI src folder category: cmake / build Cmake scripts category: continuous batching Continuous batching category: GHA CI based on Github actions category: Python API Python API for GenAI category: sampling Sampling / Decoding algorithms category: speculative decoding Speculative decoding category: text to image Text 2 image pipeline category: visual language Visual language pipeline category: whisper Whisper pipeline
#1016 opened Oct 18, 2024 by ilya-lavrenov Loading…
@Wovchena
6
[test] Update Optimum to Use Symbols do_not_merge do_not_review
#1004 opened Oct 17, 2024 by jane-intel Loading…
Add tokenized prompt to the results category: WWB PR changes WWB
#1001 opened Oct 17, 2024 by apaniukov • Draft
4
ProTip! Updated in the last three days: updated:>2024-11-14.