Skip to content

server: cancel prompt processing & non-streamed requests when connection closed #15616

server: cancel prompt processing & non-streamed requests when connection closed

server: cancel prompt processing & non-streamed requests when connection closed #15616

windows-latest-cmake (avx2-x64, -DGGML_NATIVE=OFF -DLLAMA_BUILD_SERVER=ON -DGGML_RPC=ON -DBUILD_S...

succeeded Sep 29, 2024 in 10m 2s