server: cancel prompt processing & non-streamed requests when connection closed
#15620
| Job | Run time |
|---|---|
| 11m 55s | |
| 8m 30s | |
| 3m 53s | |
| 3m 16s | |
| 2m 53s | |
| 2m 37s | |
| 2m 53s | |
| 11m 9s | |
| 3m 5s | |
| 1m 56s | |
| 5m 25s | |
| 18m 21s | |
| 4m 21s | |
| 10m 13s | |
| 10m 9s | |
| 3m 2s | |
| 2m 50s | |
| 2m 56s | |
| 1m 33s | |
| 1m 25s | |
| 8m 14s | |
| 20m 3s | |
| 4m 5s | |
| 6m 29s | |
| 12m 29s | |
| 29m 9s | |
| 11m 13s | |
| 5m 40s | |
| 10m 4s | |
| 13m 53s | |
| 11m 8s | |
| 9m 28s | |
| 3m 23s | |
| 6m 16s | |
| 9m 32s | |
| 1m 26s | |
| 2m 36s | |
| 18m 43s | |
| 2m 58s | |
| 2m 18s | |
| 0s | |
| 1s | |
| 5h 1m 30s |