You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
When there are a large number of scheduled sessions for a single scheduler tick, making all RPC calls at once may cause the manager performance issues and potential hangs.
Let's apply the concept of more_itertools.chunked() when making the RPC calls for each kernel creation, introducing a new configuration option to specify the chunk size.
We should also check if the hang happens when there are overlapping RPC calls to the same agent, even when there is a low number of kernels to create.
The text was updated successfully, but these errors were encountered:
achimnol
changed the title
Add config (or const) to limit the number of session created by a scheduler in one tick
Limit the number of sessions (and their kernels) created at a single scheduler tick
Oct 24, 2024
When there are a large number of scheduled sessions for a single scheduler tick, making all RPC calls at once may cause the manager performance issues and potential hangs.
Let's apply the concept of
more_itertools.chunked()
when making the RPC calls for each kernel creation, introducing a new configuration option to specify the chunk size.We should also check if the hang happens when there are overlapping RPC calls to the same agent, even when there is a low number of kernels to create.
The text was updated successfully, but these errors were encountered: