Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Get more informative timeout variable names or clarify them in the comments #8885

Open
falfaroalmagro opened this issue Oct 7, 2024 · 1 comment
Labels
needs info Needs further information from the user

Comments

@falfaroalmagro
Copy link

falfaroalmagro commented Oct 7, 2024

Could the variable timeout in line 6318 of the scheduler have a more sensible name?

I have no idea how to configure that parameter in the yaml configuration file. I have resorted to manually set that value to 600 seconds in my own copy of the code, because I have not been able to configure it. I have tried:

  • jobqueue.slurm.connect-timeout
  • jobqueue.slurm.tcp-timeout
  • jobqueue.slurm.no-workers-timeout
  • jobqueue.slurm.death-timeout
  • jobqueue.slurm.timeout

None of those correspond to that timeout variable.

Thanks

@jacobtomlinson
Copy link
Member

It looks to me like the scheduler function you are referring to gets called via Client.scatter(), which optionally takes timeout as an argument. The default value for that timeout is set by distributed.comm.timeouts.connect.

timeout = dask.config.get("distributed.comm.timeouts.connect")

I'm not sure renaming an internal variable within a private function makes things any clearer. Perhaps part of the confusion is the docstring mentions that this is the timeout for the initial connection to the scheduler, but that default value seems to be used to other timeouts in other places too, like scatter.

timeout: int (defaults to configuration ``distributed.comm.timeouts.connect``)
Timeout duration for initial connection to the scheduler

@jacobtomlinson jacobtomlinson added needs info Needs further information from the user and removed needs triage labels Oct 15, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
needs info Needs further information from the user
Projects
None yet
Development

No branches or pull requests

2 participants