Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

'MDAnalysis.analysis.align' parallelization #4738

Draft
wants to merge 18 commits into
base: develop
Choose a base branch
from

Conversation

talagayev
Copy link
Member

@talagayev talagayev commented Oct 18, 2024

Fixes #4659 attempt

Changes made in this Pull Request:

  • added backends and aggregators to AlignTraj and AverageStructure in analysis.align.
  • added the client_AlignTraj and client_AverageStructure in conftest.py
  • added client_AlignTraj and client_AverageStructure in run() in test_align.py

Currently for AlignTraj it only accepts serial and dask with multiprocessing leading to the pytests taking forever. An additional error that appears is the following:

OSError: File opened in mode: self.mode. Reading only allow in mode "r"

For AverageStructure the Failure that appears is the following:

AttributeError: 'numpy.ndarray' object has no attribute 'load_new'

Which leads me to believe that AverageStructure can not be parallelized, but I would need additional opinions on it and on AlignTraj :)

PR Checklist

  • Tests?
  • Docs?
  • CHANGELOG updated?
  • Issue raised/referenced?

Developers certificate of origin


📚 Documentation preview 📚: https://mdanalysis--4738.org.readthedocs.build/en/4738/

added backends and aggregators for AverageStructure
added AverageStructure to conftest
added client_AverageStructure
added for AlignTraj backends and aggregator
added client_AlignTraj
added client_AlignTraj to tests
@pep8speaks
Copy link

pep8speaks commented Oct 18, 2024

Hello @talagayev! Thanks for updating this PR. We checked the lines you've touched for PEP 8 issues, and found:

There are currently no PEP 8 issues detected in this Pull Request. Cheers! 🍻

Comment last updated at 2024-10-18 21:03:42 UTC

PEP fixes
adjusted position of inputs
fix positional arguments
added multiprocessing to test
removed multiprocessing from AlignTraj
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

MDAnalysis.analysis.align Implement parallelization or mark as unparallelizable
2 participants