Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Implementation of powerpropagation as a modifier #1685

Merged
merged 48 commits into from
Nov 20, 2023
Merged

Implementation of powerpropagation as a modifier #1685

merged 48 commits into from
Nov 20, 2023

Commits on May 18, 2023

  1. update get_named_layers_and_params_by_regex in src/sparseml/pytorch/u… 

    …tils/helpers.py to still match in the DDP training case, where module. is prepended to layer names
    @ohaijen
    ohaijen committed May 18, 2023
    Configuration menu
    Copy the full SHA
    d7dc46a View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' of github.com:neuralmagic/sparseml into main

    @ohaijen
    ohaijen committed May 18, 2023
    Configuration menu
    Copy the full SHA
    86703b9 View commit details
    Browse the repository at this point in the history

Commits on Jul 3, 2023

  1. first pass at top-kast pruner - decoupling forward and backward sparsity

    @ohaijen
    ohaijen committed Jul 3, 2023
    Configuration menu
    Copy the full SHA
    c74827a View commit details
    Browse the repository at this point in the history

Commits on Jul 12, 2023

  1. get top-kast pruner working

    @ohaijen
    ohaijen committed Jul 12, 2023
    Configuration menu
    Copy the full SHA
    e56774a View commit details
    Browse the repository at this point in the history

  2. make style and quality

    @ohaijen
    ohaijen committed Jul 12, 2023
    Configuration menu
    Copy the full SHA
    36f4c77 View commit details
    Browse the repository at this point in the history

Commits on Jul 17, 2023

  1. small cleanup

    @ohaijen
    ohaijen committed Jul 17, 2023
    Configuration menu
    Copy the full SHA
    ec4ff60 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'topkast' of github.com:neuralmagic/sparseml into topkast

    @ohaijen
    ohaijen committed Jul 17, 2023
    Configuration menu
    Copy the full SHA
    5959b07 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' of github.com:neuralmagic/sparseml into main

    @ohaijen
    ohaijen committed Jul 17, 2023
    Configuration menu
    Copy the full SHA
    51d7453 View commit details
    Browse the repository at this point in the history

  4. first pass at powerpropagated resnet

    @ohaijen
    ohaijen committed Jul 17, 2023
    Configuration menu
    Copy the full SHA
    0b006d3 View commit details
    Browse the repository at this point in the history

Commits on Jul 24, 2023

  1. first pass for powerpropagation as a modifier

    @ohaijen
    ohaijen committed Jul 24, 2023
    Configuration menu
    Copy the full SHA
    216aa60 View commit details
    Browse the repository at this point in the history

Commits on Jul 25, 2023

  1. forgot recipe_templage

    @ohaijen
    ohaijen committed Jul 25, 2023
    Configuration menu
    Copy the full SHA
    719db6a View commit details
    Browse the repository at this point in the history

Commits on Aug 2, 2023

  1. create actual powerpropagated subclasses

    @ohaijen
    ohaijen committed Aug 2, 2023
    Configuration menu
    Copy the full SHA
    4a6c863 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' of github.com:neuralmagic/sparseml into main

    @ohaijen
    ohaijen committed Aug 2, 2023
    Configuration menu
    Copy the full SHA
    ffc3eac View commit details
    Browse the repository at this point in the history

  3. make pytorch.torchvision.train.py work with torch.distributed.launch

    @ohaijen
    ohaijen committed Aug 2, 2023
    Configuration menu
    Copy the full SHA
    516a8f6 View commit details
    Browse the repository at this point in the history

  4. undo accidental add

    @ohaijen
    ohaijen committed Aug 2, 2023
    Configuration menu
    Copy the full SHA
    c0051af View commit details
    Browse the repository at this point in the history

  5. Merge remote-tracking branch 'origin/torchvision_ddp_fix' into topkast

    @ohaijen
    ohaijen committed Aug 2, 2023
    Configuration menu
    Copy the full SHA
    5075bde View commit details
    Browse the repository at this point in the history

  6. some fixes to the modifier

    @ohaijen
    ohaijen committed Aug 2, 2023
    Configuration menu
    Copy the full SHA
    b999330 View commit details
    Browse the repository at this point in the history

Commits on Aug 7, 2023

  1. setup powerpropagation tests

    @ohaijen
    ohaijen committed Aug 7, 2023
    Configuration menu
    Copy the full SHA
    8405384 View commit details
    Browse the repository at this point in the history

  2. remove fist attempt at implementation

    @ohaijen
    ohaijen committed Aug 7, 2023
    Configuration menu
    Copy the full SHA
    955ce1e View commit details
    Browse the repository at this point in the history

Commits on Aug 9, 2023

  1. get powerpropagation working as a wrapper

    @ohaijen
    ohaijen committed Aug 9, 2023
    Configuration menu
    Copy the full SHA
    4aa3d22 View commit details
    Browse the repository at this point in the history

  2. update testing recipe

    @ohaijen
    ohaijen committed Aug 9, 2023
    Configuration menu
    Copy the full SHA
    56cc96f View commit details
    Browse the repository at this point in the history

  3. ensure we don't set the mask twice and convert L2 loss to weight decay

    @ohaijen
    ohaijen committed Aug 9, 2023
    Configuration menu
    Copy the full SHA
    7f5ea36 View commit details
    Browse the repository at this point in the history

Commits on Aug 10, 2023

  1. revert train.py to main version

    @ohaijen
    ohaijen committed Aug 10, 2023
    Configuration menu
    Copy the full SHA
    4b6e7b8 View commit details
    Browse the repository at this point in the history

  2. clean, working version of powerpropagation

    @ohaijen
    ohaijen committed Aug 10, 2023
    Configuration menu
    Copy the full SHA
    24a7bf7 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'powerprop' of github.com:neuralmagic/sparseml into powe… 

    …rprop
    @ohaijen
    ohaijen committed Aug 10, 2023
    Configuration menu
    Copy the full SHA
    102c266 View commit details
    Browse the repository at this point in the history

  4. make style/quality

    @ohaijen
    ohaijen committed Aug 10, 2023
    Configuration menu
    Copy the full SHA
    97bea93 View commit details
    Browse the repository at this point in the history

  5. undo changes that shouldn't be in the PR

    @ohaijen
    ohaijen committed Aug 10, 2023
    Configuration menu
    Copy the full SHA
    dbfafee View commit details
    Browse the repository at this point in the history

  6. Merge branch 'main' into powerprop

    @ohaijen
    ohaijen committed Aug 10, 2023
    Configuration menu
    Copy the full SHA
    1bfab60 View commit details
    Browse the repository at this point in the history

  7. undo accidental change?

    @ohaijen
    ohaijen committed Aug 10, 2023
    Configuration menu
    Copy the full SHA
    d8671bf View commit details
    Browse the repository at this point in the history

  8. Merge branch 'main' into powerprop

    @ohaijen
    ohaijen authored Aug 10, 2023
    Configuration menu
    Copy the full SHA
    c70e63e View commit details
    Browse the repository at this point in the history

Commits on Aug 14, 2023

  1. make quality and add a weight decay test

    @ohaijen
    ohaijen committed Aug 14, 2023
    Configuration menu
    Copy the full SHA
    24f3d89 View commit details
    Browse the repository at this point in the history

  2. revert changes to train.py

    @ohaijen
    ohaijen committed Aug 14, 2023
    Configuration menu
    Copy the full SHA
    e11d5aa View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' into topkast

    @ohaijen
    ohaijen authored Aug 14, 2023
    Configuration menu
    Copy the full SHA
    6b072f5 View commit details
    Browse the repository at this point in the history

Commits on Sep 4, 2023

  1. Merge branch 'main' of github.com:neuralmagic/sparseml into main

    @ohaijen
    ohaijen committed Sep 4, 2023
    Configuration menu
    Copy the full SHA
    39fac2e View commit details
    Browse the repository at this point in the history

Commits on Sep 11, 2023

  1. Merge branch 'main' of github.com:neuralmagic/sparseml into main

    @ohaijen
    ohaijen committed Sep 11, 2023
    Configuration menu
    Copy the full SHA
    4ec08bc View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into topkast

    @ohaijen
    ohaijen committed Sep 11, 2023
    Configuration menu
    Copy the full SHA
    000de7d View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' into powerprop

    @ohaijen
    ohaijen committed Sep 11, 2023
    Configuration menu
    Copy the full SHA
    4065a87 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'topkast' into powerprop

    @ohaijen
    ohaijen committed Sep 11, 2023
    Configuration menu
    Copy the full SHA
    24c9ea7 View commit details
    Browse the repository at this point in the history

  5. Revert "Merge branch 'topkast' into powerprop" 

    This reverts commit 24c9ea7, reversing
changes made to 4065a87.
    @ohaijen
    ohaijen committed Sep 11, 2023
    Configuration menu
    Copy the full SHA
    a934051 View commit details
    Browse the repository at this point in the history

Commits on Oct 24, 2023

  1. Merge branch 'main' into powerprop

    @anmarques
    anmarques authored Oct 24, 2023
    Configuration menu
    Copy the full SHA
    830e01e View commit details
    Browse the repository at this point in the history

Commits on Oct 25, 2023

  1. fix quality errors

    @ohaijen
    ohaijen committed Oct 25, 2023
    Configuration menu
    Copy the full SHA
    b963683 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'powerprop' of github.com:neuralmagic/sparseml into powe… 

    …rprop
    @ohaijen
    ohaijen committed Oct 25, 2023
    Configuration menu
    Copy the full SHA
    3dadd5b View commit details
    Browse the repository at this point in the history

Commits on Nov 6, 2023

  1. Merge branch 'main' into powerprop

    @ohaijen
    ohaijen authored Nov 6, 2023
    Configuration menu
    Copy the full SHA
    0903d4e View commit details
    Browse the repository at this point in the history

Commits on Nov 16, 2023

  1. Merge branch 'main' into powerprop

    @abhinavnmagic
    abhinavnmagic authored Nov 16, 2023
    Configuration menu
    Copy the full SHA
    f246989 View commit details
    Browse the repository at this point in the history

Commits on Nov 20, 2023

  1. Merge branch 'main' into powerprop

    @ohaijen
    ohaijen authored Nov 20, 2023
    Configuration menu
    Copy the full SHA
    4e96424 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into powerprop

    @ohaijen
    ohaijen authored Nov 20, 2023
    Configuration menu
    Copy the full SHA
    db8896e View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' into powerprop

    @ohaijen
    ohaijen authored Nov 20, 2023
    Configuration menu
    Copy the full SHA
    6b77f62 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'main' into powerprop

    @ohaijen
    ohaijen authored Nov 20, 2023
    Configuration menu
    Copy the full SHA
    547889f View commit details
    Browse the repository at this point in the history