Code

merge EMA LoRA/Lycoris support#1176

Code

Merged

bghira merged 19 commits intoreleasebghira/SimpleTuner:releasefrom mainbghira/SimpleTuner:mainCopy head branch name to clipboardNov 25, 2024

+671-236

Commits

Commits on Nov 17, 2024

• (experimental) Allow EMA on LoRA/Lycoris networks

  

  bghira

  committed
  0fba5f6

• validations: attempt to copy trainable parameters only

  

  bghira

  committed
  1cb6356

Commits on Nov 18, 2024

• ema validations overhaul to allow side by side comparison

  

  bghira

  committed
  9a18a2a

• fix EMA comparison mode during validations by correctly unloading/restoring the lycoris weights during ema enable/disable

  

  bghira

  committed
  9f7fc68

Commits on Nov 19, 2024

• add EMA information to model card

  

  bghira

  committed
  ffea178

• allow PEFT LoRA to use EMA validations

  

  bghira

  committed
  4c77156

• save EMA weights for Lycoris and LoRA to mirror the proper safetensors formats

  

  bghira

  committed
  37cc1ac

• validation for PEFT LoRA EMA weights

  

  bghira

  committed
  c1b7cca

• fix model card info

  

  bghira

  committed
  9ecd59d

• ema: validation, saving and restoring for full model training

  

  bghira

  committed
  2118dcc

• ema lora save for sdxl unet

  

  bghira

  committed
  6790c25

• fix non-ema validations

  

  bghira

  committed
  8dda33d

• update EMA docs

  

  bghira

  committed
  fc68c9e

• Merge pull request #1170 from bghira/feature/ema-for-lora

  Show description for a85c6be
  bghira

  authored
  a85c6be

• fix typo in name

  

  bghira

  committed
  4cb5e03

Commits on Nov 23, 2024

• ema: fix saving of inference-compatible weights to reference the correct parameters instead of saving a 2nd copy of the main model

  

  bghira

  committed
  dcf0fc6

• Update caption_filter_list.txt.example reference

  Show description for be11bd1
  emmanuel-ferdman

  committed
  be11bd1

• Update caption_filter_list.txt.example reference

  Show description for 15e2c84
  emmanuel-ferdman

  committed
  15e2c84

• Merge pull request #1178 from emmanuel-ferdman/main

  Show description for e876e74
  bghira

  authored
  e876e74