v0.2.4

Optimisers v0.2.4

Diff since v0.2.3

Merged pull requests:

• Expand readme, link to Lux.jl (#73) (@mcabbott)
• AdaBelief bias correction and epsilon (#75) (@cossio)

v0.2.3

Optimisers v0.2.3

Diff since v0.2.2

Closed issues:

• Using destructure with functions or anything without (trainable) parameters (#67)
• Chaining gpu and cpu models (#69)

Merged pull requests:

• Allow destructure to make an empty vector (#68) (@mcabbott)

v0.2.2

Optimisers v0.2.2

Diff since v0.2.1

Merged pull requests:

• Readme links (#64) (@mcabbott)
• Widen in _grad! (#66) (@mcabbott)

v0.2.1

Optimisers v0.2.1

Diff since v0.2.0

Merged pull requests:

• Missing vec in gradient of destructure (#59) (@mcabbott)
• Improve WeightDecay docstring (#60) (@mcabbott)

v0.2.0

Optimisers v0.2.0

First registered release, almost a re-write under new management.

Diff since v0.1.0

Closed issues:

• Getting Optimisers moved out of Flux (#5)
• memory impact of the functional approach (#12)
• Missing definition in the basic usage example (#26)
• Handle non-array leaves in state(o, x) (#28)
• Support ChainRules types (#32)
• Optimise a subset of parameters (#35)
• Port over rule changes from Flux (#38)
• Correct the optimiser's eltype? (#55)

Merged pull requests:

• Add gradient clipping (#27) (@mcabbott)
• Optimise only at isnumeric leaves (#29) (@mcabbott)
• Wrap optimiser and state in a struct (#30) (@mcabbott)
• Add lazy broadcasting (#31) (@mcabbott)
• Add code coverage (#34) (@ToucheSir)
• Add trainable (#36) (@mcabbott)
• Make the example run (#37) (@mcabbott)
• Add some tests using StaticArrays (#39) (@mcabbott)
• Allow types from ChainRules (#41) (@mcabbott)
• Trivial cases of OptimiserChain (#43) (@mcabbott)
• Stop testing on windows + mac (#44) (@mcabbott)
• Disable codecov auto comment and add badge (#45) (@ToucheSir)
• Complex numbers alla Flux 1776 (#47) (@mcabbott)
• Separate @lazy from @.. macro, fix some bugs (#48) (@mcabbott)
• Ensure that update without a gradient is an error (#50) (@mcabbott)
• Add destructure, take II (#54) (@mcabbott)
• Explicitly preserve eltype (#56) (@mcabbott)

v0.1.0

Optimisers v0.1.0

Closed issues:

• README (#18)
• Package registration (#20)

Merged pull requests:

• add ADAM (#3) (@DhairyaLGandhi)
• add GA ci (#6) (@DhairyaLGandhi)
• Add some more Optimisers (#7) (@DhairyaLGandhi)
• Remove noarg constructors for some optimisers (#8) (@DhairyaLGandhi)
• Move all optimizers to Optimisers.jl (#9) (@darsnack)
• Add optimiser updates utility (#14) (@DhairyaLGandhi)
• RFC: Switch interface for higher-order optimizers (#16) (@darsnack)
• fix Descent apply rule (#17) (@DhairyaLGandhi)
• Add docs (#19) (@DhairyaLGandhi)
• Update compat sections for registration (#22) (@DhairyaLGandhi)