Skip to content

Reproducing the results in "Implicit Regularization in ReLU Networks with the Square Loss" using Matlab

Notifications You must be signed in to change notification settings

aminfadaei116/implicit-regularization-in-relu-networks-paper-code

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 
 
 

Repository files navigation

Implicit-Regularization-in-ReLU-Networks-Paper-code

Matlab Code of paper "Implicit Regularization in ReLU Networks with the Square Loss"

This paper is by Gal Vardi, Ohad Shamir. You can find the paper on https://arxiv.org/abs/2012.05156

In the paper they used L2 loss, however I added L1 loss, log(cosh) loss and Huber loss to my code.

File plot_Implicit_Regularization.m contains the function. File Test.m is an example that you could see how it works with different loss functions. Enjoy ;)

About

Reproducing the results in "Implicit Regularization in ReLU Networks with the Square Loss" using Matlab

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages