Lateral inhibitory hebbian learning to decorrelate units

[rcoreilly]

First pass, non-biological mechanism: simple hebbian term slowly learned with Inhib type connection directly between neurons in a pool -- specifically penalizes co-activity, weakly..

[rcoreilly]

This is very effective. Hebbian learning with lrate 0.0001 is better than 0.001 in the long run -- very slow process.