Batch Intrinsic Plasticity for Extreme Learning Machines

TitleBatch Intrinsic Plasticity for Extreme Learning Machines
Publication TypeConference Paper
Year of Publication2011
AuthorsNeumann K, Steil JJ
EditorHonkela T, Duch W, Girolami M, Kaski S
Conference NameArtificial Neural Networks and Machine Learning – ICANN 2011. Pt. 1

Extreme learning machines are single-hidden layer feed- forward neural networks, where the training is restricted to the output weights in order to achieve fast learning with good performance. The success of learning strongly depends on the random parameter initialization. To overcome the problem of unsuited initialization ranges, a novel and efficient pretraining method to adapt extreme learning machines task-specific is presented. The pretraining aims at desired output distributions of the hidden neurons. It leads to better performance and less dependence on the size of the hidden layer.