Neuron Learning Machine for Representation Learning

This paper presents a novel neuron learning machine (NLM) which can extract hierarchical features from data. We focus on the single-layer neural network architecture and propose to model the network based on the Hebbian learning rule. Hebbian learning rule describes how synaptic weight changes with the activations of presynaptic and postsynaptic neurons. We model the learning rule as the objective function by considering the simplicity of the network and stability of solutions. We make a hypothesis and introduce a correlation based constraint according to the hypothesis. We find that this biologically inspired model has the ability of learning useful features from the perspectives of retaining abstract information. NLM can also be stacked to learn hierarchical features and reformulated into convolutional version to extract features from 2-dimensional data.

Authors

• Jia Liu Xi'an Jiaotong University, Xi'an, China
• Maoguo Gong School of Electronic Engineering, Xidian University, Xi’an 710071, China Key Laboratory of Collaborative Intelligence Systems, Ministry of Education, Xi’an 710071, China
• Qiguang Miao MoE Key Lab of Collaborative Intelligence Systems, Xidian University School of Computer Science and Technology, Xidian University

Keywords

No keywords are indexed for this paper.