Package crino :: Module network :: Class AutoEncoder
[hide private]
[frames] | no frames]

Class AutoEncoder

source code

Known Subclasses:

An AutoEncoder is a neural network whichs aims at encoding its inputs in a smaller representation space. It is made of a projection layer and a backprojection layer. The compressed representation (or hidden representation) lies in the projection layer, while the backprojection layer reconstructs the original inputs.

The weights between those two layers are shared, that means that the backprojection matrix is constrained to be the transpose of the projection matrix. However, the two biases are independant.

If the data allows it, the AutoEncoder is best learned with a Sigmoid final activation module in conjunction with a CrossEntropy criterion.


See Also: CrossEntropy, Sigmoid

Instance Methods [hide private]
 
__init__(self, nVisibles, nHidden, outputActivation=<class crino.module.Sigmoid at 0x2b85740f5db8>)
Constructs a new AutoEncoder network.
source code
 
prepareParams(self)
Initializes the params of the submodules.
source code
 
hiddenValues(self, x_input)
Returns the hidden representation for a given input.
source code

Inherited from MultiLayerPerceptron: checkBadmoveHook, checkBatchHook, checkEpochHook, checkLearningParameters, defaultLearningParameters, finetune, getGeometry, getParameters, initBadmoveHook, initBatchHook, initEpochHook, setParameters, train

Inherited from module.Sequential: prepareGeometry, prepareOutput

Inherited from module.Container: add

Inherited from module.Module: criterionFunction, forward, forwardFunction, holdFunction, linkInputs, linkModule, prepare, prepareBackup, restoreFunction, save, trainFunction

Instance Variables [hide private]

Inherited from module.Container: modules

Inherited from module.Module: backupParams, inputs, nInputs, nOutputs, outputs, params, prepared

Method Details [hide private]

__init__(self, nVisibles, nHidden, outputActivation=<class crino.module.Sigmoid at 0x2b85740f5db8>)
(Constructor)

source code 
Constructs a new AutoEncoder network.
Parameters:
  • nVisibles (int) - The size of the visible representation.
  • nHidden (int) - The size of the hidden representation.
  • outputActivation (class derived from Activation) - The type of activation for the backprojection layer.
Overrides: module.Module.__init__

Attention: outputActivation parameter is not an instance but a class.

prepareParams(self)

source code 
Initializes the params of the submodules. The Sequential module params will include the params of its submodules .
Overrides: module.Module.prepareParams
(inherited documentation)

hiddenValues(self, x_input)

source code 
Returns the hidden representation for a given input.
Parameters:
  • x_input (ndarray) - The input on which the hidden representation must be computed.
Returns:
the corresponding hidden representation