org.encog.neural.networks.training.propagation.manhattan

Class ManhattanPropagation

java.lang.Object

org.encog.ml.train.BasicTraining

org.encog.neural.networks.training.propagation.Propagation

org.encog.neural.networks.training.propagation.manhattan.ManhattanPropagation

All Implemented Interfaces:

MLTrain, BatchSize, LearningRate, GradientWorkerOwner, Train, MultiThreadable

public class ManhattanPropagation
extends Propagation
implements LearningRate

One problem that the backpropagation technique has is that the magnitude of the partial derivative may be calculated too large or too small. The Manhattan update algorithm attempts to solve this by using the partial derivative to only indicate the sign of the update to the weight matrix. The actual amount added or subtracted from the weight matrix is obtained from a simple constant. This constant must be adjusted based on the type of neural network being trained. In general, start with a higher constant and decrease it as needed. The Manhattan update algorithm can be thought of as a simplified version of the resilient algorithm. The resilient algorithm uses more complex techniques to determine the update value.

Constructor Summary

Constructors

Constructor and Description
ManhattanPropagation(ContainsFlat network, MLDataSet training, double theLearnRate) Construct a Manhattan propagation training object.

Method Summary

Modifier and Type	Method and Description
boolean	canContinue() This training type does not support training continue.
double	getLearningRate()
void	initOthers() Perform training method specific init.
TrainingContinuation	pause() This training type does not support training continue.
void	resume(TrainingContinuation state) This training type does not support training continue.
void	setBatchSize(int theBatchSize) Do not allow batch sizes other than 0, not supported.
void	setLearningRate(double rate) Set the learning rate.
double	updateWeight(double[] gradients, double[] lastGradient, int index) Calculate the amount to change the weight by.
double	updateWeight(double[] gradients, double[] lastGradient, int index, double dropoutRate) Calculate the amount to change the weight by using dropout.

Methods inherited from class org.encog.neural.networks.training.propagation.Propagation

calculateGradients, finishTraining, finishTraining, fixFlatSpot, getBatchSize, getCurrentFlatNetwork, getDropoutRate, getL1, getL2, getLastGradient, getMethod, getThreadCount, iteration, iteration, report, rollIteration, setDroupoutRate, setErrorFunction, setL1, setL2, setThreadCount

Methods inherited from class org.encog.ml.train.BasicTraining

addStrategy, getError, getImplementationType, getIteration, getStrategies, getTraining, isTrainingDone, postIteration, preIteration, setError, setIteration, setTraining

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.encog.ml.train.MLTrain

addStrategy, getError, getImplementationType, getIteration, getStrategies, getTraining, isTrainingDone, setError, setIteration

Constructor Detail

ManhattanPropagation

public ManhattanPropagation(ContainsFlat network,
                            MLDataSet training,
                            double theLearnRate)

Construct a Manhattan propagation training object.

Parameters:

network - The network to train.

training - The training data to use.

theLearnRate - The learning rate.

Method Detail

getLearningRate

public double getLearningRate()

Specified by:

getLearningRate in interface LearningRate

Returns:

The learning rate that was specified in the constructor.

setLearningRate

public void setLearningRate(double rate)

Set the learning rate.

Specified by:

setLearningRate in interface LearningRate

Parameters:

rate - The new learning rate.

canContinue

public boolean canContinue()

This training type does not support training continue.

Specified by:

canContinue in interface MLTrain

Returns:

Always returns false.

pause

public TrainingContinuation pause()

This training type does not support training continue.

Specified by:

pause in interface MLTrain

Returns:

Always returns null.

resume

public void resume(TrainingContinuation state)

This training type does not support training continue.

Specified by:

resume in interface MLTrain

Parameters:

state - Not used.

updateWeight

public double updateWeight(double[] gradients,
                           double[] lastGradient,
                           int index)

Calculate the amount to change the weight by.

Specified by:

updateWeight in class Propagation

Parameters:

gradients - The gradients.

lastGradient - The last gradients.

index - The index to update.

Returns:

The amount to change the weight by.

updateWeight

public double updateWeight(double[] gradients,
                           double[] lastGradient,
                           int index,
                           double dropoutRate)

Calculate the amount to change the weight by using dropout.

Specified by:

updateWeight in class Propagation

Parameters:

gradients - The gradients.

lastGradient - The last gradients.

index - The index to update.

dropoutRate - The dropout rate.

Returns:

The amount to change the weight by.

initOthers

public void initOthers()

Perform training method specific init.

Specified by:

initOthers in class Propagation

setBatchSize

public void setBatchSize(int theBatchSize)

Do not allow batch sizes other than 0, not supported.

Specified by:

setBatchSize in interface BatchSize

Overrides:

setBatchSize in class Propagation

Parameters:

theBatchSize - The batch size.