MapReduce Based Parallel Neural Networks in Enabling Large Scale Machine Learning

Algorithm 1

MRBPNN_1.

Input: ,  Output:

mappers one reducer

(1) Each mapper constructs one BPNN with inputs, outputs, neurons in hidden layer

(2) Initialize ,

(3)

Input , in hidden layer computes

(4) Input , in output layer computes

(5) In each output, compute

(6) In hidden layer, compute

(7) Update

Repeat (3), (4), (5), (6), (7)

Until

Training terminates

(8) Divide into ,

(9) Each mapper inputs ,

(10) Execute (3), (4)

(11) Mapper outputs

(12) Reducer collects and merges all

  Repeat (9), (10), (11), (12)

  Until is traversed.

(13) Reducer outputs

End