MapReduce Based Parallel Neural Networks in Enabling Large Scale Machine Learning

Algorithm 3

MRBPNN_3.

Input: ,  Output:

mappers  reducers

Initially each mapper inputs

   ,

(1) For

 Input , neuron in mapper computes

(2) Mapper outputs output

,

(3) th reducer collects output

 Output ,

(4) inputs

  Execute (2), outputs

(5) th reducer collects and merges all from mappers

Feed forward terminates

(6) In th reducer

  Compute

  Using HDFS API, retrieve

  Compute

(7) Update

  into

Back propagation terminates

(8) Retrieve and

  Update into

Repeat (1), (2), (3), (4), (5), (6), (7), (8), (9)

Until

Training terminates

(9) Each mapper inputs

(10) Execute (1), (2), (3), (4), (5), (6), outputs

(11) th reducer outputs

End