Study on the Intentional Choice Mechanism of Course Selection Based on Swarm Intelligence Algorithm
Table 1
RDD processing detail.
RDD operation
Description
map
Enables each element in RDD to be processed by a user-defined function; as a result, each function in RDD is the result of user-defined functions on each element in the original RDD
groupByKey
The aggregation operation is performed according to the key values of each element in RDD; when the RDD is composed of elements of (K, V) type, the aggregation operation results in each element in RDD is (K, Sequence (V)) type
collect
All elements in RDD are sent to the driver program, when the user needs to collect the results at the Master node