Query Execution Optimization in Spark SQL

Table 3

Comparison of cache size with and without intermediate data correlation merging algorithm.

Id	1	2	3	4	5	6	7	8	9	10	11
Input data (MB)	256	896	384	1024	1792	1664	640	384	256	640	256
Spark buffer (MB)	227	792.2	340	908.8	1590	1476	568	340.8	227.2	568	227.2
SSO buffer (MB)	178	625.8	268	715.2	1251	1162	447	268.2	178.8	447	178.8