Encoding Sequential Information in Semantic Space Models: Comparing Holographic Reduced Representation and Random Permutation

Table 3

Comparison of RPM using random connections (RC) versus random permutations (RP).

Task	Full Wikipedia			TASA
	RC Sim 1	RC Sim 2	RP	RC Sim 1	RC Sim 2	RP
ESL	0.50^†	0.48^†	0.50^†	0.32	0.32	0.36^†
TOEFL	0.66^†	0.66^†	0.66^†	0.73^†	0.74^†	0.77^†
RG	0.66	0.64	0.65	0.53	0.52	0.53
MC	0.63	0.61	0.61	0.53	0.51	0.52
R	0.58	0.56	0.56	0.55	0.54	0.56
F	0.39	0.37	0.39	0.32	0.33	0.33

Significant correlation, < 0.05, one-tailed.
^†Accuracy score differs significantly from chance, < 0.05, one-tailed.
Note. For synonymy tests (ESL, TOEFL), values represent the percentage of correct responses.
For all other tasks, values represent Spearman rank correlations between human judgments of semantic similarity and those of the model. Abbreviations for tasks are defined in the main text of the paper.