Encoding Sequential Information in Semantic Space Models: Comparing Holographic Reduced Representation and Random Permutation

Table 2

Comparison of BEAGLE and RPM by corpus.

Task	Wikipedia subset		TASA		Full Wikipedia
	BEAGLE	RPM	BEAGLE	RPM	RPM
ESL	0.24	0.27	0.30	0.36^†	0.50^†
TOEFL	0.47^†	0.40^†	0.54^†	0.77^†	0.66^†
RG	0.10	0.10	0.21	0.53	0.65
MC	0.09	0.12	0.29	0.52	0.61
R	0.09	0.03	0.30	0.56	0.56
F	0.23	0.19	0.27	0.33	0.39

Significant correlation, < 0.05, one-tailed.
^†Accuracy score differs significantly from chance, < 0.05, one-tailed.
Note. For synonymy tests (ESL, TOEFL), values represent the percentage of correct responses.
For all other tasks, values represent Spearman rank correlations between human judgments of semantic similarity and those of the model. Abbreviations for tasks are defined in the main text of the paper.