Encoding Sequential Information in Semantic Space Models: Comparing Holographic Reduced Representation and Random Permutation

Table 1

Comparisons of variants of BEAGLE differing by binding operation.

Task	Wikipedia subset		Full Wikipedia
	Convolution	Random permutation	Random permutation
ESL	0.20	0.26	0.32
TOEFL	0.46^†	0.46^†	0.63^†
RG	0.07	−0.06	0.32
MC	0.08	−0.01	0.33
R	0.06	−0.04	0.35
F	0.13	0.12	0.33

Significant correlation, < 0.05, one-tailed.
Accuracy score differs significantly from chance, < 0.05, one-tailed.
Note. For synonymy tests (ESL, TOEFL), values represent the percentage of correct responses.
For all other tasks, values represent Spearman rank correlations between human judgments of semantic similarity and those of the model. Abbreviations for tasks are defined in the main text of the paper.