MTQA: Text-Based Multitype Question and Answer Reading Comprehension Model

Table 3

Pretraining corpora.

Corpus type	Corpus	Training set	Testing set
Generative	ND (numerical data)	500,000	10,000
	TD (textual data)	550,000	55,000
Manual construction	SD (spans data)	300,000	30,000