Bidirectional Language Modeling: A Systematic Literature Review

Table 4

Data extraction and synthesis.

Sr. no.	Description	Details
1	Bibliographic information	Authors, title, research type, publication year, etc.
2	Methodology	The main structure of our study is to extract the methodology of the paper.
3	Pretraining	Pretraining structure of each study is thoroughly analyzed.
4	Fine-tuning	Fine-tuning structure of each study is thoroughly analyzed.
5	Dataset	Datasets used in the selected research studies are identified.