Effective Preprocessing and Normalization Techniques for COVID-19 Twitter Streams with POS Tagging via Lightweight Hidden Markov Model

Table 8

Proposed method results on tokenized tweets.

Tweet	Tokenized tweet
Prince Charles met Albert of Monaco just days before he tested positive for coronavirus	Prince Charles/met/Albert of Monaco/just days/before/he/tested/positive/for coronavirus
Just heard Boris Johnson has tested positive for coronavirus. The man is not fit to lead out country.	Just heard/Boris Johnson/has tested/positive/for coronavirus./The man/is not fit/to lead out/country.
Tom Hanks and his wife Rita Wilson have both tested positive for coronavirus, the US actor said Wednesday	Tom Hanks/and/his wife/Rita Wilson/have/both/tested/positive/for coronavirus/, the US actor/said/Wednesday/.
I finally personally know someone that has tested positive for COVID-19. Interesting timing. As they are now getting more tests made, more tests coming back positive.	I/finally/personally/know/someone/that/has tested/positive/for COVID-19/. Interesting timing/. As/they/are now getting/more tests made/, more tests/coming back/positive.
Former movie producer Harvey Weinstein, who is serving a prison sentence for sexual assault and rape, has tested positive for coronavirus	Former/movie producer/Harvey Weinstein/, who/is serving/a prison sentence/for sexual assault/and/rape/, has tested/positive/for coronavirus.
Redmond-based Nintendo of America has confirmed that an employee has tested positive for coronavirus.	Redmond-based Nintendo/of America/has confirmed/that/an employee/has tested/positive/for coronavirus.