A Review of the Advancement in Speech Emotion Recognition for Indo-Aryan and Dravidian Languages

Table 1

Summary of some commonly used databases for speech emotion recognition.

S/N	Database	Language	Year	Size of database	Data format	Emotions
1	RAVDESS [16]	English	2018	7356 recordings by 24 actors	Audio-visual	Happy, angry, calm, sad, fearful, disgust, surprise, neutral
2	EmoDB [11]	German	2005	800 recordings by 10 actors	Audio	Joy, boredom, fear, sadness, anger, disgust, neutral
3	IEMOCAP [14]	English	2008	12 hours of data by 10 actors	Audio-visual	Happiness, anger, sadness, frustration, neutral
4	SUBESCO [12]	Bangla	2021	7 hours of recordings containing 7,000 utterances by 20 native speakers	Audio	Happiness, anger, sadness, fear, surprise, disgust, neutral
5	FAU AIBO [6]	German	2008	9.2 hours of speech by 51 children talking to robot Aibo	Audio	Angry, emphatic, neutral, positive, rest
6	BanglaSER [17]	Bangla	2022	1,467 recording by 34 actors	Audio	Angry, happy, neutral, sad, surprise
7	MELD [7]	English	2018	13,000 utterances from the TV-series friends by multiple speakers	Audio-visual and textual	Anger, fear, joy, surprise, sadness, disgust, neutral
8	AESDD [18]	Greek	2018	500 utterances from 5 different actors	Audio	Anger, disgust, fear, happiness, sadness
9	SAVEE [13]	English	2014	480 British English utterances by 4 male actors	Audio-visual	Disgust, fear, anger, happiness, sadness, surprise, neutral
10	RECOLA [19]	French	2013	3.8 hours of recordings by 46 participants	Audio-visual	Social behaviors (agreement, dominance, engagement, performance, rapport)
11	CHEAVD [8]	Chinese	2017	140 min emotional segments extracted from talk shows, TV plays, and films by 238 speakers	Audio-visual	Angry, fear, happy, neutral, sad, surprise
12	LSSED [20]	English	2020	147,025 utterances from 820 subjects	Audio	Happiness, fear, anger, excitement, sadness, boredom, disappointment, disgust, surprise, normal and other
13	Urdu [2]	Urdu	2018	400 utterances by 38 speakers from Urdu talk shows	Audio	Angry, happy, neutral, sad
14	Urdu-Sindhi speech emotion corpus [21]	Urdu, Sindhi	2020	1435 speech recordings	Audio	Happiness, anger, sadness, disgust, surprise, sarcasm, neutral
15	IITKGP-SEHSC [22]	Hindi	2011	12000 utterances by 10 professionals	Audio	Happy, anger, fear, disgust, surprise, sad, sarcastic, neutral
16	KSUEmotions [23]	Arabic	2017	5 hours and 10 minutes of recordings by 23 speakers	Audio	Neutral, happiness, sadness, surprise, anger
17	Oriya emotional speech database [15]	Oriya	2010	900 emotional utterances for text fragments from various drama scripts of Oriya language by 35 Oriya speakers	Audio	Happiness, sadness, astonish, anger, fear, neutral
18	Mandarin Chinese emotional speech database [24]	Mandarin	2008	3,400 emotional speech utterances by 18 males and 16 females	Audio	Anger, happiness, sadness, boredom, neutral
19	CASIA natural emotional audio-visual database [9]	Chinese	2014	2 hours spontaneous emotional segments extracted from 219 speakers from films, TV plays and talk shows	Audio-visual	Happy, angry, disgust, surprise, worried, sad, fear
20	Egyptian Arabic speech emotion (EYASE) database [25]	Arabic	2020	579 utterances by 3 male and 3 female professional actors from Egyptian TV series	Audio-visual	Angry, happy, neutral, sad
21	Interface multilingual emotional speech database [26]	English, French, Spanish and Slovenian	2002	In English interface database contains 8,928 utterances, Slovenian 6,080, French 5,600 and Spanish 5,520 by 2 actors	Audio	Joy, disgust, anger, fear, sadness, surprise, neutral
22	Toronto emotional speech set (TESS) [27]	English	2010	2,800 utterances by 2 actresses	Audio	Happiness, anger, sadness, disgust, pleasant surprise, fear, neutral
23	ANAD [28]	Arabic	2018	1,384 recordings from Arabic talk shows	Audio	Happy, angry, surprised
24	Multilingual emotional speech database of north east India (MESDNEI) [29]	Assamese	2009	4,200 utterances of 5 native languages of Assam by 30 speakers	Audio	Sadness, anger, fear, disgust, happiness, surprise, neutral
25	ShEMO [10]	Persian	2019	Speech data of 3 hours and 25 minutes from online radio plays	Audio	Anger, fear, happiness, sadness, surprise, neutral
26	SEMOUR^+: a scripted emotional speech repository for Urdu [30]	Urdu	2021	27,640 instances recorded by 24 actors	Audio	Anger, happiness, surprise, disgust, sadness boredom, fearful, neutral
27	Arabic natural corpus [28]	Arabic	2018	1,384 recordings from online Arabic talk shows	Audio	Angry, surprised, happy
28	EMOVO [31]	Italian	2014	588 utterances of 14 sentences by 6 actors	Audio	Joy, sadness, anger, disgust, fear, surprise, neutral
29	Punjabi emotional speech database [32]	Punjabi	2021	900 utterances by 15 speakers	Audio	Happy, angry, sad, fear, surprise, neutral
30	IITKGP-SESC [33]	Telegu	2009	12,000 utterances by 10 professionals	Audio	Happy, anger, sad, disgust, fear, sarcastic, surprise, neutral