Automatic Task Classification via Support Vector Machine and Crowdsourcing

Table 2

The precision and recall values of each task as well as the top 3 misclassifications.

Task name	Precision (%)	Recall (%)	Top 3 misclassifications
Transportation	91.48	94.33	Travel	Map	Restaurant
			1.61%	1.46%	0.76%
Map	83.87	82.76	Restaurant	Shopping	Transportation
			5.53%	4.49%	3.45%
Travel	93.64	94.44	Transportation	Wikipedia	Restaurant
			0.85%	0.81%	0.62%
Music	88.98	86.25	Music player	Wikipedia	Book
			6.33%	3.07%	1.56%
Movie	89.74	93.10	Book	Information	Music
			1.28%	1.18%	1.09%
Photo	95.86	95.13	Information	Camera	Wikipedia
			0.99%	0.90%	0.61%
Book	91.21	91.51	Music	Wikipedia	Shopping
			1.52%	1.47%	1.09%
News	93.08	94.14	Wikipedia	Information	Book
			1.37%	0.85%	0.61%
Game	88.23	89.07	Apps	Music player	Movie
			6.48%	0.71%	0.47%
Apps	90.02	88.92	Game	Map	Movie
			6.92%	0.47%	0.43%
Restaurant	86.54	88.35	Map	Shopping	Transportation
			4.31%	2.84%	1.14%
Recipe	97.14	98.15	Restaurant	Information	Map
			0.43%	0.24%	0.14%
Shopping	86.25	88.75	Map	Restaurant	Hospital
			3.99%	2.71%	1.04%
Weather	97.90	99.20	News	Information	Check schedule
			0.14%	0.14%	0.14%
Hospital	95.55	94.92	Shopping	Map	Restaurant
			1.28%	1.05%	0.81%
Wikipedia	83.05	78.63	Information	News	Music
			7.98%	3.32%	1.85%
Information	82.51	83.88	Wikipedia	Music	Book
			5.61%	1.24%	1.14%
Call	98.57	98.34	Greeting	Love	Movie
			0.48%	0.24%	0.14%
E-mail	99.38	99.19	Call	Dispraise	Memo
			0.14%	0.14%	0.10%
Camera	98.16	98.72	Photo	Apps	Movie
			0.24%	0.19%	0.14%
Check schedule	90.60	92.97	Schedule	Boredom	Memo
			4.66%	0.48%	0.38%
Schedule	93.43	91.35	Check schedule	Memo	Timer
			6.51%	0.90%	0.14%
Memo	97.57	97.29	Schedule	E-mail	Timer
			0.62%	0.29%	0.24%
Timer	97.59	98.24	Alarm	Memo	Information
			0.76%	0.24%	0.14%
Alarm	98.38	98.38	Timer	Greeting	Movie
			0.90%	0.24%	0.14%
Music player	91.23	96.28	Music	Timer	Love
			2.62%	0.14%	0.14%
SNS	98.69	96.36	News	Movie	Wikipedia
			1.09%	0.57%	0.43%
Greeting	93.87	92.14	Dispraise	Check schedule	Praise
			1.51%	1.11%	1.00%
Praise	89.12	89.52	Dispraise	Love	Restaurant
			2.79%	1.95%	1.06%
Dispraise	84.00	83.48	Boredom	Praise	Shopping
			3.29%	3.07%	1.79%
Boredom	89.76	84.14	Dispraise	Game	Greeting
			4.80%	2.79%	1.45%
Love	92.40	88.27	Praise	Dispraise	Boredom
			4.41%	2.12%	1.68%

Accuracy of our classifier (in terms of precision and recall) is promisingly high ranging from up to .