Research Article

Evaluation of a Navigation Radio Using the Think-Aloud Method

Table 3

List of problems by frequency for all 13 subjects.

FrequencyProblem #SeverityDescription

129MajorState name cannot be abbreviated (DC, Washington DC)
1110MinorSystem freeze
1014MinorNo way to enter highway intersection as destination
1042MajorNo intuitive method to save radio frequency as preset
92MajorDifficult to switch keyboard to number keys
920MajorCould not search for an XM channel by name, so they browsed the numeric listing, which was slow
924CriticalTyped building number in the street name (north/no)
935MajorSearching for an iPod song by title was very time-consuming
84MinorGuidance voice quality was inadequate
86CriticalNo intuitive method to cancel route/destination on map screen
87MajorButtons are easily confused with displays
88MajorExpected this interface to support multitouch, in particular 2-finger zooming
817MinorCorrect address rejected (wrong house number range)
728MajorDid not realize what the search button did (also used for enter)
729MajorIncomplete and insufficient text information
737CriticalNo alphabetic input method for numeric street name (Fifth Ave)
63MinorNegative response to autosuggest keyboard (autocomplete function)
613MajorDid not realize there were multiple pages for destination screen
632MajorConfusing intersection search guidance (“X”, “space”)
636MajorNo intuitive method to store the entered address/home address
645MajorDid not understand icons on the map window (Z, compass, flag, current position, scale)
523MajorTyped building number in the street name
526MajorDid not understand the acronym POI
45MajorDid not understand POI symbol/function on the map
416MinorSearch displayed multiple entries for the same destination (3 Ann Arbor)
422MajorDifficult to switch to alphabet keys
425CriticalNo intuitive method to search for a waypoint and add it as a waypoint on the map screen.
311MinorToo slow/fast system response time
312MinorAddress/text information was not legible
327MajorDid not recognize scale button on the map screen
330MajorNo way to back up (e.g., main mode screen, simulation mode, and local POI)
333MinorNo intuitive method to bring up CD control after inserting CD
334MajorDid not understand label SAT
338MajorDid not understand label Zagat
339MajorDid not recognize back button
340MinorUnable to get to CD mode after inserting CD
341MajorDid not understand Autostore
344MajorDid not understand icons on the status bar
357MajorNo intuitive graphic to select the searched result on the list (city/street)
246MinorScale window disappears too quickly on the screen
248MajorNarrow search coverage by POI Name (no support for McDonalds)
250MajorDid not recognize the delete button on keyboard
264MajorDid not understand label Map key
11MinorState name is highlighted and shown on Search by Address screen.
115MinorConfusing search result (Ann Arbor/Ann Arbor Twp)
118MinorMisunderstood seek/track button label
119MinorDid not notice volume label
121MajorNo intuitive distinction between Route and Dest key
131MinorWrong screen instruction (“search by POI” in intersection)
143MinorDid not understand label Dest
147MinorSelect button location was inconsistent
149MinorDid not understand “Alternative” menu
151MinorMisunderstood Asian, Korean, and Chinese on POI list (as language)
152MinorNo way to control volume on the screen
153MinorDid not understand preset scan
154MinorMisunderstood ATM and Bank on POI category list
155MinorWrong unit information/temperature
156MajorDid not understand play/stop icon
158MajorDid not understand numbers next to the searched street names
159MajorNot able to set clock in expected manner
160MajorNo intuitive layout for house number input
161MinorDid not understand orange line on the map
162MinorNo autosave feature in entering city
163MinorConfusing categorization on POI list (gas station-travel/automotive)

Note: Problem #: The 64 problems were numbered 1–64.