Research Article

Interaction Tasks and Controls for Public Display Applications

Table 6

List of possible controls for supporting the various interaction tasks.

TaskControlDescription

SelectActionA generic action control, which causes the application to execute an action; similar to a desktop button. Triggers an event that identifies the action.
Option listA generic list control, which presents several options and allows users to select one (or more). Triggers an event with the selected option when a user makes a selection.
VoteTime based action control with a list of alternatives that waits for interactions during a predefined period of time. Triggers an event with the most voted alternative, when the time expires.

Data entryUnbounded textAllows users to input any string of text. Triggers an event with the input string.
Bounded textSupports various text patterns (such as email addresses, phone numbers, and dates). Triggers events with input string that conform to the specified pattern.
Numeric entryGeneric numeric entry control allows users to input numbers, possibly with lower and upper limits, integer, or floating point. Triggers event with the input number.
RateAllows users to rate content. May support various formats such as different scales, discrete/continuous rating scale. Triggers event with the input rating.

Upload mediaGeneric uploadAn upload control that accepts any media file, possibly with a parameter to limit the total file size. Triggers an event with the location of the uploaded file.
Video uploadAccepts only video files. Allows applications to specify the maximum duration of the video and supported video formats. Automatically converts between unsupported video formats to supported ones, for example, or simply does not allow unsupported formats.
Image uploadAccepts only images. Allows applications to specify the maximum/minimum image size and supported image formats. Automatically converts images that do not conform to the specified size and format restrictions.
Audio uploadAccepts audio files. Allows applications to specify the supported formats and maximum audio duration.

Download mediaDownloadAllows application to specify the media type and location of a content item that users can download. Triggers an event that identifies the downloaded file.
ShareAllows users to share a content item with other people. Triggers an event that identifies the shared file.

Signal presenceCheck-inAllows users to explicitly signal their presence near a display. Optionally, the interaction event can carry the location verification status, allowing the display system to give more weight to check-ins with verified locations, for example.
PresenceSignals the presence of users obtained implicitly from sensors. The information carried on the interaction event may vary, depending on the concrete types of sensors available, but we can generally categorize it according to the levels of information that are sensed: presence detection, characterization, and identification.

Dynamic manipulationCursorAllows users to dynamically interact via (multiple) cursor positions. The interaction event is a continuous flow of cursor positions.
JoystickProvides joystick information (direction, gamepad button states), for gaming purposes. The interaction event is a continuous flow of direction and button states.
KeyboardProvides keystroke events. The interaction event is a continuous flow of key presses.
SkeletonProvides positioning of body joints and/or user’s silhouette information (full or partial body parts). The interaction event is a continuous flow of skeleton/silhouette data.