Exploiting Awareness for the Development of Collaborative Rehabilitation Systems

Table 1

Awareness elements for physical and cognitive rehabilitation.

Category	Awareness element	Specific questions	Recommended feedback stimuli			Implementation examples
			V	A	H	Gathering	Providing
Present
Who	Presence	Is anyone in the system?	X	X	X	Motion sensing	Notification of participant login
	Identity	Who is participating? Who does this avatar belong to? Who is available to collaborate with?	X	X		Face recognition	Recognized participant ID
	Authorship	Who is doing that?	X	X		Motion sensing	Notification of current action’s authorship
What	Task	What are they doing? What is the difficulty of this task?	X	X	X	Motion sensing	Visualization, hearing, and haptic feedback of remote action
	Goal	What goal is that task part of?	X	X		Manual input	Notification of current goal
	Object	What object are they working on? What object can I work with?	X	X		Motion sensing with object recognition	Visual notification of currently used objects
	Status	What are the participants’ status? What are their feelings? What is the objects’ status?	X	X	X	Biometric sensor/emotion detection	Visualization, hearing, and haptic feedback of participant’s status and feelings, as well as object’s status
	Disabilities	What are the participant disabilities? What are they not able to do because of such disabilities?	X	X		Manual input	Visual warnings about their disabilities
	Perception	What are the other participants perceiving? (Looking, touching, hearing, etc.)	X	X	X	Head-mounted camera with mic and motion sensing	Visualization, hearing, and haptic feedback of other participants’ perception
Where	Location	Where are the participants/avatars participating? Is it a physical or virtual location?	X			Motion sensing/GPS	Map locations
	Gaze	Where are the participants looking/facing?	X			Eye tracking	Visualization of other participants gaze
	Position	Where is an object? How near is it?	X	X	X	Object and proximity detection	Visualization, hearing, and haptic feedback of position and nearness of objects
	Mobility	What is the participants’ mobility range?	X			Motion sensing	Moving avatars showing participants moving range
How	Device	How do I use a certain device to interact?	X	X		Hardware detection/Manual input	Audio and video instructions
Past
How	Object history	How did this object come to be in this state?	X			Motion sensing with object recognition	Visual evolution of object state
When	Event history	When did that event happen? How often? Is there any network delay?	X			Motion sensing with object recognition	Timestamp of object changes
Who	Presence history	Who was here and when?	X			Face recognition	Log-ins list
Where	Location history	Where has a participant/avatar been?	X			Motion sensing/GPS	Heat maps of participants’ locations
	Position history	Where has an object been?	X			Object and proximity detection	Trajectories of objects’ positions
	Mobility history	What were the participants’ mobility ranges?	X			Motion detection	Moving avatars showing participants previous moving ranges and date
What	Task history	What has a participant/avatar been doing?	X			Motion sensing	Visual list of past tasks
Future
When	Next event	When will the next event happen? How often?	X	X	X	Scheduler	Visualization, hearing, and haptic feedback prior to the event
Who	Next participant	Who will be the next participant?	X	X		Face recognition	Notification of the identity of the new participant to join the session
Where	Next location	Where will a participant/avatar be?	X			GPS-based predictor	Possible next location on map
	Next position	Where will an object be?	X			Scheduler	Alert of new position on map
	Next mobility	What will the participants’ mobility ranges be?	X			Motion sensing-based predictor	Moving avatars showing participants future moving range based on current progress
What	Next task	What will happen next?	X	X		Scheduler	Visual and aural alert of next task to do
	Next status	What will the participants/avatar next status be? What will the next status of the object be?	X	X		Biometric sensor-based predictor	Visual and aural warning of participants’ dangerous physical state
Social & group dynamics
Who	Members	Who are the members of my rehabilitation group? Has anybody joined/left the group?	X			Manual input	List of rehabilitation group members
	Other members	Who are the members of the other rehabilitation groups?	X			Manual input	List of all rehabilitation group members on therapist view
	Specialist	Who is the specialist conducting the rehabilitations session? Is he/she following the session?	X	X	X	External log-in	Visualization, hearing, and haptic sensing of the specialist conducting the session
	External participants	Who is participating externally in the rehabilitation session? Are they motivators or just observers?	X	X	X	External log-in	Visualization, hearing, and haptic sensing of remote participants
What	Belonging	What rehabilitation group do I belong to?	X	X		Manual input	Visual or aural notification of current group’s name
	Role	What is my role within my group?	X			Manual input	Visualization of participant role
	Others’ roles	What are the roles of my group’s members?	X			Manual input	Visualization of all participants’ role on therapist view
	Group goal	What are the goals of my group?	X	X		Manual input	Notification of current group goal
	External motivation	What are other participants doing to motivate me to carry out my task?	X	X	X	Remote voice and commands	Visualization, hearing, and haptic sensing of remote cheering
How	Inner communication	How should I communicate with each rehabilitation session participant?	X	X		Audio recording	Text and audio instructions of how to communicate with the other participants
	Outer communication	How can I communicate with the therapist/external viewers?	X	X		Audio recording	Text and audio instructions of how to communicate with the therapist/external viewers

(V) visual, (A) aural, and (H) haptic.