Abstract

Wearable technology impacts the daily life of its users. Wearable devices are defined as devices embedded within clothes, watches, or accessories. Wrist-worn devices, as a type of wearable devices, have gained popularity among other wearable devices. They allow quick access to vital information, and they are suitable for many applications. This paper presents a comprehensive survey of wearable computing as a research field and provides a systematic review of recent work specifically on wrist-worn wearables. The focus of this research is on wrist-worn wearable studies because there is a lack of systematic literature reviews related to this area. This study reviewed journal and conference articles from 2015 and 2017 with some studies from 2014 and 2018, resulting in a selection of 54 studies that met the selection criteria. The literature showed that research in wrist-worn wearables spans three domains, namely, user interface and interaction studies, user studies, and activity/affect recognition studies. Our study then concludes with challenges and open research directions.

1. Introduction

Wearable technology impacts the daily life of its users. On a daily basis, humans perform many physical and cognitive activities, such as decision-making, eating, studying, walking, and communication with others. New technologies are involved in many aspects of our lives, such as communication (through social networks) or shopping (through e-commerce websites). In 1995, a new field of research called affective computing, which considers human affects [1], was introduced by Picard.

Wearable technology, as a type of affective computing, is mainly used for activity recognition [2, 3] and feeling or affect detection [4, 5]. Wristwear device technology has been studied more recently, for example, the WearWrite system for smartwatches [6]. Tomo is an example of an ad hoc wristwear system that uses hand gesture recognition [7]. Some other studies expand the interface of commercial devices, such as [8], where the interface of a wristwear device is extended to the user’s skin. In this article, we aim to provide a review of the studies based on only wrist-worn devices (WWDs).

The field of wearable computing has spawned many conferences and research groups. The Conference on Human Factors in Computing Systems, the International Symposium on Wearable Computers, and the Enterprise Wearable Technology Summit are examples of high impact conferences. Also, popular research groups exist at Carnegie Mellon, Columbia University, Georgia Tech, MIT, Bremen University, Darmstadt University, ETH Zurich, Lancaster University, University of South Australia, and NARA in Japan.

The structure of this paper is as follows: Initially, in Section 2, we provide background information on wearable computing (definitions, fields, devices, etc.). Then, in Section 3, we explain the methodology of this literature review, which includes search strategy and inclusion criteria. Section 4 presents a general overview of recent review studies of wearable computing. Section 5 focuses on experimental papers that are based on wrist-worn wearables. Sections 6 and 7 present discussion, challenges, and open directions. At the end of this review, Section 8 presents our conclusion and future work.

2. Background

Wearable computers are any devices that can be worn on the body. There is no specific definition of wearable computers, but they can be defined by their distinct characteristics [9]. Rhodes in 1997 and Hendrik Witt in 2008 defined wearable computers by describing many of their properties, such as portability, limited capability, context awareness, operational constancy, and hands-free or limited use of hands. In 2014, Genaro Motti et al. gave a simple definition of wearable computers as body-worn devices, such as clothing and accessories, that integrate computational capabilities to provide specific features to users [10]. The term wearables, as well as the terms wearable technology and wearable devices, is indicative of consumer electronics technology that is based on embedded computer hardware that is built into products that are worn on the outside of one’s body [11].

In 1980, Professor Steve Man built a prototype of wearable personal computer-imaging system [12]. It consists of lens, mirror, a partly silvered mirror, reflections off eyeglasses, and two antennas for communication. Over 16 years, from 1980 until 1997, his system had passed through many developments until becoming a prototype consisting of eyeglasses, a handheld control, and a computer worn in the back under the shirt.

The first report on a wearable computer was authored by Thad Starner in 1995 and was called “The Cyborgs are Coming” [9]. His concern was with wearable computer interfaces, and he identifies two main characteristics: persistence and constancy [9]. Persistence describes the permanent availability of wearable computers and the ability to use them while simultaneously performing other tasks. Constancy describes how one wearable computer can be used in every situation.

In 1998, Professor Kevin Warwick implemented a sensor embedded in the median nerves of his left arm [9]. This work has been applied to controlling a wheelchair and an artificial hand by measuring transmitted signal and creating artificial sensors through electrodes on the arm.

Wearable computing is not an independent research area; research questions from different disciplines must be raised depending on the goal of a study. As shown in Figure 1, the three significant fields that contribute to wearable computing are computer science, electrical engineering, and psychology [9]. Artificial intelligence, human-computer interaction (HCI), and hardware design are branches of computer science. HCI is related strongly to psychology, while hardware design has its roots in electrical engineering. Wearable computer interfaces are essentially related to HCI and phycology rather than electrical engineering [9].

Wearable computers are related to the internet of things (IoT). The IoT is a concept that states that everything that can be connected will be connected [13]. This evolved from both ubiquitous computing and pervasive computing [13]. Wearable devices provide this critical functionality; they are IoT devices in the sense that they are always connected to the Internet, even if they are through a device such as a phone or a tablet. Many people already own or plan to purchase wearables for fitness or medical reasons, and eventually, wearables will become essential work tools.

Wearable hardware devices include smartwatches, smart glasses, textiles (also called smart fabrics), hats, caps, shoes, socks, contact lenses, earrings, headbands, hearing aids, and jewelry, such as rings, bracelets, and necklaces [11].

Over the course of our literature review, we observed that the most investigated wearable devices are as follows: (i)Smartwatch(ii)Smart eyewear (e.g., smart glasses and head-mounted displays) [14](iii)Egocentric vision devices [15](iv)Light-based devices (e.g., LED) [1624](v)Fabrics, textiles, and skin-based devices [2528](vi)Tactile gloves [29](vii)Hair and nail-based devices [30](viii)Magnetic inputs (e.g., Google cardboard) [31, 32]

These wearable devices’ main challenges are networking, power and heat, display, and mobile input. All of them should be affordable for low-income earners and small in size and consume a small amount of battery power [33]. They can be used to communicate via wireless technologies such as Wi-Fi, Bluetooth, Zigbee, and NFC [33].

3. Methodology

In this research, we review studies on wearables and focus specifically on WWD studies. In order to find the most recent and representative papers, our search strategy and inclusion criteria are as follows.

3.1. Search Strategy

This section describes our method for obtaining literature on wearable computers from books, theses, and recent journal and conference articles with a particular focus on WDDs. As can be seen in Figure 2, our search method can be divided into two categories: organization/individual-based and keyword-based. Next, we will explain each in detail.

3.1.1. Organization/Individual-Based Search

This search included university websites, conferences, research groups, and staff homepages. For university websites, we obtained the top universities in computer science as ranked by the Top Universities website and the complete university guide. From within each university website, we searched for research groups using the terms HCI, ubiquitous computing, people and technology, wearable, IoT, and so on. Then, we searched group publications, staff pages, and any related links. For example, at Georgia Tech, there is the People and Technology research group. This group develops technologies related to health care, modern society, education, and community [34]. Also, it contains “interdisciplinary teams of computer scientists, system scientists, and engineers partnered with psychologists, sociologists, architects, designers, economists, medical professionals, government officials, and others to develop technologies that empower people in all walks of life” [34]. Similarly, within each conference website, we looked at all papers presented in these venues from the venues’ websites or conference proceedings at ACM; for example, ISWC 2016 [35], ISWC 2015 [36], and UbiComp 2016 [37].

3.1.2. Keyword-Based Search

This search used certain search terms on popular online libraries and portals. We considered the following websites: ACM, IEEE, ScienceDirect, Springer, and Google Scholar. The following general terms were used for searching: wearable computer, wearable, smart textile, smart light, smart watch, sensor devices, mobile and wearable, child and wearable, elderly and wearable, activity recognition and wearable, and wrist-worn. Specific terms used for the health domain as an example were wearable and health, mental health, wearable and bipolar disorder, and wearable and dementia. Our systematic reviewing protocol is illustrated in Figure 2.

3.2. Inclusion and Exclusion Criteria

After the searching process, we followed certain criteria in order to select the appropriate articles for review. Figure 3 shows a flow diagram for the inclusion and exclusion criteria based on the PRISMA statement.

This study is aimed at reviewing recent work; therefore, we only searched for journal and conference articles published no later than 2017, although there are some small studies from 2014 and 2018 included. Once the duplicated records were removed, we screened each paper by looking at the abstract and quickly reading it. Then, we grouped the papers based on their type: review paper or experimental paper.

Review papers included all papers that review wearables under any domain. We discuss this classification in detail in the next section. After we found the relevant review papers, we observed that few of them were based on only wrist-worn wearables.

Therefore, for experimental papers, we excluded any papers that did not discuss wrist-worn wearables, such as ones on textiles or eyeglasses only. Finally, we read each article in full and classified them based on the classification schema that we introduce in the next section. Figure 4 shows how we clustered papers in our systematic review. In the first phase, we grouped papers in terms of their type. Then, we further classified each paper based on study domain or topic.

4. Review Papers

After reviewing the literature on wearable computing, we found that many studies are from different disciplines. For the most recent studies from 2015 to 2018, we summarized thirteen of them, as shown in Table 1, which gives a comparison of studies according to year, number of studies, domain, and outcomes.

We can see from Table 1 and Figure 5 that the two main domains of wearable review studies are health and activity recognition. Few studies review wearables for the education domain [46] or biometric recognition systems. Each study can be described as having one of two approaches: general or specific.

Regarding the health domain, a specific health approach is one that targets a specific chronic disease, specific people or medical specialty such as rehabilitation, impairment, Parkinson’s disease [45], and Ambient Assistance Living systems (AALS) in elderly people [15]. In terms of activity recognition studies, they are either on wearable activity recognition in general [42] or on a specific kind of activity recognition, such as activity trackers [43].

In contrast, there is only one study that reviews the wearables in general [44] over all domains. This study reviews the current trend of wearable technology and found that wrist-worn devices have gathered much attention recently. To the best of our knowledge, there are no other studies that review wearable wrist-worn devices. Therefore, the next section focuses on wrist-worn wearable studies.

5. Wrist-Worn Wearable Studies

WWDs have gained more popularity than other wearables [44]. They allow quick access and are more suitable for many applications than other wearables. WWDs can be categorized as commercial or ad hoc devices. Commercial devices have three types: smart watch, fitness tracker, and armband [50]. Each of them has many applications from gesture recognition to authentication [51].

The literature on WWDs can be categorized into three types based on its goal: user interface and interaction studies, user studies, and activity/affect recognition studies. Next, we will explain each category in detail.

5.1. User Interface and Interaction Studies

Studies [5255] in this category are aimed at supporting the interaction of users with WWDs. They depend on a wrist-worn interface (WWI), either for input or output techniques.

There are two main challenges ahead for WWIs: their physical limitations and the contexts of their use. In order to overcome these drawbacks, two novel wrist-worn interaction paradigms were proposed by Motti and Caine in 2015 [56]. The first paradigm is the microinteractions that enable users to complete tasks in less than four seconds and attempting to have many smaller tasks rather than one big task to minimize the cognition and attention required. Examples of these microinteractions are audio, gesture, graphics, tactile, and vibratory wrist-worn interfaces. The second paradigm is the multidimensional graphical user interface for both input and output. For example, make the virtual extension to a graphical user interface. The main user interface recommendations by this study are very brief text, display content or navigation, and only using short actions to complete tasks.

Table 2 gives a comparison of user interface–based studies regarding their goal, sensor used, devices, subjects, algorithms, interactions, and their outcome.

5.2. User Studies

These studies [51, 5762] focus on understanding several issues related to WWDs from users’ viewpoints and concerns. Therefore, they analyze users’ reviews, answers, and usage in order to obtain different recommendations and limitations. As a result, the recent methods in WWD user studies can be categorized as one of the following: (i)Review analysis [51, 58](ii)Online survey [57, 60](iii)Interview [59, 61](iv)Record of usage [59]

Table 3 shows a comparison of these studies.

5.3. Activity and Affect Recognition Studies

Studies of this type are aimed at providing extra abilities to WWDs so they can recognize different activities or affects by proposing different algorithms and using different sensors.

The aspects that should be considered to develop WWDs with activity or affect recognition are sensors and devices, modeling techniques, testing duration, sampling rate, elicitation methods, extracted features, and experimental setup; next, we will discuss these aspects in more detail.

5.3.1. Sensors and Devices

The first step in recognizing activities or affects is to select the appropriate sensors and signals for measuring them. Sensing data can be classified as either direct or indirect. (i)Direct sensing means, “tracking the parameters that are related to the human subject themselves” [15]. Examples of direct sensing are sound capture, video camera, motion sensors, and wearable body sensors(ii)Indirect sensing “focuses on identifying environmental conditions and spatial features” [15]

For direct sensing, ambient intelligence techniques can be used to embed the sensing data into the environment. Such techniques can be classified as remote, mobile, or wearable sensing [63]. (i)Remote sensing is used for visual analysis such as a webcam for recognizing facial expression or blood flow under the skin. The main advantage of remote sensing is that it is easy to apply to the community without the need for any mobile or wearable devices [15]. However, there are disadvantages related to the inability to sense data away from a desk or in a remote area [63](ii)Mobile sensing collects data from mobile phones(iii)Wearable sensing employs wearable devices to sense data from close to the body. Therefore, the availability of wearable sensing devices has increased more than mobile sensing devices. Any wearable sensor consists of three main components: sensor, processor, and display [42]. Wearable devices capture the sensor’s data and send it to the processor. Then, any actions are output through the display unit. If the sensor uses wireless technology, the sensor data can be sent by a transceiver to a central station to store and process, or the processing can be completed inside the processor

Tables 4 and 5 summarize the signals used in previous studies for activity and affect recognition by wearable sensing (wrist-worn devices only).

The selection of sensors depends on the type of activity to be recognized. There are many studies that use only one sensor. For example, accelerometer, electric potential, and ambient light have each been used in studies as the only sensor type. The multisensory data approach is still used if the aim is to recognize multiple activities at the same time. Choosing the best wearable devices is important to capture the desired signals in an accurate, comfortable, and affordable way. WWDs can be classified as we mentioned before to commercial or customized. As shown in Figure 6, the percentage of using the commercial WWDs was 77% larger than using the customized devices (23%).

Tables 6 and 7 list the WWDs used in activity and affect recognition studies in addition to information about smartphones if they were used in the study. Furthermore, Table 8 lists the commercial WWD name, picture, price, their goal affect or activity, and sensors.

5.3.2. Modeling Techniques

The main step of a recognition system is classification. There are many classification methods used for activity recognition systems of WWDs; we can divide them into two approaches: machine learning-based or threshold-based. The most common and accurate machine learning algorithm is the support vector machine (SVM). Naïve Bayes and decision tree J48 are also popular to use. A deep neural network was used in only one WWD activity recognition system and gave promising results. While there are many machine learning–based studies, threshold-based studies have been conducted many times for classification. Table 9 lists the modeling techniques used in activity or affect recognition studies. Figure 7 illustrates clearly this comparison in line chart for both activity and affect recognition together. We can see that affect recognition studies preferred to use a different kind of machine learning algorithms, while most activity recognition studies preferred to use the threshold-based algorithms.

5.3.3. Testing Duration

Testing duration is essential in evaluating the performance of a system. Table 10 shows the time of test for each study. The time of testing the WWDs per user for each study ranges from two seconds up to 14 weeks. Usually, the testing time for activity recognition is in seconds or minutes for each user. In contrast, most health diagnosis systems for a specific disease, such as bipolar disorder [72], require more time to test to provide accurate results. In contrast, affect studies range from minutes to two months. Affect recognition systems take a longer time to test than activity recognition systems.

5.3.4. Extracted Features

WWD studies depend on sensory data. After the preprocessing phase, they extract the desired feature from the raw sensor data. Extracted features from sensor data have three main types: time domain, frequency domain, and district domain [86]. Time domain features have lower computational cost than those of the frequency domain [87]. The mean feature from the time domain is commonly used for WWD activity recognition systems. In addition, the statistical measures of standard deviation, minimum, and maximum have been commonly used.

5.3.5. Sampling Rate

Sampling rate is used to determine the range of activity frequencies. Therefore, it is important to set the correct sampling rate. Accuracy, power consumption, and other selected features are factors that are affected by the sampling rate [87]. The range of sampling rates is different based on the type of activity being detected. For example, step and fall detection usually uses 20 Hz as a sampling rate. This is due to the range of human movement being in the range 0-20 Hz [87]. In addition, using a small sampling rate reduces power consumption [69]. This review found different sampling rates being used for WWD activity recognition; they ranged from 1 to 1000 Hz. Different sampling rates used, along with their related studies, are shown in Table 11 and Figure 8.

5.3.6. Elicitation Method Used for WWD Affect Recognition

In order to collect the data, an emotion must be induced by a stimulus. Table 12 shows the different kinds of elicitation methods used in previous studies. Many recent studies are aimed at collecting data naturally without any elicitation by continuously collecting data over the participants’ daily lives.

5.3.7. Experimental Setup

To evaluate the performance of activity recognition systems, we need to collect representative datasets via experiments. This dataset includes a number of participants wearing the WWDs and the target activities or feelings of the subjects. The participants might be hospital patients, elderly people, students, etc. The participant demographic depends on the study domain: activity tracker, home monitoring, health, security, education, etc. Most of the affect studies applied to participants at regular daily lives and work lives. There is a lack of affect recognition studies that deal with diseases.

There are different places that an experiment can be conducted. Few experiments were applied in real-world conditions due to the difficulty to deal with changes and noise. Most experiments are implemented in a laboratory environment. For example, affect recognition studies have applied in different places: a quiet room, an office, a “natural” environment, and a real-life stress environment [5].

The number of participants for WWD activity recognition studies ranged from 1 to 41. In contrast, affect recognition studies had up to 123 participants.

Moreover, classes used to recognize the type and level of an affect vary between studies. There is no agreed-upon way to best categorize different kinds of emotion [1]. For affective computing researches, the best choice is whatever suits the application best [1]. More details about participant demographic are summarized in Table 13.

6. Discussion

In the previous sections, we reviewed 54 studies based on wearables with a particular focus on WWDs. The WWD studies take various directions, and thus, it is not possible to provide an absolute comparison of them in this discussion. Moreover, even studies that followed the same direction are not easily comparable. For example, within the activity recognition studies, we found that the activities being recognized varied, which hinders comparison. However, this discussion highlights and describes the significant challenges faced in studying wearables.

We found that wearable computing, in general, has been researched many times and in different domains, such as sport, health, education, and security. Most WWD studies were conducted in the domain of health [3841, 45], activity tracking [43], and home monitoring [15, 49], and there is a lack of studies related to education [46], security [47], and child care.

Long-term usage is considered to be the main challenge of wearable technology [40]. This challenge can be overcome by considering the issues of battery life, user acceptance, safety, privacy, weight, and fault tolerance. Ambient intelligence is an important concept to implement in WWDs.

The recent WWD studies were divided, as shown in the previous section, based on three categories: user interface and interaction studies, user studies, and activity/affect recognition studies.

Regarding WWIs, we found many limitations that must be managed or resolved by researchers in order to improve user interface and interaction. Microinteractions and multidimensional interfaces are a new proposed solution for WWIs [56].

On the other hand, conducting a user study is very important to build the theoretical framework of WWDs as well as understanding user requirements. This would be beneficial in terms of providing sufficient ideas for the design of better interfaces and for implementing the appropriate applications.

We have noticed that many WWD researchers preferred to use one sensor for activity recognition in order to reduce the power consumption and increase WWD simplicity. In contrast, some studies used multisensory data to recognize more activities for intelligent life, such as elderly care within smart homes.

Features extracted from sensor data are varied. Although the sensitivity of features is important to recognize the target activity, many factors should be considered when selecting features themselves. These factors include battery consumption and availability of feature resources.

In the classification phase, most studies used a machine learning-based approach; however, researchers are still using threshold-based approaches in some studies [2, 16, 64, 65, 69, 70]. This is because a threshold-based approach must determine the critical points of classification, which are affected by changes in context and long usage needs. Consequently, we have seen that most studies for recognizing a single activity, such as falling [64], steps [65, 69], computing activity [16], CPR [2], and hair touch detection [70], used the threshold-based approach. On the other hand, to recognize the more complex activities that are sensitive to context, such as the activity of ambulation [66], eating [3], and mood [72], the machine learning approach was used. In addition, the machine learning approach used in the study on bipolar disorder diagnosis requires long-term usage. Machine learning techniques show promising results for user interface and activity recognition systems. Deep learning algorithms have been used recently and provided more efficient results [71].

Collection of a data is mandatory in order to train a classifier in the machine learning approach or for testing a system. The collection of data should be done in a real-world environment instead of a laboratory environment, which most studies used.

7. Challenges and Open Directions

After reviewing the literature of wearable computing, we found many critical challenges and issues. As we mentioned, the main technical challenge faced by wearable devices is long-term usage. This challenge is related to many aspects: battery life, user acceptance, safety, weight, fault tolerance, and privacy concerns. On the other hand, there are challenges related to creating a main standard of wearable systems. Furthermore, there are challenges in establishing a relationship with the commercial sector to ensure installation and process completion. In this section, we provide suggested solutions for overcoming each challenge in future work.

7.1. Weight

We could use energy harvesting technology to remove the need for a battery, which will decrease total weight.

7.2. Battery Life

This challenge could be overcome with respect to hardware, software, or interface. Hardware could also use energy harvesting technology, which extracts power from the surroundings via solar, kinetic, and electromagnetic emission energy [42]. Regarding software, we could reduce the power consumption of the system firmware, which can be categorized as event-driven, duty cycle, feature selection, or sensor selection. For interface, the microinteractions used to complete the task should be done in less than 3 seconds.

7.3. Lack of Standards

This challenge makes wearable technology unstable and difficult to adapt and use. Al-Shaqi et al. said regarding this issue that “Adaptability of different system components from sensors, communication protocol, decision support, and subject interaction method or language. Availability of standards will help system designers to integrate efforts and provide the market with the necessary devices and systems to meet the subject defined requirements.” There is also a lack of commercial concern for establishing a relationship between academia and commercial sectors.

7.4. Safety

A novel nonlinear optimization framework has been presented to consider safety and sustainability requirements that depend on human physiology and derive system-level design parameters for wearable sensor applications. Reliability of data is another challenge. Therefore, we should use data collection that uses accurate thresholds with low or no fault tolerance. Fault tolerance of devices is also a concern in terms of resistance to impact, heat, cold, and water.

7.5. User Acceptance

This is the main property of wearable devices. User acceptance has many challenges with respect to personalization, interface, design, and data. Personalization is the ability to support a person’s lifestyle, for example, allowing the user to create the form that they want. Also, the focus should be on interfaces that are accessible, simple, and easy to use. In addition, there is a need for customization and adaptivity to different settings based on user requirements, such as in ALS.

7.6. Design

Wearable devices must be designed in a special form with the following properties. Firstly, it is not very obvious and appears to others. Secondly, they should not disturb the users’ daily activities, and frequent wearing must be comfortable. Finally, they must be close to the body in order to sense the required measurements accurately.

7.7. Data

It should be meaningful by displaying ambient feedback rather than showing the user lots of numerical values.

8. Conclusions

Many review studies on wearable technology have been conducted. Therefore, this paper presented a review of previous research on wearable computing studies. As a result, and to the best of our knowledge, there were no review studies on WWDs that consider many aspects. This paper discussed the different kinds of WWD studies, highlighted important issues, and suggested future works.

The next step is to attempt investigating more studies based on a specific domain or a specific topic that could be solved with wearable technology then explore and detect problems with the aid of a domain expert to determine requirements.

Conflicts of Interest

The authors declare that there is no conflict of interest regarding the publication of this paper.

Acknowledgments

The authors would like to thank the Deanship of Scientific Research for funding and supporting this research through the initiative of DSR Graduate Students Research Support (GSR). The authors also thank the Deanship of Scientific Research and RSSU at King Saud University for the technical support.