[Retracted] A Complexity Analysis of User Interaction with Hotel Robots

Zhong, Lina; Yang, Liyu; Rong, Jia; Li, Xiaonan

doi:https://doi.org/10.1155/2020/4537152

Complexity

On this page

Abstract Introduction Literature Review Materials and Methods Results and Discussion Conclusion Data Availability Conflicts of Interest Authors’ Contributions Acknowledgments References Copyright Related Articles

Research Article Retraction

!

This article has been Retracted. To view the article details, please click the ‘Retraction’ tab above.

Special Issue

Complexity Problems Handled by Advanced Computer Simulation Technology in Smart Cities 2020

View this Special Issue

Research Article | Open Access

Volume 2020 | Article ID 4537152 | https://doi.org/10.1155/2020/4537152

[Retracted] A Complexity Analysis of User Interaction with Hotel Robots

Lina Zhong,¹Liyu Yang,¹Jia Rong,²and Xiaonan Li¹

Guest Editor: Zhihan Lv

Received28 Mar 2020

Accepted12 May 2020

Published30 May 2020

Abstract

Service robots have been introduced to hotel industry in the past decade and received various feedback on their performance. To provide better service, one needs to understand how the hotel customers look at the service robots. Understanding their interests, motivation, and behaviors in human-robot interaction is the key to develop high-quality services and improve robot’s performance. This is the first work to study human-robot interaction in hotels in China. Frequent pattern mining and social network analysis techniques are used in this work to find out useful suggestions to both hotel management and robot manufactory. Turning on and off lights, TV, curtain, and window screens are popular services that most of the hotel customers preferred during their stays. Service robots are also found to entertain customers to carry out repeated commands for fun or to kill time. Customers also showed various motivations to stay in hotel rooms by calling different commands.

1. Introduction

Rapid development of IT and AI makes it possible to have intelligent robots in people’s daily life. In terms of functionality, robots could be classified as industry robots and service robots [1]. By a close look at the service robots, a further categorization can be applied for professional use or for personal/private use [2]. Service robots for professional use are designed to accomplish a particular task or serve a target group of users. For example, professional service robots include cleaning robots, sewer robots, inspection robots, demolition robots, underwater robots, robots in medical institutions, robots with disabilities such as auxiliary robots and wheelchair robots, delivery robots, guidance robots, gas station robots, firefighting robots and air defense robots, construction robots, agricultural robots, etc. Service robots for personal and private use include domestic (home) robots, entertainment robots, educational robots, and so on. These service robots have been developed to assist human beings to finish daily tasks [3]. Both service robots are designed to assist and interact with human beings to complete tasks.

Current research focuses on the design, application, and evaluation of service robots. In terms of design, how do designers design robots, robot interactions, and experiences based on customer needs and preferences? They can weaken or strengthen customers’ perception of value, leading to positive or negative word of mouth [4]. Ivanov and Webster [5] focus on the design of friendly hospitality robots. Korea Institute of Science and Technology (KIST) designed elderly robot [6]. Lakshmi et al. [7] designed a hospital nursing drug delivery robot. In terms of applications, unlike industrial robots, the accuracy or speed of service robots is not always the most important aspect. Their function or purpose is not only for entertainment but also to provide help, guidance, treatment, education, and communication [3]. In terms of evaluation, Ivanov et al. [8] used a questionnaire to explore how Iranians view the hotel robots, especially what Iranian consumers think robots can do for them and what they want robots to do. Ivanov et al. [8] investigated the attitude of young Russians towards introducing robots in hotels. Tussyadiah and Park [9] focused on customer evaluation of hotel service robots. There is still a lack of understanding of the content and effects of robot services, which is why the paper is written. The existing studies have not explored much in the service content of the hotel robots or effectiveness of the human-robot interaction.

Human-robot Interaction was distinguished by Thrun [10] into two categories: direct and indirect interactions. Direct interaction assumes a type of two-way communication, which shows equal status between humans and robots. Indirect interaction assumes a type of one-way communication, where the robot acts according to the users’ command and reacts to its users. This work focuses on indirect interaction with remote-control robots. The remote-control robot is controlled by a human from a distance (near or far), and the human can control the robot through a joystick or instruction [11].

This work aims to study the actual services requested by human to be implemented by hotel robots by analyzing historical data collected from the real hotel rooms equipped with service robots from 2017 to 2018. This work tried to answer questions such as (1) what are the most popular services the users requested from the hotel robots, (2) what are the motivations for humans to interact with hotel robots, and (3) how often do users give commands to hotel robots. Furthermore, the responsiveness of the hotel robots to the commands received is another interesting topic in this work.

The rest of the paper is organized as follows: Section 2 reviews the current research work on service robots in hotel industry and customer feedback on their performance; Section 3 introduces the data resource and collection process followed by the details of selected data analysis methods; the interesting user command patterns as the experimental results are presented and discussed in Section 4; Section 5 concludes the entire work together with limitation and possible future work.

2. Literature Review

To conduct the study of human-robot interactions, the related literature has been carefully reviewed to have a comprehensive understanding of the current work of service robot applications in relevant industry, especially in hotel industry, and the technology level and the performance of the current hotel service robots in real world.

2.1. Robot Applications in Service Industry

Service robots are designed to support and service humans through physical and social interactions [12]. For frontline service robots, Martins [13] defined them as follows: a service robot is a system-based autonomous and adaptive interface to communicate and provide services to customers. Service robots play different roles, such as pets, companions, secretaries (or subordinates), and bystanders, just like the relationship with humans [14, 15]. Service robots can significantly reduce labor costs, and they are more like “tools” of technology and employees than their replacements [16]. Martins [13] considered the following three attributes related to service design: representation, personification, and task orientation. The service robot can have a physical representation (such as Pepper) or only a virtual representation (such as Alexa). Therefore, we believe that virtual AI software that can run autonomously and learn over time can also be classified as a service robot. The service robot can be designed as a humanoid robot (such as anthropomorphic robot) that simulates the appearance of a human (such as Sophia) or it can be designed as a nonhumanoid robot (such as a cleaning robot). Finally, service robots can perform cognitive analysis tasks according to basic computer functions (such as image analysis software assistants for medical diagnosis) or emotional social tasks (such as receiving robots).

Robots are widely used in the service industry. In terms of home education, South Korea has developed the world’s first available e-learning home robot and demonstrated the future of robots as a new educational medium. The survey found that home robots are superior in promotion and application and are more able to focus students’ attention and interests and improve their academic performance [17]. Ju et al. [18] designed an educational robot platform for the needs of robot education for elementary and middle school students. In terms of senior care, van Osch et al. [11] developed a home care robot called Rose, which is controlled from a long distance (8 km) to perform small tasks for the elderly. The Korea Institute of Science and Technology (KIST) has launched a new project to develop an elderly service robot named T-Rot at the Intelligent Robot Center [6]. Lee and Naguib [19] introduced the design and implementation of the next-generation elderly care robot “Home Mate” based on innovative commitment to sociality and reliability and extensive user research, which can be used for infotainment, video chat, games, and drug reminders. In terms of guidance, Bohus and Horvitz [20] introduced directional robots that can use natural language to interact with one or more participants and provide directions to offices, conference rooms, and other public areas within the building, such as kitchens, cafeterias, and bathrooms. Kanda et al. [21] developed a robot for a shopping mall designed to interact naturally with customers and provide shopping information emotionally. Linder et al. [22] experimentally tested the performance of tracking robots in dense places such as airport terminals for shopping malls. In terms of medicine, Mirheydar and Parsons [23] reviewed the application of robotic surgery in urology and pointed out that the safety of patients with robotic prostatectomy increases. Lakshmi et al. [7] introduced the design and manufacture of a drug delivery robot for hospitals to provide alternate care services. Hu et al. [24] designed a planner based on Gaussian process classification, which aims to promote the further integration of multifinger manipulators and medical image detection.

2.2. Service Robots in Hotel Industry

Service automation, artificial intelligence, and robotics offer huge opportunities for the hospitality industry [25]. Hotel robot functions include interacting with travelers and entertaining them, as well as physical assistance, such as transport, checking baggage, and guidance. [26]. Starwood has introduced a robot butler in their Aloft hotel mainly to provide conveniences to guest rooms [27]. Henn-na Hotel is the first hotel to hire hotel robots during the entire operation from check-in to automatic baggage delivery, using robots to check in occupants and escort guests to their rooms. The robotic receptionist speaks Japanese or English, depending on guest preferences. It can set reservations for people, take them to their rooms, and adjust the temperature of their accommodation. In the room, guests can use voice commands to change the lights and ask questions about time or weather [28]. In collaboration with IBM, Hilton Worldwide is the first to launch the world’s first robotic concierge service (using SoftBank’s NAO robots) to gain knowledge from artificial intelligence systems and inform guests of local attractions, restaurants, hotel facilities, etc. [29]. The Las Vegas Wayne Hotel has announced that it will introduce Amazon Echo voice roll-up speakers in all rooms with Alexa digital assistants [30]. By the end of 2018, Alibaba’s first future unmanned hotel “Flyzoo Hotel” has been put into operation [31].

From the demand side, economically, hotel robots can help hotels cope with seasonal employment and labor costs. Dirican [32] believes that artificial intelligence, especially the introduction of robotic services to hotels, greatly improves the efficiency of hotel services and reduces hotel operating costs, although some hotels with robots still consider investment costs to be high. With increasing labor costs, decreasing labor availability, decreasing robot costs, and increasing robot capabilities, many low-wage service jobs in the hotel industry are expected to be replaced [33]. The time spent on robot labor is less expensive than paying humans [34]. On the noneconomic side, using robots to complete some daily tasks may be considered by hotel managers as a good choice because it will save them most of the concerns of legal authorities, unions, and immigration offices such as seasonal layoffs. [12, 35]. Stringam and Gerdes [36] used a combination of quantitative and qualitative methods, pointing out that the self-service of hotels has not yet led to a significant reduction in labor. Due to hotel technology’s labor savings, most hotels choose to redeploy employees to other tasks. It is improving customer service, not reducing staffing. Managing robots will be different than managing tangible goods. How robots, staff, and customers interact is an important focus for future travel and hotel managers [37].

From the supply side, Murphy et al. [38] discussed the design of robots for hotel and tourism industries and training in robot management. The implementation of hotel robots is usually integrated with other technologies such as facial recognition, automatic payment, drone delivery, and autonomous vehicles [9]. According to [39, 40], a robot control system requires three development levels, including hardware, functions, and services. Hardware refers to the shape of the mechanical design, which includes the main part of the service robot, the perception system (sensor), and the motion system (actuator). Function refers to the software architecture of the control system, which can implement navigation, dialogue, visual and speech recognition, positioning and mapping mechanisms, and the representation of knowledge mental models. Service refers to the added value that the hotel aims to create and provide customers with services to maintain a competitive advantage. Chung et al. [41] believe that a key requirement of the robot is that the robot should perceive people around the robot. Through two field studies of custom programs and iterative design, a programming system for social interaction applications of mobile service robots has been developed. The timing for widespread deployment of service robots anywhere in the hotel will depend on when technical limitations can be addressed [42]. Zhang et al. [43] proposed a smart hotel robot based on ROS, which simplifies the check-in process. López et al. [44] proposed an automated hotel assistant system based on a series of mobile platforms that interact with guests to help them complete different tasks, including bring small items to customers, show them the different attractions of the hotel, accompany guests into their rooms, and provide them with general information.

2.3. Related Work on Robot Service Quality and Feedback

Customers can feel valuable in the self-service process when interacting with service robots out of fun, enjoyment, and curiosity [45, 46]. Robot customization with user-friendly interface design is important to attract specific new customer markets [47, 48]. Although current robotics technology may not directly complement comprehensive human services, from a marketing perspective, service robots will indirectly attract existing and potential customers [49, 50]. Zhang and Qi [51] pointed out that people with high education and high income who are interested in AI technology are more looking forward to staying in AI robot hotels. Some authors have even suggested that marketers should start thinking about robots as attractions [52]. With the popularity of robots, curiosity will no longer be an important reason for guests to stay in hotels but instead will be service quality and customer satisfaction. Many scholars have researched and explored the service quality of robots [53–55]. Service robots can improve perceived service quality through new attractive interactive services, communication, and contact with customers [56]. Unlike industrial robots whose performance indicators depend entirely on efficiency, the success of service robots depends on user satisfaction [57]. Robots that fail to deliver services can severely impact customer satisfaction and hotel performance [58]. Nakanishi et al. [59] found that the warm heart interactive service of humanoid robots potentially improves customer satisfaction with the entire service.

Customer satisfaction with robot services is largely determined by the robot itself. Therefore, the optimal design of the robot is particularly important. One of the current research studies is to subjectively obtain feedback through customers’ questionnaires, polls [60], secondary data analysis [61], hybrid approach [62], and so on. Jeonghye et al. [14] proposed an evolutionary model of service robots with LCD touch panels, such as home robots, by questionnaire survey of parents and children and proposed the importance of rebuilding the robot’s facial expressions based on the evaluation model. Tussyadiah and Park [9] found that customers’ perception of different types of hotel service robots is different through online surveys and the use of biosensors to measure automatic emotional responses, and the adoption of hotel service robots is significantly affected by the following aspects: intelligent and perceived security. Another aim is to objectively optimize the algorithm, for example, Ju et al. [18] designed a Python plug-in management system based on the mechanical mechanism design of the robot platform to implement graphical programming to control the robot. Huang et al. [63] proposed a multiattention-based group recommendation model (MAGRM), and experiments showed that its performance in solving group recommendation problems is significantly better than the latest technology.

The above methods are either subjective or disconnected from the customer, and it is important to find an objective and customer-relevant robotic optimization feedback channel, such as robot optimization through service commands issued directly by customers. Therefore, this paper analyzes the general situation of hotel robot service from the command, by studying what the consumer’s commands to the robot mainly include, whether it has formed a certain pattern according to the time series, and whether there are different service differences from the response of the command. The aim is to analyze the service content and quality of hotel robots and to point out new directions and ideas for hotel robot design. It is expected to contribute to the further optimization of robot design, such as packaging preset behavior patterns, optimizing repetitive commands, and human development to improve the service quality of the robot.

3. Materials and Methods

To have a systematic analysis on human-robot interaction, a rich data source containing a large amount of interaction records is needed. Then, the collected big dataset is preprocessed to remove incorrect and irrelevant information to reduce possible bias in results. After a basic statistical analysis on the clean dataset, the paper uses a frequent pattern mining method to study the user command patterns and a social network-based clustering method, which aims to help understand users’ motivations, interests, and particular behaviors.

3.1. Data Collection and Preprocessing

The data were collected from 88 hotels in 23 cities across the mainland China. The service robots are equipped in 789 hotel rooms in these hotels. A robot management system by robot manufactory recorded all the user commands received by the hotel robots in the rooms. In this work, the historical data of command records in 2017 are selected for analysis and evaluation purpose due to the stability of the robot operations and the completeness of data.

In the interaction between user and hotel robots, the commands were given by voice. The user spoke out their requests and then the robot received the entire voice sentences and converted them into simple text-based command labels by its voice recognition functions. The collected data were then preprocessed to remove the inconsistent command labels caused by the updation of the robot system. The unrecognized commands were also removed as they were mainly caused by accent issues. After preprocessing, 745,528 valid user commands from 49,955 hotel customers were kept and input into the next-step analysis processing.

3.2. Association Analysis on User Commands

To understand human-robot interaction, the commands given by the users are the only resource that can be carefully studied in this case. Frequent pattern mining is used to discover most popular user command patterns in order.

3.2.1. Sequential Frequent Pattern Discovery from User Commands

Frequent patterns are often used to present the most common or similar features among data examples in a dataset. Given a set of commands, frequent pattern mining aims to find the rules that enable us to predict the occurrence of a specific item based on the occurrence of other items in the commands. A frequent pattern can be determined by a set of standard constraints [64].

The simple form for frequency of a pattern can be easily gained by counting the total number of its occurrence in the entire dataset. This is commonly used for finding out the most popular patterns with only one individual command.

Support, as one of the widely used constraints, was proposed by Agrawal et al. [65] in their Association Rule Mining (ARM) algorithm to identify a frequent pattern with two or more user commands. Let C be the complete set of all user commands in the collected dataset D c₁ and c₂ be two commands from C, that is, c₁ ∈ C, c₂ ∈ C. c₁ and c₂ are two different commands. The support of these two commands can be obtained by

A pattern can be indicated as a frequent one if its support score is not less than a minimum support threshold , . The classic Apriori-heuristic-based ARM is not suitable for processing large-scale dataset as it is very time consuming and expensive in computation. The concept of interestingness is then considered into the process to avoid generating too many useless candidate command patterns [66]. Only the candidate patterns with a higher interestingness score than the minimum interestingness threshold can join the next round of candidate pattern generation. A candidate pattern with two commands is generated based on the single commands with acceptable support score in previous generation; the candidate patterns with three commands are generated from the candidate patterns with two commands, and so on. The interestingness is calculated by the leverage of two commands as an example below:

In such a way, the computation time and waste can be controlled under an acceptable range. In this work, the candidate command patterns are indicated as frequent patterns based on their frequency of occurrence. One of the reasons is due to the high repeats of the same command patterns in one interaction. The user could place the same set of commands one after another, for example, “turn on lamp, turn off lamp, turn on lamp, play music, turn off lamp, turn on lamp …” Therefore, the strength measurement constraints in ARM do not fit and are ignored in this study.

Another special feature in this work is that the actual time when users placed the commands was recorded as well, which makes the collected data time-series data. Time-series data are often presented in data sequences. In this work, each sequence records an interaction between the user and the robot. Accordingly, the command patterns are not random combination of the commands, and the order of the commands is also important.

3.2.2. Social Network Analysis for User Clustering

In recent years, the world has become more and more complex, and the research community has done a lot of work on the measurement of complexity. Social network is an analysis and simulation method that attempts to use the relationship between points and lines to analyze complex systems through the algorithmic characteristics of graphs. Social network analysis is widely used to understand the nature and discover useful patterns representing the relationships among members in a group [67]. In this work, the relationships among the hotel customers (users) were studied based on the commands they placed. The dataset was reorganized into a collection of the sequences of commands recorded for each individual user. A matrix M was obtained where n is the total number of the user commands. The intersection m_ij records the number of occasions that command c_i and command c_j are in the same clique. A clique is a subset of commands that always occur together over all the command sequences [68]. The total number of links in the network is calculated by .

Hierarchical clustering (Johnson, 1967) was then used to group commands into clusters based on the nearest pair of commands. By clustering the commands together, the users’ interests are discovered, that is, what commands are always called together with high densities. The social network analysis was implemented using a software called UCINET [69].

4. Results and Discussion

This section presents the experiment results obtained by applying the selected method on the collected data. The results are explained with the method used, respectively, followed by discussion of overall findings.

4.1. Dataset and Descriptive Statistical Analysis

After data cleaning and preprocessing, a total number of 103 individual commands were extracted from the collected historical data. Table 1 lists the top 50 commands placed by the users in the interaction with hotel robots. The top 12 commands have much higher frequency to be called by the users than the rest, which have over 90% of the listed commands. Close to 70% of user commands fall into one of the OpenLamp, CloseLamp, TVOFF, OpenCurtain, and CloseCurtain commands. That is, about 90 commands have less than 0.4% of chances to be called once in a year.

4.2. Time-Based User-Robot Interaction Analysis

Analyzing the active degrees of user commands helps to understand the peak and off-peak periods of human-robot interaction. An hour-based activity frequency chart is presented in Figure 1. Some common senses can be detected including the interactions which always start alone with users waking up in the morning from 6 am and increase to reach the first high point around 10 am. A small drop is found around 12 pm when users leave the rooms for lunch, and the number of commands climbs back quickly from 1 pm and remains stable until dinner time. The peak time is around 10 pm when users stay in the room to enjoy entertainment. It is a surprise to see that users still communicate with service robots after midnight. Finally, the quiet time starts from 2 am to 5 am. Many people stay late in the hotel rooms and talk to service robots.

A month-based activity frequency chart is presented in Figure 2. During the whole year, the service robots are busy in July and August and most of them are in idle or standby status in January and February. This matches the factor that during summer time, more hotel reservations and travels are made in general. The monthly-based interaction data also indicate that most of the users who lived in the hotel rooms equipped with service robots tried to interact with them almost every time. The service robots are accepted by users who stayed in the hotels anytime.

4.3. User-Robot Interaction Pattern Discovery

Frequent command patterns are expected to provide some knowledge about users’ interests, behaviors, and the responsiveness performance of service robots.

4.3.1. Command Patterns for Popular Command Combinations

In human-robot interaction analysis, a main object is to find out the user interests when they request robots for services. The frequent command patterns can indicate what groups of commands users preferred to work with service robots. The frequent individual user commands are listed in Table 1. Tables 2–4 list top 10 frequent patterns as the permutations of two, three, and four commands, respectively. The pattern generation stopped at four-command level since the frequency and support score of the candidate five-command patterns were too low to have significant influence. The frequency was measured by the total number of occurrences including the repeats in the same interaction. The number of interactions when a pattern appeared at least once was also recorded. The difference between these two numbers indicate that many patterns have high repeats in a single interaction. The reasons to have this situation are complex and will be explained in the following context. Note that the order of commands is a key concept to be considered in all cases.

In the frequent two-command and three-command patterns, most of the patterns contain operations of turn on and off lamp (all lights), curtain, and TV. In the frequent four-command patterns, close screen (for windows) as a new command can be seen in most of the patterns. However, the number of commands increased in the patterns, and the total number of occurrences dropped significantly. A common behavior from all the pattern sets that can be seen is that users like to turn off light, curtain, window screen, and TV together. The difference is just the order of turning which one first. For those patterns regarding TV, users turned off the TV more frequent than to turn it on because the TV was automatically turned on after the user entered or returned to the rooms in many hotels in China region. In addition, from all the frequent patterns in these three tables, the lamps (lights) and the curtains were turned on or off together. If the curtain was closed, then the lamp would be off too, and vice versa. It is not a common case to close the curtain and turn on the lights, from which one can claim that such operation was normally done before the user went to bed. It also confirmed that the human-robot interactions were active in the late hours of the day (as shown in Figure 1). The patterns of opening curtain and turning on the lamps may suggest the natural lighting in the rooms is insufficient.

A particular behavior is found from the analysis, in which the users tried to “play” with service robots by placing paired commands. That is, when the first command was given, immediately another command followed. The paired commands are always to turn on or off one device, such as lamps, TV, curtain, and air conditioner. This indicates that the users were bored and called those commands without a clear purpose. They might just want to talk to service robots for fun or kill time. Table 5 lists the top 20 paired commands in this category. Rather than turning on and off a particular light, users preferred more to turn all the lights on and off. For TV and air conditioner, the same situations are detected. Users did not give details in order but went for simple and short commands.

4.3.2. Robot Responsiveness Analysis

Although the human-robot interaction is identified as the indirect one that only one-way communication is applied, the responsiveness of the service robots to the user’s commands is an interesting topic to be explore more in this section.

The responsiveness analysis carried out in this work is to look at how many times a user needs to repeat continuously the same command until the robot takes action or the user gives up. From the frequent pattern analysis above, there are some differences between the total number of the occurrences of the patterns and the number of the interactions having the patterns. They are not the same numbers, and in many cases, there are big gaps between them. The reason for this is that some commands are repeated many times in one interaction. The commands with repeats were closely observed, and the findings are summarized in Figure 3. The number of repeats for one single command daily is around 2.9, which indicates that the service robot’s responsiveness still has a big room for improvement. Top 20 repeated commands were extracted from the analysis. By comparing with the initial count on top 50 frequent individual commands in Table 1, 17 out of 20 most frequent commands are found to have high repeats. Most of the commands were repeated within 2 seconds.

Table 6 lists the top 20 commands that have the most repeats. Not all of them have repeats due to the poor responsiveness of the robots. The repeats may be caused due to the nature of the commands themselves. For example, MusicVolDown, TVChannelADD, TVVolUp, MusicVolUp, TVVolDown, and TVMenuUp are six commands that the users will repeat several times to reach their satisfied status. It is understandable that a user will keep on calling the command MusicVolDown to turn the music volume down to an acceptable amount. However, other commands to be repeated are treated as the cases of poor responsiveness of service robots. ReadLightMax has the highest repeat rate over 85% followed by OpenPowerLight (81.32%). These commands with high repeats need special attention to the service robot manufactory for performance.

4.4. User Command Clustering

The user clustering based on the commands they called in the human-robot interaction is shown in Figure 4. In total, six user clusters were obtained from social network analysis by UCINET. They are colored in Figure 4 for visualizing the user groups and the commands used by each group. Overall, a set of common commands is detected, which confirms the most popular commands like switching lights, pulling curtains, watching TV, and playing music are the favorites for all six groups of users. Individual groups also have their preferred commands. Even with the same devices, they have different operations. Each group is discussed in more detail in the rest of the section.

Group 1 (in pink) has the biggest set of the commands. Except the commands related to switching TV, light, and curtain operations, this group works more active in playing music and changing TV channels. The users in this group may prefer more to turn on TV to play music, but few of them used commands to adjust room temperature.

Group 2 (in dark blue) has the active users who used service robots to mainly adjust the room temperature by air conditioner. A set of temperature setting commands like “Aircondset25,” “Aircondset24,” “Aircondset26,” “Aircondset20,” and so on is detected in this group particularly. The temperature range is from 17°C to 29°C across the year, which falls into the normal external temperature adjustment of the human body. This user group focused more on the operations with accurate requirements rather than some general commands preferred by Group 1.

Group 3 (in light blue) is a small one at the margin areas. The commands used more by this group are entertainment-related operations on TV and playing music. They used “Bluetooth” to connect with their own smart devices and played music on TV. They also used “Checkouton” command to inform the service robot before they left the room. They can be indicated as avant-garde customers for hotels.

Group 4 (in green) often used robots to call for room service. The users in this group put “Nodisturbon” and “Cleanon” to call for cleaning service. They also watched the charge channels on TV rather than browsing the noncharge channels. These customers preferred more to keep the hotel room as their private space and had strong control on the activities in their space.

Group 5 (in yellow) and Group 6 (in brown) are two groups with the users who spent more time on switching lamps in the room to adjust the lighting. These two groups do not share a lot of overlaps with the other groups; especially Group 6 has commands with only one connection. These two groups have high interests to particular lights at different positions in the room. They did not use general commands to turn all the light on or off, but carefully and clearly gave the name of the lights. This behavior shows that the users moved a lot inside the room. They are energy savers to use individual lights in small areas.

4.5. Discussion

From the analysis on the results above, a number of issues and valuable points obtained need special attention from hotel management and technical experts in service robot manufactory.

In terms of theoretical contributions, this article makes an in-depth analysis of the services provided by robots from the perspective of the service industry. Different from the traditional robot research, it closely integrates human feelings and robot design and provides more knowledge to this area. Furthermore, this paper proposed a command mode for hotel robots through a complex network analysis of a large number of robot commands. This is an innovative attempt in service robot research.

In terms of practical contributions, the robot needs to be improved in terms of human-computer interaction performance. From the same command in the same minute, the robot has certain problems in accepting customer orders, and there are many reasons for these problems. For example, the accent of the customer speaking Mandarin causes the robot not to be unrecognizable, or the voice of the customer is inaudible. Hotel robots lack sematic understanding of customer commands, which means that now hotel robots mostly use keywords matching and provide search results according to customers’ command. Unrecognizable or too many external environmental interference factors cannot be removed by the robot. Regardless of the possible reasons, developers are still waiting to improve the performance of robots in human-computer interaction.

The customer conducts a curious operation. The typical performance is that the customer speaks many different types of operation commands in a short period of time, and thus the customer, being curious, is in a slow process of trying, trying, and accepting the service robot. Because of the curiosity about new things, the customer is willing to issue different commands to the robot. There are two kinds of mentality, one is the verification of the performance of the robot, and the other is the attempt of new things. Regardless of the mentality, it is conducive to the widespread use of future service robots. After repeated trials, the customer has a sensory feeling about the performance and service quality of the robot. In addition, because customers are more and more getting used to hotel robots and loss of interest, the paper provided a good reason for manufacturers to improve their service robots. This is crucial for the follow-up customer’s willingness to continue using or staying in a hotel with a robot. The following components can promote the customer's visit again; on the one hand, it is a good trial experience; on the other hand, it can bring convenience and comfort to customers. Of course, contrary to these two components, due to poor trial experience and complex or infinite operations, customers will be greatly reduced in the use and expectation of the robot.

Operation instructions are too limited. From the perspective of the type of operation instructions throughout the day, most of the operation instructions are control-type instructions. These instructions can only meet the customer’s regular needs, and it is difficult to make a deep impression on the customer and urge the customer to have the urge to visit again. This is mainly due to the narrow range of hotel robot services. It is recommended that robot designers go to the hotel to experience the on-site experience of their products, think about the potential needs of customers from the perspective of customers, and develop some operational instructions that can impress customers. For example, automatic indoor temperature monitoring and adjustment, human body temperature automatic monitoring, potential hazard automatic alarm, customer demand input and implementation, and customer health care; only by developing these kinds of orders, we can grasp the customer’s heart and promote and use service robots.

5. Conclusion

This paper proposed a first study on human-robot interaction between customers and service robots in hotels in China. Different from other service robot research studies that focused more on technical problems in robot design, development, and performance evaluation, this work made use of real data collected from live interactions between customers and robots in the hotel rooms by applying frequent pattern mining and social network analysis techniques to find out hotel customers’ interests, motivations, and behaviors when they interact with service robots.

Among a total of 103 user commands called by over 49,955 hotel customers during their stays in 88 hotels from 23 cities in China, the frequent command patterns indicate that most of the customers called service robots to do simple operations such as switching on or off the lights, TV, curtain, and window screen. Hotel customers have special preferences on services when they interacted with service robots. Some like to try a big range of service; some prefer to give accurate commands to adjust the room environment; some spend their time in hotel rooms for entertainment; some take time to enjoy themselves in hotel rooms as their private spaces; and others treat service robots as a company to kill time by repeating same set of commands continuously. Robots are also found to be slow to respond to some of the user commands, and potential improvement is expected to be made in near future.

Since this is the first work of this area, there were some limitations when the research was conducted. The raw data collected from the robot management system by manufactory contain inconsistent command labels due to system updation. Only the data in 2017 are complete to be used in this work. The users’ information is lacking in this work due to privacy concerns and since their personal information cannot be shared by hotels. In addition, whether social network analysis is applicable to robot commands needs to be carefully studied afterwards. However, these issues did not stop this work from discovering useful knowledge to understand hotel customers’ interaction with service robots, and this is a remarkable step in human-robot interaction study in the future. The findings help hotel management to adjust the services that the customers are interested in and what the robots could provide.

Data Availability

The data are owned by the robot company and could not be released.

Conflicts of Interest

The authors declare that they have no known competing financial interest or personal relationships that could have appeared to influence the work reported in this paper.

Authors’ Contributions

Lina Zhong was responsible for conceptualization, methodology, writing, and funding acquisition. Liyu Yang contributed to literature review. Jia Rong reviewed and edited the manuscript and supervised the study. Xiaonan Li was responsible for software and formal analysis.

Acknowledgments

This study was supported by the Beijing Social Science Foundation under grant nos. 19JDXCA005 and 18JDGLB013 and National Natural Science Foundation of China under grant no. 71673015.

References

S. Ivanov and C. Webster, “Perceived appropriateness and intention to use service robots in tourism,” in International Conference in Nicosia, pp. 237–248, Springer, Cham, Switzerland, 2019.
View at: Publisher Site | Google Scholar
International Federation of Robotics, United Nations, and Economic Commission for Europe, World Robotics, 2002: Statistics, Market Analysis, Forecasts, Case Studies and Profitability of Robot Investment, United Nations Publications, Newyork, NY, USA, 2002.
T. Shibata, “An overview of human interactive robots for psychological enrichment,” Proceedings of the IEEE, vol. 92, no. 11, pp. 1749–1758, 2004.
View at: Publisher Site | Google Scholar
M. M. Wasko and S. Faraj, “Why should I share? Examining social capital and knowledge contribution in electronic networks of practice,” MIS Quarterly, vol. 29, no. 1, pp. 35–57, 2005.
View at: Publisher Site | Google Scholar
S. H. Ivanov and C. Webster, “Designing robot-friendly hospitality facilities,” in Proceedings of the Scientific Conference on Tourism. Innovations. Strategies, pp. 74–81, Bourgas, Bulgaria, 2017.
View at: Google Scholar
M. Kim, S. Kim, S. Park, M.-T. Choi, M. Kim, and H. Gomaa, “Service robot for the elderly,” IEEE Robotics & Automation Magazine, vol. 16, no. 1, pp. 34–45, 2009.
View at: Publisher Site | Google Scholar
N. K Lakshmi, G. Rajakumar, D. N. M. Kumaran, I. Dinesh, V. Caleb, and H. Arshadh, “Design and fabrication of medicine delivery robots for hospitals,” in Proceedings of International Conference on Recent Trends in Computing, Communication & Networking Technologies (ICRTCCNT), Chennai, Tamilnadu, India, October 2019.
View at: Publisher Site | Google Scholar
S. Ivanov, C. Webster, and A. Garenko, “Young Russian adults’ attitudes towards the potential use of robots in hotels,” Technology in Society, vol. 55, pp. 24–32, 2018.
View at: Publisher Site | Google Scholar
I. P. Tussyadiah and S. Park, “Consumer evaluation of hotel service robots,” in Information and Communication Technologies in Tourism 2018, pp. 308–320, Springer, Cham, Switzerland, 2018.
View at: Publisher Site | Google Scholar
S. Thrun, “Toward a framework for human-robot interaction,” Human–Computer Interaction, vol. 19, no. 1-2, pp. 9–24, 2004.
View at: Publisher Site | Google Scholar
M. van Osch, D. Bera, K. van Hee, Y. Koks, and H. Zeegers, “Tele-operated service robots: rose,” Automation in Construction, vol. 39, pp. 152–160, 2014.
View at: Publisher Site | Google Scholar
S. Berezina, H. I. Stainslav, and C. Webster, “Adoption of robots and service automation by tourism and hospitality companies,” Revista Turismo & Desenvolvimento, vol. 27, pp. 1501–1517, 2017.
View at: Google Scholar
A. Martins, “Brave new world: service robots in the frontline,” Journal of Service Management, vol. 29, no. 5, pp. 907–931, 2018.
View at: Publisher Site | Google Scholar
H. Jeonghye, L. Jaeyeon, and C. Youngjo, “Evolutionary role model and basic emotions of service robots originated from computers,” in Proceedings of the International Workshop on Robots and Human Interactive Communication, pp. 30–35, IEEE, Nashville, TN, USA, August 2005.
View at: Publisher Site | Google Scholar
D. Norman and S. W. Draper, User Centered Design: New Perspectives on Human-Computer Interaction, Lawrence Erlbaurn Associates, Hillsdale, NJ, USA, 1986.
C. Webster and S. Ivanov, “Adoption of robots, artificial intelligence and service automation by travel, tourism and hospitality companies—a cost-benefit analysis,” in Artificial Intelligence and Service Automation by Travel, Emerald Group Publishing, Bingley, UK, 2017.
View at: Google Scholar
H. Jeonghye, J. Miheon, P. Sungju, and K. Sungho, “The educational use of home robots for children,” in Proceedings of the International Workshop on Robots and Human Interactive Communication, pp. 378–383, IEEE, Nashville, TN, USA, August 2005.
View at: Publisher Site | Google Scholar
A. Ju, D. Chen, and J. Tang, “Design of Educational Robot Platform Based on Graphic Programming,” in Advances in Intelligent Systems and Computing, vol. 1117, Springer, Singapore, 2019, International Conference on Big Data Analytics for Cyber-Physical-Systems.
View at: Publisher Site | Google Scholar
S. Lee and A. M. Naguib, “Toward a sociable and dependable elderly care robot: design, implementation and user study,” Journal of Intelligent & Robotic Systems, vol. 98, no. 11, pp. 5–17, 2019.
View at: Publisher Site | Google Scholar
D. Bohus and E. Horvitz, “Directions robot: in-the-wild experiences and lessons learned,” in Proceedings of the International Conference on Autonomous Agents and Multiagent Systems, pp. 637–644, Paris, France, May, 2014.
View at: Google Scholar
T. Kanda, M. Shiomi, Z. Miyashita, H. Ishiguro, and N. Hagita, “An affective guide robot in a shopping mall,” in Proceedings of the International Conference on HumanRobot Interaction, pp. 173–180, ACM/IEEE, San Diego, CA, US, October 2009.
View at: Publisher Site | Google Scholar
T. Linder, S. Breuers, B. Leib, and K. O. Arras, “On multi-modal people tracking from mobile platforms in very crowded and dynamic environments,” in Proceedings of the International Conference on Autonomous Robot Systems and Competitions, pp. 5512–5519, IEEE, Stockholm, Sweden, May 2016.
View at: Publisher Site | Google Scholar
H. S. Mirheydar and J. K. Parsons, “Diffusion of robotics into clinical practice in the United States: process, patient safety, learning curves, and the public health,” World Journal of Urology, vol. 31, no. 3, pp. 455–461, 2013.
View at: Publisher Site | Google Scholar
J. Hu, Y. Sun, G. Li, G. Jiang, and B. Tao, “Probability analysis for grasp planning facing the field of medical robotics,” Measurement, vol. 141, pp. 227–234, 2019.
View at: Publisher Site | Google Scholar
G. Ritzer, “Hospitality and prosumption,” Research in Hospitality Management, vol. 5, no. 1, pp. 9–17, 2015.
View at: Publisher Site | Google Scholar
P. Alexis, “R-tourism: introducing the potential impact of robotics and service automation in tourism,” Ovidius University Annals, Economic Sciences Series, vol. 17, no. 1, pp. 211–216, 2017.
View at: Google Scholar
J. Crook, “Starwood introduces robotic butlers at aloft hotel in cupertino,” 2014, https://techcrunch.com/2014/08/13/starwood-introduces-robotic-butlers-at-aloft-hotel-in-palo-alto/.
View at: Google Scholar
Guardian, “Japan’s robot hotel: a dinosaur at reception, a machine for room service,” 2015, https://www.theguardian.com/world/2015/jul/16/japans-robot-hotel-a-dinosaur-at-reception-a-machine-for-room-service.
View at: Google Scholar
Hilton, “Hilton and IBM pilot “connie,” the world’s first watson-enabled hotel concierge,” 2016, http://newsroom.hilton.com/index.cfm/news/hilton-and-ibm-pilot-connie-the-worlds-first-watsonenabled-hotel-concierge.
View at: Google Scholar
HotelManagement.net, “WYNN las vegas adds amazon echo to all guestrooms,” 2016, http://www.hotelmanagement.net/tech/wynn-lasvegas-adds-amazon-echo-to-all-hotel-rooms.
View at: Google Scholar
C. L. Liang, “Future hotel is coming, Alibaba opens the first unmanned hotel,” Jing Rong Ke Ji Shi Dai, vol. 11, p. 91, 2018.
View at: Google Scholar
C. Dirican, “The impacts of robotics, artificial intelligence on business and economics,” Procedia—Social and Behavioral Sciences, vol. 195, pp. 564–573, 2015.
View at: Publisher Site | Google Scholar
C. B. Frey and M. A. Osborne, “The future of employment: how susceptible are jobs to computerisation?” Technological Forecasting and Social Change, vol. 114, pp. 254–280, 2017.
View at: Publisher Site | Google Scholar
H. Osawa, A. Ema, H. Hattori et al., “What is real risk and benefit on work with robots? From the analysis of a robot hotel,” in Proceedings of the Companion of the 2017 International Conference on human-robot interaction, ACM/IEEE, Vienna, Austria, March 2017.
View at: Publisher Site | Google Scholar
C.-M. Kuo, L.-C. Chen, and C.-Y. Tseng, “Investigating an innovative service with hospitality robots,” International Journal of Contemporary Hospitality Management, vol. 29, no. 5, pp. 1–17, 2017.
View at: Publisher Site | Google Scholar
B. B. Stringam and J. H. Gerdes, “The automation of service in the hotel industry,” in Proceedings of the Global Conference on Services Management (GLOSERV 2017), Volterra, Italy, October 2017.
View at: Google Scholar
J. Murphy, U. Gretzel, and J. Pesonen, “Marketing robot services in hospitality and tourism: the role of anthropomorphism,” Journal of Travel & Tourism Marketing, vol. 36, no. 7, pp. 784–795, 2019.
View at: Publisher Site | Google Scholar
J. Murphy, C. Hofacker, and U. Gretzel, “Dawning of the age of robots in hospitality and tourism: challenges for teaching and research,” European Journal of Tourism Research, vol. 15, pp. 104–111, 2017.
View at: Google Scholar
T. Haidegger, M. Barreto, P. Gonçalves et al., “Applied ontologies and standards for service robots,” Robotics and Autonomous Systems, vol. 61, no. 11, pp. 1215–1223, 2013.
View at: Publisher Site | Google Scholar
E. Zalama, J. G. García-Bermejo, S. Marcos et al., “Sacarino, a service robot in a hotel environment,” ROBOT2013: First Iberian Robotics Conference, Advances in Intelligent Systems and Computing, vol. 253, Springer, Cham, Switzerland, 2014.
View at: Publisher Site | Google Scholar
M. J.-Y. Chung, J. Huang, L. Takayama, L. Takayama, T. Lau, and M. Cakmak, “Iterative design of a system for programming socially interactive service robots,” Social Robotics, vol. 9979, Springer, Cham, Switzerland, 2016.
View at: Publisher Site | Google Scholar
Y.-H. Chin, H.-P. Lee, C.-W. Su et al., “A framework design for human-robot interaction,” in Advanced Technologies, Embedded and Multimedia for Human-Centric Computing, vol. 260, pp. 1043–1048, Springer, Dordrecht, Netharlands, 2014, Lecture Notes in Electrical Engineering.
View at: Publisher Site | Google Scholar
Y. Zhang, X. Wang, X. Wu, W. Zhang, M. Jiang, and M. Al-Khassaweneh, “Intelligent hotel ROS-based service robot,” in International Conference on Electro Information Technology (EIT), IEEE, Brookings, SD, USA, May 2019.
View at: Publisher Site | Google Scholar
J. López, D. Pérez, E. Zalama, and J. Gómez-García-Bermejo, “BellBot—a hotel assistant system using mobile robots,” International Journal of Advanced Robotic Systems, vol. 10, no. 1, pp. 40–52, 2013.
View at: Publisher Site | Google Scholar
M. S. Chtourou and N. Souiden, “Rethinking the TAM model: time to consider fun,” Journal of Consumer Marketing, vol. 27, no. 4, pp. 336–344, 2010.
View at: Publisher Site | Google Scholar
C. Grönroos and A. Ravald, “Service as business logic: implications for value creation and marketing,” Journal of Service Management, vol. 22, no. 1, pp. 5–22, 2011.
View at: Publisher Site | Google Scholar
C. Morosan and A. DeFranco, “Co-creation of value using hotel interactive technologies: examining intentions and conversion,” International Journal of Contemporary Hospitality Management, vol. 31, no. 3, pp. 1183–1204, 2019.
View at: Publisher Site | Google Scholar
A. Scherer, N. V. Wünderlich, F. von Wangenheim, University of Paderborn, and E. T. H. Zürich, “The value of self-service: long-term effects of technology-based self-service usage on customer retention,” MIS Quarterly, vol. 39, no. 1, pp. 177–200, 2015.
View at: Publisher Site | Google Scholar
M. Barrett, University of Cambridge, E. Davidson et al., “Service innovation in the digital age: key contributions and future directions,” MIS Quarterly, vol. 39, no. 1, pp. 135–154, 2015.
View at: Publisher Site | Google Scholar
D. Kindström, C. Kowalkowski, and E. Sandberg, “Enabling service innovation: a dynamic capabilities approach,” Journal of Business Research, vol. 66, no. 8, pp. 1063–1073, 2013.
View at: Publisher Site | Google Scholar
Y. Zhang and S. Qi, “User experience study: the service expectation of hotel guests to the utilization of ai-based service robot in full-service hotels,” in HCI in Business, Government and Organizations. eCommerce and Consumer Behavior, F. H. Nah and K. Siau, Eds., vol. 11588, Springer, Cham, Switzerland, 2019, Lecture Notes in Computer Science International Conference on Human-Computer Interaction.
View at: Publisher Site | Google Scholar
S. H. Ivanov and C. Webster, “The robot as a consumer: a research agenda,” in Proceedings of the Marketing: Experience and Perspectives Conference, pp. 71–79, University of Economics-Varna, Bulgaria, June 2017.
View at: Google Scholar
Y. Choi, M. Choi, M. Oh, and S. Kim, “Service robots in hotels: understanding the service quality perceptions of human-robot interaction,” Journal of Hospitality Marketing & Management, pp. 1–23, 2019.
View at: Publisher Site | Google Scholar
Y. Kim and H. S. Lee, “Quality, perceived usefulness, user satisfaction, and intention to use: an empirical study of ubiquitous personal robot service,” Asian Social Science, vol. 10, no. 11, pp. 1–16, 2014.
View at: Publisher Site | Google Scholar
R. Pinillos, S. Marcos, R. Feliz, E. Zalama, and J. Gómez-García-Bermejo, “Long-term assessment of a service robot in a hotel environment,” Robotics and Autonomous Systems, vol. 79, pp. 40–57, 2016.
View at: Publisher Site | Google Scholar
C.-M. Kuo, L.-C. Chen, and C.-Y. Tseng, “Investigating an innovative service with hospitality robots,” International Journal of Contemporary Hospitality Management, vol. 29, no. 5, pp. 1305–1321, 2017.
View at: Publisher Site | Google Scholar
C. Bartneck, T. Kanda, O. Mubin, and A. Al Mahmud, “Does the design of a robot influence its animacy and perceived intelligence?” International Journal of Social Robotics, vol. 1, no. 2, pp. 195–204, 2009.
View at: Publisher Site | Google Scholar
S. Melián-González and J. Bulchand-Gidumal, “A model that connects information technology and hotel performance,” Tourism Management, vol. 53, pp. 30–37, 2016.
View at: Publisher Site | Google Scholar
J. Nakanishi, I. Kuramoto, J. Baba, O. Kohei, Y. Yoshikawa, and H. Ishiguro, “Can a humanoid robot engage in heartwarming interaction service at a hotel?” in Proceedings of the 6th International Conference on Human-Agent Interaction, Southampton, UK, December 2018.
View at: Publisher Site | Google Scholar
J. Hudson, M. Orviska, and J. Hunady, “People’s attitudes to robots in caring for the elderly,” International Journal of Social Robotics, vol. 9, no. 2, pp. 199–210, 2017.
View at: Publisher Site | Google Scholar
H. Yan, M. H. Ang, and A. N. Poo, “A survey on perception methods for human-robot interaction in social robots,” International Journal of Social Robotics, vol. 6, no. 1, pp. 85–119, 2014.
View at: Publisher Site | Google Scholar
M. Pino, M. Boulay, F. Jouen, and A. S. Rigaud, ““Are we ready for robots that care for us?” attitudes and opinions of older adults toward socially assistive robots,” Frontiers in Aging Neuroscience, vol. 7, p. 141, 2015.
View at: Publisher Site | Google Scholar
Z. Huang, X. Xu, H. Zhu, and M. Zhou, “An efficient group recommendation model with multiattention-based neural networks,” IEEE Transactions on Neural Networks and Learning Systems, 2020, in Press.
View at: Publisher Site | Google Scholar
X. Wu, C. Zhang, and S. Zhang, “Efficient mining of both positive and negative association rules,” ACM Transactions on Information Systems (TOIS), vol. 22, no. 3, pp. 381–405, 2004.
View at: Publisher Site | Google Scholar
R. Agrawal, T. Imieinski, and A. Swami, “Mining association rules between sets of items in large databases,” in Proceedings of the ACM SIGMOD International Conference on the Management of Data, P. Buneman and S. Jajodia, Eds., pp. 207–216, Washington, DC, USA, May 1993.
View at: Publisher Site | Google Scholar
G. Li, R. Law, J. Rong, and H. Q. Vu, “Incorporating both positive and negative association rules into the analysis of outbound tourism in Hong Kong,” Journal of Travel & Tourism Marketing, vol. 27, no. 8, pp. 812–828, 2010.
View at: Publisher Site | Google Scholar
C. Hu and P. Racherla, “Visual representation of knowledge networks: a social network analysis of hospitality research domain,” International Journal of Hospitality Management, vol. 27, no. 2, pp. 302–312, 2008.
View at: Publisher Site | Google Scholar
S. P. Borgatti, M. G. Everett, and J. C. Johnson, Analyzing Social Networks, Sage Publications Ltd., Thousand Oaks, CA, USA, 2013.
S. P. Borgatti, M. G. Everett, and L. C. Freeman, UCINET for Windows: Software for Social Network Analysis, Analytic Technologies, Lexington, KY, USA, 2002.

Copyright

Copyright © 2020 Lina Zhong et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

3868

Downloads

1464

Citations