Abstract
In view of the lack of objective data support for product evaluation methods in the industry, a triangular verification method was proposed; it considered nursing beds as the study object and combined subjective evaluation with eye movement and electroencephalogram. Because the triangular validation method is based on the numerical value between the indicators and the frequency of ranking, this method is worth investigating for analyzing experimental data more scientifically. This paper focuses on the further analysis of the experimental data, especially the use of interval estimation method. After analysis, we obtain that proposal 2 is the optimal solution. This method is more suitable for product evaluation which will collect large amount of experimental data to obtain more accurate results. For industrial product designers, the evaluation of products by users is very important. In the design stage, how to grasp the user’s evaluation of the product more accurately is a difficult problem. This paper takes nursing bed as the research object and studies the user participation design in order to make the product more acceptable to most people after it is launched.
1. Introduction
Nursing beds are designed as original ordinary steel beds, mechanical transmission beds, electric beds, or multifunctional beds. With the development of computer technology, development of multifunctional nursing beds is increasing. The development of multifunctional nursing beds is a breakthrough in realizing comprehensive nursing and is also an innovation in patient healthcare function [1]. With the development of information network, sensor, intelligent control, and bionic technology as well as the intersection of electromechanical technology and biotechnology, the development direction of multifunctional nursing bed is networking, digitalization, and intellectualization [2, 3]. The higher the level of medical treatment, the greater the pursuit of living standards and quality. Users not only require basic functions, safety, and practicality of the product but also pay more attention to comfort, aesthetics, and emotion of the product [4, 5]. However, the design of medical beds is obviously lacking in terms of Kansei engineering [6, 7]. As a result, patients not only suffer from illnesses but also feel inconvenienced due to unreasonable designs [8]. It is extremely important to improve and promote the design of medical beds for patients. In recent years, most studies on nursing beds focus on function and user experience. The research on function focuses on solving problems of patients and nurses when using nursing beds. For example, Enoi et al. [9] designed a smart bed to help nurses move overweight patients slowly and smoothly from the bed to other places. In addition, Takanokura et al. developed a systematic approach to use sensors around the nursing bed to prevent falls and secondary injuries.
The evaluation of nursing beds also focuses on functionality. Boorman et al. [10] assessed the value of a “Clinitron” air-fluidized bed in the setting of a general plastic surgery unit by using pressure sensor data in 1981. Milward et al. [11] put forward the Walsall scoring system, which was designed with community patients in mind; it was later improved by Chaloner and Franks [12]. A scoring system is typically used to evaluate the medical system for both hospital and community staff. Some researchers pay more attention to decompressing equipment such as the mattress of the nursing bed, which can also be called a pressure-reducing foam mattress (PRFM); they evaluated the role of PRFMs [13–15]. They also focused on the evaluation of long-term clinical efficacy of PRFMs and found that PRFMs perform well after 3 and 4 years, respectively, in two different clinics [16]. In 2016, Gray et al. not just evaluated PRFMs but also electric bed frames [17]. All these studies focus on the functionality of equipment and the extent to which it can reduce the physical workload of nurses and improve the dignity and comfort of patients.
In terms of a product evaluation system, the current evaluation method is mainly based on expert opinions combined with random sampling. Subjective factors are major contributors in this evaluation method; it is impossible to determine whether the obtained evaluation is a true evaluation. Therefore, in a previous article, a triangular verification method, by combining subjective evaluation, electroencephalogram (EEG) data, and eye movement data, was proposed for a more convincing evaluation method [18].
Based on Kansei engineering [19], the psychological and physiological data collected from the experiment were combined, i.e., subjective evaluation, eye movement, and EEG data; a triangular validation system of nursing bed, which is based on the fact that there is correlation between subjective evaluation, eye movement, and EEG data, was established. The specific execution process is shown in Figure 1.
In Figure 1, we first identify the purpose of the evaluation, which is proposing four nursing bed designs. Participants were selected, and the Likert scale method [20] was used to obtain the subjective evaluation, eye movement, and EEG data synchronously using an instrument. Finally, the four proposals were ranked in terms of subjective evaluation, eye movement data, and EEG data; the final results were verified to improve the reliability of subjective evaluation. The four proposed nursing beds are marked as C1, C2, C3, and C4 as shown in Figure 2.
The experimental method is shown in Figure 3. Tobii X3-120 [21], a small eye movement tracking instrument developed by Sweden Tobii Company, was used in the experiment; its accuracy is 0.2 degrees and the sampling rate is 120 Hz. It can provide portability and large head movement range and ensure high-quality tracking accuracy and stable tracking. The EEG signal acquisition instrument used in the experiment was NeurOne innovative research system produced by Mega Electronics, USA. It has 24-bit analog-to-digital conversion with sensitivity of 51 nV/bit and input range of +430 mV, and the 40-channel amplifier includes 32 EEG+8 bipolar channels. This neuroscience measurement system provides a more accurate and cleaner signal, faster sampling, modular solutions, use of the latest processing in digital signal processing, more flexibility, and scalability.
Data were obtained from 20 participants with normal vision. All the data in this experiment were obtained according to relevant standards. The experimental process is as follows: (1)Participants washed their hair with shampoo and dried it(2)Participants watched and understood the experimental guidance and signed the statement(3)Researchers prepared experimental instruments(4)Researchers explained the experimental process to the participants(5)At the beginning of the experiment, participants looked at the first randomly occurring proposal of the medical nursing bed and scored by pressing a button from 1 to 5 (1—worst; 2—worse; 3—normal; 4—better; 5—best). When the participants press the button, the first rendering experiment ends and the second rendering experiment begins until all the experimental materials are completed. To ensure the effectiveness of the experiment, after the first round of grading, four proposals will be played randomly. The experiment was repeated 50 times(6)After the experiment was completed, the eye tracker and brain instrument stopped recording
The experimental procedure is shown in Figure 4.
According to the experiment, we obtain the following data: (1)The expected value of 20 people’s subjective evaluation is
represents the expected value of the subjective evaluation of proposal and represents the expected value of participant ’s subjective evaluation of proposal ; the calculation process is as follows: (2)The expected value of 20 people’s eye movement data is
represents the expected value of the fixation time for proposal () marked as e1. represents the expected value of the number of fixations for proposal () marked as e2. represents the expected value of the first fixation time for proposal () marked as e3; the calculation process is as follows: (3)The expected value of 20 people’s EEG data is
represents the expected value of index of EEG data for proposal (). In this experiment, the observed electrodes and overlapping topographic maps are shown in Figure 5. According to the brain topographic map, 11 electrodes were selected in the most active area, named F4, F7, F8, FZ, FC1, FC2, FC5, FC6, ft9, ft10, and F3; therefore, in this experiment, .
Based on the above analysis, we can obtain matrix as follows:
The final data obtained are as follows:
The correlation analysis of the data is carried out, and the results are shown in Tables 1–3.
It can be seen from the table that there is a certain correlation between subjective evaluation data, eye movement data, and EEG data. The first fixation time was negatively correlated with other indicators because the shorter the first fixation time, the more attention the participants paid, and vice versa.
Then, we need to analyze the results in terms of three different factors, namely, subjective evaluation, eye movement, and EEG data. First, proximity analysis is carried out.
Procedure 1. To calculate the maximum and minimum of each evaluation index.
Procedure 2. To calculate the distance from the maximum to minimum of each proposal.
Procedure 3. To calculate relative closeness of evaluative value and maximum value for each program.
We use the relative closeness of evaluative value and maximum value for each proposal as the foundation of the final evaluation for the design proposal.
Through the above steps, we can obtain the results of the close degree analysis data as shown in Table 4. Because the first fixation time is negatively related to other indicators, the smaller the value, the closer will be the ranking.
Then, we use the frequency statistics method for the three factors and obtain the final ranking method according to the frequency of the four rankings. The specific calculation formula is as follows:
The frequency of proposal appearing in the ranking is the number of effective evaluation indexes in different dimensions. In this paper, in the subjective evaluation dimension , in the eye movement evaluation dimension , and in the EEG evaluation dimension ; is the frequency of proposal appearing in the ranking. The specific frequency of the four proposals under different dimensions and ranking is shown in Tables 5–7.
From Tables 5–7, we can see that from the perspective of subjective evaluation, the ranking is C2>C1>C3>C4; from the perspective of eye movement data, the ranking is C2>C1>C4>C3; from the perspective of the EEG evaluation data, the ranking is C2>C1>C4>C3. We can see that from the three dimensions, which are subjective valuation, eye movement data, and EEG objective data to evaluate the four proposals, sorting results are the same. The triangular validation was passed, indicating that the experimental subject evaluation is highly reliable.
Because the original triangular validation method mainly relies on the size of the data value to arrange the data, which is not convincing to a certain extent, there is contingency; therefore, this study focuses on data processing, especially of the confidence interval validation method used in data analysis. We assume that the reader is familiar with the basic notions of statistical theory.
2. Methods
According to central limit theorem [22], for independent random variables, when the number is large, the data distribution follows a normal distribution. Then, according to the correlation and significance between the fifteen indicators of this experiment, F3 was selected as the specific analysis index.
The specific data of proposal 1 of the F3 indicator are as follows: .
The box diagram of the F3 index is shown in Figure 6. Because the experimental data of participant 7 and participant 16 deviated too much from other data, the data of these two individuals was rejected [23].
The final data and sample size , sample mean , sample standard deviation , and sample variance are shown in Table 8.
According to Table 8, we know the specific data, sample average, and sample variance of F3-i (). According to central limit theorem [22], F3-1 to F3-4 follows normal distribution approximately. Population average and population variance are unknown. (Formulas (13)–(15) and (17)–(20) are quoted from references [22–27].) First, we analyze F3-1 and F3-2. We need to find a confidence interval with a confidence level of 0.90 for the variance ratio [23]. From Table 8, we know , , , , and .
The distribution has the following theorem:
Distribution does not depend on any unknown parameters. Taking as the pivot amount, we can obtain the following formula:
Thus, we get a confidence interval of with a confidence level of :
According to the data table of distribution, we can find that , . According to the above formula, it can be concluded that the confidence interval of is as follows:
that is, .
Because the confidence interval contains 1, we can assume that and are not significantly different. Similarly, we can conclude that there is no significant difference between the variance of the two proposals as shown in Table 9.
Based on the above analysis, we may consider the variance of each set of data to be equal and assume that the population variance of each data is equal. Next, we will verify the confidence interval of the population mean difference [28]. We take and as examples. We already know that and . Due to their independence, we know that
or it can be written as
A confidence level of is obtained when is chosen as a pivotal quantity, and the confidence interval of is
Although and are unknown but from formulas (12)–(15), we know that ; so we can prove that
In this formula, .
According to Table 8, we know that , and , . We want to verify the confidence interval with a confidence level of 0.95 for the two population mean difference . We know , , , , , , , and .
Based on the above formulas, we can obtain the confidence intervals as
that is, .
Because the lower bound of the confidence interval is greater than zero, can be considered to be greater than . Thus, we can infer that according to the F3 index, proposal 2 is better than proposal 3. Similarly, other results are shown in Table 10.
Similarly, in proposal 3, proposal 1, and proposal 4, the lower bound of confidence interval is lower than zero; therefore, we can conclude that according to the F3 index in this analysis method, there is no significant difference between proposal 3, proposal 1, and proposal 4.
3. Results
The same analysis method was adopted to verify the other 14 indexes; the nine indicators cannot draw a clear conclusion. Specific conclusions are shown in Table 11. According to the F8 index and FZ index, we can conclude that proposal 2 is better than proposal 1, and proposal 2 is better than proposal 3. According to the FT10 index, we can conclude that proposal 2 is better than proposal 1, proposal 3, and proposal 4.
According to the data obtained, we can see that proposal 2 is better than the others, that is, proposal 2 is the best, which is consistent with the previous conclusion.
4. Conclusions
In this study, we improved the way of data comparison in the triangular validation method. We apply the confidence interval in statistics to the analysis model and improve the problem of previous data comparison which is being too simple. Because less amount of data is collected in this experiment, a definite result cannot be acquired from a single indicator. However, according to statistical theory, when the number of data sample is large, the model constructed will draw a clear conclusion. This study shows that mathematical statistics can be well used in product evaluation and that triangular evaluation is deepened to make the evaluation model more convincing and applicable. With the development of intelligent wearable equipment, data acquisition will become more convenient in the future. Therefore, this evaluation model should have an extensive application and research value. We hope that more mathematical and statistical knowledge will be used for product evaluation to promote the development of industrial evaluation systems. Next, we will analyze the product evaluation in industrial design and guide the product design process through the analysis of a large number of data.
Data Availability
No data were used to support this study.
Conflicts of Interest
The authors declare that they have no conflicts of interest.
Acknowledgments
The work presented in this paper is supported by Shanghai Multidirection Die Forging Engineering Technology Research Center (No. 20DZ2253200), National Key R&D Program—Research on Modernization of Traditional Chinese Medicine (2018YFC1707802), and science and technology support project in biomedical field of “Science and Technology Innovation Action Plan” of Shanghai in 2019 (No. 19441914900).