Abstract

Insecticide-treated bednets (ITNs) are a mainstay of malaria prevention, yet poor adherence poses a major barrier to effective prevention. Self-reports of bednet use suffer from recall and social desirability biases. We have designed a device that electronically records ITN usage longitudinally. SmartNet consists of circuits made from a conductive fabric interwoven into the sides and top of a rectangular ITN. Digital sampling of the state of these circuits allows for determining whether the SmartNet is deployed for use or folded up. We conducted a study among pregnant women and women with children <5 years in Uganda to determine attitudes about objective bednet monitoring and SmartNet. Fifty women were interviewed with an average age of 27 years and 2.3 children. Twenty-two percent were pregnant. Ninety-five percent had used a bednet and 90% reported having a bednet at home. After displaying a SmartNet, 92% thought it would be easy to use and 100% expressed interest in using SmartNet. Concerns about SmartNet included washing the net, worries about being monitored while asleep, and worries about users removing the device components. Objective monitoring of ITN use appears to be acceptable among women in rural Uganda, setting the stage for further SmartNet field testing.

1. Introduction

Approximately 3.4 billion people live at risk of malaria infection throughout the world and most of the more than 600,000 annual malaria-related deaths occur among Sub-Saharan African children under five years of age [1]. The United Nations Development Goals target a 75% reduction in malaria by 2015 [2]. Insecticide-treated bednets (ITNs) are a cost-effective means of malaria prevention [1, 3]. Ownership of an ITN reduces mortality by 18–23% [4], saving 5.5 lives per year for every 1000 ITNs distributed [5]. In 2013, the World Health Organization (WHO) recommended that free bednets be made available universally for anyone at risk of malaria [6].

Despite the acceptance of bednets as effective tools for malaria prevention, there are still significant questions about the factors that influence household decisions to use bednets [7]. Most studies assessing the determinants of bednet use rely on self-reports from households and individuals [812]. However, self-reported use may be prone to both social desirability and recall biases [13], which compromise both our understanding of barriers to bednet use and estimates of the true cost-effectiveness of bednets as a malaria prevention tool. The effects of these biases due to self-reporting on estimates of bednet use are not well defined in the literature, as there are very few studies which explicitly discuss the discrepancy between self-reports and more objective measures [1416].

Compared to asking individuals or household representatives about their bednet use, more objective means of measuring bednet use have been attempted but are problematic. Spot checks during sleeping hours [1719], while the most accurate, are invasive and unlikely to be acceptable to most populations. Visually confirming that bednets are mounted above sleeping areas in households [2024] is also invasive, requiring entry into households, and does not ensure that a bednet is actually being unfurled at night.

Real-time logging of bednet use for later analysis offers the possibility for more precise understanding of bednet use behaviors, in terms of both accuracy and temporal resolution, with less invasion than visual observation of use [25]. Furthermore, objective bednet use monitoring will be a key to understanding malaria epidemiology and prevention as mosquito biting behavior is known to change with bednet usage [26]. With these advantages of objective monitoring in mind, we have developed SmartNet, an electronic monitor of bednet use. SmartNet uses a microprocessor and conductive fabric sewn into a WHO-approved bednet in order to detect whether a bednet is unfurled or not. The unfurling of the bednet in a household is taken as a proxy of bednet use and, conversely, the folding up of the bednet is assumed to be a proxy of nonuse. The conductive material can be integrated into any size bednet. For this study, SmartNet components were integrated into white rectangular () bednets bought from a local pharmacy (~$12). The conductive fabric is sewn to form three distinct electric circuits that make contact with each other when the bednet is folded or tied up for storage. A microprocessor sends an electrical current every 15 minutes to check circuit connectivity, allowing the SmartNet to distinguish between a net in use or not. Time-stamped data is stored on a removable memory card for later analysis (Figures 1, 2, and 3).

SmartNet is being actively developed through a collaboration between engineers and health professionals at Massachusetts General Hospital in Boston, MA, USA, and the Mbarara University of Science and Technology (MUST) at the Consortium for Affordable Medical Technologies (CAMTech) innovation center in Uganda. Development of SmartNet exemplifies a cocreation model for development of health technologies in developing countries [27]. Cocreation engages the end-users of technologies in developing countries to become innovators themselves through top-to-bottom involvement across the product development lifecycle.

It is envisioned that SmartNet could be utilized as a research tool for obtaining reliable measures of longitudinal bednet use in target populations or as a sampling tool to validate other forms of assessing bednet use, that is, self-reports. As a first step to understand the feasibility and acceptability of electronic bednet use monitoring, we examined the attitudes about SmartNet among mothers of young children and among pregnant women in malaria-endemic rural Uganda. After introducing the women to a model SmartNet and explaining its functionality, we conducted quantitative and semistructured qualitative interviews focused on impressions of SmartNet and attitudes about objective bednet monitoring.

2. Methods

This study was conducted in southwestern Uganda at the Kinoni Health Center IV in Rugando Subcounty, Mbarara District. The health center, located 5 kilometers from Mbarara Town, serves about 110 patients per day, most of whom are rural subsistence farmers. Malaria is endemic to the region and makes up an estimated 20% of outpatient visits (16–25 visits/day) to the Kinoni Health Center.

We recruited 50 participants from July to August 2014. The number of participants was based on an attempt to capture the range of experiences with bednets and attitudes about SmartNet and electronic bednet monitoring. Participants were identified among patients waiting to see health providers at the clinic. They were invited to participate in the study after their clinic visit was complete. A room was set aside for confidential study visits. Informed consent was gathered from all participants before proceeding to the study interviews. Since our study focused on those at most risk of malaria, we recruited women to participate in the study if they were mothers of at least one child aged five years or younger or were currently pregnant. These recruitment criteria also allowed for selection of a study sample which is familiar with bednets, as our previous work suggests that households with young children are more likely to own and use bednets [28]. Participants were informed that their participation in this study would not affect future inclusion in SmartNet-related studies. No incentive was provided for participation. All consents and surveys were translated into Runyankole, the local language. All participants signed a written informed consent to participate. Participants were given the option to complete the survey in either English or Runyankole. In order to maintain consistency of interpretation of qualitative responses, a single research assistant (Nuriat Nambogo), who is fluent in Runyankole and English, conducted all interviews.

Participants received a structured interview to collect data on age, marital status, number of children, pregnancy status, education and literacy, employment, and average monthly income. Then they answered a questionnaire relating to their prior experience with antimalarial bednets, current use of bednets, frequency of household bednet use, and their opinions about the ease of use of bednets. Our prior work suggests that knowledge about malaria is a significant indicator of bednet use within a household [29]. All participants were shown a SmartNet, which was hanging in the interview room, and its components and functionality were described before participants were asked SmartNet-specific qualitative questions.

Participants answered open-ended questions about their impressions of SmartNet, their “likes” and “dislikes” about the device, individual concerns, and anticipated concerns about the device from the viewpoint of others within their household. This final line of questioning, from the viewpoint of others in the household, provided a level of abstraction in order for participants to provide honest comments without violating social norms. The responses were written on the survey sheet for later translation and coding. Themes were derived from a sample of qualitative responses to each question, and then each survey was coded independently by two members of the research team (Jeffrey I. Campbell and Nuriat Nambogo). Researchers discussed inconsistencies in coding, and when inconsistencies existed, a final code was established by consensus between the two coders or the primary author if consensus could not be reached.

All data were collected on paper forms and entered manually into the Research Electronic Data Capture (REDCap) tool hosted at Massachusetts General Hospital, Boston, MA, USA [30]. The data were cleaned following the completion of data entry. Quantitative data were analyzed in Stata 10 (Statacorp, College Rd, TX) and qualitative responses were reviewed and coded in Microsoft Excel.

3. Results

3.1. Demographic Characteristics

A total of 50 women were approached and all consented to participate. Participants had a mean age of 27 years and a mean of 2.3 children. Ten percent of the women had no children (5/50) and 8% (4/50) had more than two children under five years. Overall, twenty-two percent (11/50) of women reported being currently pregnant.

Fifty-four percent (27/50) of women had attended only primary school and 8% (4/50) had never attended school. Seventy-two percent (36/50) of women self-identified as farmers. The average self-reported monthly income was 162,250 Ugandan Shillings (UGX) (~$62.28) (range: 5,000 UGX to 1,500,000 UGX) (Table 1).

3.2. Bednet Ownership and Use

Ninety percent (45/50) of women reported that their household currently owned at least one bednet and 80% (40/50) reported that at least one bednet in their household was in use the night before the survey. Seventy-six percent (38/50) of women reported that a bednet was in use every day in the previous week by at least someone in their household. Eighty-four percent (42/50) reported that their household’s ability to use bednets as directed was good or very good and 8% (4/50) reported their household’s ability as poor or very poor. The households owned an average of 2.42 bednets (range: 1 to 6) (Table 2).

Self-reported bednet use was high, with 96% (48/50) of respondents reporting that they had used a bednet at some point in the past and 66% (33/50) reporting using a bednet every night in the previous week. Twenty percent (10/50) did not use a net at all in the last week and 14% (7/50) had not used a net in the last month. Among women who had ever used bednets, greater than 80% reported that bednets were easy or very easy to use and easy or very easy to remember to use. However, 14.6% (7/48) of ever-users reported that they were difficult to use and 10.4% (5/48) reported that they were difficult to remember to use. Reasons for not using bednets included excessive heat while under the net, traveling away from home or not owning enough nets.

3.3. Impressions of the SmartNet Device

All participants (50/50) said they would be interested in using the SmartNet in their homes. In open-ended responses, reasons that women gave included liking the appearance of the SmartNet, thinking the net would be useful and wanting to have a new net. Ninety-two percent (46/50) reported that they thought the device would be easy to use (Table 3). Notably, many of the responses to the question “are there particular things you like about the SmartNet?” pertained to nets in general and were independent of monitoring. For instance, many participants reported that they would like new nets because their current nets were old or had holes in them.

When queried about how their behavior would change in response to using SmartNet, 32% (16/50) of women reported that the SmartNet would not change their net use. No participants stated that their net use would decrease. Of the 68% (34/50) who reported an anticipated increase in net use, reasons included the fact of being monitored, being reminded by the device to use the net, and the attractive appearance of the net.

While the majority of responses to the SmartNet demonstration were positive, some participants offered suggestions or negative impressions of the net. Themes included fear of the device, perceived dislike of being studied when use of bed net is not as directed and dislike of home-visits to check on the net.

3.4. Perceptions of Objective Monitoring of Bednet Use

The majority of participants did not express personal concerns with objective monitoring. When participants were asked “how would you feel knowing that your bednet use is being monitored by the SmartNet?” ninety percent (45/50) of participants reported that they did not believe their family members would be worried about being monitored by SmartNet (Table 4).

When they did mention concerns, participants focused on monitoring of behaviors, including sleeping behaviors, while in bed at night:

“I would think that the device is recording me while in bed with my husband.”

“I would be thinking every time they are looking at me and measuring me while in my bed.”

More participants described how other people might be concerned with monitoring compared to those who reported being concerned themselves. Some other concerns focused around fear of detecting net misuse:

“Some people may not like to be monitored, especially those that at times do not use their nets.”

“For people who get discomfort with heat at night and they remove their nets, they may fear to do this because of being monitored.”

Several participants reported that monitoring would help them to improve their net usage and said they would appreciate feedback that the net could provide. For instance, one participant noted that the desire to “get good results” would help her to improve her net use. A few participants also mentioned the perceived benefits of participating in a research study involving SmartNet, including frequent interaction with study staff.

4. Discussion

In this mixed-method survey, mothers and pregnant women in rural Uganda, who were well acquainted with bednets, expressed favorable views regarding using SmartNet for objective monitoring of their households’ bednet use. While a minority of participants expressed concern about being monitored at night while they slept, all participants were nevertheless willing to use a SmartNet in their home.

SmartNet was developed out of a concern that self-reported use of bednets is inaccurate and temporally imprecise. Most studies of bednet use rely on self-reported use. While some studies have relied on more objective measurements to reduce bias, the majority of these have been one-time assessments with visual observation of hanging bednets or individuals under bednets. Since effective malaria prevention requires consistent correct bednet use to protect against mosquitoes every night, one-time surveys of use are unable to capture a temporally complete adherence record. The ideal adherence monitor for bednet use must capture nightly adherence data. We are aware of only one other study that has used an objective, nightly adherence tool [21]. This study found that reports of use the night before correlated well with objective use data from a motion detector. However, there were significant discrepancies in reports about net use a week prior and 2–4 weeks prior, confirming the presence of recall bias. This study did not report on the views of participants about the monitoring of their bednet use.

While multiple studies have used qualitative methods to examine perceptions of malaria and bednet use throughout Sub-Saharan Africa [31, 32], we are unaware of any study which has made as its primary aim the exploration of study subjects’ attitudes towards objective monitoring of bednet use. Perceptions of the monitoring itself are particularly important when developing tools for electronic adherence monitoring, in order to understand how a tool will be used and to ensure that monitoring is culturally acceptable.

An important question is whether the monitoring itself will change behaviors. This is the well-known “Hawthorne effect,” whereby individuals modify their behavior merely as a result of being monitored. For instance, women in the study reported that they thought the use of SmartNet would improve their regular use of bednets in a desire to “get good results.” Determining how objective bednet monitoring influences bednet behavior is an important area of future research.

Data gathered in our study highlighted several areas for design modifications for SmartNet and for similar objective bednet monitors. In particular, participants reported a fear that the uncovered logging device for capturing use data could be damaged. Future improvements could include better protection and concealment of the logging device. In addition, some participants reported a dislike of household visits to gather net use data. Improvements in battery life or, potentially, wireless transmission of data, could mitigate this concern. Predeployment studies such as this one are crucial components of a cocreation ethic [22], whereby real-time data about user impressions of technologies are fed back into design improvements. Further refinements of the SmartNet device are already underway in Uganda at the CAMTech Innovation laboratory (http://www.massgeneralcenterforglobalhealth.org/camtech/) offering an enhanced responsiveness to local views of the SmartNet technology.

There are several limitations of this study. The participants did not actually use the SmartNet, so these results are perceptions of participants based on theoretical use. Further design improvement and perceptions data will come from acceptability components of longer field studies among households using SmartNet devices. Because of the focus on bednet use to prevent maternal and child malaria, men were not interviewed and may hold different views of bednets, objective monitoring of bednet use, and SmartNet in particular. Future studies will explore this in more detail. The responses to this predeployment attitudes survey could be prone to social desirability bias providing an overly positive impression of the device. Women were told before joining this study that their answers would make no difference in ultimately being chosen for use of a SmartNet in future studies. Nevertheless, some of the perceptions of SmartNet suggest that women indicated interest in SmartNet as a means of obtaining a free bednet, perhaps inflating the apparent acceptability of the technology. The study participants were drawn from a convenience sample of women visiting one health center in the community of interest and therefore the study results may suffer from selection bias related to this choice. Finally, SmartNet measures whether or not a bednet is unfurled but does not measure who is under the bednet or whether the bednet is in perfect use.

5. Conclusion

Objective monitoring of ITN use appears to be acceptable among women in rural Uganda. Concerns about monitoring focused on the appearance of the device and the idea of being monitored while sleeping. These results will inform SmartNet device improvements and set the stage for future field-based feasibility testing.

Ethical Approval

The study was approved by the Mbarara University of Science and Technology and the Partners Human Research Committee Institutional Review Boards.

All participants signed a written informed consent to participate.

Competing Interests

The authors declare no competing interests.

Authors’ Contributions

Paul J. Krezanoski, Data Santorino, Jeffrey I. Campbell, and David R. Bangsberg conceived the study; Paul J. Krezanoski, Data Santorino, Nuriat Nambogo, and Jeffrey I. Campbell designed the study protocol; Paul J. Krezanoski, Data Santorino, Jeffrey I. Campbell, and David R. Bangsberg carried out the analysis and interpretation of data; Paul J. Krezanoski drafted the manuscript; Data Santorino, Nuriat Nambogo, Jeffrey I. Campbell, and David R. Bangsberg critically revised the manuscript for intellectual content. All authors read and approved the final manuscript. Paul J. Krezanoski is the guarantor of the paper.

Acknowledgments

The SmartNet team wishes to thank the study participants, Dr. Robert Ssekimpi (the one in-charge of the Kinoni Health Center), and the Mbarara District Health Office for supporting this study. Additional thanks go to the student volunteers at MUST/CAMTech, the local tailors instrumental in preparing the SmartNet devices, and Michael Yang for assistance in preparing the manuscript for publication. This work was supported through generous support from the Thrasher Research Foundation Early Career Award (Paul J. Krezanoski) and the American Academy of Pediatrics Resident Research Grant (Paul J. Krezanoski).