Research Article | Open Access
Measuring Problematic Mobile Phone Use: Development and Preliminary Psychometric Properties of the PUMP Scale
This study aimed to develop and assess the psychometric properties of an English language measure of problematic mobile phone use. Participants were recruited from a university campus, health science center, and other public locations. The sample included 244 individuals (68.4% female) aged 18–75. Results supported a unidimensional factor structure for the 20-item self-report Problematic Use of Mobile Phones (PUMP) Scale. Internal consistency was excellent (). Strong correlations (, ) were found between the PUMP Scale and an existing scale of cellular phone dependency that was validated in Asia, as well as items assessing frequency and intensity of mobile phone use. Results provide preliminary support for the use of the PUMP Scale to measure problematic use of mobile phones.
Mobile phones (a.k.a., cellular telephones) have many perceived benefits, including increased accessibility and social connection, efficiency in the workplace, convenience, and improved safety. However, in recent years, there has been increasing public interest in the negative consequences of mobile phone use. In one Saudi Arabian study, 44.4% of participants related common health complaints such as headache, trouble concentrating, memory loss, hearing loss, and fatigue to their mobile phone use . Another Saudi Arabian study suggested that 3%-4% of mobile phone users exhibit problems such as tension, fatigue, sleep disturbance, and dizziness related to their mobile phone use, and over 20% complain of headaches . Accidents caused by distracted driving [3, 4] have been highlighted as a public health concern. In addition, anecdotal observation and media reports suggest that the number of self-professed “cell phone addicts” and compulsive users of “crack-berries” and other smartphones has increased as mobile phones have become ubiquitous. Public recognition of this phenomenon is reflected in the many websites and blogs addressing the issue, as well as numerous articles in the popular press describing cell phone addiction. Though stories have appeared in publications such as the New York Times , the Los Angeles Times , and http://www.forbes.com/  for many years, the academic literature surrounding problematic mobile phone use remains fairly limited, even when compared to other “behavioral addictions” such as pathological gambling, problematic internet use, and problem video gaming [8–10].
While “addiction” is a term commonly used and arguably overused in society, the conceptualization of addiction remains controversial even among researchers and clinicians who specialize in substance use disorders and addictive behaviors. Indeed, the Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition—Text Revision [DSM-IV-TR]  did not include a condition called “addiction.” Rather, it described substance abuse and substance dependence as distinct psychiatric disorders, and failed to include discussion of addictive behaviors that do not involve substance use. Furthermore, the recently released Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition (DSM-5) describes “substance use disorders” using the following 11 criteria: (1) use in larger quantities or over longer amounts of time than initially intended, (2) a desire to cut down or control use, (3) spending a great deal of time obtaining, using, or recovering from the substance, (4) craving, (5) recurrent substance use resulting in a failure to fulfill major role obligations, (6) continued use despite social/interpersonal problems, (7) neglect of other important activities because of substance use, (8) use in situations in which it is physically hazardous, (9) continued use of the substance despite adverse physical or psychological consequences associated with use, (10) tolerance, and (11) withdrawal symptoms .
Though the DSM-IV-TR and DSM-5 do not include any disorders related to the problematic use of technology, pathological gambling is included in DSM-IV as a diagnosable condition under the category of impulse control disorders not elsewhere classified , and in DSM-5 as the first “behavioral addiction.” Even though pathological gambling does not involve the use of a chemical substance, the similarities between the diagnostic criteria for substance use disorders and pathological gambling are striking. In general terms, both may be described as disorders involving loss of control over a compulsive, time- and resource-consuming behavior, which persists in the face of adverse consequences, with continued escalation of the behavior and/or withdrawal symptoms from reduction of the behavior.
Similarly, it was suggested as early as 1982 (i.e., well before the widespread use of mobile phones) that pathological use of technology may exist in the form of “technodependence” . The constructs of internet addiction and problem video gaming are gaining both clinical and empirical support [10, 14]. In addition, though problematic mobile phone use has not, to date, been recognized as a diagnosable condition, experts in the field are debating its inclusion as one . While evidence is scarce regarding a true “addiction” to mobile phones, data from recent studies suggest that some mobile phone users exhibit serious problematic behaviors analogous to the diagnostic criteria for substance use disorders or pathological gambling. These symptoms include preoccupation with mobile phone-based communication, excessive time or money spent on mobile telephones/communication plans, use of cellular devices in socially inappropriate or even physically dangerous situations (e.g., “texting” while driving an automobile), adverse effects on relationships, increased frequency or duration of mobile phone communication, and anxiety when separated from one’s telephone or when without an adequate cellular signal [16–19]. Given these findings, it seems plausible that the consequences and psychological dependence seen in problematic mobile phone use (like pathological gambling and problematic internet and video game use) seem to parallel substance use and dependence and may be important to consider as a potential diagnostic entity and target of intervention.
In order to evaluate the extent to which problematic mobile phone use may be related to other addictive behaviors, research is needed to clarify the construct. To date, research on problematic mobile phone use has been limited by the lack of validated diagnostic criteria or standardized assessment measures. For this study, we operationally defined “problematic mobile phone use” as any pattern of mobile phone use resulting in subjective distress or impairment in important areas of functioning. Given that some individuals have legitimate reason to use their mobile phone very frequently (e.g., for work obligations) and are able to do so without negative consequences, we believed it was important to distinguish “problematic” use from “very frequent” use. We expected rates of mobile phone use to be higher among individuals who exhibited symptoms of problematic mobile phone use, just as substance abusers generally tend to use substances in greater quantities/frequencies than nonabusers. However, as with substance use disorders, we did not feel that high frequency use should be considered a symptom of the condition. For this study, quantity of use was not included as a component of “problematic mobile phone use,” except that individuals’ subjective assessment of their use as excessive and troublesome was considered.
The purpose of the present study was to develop an English language measure of problematic mobile phone use symptoms, based on adaptations of the DSM-5 substance use disorder criteria. The study followed a similar methodology to that utilized in previous studies regarding behavioral addictions [10, 20]. Specifically, our overarching hypotheses for this study included the following.(1)Symptoms of problematic mobile phone use can be measured reliably and validly using a self-report questionnaire. (2)Scores on the preliminary measure of problematic mobile phone use developed for this study will correlate significantly with an existing measure of cellular phone “dependency,” which was validated on Asian samples. (3)Symptoms of problematic mobile phone use will correlate positively with frequency and intensity of mobile telephone usage.
All procedures were approved by the University of Florida Institutional Review Board. Participants were recruited for this study using several methods. First, flyers advertising the study were posted around the university campus, the health science center, and in public locations including a mobile phone store. Individuals who were interested in study participation called the research team to obtain a survey packet or to arrange a time to complete the survey. Second, university students were recruited for the study via announcements made in various undergraduate and graduate level courses. Questionnaires were passed out with a self-addressed, stamped envelope for participants to return the survey to the research team. Third, other participants learned of the study via word-of-mouth and made contact with members of the research team in order to participate. All surveys were completed anonymously. Completion of the full study questionnaire required 20–30 minutes, and no compensation was provided to study participants.
Data were collected from 244 individuals (68.4% female) who ranged in age from 18 to 75 years old ( years old, SD = 14.1 years). Participants were self-identified as Caucasian (74.4%), Hispanic/Latino (11.3%), Asian/Pacific Islander (9.2%), African American/Black (2.5%), or Other (2.5%). The sample included university students (37.7%), individuals employed full-time (32.6%), individuals employed part-time (17.4%), and individuals who were not currently employed or in school (12.2%). Annual income was reported by 86.5% of the sample and ranged from $0 to $190,000 (, SD = $35,587).
2.2.1. Problematic Use of Mobile Phones (PUMP) Scale
A pool of 69 potential items for the PUMP Scale was developed by the first author based upon (1) informal interviews with several self-identified “cell phone addicts” who contacted the first author to discuss their mobile phone usage, (2) adaptation of the DSM-IV criteria for substance use disorders, and (3) review of existing measures assessing consequences of excessive internet use. These items were reviewed by 4 undergraduate research assistants for clarity but were not specifically pretested to assess psychometric properties before the questionnaires were distributed. After reviewing the proposed criteria for substance use disorders in the DSM-5 , which was not yet published, the first and second authors together selected 22 items for inclusion in the scale. Item selection was guided by the rational method, with the authors together choosing the 2 items that best reflected each of the 11 substance use disorder criteria proposed by the DSM-5 Task Force on Substance-Related Disorders. All items were rated on a 5-point scale ranging from 1 = “strongly disagree” to 5 = “strongly agree.” Scale analysis was utilized to assess psychometric properties of the individual items and the scale as a whole. Further description of the scale is included in the results section.
2.2.2. Cellular Phone Dependence Tendency Questionnaire (CPDQ: )
The CPDQ was originally developed in Japan, to assess cellular phone “dependency” among Japanese university students. It was later translated from Japanese to Thai and was used to study high school and university students in Thailand . Kawasaki and colleagues also published an English translation of the CPDQ in the report of their research . For the present study, some items from this English translation were reworded slightly to more closely match the accepted local vernacular. The CPDQ is a 20-item self-report measure. Though it taps the domain of “cell phone addiction,” the CPDQ was not developed on the basis of either DSM-IV or DSM-5 criteria for substance use disorders and does not include items that would be considered reflective of “abuse” criteria per DSM-IV-TR guidelines. Rather, items solely assess respondents’ perceived dependence on their cellular phone (e.g., “I would feel worse if I lost my cellular phone than if I lost my wallet” and “I send text messages even during work or class”). Items are rated on a 4-point scale ranging from “not true at all” to “true.” The CPDQ has demonstrated good reliability and validity in non-English-speaking populations [18, 19, 22]. In addition, internal consistency for the current sample was excellent .
2.2.3. Cellular Phone Usage Questionnaire (CUQ)
The CUQ is a compilation of items assessing specific mobile phone usage patterns. It was developed for the present study as a general measurement of mobile phone use and does not attempt to distinguish excessive usage or identify consequences or symptoms associated with mobile phone use. Items assess the amount of time spent utilizing various components of cellular phones (e.g., phone minutes, text messaging, emailing, internet access, and video game play). Items are rated on a 6-point scale ranging from “never” to “constantly.” Participants also completed 3 self-assessment questions regarding perceptions of their mobile phone usage. Items are included in Table 1.
|CPDQ refers to the cell phone dependency tendency questionnaire.|
CUQ refers to the cell phone use questionnaire.
All CUQ item responses ranged from 1= never to 6= constantly.
All statistical analyses were conducted using PASW 17.0. In order to address isolated cases of missing data, mean substitution was utilized for subscales in which at least 80% of the data were complete.
3.1. Mobile Phone Use Patterns
Participants reported having a mobile phone for an average of 7.29 years (SD = 3.73, range = 0–20 years). The majority of respondents (88.8%) reported having a personal cellular phone with a monthly contract, 6.6% reported having a personal cellular phone with a prepaid contract, and 1.2% reported sharing a cellular phone with at least one other person. Of the sample, 3.3% of respondents denied having a cellular phone.
3.2. Reliability Analysis
The items of the proposed PUMP Scale were subjected to scale analysis. Results demonstrated that the 2 items assessing the DSM criterion “desire to cut down” (i.e., “I would feel relieved if I was somewhere that my cell phone did not work” and “I sometimes wish I could get rid of my cell phone”) had extremely low item total correlations (.05 and .15, resp.). After first considering their theoretical importance, it was decided that these items should be deleted from the final scale, as they did not appear to fit the overall construct of problematic mobile phone use. The final PUMP Scale demonstrated excellent internal consistency (20 items, ). Removal of any item would have resulted in a negative impact on the scale alpha. Items included in the final PUMP Scale are listed in Table 2.
|Note: item responses ranged from 1 = strongly disagree to 5 = strongly agree.|
3.3. Factorial Validity
A principal components analysis was utilized to assess the factor structure of the 20-item PUMP Scale. Results supported a one-factor solution, with factor loadings for all items ≥.48. The one-factor solution explained 49.05% of the variance, meeting Carmines and Zeller’s criterion . Analysis of the Scree plot also supported a one-factor solution , with the eigenvalue of the first component (9.86) far exceeding the eigenvalue of the second component (1.45), which was not significantly different from the remaining eigenvalues.
3.4. Convergent and Discriminant Validity Data
Scores on the PUMP Scale ranged from 20 to 82 (, SD = 16.11) out of a possible score of 100. Frequency counts for each item response are listed in Table 3. PUMP scores were compared to scores on the Cellular Phone Dependency Tendency Questionnaire (CPDQ), the Cell Phone Use Questionnaire (CUQ), and the self-assessment items. Results are listed in Table 1. It is noteworthy that PUMP Scale total scores were not associated with the length of time the individual has owned a mobile phone (Pearson , ns) or with the amount of money spent per month for mobile phone minutes (Pearson , ns). However, PUMP Scale scores were positively correlated with the amount of time spent engaging in any form of mobile phone use (see Table 1), as well as the amount of money spent for text messaging service (, ). As seen in Table 1, PUMP Scale scores also correlated positively with perceptions of excessive mobile phone usage, including self-reported feelings of “addiction” to the mobile phone.
The purpose of the present study was to develop and validate a self-report measure of problematic mobile phone use (i.e., “cell phone addiction”) for English-speaking respondents, based on criteria utilized for other addictive behaviors. Results indicated that problematic mobile phone use can be measured via self-report. The Problematic Use of Mobile Phones (PUMP) Scale demonstrated a single-factor structure, with excellent internal consistency. It also displayed convergent validity when compared to an existing measure of cellular phone dependency [the CPDQ ], items measuring the frequency and intensity of cellular phone use behaviors (the CUQ), and self-reported feelings of “addiction” to the mobile phone. These data provide preliminary support for the use of the PUMP Scale in research examining problematic mobile phone use in English-speaking samples.
Items included on the PUMP Scale instrument covered a wide range of symptoms. Most participants did not report symptoms, but it is noteworthy that a significant minority of respondents endorsed experiencing harm to their relationships, finances, and safety as a result of excessive phone use or use in inappropriate circumstances. Some respondents also acknowledged subjective loss of control over escalating phone use, as well as withdrawal-like symptoms when unable to use their phone. Finally, individuals who reported more symptoms of problematic mobile phone use on the PUMP Scale were more likely to endorse feeling “addicted” to their cellular phone. These findings support the popular construct of problematic mobile phone use (sometimes referred to as “cell phone addiction”) and suggest that this area merits further study.
When considering these findings, it is important to acknowledge some limitations of the present study. First, like many instrument development studies, the sample was relatively small () and was comprised of individuals recruited through convenience. Many of the participants were recruited from a college campus, and some were recruited from a mobile phone store, which may have introduced selection bias. Thus, the generalizability of results to the population as a whole may be limited. Future validation efforts should include larger, more diverse samples that are randomly selected. Second, the use of self-report, particularly regarding past behaviors and experiences, may have introduced biases due to faulty recall, social desirability, or shared methods variance. Obtaining more objective measures (i.e., mobile phone records, collateral reports) would strengthen the data. Third, no “gold standard” measure (i.e., accepted formal diagnostic criteria) exists for problematic mobile phone use. Therefore, it was not possible to assess the operating characteristics of the PUMP Scale. Future research is needed to identify the cut-point(s) of the PUMP Scale for the purpose of detecting clinically significant symptoms.
It must also be emphasized that the construct of problematic mobile phone use is not yet well-studied or supported in the literature. The merits and implications of considering this construct should be further explored and developed. Clearly, some individuals use their mobile phones more than others, but the reasons for this may be multifaceted. Job requirements, safety issues, and family and social factors all may contribute. However, “problematic mobile phone use” appears to extend beyond frequency of use, to the extent that mobile phone use produces social, occupational, and psychological distress; it may be useful to identify these symptoms as potential targets for prevention and intervention. More research is needed to support the results of the current study. Finally, future studies should elucidate the mechanisms underlying problematic mobile phone use, in order to determine whether it exists as a primary phenomenon or alternatively is a symptom of other underlying pathology (e.g., anxiety disorders, impulse control deficits, personality factors). The long-term goal of research into problematic mobile phone use should be to effectively identify and treat problem users or those at risk for problematic use and ultimately to maximize communication utility of mobile technology while minimizing resulting dysfunction.
Lisa J. Merlo’s work was supported in part by National Institute on Drug Abuse (NIDA) Training Grant no. T32-DA-07313-10 (PI: Linda B. Cottler).
- M. M. Khan, “Adverse effects of excessive mobile phone use,” International Journal of Occupational Medicine and Environmental Health, vol. 21, no. 4, pp. 289–293, 2008.
- T. Al-Khlaiwi and S. A. Meo, “Association of mobile phone radiation with fatigue, headache, dizziness, tension and sleep disturbance in Saudi population,” Saudi Medical Journal, vol. 25, no. 6, pp. 732–736, 2004.
- C. Laberge-Nadeau, U. Maag, F. Bellavance et al., “Wireless telephones and the risk of road crashes,” Accident Analysis and Prevention, vol. 35, no. 5, pp. 649–660, 2003.
- A. T. McCartt, L. A. Hellinga, and K. A. Bratiman, “Cell phones and driving: review of research,” Traffic Injury Prevention, vol. 7, no. 2, pp. 89–106, 2006.
- M. Richtel, “Drivers and legislators dismiss cellphone risks,” The New York Times, July 2009.
- S. Brink, “Disconnect for R & R? That's LOL,” Los Angeles Times, p. 14F, May 2007.
- W. Tanaka and S. Terry-Cobo, “Cellphone addiction,” June 2008, http://www.forbes.com/2008/06/15/cellphone-addict-iphone-tech-wireless08-cx_wt0616addict.html.
- H. R. Lesieur and S. B. Blume, “The South Oaks Gambling Screen (SOGS): a new instrument for the identification of Pathological gamblers,” American Journal of Psychiatry, vol. 144, no. 9, pp. 1184–1188, 1987.
- L. A. Nichols and R. Nicki, “Development of a psychometrically sound internet addiction scale: a preliminary step,” Psychology of Addictive Behaviors, vol. 18, no. 4, pp. 381–384, 2004.
- R. A. Tejeiro Salguero and R. M. Bersabé Morán, “Measuring problem video game playing in adolescents,” Addiction, vol. 97, no. 12, pp. 1601–1606, 2002.
- American Psychiatric Association, Diagnostic and Statistical Manual of Mental Disorders (DSM-IV-TR), American Psychiatric Association, Washington, DC, USA, 4th edition, 2000.
- American Psychiatric Association, Diagnostic and Statistical Manual of Mental Disorders (DSM-5), American Psychiatric Association, Washington, DC, USA, 5th edition, 2013.
- C. Brod, “Managing technostress: optimizing the use of computer technology,” The Personnel Journal, vol. 61, no. 10, pp. 753–757, 1982.
- S. Byun, C. Ruffini, J. E. Mills et al., “Internet addiction: metasynthesis of 1996–2006 quantitative research,” Cyberpsychology and Behavior, vol. 12, no. 2, pp. 203–207, 2009.
- M. Choliz, “Mobile phone: a point of issue,” Addiction, vol. 105, no. 2, pp. 373–374, 2010.
- A. Bianchi and J. G. Phillips, “Psychological predictors of problem mobile phone use,” Cyberpsychology and Behavior, vol. 8, no. 1, pp. 39–51, 2005.
- C. Jenaro, N. Flores, M. Gómez-Vela, F. González-Gil, and C. Caballo, “Problematic internet and cell-phone use: psychological, behavioral, and health correlates,” Addiction Research and Theory, vol. 15, no. 3, pp. 309–320, 2007.
- N. Kawasaki, S. Tanei, F. Ogata et al., “Survey on cellular phone usage on students in Thailand,” Journal of Physiological Anthropology, vol. 25, no. 6, pp. 377–382, 2006.
- M. Toda, K. Monden, K. Kubo, and K. Morimoto, “Mobile phone dependence and health-related lifestyle of university students,” Social Behavior and Personality, vol. 34, no. 10, pp. 1277–1284, 2006.
- L. Widyanto and M. McMurran, “The psychometric properties of the internet addiction test,” Cyberpsychology and Behavior, vol. 7, no. 4, pp. 443–450, 2004.
- American Psychiatric Association, DSM-5 Development: Substance-Use Disorders, 2010, http://www.dsm5.org/ProposedRevisions/Pages/proposedrevision.aspx?rid=431, Archived by WebCite, http://www.webcitation.org/5r3EW4O87.
- M. Toda, K. Monden, K. Kubo, and K. Morimoto, “Cellular phone dependence tendency of female university students,” Japanese Journal of Hygiene, vol. 59, no. 4, pp. 383–386, 2004 (Japanese).
- E. Carmines and R. Zeller, Reliability and Validity Assessment, Sage, London, UK, 1979.
- F. Lord, Applications of Item Response Theory to Practical Testing Problems, Lawrence Erlbaum Associates, Hillsdale, NJ, USA, 1980.
Copyright © 2013 Lisa J. Merlo et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.