Research Article | Open Access
Reliability of Family Proxy Data for Studies of Malignant Mesothelioma: Results from the ATSDR Pilot Surveillance
Objective. To evaluate the validity of proxy interviews in obtaining information on persons with rapidly fatal diseases such as malignant mesothelioma (MM). Methods. Persons with MM diagnosed in 2002 through 2005 in New York and New Jersey and 1997–2004 in Wisconsin were eligible for inclusion in the project. Persons with MM and their family member proxy were interviewed using the same questionnaire designed by ATSDR to collect information on potential direct or indirect occupational and environmental exposure to asbestos, genetic, and health related malignancy predisposition, and exposure to tobacco products. Descriptive statistics and the McNemar/Durkalski test were used to analyze 33 matched pairs. Results. The overall study confirmed a generally high ability of proxies to give interviews of comparable quality and completeness when asked dichotomous questions. The reliability of information collected from proxies varied by topic and family relationship. Conclusions. Family proxy interviews, using dichotomous responses, can serve as an acceptable source of information about health and exposure-related risk factors for MM.
Mesothelioma is an uncommon, malignant neoplasm that arises from mesothelial tissue usually in the pleura, less often in the peritoneum, and rarely elsewhere. Prognosis for malignant mesothelioma (MM) is poor, and the tumor has a median latency period of 32 years from the time of exposure to causative agents [1, 2]. Exposure to asbestos is considered the most important cause of MM [3, 4]. In diseases with potential occupationally or environmentally related causes, such as mesothelioma, exposure identification is critical for the development of preventive public health strategies.
Once diagnosed, the median length of survival for persons with MM varies from 5.9 to 11 months [5–7]. The ability to interview persons with newly diagnosed MM is limited because of the very short survival period. Proxy interviewing is a commonly used method of obtaining information on persons with rapidly fatal diseases [8, 9]. However, some studies have shown that data received from proxies may be inaccurate or require the review of additional information sources [10–12].
For this investigation, we collected data on the persons potential direct or indirect occupational and environmental exposure to asbestos, genetic, and health related malignancy predisposition, and exposure to tobacco products which does not cause mesothelioma by itself but may complicate the person’s chances of contracting a disease . We collected this information from both the person with MM and a family member designated as his or her proxy. This analysis evaluates the validity of proxy interviews.
MM was defined as an International Classification of Disease (ICD) Oncology (ICD-9 and ICD-10) histology codes 9050 through 9053. Persons with MM diagnosed in 2002 through 2005 in New York and New Jersey and 1997–2004 in Wisconsin were eligible for inclusion in the project. Persons with MM were ascertained through State Cancer Registries. Additionally, in New York and New Jersey, names, phone numbers, and addresses of persons with newly diagnosed mesothelioma were collected through monthly visits and phone calls to hospitals where the majority of mesothelioma patients were observed and treated. As soon as persons with MM were identified and were determined to be alive, we contacted their physician to obtain the written or verbal consent to contact his/her patients. If consent was received, we sent an introductory letter inviting them to participate in this investigation. Then we contacted them by phone to obtain verbal consent and interview. During the interview, we asked them to identity a family member they knew them best and who could give the most detailed information in a proxy interview. At a later point in time, which varied, the proxies gave verbal consent and were interviewed.
Trained interviewers conducted telephone interviews using a questionnaire designed by ATSDR. The interview focused on the respondents’ and their family’s exposure history and medical history, and respondents’ smoking history. The Environmental Protection Agency (EPA) list of jobs/activities potentially associated with exposure to asbestos was adapted for this project to assess the exposure history .
There were a total of 77 questions on five topics; 73 of these questions for which paired responses were a dichotomous “Yes” or “No,” were analyzed. Four nondichotomous questions, were excluded from the analysis. Pairs where one or both respondents had missing, “Don’t know” or “Refused” answers, were also excluded from the dichotomous analysis. Analysis included 15 case exposure history questions, 24 case medical history questions, 14 family exposure history questions, 13 family medical history questions, and 7 smoking history questions. The relationship of the proxy to the case was categorized as spouse, child, sibling, or other (mostly parents). To evaluate the response differences, we stratified the response data by the relationship subgroups during the analysis.
3. Statistical Analysis
In 1947, McNemar introduced a test for matched-pair data with a dichotomous response. Since then, this test has become a commonly used method for analyzing paired binary response data as correlated proportions . In our analysis, these procedures refer to the case and the proxy, respectively. The McNemar test assumes independence among the paired responses. Our study evaluated matched-pair responses to five topics. Each topic included a varied number of questions. Each case/proxy pair contributed more than one paired binary response to each topic. Therefore, the independence assumption no longer existed, and application of the McNemar test could result in inflating paired responses and underestimating standard error.
Durkalski et al.  proposed an adjusted McNemar test for analysis of clustered matched-pair data. This adjusted McNemar test allows testing the agreement of multiple paired responses between the respondents and their proxy with no inflated information. The adjusted chi-square value,  was calculated as where and , and , or 1 for all questions in the th matched-pair responding. The is the valid count of paired binary response. The is the total number of matched pairs in the study. The and are the summation of the two types of discordant of and , respectively. We used the McNemar/Durkalski test to adjust the correlated multiple paired responses on each topic. The null hypothesis of this test is that the two marginal probabilities are the same; that is, there is no difference between the responses from matched pairs. If the value was less than 0.05, we rejected the null hypothesis. The data were analyzed using SAS version 9.3.1 analytical software (Cary, NC).
Total of 33 paired interviews (eight paired interviews in New Jersey, ten paired interviews in New York, and 15 paired interviews in Wisconsin) were collected. Demographic characteristics of respondents are presented in Table 1. Respondents were mostly white males, not of Hispanic or Latino origin, married, and over 60 years old with a high school or college pregraduate education.
The familial relationship of the proxy is presented in Table 2. There were more spouses than any of the other categories combined (51.4%). Of the proxies, 85% knew the case over 30 years.
Responses of the 33 matched pairs are presented in Table 3. Spouses had the best data completion, with only 3 questions being unanswered. Respondent medical and family medical questions were the most difficult to answer with 3.8% and 4.2% unknown/missing, respectively. Spouses performed the best in exposure questions (89.8% agreement) and respondent and proxy medical history questions (94.1% and 90.0% agreement accordingly). Parents performed the best at family exposure questions (95.7% agreement). Children showed better agreement on smoking history (90.5%). However, the McNemar/Durkalski test discovered no statistically significant heterogeneity between paired responses regardless of relationship and the question’s topic. The only exception was a chi-square value 5.57 () for smoking history, showing statistically significant disagreement between paired responses. This was statistically significant only for spouses (chi-square value 5.91, ), although they answered the same percent of questions correctly as siblings and parents.
|Missing or unknown answers were excluded from the McNemar/Durkalski statistic calculation.|
Of the 33 paired interviews obtained from New Jersey, New York, and Wisconsin, we generally found agreement across the topics regardless of the familial relationship. The exception was smoking history, an area in which paired responses statistically differed. However, the larger number of spouses in the cohort contributed to the statistical significance. The real percent disagreement was not really that much more for spouses than for other subgroups of proxies. The generally high ability of surrogate responders to give interviews of comparable quality and completeness of exposure data was reported by Nam et al. , Pickle et al. , and Cordiero . Similar results were found by Campbell et al. , who applied the polytomous logistic regression models analyzing the utility of proxy versus index respondent information in a population-based case-control study of rapidly fatal cancers. Polytomous logistic regression models found only a few examples of meaningful heterogeneity among all variables including the cigarette smoking model.
The biggest limitation of this study was the small number (33) of paired interviews available for the analysis. For example, we may speculate that siblings and others that have borderline values for each question group might show significant difference with a larger number of pairs. The interpretation of results with regard to the accuracy of proxy interviews could be affected by the biased nature of the sample. For example, respondents were asked what family member would provide the best information. Additionally respondents may have had a somewhat longer survival from time of diagnosis than those not able to participate, perhaps because they were younger or had a stronger social support network of relatives. In addition, other factors, such as pending litigation and communication between pairs about the interview, may affect the accuracy. This theory could support relatively high agreement for these dichotomous questions. The more detailed multilevel responses were not analyzed because they did not show good agreement or were difficult to meaningfully compare answers.
Obtaining exposure information on persons with rapidly fatal diseases such as MM and other aggressive malignancies requires using alternative methods of collecting information about risk factors. Our study indicates that family proxy interviews, using dichotomous responses, can serve as an acceptable source of information about health and exposure-related risk factors for MM.
The reliability of information received from proxies was generally high but varied by topic and familial relationship, all of which need to be taken into consideration, particularly in diseases strongly associated with smoking.
Although the number of pairs available for analysis was small, these data suggests proxy interviews adequately answered big-picture questions regarding exposure. Future studies should explore whether more accurate information can be obtained through the use of interviews with multiple proxies per case.
Conflict of Interests
Neither N. Melnikova, M.D, Ph.D., an author of the paper nor any of the three other authors of the paper, M. Orr, M.S., W. Kaye, Ph.D., J. Wu, M.S., have a direct financial relation with the commercial identities of SAS version 9.3.1 analytical software mentioned in the paper that might lead to a conflict of interests for any of them.
The authors acknowledge Lisa M. Roche, M.P.H., Ph.D.; Karen Pawlish, M.P.H., S.D., State of New Jersey Department of Health and Senior Services, Cancer Epidemiology Services; Maria Schymura, Ph.D., New York State Department of Health; and Jennifer M. Hayes, Wisconsin Division of Public Health, Department of Health and Family Services.
- B. P. Lanphear and C. R. Buncher, “Latent period for malignant mesothelioma of occupational origin,” Journal of Occupational Medicine, vol. 34, no. 7, pp. 718–721, 1992.
- P. Greenberger, “Immunologic aspects of lung diseases and cystic fibrosis,” Journal of the American Medical Association, vol. 278, no. 22, pp. 1924–1930, 1997.
- M. Carbone, R. A. Kratzke, and J. R. Testa, “The pathogenesis of mesothelioma,” Seminars in Oncology, vol. 29, no. 1, pp. 2–17, 2002.
- H. Pass and N. J. Vogelzand, “Malignant pleural mesothelioma,” Current Problems in Cancer, vol. 28, no. 3, pp. 93–160, 2004.
- J. G. Edwards, K. R. Abrams, J. N. Leverment, T. J. Spyt, D. A. Waller, and K. J. O'Byrne, “Prognostic factors for malignant mesothelioma in 142 patients: validation of CALGB and EORTC prognostic scoring systems,” Thorax, vol. 55, no. 9, pp. 731–735, 2000.
- F. Montanaro, R. Rosato, M. Gangemi et al., “Survival of pleural malignant mesothelioma in Italy: a population-based study,” International Journal of Cancer, vol. 124, no. 1, pp. 201–207, 2009.
- G. Gorini, G. De Gregorio, S. Silvestri, E. Chellini, V. Cupelli, and A. S. Costantini, “Survival of malignant pleural mesothelioma cases in the Tuscan Mesothelioma Register, 1988–2000: a population-based study,” European Journal of Cancer Prevention, vol. 14, no. 3, pp. 195–199, 2005.
- L. Duan, A. H. Wu, J. Sullivan-Halley, and L. Bernstein, “Antacid drug use and risk of esophageal and gastric adenocarcinomas in Los Angeles county,” Cancer Epidemiology Biomarkers and Prevention, vol. 18, no. 2, pp. 526–533, 2009.
- A. Blair and S. H. Zahm, “Patterns of pesticide use among farmers: implications for epidemiologic research,” Epidemiology, vol. 4, no. 1, pp. 55–62, 1993.
- J. P. Fryzek, L. Lipworth, L. B. Signorello, and J. K. Mclaughlin, “The reliability of dietary data for self- and next-of-kin respondents,” Annals of Epidemiology, vol. 12, no. 4, pp. 278–283, 2002.
- R. Cordeiro, “Validity of occupational histories from proxy respondents,” Revista de Saude Publica, vol. 34, no. 5, pp. 522–528, 2000.
- L. Lipworth, J. P. Fryzek, C. M. Fored, W. J. Blot, and J. K. McLaughlin, “Comparison of surrogate with self-respondents regarding medical history and prior medication use,” International Journal of Epidemiology, vol. 30, no. 2, pp. 303–308, 2001.
- A. O'Hara, Mesothelioma and smoking, http://ezinearticles.com/?Mesothelioma-And-Smoking&id=1031653, 2008.
- EPA Asbestos Fact Sheet, http://epa.gov/region08/news/erlibby/libbyfact.html, 2003.
- Q. McNemar, “Note on the sampling error of the difference between correlated proportions or percentages,” Psychometrika, vol. 12, no. 2, pp. 153–157, 1947.
- V. L. Durkalski, Y. Y. Palesch, S. R. Lipsitz, and P. F. Rust, “Analysis of clustered matched-pair data,” Statistics in Medicine, vol. 22, no. 15, pp. 2417–2428, 2003.
- J. M. Nam, C. Rice, and M. H. Gail, “Comparison of asbestos exposure assessments by next-of-kin respondents, by an occupational hygienist, and by a job-exposure matrix from the national occupational hazard survey,” American Journal of Industrial Medicine, vol. 47, no. 5, pp. 443–450, 2005.
- L. W. Pickle, L. M. Brown, and W. J. Blot, “Information available from surrogate respondents in case-control interview studies,” American Journal of Epidemiology, vol. 118, no. 1, pp. 99–108, 1983.
- P. T. Campbell, M. Sloan, and N. Kreiger, “Utility of proxy respondent information in a population-based case-control study of rapidly fatal cancers,” Annals of Epidemiology, vol. 17, no. 4, pp. 253–257, 2007.
Copyright © 2013 Natalia Melnikova et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.