A Proxy Outcome Approach for Causal Effect in Observational Studies: A Simulation Study

Liang, Wenbin; Zhao, Yuejen; Lee, Andy H.

doi:https://doi.org/10.1155/2014/872435

BioMed Research International

On this page

Abstract Background Results Discussion Conclusion References Copyright Related Articles

Research Article | Open Access

Volume 2014 | Article ID 872435 | https://doi.org/10.1155/2014/872435

A Proxy Outcome Approach for Causal Effect in Observational Studies: A Simulation Study

Wenbin Liang,¹Yuejen Zhao,²and Andy H. Lee³

Academic Editor: Abdelwahab Omri

Received01 Nov 2013

Revised03 Jan 2014

Accepted03 Jan 2014

Published18 Feb 2014

Abstract

Background. Known and unknown/unmeasured risk factors are the main sources of confounding effects in observational studies and can lead to false observations of elevated protective or hazardous effects. In this study, we investigate an alternative approach of analysis that is operated on field-specific knowledge rather than pure statistical assumptions. Method. The proposed approach introduces a proxy outcome into the estimation system. A proxy outcome possesses the following characteristics: (i) the exposure of interest is not a cause for the proxy outcome; (ii) causes of the proxy outcome and the study outcome are subsets of a collection of correlated variables. Based on these two conditions, the confounding-effect-driven association between the exposure and proxy outcome can then be measured and used as a proxy estimate for the effects of unknown/unmeasured confounders on the outcome of interest. Performance of this approach is tested by a simulation study, whereby 500 different scenarios are generated, with the causal factors of a proxy outcome and a study outcome being partly overlapped under low-to-moderate correlations. Results. The simulation results demonstrate that the conventional approach only led to a correct conclusion in 21% of the 500 scenarios, as compared to 72.2% for the alternative approach. Conclusion. The proposed method can be applied in observational studies in social science and health research that evaluates the health impact of behaviour and mental health problems.

1. Background

Due to lack of randomization, estimates obtained from observational studies are often affected by uncontrolled or unmeasured confounding effects. Several methods have been proposed to deal with the problem [1–11], but their application relies on assumptions about the distribution of the unknown confounding factor(s) in relation to the outcome, the exposure, and other known covariates.

The present study investigates an alternative approach of analysis that makes use of field-specific knowledge to determine a proxy outcome, which then will be employed to estimate uncontrolled confounding effects. A proxy outcome should satisfy the following conditions: (i) the exposure of interest is not a cause for the proxy outcome; and (ii) causes of the proxy outcome and the main outcome are subsets of a collection of correlated variables. If condition one is satisfied, then it is certain that the observed association between the exposure and the proxy outcome is completely driven by confounding effects. Nevertheless, condition one may be relaxed to some extent, for example, when it is certain that the confounding effect is by far stronger than possible causal effect. When condition two is satisfied, confounders for the proxy outcome and the outcome of interest are similar or at least correlated. For example, various forms of physical and mental health outcomes can be affected by a cluster of socioeconomic, behavioural, psychological, and genetic factors [12–22]. Researchers can apply their field knowledge and experience to determine the best proxy outcome for their outcome and exposure of interest.

Intuitively, let and be the main outcome and the proxy outcome, respectively; denotes the possible risk of due to a given level of exposure; and the unexposed and exposed person-time at risk; and represent the number of cases of observed in and , whereas and are the number of cases of observed in and , respectively. Further, suppose that and define the expected probability of one or more sufficient causes that the exposure of interest is not involved, occurring for in a unit of person-time at risk within and , respectively; correspondingly, and define the expected probability of one or more sufficient causes occurring for in a unit of person-time at risk within and , respectively. Then, the observed crude risk ratios are

If the sufficient causes of and are the same, largely overlapped, or strongly correlated, then will be observed if the exposure is not causal for , whereas will be observed if the exposure is causal for . Given this strict assumption, the method has been successfully applied in time series analysis recently, whereby the proxy outcome was described as a control series [23, 24]. For example, the study by Herttua and colleagues investigated the effect of alcohol price (exposure) on alcohol-related mortality (outcome of interest), while coronary operations were used as the control series (proxy outcome) [23]. Nevertheless, such a method may remain valid when assumptions are relaxed and can be applied to different study designs. Because the details of underlying causal mechanisms for an outcome (i.e., all sufficient causes) are typically unknown, it is best to ascertain the validity of the method through simulations. Therefore, we conduct a simulation study to test its application, focusing on situations when the causes of and are only partly overlapped and have only low to moderate strength of association.

2. Method

2.1. Simulation Design

The simulation process follows the sufficient cause model [25]. In the simulation for an event to occur, at least one sufficient cause has to occur, which comprises the occurrence of two matched causal components and absence of any competing event. In addition, a randomly distributed small error term is introduced to ensure that perfect prediction (which interrupts the computing process) will not occur. To account for the fact that only certain real causal factors are known yet some of the noncausal factors are mistaken as causal factors, a collection of variables are included to encompass exposure, causal factors, and noncausal factors, while a subset from the pool provides the known variables. All simulations are performed within the STATA package release 12.

The simulations contain 500 replicates, with each replicate being generated through an independent process. There are seven simulation steps involved in each replicate.(1)Generate a collection of correlated binary variables, , , and . For each , is set to 1 if an intermediate process variable and 0 otherwise, where is a combination of a variable component () and an unique component () for each , both being uniform distributed random variables, and is a random proportion drawn from a uniform distribution. The range is chosen in order to set a low to moderate level of correlation among . The mean (standard deviation), 25th, 50th, and 75th percentiles of the correlation coefficients for the matrix are 0.29 (0.12), 0.20, 0.26, and 0.34, respectively.(2)Determine the real causes for outcomes of interest , , and proxy outcome . Real causes for , , and are subsets of in which and , form ten matched pairs. Let indicate the factual causes, and . In this simulation, we force and ; that is, is causal for , but not causal for and . For , is a random value drawn from the Bernoulli distribution with probability of success = 0.5, value of success = 1, and value of failure = 0. For example if , then the pair of and is a cause of .(3)Generate competing events for outcomes , , and . Let denote the competing events for outcomes , , and , and . is a Bernoulli distributed random variable with a probability of success = 0.1, value of success = 1, and value of failure = 0. is also independent of .(4)Generate background errors for outcomes , , and . Let denote “background” sufficient causes, and . is a Bernoulli distributed random variable with a probability of success = 0.05, value of success = 1, and value of failure = 0. is independent of and . services as small random error, and it is introduced to smooth the computing process only.(5)Determine the status (occur or not occur) of outcomes , , and . Let where and denote the status of outcomes , , and . Value of each is determined as follows. For each observation , (outcome occurred) if , or for , when ; Otherwise (outcome not occurred).(6)Determine the known/suspected (not necessary the fact) “causal” factors (except ) for outcomes and . The known/suspected “causal” factors for outcomes , , and are determined for for . Let denote the researcher’s knowledge (not necessary the fact) of causes for outcomes and . Let , and indicates a known “causal” factor. Because is the exposure of interest, so we force each when . For , is a random value drawn from a Bernoulli distribution with a probability of success = 0.5. For , is a random value drawn from the Bernoulli distribution with a probability of success = 0.15, value of success = 1, and value of failure = 0. The difference in the success rates between the two groups indicates that a real causal factor is more likely to be acknowledged than a noncausal factor.(7)Estimate the effects of on outcomes and based on the fact model, and compare the conventional approach with the proposed approach. Let , , , be the presence of causes (except and ) for outcomes and for each observation. For each , for , if ; otherwise.

The true effects of on outcomes and based on the fact model are estimated by where is the estimated real effect of on outcome for . To estimate the effects of on outcomes and based on known/suspected confounders and applying standard multivariate logistic regression as the adjustment method, we have where is the estimated effect of on outcome for . To estimate the confounding effects on on outcomes and using the proxy outcome , the logistic model for adjustment becomes where is the estimated effect of on outcome (proxy outcome) for .

The adjusted effects of on and are and , respectively.

2.2. Classification of Effect of on and

Based on the fact model, increases risk of outcome if and value for ; otherwise has no effect on . Also, increases risk of outcome if and value for ; otherwise has no effect on . The same effect patterns hold analogously for the conventional model and the alternative approach by replacing the regression coefficient with and , respectively. Classifications of the effect of based on the fact model are then used as the gold standard to compare with the classifications based on the conventional approach and the alternative approach.

2.3. Empirical Application

A simple example is provided to clarify the methodology. For additional illustration of the proxy outcome method to adjust for residual confounding effects, interested readers are referred to the first author’s recently published research [26]. Briefly, when investigating the effect of alcohol use (exposure) on general health status (outcome), both measured and unmeasured confounding factors are involved. Many of these confounding factors are clustered within the family such as socioeconomic determinants, environmental factors, lifestyle, and genetic susceptibility. Although current alcohol use by adults does not produce any physiological effect on their children’s current health, observed effect of current alcohol use (exposure) on their children’s health status (proxy outcome) can be used as an approximation of confounding effects.

This example used the data from the 2010 National Health Interview Survey. A first logistic regression model was fitted to compare the likelihood of having undesirable (poor or fair) health status (outcome) between lifetime abstainers and current light drinkers (exposure). A second logistic regression model was then applied to compare the likelihood of having undesirable health status in the children (proxy outcome) in relation to the drinking status of their parents. To adjust for confounding effects, natural logarithm of the odds ratios from the second model was introduced as an offset variable into the first model.

3. Results

Estimates based on the knowledge and conventional model from one replicate are shown in Tables 1 and 2 as an example. Both outcomes and are treated as the outcomes of interest, while outcome is used as the proxy outcome. In this replicate, between outcomes and , there are four common causal factors. These account for 33% and 40% of all causal factors for and , respectively. Except for the exposure of interest (), 54% of causal factors for are known. The true effect of on outcome () based on the fact model is 1.27 ( value < 0.001) indicating that is a real causal factor to . The estimated effect based on the conventional approach () is 0.79 ( value < 0.001). The estimated effect based on the alternative approach () is . Both the conventional approach and alternative approach lead to the same correct conclusion that is a causal factor to .

Between outcomes and there are also four common factors. These account for 67% and 40% of all causal factors for and , respectively. Except the exposure of interest (), 33% of causal factors for are known. The true effect of on outcome () based on the fact model is −0.024 () indicating that is not a causal factor to . The estimated effect based on the conventional approach is 0.12 (). The estimated effect based on the alternative approach () is . Therefore, based on estimation from the conventional approach one would mistakenly draw the conclusion that “ is a causal factor to .” However, given that , the alternative approach has led to the correct conclusion that is not a causal factor to .

Table 3 summarises findings from the 500 replicates. Based on the fact model, the exposure of interest () is classified as a causal factor for outcome in all replicates. This is in perfect agreement with the simulation process that is set to be a causal factor for . In the simulation process, is set to be a noncausal factor for ; in 97.4% of the 500 replicates, the fact model concludes that is not a causal factor for , but in 2.6% of the replicates the fact model concludes that is a causal factor for . The disagreement between the simulation process and the fact model in these 2.6% replicates is a result of type I error (setting the two-sided confidence interval to 95%). Nevertheless, in all replicates, both the conventional and alternative approaches have classified as a causal factor for . When comparing the estimates between the conventional approach and the fact model, the two models have led to the same conclusion in only 21% of the replicates, while in 72.2% of the replicates, the alternative approach has led to the same conclusion as the fact model. When the simulation process is used as the gold standard for classification (i.e., is causal for , but not causal for ), the sensitivity of the new approach is 100%, and the specificity is 70.2%.

Table 4 presents results of the example. Alcohol use by adults has similar effects on their health status and their children’s health status, whereas the effect on children’s health status is mediated by confounding factors. To account for the uncontrolled confounding effects when estimating the effect of adults’ alcohol use on their health status, an offset variable, which takes on the value of the natural logarithm of 1 for lifetime abstainers and 0.60 for current light drinkers, is added to the model. The adjustment changes the odds ratio from 0.54 () to 0.90 ().

4. Discussion

In this study, we introduce a new analysis approach for causal effect. Although the new approach is only applicable to measurements of relative effects (i.e., risk ratios, odds ratios), it does not require any distributional assumption for the confounding variables in relation to the outcome, the exposure, and other known confounding variables. Instead, the approach merely assumes that the causes for the outcome of interest and proxy outcome are partly overlapped and correlated. The choice of an optimal proxy outcome is achievable by directly applying field expertise without advanced knowledge in statistics. The simulation results show that the alternative approach is far more accurate than the conventional approach in classifying causal associations, even under conditions of low to moderate correlation between the causes for the outcome and causes for the proxy outcome. The proposed approach appears to be suitable for observational studies in social science and health research that evaluate the health impact of behaviour and mental health problems, especially where clusters of causes for various outcomes are strongly correlated and overlapped in these fields [12, 27, 28].

It should be remarked that the analysis can only be performed when effects are measured by relative risk difference such as risk ratio or odds ratio. Another limitation is that false classification remains possible, even though the proposed method appears to have an advantage over the conventional approach. In this study, we demonstrate a new simulation process that incorporates the component causes, competing events, difference between the fact and the knowledge, to model realistic scenarios in observational studies. This simulation process could be further developed and used to determine how knowledge that deviates from the fact can introduce bias in estimates.

5. Conclusion

In conclusion, the proposed proxy outcome approach can be applied in observational studies in social science and health research that evaluate the health impact of behaviour and mental health problems.

Conflict of Interests

The authors declare that they have no conflict of interests.

References

D. Y. Lin, B. M. Psaty, and R. A. Kronmal, “Assessing the sensitivity of regression results to unmeasured confounders in observational studies,” Biometrics, vol. 54, no. 3, pp. 948–963, 1998.
View at: Publisher Site | Google Scholar
S. Greenland, “The impact of prior distributions for uncontrolled confounding and response bias: a case study of the relation of wire codes and magnetic fields to childhood leukemia,” Journal of the American Statistical Association, vol. 98, no. 461, pp. 47–54, 2003.
View at: Publisher Site | Google Scholar
S. Greenland, J. Copas, D. R. Jones et al., “Multiple-bias modelling for analysis of observational data,” Journal of the Royal Statistical Society A, vol. 168, no. 2, pp. 267–306, 2005.
View at: Publisher Site | Google Scholar
L. C. McCandless, P. Gustafson, and A. Levy, “Bayesian sensitivity analysis for unmeasured confounding in observational studies,” Statistics in Medicine, vol. 26, no. 11, pp. 2331–2347, 2007.
View at: Publisher Site | Google Scholar
O. A. Arah, Y. Chiba, and S. Greenland, “Bias formulas for external adjustment and sensitivity analysis of unmeasured confounders,” Annals of Epidemiology, vol. 18, no. 8, pp. 637–646, 2008.
View at: Publisher Site | Google Scholar
T. M. Palmer, J. R. Thompson, M. D. Tobin, N. A. Sheehan, and P. R. Burton, “Adjusting for bias and unmeasured confounding in Mendelian randomization studies with binary responses,” International Journal of Epidemiology, vol. 37, no. 5, pp. 1161–1168, 2008.
View at: Publisher Site | Google Scholar
T. J. VanderWeele, M. A. Hernán, and J. M. Robins, “Causal directed acyclic graphs and the direction of unmeasured confounding bias,” Epidemiology, vol. 19, no. 5, pp. 720–728, 2008.
View at: Publisher Site | Google Scholar
Y. Chiba, “The sign of the unmeasured confounding bias under various standard populations,” Biometrical Journal, vol. 51, no. 4, pp. 670–676, 2009.
View at: Publisher Site | Google Scholar
W.-C. Lee, “Bounding the bias of unmeasured factors with confounding and effect-modifying potentials,” Statistics in Medicine, vol. 30, no. 9, pp. 1007–1017, 2011.
View at: Publisher Site | Google Scholar
T. J. Vanderweele and O. A. Arah, “Bias formulas for sensitivity analysis of unmeasured confounding for general outcomes, treatments, and confounders,” Epidemiology, vol. 22, no. 1, pp. 42–52, 2011.
View at: Publisher Site | Google Scholar
L. C. McCandless, P. Gustafson, A. R. Levy, and S. Richardson, “Hierarchical priors for bias parameters in Bayesian sensitivity analysis for unmeasured confounding,” Statistics in Medicine, vol. 31, no. 4, pp. 383–396, 2012.
View at: Publisher Site | Google Scholar
F. Jacobi, H.-U. Wittchen, C. Hölting et al., “Prevalence, co-morbidity and correlates of mental disorders in the general population: results from the German Health Interview and Examination Survey (GHS),” Psychological Medicine, vol. 34, no. 4, pp. 597–611, 2004.
View at: Publisher Site | Google Scholar
Y.-F. Chan, M. L. Dennis, and R. R. Funk, “Prevalence and comorbidity of major internalizing and externalizing problems among adolescents and adults presenting to substance abuse treatment,” Journal of Substance Abuse Treatment, vol. 34, no. 1, pp. 14–24, 2008.
View at: Publisher Site | Google Scholar
M. Teesson, W. Hall, T. Slade et al., “Prevalence and correlates of DSM-IV alcohol abuse and dependence in Australia: findings of the 2007 National Survey of Mental Health and Wellbeing,” Addiction, vol. 105, no. 12, pp. 2085–2094, 2010.
View at: Publisher Site | Google Scholar
W. Liang and T. Chikritzhs, “Does light alcohol consumption during pregnancy improve offspring's cognitive development?” Medical Hypotheses, vol. 78, no. 1, pp. 69–70, 2012.
View at: Publisher Site | Google Scholar
W. Liang and T. Chikritzhs, “Alcohol consumption and health status of family members: health impacts without ingestion,” Internal Medicine Journal, vol. 43, no. 9, pp. 1012–1016, 2013.
View at: Publisher Site | Google Scholar
E. Petridou, X. Zavitsanos, N. Dessypris et al., “Adolescents in high-risk trajectory: clustering of risky behavior and the origins of socioeconomic health differentials,” Preventive Medicine, vol. 26, no. 2, pp. 215–219, 1997.
View at: Publisher Site | Google Scholar
J. W. Lynch, G. A. Kaplan, and J. T. Salonen, “Why do poor people behave poorly? Variation in adult health behaviours and psychosocial characteristics by stages of the socioeconomic lifecourse,” Social Science and Medicine, vol. 44, no. 6, pp. 809–819, 1997.
View at: Publisher Site | Google Scholar
A. Rozanski, J. A. Blumenthal, K. W. Davidson, P. G. Saab, and L. Kubzansky, “The epidemiology, pathophysiology, and management of psychosocial risk factors in cardiac practice: the emerging field of behavioral cardiology,” Journal of the American College of Cardiology, vol. 45, no. 5, pp. 637–651, 2005.
View at: Publisher Site | Google Scholar
K.-J. Suzuki, S. Nakaji, S. Tokunaga, T. Shimoyama, T. Umeda, and K. Sugawara, “Confounding by dietary factors in case-control studies on the efficacy of cancer screening in Japan,” European Journal of Epidemiology, vol. 20, no. 1, pp. 73–78, 2005.
View at: Publisher Site | Google Scholar
R. H. H. Groenwold, A. W. Hoes, and E. Hak, “Confounding in publications of observational intervention studies,” European Journal of Epidemiology, vol. 22, no. 7, pp. 413–415, 2007.
View at: Publisher Site | Google Scholar
P. Lagiou, H.-O. Adami, and D. Trichopoulos, “Causality in cancer epidemiology,” European Journal of Epidemiology, vol. 20, no. 7, pp. 565–574, 2005.
View at: Publisher Site | Google Scholar
K. Herttua, P. Mäkelä, and P. Martikainen, “An evaluation of the impact of a large reduction in alcohol prices on alcohol-related and all-cause mortality: time series analysis of a population-based natural experiment,” International Journal of Epidemiology, vol. 40, no. 2, Article ID dyp336, pp. 441–454, 2011.
View at: Publisher Site | Google Scholar
E. Poirier, L. Watier, E. Espie, F.-X. Weill, H. de Valk, and J.-C. Desenclos, “Evaluation of the impact on human salmonellosis of control measures targeted to Salmonella Enteritidis and Typhimurium in poultry breeding using time-series analysis and intervention models in France,” Epidemiology and Infection, vol. 136, no. 9, pp. 1217–1224, 2008.
View at: Publisher Site | Google Scholar
K. J. Rothman, S. Greenland, C. Poole, and T. L. Lash, “Causation and causal inference,” Modern Epidemiology, vol. 2, pp. 7–28, 1998.
View at: Google Scholar
W. Liang and T. Chikritzhs, “Observational research on alcohol use and chronic disease outcome: new approaches to counter biases,” The Scientific World Journal, vol. 2013, Article ID 860915, 14 pages, 2013.
View at: Publisher Site | Google Scholar
M. Zuckerman and D. M. Kuhlman, “Personality and risk-taking: common biosocial factors,” Journal of Personality, vol. 68, no. 6, pp. 999–1029, 2000.
View at: Google Scholar
R. C. Kessler, C. B. Nelson, K. A. McGonagle, M. J. Edlund, R. G. Frank, and P. J. Leaf, “The epidemiology of co-occurring addictive and mental disorders: implications for prevention and service utilization,” American Journal of Orthopsychiatry, vol. 66, no. 1, pp. 17–31, 1996.
View at: Publisher Site | Google Scholar

Copyright

Copyright © 2014 Wenbin Liang et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

2558

Downloads

865

Citations