Research Article | Open Access
Farrokh Alemi, Manaf Zargoush, James L. Oakes, Hanan Edrees, "A Simple Method for Causal Analysis of Return on IT Investment", Journal of Healthcare Engineering, vol. 2, Article ID 628634, 12 pages, 2011. https://doi.org/10.1260/2040-2218.104.22.168
A Simple Method for Causal Analysis of Return on IT Investment
This paper proposes a method for examining the causal relationship among investment in information technology (IT) and the organization's productivity. In this method, first a strong relationship among (1) investment in IT, (2) use of IT and (3) organization's productivity is verified using correlations. Second, the assumption that IT investment preceded improved productivity is tested using partial correlation. Finally, the assumption of what may have happened in the absence of IT investment, the so called counterfactual, is tested through forecasting productivity at different levels of investment. The paper applies the proposed method to investment in the Veterans Health Information Systems and Technology Architecture (VISTA) system. Result show that the causal analysis can be done, even with limited data. Furthermore, because the procedure relies on overall organization's productivity, it might be more objective than when the analyst picks and chooses which costs and benefits should be included in the analysis.
- S. Xu, “Advancing return on investment analysis for electronic health record investment. Impacts of payment mechanisms and public returns,” J Healthc Inf Manag, vol. 21, no. 4, pp. 32–9, 2007 Fall.
- S. J. Simon and S. J. Simon, “An examination of the financial feasibility of Electronic Medical Records (EMRs): a case study of tangible and intangible benefits,” Int J Electron Healthc, vol. 2, no. 2, pp. 185–200, 2006.
- D. L. Grieger, S. H. Cohen, and D. A. Krusch, “A pilot study to document the return on investment for implementing an ambulatory electronic health record at an academic medical center,” J Am Coll Surg, vol. 205, no. 1, pp. 89–96, 2007 Jul.
- R. Kaushal, A. K. Jha, C. Franz et al., “Brigham and Women's Hospital CPOE Working Group. Return on investment for a computerized physician order entry system,” J Am Med Inform Assoc, vol. 13, no. 3, pp. 261–6, 2006 May-Jun.
- K. F. Schmitt and D. A. Wofford, “Financial analysis projects clear returns from electronic medical records,” Healthc Financ Manage, vol. 56, no. 1, pp. 52–7, 2002 Jan.
- R. Amarasingham, L. Plantinga, M. Diener-West, D. J. Gaskin, and N. R. Powe, “Clinical information technologies and inpatient outcomes: a multiple hospital study,” Arch Intern Med, vol. 169, no. 2, pp. 108–14, 2009 Jan 26.
- R. H. Miller, C. West, T. M. Brown, I. Sim, and C. Ganchoff, “The value of electronic health records in solo or small group practices,” Health Aff (Millwood), vol. 24, no. 5, pp. 1127–37, 2005 Sep-Oct.
- R. Fernandopulle and N. Patel, “How the electronic health record did not measure up to the demands of our medical home practice,” Health Aff (Millwood), vol. 29, no. 4, pp. 622–8, 2010 Apr.
- J. Sidorov, “It Ain't Necessarily So: The Electronic Health Record And The Unlikely Prospect Of Reducing Health Care Costs,” Health Aff (Millwood), vol. 25, no. 4, pp. 1079–85, 2006 Jul-Aug.
- P. G. Shekelle, S. C. Morton, and E. B. Keeler, “Costs and benefits of health information technology,” Evid Rep Technol Assess, no. 132, pp. 1–71, 2006 Apr.
- L. M. Hitt and E. Brynjolfsson, “Productivity, Business Profitability, and Consumer Surplus: Three Different Measures of Information Technology Value,” MIS Quarterly, vol. 20, no. 2, pp. 121–142, 1996.
- R. Borzekowski, “Measuring the cost impact of hospital information systems: 1987-1994,” J Health Econ, vol. 28, no. 5, pp. 938–49, 2009 Sep, Epub 2009 Jun 13.
- Sachdeva, Ramesh C. MD, PhD, MBA, “Measuring the impact of new technology: An outcomes-based approach,” Critical Care Medicine, vol. 29, no. 8, Supplement, pp. N190–N195, August 2001.
- S. J. Wang, B. Middleton, L. A. Prosser et al., “A cost-benefit analysis of electronic medical records in primary care,” Am J Med, vol. 114, no. 5, pp. 397–403, 2003 Apr 1.
- S. T. Parente and J. S. McCullough, “Health information technology and patient safety: evidence from panel data,” Health Aff (Millwood), vol. 28, no. 2, pp. 357–60, 2009 Mar-Apr.
- J. S. McCullough, M. Casey, I. Moscovice, and S. Prasad, “The effect of health information technology on quality in U. S. hospitals,” Health Aff (Millwood), vol. 29, no. 4, pp. 647–54, 2010 Apr.
- C. L. Goldzweig, A. Towfigh, M. Maglione, and P. G. Shekelle, “Costs and benefits of health information technology: new trends from the literature,” Health Aff (Millwood), vol. 28, no. 2, pp. w282–93, 2009 Mar-Apr, Epub 2009 Jan 27.
- D. U. Himmelstein, A. Wright, and S. Woolhandler, “Hospital computing and the costs and quality of care: a national study,” Am J Med, vol. 123, no. 1, pp. 40–6, 2010 Jan, Epub 2009 Nov 24.
- M. Joffe and J. Mindell, “Complex causal process diagrams for analyzing the health impacts of policy interventions,” Am J Public Health, vol. 96, no. 3, pp. 473–9, 2006 Mar.
- R. J. Little and D. B. Rubin, “Causal effects in clinical and epidemiological studies via potential outcomes: concepts and analytical approaches,” Annu Rev Public Health, vol. 21, pp. 121–45, 2000.
- A. Bernard and S. Tichkiewitch, Methods and Tools for Effective Knowledge Life-Cycle-Management, Springer, 2008.
- N. Menachemi, J. Burkhardt, R. Shewchuk, D. Burke, and R. G. Brooks, “Hospital information technology and positive financial performance: a different approach to finding an ROI,” Healthc Manag, vol. 51, no. 1, pp. 40–58, 2006 Jan-Feb.
- J. Pearl, Causality: Models Reasoning and Inference, Cambridge University Press, 2000.
- M. G. Kendall and A. Stuart, The Advanced Theory of Statistics, Volume 2, 3rd edition, 1973, ISBN 0-85264-215-6.
- Baba, Kunihiro, Reitei Shibata, and Masaaki Sibuya, “Partial correlation and conditional correlation as measures of conditional independence,” Australian and New Zealand Journal of Statistics, vol. 46, no. 4, pp. 657–664, 2004.
- C. M. Byrne, L. M. Mercincavage, E. C. Pan, A. G. Vincent, D. S. Johnston, and B. Middleton, “The value from investments in health information technology at the U. S. Department of Veterans Affairs,” Health Aff (Millwood), vol. 29, no. 4, pp. 629–38, 2010 Apr.
- Unspecified authors, “The Veterans Health Administration: quality, value, accountability and information as transforming strategies for patient centered care,” The American Journal of Managed Care, November, 2004a.
- Unspecified authors, “Comparison of quality of care for patients in the Veterans Health Administration and patients in a national sample,” Annals of Internal Medicine, December, 2004b.
- M. M. Glymour and S. Greenland, “Causal diagrams,” in Modern epidemiology, K. J. Rothman, S. Greenland, and T. L. Lash, Eds., Wolters Kluwer/Lippincott Williams & Wilkins, Philadelphia, 2008.
- P. P. Howards, E. F. Schisterman, and P. J. Heagerty, “Potential confounding by exposure history and prior outcomes – an example from perinatal epidemiology,” Epidemiology, vol. 18, no. 5, pp. 544–51, 2007.
Copyright © 2011 Hindawi Publishing Corporation. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.