Table of Contents Author Guidelines Submit a Manuscript
BioMed Research International
Volume 2016, Article ID 1425693, 11 pages
http://dx.doi.org/10.1155/2016/1425693
Review Article

Complementarity of Clinician Judgment and Evidence Based Models in Medical Decision Making: Antecedents, Prospects, and Challenges

1Institute of Medical Insurance and Hospital Management, Jiangsu University, Zhenjiang, Jiangsu, China
2School of Management, Jiangsu University, 301 Xuefu Road, Zhenjiang, Jiangsu, China
3School of Graduate Studies, Ghana Technology University College, Private Mail Bag 100, Accra, Ghana

Received 10 March 2016; Accepted 25 July 2016

Academic Editor: Rita Casadio

Copyright © 2016 Zhou Lulin et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Linked References

  1. C. Gao, J.-S. Song, J. Xiong, X.-H. Xue, and T.-G. Shang, “Standard research on the quality of published medical case literature from Treatise on Febrile Diseases based on the Delphi method,” China Journal of Traditional Chinese Medicine and Pharmacy, vol. 2, p. 12, 2012. View at Google Scholar
  2. J. Spiby, “Advances in medical technology over the next 20 years,” Journal of Public Health, vol. 10, no. 4, pp. 273–278, 1988. View at Google Scholar · View at Scopus
  3. A. Nimgaonkar, D. R. Karnad, S. Sudarshan, L. Ohno-Machado, and I. Kohane, “Prediction of mortality in an Indian intensive care unit: comparison between APACHE II and artificial neural networks,” Intensive Care Medicine, vol. 30, no. 2, pp. 248–253, 2004. View at Publisher · View at Google Scholar · View at Scopus
  4. T. Yu and S.-H. Chen, “Agent-based modeling of the prediction markets for political elections,” in Multi-Agent-Based Simulation XII: International Workshop, MABS 2011, Taipei, Taiwan, May 2–6, 2011, Revised Selected Papers, vol. 7124 of Lecture Notes in Computer Science, pp. 31–43, Springer, Berlin, Germany, 2012. View at Publisher · View at Google Scholar
  5. L. Ohno-Machado, “Modeling medical prognosis: survival analysis techniques,” Journal of Biomedical Informatics, vol. 34, no. 6, pp. 428–439, 2001. View at Publisher · View at Google Scholar · View at Scopus
  6. R. B. Akins, H. Tolson, and B. R. Cole, “Stability of response characteristics of a Delphi panel: application of bootstrap data expansion,” BMC Medical Research Methodology, vol. 5, article 37, 2005. View at Publisher · View at Google Scholar · View at Scopus
  7. S. S. Bederman, W. J. McIsaac, P. C. Coyte, H. J. Kreder, N. N. Mahomed, and J. G. Wright, “Referral practices for spinal surgery are poorly predicted by clinical guidelines and opinions of primary care physicians,” Medical Care, vol. 48, no. 9, pp. 852–858, 2010. View at Publisher · View at Google Scholar · View at Scopus
  8. G. Ohi, I. Kai, Y. Kobayashi et al., “AIDS prevention in Japan and its cost benefit aspects,” Health Policy, vol. 8, no. 1, pp. 17–27, 1987. View at Publisher · View at Google Scholar · View at Scopus
  9. S. Uchino, R. Bellomo, D. Goldsmith, S. Bates, and C. Ronco, “An assessment of the RIFLE criteria for acute renal failure in hospitalized patients,” Critical Care Medicine, vol. 34, no. 7, pp. 1913–1917, 2006. View at Publisher · View at Google Scholar · View at Scopus
  10. B. H. Bornstein and A. C. Emler, “Rationality in medical decision making: a review of the literature on doctors' decision-making biases,” Journal of Evaluation in Clinical Practice, vol. 7, no. 2, pp. 97–107, 2001. View at Publisher · View at Google Scholar · View at Scopus
  11. A. I. Mushlin and F. A. Appel, “Diagnosing potential noncompliance: physicians' ability in a behavioral dimension of medical care,” Archives of Internal Medicine, vol. 137, no. 3, pp. 318–321, 1977. View at Publisher · View at Google Scholar · View at Scopus
  12. C. Christensen and A. S. Elstein, “Informal reasoning in the medical profession,” Informal Reasoning and Education, pp. 17–35, 1991. View at Google Scholar
  13. A. Kittur, E. Chi, B. A. Pendleton, B. Suh, and T. Mytkowicz, “Power of the few vs. wisdom of the crowd: wikipedia and the rise of the bourgeoisie,” World Wide Web, vol. 1, no. 2, p. 19, 2007. View at Google Scholar
  14. R. P. Jones, “Myths of ideal hospital size,” Medical Journal of Australia, vol. 193, no. 5, pp. 298–300, 2010. View at Google Scholar · View at Scopus
  15. A. W. Bradbury, D. J. Adam, J. Bell et al., “Bypass versus Angioplasty in Severe Ischaemia of the Leg (BASIL) trial: a survival prediction model to facilitate clinical decision making,” Journal of Vascular Surgery, vol. 51, no. 5, pp. 52S–68S, 2010. View at Publisher · View at Google Scholar · View at Scopus
  16. K. M. Smart, C. Blake, A. Staines, and C. Doody, “Clinical indicators of ‘nociceptive’, ‘peripheral neuropathic’ and ‘central’ mechanisms of musculoskeletal pain. A Delphi survey of expert clinicians,” Manual Therapy, vol. 15, no. 1, pp. 80–87, 2010. View at Publisher · View at Google Scholar · View at Scopus
  17. E. Diaz-Aviles, A. Stewart, E. Velasco, K. Denecke, and W. Nejdl, “Epidemic intelligence for the crowd, by the crowd,” in Proceedings of the International AAAI Conference on Weblogs and Social Media (ICWSM '12), Dublin, Ireland, 2012.
  18. S. S. Jones, A. Thomas, R. S. Evans, S. J. Welch, P. J. Haug, and G. L. Snow, “Forecasting daily patient volumes in the emergency department,” Academic Emergency Medicine, vol. 15, no. 2, pp. 159–170, 2008. View at Publisher · View at Google Scholar · View at Scopus
  19. P. Bassi, E. Sacco, V. De Marco, M. Aragona, and A. Volpe, “Prognostic accuracy of an artificial neural network in patients undergoing radical cystectomy for bladder cancer: a comparison with logistic regression analysis,” BJU International, vol. 99, no. 5, pp. 1007–1012, 2007. View at Publisher · View at Google Scholar · View at Scopus
  20. A. Biglarian, E. Hajizadeh, A. Kazemnejad, and M. R. Zali, “Application of artificial neural network in predicting the survival rate of gastric cancer patients,” Iranian Journal of Public Health, vol. 40, no. 2, pp. 80–86, 2011. View at Google Scholar · View at Scopus
  21. Z. Amiri, K. Mohammad, M. Mahmoudi, M. Parsaeian, and H. Zeraati, “Assessing the effect of quantitative and qualitative predictors on gastric cancer individuals survival using hierarchical artificial neural network models,” Iranian Red Crescent Medical Journal, vol. 15, no. 1, pp. 42–48, 2012. View at Google Scholar · View at Scopus
  22. L. Zhu, W. Luo, M. Su et al., “Comparison between artificial neural network and Cox regression model in predicting the survival rate of gastric cancer patients,” Biomedical Reports, vol. 1, pp. 757–760, 2013. View at Google Scholar
  23. D. Ansari, J. Nilsson, R. Andersson, S. Regnér, B. Tingstedt, and B. Andersson, “Artificial neural networks predict survival from pancreatic cancer after radical surgery,” The American Journal of Surgery, vol. 205, no. 1, pp. 1–7, 2013. View at Publisher · View at Google Scholar · View at Scopus
  24. J. Wang, M. Li, Y.-T. Hu, and Y. Zhu, “Comparison of hospital charge prediction models for gastric cancer patients: neural network vs. decision tree models,” BMC Health Services Research, vol. 9, article 161, 2009. View at Publisher · View at Google Scholar · View at Scopus
  25. Y. Xu, F. M. Selaru, J. Yin et al., “Artificial neural networks and gene filtering distinguish between global gene expression profiles of Barrett's esophagus and esophageal cancer,” Cancer Research, vol. 62, no. 12, pp. 3493–3497, 2002. View at Google Scholar · View at Scopus
  26. C.-H. Wang, L.-R. Mo, R.-C. Lin, J.-J. Kuo, K.-K. Chang, and J.-J. Wu, “Artificial neural network model is superior to logistic regression model in predicting treatment outcomes of interferon-based combination therapy in patients with chronic hepatitis C,” Intervirology, vol. 51, no. 1, pp. 14–20, 2008. View at Publisher · View at Google Scholar · View at Scopus
  27. A. Uys, B. L. Rapoport, H. Fickl, P. W. A. Meyer, and R. Anderson, “Prediction of outcome in cancer patients with febrile neutropenia: comparison of the multinational association of supportive care in cancer risk-index score with procalcitonin, C-reactive protein, serum amyloid A, and interleukins-1β, -6, -8 and -10,” European Journal of Cancer Care, vol. 16, no. 6, pp. 475–483, 2007. View at Publisher · View at Google Scholar · View at Scopus
  28. L. Spelt, J. Nilsson, R. Andersson, and B. Andersson, “Artificial neural networks-A method for prediction of survival following liver resection for colorectal cancer metastases,” European Journal of Surgical Oncology, vol. 39, no. 6, pp. 648–654, 2013. View at Publisher · View at Google Scholar · View at Scopus
  29. H. B. Burke, P. H. Goodman, D. B. Rosen et al., “Artificial neural networks improve the accuracy of cancer survival prediction,” Cancer, vol. 79, no. 4, pp. 857–862, 1997. View at Publisher · View at Google Scholar · View at Scopus
  30. L.-J. Chen, G.-P. Lian, and L.-J. Han, “Prediction of human skin permeability using artificial neural network (ANN) modeling,” Acta Pharmacologica Sinica, vol. 28, no. 4, pp. 591–600, 2007. View at Publisher · View at Google Scholar · View at Scopus
  31. H.-Y. Shi, J.-T. Tsai, Y.-M. Chen, R. Culbertson, H.-T. Chang, and M.-F. Hou, “Predicting two-year quality of life after breast cancer surgery using artificial neural network and linear regression models,” Breast Cancer Research and Treatment, vol. 135, no. 1, pp. 221–229, 2012. View at Publisher · View at Google Scholar · View at Scopus
  32. J. B. Soll and R. P. Larrick, “Strategies for revising judgment: how (and how well) people use others' opinions,” Journal of Experimental Psychology: Learning Memory and Cognition, vol. 35, no. 3, pp. 780–805, 2009. View at Publisher · View at Google Scholar · View at Scopus
  33. J. G. Webster and T. B. Ksiazek, “The dynamics of audience fragmentation: public attention in an age of digital media,” Journal of Communication, vol. 62, no. 1, pp. 39–56, 2012. View at Publisher · View at Google Scholar · View at Scopus
  34. H.-Y. Shi, K.-T. Lee, H.-H. Lee et al., “Comparison of artificial neural network and logistic regression models for predicting in-hospital mortality after primary liver cancer surgery,” PLoS ONE, vol. 7, no. 4, Article ID e35781, 2012. View at Publisher · View at Google Scholar · View at Scopus
  35. A. Graefe and J. S. Armstrong, “Comparing face-to-face meetings, nominal groups, Delphi and prediction markets on an estimation task,” International Journal of Forecasting, vol. 27, no. 1, pp. 183–195, 2011. View at Publisher · View at Google Scholar · View at Scopus
  36. L. Wei, Z. Zewei, Z. Hao et al., “Construction of a prediction system for chinese materia medica hot/cold properties,” World Chinese Medicine, vol. 3, article 33, 2013. View at Google Scholar
  37. S. Tepper, G. Dejong, D. Wilkerson, and R. Brannon, “Criteria for selection of a payment method for inpatient medical rehabilitation,” Archives of Physical Medicine and Rehabilitation, vol. 76, no. 4, pp. 349–354, 1995. View at Publisher · View at Google Scholar · View at Scopus
  38. X. Liu, N.-S. Li, L.-S. Lv et al., “A comparison of the performances of an artificial neural network and a regression model for GFR estimation,” American Journal of Kidney Diseases, vol. 62, no. 6, pp. 1109–1115, 2013. View at Publisher · View at Google Scholar · View at Scopus
  39. J. A. Lowthian, D. J. Jolley, A. J. Curtis et al., “The challenges of population ageing: Accelerating demand for emergency ambulance services by older patients, 1995–2015,” Medical Journal of Australia, vol. 194, no. 11, pp. 574–578, 2011. View at Google Scholar · View at Scopus
  40. C.-L. Chi, W. N. Street, and W. H. Wolberg, “Application of artificial neural network-based survival analysis on two breast cancer datasets,” AMIA Annual Symposium Proceedings, vol. 11, pp. 130–134, 2007. View at Google Scholar
  41. M. C. Çolak, C. Çolak, H. Kocatürk, Ş. Sağiroğlu, and I. Barutçu, “Predicting coronary artery disease using different artificial neural network models,” The Anatolian Journal of Cardiology, vol. 8, no. 4, pp. 249–254, 2008. View at Google Scholar · View at Scopus
  42. S.-Y. Peng and S.-K. Peng, “Predicting adverse outcomes of cardiac surgery with the application of artificial neural networks,” Anaesthesia, vol. 63, no. 7, pp. 705–713, 2008. View at Publisher · View at Google Scholar · View at Scopus
  43. E. H. Bollschweiler, S. P. Mönig, K. Hensler, S. E. Baldus, K. Maruyama, and A. H. Hölscher, “Artificial neural network for prediction of lymph node metastases in gastric cancer: a phase II diagnostic study,” Annals of Surgical Oncology, vol. 11, no. 5, pp. 506–511, 2004. View at Publisher · View at Google Scholar · View at Scopus
  44. D. Delen, G. Walker, and A. Kadam, “Predicting breast cancer survivability: a comparison of three data mining methods,” Artificial Intelligence in Medicine, vol. 34, no. 2, pp. 113–127, 2005. View at Publisher · View at Google Scholar · View at Scopus
  45. J. M. Jerez-Aragonés, J. A. Gómez-Ruiz, G. Ramos-Jiménez, J. Muñoz-Pérez, and E. Alba-Conejo, “A combined neural network and decision trees model for prognosis of breast cancer relapse,” Artificial Intelligence in Medicine, vol. 27, no. 1, pp. 45–63, 2003. View at Publisher · View at Google Scholar · View at Scopus
  46. M. R. Gohari, A. Biglarian, E. Bakhshi, and M. A. Pourhoseingholi, “Use of an artificial neural network to determine prognostic factors in colorectal cancer patients,” Asian Pacific Journal of Cancer Prevention, vol. 12, no. 6, pp. 1469–1472, 2011. View at Google Scholar · View at Scopus
  47. L. Mariani, D. Coradini, E. Biganzoli et al., “Prognostic factors for metachronous contralateral breast cancer: a comparison of the linear Cox regression model and its artificial neural network extension,” Breast Cancer Research and Treatment, vol. 44, no. 2, pp. 167–178, 1997. View at Publisher · View at Google Scholar · View at Scopus
  48. J. Maroco, D. Silva, A. Rodrigues, M. Guerreiro, I. Santana, and A. de Mendonça, “Data mining methods in the prediction of Dementia: a real-data comparison of the accuracy, sensitivity and specificity of linear discriminant analysis, logistic regression, neural networks, support vector machines, classification trees and random forests,” BMC Research Notes, vol. 4, article 299, 2011. View at Publisher · View at Google Scholar · View at Scopus
  49. C. Grainger and R. Griffiths, “Day surgery-how much is possible? A Delphi consensus among surgeons,” Public Health, vol. 108, no. 4, pp. 257–266, 1994. View at Publisher · View at Google Scholar · View at Scopus
  50. J. A. Kors and J. H. van Bemmel, “The Delphi method: a review of its applications in medicine,” Medinfo, vol. 89, pp. 156–160, 1989. View at Google Scholar
  51. S. Hickey and H. Roberts, Ascorbate: The Science of Vitamin C, Lulu.com, 2004.
  52. R. Jones, “Forecasting conundrum: a disease time cascade,” British Journal of Health Care Management, vol. 20, no. 2, pp. 90–91, 2014. View at Publisher · View at Google Scholar · View at Scopus
  53. J. Surowiecki, The wisdom of crowds: Anchor, 2005.
  54. D. B. Starkweather, L. Gelwicks, and R. Newcomer, “Delphi forecasting of health care organization,” Inquiry, vol. 12, no. 1, pp. 37–46, 1975. View at Google Scholar · View at Scopus
  55. J. Surowiecki, “The wisdom of crowds,” in Why the Many are Smarter Than the Few and How Collective Wisdom Shapes Business, Economies, Societies and Nations, Little, Brown, Boston, Mass, USA, 2004. View at Google Scholar
  56. I. Silber and A. A. Israeli, “Using information markets for pricing: the case of the airline industry,” Journal of Hospitality Marketing and Management, vol. 21, no. 1, pp. 100–112, 2012. View at Publisher · View at Google Scholar · View at Scopus
  57. J. Pill, “The Delphi method: substance, context, a critique and an annotated bibliography,” Socio-Economic Planning Sciences, vol. 5, no. 1, pp. 57–71, 1971. View at Publisher · View at Google Scholar · View at Scopus
  58. H. D. Thoreau, I to Myself: An Annotated Selection from the Journal of Henry D. Thoreau (Jeffrey S. Cramer, ed.), Yale University Press, New Haven, Conn, USA, 1962. View at Scopus
  59. F. Nietzsche, Beyond Good and Evil, Trans. Walter Kaufmann, Random House, New York, NY, USA, 1966.
  60. H. A. Linstone and M. Turoff, The Delphi Method: Techniques and Applications, vol. 29, Addison-Wesley, Reading, Mass, USA, 1975.
  61. Z. Xu and H. O. Xia, “The Delphi technique and its application in nursing research,” Journal of Nursing Science, vol. 6, p. 49, 2008. View at Google Scholar
  62. N. Bowles, “The Delphi technique,” Nursing Standard, vol. 13, no. 45, pp. 32–36, 1999. View at Google Scholar · View at Scopus
  63. W. E. Riggs, “The Delphi technique. An experimental evaluation,” Technological Forecasting and Social Change, vol. 23, no. 1, pp. 89–94, 1983. View at Publisher · View at Google Scholar · View at Scopus
  64. A. D. Bender, A. E. Strack, G. W. Ebright, and G. Von Haunalter, “Delphic study examines developments in medicine,” Futures, vol. 1, no. 4, pp. 289–303, 1969. View at Publisher · View at Google Scholar · View at Scopus
  65. J. Mclennan, “Derivation and validation of a clinical prediction rule to predict the likelihood of massive transfusion in military major trauma,” 2013.
  66. J. Zeng, X. Rong, and S. Nie, “Developing an early warning indicators system for infectious diseases in Wuhan Urban area: a delphi approach,” Chinese Journal of Social Medicine, vol. 29, pp. 212–213, 2012. View at Google Scholar
  67. C. Cook, J.-M. Brismée, R. Pietrobon, P. Sizer Jr., E. Hegedus, and D. L. Riddle, “Development of a quality checklist using Delphi methods for prescriptive clinical prediction rules: the QUADCPR,” Journal of Manipulative and Physiological Therapeutics, vol. 33, no. 1, pp. 29–41, 2010. View at Publisher · View at Google Scholar · View at Scopus
  68. K. A. Sporer, A. M. Craig, N. J. Johnson, and C. C. Yeh, “Does emergency medical dispatch priority predict delphi process-derived levels of prehospital intervention?” Prehospital and Disaster Medicine, vol. 25, no. 4, pp. 309–317, 2010. View at Publisher · View at Google Scholar · View at Scopus
  69. R. G. Hazard, L. D. Haugh, S. Reid, J. B. Preble, and L. MacDonald, “Early prediction of chronic disability after occupational low back injury,” Spine, vol. 21, no. 8, pp. 945–951, 1996. View at Publisher · View at Google Scholar · View at Scopus
  70. J. C. Norcross, M. Hedges, and J. O. Prochaska, “The face of 2010: a Delphi poll on the future of psychotherapy,” Professional Psychology: Research and Practice, vol. 33, no. 3, pp. 316–322, 2002. View at Publisher · View at Google Scholar · View at Scopus
  71. R. P. Hudak, P. P. Brooke, and K. Finstuen, “FORECAST 2000: a prediction of skills, knowledge, and abilities required by senior medical treatment facility leaders into the 21st century,” Military Medicine, vol. 159, no. 7, pp. 494–500, 1994. View at Google Scholar · View at Scopus
  72. M. Hosokawa and S. Zweig, “Future directions in family medicine: results of a Delphi study,” Family Medicine, vol. 22, pp. 429–433, 1989. View at Google Scholar
  73. C. Hall, “Prediction markets: issues and applications,” The Journal of Prediction Markets, vol. 4, no. 1, pp. 27–58, 2010. View at Google Scholar
  74. S. L. Kanter, “The future of academic medicine: what can academic medicine do about it?” Academic Medicine, vol. 84, no. 4, pp. 405–406, 2009. View at Publisher · View at Google Scholar · View at Scopus
  75. T.-H. Ho and K.-Y. Chen, “New product blockbusters: the magic and science of prediction markets,” California Management Review, vol. 50, no. 1, pp. 144–158, 2007. View at Google Scholar · View at Scopus
  76. B. Spears, C. LaComb, J. Interrante, J. Barnett, and D. Senturk-Dogonaksoy, “Examining trader behavior in idea markets: an implementation of GE's imagination markets,” The Journal of Prediction Markets, vol. 3, no. 1, pp. 17–39, 2009. View at Google Scholar
  77. E. Dahan and V. Srinivasan, “Predictive power of Internet-based product concept testing using visual depiction and animation,” Journal of Product Innovation Management, vol. 17, no. 2, pp. 99–109, 2000. View at Publisher · View at Google Scholar · View at Scopus
  78. K. Strumpf, “Introduction to special issue on corporate applications of prediction markets,” The Journal of Prediction Markets, vol. 3, no. 1, 2009. View at Google Scholar
  79. J. Greibe, P. Bugge, T. Gjorup, T. Lauritzen, O. Bonnevie, and H. R. Wulff, “Long-term prognosis of duodenal ulcer: follow-up study and survey of doctors' estimates,” The British Medical Journal, vol. 2, no. 6102, pp. 1572–1574, 1977. View at Publisher · View at Google Scholar · View at Scopus
  80. K. L. Lee, D. B. Pryor, F. E. Harrell Jr. et al., “Predicting outcome in coronary disease statistical models versus expert clinicians,” The American Journal of Medicine, vol. 80, no. 4, pp. 553–560, 1986. View at Publisher · View at Google Scholar · View at Scopus
  81. R. W. S. Chang, B. Lee, S. Jacobs, and B. Lee, “Accuracy of decisions to withdraw therapy in critically ill patients: clinical judgment versus a computer model,” Critical Care Medicine, vol. 17, no. 11, pp. 1091–1097, 1989. View at Publisher · View at Google Scholar · View at Scopus
  82. P. M. Polgreen, F. D. Nelson, and G. R. Neumann, “Use of prediction markets to forecast infectious disease activity,” Clinical Infectious Diseases, vol. 44, no. 2, pp. 272–279, 2007. View at Publisher · View at Google Scholar · View at Scopus
  83. D. Rajakovich and V. Vladimirov, “Prediction markets as a medical forecasting tool: demand for hospital services,” Journal of Prediction Markets, vol. 3, pp. 78–106, 2009. View at Google Scholar
  84. F. Sato, Y. Shimada, F. M. Selaru et al., “Prediction of survival in patients with esophageal carcinoma using artificial neural networks,” Cancer, vol. 103, no. 8, pp. 1596–1605, 2005. View at Publisher · View at Google Scholar · View at Scopus
  85. E. P. Hui, L. K. S. Leung, T. C. W. Poon et al., “Prediction of outcome in cancer patients with febrile neutropenia: a prospective validation of the Multinational Association for Supportive Care in Cancer risk index in a Chinese population and comparison with the Talcott model and artificial neural network,” Supportive Care in Cancer, vol. 19, no. 10, pp. 1625–1635, 2011. View at Publisher · View at Google Scholar · View at Scopus
  86. I. Kaiserman, M. Rosner, and J. Pe'er, “Forecasting the prognosis of choroidal melanoma with an artificial neural network,” Ophthalmology, vol. 112, no. 9, pp. 1608.e1–1608.e6, 2005. View at Publisher · View at Google Scholar · View at Scopus
  87. R. K. Orr, “Use of an artificial neural network to quantitate risk of malignancy for abnormal mammograms,” Surgery, vol. 129, no. 4, pp. 459–466, 2001. View at Publisher · View at Google Scholar · View at Scopus
  88. P. J. G. Lisboa, “A review of evidence of health benefit from artificial neural networks in medical intervention,” Neural Networks, vol. 15, no. 1, pp. 11–39, 2002. View at Publisher · View at Google Scholar · View at Scopus
  89. G. S. Sonke, T. Heskes, A. L. M. Verbeek, J. J. M. C. H. De La Rosette, and L. A. L. M. Kiemeney, “Prediction of bladder outlet obstruction in men with lower urinary tract symptoms using artificial neural networks,” The Journal of Urology, vol. 163, no. 1, pp. 300–305, 2000. View at Publisher · View at Google Scholar · View at Scopus
  90. J. P. Simmons, L. D. Nelson, J. Galak, and S. Frederick, “Are crowds wise when predicting against point spreads? It depends on how you ask,” in NA—Advances in Consumer Research, Association for Consumer Research, 2009. View at Google Scholar
  91. R. M. Hogarth, “A note on aggregating opinions,” Organizational Behavior and Human Performance, vol. 21, no. 1, pp. 40–46, 1978. View at Publisher · View at Google Scholar · View at Scopus
  92. S. Makridakis and R. L. Winkler, “Averages of forecasts: some empirical results,” Management Science, vol. 29, no. 9, pp. 987–996, 1983. View at Publisher · View at Google Scholar · View at Scopus
  93. O. Duru, E. Bulut, and S. Yoshida, “A fuzzy extended DELPHI method for adjustment of statistical time series prediction: an empirical study on dry bulk freight market case,” Expert Systems with Applications, vol. 39, no. 1, pp. 840–848, 2012. View at Publisher · View at Google Scholar · View at Scopus
  94. E. Servan-Schreiber, J. Wolfers, D. M. Pennock, and B. Galebach, “Prediction markets: does money matter?” Electronic Markets, vol. 14, no. 3, pp. 243–251, 2004. View at Publisher · View at Google Scholar
  95. G. M. Caporale and L. Gil-Alana, “Long memory and fractional integration in high frequency data on the US dollar/British pound spot exchange rate,” International Review of Financial Analysis C, vol. 29, pp. 1–9, 2013. View at Google Scholar
  96. O. Arazy, W. Morgan, and R. Patterson, “Wisdom of the crowds: decentralized knowledge construction in Wikipedia,” in Proceedings of the 16th Annual Workshop on Information Technologies & Systems (WITS '06) Paper, Milwaukee, Wis, USA, December 2006.
  97. J. Lorenz, H. Rauhut, F. Schweitzer, and D. Helbing, “How social influence can undermine the wisdom of crowd effect,” Proceedings of the National Academy of Sciences of the United States of America, vol. 108, no. 22, pp. 9020–9025, 2011. View at Publisher · View at Google Scholar · View at Scopus
  98. S. E. Page, The Difference: How the Power of Diversity Creates Better Groups, Firms, Schools, and Societies, Princeton University Press, Princeton, NJ, USA, 2007.
  99. J. G. March, “Exploration and exploitation in organizational learning,” Organization Science, vol. 2, no. 1, pp. 71–87, 1991. View at Publisher · View at Google Scholar
  100. W. G. Chase and H. A. Simon, “Perception in chess,” Cognitive Psychology, vol. 4, no. 1, pp. 55–81, 1973. View at Publisher · View at Google Scholar · View at Scopus
  101. J. A. Sniezek and T. Buckley, “Cueing and cognitive conflict in judge-advisor decision making,” Organizational Behavior and Human Decision Processes, vol. 62, no. 2, pp. 159–174, 1995. View at Publisher · View at Google Scholar · View at Scopus
  102. E. Mannix and M. A. Neale, “What differences make a difference? The promise and reality of diverse teams in organizations,” Psychological Science in the Public Interest, vol. 6, no. 2, pp. 31–55, 2005. View at Publisher · View at Google Scholar · View at Scopus
  103. N. D. Weinstein and W. M. Klein, “Unrealistic optimism: present and future,” Journal of Social and Clinical Psychology, vol. 15, no. 1, pp. 1–8, 1996. View at Publisher · View at Google Scholar · View at Scopus
  104. A. J. Rothman, W. M. Klein, and N. D. Weinstein, “Absolute and relative biases in estimations of personal risk,” Journal of Applied Social Psychology, vol. 26, no. 14, pp. 1213–1236, 1996. View at Publisher · View at Google Scholar · View at Scopus
  105. S. Asch, Social Psychology, Prentice Hall, Englewood Cliffs, NJ, USA, 1952.
  106. L. Festinger, “A theory of social comparison processes,” Human Relations, vol. 7, no. 2, pp. 117–140, 1954. View at Publisher · View at Google Scholar
  107. F. Galton, “Vox populi,” Nature, vol. 75, no. 1949, pp. 450–451, 1907. View at Publisher · View at Google Scholar · View at Scopus
  108. J. L. Treynor, “Market efficiency and the bean jar experiment,” Financial Analysts Journal, vol. 43, no. 3, pp. 50–53, 1987. View at Publisher · View at Google Scholar
  109. R. Hastie and T. Kameda, “The robust beauty of majority rules in group decisions,” Psychological Review, vol. 112, no. 2, pp. 494–508, 2005. View at Publisher · View at Google Scholar · View at Scopus
  110. C. R. Sunstein, Infotopia: How Many Minds Produce Knowledge, Oxford University Press, Oxford, UK, 2006.
  111. T. Kugler, E. E. Kausel, and M. G. Kocher, “Are groups more rational than individuals? A review of interactive decision making in groups,” Wiley Interdisciplinary Reviews: Cognitive Science, vol. 3, no. 4, pp. 471–482, 2012. View at Publisher · View at Google Scholar · View at Scopus
  112. R. Radner, “Bounded rationality, indeterminacy, and the theory of the firm,” The Economic Journal, vol. 106, no. 438, pp. 1360–1373, 1996. View at Publisher · View at Google Scholar · View at Scopus
  113. D. Paton, D. S. Siegel, and L. V. Williams, “The growth of gambling and prediction markets: economic and financial implications,” Economica, vol. 76, no. 302, pp. 219–224, 2009. View at Publisher · View at Google Scholar · View at Scopus