Computer-Based Diagnostic Expert Systems in Rheumatology: Where Do We Stand in 2014?

Alder, Hannes; Michel, Beat A.; Marx, Christian; Tamborrini, Giorgio; Langenegger, Thomas; Bruehlmann, Pius; Steurer, Johann; Wildi, Lukas M.

doi:https://doi.org/10.1155/2014/672714

International Journal of Rheumatology

On this page

Abstract Introduction Methods Results Discussion Conclusion References Copyright Related Articles

Review Article | Open Access

Volume 2014 | Article ID 672714 | https://doi.org/10.1155/2014/672714

Computer-Based Diagnostic Expert Systems in Rheumatology: Where Do We Stand in 2014?

Hannes Alder,¹Beat A. Michel,¹Christian Marx,²Giorgio Tamborrini,²Thomas Langenegger,³Pius Bruehlmann,¹Johann Steurer,⁴and Lukas M. Wildi¹

Academic Editor: Ronald F. van Vollenhoven

Received07 May 2014

Accepted20 Jun 2014

Published08 Jul 2014

Abstract

Background. The early detection of rheumatic diseases and the treatment to target have become of utmost importance to control the disease and improve its prognosis. However, establishing a diagnosis in early stages is challenging as many diseases initially present with similar symptoms and signs. Expert systems are computer programs designed to support the human decision making and have been developed in almost every field of medicine. Methods. This review focuses on the developments in the field of rheumatology to give a comprehensive insight. Medline, Embase, and Cochrane Library were searched. Results. Reports of 25 expert systems with different design and field of application were found. The performance of 19 of the identified expert systems was evaluated. The proportion of correctly diagnosed cases was between 43.1 and 99.9%. Sensitivity and specificity ranged from 62 to 100 and 88 to 98%, respectively. Conclusions. Promising diagnostic expert systems with moderate to excellent performance were identified. The validation process was in general underappreciated. None of the systems, however, seemed to have succeeded in daily practice. This review identifies optimal characteristics to increase the survival rate of expert systems and may serve as valuable information for future developments in the field.

1. Introduction

Rheumatologic diseases manifest themselves in varying combinations of symptoms and signs, particularly at early stages, and therefore make differential diagnosis a challenge, especially for nonrheumatologists including general practitioners. Since diagnosis at an early stage and adequate treatment improve prognosis, assistance in establishing diagnosis is desirable. Given the substantial progress in computer science in the last years, the idea of computers taking the role of diagnostic support is not far-fetched. Software applications have affected decision processes in clinical routine, for example, in controlling depth of anesthesia [1] or in detecting drug interactions [2]. Software tools to support physicians in the diagnostic process have been developed in almost every field of medicine. A widely utilized type is the so-called expert system, defined as artificial intelligence program designed to provide expert-level solutions to complex problems [3]. Figures 1 and 2 give an overview of the concept.

Figure 2

Typical structure of a knowledge-based expert system. Based on Buchanan [3], the user interface allows the nonexpert to enter the symptoms and findings [3] and presents the diagnostic output. The knowledge base provides the knowledge. Different ways of representation, such as rules, models, or cases, can be chosen. The inference engine examines the knowledge base and produces reasoning [15]. The knowledge engineering tool allows for changing or enlarging the knowledge base by adding further rules, cases, or models [7]. There may also be an explaining component, which illustrates the diagnostic process and which gives a rationale [7]. A knowledge-based expert system with an empty knowledge base is called shell. It can be used for the development of other expert systems by adding a new knowledge base [7].

Pandey and Mishra distinguished between knowledge-based systems and intelligent computing systems [4]. There are three different approaches to knowledge-based systems depending on the form of knowledge representation: rule based, case based, and model based. In rule based reasoning, the knowledge is expressed by rules, often IF⋯ THEN⋯ rules [4]. The rules can be newly developed or can be extracted from decision tables or decision trees [5]. In case of based reasoning, the inference engine searches the knowledge base for similar cases. Finally, models, that is, biochemical or biophysical, can also form the knowledge [4]. The typical knowledge-based expert system consists of four parts. Figure 2 illustrates its structure.

The approaches to intelligent computing systems are artificial neuron nets, genetic algorithm, and fuzzy systems. Artificial neuron nets are built like biologic intelligent nervous systems and are regarded as learn-like [4]. Individual variables receive inhibitory and excitatory inputs like neurons. The calculations are made in parallel, not only sequentially like in other methodologies [6]. Genetic algorithm mimics the process of natural evolution and is mainly used in search processes. Fuzzy systems are usually based on rules, but the reasoning is approximate to cope with uncertainty and imprecision because the rules are given varying truth-value using fuzzy sets [7]. Thus, linguistic certainty or frequency levels, such as probable or seldom, derived from medical texts or experts can be incorporated into the knowledge base [8].

Bayes’ theorem is a statistical method. The probability of a diagnosis is calculated with the accuracy of a test or a clinical finding and the prevalence of the disease [9]. Thus Bayes’ theorem sets probabilistic values for each diagnostic output [4].

Different methodologies are often combined, which are then called hybrid expert systems [10].

Already in 1959, Ledley and Lusted anticipated the use of computers in supporting decisions and proposed different mathematical models to emulate the reasoning in medical diagnosis [11]. Since then, the number of expert systems in medicine has grown rapidly. The first expert systems were developed in the 1970’s. Two well-known pioneer expert systems are MYCIN and INTERNIST-1. They were archetypes for following expert systems, but they also demonstrated the challenges in the development of such tools. MYCIN was developed at the Stanford University in the 1970s. It was used for diagnosis and therapy of bacterial infection and has become the probably best-known expert system in medicine [3]. INTERNIST-1 was developed at the University of Pittsburgh [12]. It was designed to assist physicians in the diagnosis of complex and multiple diseases in internal medicine covering more than five hundred diseases [13]. The problems encountered in developing INTERNIST-1 and its successors showed that a comprehensive knowledge base is needed for a correct diagnosis of complex diseases in internal medicine [7].

Several somewhat outdated review articles explored the development and application of expert systems in medicine in general [4, 10, 14]. In 1991, Bernelot Moens and van der Korst reviewed the literature assessing computer-assisted diagnosis of rheumatic diseases [15]. Meanwhile, also in rheumatology new expert systems have emerged and earlier expert systems have been improved to meet the many demands of modern rheumatology: establishing an early diagnosis with the highest probability to allow for a better outcome with the help of a prompt treatment.

Besides an overview of characteristics, comprehensiveness, and validation of existing diagnostic expert systems in rheumatology, this systematic review seeks to point out whether the current expert systems fulfill the expectations of clinicians in daily practice and finally what the characteristics of an optimal system would be.

2. Methods

The systematic literature review was carried out following the PRISMA statement [16]. No ethics board approval or consent of any individual was necessary. The research questions were as follows: what information is currently available on diagnostic expert systems in rheumatology, how do these systems work, what is their validity and their applicability in daily practice, and finally what is an optimal diagnostic expert system expected to be.

2.1. Scenarios

In the optimal scenario we anticipated to find comprehensive reports on each individual diagnostic expert system including information on the precise diagnostic algorithm, the targeted diseases, a well-described validation cohort, and predictive values for diagnostic performance. The data would allow for a statistical comparison of the expert systems. In a suboptimal scenario, only descriptive reports of expert systems will be found allowing for a comprehensive overview of the past developments without statistical comparability.

2.2. Systematic Literature Search

Medline, Embase, and Cochrane Library were searched using the following Medical Subject Heading (MESH) terms: “rheumatic diseases,” “rheumatology,” “arthritis,” “computer assisted diagnosis,” and “expert systems.” No restrictions were placed on publication date. Only literature in English or German was considered. The last search was run on February 10, 2014.

2.3. Selection of Articles

The literature was screened based on title and abstract of the records. All publications referring to diagnostic expert systems in rheumatology or in a rheumatic subfield were included. Reviews, editorials, and literature which described an expert system only used for education of healthcare providers and therefore not used in diagnostics were excluded. Also, literature that referred to an expert system used for identifying solely the stage of a disease and hence not used for diagnosing a disease itself was excluded. Records which described an expert system applied only to image analysis were not considered either. Literature referring to data mining strategies using index diagnoses or solely epidemiological variables was excluded as well. Figure 3 shows a flow diagram of the selection of studies. In case of uncertainties, inclusion or exclusion was based on consensus.

2.4. Data Extraction and Statistical Analysis

Year of the last update of the system, number of considered rheumatic diseases, targeted diseases, information to feed the expert systems (history, clinical exam, laboratory analyses, and imaging studies), methodology of the inference mechanism, and embedding of accepted disease criteria sets such as the American College of Rheumatology (ACR) or The European League Against Rheumatism (EULAR) criteria were extracted using standard forms.

For the description of the validation method and the performance, the following information was extracted from the articles: number of cases used for the validation, determination of the resulting diagnosis, identification of the correct diagnosis, the reference diagnosis, percentage of correctly identified cases, sensitivity and specificity, positive predictive values, negative predictive values, positive likelihood ratio, and negative likelihood ratio.

Only descriptive statistics are reported. Statistical analyses could not be performed due to the lack of information.

3. Results

3.1. Literature Searches

A total of 10,282 references were identified using the search strategy. Seventy-three articles related to diagnostic expert systems in rheumatology were included. Nine duplicates were excluded. The remaining 64 full text articles were then assessed. One record describing an expert system developed solely for education [17] and one record referring to an expert system that was not designed for clinical use [18] were excluded. Six reviews or editorials were excluded [6, 15, 19–22]. In the case of repeated reports, either the original or the more comprehensive article was included in the evaluation leading to a final number of 38 original articles (Figure 3). In these 38 articles, 25 different expert systems and their successors or further developments are presented. Most of the articles shown in this review presented the development and the methodology of expert systems.

3.2. Characteristics of the Identified Expert Systems

Table 1 gives an overview over the 25 identified expert systems and their characteristics. The number of considered diseases varies from one to 170. Both the amount and the nature of information to feed the expert systems vary according to the targeted disease group and inference mechanisms. The following methodologies of expert systems were observed: rule based, case based, model based, artificial neuron nets, fuzzy systems, Bayes’ theorem, and other not further described algorithms or calculation tools (Figure 1). Rule-based systems were the most frequent. Twelve different spectra of targeted diseases were found. Six expert systems used ACR or EULAR criteria to establish a diagnosis.

3.3. Validation

Table 2 summarizes the validation of the expert systems. 19 of the 25 expert systems (76%) were validated. The number of cases used for the validation varied widely between 32 real cases and 12 000 simulated patients. Different units of measurement were selected to report the performance of the expert systems, mostly the percentage of correctly diagnosed cases, sensitivity and specificity. The proportion of correctly diagnosed cases—the diagnostic accuracy—was between 43.1 and 99.9%. Values for sensitivity and specificity ranged from 62 to 100, and 88 to 98%, respectively. Positive or negative predictive values and likelihood ratios were only surveyed for two expert systems [26, 27]. Liu et al. reached a positive predictive value of 91%. Binder et al. showed a positive likelihood ratio of 12.1 (95% CI 7.70–19.1) and a negative likelihood ratio of 0.187 (95% CI 0.099–0.351). Excluding this last report, confidence intervals were not indicated.

The reference standards were chosen differently: diagnoses according to established criteria, consensus diagnoses, discharge diagnoses, and diagnoses provided by a rheumatologist were used most often as reference. Three expert systems presented certain criteria for the determination of the resulting diagnosis when several diagnoses were presented as a result or when a probability value was added to the diagnosis. Table 3 presents the chosen reference diagnoses and the determinations of the resulting diagnoses.

An article that reports on the applicability of a rheumatological expert system in clinical routine could not be identified in the published literature.

4. Discussion

The main result of this systematic review is threefold. First, an overview over 25 different diagnostic expert systems designed for rheumatology is given. Second, it is shown that the different designs and validation methods of the expert systems hinder the comparison of their performances. Third, we found no publications reporting on the routine application of an expert system in rheumatology.

Artificial intelligence has achieved enormous progress in its development and computers have outclassed human beings in various fields, such as computer chess or IBM’s Watson winning on the quiz show “Jeopardy!” Given this progress in technology and the time period covered by this systematic review of over forty years, the low number of identified expert system is surprising. The reasons would be either low interest in supportive software or, more likely, the difficulties encountered in simulating the complex human diagnostic process. Spreckelsen et al. [60] reported that developers of knowledge-based systems regarded pharmacovigilance, intensive care monitoring, and support for guidelines and clinical pathways as the most promising fields of knowledge-based systems. In other words, systems covering clearly defined decision rules or comparing databases. Diagnostic support was less favorably judged. In rheumatology in particular, the diagnostic process is hampered by multiple factors. First of all, nonspecific findings occurring in multiple rheumatic diseases are common and consequently complicate the knowledge representation in expert systems. Second, there is a lack of epidemiological data concerning the prevalence and incidence of rheumatic diseases as well as sensitivity and the specificity of single findings in diseases. Third, even if available for a large population, such data vary greatly amongst ethnic groups and regions becoming an increasing problem in times of global migration. Fourth, for many of the disease-specific findings, there are no internationally established standardized cut-off values. And finally, many rheumatic diseases can coexist with each other in overlap syndromes.

Nevertheless, the growing understanding of diseases and the corresponding findings or symptoms will facilitate the representation of medical knowledge and decision processes in the future.

4.1. Validation of Expert Systems

In consequence of the variation in the method of validation, the achieved validation results could not be compared with each other. The reason for this variability probably lies in two elements.

First, the result of the expert systems to be compared with the reference diagnosis was presented in different ways. Some expert systems indicated a probability value of the calculated resulting diagnosis, and others present a hypotheses list. Final diagnoses in rheumatology often remain descriptive or incomplete and evolve over time as many of the rheumatic disorders present atypically and do not completely fulfill a diagnostic criteria set at the beginning. This issue is met by the presentation of the results as a hypotheses list or probability values, which can, as an important advantage, multiply the user’s own differential diagnosis and lead to more focused testing. Yet, this method causes difficulties in the validation and the comparison of expert systems. For example, the diagnostic accuracy is erroneously high if a diagnosis at a low position in the hypotheses list or a diagnosis with a low probability value is accepted as a correct resulting diagnosis during the validation process.

Second, there is a lack of widely accepted reference standards for the correct diagnosis to compare the resulting diagnosis with. Some authors used diagnoses in medical records or discharge diagnoses as a comparator assuming the correctness of their peers, some chose the consensus of rheumatologists, and others used diagnoses according to official diagnostic criteria sets. The latter is probably the most reliable way; however, even if international consensus criteria exist, there are still many different criteria sets especially for rare diseases where the superiority of one set over the other and in particular the threshold for a diagnosis remains a matter of debate. In addition, many of these criteria sets were established to obtain homogenous cohorts in clinical trials leading to a low sensitivity in early or mild disease.

Another approach was the assessment of the interobserver variability by Hernandez et al. [34] and Martín-Baranera et al. [35]. Here, the distance between the resulting diagnoses of clinicians and RENOIR was calculated without setting a reference diagnosis. By this means the uncertainty of the final diagnosis and the error proneness of clinicians were taken into account.

The transferability of expert systems to the general population (the external validity) can be tested with a validation in a developer-independent clinical setting. Only AI/RHEUM, CADIAG, and RHEUMA [29, 39, 40, 49] were validated this way, resulting in a lack of data on the transferability to daily practice of most of the presently available expert systems.

4.2. Clinical Use and Requirements of Expert Systems in Practice

Besides the internal and external validity, the following features are, according to Kawamoto et al., highly associated with an expert system’s ability to improve clinical practice: the availability at the time and location of decision making, the integration into clinical workflow, and the provision of recommendations rather than a pure assessment [61]. The wider use of computers in clinical routine, such as the possible use of tablet computers on ward rounds, will facilitate the integration into clinical workflow and enhance the availability at the time and location of decision making. The need of more detailed documentation for quality assurance may have a positive influence as well. Boegl et al. are the only authors who reported the clinical use of their diagnostic expert system Cadiag-4/Rheuma-Radio. The expert system was incorporated in the medical information system of the respective clinic [30]. For the lack of accessibility of diagnostic support, the universally present search engines for the World Wide Web have become a popular alternative with an astonishing accuracy as shown by Tang and Ng [62] and Lombardi et al. [63].

Kolarz et al. [37] and Schewe and Schreiber [49] regarded the time required for data input as the most limiting factor. Considering the smaller amount of input data and consequently the shorter input time, specialized and restricted expert systems like the laboratory results analyzing system presented by Binder et al. [26] have the edge over more comprehensive systems. Kaplan [41] presented a system with a provisional hypothesis list, which updates after every further input. Here, the data input is limited; hence, there is a risk of missed diagnoses due to the less thorough questioning. The required time for data input would decrease if the expert system was compatible with the institutional medical information system and consequently could allow direct access to all electronically stored patient data comprising patient history, physical exam, imaging studies, and laboratory analyses. The latter include the increasingly important biomarkers [64, 65]. Then again the data input and the required time depend on an intuitive user interface, which Boegl et al. believed to have the biggest influence on the clinical success [30].

The reason for the absence of expert systems in clinical use hitherto has been discussed in detail in the literature. Mandl and Kohane claimed that health information technology in general was in arrears compared to other industries. Also they took the health information technology products as too specific and incompatible with each other [66]. Spreckelsen et al. evaluated an online survey of researchers and developers of knowledge-based systems. They stated that the lack of acceptance by the medical staff is the main problem in the application of knowledge-based systems in medicine [60]. The different points of view of developers and clinicians show that a better cooperation is necessary. Expert systems have to be adapted to clinical problems and to clinical workflow. On the other hand, clinicians should become more aware of the supportive possibilities of expert systems.

4.3. Importance of Targeted User Group

In spite of computerized assistance, the user of the expert system needs rheumatologic fundamentals for the detection and the correct description of rheumatologic findings. CADIAG, AI/RHEUM, RENOIR, RHEUMexpert, and MESICAR were specifically developed for the assistance of nonrheumatologists [31, 37, 39, 48, 50]. These systems were designed to remind the nonspecialist of rare diseases or to indicate the cases which needed immediate treatment. Yet, an expert system’s outcome highly depends on the entry of correct parameters. Therefore, educational parts were added to some of the expert systems to increase the user’s diagnostic skills. These educational parts explain certain symptoms or show photographs of findings [30, 42, 51]. Also, some systems provided a link to literature, such as Medline, for further information [30, 42]. The AI/RHEUM and CADIAG project presented the most extensive educational parts. A widely accepted system ideally covers the demands of generalists and specialists offering an easy understandable handling and not being too basic at the same time.

4.4. Diagnostic Criteria Sets

The integration of widely accepted diagnostic criteria sets such as the ACR or EULAR criteria into the diagnostic process would increase the acceptance and credibility of an expert system. It also reduces the influence of individual diagnostic strategies of the developers. Nevertheless, only six of the identified expert systems reported the integration of such criteria sets into their expert database. The downside of diagnostic criteria originating primarily from classification criteria for the inclusion into clinical trials, however, is the generally low sensitivity in early disease. This insensitivity of some criteria, such as the 1987 ARA criteria for rheumatoid arthritis, forced Leitich et al. to modify the criteria using fuzzy sets to gain different levels of sensitivity [32]. The recent development of official diagnostic criteria, which are more dedicated to the diagnosis in an early stage of the disease [67], will make their use in the design of expert systems more attractive. Furthermore, some methodologies are ill suited to the use of diagnostic criteria, such as a mere probabilistic approach like Bayes’ theorem or artificial neural network. These systems extract their knowledge base from patient data, such as symptoms and clinical findings, and the corresponding diagnoses assuming a correctness of the chosen diagnosis. Diagnostic criteria cannot be included in these systems without the combination with another methodology or an adaption of the reasoning process like the review of symptom weighing. Other ways of knowledge representation facilitate the usage of official diagnostic criteria, like rule-based reasoning though the minority of the articles presenting a rule-based expert system reported an integration of official diagnostic criteria.

4.5. Limitations

Although a thorough systematic search has been performed in the most relevant databases, some reports could have been missed if written in other languages than English or German. As most of the current literature is published in English at least as an abstract, we are confident that we did not miss relevant articles on diagnostic expert systems in rheumatology. The number of expert systems which have remained unpublished because of their expected commercial use or the abortion of the system at an early stage is hard to estimate.

The reported expert systems showed a great variety in diseases spectrum, methodology, and validation status. This made a statistical comparison of the systems impossible.

And finally, the important topic of patient reported outcomes which are of increasing importance not only in clinical trials and patient’s follow-up but also in the diagnostic process was beyond the scope of this review.

5. Conclusion

In conclusion, this systematic review shows that the many attempts made for an ideal expert system in rheumatology in the past decades have not yet resulted in convincing validated tools allowing for reliable application in daily practice. Nevertheless, the demand in support by expert systems is pressing as the knowledge about the rheumatic diseases increases and the therapeutic options especially in early disease stages are growing constantly. An ideal diagnostic expert system in rheumatology would have the following characteristics. The expert system would allow for universal integration into the clinical workflow as well as rapid and intuitive data input. Since rheumatologic diagnoses cannot always be definite, the resulting diagnosis would have a probabilistic grade to indicate uncertainty. The system would also have an educational component to improve the nonexpert’s ability to recognize pathological findings. Finally, accepted diagnostic criteria sets would be applied to increase the general validity of the system’s diagnostic process.

Based on the demand of such a tool and the progress made hitherto it seems to be a matter of time until new and promising expert systems enter clinical practice.

Conflict of Interests

The authors declare that there is no conflict of interests regarding the publication of this paper.

Authors’ Contribution

All authors have made substantial contribution to the analysis and interpretation of the data, have been involved in the revising of the manuscript, and have given final approval of the version to be published. Hannes Alder and Lukas M. Wildi were responsible for conception, design, and drafting of the manuscript, and Hannes Alder performed the data acquisition.

Acknowledgment

This study was supported by the University Hospital of Zurich, Zurich, Switzerland.

References

G. N. Schmidt, J. Müller, and P. Bischoff, “Measurement of the depth of anaesthesia,” Anaesthesist, vol. 57, no. 1, pp. 9–30, 2008.
View at: Google Scholar
K. A. McKibbon, C. Lokker, S. M. Handler et al., “The effectiveness of integrated health information technologies across the phases of medication management: a systematic review of randomized controlled trials,” Journal of the American Medical Informatics Association, vol. 19, no. 1, pp. 22–30, 2012.
View at: Publisher Site | Google Scholar
B. G. Buchanan, Rule Based Expert Systems: The Mycin Experiments of the Stanford Heuristic Programming Project, Addison-Wesley Longman, Reading, Mass, USA, 1984.
B. Pandey and R. B. Mishra, “Knowledge and intelligent computing system in medicine,” Computers in Biology and Medicine, vol. 39, no. 3, pp. 215–230, 2009.
View at: Publisher Site | Google Scholar
T. M. Lehmann, Handbuch der Medizinischen Informatik, Hanser, München, Germany, 2002.
M. L. Astion, D. A. Bloch, and M. H. Wener, “Neural networks as expert systems in rheumatic disease diagnosis: artificial intelligence or intelligent artifice?” Journal of Rheumatology, vol. 20, no. 9, pp. 1465–1468, 1993.
View at: Google Scholar
G. Gottlob, T. Frühwirth, W. Horn, and G. Fleischanderl, Expertensysteme, Springer, Wien, Austria, 1990.
K. P. Adlassnig, G. Kolarz, and W. Scheithauer, “Present state of the medical expert system CADIAG-2,” Methods of Information in Medicine, vol. 24, no. 1, pp. 13–20, 1985.
View at: Google Scholar
M. Sadatsafavi, A. Moayyeri, H. Bahrami, and A. Soltani, “The value of Bayes theorem in the interpretation of subjective diagnostic findings: what can we learn from agreement studies?” Medical Decision Making, vol. 27, no. 6, pp. 735–743, 2007.
View at: Publisher Site | Google Scholar
A. N. Ramesh, C. Kambhampati, J. R. T. Monson, and P. J. Drew, “Artificial intelligence in medicine,” Annals of the Royal College of Surgeons of England, vol. 86, no. 5, pp. 334–338, 2004.
View at: Publisher Site | Google Scholar
R. S. Ledley and L. B. Lusted, “Reasoning foundations of medical diagnosis; symbolic logic, probability, and value theory aid our understanding of how physicians reason,” Science, vol. 130, no. 3366, pp. 9–21, 1959.
View at: Publisher Site | Google Scholar | Zentralblatt MATH
R. A. Miller, H. E. Pople Jr., and J. D. Myers, “Internist-I, an experimental computer-based diagnostic consultant for general internal medicine,” The New England Journal of Medicine, vol. 307, no. 8, pp. 468–476, 1982.
View at: Publisher Site | Google Scholar
R. A. Miller, M. A. McNeil, S. M. Challinor, F. E. Masarie Jr., and J. D. Myers, “The internist-1/quick medical reference project—status report,” Western Journal of Medicine, vol. 145, no. 6, pp. 816–822, 1986.
View at: Google Scholar
S. Liao, “Expert system methodologies and applications—a decade review from 1995 to 2004,” Expert Systems with Applications, vol. 28, no. 1, pp. 93–103, 2005.
View at: Publisher Site | Google Scholar
H. J. Bernelot Moens and J. K. van der Korst, “Computer-assisted diagnosis of rheumatic disorders,” Seminars in Arthritis and Rheumatism, vol. 21, no. 3, pp. 156–169, 1991.
View at: Publisher Site | Google Scholar
D. Moher, A. Liberati, J. Tetzlaff, D. G. Altman, and P. Group, “Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement,” OpenMed, vol. 3, no. 3, pp. e123–e130, 2009.
View at: Google Scholar
J. D. McCrea, M. R. E. McCredie, D. M. G. McSherry, and P. M. Brooks, “A controlled evaluation of diagnostic criteria in the development of a rheumatology expert system,” British Journal of Rheumatology, vol. 28, no. 1, pp. 13–17, 1989.
View at: Publisher Site | Google Scholar
S. E. Gabriel, C. S. Crowson, and W. M. O'Fallon, “A mathematical model that improves the validity of osteoarthritis diagnoses obtained from a computerized diagnostic database,” Journal of Clinical Epidemiology, vol. 49, no. 9, pp. 1025–1029, 1996.
View at: Publisher Site | Google Scholar
G. P. Balint and W. W. Buchanan, “Diagnosis of rheumatic disease: a plea for contemplation of the future,” British Journal of Rheumatology, vol. 25, no. 4, pp. 399–401, 1986.
View at: Publisher Site | Google Scholar
B. Montgomery, “Computers in medicine,” The Journal of the American Medical Association, vol. 240, no. 24, pp. 2613–2617, 1978.
View at: Publisher Site | Google Scholar
N. Thumb, “Clinical diagnostic strategy in rheumatology,” Zeitschrift fur die Gesamte Innere Medizin und Ihre Grenzgebiete, vol. 42, no. 15, pp. 431–434, 1987.
View at: Google Scholar
M. H. Wener, “Multiplex, megaplex, index, and complex: the present and future of laboratory diagnostics in rheumatology,” Arthritis Research & Therapy, vol. 13, no. 6, article 134, 2011.
View at: Publisher Site | Google Scholar
C. L. Romano, D. Romano, C. Bonora, A. Degrate, and G. Mineo, “Combined diagnostic tool for joint prosthesis infections,” Le Infezioni in Medicina: Rivista Periodica di Eziologia, Epidemiologia, Diagnostica, Clinica e Terapia delle Patologie Infettive, vol. 17, no. 3, pp. 141–150, 2009.
View at: Google Scholar
E. W. Watt and A. A. T. Bui, “Evaluation of a dynamic bayesian belief network to predict osteoarthritic knee pain using data from the osteoarthritis initiative,” AMIA—Annual Symposium proceedings / AMIA Symposium. AMIA Symposium, pp. 788–792, 2008.
View at: Google Scholar
D. A. Provenzano, G. J. Fanciullo, R. N. Jamison, G. J. McHugo, and J. C. Baird, “Computer assessment and diagnostic classification of chronic pain patients,” Pain Medicine, vol. 8, no. 3, supplement, pp. S167–S175, 2007.
View at: Publisher Site | Google Scholar
S. R. Binder, M. C. Genovese, J. T. Merrill, R. I. Morris, and A. L. Metzger, “Computer-assisted pattern recognition of autoantibody results,” Clinical and Diagnostic Laboratory Immunology, vol. 12, no. 12, pp. 1353–1357, 2005.
View at: Publisher Site | Google Scholar
H. Liu, J. O. Harker, A. L. Wong et al., “Case finding for population-based studies of rheumatoid arthritis: comparison of patient self-reported ACR criteria-based algorithms to physician-implicit review for diagnosis of rheumatoid arthritis,” Seminars in Arthritis and Rheumatism, vol. 33, no. 5, pp. 302–310, 2004.
View at: Publisher Site | Google Scholar
C. K. Lim, K. M. Yew, K. H. Ng, and B. J. J. Abdullah, “A proposed hierarchical fuzzy inference system for the diagnosis of arthritic diseases,” Australasian Physical and Engineering Sciences in Medicine, vol. 25, no. 3, pp. 144–150, 2002.
View at: Publisher Site | Google Scholar
H. Leitich, H. P. Kiener, G. Kolarz, C. Schuh, W. Graninger, and K. P. Adlassnig, “A prospective evaluation of the medical consultation system CADIAG-II/RHEUMA in a rheumatological outpatient clinic,” Methods of Information in Medicine, vol. 40, no. 3, pp. 213–220, 2001.
View at: Google Scholar
K. Boegl, F. Kainberger, K. P. Adlassnig et al., “New approaches to computer-assisted diagnosis of rheumatologic diseases,” Radiologe, vol. 35, no. 9, pp. 604–610, 1995.
View at: Google Scholar
G. Kolarz and K. Adlassnig, “Problems in establishing the medical expert systems CADIAG-1 and CADIAG-2 in rheumatology,” Journal of Medical Systems, vol. 10, no. 4, pp. 395–405, 1986.
View at: Publisher Site | Google Scholar
H. Leitich, K.-P. Adlassnig, and G. Kolarz, “Development and evaluation of fuzzy criteria for the diagnosis of rheumatoid arthritis,” Methods of Information in Medicine, vol. 35, no. 4-5, pp. 334–342, 1996.
View at: Google Scholar
K. P. Adlassing, G. Kolarz, W. Scheithauer, H. Effenberger, and G. Grabner, “CADIAG: approaches to computer-assisted medical diagnosis,” Computers in Biology and Medicine, vol. 15, no. 5, pp. 315–335, 1985.
View at: Publisher Site | Google Scholar
C. Hernandez, J. J. Sancho, M. A. Belmonte, C. Sierra, and F. Sanz, “Validation of the medical expert system RENOIR,” Computers and Biomedical Research, vol. 27, no. 6, pp. 456–471, 1994.
View at: Publisher Site | Google Scholar
M. Martín-Baranera, J. J. Sancho, and F. Sanz, “Controlling for chance agreement in the validation of medical expert systems with no gold standard: PNEUMON-IA and RENOIR revisited,” Computers and Biomedical Research, vol. 33, no. 6, pp. 380–397, 2000.
View at: Publisher Site | Google Scholar
L. Godo, R. López de Mántaras, J. Puyol-Gruart, and C. Sierra, “Renoir, Pneumon-IA and Terap-IA: three medical applications based on fuzzy logic,” Artificial Intelligence in Medicine, vol. 21, no. 1–3, pp. 153–162, 2001.
View at: Publisher Site | Google Scholar
G. Kolarz, K. P. Adlassnig, and K. Bögl, “RHEUMexpert: a documentation and expert system for rheumatic diseases,” Wiener Medizinische Wochenschrift, vol. 149, no. 19-20, pp. 572–574, 1999.
View at: Google Scholar
B. Zupan and S. Džeroski, “Acquiring background knowledge for machine learning using function decomposition: a case study in rheumatology,” Artificial Intelligence in Medicine, vol. 14, no. 1-2, pp. 101–117, 1998.
View at: Publisher Site | Google Scholar
H. J. Bernelot Moens, “Validation of the AI/RHEUM knowledge base with data from consecutive rheumatological outpatients,” Methods of Information in Medicine, vol. 31, no. 3, pp. 175–181, 1992.
View at: Google Scholar
J. F. Porter, L. C. Kingsland III, D. A. B. Lindberg et al., “The AI-RHEUM knowledge-based computer consultant system in rheumatology. Performance in the diagnosis of 59 connective tissue disease patients from Japan,” Arthritis & Rheumatism, vol. 31, no. 2, pp. 219–226, 1988.
View at: Publisher Site | Google Scholar
R. S. Kaplan, “AI/Consult: a prototype directed history system based upon the AI/Rheum knowledge base,” Proceedings of the Annual Symposium on Computer Application [sic] in Medical Care. Symposium on Computer Applications in Medical Care, pp. 639–643, 1991.
View at: Google Scholar
B. H. Athreya, M. L. Cheh, and L. C. Kingsland III, “Computer-assisted diagnosis of pediatric rheumatic diseases,” Pediatrics, vol. 102, no. 4, article E48, 1998.
View at: Publisher Site | Google Scholar
L. C. Kingsland III, D. A. B. Lindberg, and G. C. Sharp, “AI/RHEUM—a consultant system for rheumatology,” Journal of Medical Systems, vol. 7, no. 3, pp. 221–227, 1983.
View at: Publisher Site | Google Scholar
S. Dzeroski and N. Lavrac, “Rule induction and instance-based learning applied in medical diagnosis,” Technology and Health Care, vol. 4, no. 2, pp. 203–221, 1996.
View at: Google Scholar
I. Heller, A. Isakov, S. Blinder-Weiner, and M. Topilsky, “Bayesian classification of vasculitis: a simulation study,” Methods of Information in Medicine, vol. 34, no. 3, pp. 259–265, 1995.
View at: Google Scholar
M. L. Astion, M. H. Wener, R. G. Thomas, G. G. Hunder, and D. A. Bloch, “Application of neural networks to the classification of giant cell arteritis,” Arthritis and Rheumatism, vol. 37, no. 5, pp. 760–770, 1994.
View at: Publisher Site | Google Scholar
J. M. Barreto and F. M. de Azevedo, “Connectionist expert systems as medical decision aid,” Artificial Intelligence in Medicine, vol. 5, no. 6, pp. 515–523, 1993.
View at: Publisher Site | Google Scholar
G. Widmer, W. Horn, and B. Nagele, “Automatic knowledge base refinement: learning from examples and deep knowledge in rheumatology,” Artificial Intelligence in Medicine, vol. 5, no. 3, pp. 225–243, 1993.
View at: Publisher Site | Google Scholar
S. Schewe and M. A. Schreiber, “Stepwise development of a clinical expert system in rheumatology,” Clinical Investigator, vol. 71, no. 2, pp. 139–144, 1993.
View at: Google Scholar
H. J. Bernelot Moens and J. K. van der Korst, “Comparison of rheumatological diagnoses by a Bayesian program and by physicians,” Methods of Information in Medicine, vol. 30, no. 3, pp. 187–193, 1991.
View at: Google Scholar
H. J. Bernelot Moens and J. K. van der Korst, “Development and validation of a computer program using Bayes's theorem to support diagnosis of rheumatic disorders,” Annals of the Rheumatic Diseases, vol. 51, no. 2, pp. 266–271, 1992.
View at: Publisher Site | Google Scholar
H. J. Bernelot Moens, A. J. Hishberg, and A. A. M. C. Claessens, “Data-source effects on the sensitivities and specificities of clinical features in the diagnosis of rheumatoid arthritis: the relevance of multiple sources of knowledge for a decision-support system,” Medical Decision Making, vol. 12, no. 4, pp. 250–258, 1992.
View at: Publisher Site | Google Scholar
D. Sereni, A. Venot, M. Forest et al., “Clinical and computer-aided diagnosis of temporal arteritis,” European Journal of Internal Medicine, vol. 2, no. 2, pp. 81–90, 1991.
View at: Google Scholar
A. S. Rigby, “Development of a scoring system to assist in the diagnosis of rheumatoid arthritis,” Methods of Information in Medicine, vol. 30, no. 1, pp. 23–29, 1991.
View at: Google Scholar
S. Schewe, P. Herzer, and K. Kruger, “Prospective application of an expert system for the medical history of joint pain,” Klinische Wochenschrift, vol. 68, no. 9, pp. 466–471, 1990.
View at: Publisher Site | Google Scholar
R. M. Prust, “Diagnostic knowledge base construction,” Medical Informatics, vol. 11, no. 1, pp. 83–88, 1986.
View at: Publisher Site | Google Scholar
G. Gini and M. Gini, “A serial model for computer assisted medical diagnosis,” International Journal of Bio-Medical Computing, vol. 11, no. 2, pp. 99–113, 1980.
View at: Publisher Site | Google Scholar
C. Dostál and J. Nikl, “Application of the information theory in automatic data processing and diagnosis of rheumatic diseases,” Zeitschrift fur die Gesamte Innere Medizin und Ihre Grenzgebiete, vol. 27, no. 9, pp. 395–398, 1972.
View at: Google Scholar
J. F. Fries, “Experience counting in sequential computer diagnosis,” Archives of Internal Medicine, vol. 126, no. 4, pp. 647–651, 1970.
View at: Publisher Site | Google Scholar
C. Spreckelsen, K. Spitzer, and W. Honekamp, “Present situation and prospect of medical knowledge based systems in German-speaking countries,” Methods of Information in Medicine, vol. 51, no. 4, pp. 281–294, 2012.
View at: Publisher Site | Google Scholar
K. Kawamoto, C. A. Houlihan, E. A. Balas, and D. F. Lobach, “Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success,” The British Medical Journal, vol. 330, no. 7494, pp. 765–768, 2005.
View at: Publisher Site | Google Scholar
H. Tang and J. H. K. Ng, “Googling for a diagnosis—use of Google as a diagnostic aid: Internet based study,” British Medical Journal, vol. 333, no. 7579, pp. 1143–1145, 2006.
View at: Publisher Site | Google Scholar
C. Lombardi, E. Griffiths, B. McLeod, A. Caviglia, and M. Penagos, “Search engine as a diagnostic tool in difficult immunological and allergologic cases: is Google useful?” Internal Medicine Journal, vol. 39, no. 7, pp. 459–464, 2009.
View at: Publisher Site | Google Scholar
D. S. Gibson, M. E. Rooney, S. Finnegan et al., “Biomarkers in rheumatology, now and in the future,” Rheumatology, vol. 51, no. 3, Article ID ker358, pp. 423–433, 2012.
View at: Publisher Site | Google Scholar
W. H. Robinson, T. M. Lindstrom, R. K. Cheung, and J. Sokolove, “Mechanistic biomarkers for clinical decision making in rheumatic diseases,” Nature Reviews Rheumatology, vol. 9, no. 5, pp. 267–276, 2013.
View at: Publisher Site | Google Scholar
K. D. Mandl and I. S. Kohane, “Escaping the EHR trap—the future of health IT,” The New England Journal of Medicine, vol. 366, no. 24, pp. 2240–2242, 2012.
View at: Publisher Site | Google Scholar
C. Alves, J. J. Luime, D. Van Zeben et al., “Diagnostic performance of the ACR/EULAR 2010 criteria for rheumatoid arthritis and two diagnostic algorithms in an early arthritis clinic (REACH),” Annals of the Rheumatic Diseases, vol. 70, no. 9, pp. 1645–1647, 2011.
View at: Publisher Site | Google Scholar

Copyright

Copyright © 2014 Hannes Alder et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

10147

Downloads

3763

Citations