Internet of Medical Things for Healthcare EngineeringView this Special Issue
Research Article | Open Access
Li He, Zi Yi Zhou, Fu Sheng Niu, Yu Fan Yang, Qiang Xu, Chuan Biao Wen, Tao Sun, Yue Luo, "Research on Standard Compliance Test Algorithm Based on Electronic Medical Records of Traditional Chinese Medicine Outpatients", Journal of Healthcare Engineering, vol. 2020, Article ID 8865264, 9 pages, 2020. https://doi.org/10.1155/2020/8865264
Research on Standard Compliance Test Algorithm Based on Electronic Medical Records of Traditional Chinese Medicine Outpatients
Objectives. To effectively evaluate the compliance degree between the electronic medical records of Traditional Chinese Medicine (TCM) hospitals, as well as the information platform, and the related information standards of electronic medical records, a standard compliance testing scheme based on electronic medical records of TCM outpatients is proposed. Methods. This research selected the data of clinical outpatients accumulated in 10 years by the Digital Medicine Institute of Chengdu University of TCM and processed the data through security check and desensitization process. And then 28348 cases of processed electronic medical records of TCM outpatients were inputted into the standard compliance testing platform for assessment. The result was then outputted. Results. There are 924 cases among the 28348 that can be rated as five-star medical records, 84 cases four-star, 132 cases three-star, 12460 cases two-star, 13488 one-star, and 1260 cases zero-star through the integrity and standardization test. Conclusion. By the way of assessing the integrity and standardization of data, the standard compliance test algorithm scheme for electronic medical records of TCM outpatients introduced in this paper can solve the problems such as data unavailability caused by ununified codes and incomplete data in the data-sharing process and provides technical support for the construction of data standardization testing in electronic medical records of TCM outpatients.
The Opinions of the CPC Central Committee and the State Council on Deepening the Reform of the Medical and Health System (hereinafter referred to as the Opinions) proposed to establish a practical and shared medical and health information system [1, 2] and employ artificial intelligence technology in promoting the construction of hospital informatization. In order to implement the Opinions, as well as to improve the quality of health services and management, it is urgently needed to establish and improve the health information standard system in our country, to unify information and code standards of various terms in the health field, and to enhance the corresponding exchange and technology standards. In addition, it is of crucial importance to cowork with related departments to strengthen the construction of information standardization and public information service platform .
With the deepening of medical and health system reform, the application of electronic medical record has become an inevitable trend of informatization construction in hospitals. In the new medical reform policy, the Ministry of Health and domestic medical institutions have shown certain understanding and attention in the standardization development of electronic medical records and revised successively about 150 health information standards such as the basic dataset of electronic medical record, specification for sharing document of electronic medical record, technical specification for hospital information platform based on electronic medical record , and so on. On the one hand, many hospitals have set up information system within hospitals with the development of national Jin Wei project, which laid a solid foundation for the study and application of electronic medical record in China; on the other hand, with the development of hospital HIS system in the direction of clinical information system (CIS), electronic medical record is getting more and more attention and a professional committee on it has been set up in China. At the same time, studies on standard compliance test methodology have appeared successively in scientific research filed. In light of the rapid development of computer network technology, it is of great value to transfer electronic medical records with the help of Internet technology. While at present, the development of electronic medical record in China has just started and the research related to compliance test for the electronic medical record digitization of TCM is yet to come. TCM is an important component of medical and healthcare, it is of great urgency to study the compliance test for electronic medical records of TCM digitization.
Therefore, this paper introduces the algorithm of standard compliance test into the health informatization construction of electronic medical records of TCM outpatients and tries to explore the specific medical and health informatization construction that fits China’s national conditions. It has great guiding significance to the successful implementation of the standard compliance test for TCM electronic medical record. It can boost the application of information standards of TCM electronic medical records in our country, as well as promote the construction of efficient, unified, data-shared health informatization.
With the popularization of TCM electronic medical record system, the application of standards of TCM electronic medical records has become an important issue to be studied. And the research on standard compliance test for TCM electronic medical records information makes up the lack of health informatization construction and evaluates the application of information standards.
In addition to the characteristics of general electronic medical record, the electronic medical record of TCM outpatient has its own particularity, such as its unique contents, structure, and clinical information standardization . TCM is different from Western medicine in dealing with clinical data from the aspects of disease classification, treatment, test, and so on. For example, TCM pays attention to holistic, dynamic, and personalized diagnosis and syndrome differentiation treatment, and clinical treatment combines four diagnoses, focusing more on the diagnosis and treatment of patients’ overall function of their viscera, while Western medicine has a variety of biochemical and physical tests along with clear indicators of diagnostic results. Therefore, the electronic medical records of Western medicine are structured electronic medical records, while the electronic medical records of TCM are semistructured or unstructured. In light of these differences, the assessment for TCM electronic medical records’ data as the test object can not only improve their integrity and standardization, but also the research on standard compliance test for TCM electronic medical records can test the application of the standard compliance testing platform, as well as verify whether the application of TCM electronic medical records’ information standards is effective, normalized, and standardized.
2. Related Researches
This study retrieved related research from the database of China National Knowledge Infrastructure (CNKI) with “standard compliance testing platform” as the searching key words and without requirements for the publishing time. There are only 31 articles that are found related to “standard compliance testing platform,” and these articles include “A Framework of SQL Conformance Test” by Li et al.  in 2003, “XML-Based Standards Compliance Testing Scheme” by Wu and Fan  in 2012, “Research and Development of Health Information Standard Conformance Test Case Library” by Xiao Youhua et al.  in 2015, and “Research on Conformance Testing of Data Standard” by Zhu et al.  in 2019. Among these studies, there are only 2 that are related to TCM electronic medical records, which is extremely rare. These two articles were published by Si Tong and Wang Wenjing, a master student in Hubei University of Chinese Medicine in 2014 as her graduation dissertation [10, 11]. Si Tong reviewed the current development of TCM electronic medical records in both home and abroad and then proposed and designed an outpatient electronic medical record software with Chinese traditional medicine characteristics , which presented a novel method for the development of TCM electronic medical records. While Wang’s research was mainly related to the study of standard compliance of TCM electronic medical record information. Three articles are related to electronic health records, which mainly involve the study, proposition, and design of standard compliance test for electronic health records [13–15]. The searching result also shows that there are about 22 articles on standard compliance test, with contents covering from data element standards, platforms, e-commerce products, and e-government data exchange to ODBC standard testing framework [8, 16–28]. It indicates that the research on standard compliance testing platforms is in-depth in testing various types of standards, but short in the medical industry, such as TCM electronic medical records and electronic health records. In addition, from the overall trend of the research as shown in Figure 1, it can be seen that the development of research on the standard compliance testing platform is slow, or even stagnant.
In the era of rapid development of medical informatization, TCM hospitals have accumulated a large number of electronic medical records data. But the existing standard compliance testing and research platforms have their own specific standards, respectively, which leads to the fact that the tested data are not mutually relevant. Therefore, how to effectively utilize these data to improve medical and health service is of vital importance at present .
As shown in Figure 1, the selected literatures in this paper were mainly published in the year from 2003 to 2019 in CNKI, with an increase in the number of articles published since 2003. The number of researches on standard compliance testing platform reached a peak between 2012 and 2013. The above figure also shows that the number of citations began to rise in 2005, reaching its peak in 2016 followed by a decline. The references of this paper were published as early as the 1990s or even earlier, which signifies that the topic of this paper appeared as early as back then, providing basic support and basis for current research, and that the research on standard compliance testing platforms has always been a hot issue which needs to be excavated deeply and widely.
This study starts from the literature review, which indicates that the research on the standard compliance test for TCM electronic medical records is rare and lacks available publicly labeled datasets . In view of the fact that the research on entity standardization of electronic medical records being a hotspot driven by international public evaluation tasks1, this paper then comes up with a research scheme for standard compliance test based on TCM electronic medical records. The electronic medical records data employed in this paper were randomly selected from the clinical outpatient data accumulated by the Institute of Digital Medicine of Chengdu University of TCM in the past 10 years. The basic four diagnosis and prescription information of TCM outpatients were first collected and processed through data security check and desensitization and then were inputted into the standard compliance testing platform, and the platform outputted the compliance test results subsequently. This research is believed to effectively promote the standardization of TCM outpatient electronic medical records and further bring positive impact on the medical cause.
3. Algorithm of Standard Compliance Test for Electronic Medical Records of TCM Outpatients
The two most representative evaluation tasks are ShARe/CLEF eHealth Shared Task 1b  in 2013 and SemEval Task 7  in 2014, whose tasks are to find out the coding of entities in electronic medical records such as diseases and symptoms in Systematized Nomenclature of Medicine-Clinical Terms, abbreviated as SNOMED-CT .
The algorithm of standard compliance test based on electronic medical records of TCM outpatients includes score assessment algorithm and star-rating assessment algorithm.
3.1. The Score Assessment Algorithm of the Standard Compliance Test
The score assessment algorithm is employed to check the integrity and coding standards of the electronic medical record data of TCM outpatients uploaded by medical institutions every single time and then evaluate its quality through certain rules. The score assessment algorithm consists of three parts, namely, integrity assessment, coding standard assessment, and total score assessment. Integrity test and coding standard test are targeted at the assessment of the integrity and coding standards of TCM outpatients’ electronic medical records, while the total score is the sum of integrity assessment score and coding standard assessment score calculated according to their weight proportion.
The integrity assessment checks whether the mandatory items in TCM outpatients’ electronic medical records are filled in. For example, the name and age of the patient must be put down, and if not, this standard will be scored zero. The mandatory items in TCM outpatients’ electronic medical records determined in this study are shown in Table 1.
Coding standard assessment tests whether the codes of TCM symptoms, syndrome types, and treatments in TCM electronic medical records conform with related coding standards. The codes and their corresponding coding standards of TCM outpatients’ electronic medical records determined in this study are shown in Table 2.
The integrity assessment algorithm, coding standard assessment algorithm, and total score assessment algorithm are, respectively, introduced as follows:(1)Integrity assessment algorithm Provided that Xi is the number of missing items required in each medical record, n is the total number of medical records, k is the number of integrity items, and the integrity assessment score is Si, the calculation of Si is presented as(2)Coding standard assessment algorithm Provided that Yj is the number of missing items, n is the total number of medical records, k is the number of coding items, and the coding standard assessment score is Sc, the calculation of Sc is shown as(3)Total score assessment algorithm The total score of TCM electronic medical record is codetermined by the integrity assessment score and the coding standard assessment score. Provided that the total score is St, the calculation of St is stated as
3.2. The Star-Rating Assessment Algorithm
3.2.1. Star-Rating Assessment of Each Outpatient Electronic Medical Record
It is a process to star-rate every medical record uploaded by medical institutions via star-rating assessment algorithm. The star-rating process is conducted as per the standards described in Table 3, after the assessment of the integrity and coding standard of contents in medical records.
The following star-rating principles are indicated from Table 3:(1)Medical records will be rated as one-star records if the above standards from no.1 to no.5 are met simultaneously.(2)Medical records will be rated as two-star records if the above standards from no.1 to no.7 are met simultaneously.(3)Medical records will be rated as three-star records if the above standards from no.1 to no.9 are met simultaneously.(4)Medical records will be rated as four-star records if the above standards from no.1 to no.11 are met simultaneously.(5)Medical records will be rated as five-star records if the above standards from no.1 to no.14 are met simultaneously.
3.2.2. Overall Star-Rating Assessment of Outpatient Medical Records Uploaded by Medical Institutions in a Single Time
The overall star-rating assessment of medical records uploaded by medical institutions every single time is composed of the star-ratings of the five-star, four-star, three-star, two-star, and one-star medical records as shown in Formula (4).
4. The Application of Standard Compliance Testing Platform for TCM Electronic Medical Records
Based on the above algorithm, the setting up of standard compliance testing platform for TCM electronic medical records is achieved via the applying of Visual Studio 2012 development tools, C# programming language, and SQL Server 2008 database management system.
After registering and logging in the standard compliance testing platform for TCM electronic medical records, as shown in Figure 2, medical institutions can upload outpatient electronic medical records by clicking the “Upload outpatient medical record” button under the menu of “Upload data,” as shown in Figure 3.
The data of clinical outpatients accumulated in 10 years by the Digital Medicine Institute of Chengdu University of TCM were selected to be dealt with through security check and desensitization process. After processing, 28348 cases of electronic medical records of TCM outpatients were inputted into the standard compliance testing platform for assessment. The result was then outputted.
The result of testing shows that in all the 28348 cases of TCM outpatient electronic medical records, there are 924 cases are rated as five-star, 84 cases four-star, 132 cases three-star, 12460 cases two-star, and 1260 cases zero-star, as shown in Table 4 and Figure 4.
As a result of the integrity assessment and coding standards assessment, the integrity score and coding standard score of the TCM outpatient electronic medical records case data upload this time are 75 points and 86 points, respectively, and the total score is 81 points, as shown in Figure 5.
100 cases of TCM outpatient medical records were randomly selected manually and assessed by the above scoring and star-rating algorithm designed in this paper, and the result is consistent with the above result calculated by the standard compliance testing platform.
The algorithm of standard test for TCM outpatient electronic medical records put forward in this paper assesses outpatient electronic medical records from the aspects of integrity and coding standard while combining computer technology and traditional Chinese medicine. It presents a monitoring platform for the standard writing of TCM outpatient electric medical records, as well as a solution to problems such as data unavailability caused by disunified codes and incomplete data in the sharing process. Additionally, it gives feedbacks on the quality of data to hospitals which provide their electronic medical record data in order to correct the data timely and provides technical support for the construction of data standardization testing of TCM outpatient electronic medical records.
The basic data of our study come from the Institute of Digital Medicine of Chengdu University of Traditional Chinese Medicine. Through the cleaning, desensitization, and privacy security processing of the basic data, a total of 28348 data are obtained. And the basic data content can be obtained through the relevant platform of the Digital Medicine Research Institute of Chengdu University of Traditional Chinese Medicine.
Conflicts of Interest
The authors declare that they have no conflicts of interest regarding the publication of this paper.
YL, CBW, and TS provided resources. LH and ZYZ performed formal analysis. YL and CBW supervised the study. YL was responsible for funding acquisition. FSN and YFY performed testing and verification. LH, QX, and YL wrote the original draft. LH, YL, CBW, and TS reviewed and edited the article. All authors read and approved the final manuscript.
The authors sincerely acknowledge the enormous contributions from authors and supports from many expert reviewers. This research was funded by the Scientific Research Project of Sichuan Health Information Society and the National Natural Science Foundation of China (no.81904324) and the National Key research and Development Program of China (2018YFC1707606).
- Q. Meng, “Focus on the implementation of efforts to create a new situation in health statistics and informatization,” Chinese Journal of Health Informatics and Management, vol. 9, no. 2, pp. 2–7, 2019.
- Y. C. Wang, “Study on the development plan of health informatization during the 12th five-year plan period,” Chinese Journal of Health Informatics and Management, vol. 9, no. 2, pp. 2–13, 2019.
- National Administration of Traditional Chinese Medicine and Ministry of Health, “Guidance on strengthening the construction of health informatization,” 2012.
- Ministry of Health, “Technical solution for the construction of hospital information platform based on electronic medical records,” 2011.
- B. Y. Liu, H. Zhang, and W. D. Ni, “TCM electronic medical record system and its particularity,” Medical Information, vol. 17, no. 1, pp. 9–11, 2004.
- M. Li, Q. Lian, and X. K. Yang, “A framework of SQL conformance test,” Computer Engineering and Applications, vol. 7, no. 20, pp. 173–175, 2003.
- J. M. Wu and G. M. Fan, “XML-based standards compliance testing scheme,” Journal of Computer Applications, vol. 32, no. 2, pp. 551–553, 2012.
- Y. H. Xiao, Y. B. Ye, D. L. Feng, and P. He, “Research and development of health information standard conformance test case library,” Information Technology and Standardization, vol. 10, no. 07, pp. 35–39, 2014.
- H. Zhu, A. Gao, and S. M. Wang, “Research on conformance testing of data standard,” Standard Science, vol. 16, no. 07, pp. 53–57, 2019.
- S. Tong, “The current situation and innovational methods of TCM outpatient electronic medical records,” Journal of Medicine Informatics, vol. 10, no. 09, pp. 37–39, 2008.
- W. J. Wang, “Traditional Chinese Medicine electronic medical records compliance information standard application research,” Hubei University of Chinese Medicine, Wuhan, China, 2014, Master thesis.
- S. X. Tong, W. Y. Lin, N Yang et al., “Design and realization of the doctor’s work station software for traditional Chinese Medicine Clinic,” Chinese Journal of Tissue Engineering Research, vol. 43, pp. 183–185, 2006.
- J. P. Hu, X. J. Tang, J. M. Qu, Q. H. Huang, and F. J. Dong, “Research on methods of standard compliance test for electronic health records,” Chinese Digital Medicine, vol. 15, no. 07, pp. 32–34, 2013.
- Q. Meng, J. P. Hu, X. J. Tang, J. F. Shen, and W. H. Zong, “Conformance testing of electronic health records,” Chinese Journal of Health Informatics and Management, vol. 20, no. 01, pp. 31–34, 2013.
- L. N. Shen, J. P. Hu, X. J. Tang, L. X. Pu, and C. K. Wang, “Contents and design of conformance test for electronic health records in China,” Chinese Hospital Management, vol. 5, no. 01, pp. 62–64, 2010.
- G. J. Liu, “Development and application of CNONIX standard compliance testing platform,” Information on Publication, vol. 10, pp. 10–13, 2018.
- R. Duan, “Research on the validation method of relevant data elements based on CNONIX standard,” North China University of Technology, Beijing, China, 2016, Master thesis.
- T. Pan, “The design and implementation of e-commerce products information standard conformance test,” Beijing University of Technology, Beijing, China, 2015, Master thesis.
- X. Meng, L. Wei, J. P. Huang, and Y. Z. Zhang, “Research on standard conformance testing methodology of traffic signal controller communication protocol,” Information Technology and Standardization, vol. 9, pp. 35–42, 2015.
- X. D. Guo, “Standard conformance test platform design and implementation based on oriented XML S1000D,” University of Electronic Science and Technology of China, Sichuan, China, 2015, Master thesis.
- S. Z. Li, “Research and implement of the compliance testing of china online information exchange,” North China University of Technology, Beijing, China, 2014, Master thesis.
- Q. Zhou, “Study of standard compliance test platform based on digital rights metadata,” North China University of Technology, Beijing, China, 2013, Master thesis.
- J. J. Dong, B. Y. Wu, F. Shen, and Z. C. Wu, “Research on conformance test of sensor signal interface standard,” Computer Measurement and Control, vol. 11, pp. 2867–2869, 2012.
- H. L. Wang and X. L. Shangguan, “Analysis on electronic signature conformance testing platform,” Information Technology and Standardization, vol. 10, pp. 33–38, 2012.
- G. M. Fan, “Study and implementation of standard compliance test platform,” North China University of Technology, Beijing, China., 2012, Master thesis.
- Y. W. Li, “Research and development of standard conformity test platform based on two-dimensional code of books,” North China University of Technology, Beijing, China, 2011, Master thesis.
- X. D. Yang, “ODBC standard conformance test for database management system,” University of Electronic Science and Technology of China, Sichuan, China, 2010, Master thesis.
- W. Qi, X. J. Ye, and J. M. Wang, “A framework for ODBC conformance test,” Computer Engineering, vol. 20, pp. 101–103, 2005.
- Y. F. Zhao, J. L. Zheng, and X. L. Xu, “Deep learning based entity normalization of electronic medical records,” Software Guide., vol. 18, no. 8, p. 12, 2009.
- H. Suominen and S. Velupillai, “Overview of the share/clef ehealth evaluation lab 2013,” in Proceedings of International Conference of the Cross-Language Evaluation Forum for European Language, pp. 212–231, Springer, Heidelberg, Germany, September 2013.
- S. Pradhan, N. Elhadad, and W. Champman, “SemEval-2014 task 7: analysis of clinical text,” in Proceedings of the 8th International Workshop on Semantic Evaluation , (SemEval 2014), pp. 54–62, Dublin, Ireland, August 2014.
- T. S. De Silva, D. Macdonald, G. Paterson, K. C. Sikdar, and B. Cochrane, “Systematized nomenclature of medicine clinical terms , (SNOMED CT) to represent computed tomography procedures,” Computer Methods and Programs in Biomedicine, vol. 101, no. 3, pp. 324–329, 2011.
- National Standard of the People’s Republic of China-Clinic Terminology Traditional Chinese Medical Diagnosis and Treatment-Therapeutic Methods [GB]/T 16571.3-1997.
- National Standard of the People’s Republic of China-Clinic Terminology Traditional Chinese Medical Diagnosis and Treatment-Syndromes [GB]/T 16751.2-1997.
- National Standard of the People’s Republic of China-Clinic Terminology Traditional Chinese Medical Diagnosis and Treatment-Disease [GB]/T 16751.1-1997.
- National Standard of the People’s Republic of China-Classification and Codes of Diseases and ZHENG of Traditional Chinese Medicine [GB]/T 15657-1995.
Copyright © 2020 Li He et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.