Empirical Study on the Transparency of Security Risk Information in Chinese Listed Pharmaceutical Enterprises Based on the ANP-DS Method

Wang, Jining; Guo, Chong; Chen, Tingqiang

doi:https://doi.org/10.1155/2020/4109354

Journal of Healthcare Engineering

On this page

Abstract Introduction Conclusion Data Availability Conflicts of Interest Acknowledgments References Copyright Related Articles

Research Article | Open Access

Volume 2020 | Article ID 4109354 | https://doi.org/10.1155/2020/4109354

Empirical Study on the Transparency of Security Risk Information in Chinese Listed Pharmaceutical Enterprises Based on the ANP-DS Method

Jining Wang,¹Chong Guo,¹and Tingqiang Chen^1,2

Academic Editor: Hongbo Zhang

Received25 Jun 2019

Revised14 Dec 2019

Accepted07 Jan 2020

Published14 Feb 2020

Abstract

Frequent outbreaks of drug safety incidents pose a massive threat to public health and safety, while the transparency of security risk information in medical enterprises is not optimistic. Therefore, this study uses the analytic network process (Dempster-Shafer method) to construct a transparent comprehensive evaluation model for security risk information in listed pharmaceutical enterprises from the perspective of government supervision and listed pharmaceutical enterprises. On the basis of 59,305 data obtained by 303 enterprises listed in the Chinese biomedical sector, this research conducted an empirical study on the transparency of safety risk information in Chinese listed pharmaceutical enterprises. The current study found that the transparency of security risk information in Chinese listed pharmaceutical enterprises is generally between “general” and “relatively good” and tends to be “relatively good.” However, administrative punishment information, adverse drug reaction reporting systems, and production processes need continuous improvement.

1. Introduction

From the “Plum Blossom K” and “Guan Mu Tong” incidents to the Changchun Changsheng vaccine incident, these occurrences cause widespread concern for the pharmaceutical industry [1, 2] and seriously threaten the public’s health and safety [3, 4], thereby affecting government credibility and social harmony and stability [5, 6]. Chen [7], Uthayakumar and Priyan [8], and de Korne et al. [9] believed that, as a field closely related to people’s lives, health, and safety, medicines have a security risk in any part of the production, transportation, storage, and usage. Applequist et al. [10] and Listed [11] focused on the research and development of pharmaceuticals and study the entire pharmaceutical supply chain from the perspective of the full life cycle of drugs. They found risk, unique uncertainty, and other issues in the drug supply chain. Therefore, improving and strengthening the transparency of security risk information in listed pharmaceutical companies is imminent.

Drug safety incidents continue to occur. Davis [12], Naser [13], Zhang [14], Hossain [15], and Darmadi and Sodikin [16] conducted a series of studies to expose the causes of outbreaks. Ghorbel and Triki [17] find that companies have a good relationship with stakeholders to prove that their behavior is legal. However, the industry is characterized by substantial investment, high risk, and long industrialization cycle [18]. Operators use information asymmetry between consumers and business to maximize profits, fabricate production and product inspection records, and change process parameters and equipment arbitrarily [19, 20]. Chen et al. [21] pointed out that entrepreneurs reduce the sales cost to meet the consumer demand and to profit by maximizing their own interests and consumer utility because of moral considerations and other factors. Simultaneously, the imperfections of the drug regulatory system, backwardness of organizational concepts, and insufficiency of awareness on drug safety governance have resulted in the absence or lack of drug safety regulations [22]. Therefore, some scholars have explained that reducing the risk of drug safety entails drug regulatory authorities to enhance the forms and channels of information dissemination and improve the information disclosure, supervision, and evaluation system [23].

The world public medicine field is concerned with the reality of information transparency. The existing research focuses on the transparent supervision of drug information, transparency of the pharmaceutical industry chain in all aspects, and subject of participation [24–26]. For example, Vian et al. [27] found that the Medicines Transparency Alliance regulates the procurement of pharmaceuticals, drug policies, and drug supply, and establishes appropriate accountability in member states to promote transparency of drug information. Kaynak et al. [28] proposed that strengthening the transparency of the drug regulatory process can resolve such unethical behaviors as corruption in all aspects of the pharmaceutical industry chain. Formoso et al. [29] evaluated the primary sources of drug information in eight European countries and found that health professionals, policymakers, and the public are the main participants in drug information. Bushman and Smith [30] and Norris et al. [31] used corporate information transparency as research object and analyzed the factors affecting corporate information transparency from the perspective of government and industry. Chen et al. [32] introduced the SIRS contagion model of food safety risk considering the entry rate, the normal bankruptcy rate, the abnormal bankruptcy rate, and other correlated parameters of food enterprise, and they discussed and theoretically analyzed the influences of these correlated factors on the contagion of food safety risk. However, only a few studies have been conducted on the transparency of safety risk information in listed pharmaceutical companies, particularly the quantitative information disclosure with the characteristics of pharmaceutical companies. These studies have indicated the necessity to construct a transparency system of security risk information for listed pharmaceutical companies, quantify the safety risk information transparency of pharmaceutical companies, provide a useful reference model for security risk transparency in the pharmaceutical industry, and protect public health and safety.

The present study uses the preceding analysis as basis in using the Delphi method and network analytic network process (ANP) to construct an index system for judging the transparency of security risk information in medical enterprise from the perspective of government supervision and listed pharmaceutical enterprises. Moreover, this study uses the Dempster-Shafer evidence theory (DS) as basis in using Super Decisions and MATLAB to determine the weight of each index. The current study uses 59,305 data obtained from 303 enterprises listed in the Chinese biomedical sector to conduct an empirical study on the transparency level of security risk information for Chinese listed pharmaceutical companies.

The remainder of this paper is organized as follows. Section 2 describes an evaluation index system for the transparency of security risk information in listed pharmaceutical companies. Section 3 builds an evaluation model on the basis of ANP-DS. Section 4 uses 59,305 data obtained from 303 enterprises listed in the Chinese biomedical sector to conduct an empirical study on the transparency level of security risk information for Chinese listed pharmaceutical companies. Section 5 discusses and analyzes the results of empirical research. Lastly, Section 6 elaborates the conclusions.

2. Construction of an Evaluation Index System

The stakeholders of listed pharmaceutical enterprises obtain such information as financial status, business results, and social responsibility from outside the company. An operator’s motivation, finances, environment, and traits determine the transparency of their security risk information [33–35]. Furthermore, the state forces listed enterprises to disclose their information to the public to improve the transparency of corporate security risk. However, the information disclosed by listed enterprises includes mandatory disclosure and voluntary disclosure [36]. Therefore, the present study constructs a transparent index system of security risk information in listed pharmaceutical companies from the perspective of government supervision and listed pharmaceutical enterprises to investigate the security risk information transparency of listed pharmaceutical companies.

2.1. Government Supervision Information Transparency

The government is the examination and approval party for drugs entering the market, makers of relevant laws and regulations, and supervisors of drug safety [1, 37]. Arnesano et al. [38] explained that government supervision of information transparency is the extent to which the government discloses their administration in the administrative process and the management of public information within the department or to the public at specified times and frequencies. Accordingly, improving the transparency of government supervision information for drugs can effectively realize the transparency of government regulatory information between governments and the government and the public, as well as eliminate public concerns on drug safety. The present study uses the literature and related laws as bases in analyzing the government supervision of information transparency from four aspects: safety supervision information, safety sampling information, clinical trial information, and accident emergency information.

2.1.1. Safety Supervision Information

The government shoulders the responsibility of leading, directing, supervising, coordinating, safeguarding and guiding pharmaceutical matters within its administrative area to monitor drug safety in all aspects [1]. According to the existing achievements and Articles 72, 86, and 87 of the Drug Administration Law of the People’s Republic of China, safety supervision information is divided into the following types: supervision focus, administrative punishment, risk warning, supervision announcement, production and business license directory, and media coverage [1, 39].

2.1.2. Safety Sampling Information

Drug regulatory authorities regularly organize postmarket surveillance and sampling of biological products, including vaccines. For example, samples from market circulation are used to test the quality of vaccines [40] to reduce the safety risk of drugs. According to the existing achievements and Articles 24, 64, and 67 of the Drug Administration Law of the People's Republic of China, safety sampling information is divided into four third-level indexes: random inspection information, test instrument information, tracking inspection information, and chemical dangerous goods management information [41].

2.1.3. Clinical Trial Information

Before the drugs are released to the market, relevant data and samples, such as research and development methods, quality indexes, and pharmacological and toxicological test results, must be submitted to the drug regulatory authority under the State Council. According to the existing research and Article 29 of the Drug Administration Law of the People’s Republic of China, clinical trial information is measured from four aspects, namely, development method information, quality index information, pharmacological toxicology experimental results information, and clinical and nonclinical research quality management regulatory information [42, 43].

2.1.4. Accident Emergency Information

The drug accident emergency and information linkage early warning mechanism can effectively prevent, control in a timely manner, and correctly dispose of drug quality accidents to protect the public’s physical health and life safety [44]. According to the relevant literature and Article 70 of the Drug Administration Law of the People’s Republic of China, the accident emergency information is divided into four third-level indexes: expired product recycling system, product return and recall system, product accident emergency mechanism, and adverse drug reaction reporting system [44, 45].

2.2. Listed Pharmaceutical Enterprises Information Transparency

If listed pharmaceutical enterprises can be self-disciplined, then they can effectively avoid the emergence of problematic products and strengthen their development as well. Self-discipline can promote the healthy development of the pharmaceutical industry through a virtuous circle, thereby protecting public health and safety [46]. According to the relevant literature and laws and regulations, the transparency information of listed pharmaceutical enterprises is divided into five second-level indexes: enterprise basic information, product information, safety production and sales information, enterprise governance information, and financial information [30, 46].

2.2.1. Enterprise Basic Information

At present, the pharmaceutical industry has numerous manufacturers. Drug markets exist for illegal, low-level redundant construction; disordered market order; and consumers’ single access to corporate information channels [47], which seriously affect the transparency of basic corporate information. Therefore, according to the existing research and Articles 7, 14, 42, and 70 of the Drug Administration Law of the People’s Republic of China, the basic information of the enterprise is divided into four third-level indexes: pharmaceutical production license information, pharmaceutical business license information, basic situation of the Board of Supervisors members, and the integrity of other employees [48, 49].

2.2.2. Product Information

Given the emergence of new sales channels, such as the Internet, global production and distribution channels have become complicated. Drug counterfeiters can enter the supply chain to sell products directly, thereby resulting in the need for product information transparency [50]. According to the existing achievements and the 31st, 54th, 60th, 61st, 62nd, and 6th chapters of the Drug Administration Law of the People’s Republic of China, product information is divided into four third-level indexes: drug label and approval number, drug advertisement information, packaging materials and container information, and drug purchase inspection, acceptance, and custody information [50, 51].

2.2.3. Safety Production and Sales Information

From research and development to final commercialization of biopharmaceuticals, basic research, pilot production, clinical trials, large-scale production, and marketization must be conducted [42]. If every link is guaranteed, then the quality of a drug can comply with the standard, protect public health and safety, and improve security risk transparency. According to the existing achievements and Articles 10, 15, 20, 26, and 56 of the Drug Administration Law of the People’s Republic of China, safety production and sales information is divided into four third-level indexes: production process and records, equipment information, storage facilities, and purchase and sales records [42, 52].

2.2.4. Enterprise Governance Information

The improvement of enterprise governance information transparency can improve government efficiency, correct violations of listed enterprises, enhance executive behavior constraints, and reduce agency costs [30, 53]. According to the current research and Article 18 of the Drug Administration Law of the People’s Republic of China, the corporate governance framework, Board of Supervisors’ decision-making supervision and performance, and enterprise governance information are analyzed from six aspects: enterprise governance framework, decision-making supervision and performance of the Board of Supervisors, reporting evaluations such as finance and social governance, rewards and punishments of the senior executive, participation of other stakeholders in governance, and equity concentration [53].

2.2.5. Financial Information

The disclosure of information by listed enterprises mainly refers to the disclosure of finance, operation, and other aspects to the public under statutory or agreed requirements [54, 55]. The current study divides financial information into four third-level indexes: return on net assets, asset–liability ratio, operating cash flow, and growth rate of gross operating income [54, 55].

The correct selection and quantification of the evaluation indexes is the basis for the construction of an index system, which is also related to the merits of the evaluation results [56]. Moreover, following the basic principles of systemic, normative, and measurable in the process of constructing the evaluation index system is necessary. Therefore, this study comprehensively uses the Delphi expert survey method to demonstrate and improve the initially constructed index system. Lastly, an index system is formed to evaluate the transparency level of security risk information in Chinese listed pharmaceutical enterprises (Table 1 shows the specific indicator system). In particular, the Delphi expert group consists of 21 experts in pharmaceutical-related fields (i.e., 9 professors engaged in food and drug safety management research, 5 food and drug safety government regulatory authorities, 3 listed pharmaceutical company executives, 2 newspaper reporters involved in drug safety issues, and 2 ordinary consumers).

3. Evaluation Model

3.1. ANP-Based Index Weight Calculation

The analytic network process (ANP) is a scientific decision-making method based on the analytic hierarchy process (AHP) [57]. Nishizawa [58] believes that compared with AHP, ANP not only considers the hierarchical structure of the network but also considers the interaction and constraints between the indexes. Therefore, ANP can describe and characterize complex decision problems realistically.

In the network AHP, the entire decision system is divided into two parts, namely, the control and network layers. The decision criteria in the control layer are independent of each other and are typical AHP hierarchical structures [58]. Therefore, the weight of each decision criterion can be obtained by the traditional AHP method. Given that the different elements in the network layer interact with each other, an interactive network structure is formed [58]. The necessary steps are as follows. Step 1: construct a typical structure of ANP. First, build the control hierarchy and define the decision objectives and guidelines. Thereafter, calculate the weight of each decision criterion relative to the decisive goal. Lastly, analyze the interactions between the elements in each element set and build a network hierarchy. Step 2: construct a supermatrix to calculate the weights. Let the criteria corresponding to the target layer G in the control layer be R₁, R₂, …, R_N, respectively, and the element set E₁, E₂, …, E_N exists in the network layer, whereas the element set E_i contains the elements E_i1, E_i2, …, E_in, i = 1,2, …, N. Take the element R_s in the control layer as the criterion and the element E_j1 in the element set E_j as the subcriterion. Analyze the importance of each element in the element set E_j and then construct the judgment matrix and obtain the normalized feature vector . That is, the network element sorting vector. Compared with the sorting vector of other elements, the supermatrix is obtained and marked as . Step 3: construct a weighted supermatrix: Judge the importance of the elements E₁, E₂, … E_N for the criterion under the R_s criterion, and sorting by size, the normalized row vector is . The weighting matrix is , constructing a weighted supermatrix of ANP on the basis of the preceding analysis . Step 4: extreme supermatrix . On the basis of constructing a weighted supermatrix, we stable processing . That is, calculating the limit relative sorting vector: . If the limit converges and is unique, then the relative ordering of the elements in the network layer under the criterion layer for the element j is the jth column of . That is, the weight value of each element relative to the ultimate goal.

3.2. Evaluation Model for the Transparency of Security Risk Information in Listed Pharmaceutical Enterprises Based on DS

In the evaluation, numerous information show different degrees of ambiguity, and evidence theory can better describe the uncertainty in decision problems [59]. By contrast, the Dempster–Shafer synthesis formula combines different reliability functions that can integrate the opinions of decision-makers effectively [60]. Therefore, a comprehensive evaluation model based on evidence theory was finally established.

3.2.1. Evaluation Index Weights and Evaluation Sets

In this section, the method for determining the weight of each index is ANP and the weights of the third-level indexes P, and are represented by , , and . The weight values of the layers are normalized using the method of or [60], and according to the expert's preference coefficient , adjust the basic trust distribution function as follows:

Assume that its rating is , which means the transparency evaluation of security risk information in Chinese listed pharmaceutical enterprises is good, relatively good, average, relatively poor, and poor. Simultaneously, the evaluation value of each transparency level is set in advance on the basis of the characteristics of information transparency.

3.2.2. Building Basic Credibility Allocation

Evidence theory indicates that the transparency evaluation of security risk information in Chinese listed pharmaceutical enterprises under different levels of third-level indexes is considered to be the lowest subproposition [59], and confidence is directly assigned to the different performance levels by the evaluation experts. If there are q experts who evaluate the security risk information transparency, then indicates the confidence level of the expert on the information transparency level of the index . The largest index of weight for each index set is the key index, whereas the others are nonkey indexes [60]. Assume that is the third-level index with the highest weight under the first-level index , and its basic credibility is assigned as follows:where represents a completely unascertained basic credibility assignment and is the preference coefficient of expert for the key subindex in [61], and its value is [0.9, 1]. Moreover, the larger the value, the more important the key subindexes and the nonkey subindexes.

3.3. Synthesis of the ANP-DS Calculation Results

3.3.1. Transparency of Security Risk Information in Listed Pharmaceutical Enterprises Based on the ANP-DS Model

The basic credibility of the third-level index is allocated to synthesize the basic credibility of the third-level index via the q expert(s), which can form a matrix , while , . A recursive algorithm is used to avoid the intersection calculation and to synthesize the evidence for the basic credibility of the third-level index by expert(s) [61]. Assume that the first r expert(s) information sets are . The basic credibility of the first rows in the matrix is assigned as .

3.3.2. Calculate the Transparency Level of Trust in the Security Risk Information for Listed Pharmaceutical Enterprises on the Basis of ANP-DS

The reliability and likelihood of each rating of the transparency for the listed pharmaceutical enterprises in security risk information [59] are as follows:

Equation (3) can obtain a confidence interval for each evaluation level . According to the confidence interval, the trust degree is .

In particular, indicates that the evidence supports the uncertainty of information transparency as . The grades with the highest degree of trust in various evaluation levels correspond to the comprehensive evaluation of listed pharmaceutical enterprises security risk information transparency.

3.3.3. Comprehensive Evaluation Value Calculation in the Transparency of Security Risk Information for Listed Pharmaceutical Enterprises Based on the ANP-DS Model

Assume that the evaluation value of the information transparency evaluation level is , while the evaluation value of the transparency of the first-level index information can be obtained as : . The evaluation effect of information transparency can be obtained through the above analysis of listed pharmaceutical enterprises security risk information transparency.

4. Empirical Research on the Transparency of Security Risk Information in Listed Pharmaceutical Enterprises Based on ANP-DS

4.1. Establish an Evaluation Model

In the constructed evaluation index system, the indexes within the standard layer are not independent of one another, although interactions are evident. For example, the safety supervision information and accident emergency information have an interaction. Therefore, the elements of the evaluation indexes and internal factors of the elements will inevitably interact rather than be independent. That is, the relationship between the indexes in the index system should be a network relationship, rather than a simple hierarchical relationship [62]. The preceding analysis and structure of the ANP model indicate that the present study constructs the network structure of the evaluation model (see Figure 1 for the model structure).

4.2. Determination of Index Weight

The process of determining the weight of an index using the ANP method is the same as that of the AHP. Judgment regarding the importance of each index according to the expert is necessary, and then a judgment matrix is constructed to determine the weight of each index. To ensure the rationality of the index weights, an expert group consisting of 11 experts was invited to judge the importance of each index. At the same time, we developed the pairwise comparison matrices based on the ANP model [63]. The relative importance values are determined on a scale of 1–9 [57, 63, 64], where 1 means equal importance between the two elements and 9 indicates the extreme importance of one element compared with the other one (see Table 2). In the current study, the data in the recycled Delphi expert questionnaire are used and combined with the principle of ANP. The local weight and global weight of each index are calculated via Super Decisions software.

4.2.1. Weight of Internal Independent Index Layer

In the ANP model, the 1–9 scaling method of Saaty is used to represent the importance of the factors, and the judgment matrix is expressed by the interval number [63]. Because A₁ and A₂ are independent indicators, there is no need to consider the interaction between factors, and the eigenvector method can be used to determine index weights. We used the data from the three-round Delphi expert questionnaire, construct a judgment matrix between the two first-level indexes, and derive the weights of the first-level indexes (see Table 3).

4.2.2. Consistency Test

When CR ≤ 0.1, the judgment matrix can be considered to have satisfactory consistency. The random consistency ratio is first tested to ensure the reliability of the construction of the index system and the rationality of the expert scoring. Through the consistency test scores of each judgment matrix in Table 4, the judgment matrix constructed by the expert scoring system has passed the consistency test and has satisfactory consistency under the index system constructed in this chapter. The judgment matrix also explains the scientificity and rationality of the weights obtained in this chapter.

4.2.3. Reliability and Validity Test

This study conducted a reliability and validity test to test the credibility and validity of the survey results, as presented in Table 5:

As can be seen from Table 5, Cronbach’s alpha value of government supervision and enterprise reliability index is above 0.9, indicating that the transparency index measurement of government regulation and enterprise information have good internal consistency and stability, and the reliability is good. The validity index of KMO is above 0.9, indicating that the factor analysis is suitable and the validity is high.

4.2.4. Network Layer Index Set and Weight of Each Index

The set of indexes of the network layer and indexes are not entirely independent and have a certain influence on each other. Therefore, when calculating the index weight, the local weight and global weight are obtained via the ANP method strictly according to the network hierarchy.

Firstly, we get the local weight of Bi through the interval judgment matrix constructed by experts (see Table 6).

To alleviate the mathematical burden, the following calculations were implemented through the software Super Decisions [65]. On completion of all pairwise comparison matrices, the unweighted supermatrix is built based on the interrelationship of each index in the Bi network layer (Table 7).

Then, we used the “Computations/Weighted Super Matrix” command in Super Decisions software and obtained the weighted supermatrix of the Bi evaluation index of the transparency for listed pharmaceutical enterprises in security risk information (Table 8).

Lastly, raising the weighted supermatrix to limiting powers until the weights converge and remain stable, the limit supermatrix will be achieved. At the same time, we got the global weight of Bi. The global weight of Ci can also be obtained through the same steps. Based on the above calculation steps, we can get the specific weight of each index of the transparency for listed pharmaceutical enterprises in security risk information (Table 9 shows the specific weight of each index).

4.3. Sample and Data Characteristics

The current study selected 303 listed enterprises in the biomedical sector as samples by consulting the Ruisi database. According to the indexes built in the previous section, the corresponding scoring standards are designed and divided into five categories: “good,” “relatively good,” “general,” “relatively poor,” and “poor.” Lastly, the evaluation criteria for the transparency score of security risk information in listed pharmaceutical enterprises are as follows: 100 points for full marks; 60, passing; 0–30, poor; 30–60, relatively poor; 60–75, general; 75–90, relatively good; and 90–100, good. We provide professional knowledge training for each investigator to collect sample information objectively and accurately. We modify and improve the sample form through pre-acquisition to determine the final sampling form for the transparent investigation of safety risk information in listed pharmaceutical enterprises.

According to the data collection form developed, we collected data in January and February 2019 through the websites of the government, enterprises, and China Securities Regulatory Commission and obtained 59,305 relevant data for transparency of security risk information in listed pharmaceutical enterprises. In this research, the sample is divided into 7 categories according to the economic region where the enterprise is located. The data samples are mainly concentrated in North and Southern China, with a total of 172 samples, and account for 56.77% of the total sample. Compared with the developed coastal areas, the sample size data of the Northeast and Northwest China are relatively small, and the number of enterprises is 8.91% of the sample size, which is below 10%. Table 10 shows the data characteristics.

4.4. Comprehensive Evaluation Value Calculation for Transparency of Security Risk Information in Listed Pharmaceutical Enterprises Based on the ANP-DS Model

According to the composition of the indexes for the transparency of security risk information in listed pharmaceutical enterprises (see Table 1), 11 experts from the drug safety experts, the market supervision administration department, and the marketing department of the listed biomedical enterprises were invited to analyze the relevant materials and data. Furthermore, experts have given confidence to the transparency evaluation indicators of listed pharmaceutical companies’ safety risk information.

Suppose H = {good (H₁), relatively good (H₂), general (H₃), relatively poor (H₄), poor (H₅)} is the fuzzy evaluation set selected for this section, and its fuzzy evaluation reference value is . We assume that the decision maker’s preference coefficient α = 0.9, and normalize the indexes of each layer in Table 9 and the normalized calculation results based on the local weight calculation are revealed in Table 11.

According to the survey and statistical results of the external and internal indexes, respectively, experts gave the initial evidence credibility regarding the third-level indexes for the transparency of security risk information in listed pharmaceutical enterprises after discussion. Initial credibility is multiplied by the weight corresponding to each third-level index. That is, the basic credibility calculation result of the third-level indicator is obtained (Appendix Table 3 presents the specific data). In the DS synthesis process, the current study uses the steps of evidence theory evaluation to write the DS synthesis program using MATLAB, owing to the extensive calculation. Using this program, we synthesize the basic credibility of the third-level indexes and obtain the initial credibility of the second-level indexes (the specific data is in Appendix Table 4). In the same manner, the basic credibility calculation results of the second-level indexes and initial credibility calculation results of the first-level indexes are obtained (specific data are presented in Appendix Table 5 and Appendix Table 6). Lastly, we use the programmed procedure to synthesize the results of the basic credibility of the first-level indexes (Appendix Table 7 provides the specific data) and obtain the credibility of the transparency level for the security risk information in listed pharmaceutical enterprises (see Table 12).

According to the formula, the comprehensive evaluation results of transparency for security risk information in Chinese listed pharmaceutical enterprises are as follows:

For the transparency of security risk information in Chinese listed pharmaceutical enterprises, due to 0.60 < 0.7360 < 0.80, the transparency level is between “general” and “relatively good,” and is inclined to be “relatively good.”

5. Empirical Results

Through the transparency evaluation of security risk information in Chinese listed pharmaceutical enterprises based on the ANP-DS model, we find that the reasons for the transparency of security risk information in Chinese listed pharmaceutical enterprises are as follows.(1)Among the 40 indexes for evaluating the transparency of safety risk information in Chinese listed pharmaceutical enterprises, a total of 3 indexes are at the levels of “relatively good” and “good” (Table 13).

Compared with other indexes, the information transparency of the indexes in Table 13 is above 0.8, which is between “relatively good” and “good.”(2)Among the 40 indexes for evaluating the transparency of safety risk information in Chinese listed pharmaceutical enterprises, 34 indexes are at the level between “general” and “relatively good” (Table 14).

The evaluation level of the indexes in Table 14 is between “general” and “relatively good.” The reason for the problems of these indexes is first the lack of legal links. The existing “Drug Administration Law of the People’s Republic of China,” “Regulations on the Implementation of the Drug Administration Law of the People’s Republic of China,” and “Regulations on the Administration of Drug Quality Supervision and Sampling,” as well as other provisions of the law, have further improved the Chinese drug safety legal system. However, during the review process from the production to the circulation of the drug, if the auditor violates the law and regulations, then the matter of the disposal of the certificate issued by the auditor and the relevant person responsible for the enterprise has no corresponding regulation. The ethics of pharmaceutical enterprises are lacking. The approval of the drug is based on the fact that the application materials and samples submitted by the enterprise are accurate and reliable, but the quality of the product cannot be guaranteed. Furthermore, enterprises directly tamper with production quality data and forge production and inspection records to reduce costs and obtain high profits. Government supervision is considerably lacking. The institutions responsible for reviewing and supervising drugs are complicated, including the Drug Evaluation Center of the General Administration, Food and Drug Inspection and Inspection Center of the General Administration, and Chinese Food and Drug Testing Institution. This decentralization of power has led to an inconsistent division of powers and responsibilities, resulting in a long-term situation of “separate government” in the drug regulatory authorities and contributed to the expansion of the drug incident. Moreover, current drug supervision is a mere formality. For example, local area owns an abnormal reaction investigation agency for disease prevention and control, but the agency undertakes the amount of vaccination work. In addition, third-party participation in drug safety is low. The supervision of pharmaceutical enterprises is affected by such factors as policy burden and regulatory capture and relies on the government. Moreover, the consumer, media, and pharmaceutical industry associations have a weak sense of responsibility, and the situation of coordinated management by government, enterprises, and third parties has yet to be formed.(3)Among the 40 indexes for evaluating the transparency of safety risk information in Chinese listed pharmaceutical enterprises, 3 indexes are at the level between “relatively poor” and “general” (Table 15).

The current design of the adverse drug reaction reporting system is flawed. The reporting methods are spontaneous and nonmandatory and rely heavily on the subjective judgment and reporting effort of the reporter. These factors lead to the low availability of adverse drug reaction cases in China, which seriously affects the early warning ability of drug safety. Furthermore, the processes of discovery, reporting, verification, evaluation, and risk control in the adverse drug reaction monitoring system involve multiple parties. For example, the drug regulatory and health departments are the competent authorities for monitoring and reporting in the adverse drug reaction monitoring system. However, the two government departments are not affiliated with each other, and simultaneously have cross-cutting in drug regulatory aspects of medical institutions. The drug regulatory authorities need to seek the opinions of the health administrative department when formulating relevant policies. Management departments are different; however, they have conflicts of interest, and therefore can shirk their responsibilities.

The new version of Good Manufacturing Practice (GMP) has raised the requirements for pharmaceutical enterprises in terms of equipment, production environment and conditions, production processes, management systems, and other aspects. These requirements can assist in controlling the quality and safety of the drug from the source and ensuring the safety, effectiveness, and uniformity of the drug quality. However, after the completion of the certification, some pharmaceutical manufacturers have deliberately relaxed the quality control from the factory entrance of the raw materials to the final product for cost reduction, sacrificed the quality of the drugs, or violated and illegally produced the requirements of the new GMP. Moreover, the production process is often not kept a secret, and the pharmaceutical enterprise falsely states the process or deliberately submits a registration process with incomplete and fuzzy parameters. In addition, enterprises intentionally exclude the deviation of the quality management of the enterprise’s products to reduce the impact on the GMP review results, causing the actual production process of the drug to be hidden from the preapproval process and not be traced when drug safety problems occur.

The “Regulations on Administrative Punishment Procedures for Drug Administration” in the field of drug regulation in China has not yet accurately defined various concepts. In the process of administrative law enforcement, an inevitable fuzzy zone exists in the application of the law, and the understanding between the administrative organs and the administrative counterparts is not synchronized. The imperfection of the drug administrative law enforcement suspected criminal case transfer system has led to a certain lag in consumers’ administrative punishment information. Therefore, the transparency of this index is low.

6. Conclusion

In recent years, the pressure of public opinion in the Chinese pharmaceutical industry has remained high, and corporate brands and reputation have been seriously damaged. Scholars actively explore how to block loopholes, eliminate risk, protect public health and safety, and improve the transparency of safety risk information in pharmaceutical companies. This study uses the ANP-DS method to construct a transparent comprehensive evaluation model for security risk information in listed pharmaceutical enterprises from the perspective of government supervision and listed pharmaceutical enterprises. Based on the 59,305 data obtained via 303 listed enterprises in the Chinese biomedical sector, we conducted an empirical study on the transparency of security risk information in Chinese listed pharmaceutical enterprises. The research conclusions are as follows.(1)The overall transparency level of the security risk information in Chinese listed pharmaceutical enterprises is between “general” and “relatively good” and tends to be “relatively good.” The overall transparency level has not yet reached the “good” level, and a certain gap continues to exist.(2)The transparency of government supervision information is between “general” and “relatively good,” but biased toward the “general.” The main reason is that in view of the problems in drug practice, blank and fuzzy areas continue to exist in the laws and regulations related to drug supervision. In particular, the drug reaction reporting system and administrative punishment information have seriously affected the transparency of government supervision information.(3)The transparency of listed pharmaceutical enterprises information is between “general” and “relatively good” and tends to be “relatively good.” However, a room for improvement in the production process and recorded information of enterprises continues.

The research results have specific reference significance for managing listed pharmaceutical enterprises and protecting consumer rights. However, this research only selects the data of the past three years and does not adequately consider the persistent impact of specific indicators on the transparency of the security risk information of listed pharmaceutical companies. Succeeding research can supply certain dynamic indexes to improve the existing index system and conduct a large sample of data on safety risk information of listed pharmaceutical enterprises in China for nearly 10 years, thereby making the results increasingly accurate and reliable.

Data Availability

The data used to support the findings of this study are available from the corresponding author upon request.

Conflicts of Interest

The authors declare that they have no conflicts of interest.

Acknowledgments

This work was supported by the National Natural Science Foundation of China (Nos. 71971111 and 71871115), the Humanity and Social Science Foundation of Ministry of Education of China (No. 19YJAZH086), the Key Project of Philosophy and Social Science Research in Colleges and Universities in Jiangsu Province (No. 2018SJZDI063), the Major Project of Philosophy and Social Science Research in Colleges and Universities in Jiangsu Province (No. 2019SJZDA035), the Innovation Team Project of Philosophy and Social Sciences in Colleges and Universities in Jiangsu Province (No. 2017ZSTD005), and Postgraduate Research and Practice Innovation Program of Jiangsu Province (No. SJKY19_1064).

References

W. Du, J. Guo, Y. Jing et al., “Drug safety surveillance in China and other countries: a review and comparison,” Value in Health the Journal of the International Society for Pharmacoeconomics & Outcomes Research, vol. 11, no. s1, pp. S130–S136, 2010.
View at: Publisher Site | Google Scholar
I. E. Cock, “Is the pharmaceutical industry’s preoccupation with the monotherapy drug model stifling the development of effective new drug therapies?” Inflammopharmacology, vol. 26, no. 3, pp. 861–879, 2018.
View at: Publisher Site | Google Scholar
J. M. Burgert, “An analysis of communication-centered policy alternatives to address the anesthesia drug shortage,” Health Policy and Technology, vol. 3, no. 1, pp. 66–73, 2014.
View at: Publisher Site | Google Scholar
H. Hagiwara, S. Nakano, Y. Ogawa, and M. Tohkin, “The effectiveness of risk communication regarding drug safety information: a nationwide survey by the Japanese public health insurance claims data,” Journal of Clinical Pharmacy and Therapeutics, vol. 40, no. 3, pp. 273–278, 2015.
View at: Publisher Site | Google Scholar
H. H. Tohkin, “Social policy and drug safety,” Clinics in Geriatric Medicine, vol. 2, no. 1, pp. 165–180, 1986.
View at: Publisher Site | Google Scholar
C. C. Yang, H. Yang, and L. Jiang, “Postmarketing drug safety surveillance using publicly available health-consumer-contributed content in social media,” ACM Transactions on Management Information Systems, vol. 5, no. 1, pp. 1–21, 2014.
View at: Publisher Site | Google Scholar
M.-S. Chen, “Workers’ participation and their health and safety protection in China’s transitional industrial economy,” International Journal of Occupational and Environmental Health, vol. 9, no. 4, pp. 368–377, 2003.
View at: Publisher Site | Google Scholar
R. Uthayakumar and S. Priyan, “Pharmaceutical supply chain and inventory management strategies: optimization for a pharmaceutical company and a hospital,” Operations Research for Health Care, vol. 2, no. 3, pp. 52–64, 2013.
View at: Publisher Site | Google Scholar
D. F. de Korne, J. D. van Wijngaarden, C. van Dyck, U. Francis Hiddema, and N. S. Klazinga, “Evaluation of aviation-based safety team training in a hospital in the Netherlands,” Journal of Health Organization and Management, vol. 28, no. 6, pp. 731–753, 2014.
View at: Publisher Site | Google Scholar
G. E. Applequist, J. F. Pekny, and G. V. Reklaitis, “Risk and uncertainty in managing chemical manufacturing supply chains,” Computers & Chemical Engineering, vol. 24, no. 9-10, pp. 2211–2222, 2000.
View at: Publisher Site | Google Scholar
Bethesda Maryland, “Summary of the executive session on emergency preparedness and the pharmaceutical supply chain,” American Journal of Health-System Pharmacy, vol. 59, no. 3, pp. 247–253, 2002.
View at: Publisher Site | Google Scholar
M. F. Davis, “Occupational health and safety information systems in the pharmaceutical industry,” Occupational Medicine, vol. 12, no. 1, pp. 179–191, 1997.
View at: Google Scholar
K. Naser, K. Al-Khatib, and Y. Karbhari, “Empirical evidence on the depth of corporate information disclosure in developing countries: the case of Jordan,” International Journal of Commerce and Management, vol. 12, no. 3/4, pp. 122–155, 2002.
View at: Publisher Site | Google Scholar
C. Zhang, “Insider motivation, corporate governance and information disclosure quality—empirical evidence from Shenzhen listed companies,” Research on Economics & Management, vol. 31, pp. 10–18, 2010.
View at: Google Scholar
M. S. Hossain, “Profitability attributes and the level of disclosure: a study on listed pharmaceutical companies of Bangladesh,” vol. 1, pp. 8–15, 2012.
View at: Google Scholar
S. Darmadi and A. Sodikin, “Information disclosure by family-controlled firms,” Asian Review of Accounting, vol. 21, no. 3, pp. 223–240, 2013.
View at: Publisher Site | Google Scholar
H. S. Ghorbel and F. Triki, “Voluntary corporate disclosure: motivation and consequences: the case of Tunisian listed firms (la divulgation volontaire: motivations et conséquences: cas des entreprises tunisiennes cotées) (French),” SSRN Electronic Journal, pp. 1–25, 2011.
View at: Publisher Site | Google Scholar
G. Yan, “The development of bio-pharmaceutical industry in China: problems and solutions,” Pakistan Journal of Pharmaceutical Sciences, vol. 27, no. 4, pp. 1035–1039, 2014.
View at: Google Scholar
V. K. Chong and I. R. C. Eggleton, “The impact of reliance on incentive-based compensation schemes, information asymmetry and organisational commitment on managerial performance,” Management Accounting Research, vol. 18, no. 3, pp. 312–342, 2007.
View at: Publisher Site | Google Scholar
L. Qiu, Z. Y. Chen, D. Y. Lu et al., “Public funding and private investment for R&D: a survey in China’s pharmaceutical industry,” Health Research Policy and Systems, vol. 12, no. 1, pp. 1–11, 2014.
View at: Publisher Site | Google Scholar
T. Chen, S. Wang, L. Pei, and J. Wang, “Assessment of dairy product safety supervision in sales link: a fuzzy-ANP comprehensive evaluation method,” Journal of Food Quality, vol. 2018, Article ID 1389879, 16 pages, 2018.
View at: Publisher Site | Google Scholar
F. Wang, “A strategic thinking of the scientific system of drug regulatory in China—advancing drug standards of China,” Journal of Translational Medicine, vol. 10, no. S2, p. A39, 2012.
View at: Publisher Site | Google Scholar
L. Zhang, L. Y. L. Wong, Y. He, and I. C. K. Wong, “Pharmacovigilance in China: current situation, successes and challenges,” Drug Safety, vol. 37, no. 10, pp. 765–770, 2014.
View at: Publisher Site | Google Scholar
Y. Wong, L. Zhu, W. Chu et al., “Internet-based mode of real-time drug supervision and administration,” Chinese Journal of New Drugs, vol. 17, no. 22, pp. 1908–1907, 2008.
View at: Google Scholar
G. R. Lv and Q. Yu, “The construction of intelligent supply chain,” Advanced Materials Research, vol. 694–697, pp. 3567–3570, 2013.
View at: Publisher Site | Google Scholar
E. M. Morais, T. M. Salgado, I. Vazquez Gomez, A. M. Duarte, and F. Fernandez-Llimos, “Differences in the information about procedures after cold chain disruption provided by pharmaceutical industry to hospital and community pharmacies,” European Journal of Hospital Pharmacy, vol. 23, no. 2, pp. 96–99, 2016.
View at: Publisher Site | Google Scholar
T. Vian, J. C. Kohler, G. Forte et al., “Promoting transparency, accountability, and access through a multi-stakeholder initiative: lessons from the medicines transparency alliance,” Journal of Pharmaceutical Policy and Practice, vol. 10, no. 1, pp. 1–11, 2017.
View at: Publisher Site | Google Scholar
R. Kaynak, T. Sert, G. Sert, and B. Akyuz, “Supply chain unethical behaviors and continuity of relationship: using the PLS approach for testing moderation effects of inter-organizational justice,” International Journal of Production Economics, vol. 162, pp. 83–91, 2015.
View at: Publisher Site | Google Scholar
G. Formoso, M. Font-Pous, W.-D. Ludwig et al., “Drug information by public health and regulatory institutions: results of an 8-country survey in Europe,” Health Policy, vol. 121, no. 3, pp. 257–264, 2017.
View at: Publisher Site | Google Scholar
R. M. Bushman and A. J. Smith, “Transparency, financial accounting information, and corporate governance,” Financial Accounting Information, and Corporate Governance, vol. 9, no. 1, pp. 237–333, 2003.
View at: Google Scholar
S. L. Norris, H. K. Holmer, L. A. Ogden, B. U. Burda, and R. Fu, “Characteristics of physicians receiving large payments from pharmaceutical companies and the accuracy of their disclosures in publications: an observational study,” BMC Medical Ethics, vol. 13, no. 1, p. 24, 2012.
View at: Publisher Site | Google Scholar
T. Chen, B. Ma, and J. Wang, “SIRS contagion model of food safety risk,” Journal of Food Safety, vol. 38, no. 1, pp. 1–9, 2018.
View at: Publisher Site | Google Scholar
C. Simon, “Corporate information transparency,” Journal of Management Development, vol. 25, no. 10, pp. 1029–1031, 2006.
View at: Publisher Site | Google Scholar
J. Overland, “Corporate social responsibility in context: the case for compulsory sustainability disclosure for listed public companies in Australia?” SSRN Electronic Journal, vol. 4, no. 2, pp. 1–20, 2007.
View at: Publisher Site | Google Scholar
D. G. Deboskey and P. R. Gillett, “The impact of multi-dimensional corporate transparency on us firms’ credit ratings and cost of capital,” Review of Quantitative Finance and Accounting, vol. 40, no. 1, pp. 101–134, 2013.
View at: Publisher Site | Google Scholar
W. Gillett and P. Leung, “Cultural impact on Chinese corporate disclosure—a corporate governance perspective,” Managerial Auditing Journal, vol. 21, no. 3, pp. 241–264, 2006.
View at: Publisher Site | Google Scholar
I. Torjesen, “Pressure grows for government to “grasp the nettle” and close hospitals,” BMJ, vol. 342, no. 2, Article ID d3921, 2011.
View at: Publisher Site | Google Scholar
F. Arnesano, L. Banci, I. Bertini et al., “Government information transparency,” Working Papers, vol. 12, no. 4, pp. 669–676, 2009.
View at: Google Scholar
M. Qi, “The analysis of Chinese food safety issues: legislations and governmental supervision,” Chinese Law & Government, vol. 45, no. 2, pp. 3–8, 2012.
View at: Publisher Site | Google Scholar
R. Y. Cheung and S. H. Goodwin, “An overview of Canadian and U.S. approaches to drug regulation and responses to postmarket adverse drug reactions,” Journal of Diabetes Science and Technology, vol. 7, no. 2, pp. 313–320, 2013.
View at: Publisher Site | Google Scholar
Y. Ma, L. Tian, J. Qi et al., “Experience on equipment supervision and inspection in food and drug control agency,” Chinese Journal of Medical Instrumentation, vol. 37, no. 5, pp. 370–372, 2013.
View at: Google Scholar
J. W. Lee, R. S. Weiner, J. M. Sailstad et al., “Method validation and measurement of biomarkers in nonclinical and clinical samples in drug development: a conference report,” Pharmaceutical Research, vol. 22, no. 4, pp. 499–511, 2005.
View at: Publisher Site | Google Scholar
F. Pea, P. Cojutti, L. Dose, and M. Baraldo, “A 1 year retrospective audit of quality indicators of clinical pharmacological advice for personalized linezolid dosing: one stone for two birds?” British Journal of Clinical Pharmacology, vol. 81, no. 2, pp. 341–348, 2016.
View at: Publisher Site | Google Scholar
X. Baraldo, “System design for information monitoring at drug sales end,” Applied Mechanics and Materials, vol. 48-49, pp. 817–823, 2011.
View at: Publisher Site | Google Scholar
I. Ayani, C. Aguirre, G. Gutiérrez et al., “A cost-analysis of suspected adverse drug reactions in a hospital emergency ward,” Pharmacoepidemiology & Drug Safety, vol. 8, no. 7, pp. 529–534, 2015.
View at: Publisher Site | Google Scholar
K. Wündisch, “The research-based pharmaceutical industry and society: what is at stake in the future?” Journal of Pharmaceutical Marketing & Management, vol. 16, no. 1, pp. 21–40, 2011.
View at: Publisher Site | Google Scholar
J. Tyrawski and D. C. Deandrea, “Pharmaceutical companies and their drugs on social media: a content analysis of drug information on popular social media sites,” Journal of Medical Internet Research, vol. 17, no. 6, pp. 1–13, 2015.
View at: Publisher Site | Google Scholar
Q. Zhang, “The Chinese regulatory licensing regime for pharmaceutical products: a law and economics analysis,” Michigan Telecommunications and Technology Law Review, vol. 20, no. 4, pp. 24–417, 2009.
View at: Google Scholar
K. B. Pissler and J. Liu, “Corporate governance of business organizations in the People’s Republic of China: the legal framework after the revision of the company law in 2005,” SSRN Electronic Journal, vol. 31, no. 1, pp. 156–207, 2010.
View at: Publisher Site | Google Scholar
M. A. Lyles, B. B. Flynn, and M. T. Frohlich, “All supply chains don’t flow through: understanding supply chain issues in product recalls,” Management & Organization Review, vol. 4, no. 2, pp. 167–182, 2010.
View at: Publisher Site | Google Scholar
Q. Liu, Y. Zhang, and H. Gao, “Biosafety suggestions in current national drug packaging containers (material) standard,” Chinese Journal of Pharmaceutical Analysis, vol. 32, no. 10, pp. 1889–1897, 2012.
View at: Google Scholar
H. Lin, O. J. Dyar, S. Rosales-Klintz et al., “Trends and patterns of antibiotic consumption in Shanghai municipality, China: a 6 year surveillance with sales records, 2009–14,” Journal of Antimicrobial Chemotherapy, vol. 71, no. 6, pp. 1723–1729, 2016.
View at: Publisher Site | Google Scholar
D. L. Gold and J. W. Dienhart, “Business ethics in the corporate governance era: domestic and international trends in transparency, regulation, and corporate governance,” Business & Society Review, vol. 112, no. 2, pp. 163–170, 2010.
View at: Publisher Site | Google Scholar
D. G. Barako, P. Hancock, and H. Y. Izan, “Factors influencing voluntary corporate disclosure by Kenyan companies,” Corporate Governance: An International Review, vol. 14, no. 2, pp. 107–125, 2010.
View at: Publisher Site | Google Scholar
A. Andrikopoulos, A. A. Merika, A. Triantafyllou, and A. G. Merikas, “Internet disclosure and corporate performance: a case study of the international shipping industry,” Transportation Research Part A: Policy and Practice, vol. 47, pp. 141–152, 2013.
View at: Publisher Site | Google Scholar
H. Merikas, B. M. Campbell, and J. A. Sayer, “Assessing viability and sustainability: a systems-based approach for deriving comprehensive indicator sets,” Conservation Ecology, vol. 5, no. 2, pp. 213–218, 2002.
View at: Publisher Site | Google Scholar
T. Chen, L. Wang, J. Wang, and Q. Yang, “A network diffusion model of food safety scare behavior considering information transparency,” Complexity, vol. 2017, no. 1, Article ID 5724925, 16 pages, 2017.
View at: Publisher Site | Google Scholar
K. Nishizawa, “Bidirectional nearness in a network by AHP (analytic hierarchy process) and ANP (analytic network process),” RAIRO—Operations Research, vol. 34, no. 34, pp. 313–330, 2010.
View at: Publisher Site | Google Scholar
M. Bauer, “Approximation algorithms and decision making in the Dempster-Shafer theory of evidence—an empirical study,” International Journal of Approximate Reasoning, vol. 17, no. 2-3, pp. 217–237, 1997.
View at: Publisher Site | Google Scholar
M. Sallak, W. Schön, and F. Aguirre, “Reliability assessment for multi-state systems under uncertainties based on the Dempster-Shafer theory,” IIE Transactions, vol. 45, no. 9, pp. 995–1007, 2013.
View at: Publisher Site | Google Scholar
S. Chowdhury, “Fusing probability density function into Dempster-Shafer theory of evidence for the evaluation of water treatment plant,” Environmental Monitoring and Assessment, vol. 185, no. 5, pp. 3917–3929, 2013.
View at: Publisher Site | Google Scholar
T. Chen, L. Wang, and J. Wang, “Transparent assessment of the supervision information in China’s food safety: a fuzzy-ANP comprehensive evaluation method,” Journal of Food Quality, vol. 2017, Article ID 4340869, 14 pages, 2017.
View at: Publisher Site | Google Scholar
T. L. Saaty, Decision Making with Dependence and Feedback: The Analytic Network Process, RWS Publications, Pittsburgh, PA, USA, 1996.
S. Jharkharia and R. Shankar, “Selection of logistics service provider: an analytic network process (ANP) approach,” Omega, vol. 35, no. 3, pp. 274–289, 2007.
View at: Publisher Site | Google Scholar
A. Smith-Perera, M. García-Melón, R. Poveda-Bautista, and J.-P. Pastor-Ferrando, “A project strategic index proposal for portfolio selection in electrical company based on the analytic network process,” Renewable and Sustainable Energy Reviews, vol. 14, no. 6, pp. 1569–1579, 2010.
View at: Publisher Site | Google Scholar

Copyright

Copyright © 2020 Jining Wang et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

350

Downloads

720

Citations