Clinical Study | Open Access
Manuel Eckenschwiller, Hanns Ackermann, Wolf O. Bechstein, Frank Grünwald, "Accuracy of Hepatobiliary Scintigraphy after Liver Transplantation and Liver Resection", International Journal of Molecular Imaging, vol. 2016, Article ID 7857849, 8 pages, 2016. https://doi.org/10.1155/2016/7857849
Accuracy of Hepatobiliary Scintigraphy after Liver Transplantation and Liver Resection
Background and Aims. Biliary complications are the most frequent complications after common liver surgeries. In this study, accuracy of hepatobiliary scintigraphy (HBS) and impact of hyperbilirubinemia were evaluated. Methods. Between November 2007 and February 2016, 131 patients underwent hepatobiliary scintigraphy after having liver surgery. 39 patients with 42 scans after LTX () or hepatic resection () were evaluated in the study; 27 were male, with mean age 60 years. The subjects underwent hepatobiliary scintigraphy with Tc-99m labeled Mebrofenin. The results were compared to ERCP as gold standard performed within one month after HBS. We calculated sensitivity, specificity, PPV, and NPV. We compared LTX patients to patients with other liver surgeries. Furthermore the influence of hyperbilirubinemia on HBS scans was evaluated. Results. HBS always provided the correct diagnosis in cases of bile leak in the liver-resected group (14/14). Overall diagnostic accuracy was 76% (19/25) in this group and 54% (7/13) in the LTX group. False negative (FN) diagnoses occurred more often among LTX patients (). Hyperbilirubinemia (>5 mg/dL) significantly influenced the excretion function of the liver, prolonging HBS’s time-activity-curve (). Conclusions. Hepatobiliary scintigraphy is a reliable tool to detect biliary complications, but reduced accuracy must be considered after LTX.
Hepatic resection is widely used for the curative treatment of primary and secondary malignant as well as benign liver diseases . In case of liver failure and end-stage liver disease, liver transplantation is required [2, 3]. In spite of great improvements in surgical techniques, however, postoperative complications remain a major cause of mortality and morbidity. For LTX and other liver surgeries, biliary tract complications such as bile leak or strictures are the most frequent postoperative complications [1, 4, 5]. Therefore a diagnostic tool to detect these complications should preferably be easy to perform, be noninvasive, and provide reliable results. The current gold standard in detecting biliary abnormalities is endoscopic retrograde cholangiopancreatography (ERCP) which is an invasive but reliable method and also provides interventional opportunities .
Other noninvasive diagnostic modalities are used to detect biliary complications after common liver surgery but are mostly limited due to different factors. Ultrasound is a quickly applicable, cheap, and broadly available diagnostic tool; however, it does not provide reliable results on biliary strictures  and bilomas  and can therefore only be used as screening or supplementary tool. For the evaluation of biliary complications, X-ray computed tomography is inferior to ERCP and magnetic resonance cholangiography, although it is useful in detecting vascular problems, abscesses, and bilomas. For the sole assessment of biliary strictures, magnetic resonance cholangiography is considered a reliable and noninvasive method . HBS scans are used as primary or supplementary diagnostic tools. Current study data evaluating the usefulness of hepatobiliary scintigraphies in liver transplanted patients are broad; however, most studies deal with specific details such as living donor liver transplantation [9, 10] or pediatric LTX . Reliable studies that actually examined the role of HBS in liver-resected patients are rare , because most of those studies focused on preoperative evaluation of liver function [13, 14]. Only a few studies with strict and reasonable inclusion criteria and a prospective study design were performed, focusing on LTX patients . There has not yet been a study investigating differences in the usefulness of HBS between liver transplanted and liver-resected patients. Moreover, the role of hyperbilirubinemia and its impact on cholescintigraphic scans remain unclear, as a study found bilirubin to have a negative influence on the diagnosis provided by HBS .
The aim of this study was to determine the usefulness of hepatobiliary scintigraphy in diagnosing the most frequent biliary complications after common liver surgery and to evaluate the influence of bilirubin on hepatobiliary scintigraphy scans.
2. Materials and Methods
This retrospective study was approved by the ethical review committee of the J. W. Goethe University Medical Center in Frankfurt, Germany (reference number: 27/13), and the need for written informed consent was waived.
2.1. Clinical Setting and Patients
Between November 2007 and February 2016, 131 patients underwent hepatobiliary scintigraphy after performed liver surgery (transplantation or resection). Inclusion criteria were an ERCP within one month (31 days) after the HBS and, furthermore, blood analyses performed within a maximum time of 2 days from the HBS. 39 patients with hepatobiliary scintigraphies (3 patients were examined twice) met inclusion criteria. 26 (66.7%) had undergone partial liver resection (hemihepatectomy, partial hepatectomy, or cholecystectomy) and 13 were liver transplanted patients. 27 (69%) were male and the mean age was 60 years.
2.2. Technical Equipment and Pharmaceuticals
Mebrofenin (Bridatec, GE Healthcare Buchler GmbH & Co. KG, Braunschweig, Germany), labeled with radioactive Tc-99m, was used as the tracer (1.11 MBq per kg body weight). The effective equivalent dose of Tc-99m is 0.017 mSv per MBq resulting in a total of 1.36 mSv for one examination of a patient weighing 70 kg. The maximum activity for one patient was 148 MBq.
2.2.2. Gamma Camera
Images were acquired with a large-field double-head gamma camera (DST-Xli, GE Healthcare, Solingen, Germany) equipped with a low-energy high resolution (LEHR) collimator.
Documentation of the images was done using RIS/PACS software (GE Healthcare, Dornstadt, Germany) and the analysis was performed using Xeleris software, version 3.0423 (GE Healthcare, Dornstadt, Germany).
2.3. Measurement and Evaluation
To avoid gall bladder contraction, the patients had to fast and were not allowed to smoke at least two hours prior to the examination. After intravenous bolus injection of Tc-99m-Mebrofenin with 1.11 MBq per kg body weight, dynamic sequences were started simultaneously from anterior and posterior views. To evaluate the perfusion phase, 60 frames were obtained with time intervals of one second each at the Tc-99m peak of 140 KeV with a 20% window, a 128 × 128 matrix (256 × 256 for static images), and a zoom of 1.33. After this first minute, another dynamic sequence was run with 30 frames and time intervals of 120 seconds each, taking 61 minutes for a complete dynamic acquisition. Static images were then obtained from anterior, posterior, and, if necessary, oblique and lateral views. They were taken 70, 80, and 90 minutes after injection for 10 minutes each. If abdominal activity was elevated and a maximum of 600,000 counts was reached before the time of 10 minutes, the acquisition was stopped earlier. If the patient lacked parenchymal clearance, more static images were taken until 24 hours after injection.
2.3.2. Evaluation of Hepatobiliary Scintigraphy
Quantitative evaluation was performed using Xeleris software, version 3.0423 by combining the dynamic images of the last 30 frames (120 sec/each) to make one sum picture. Two or three regions of interest (ROI) were then placed in this image: one over the liver in a noncentral part (to avoid measuring bile ducts), one over the duodenum, and, if necessary, one over the drainage bag. With the resulting time-activity curves (TAC), evaluation of liver uptake, excretion function, and transport to the bowel were performed and the peak of each curve was determined. The peaks were then compared to standard values: min for the uptake maximum in the liver and min in the duodenum. After 60 minutes, the liver parenchyma was expected to be nearly activity-free. Using these criteria, it was possible to analyze the parenchymal function and the bile excretion and transport into the duodenum. Possible diagnoses were bile leak, obstruction, and parenchymal dysfunction. All results were reviewed by experienced physicians. Parenchymal dysfunction was diagnosed if the uptake maximum appeared after more than 13 minutes after injection representing a prolonged clearance of the liver. Bile leak was diagnosed if tracer accumulated at a nonphysiological abdominal site (Figures 1 and 2). The diagnosis of biliary obstruction was made if the dynamic images showed a prolongation of the transport to the bowel or if bile retention was observed in the static images.
ERCP was performed at our institutional gastroenterologic department as the gold standard for our study within a maximum time of 31 days after the HBS. With this short period of time, we tried to avoid incorrect diagnoses due to changes in the biliary system. Because this was a retrospective study and ERCP was performed after the HBS, the physicians performing the HBS were blinded automatically. The ERCP was performed by at least one senior physician of the gastroenterologic department with one resident or another senior physician. Possible diagnoses were bile leak or obstruction and there was the possibility to extend the bile ducts with a balloon and implant stents.
2.3.4. Blood Parameters
Blood test analysis was performed at our institutional laboratory prior to the HBS scan, when possible, on the day of the examination. If lab data were not available on the same day, we took the closest results to the HBS with a maximum time of two days between blood sampling and scintigraphy.
2.3.5. Evaluation of Results
Hepatobiliary scintigraphy results were compared to ERCP as the gold standard and were categorized as true positive (TP), true negative (TN), false positive (FP), false negative (FN), and inconclusive. Results were considered positive when the HBS provided a nonphysiological result (e.g., biliary obstruction) that later was confirmed by ERCP (TP) or not confirmed (FP). Negatives were considered all results from the HBS that did not show abnormal liver function or tracer accumulation. These results were also compared to ERCP and were either confirmed (TN) or negated (FN). Using these values, we calculated sensitivity and specificity as well as positive predictive value (PPV) and negative predictive value (NPV). We compared patients with liver transplantation (LTX) to patients who had other types of surgery (hemihepatectomy, partial resection, or cholecystectomy). We also compared patients with elevated total bilirubin to patients who had normal bilirubin values. We calculated results for both 1 mg/dL and for 5 mg/dL as the upper thresholds of the standard total bilirubin values. At our institution 1 mg/dL was the standard bilirubin value, but since 5 mg/dL has shown to be statistically significant in other studies, we used both. Patients were categorized into three groups according to the peak of their TAC: 0–13 minutes was considered a normal excretion function of the liver; 14–20 minutes was categorized as moderate prolongation, and more than 20 minutes was considered severe prolongation. These three groups were analyzed for statistically significant differences due to elevated bilirubin levels. To evaluate the differences regarding the usefulness of the HBS scans, we also compared patients who were diagnosed by ERCP to have either bile leak, obstruction, or no findings. We analyzed whether there were any statistical differences with respect to blood tests, sensitivity, specificity, PPV, and NPV.
2.4. Statistical Analysis
Statistical analysis was performed using BiAS, version 10.03 for Windows (epsilon-Verlag, Hochheim Darmstadt, Germany). Data were analyzed using the chi2-test to compare the group of LTX patients with the group of liver-resected patients in relation to the diagnosis (TP, TN, FP, and FN). It was also used to analyze the dependence of the TAC on total bilirubin levels. For a more specific evaluation of the results of the chi2 test, we used Fisher’s exact test to determine which diagnosis was influenced most significantly. Kruskal-Wallis’ test was used to determine whether there was a significant distribution of quantitative values, such as blood tests, between the study groups. Results were considered statistically significant for a value <0.05.
Table 1 shows the characteristics of the study subjects.
|Surg. = surgery; HBS = hepatobiliary scintigraphy; ERCP = endoscopic retrograde cholangiopancreaticography; LTX = liver transplantation.|
Table 2 shows the median and the range of the blood tests of the study subjects at the time of the HBS scan. Kruskal-Wallis’ test showed that those values associated with the liver such as hepatic enzymes, bilirubin, albumin, or coagulation parameters were not statistically significant distributed between the final diagnoses (TP, TN, FP, and FN). The associated values between the laboratory values and the diagnoses are shown in Table 2.
|Lab = laboratory; GOT = glutamic-oxaloacetic-transaminase; GPT = glutamic-pyruvic-transaminase; GGT = gamma-glutamyl-transferase; alk. = alkaline; PT = prothrombin time; INR = international normalized ratio; PTT = partial prothrombin time; U = unit; L = litre; mg = milligram; dL = decilitre; sec = second.|
The comparison of LTX patients to patients who underwent liver resection showed a statistically significant difference in the distribution of results between both groups (Table 3) with a value = 0.035. This was due to the FN diagnoses showing a significant distribution with a value = 0.011. The reason was the group of LTX patients in which 6 of 13 scans (46%) were FN while in the resection group; there were only 2 FN out of 25 (8%). TP (), TN (), and FP () were not distributed significantly between the two groups.
|LTX = liver transplantation; TP = true positive; TN = true negative; FP = false positive; FN = false negative; inc. = inconclusive.|
26 out of 42 scans were read correctly and 12 were read falsely. Four patients included in the study were classified inconclusive regarding the diagnoses (TP, TN, FP, and FN): 2 patients were diagnosed by the HBS to have biliary obstruction while ERCP showed bile leak. So, those diagnoses were neither right nor wrong and could therefore not be classified TP or FN. 2 patients were classified inconclusive because ERCP had to be cancelled due to intestinal edema in one case and intestinal food rests in the other. Data from those 4 patients were only evaluated in the second part of the study in which we studied the dependence of the TAC on bilirubin. There were differences between the two groups with respect to sensitivity, specificity, PPV, and NPV which are shown in Table 4.
|LTX = liver transplantation; PPV = positive predictive value; NPV = negative predictive value.|
For a more specific evaluation, we evaluated data from the two groups with respect to differences between the diagnoses, “obstruction,” “bile leak,” or “no findings” (Table 5), confirmed by ERCP. Of note were the 14 liver-resected patients with a “bile leak” determined by ERCP who all were diagnosed correctly (TP) by the HBS, leading to a sensitivity of 100% for the “bile leak” diagnosis in liver-resected patients. The HBS provided the correct diagnosis in 76% of cases (19/25) for resected patients while the diagnostic accuracy for LTX patients was 54% (7/13). The diagnostic accuracy of the leakage and obstruction in liver transplantation and resection is also shown in Table 5, as it is equal to the sensitivity here. Inconclusive cases were not used for calculation and are therefore not included in Table 5.
|LTX = liver transplantation; TP = true positive; TN = true negative; FP = false positive; FN = false negative; sens. = sensitivity; spec. = specificity; acc. = diagnostic accuracy.|
3.1. Impact of Hyperbilirubinemia on HBS Scans
The comparison of both groups regarding the impact of total bilirubin on the diagnosis (TP, TN, FP, and FN) did not show any statistical significance. Neither 5 mg/dL nor 1 mg/dL as the threshold value had any significant impact on the correctness of the HBS results and there were no significant differences between the two groups.
We found that the hepatic uptake of Mebrofenin, which is expressed through the TAC, is slowed down by high bilirubin levels. Figure 3 shows the mean bilirubin levels in the three groups of TAC peaks with standard deviation (SD). The chi2-test showed a statistically significant dependence of those TACs on total bilirubin levels with a value = 0.001 for a threshold of 5 mg/dL and for a threshold of 1 mg/dL. Comparing the group with normal excretion function (peak of the TAC between 0 and 13 minutes) with the one with severe prolongation of excretion (>20 minutes), we found statistical significance for both thresholds (Figures 4(a) and 4(b)). When we compared patients with normal excretion function to all patients with prolonged excretion (>13 minutes), was 0.029 for 1 mg/dL.
We tried to evaluate the clinical usefulness of hepatobiliary scintigraphies compared to ERCP as the gold standard in patients who underwent common liver surgery, focusing on the comparison of LTX patients to liver-resected patients and on the HBS’s dependence on total bilirubin levels. Our results showed statistically significant differences in finding the correct diagnosis between LTX patients and the group of liver-resected patients with a value = 0.035. Dependence of the diagnosis on elevated total bilirubin could not be observed; however, we found that high levels of total bilirubin delayed the peak of the TAC of the HBS. Our study showed a remarkable difference between LTX patients and liver-resected patients with respect to the usefulness of the HBS.
Our study showed a significant difference between LTX patients and liver-resected patients, with respect to the diagnosis as well as remarkable differences in sensitivity, specificity, PPV, and NPV.
The relatively large amount of cases diagnosed as FN in the LTX group led to the significant difference between the two groups, to a low sensitivity (45%) and an even lower NPV (25%) for LTX patients. Other studies showed sensitivity ranging between 50% and 100% [3, 9, 10, 15]. This large range is most likely due to different study performances, different measurements, and other evaluation methods. In 1997, Kurzawinski et al.  performed a prospective study with LTX patients only, using similar inclusion criteria and study design as we did. Their results were similar to the now presented data, only their specificity for biliary complications was lower than in our study . A possible explanation for the low sensitivity and accuracy of the HBS in LTX patients might be due to the development of complications after performed hepatobiliary scintigraphy. We tried to rule out these FN diagnoses with a short period (1 month) between the HBS and ERCP, but it is nevertheless possible that changes might have occurred rendering the results different from the HBS. LTX being a more invasive and complex procedure as partial liver or gallbladder resection might lead to a broader variety of complications that are more difficult to detect by scintigraphy. This might explain why the HBS did not give reliable results for LTX patients who actually had complications.
The results for detection of obstruction in the liver-resected group were not as good as in other studies . Most comparable, retrospective studies showed good results for the detection of bile leak [3, 12, 16], as did ours. This seems likely as bile leaks are easy to detect by scintigraphy, for example, tracer accumulation in a nonphysiological site as shown in Figure 2.
Kurzawinski et al. calculated a low sensitivity (50%) for bile leak detection in their study . Their results indicate that the HBS is more useful in patients who have undergone liver or gallbladder resection than in LTX patients. The FP diagnoses in liver-resected patients affect PPV (78%) and specificity (56%) but usually have no bad influence on the treatment, as the patient receives further examinations to confirm the diagnosis. Our results show that the hepatobiliary scintigraphy is an appropriate method to detect biliary complications in general.
Another study showed significant negative influence of hyperbilirubinemia (>5 mg/dL) on the diagnosis provided by the HBS in patients who underwent orthotopic liver transplantation . A correlation between elevated total bilirubin and the final diagnosis could be observed in neither LTX patients nor in liver-resected patients. Yet there was a strong correlation between elevated total bilirubin and a prolonged peak of the TAC. This seems likely, as Mebrofenin is carried by the same transporters as bilirubin  and therefore the Mebrofenin uptake is competitively inhibited. Our results indicate that bilirubin > 5 mg/dL is a reliable cut-off-value (). Other lab values (Table 2) did not interact with the final diagnosis so that it can be concluded that alterations of those values do not influence the result of the HBS figures.
Hepatobiliary scintigraphies are used to detect complications as obstructions or bile leaks especially in patients who have undergone common liver surgery. Low sensitivity and NPV show that, in our study, the HBS did not prove to be successful in detecting complications in LTX patients. Although specificity and PPV were 100% each, it is the FN diagnoses that play an important role in clinical practice. Being diagnosed negatively for biliary complications by the HBS affects further treatment and, in case of FN diagnoses, might delay necessary treatment of existing complications. For patients with liver or gallbladder resection, the HBS is an appropriate method in the postoperative evaluation of complications.
Our study was retrospective, limiting the relevance of this study as it is more vulnerable to biases as a prospective study. We tried to minimize these biases with strict inclusion criteria. We focused solely on patients who had undergone ERCP as the gold standard within one month after the HBS to minimize the risk of severe intestinal changes leading to different diagnoses . There were no interventions between the HBS and ERCP that could have changed the structure of the anastomosis or intestinal anatomy. However, it was impossible to completely rule out changes that could lead to false diagnoses and therefore to low sensitivity, specificity, PPV, and NPV. Due to our small sample size (42 scans; 39 patients), the validity of our study is limited. However, our inclusion and exclusion criteria were strict, so in spite of the small number of study subjects, the data resulting from this study are more reliable.
Hepatobiliary scintigraphy in general is an appropriate method to detect biliary complications after common liver surgery. However, as the HBS proved to be less sensitive in LTX patients, a negative result in a clinically suspicious patient should be confirmed by other diagnostic tests, preferably ERCP. HBS is a reliable method to detect bile leak, especially in liver-resected patients, and may therefore be used in the follow-up of these patients. Hyperbilirubinemia prolongs the hepatic uptake of Mebrofenin and prolongs the HBS’s TAC, but the final result, the diagnosis, is not influenced. Therefore, hepatobiliary scintigraphy can also be performed in patients with high bilirubin levels. We recommend a restricted use of the HBS in LTX patients but advise this diagnostic tool to rule out bile leaks after liver surgery.
The authors declare that there are no competing interests regarding the publication of this paper.
Special thanks are due to Mr. Donald Ludwig for his time, his constructive criticism, and his corrections. Thanks are due to Mr. Hüdayi Korkusuz for his hard work and his knowledge.
- W. R. Jarnagin, M. Gonen, Y. Fong et al., “Improvement in perioperative outcome after hepatic resection: analysis of 1,803 consecutive cases over the past decade,” Annals of Surgery, vol. 236, no. 4, pp. 397–407, 2002.
- D.-B. Moon and S.-G. Lee, “Liver transplantation,” Gut and Liver, vol. 3, no. 3, pp. 145–165, 2009.
- M. S. Al Sofayan, A. Ibrahim, A. Helmy, M. I. Al Saghier, M. I. Al Sebayel, and M. M. Abozied, “Nuclear imaging of the liver: is there a diagnostic role of HIDA in posttransplantation?” Transplantation Proceedings, vol. 41, no. 1, pp. 201–207, 2009.
- A. R. Mueller, K.-P. Platz, and B. Kremer, “Early postoperative complications following liver transplantation,” Best Practice and Research: Clinical Gastroenterology, vol. 18, no. 5, pp. 881–900, 2004.
- M. Wojcicki, P. Milkiewicz, and M. Silva, “Biliary tract complications after liver transplantation: a review,” Digestive Surgery, vol. 25, no. 4, pp. 245–257, 2008.
- C. Sanna, C. Giordanino, I. Giono et al., “Safety and efficacy of endoscopic retrograde cholangiopancreatography in patients with post-liver transplant biliary complications: results of a cohort study with long-term follow-up,” Gut and Liver, vol. 5, no. 3, pp. 328–334, 2011.
- D. M. Beswick, R. Miraglia, S. Caruso et al., “The role of ultrasound and magnetic resonance cholangiopancreatography for the diagnosis of biliary stricture after liver transplantation,” European Journal of Radiology, vol. 81, no. 9, pp. 2089–2092, 2012.
- A. K. Singh, A. C. Nachiappan, H. A. Verma et al., “Postoperative imaging in liver transplantation: what radiologists should know,” Radiographics, vol. 30, no. 2, pp. 339–351, 2010.
- J. Kim, D. Moon, S. Lee et al., “The usefulness of hepatobiliary scintigraphy in the diagnosis of complications after adult-to-adult living donor liver transplantation,” European Journal of Nuclear Medicine, vol. 29, no. 4, pp. 473–479, 2002.
- Y. J. Kim, K. T. Lee, Y. C. Jo et al., “Hepatobiliary scintigraphy for detecting biliary strictures after living donor liver transplantation,” World Journal of Gastroenterology, vol. 17, no. 21, pp. 2626–2631, 2011.
- R. C. Concannon, R. Howman-Giles, A. Shun, and M. O. Stormon, “Hepatobiliary scintigraphy for the assessment of biliary strictures after pediatric liver transplantation,” Pediatric Transplantation, vol. 13, no. 8, pp. 977–983, 2009.
- J. S. Kim, D. H. Moon, S. G. Lee et al., “Hepatobiliary scintigraphy in the assessment of biliary obstruction after hepatic resection with biliary-enteric anastomosis,” European Journal of Nuclear Medicine, vol. 27, no. 2, pp. 170–175, 2000.
- W. de Graaf, K. P. van Lienden, S. Dinant et al., “Assessment of future remnant liver function using hepatobiliary scintigraphy in patients undergoing major liver resection,” Journal of Gastrointestinal Surgery, vol. 14, no. 2, pp. 369–378, 2010.
- R. J. Bennink, S. Dinant, D. Erdogan et al., “Preoperative assessment of postoperative remnant liver function using hepatobiliary scintigraphy,” Journal of Nuclear Medicine, vol. 45, no. 6, pp. 965–971, 2004.
- T. R. Kurzawinski, L. Selves, M. Farouk et al., “Prospective study of hepatobiliary scintigraphy and endoscopic cholangiography for the detection of early biliary complications after orthotopic liver transplantation,” British Journal of Surgery, vol. 84, no. 5, pp. 620–623, 1997.
- L. O. Hopkins, E. Feyssa, A. Parsikia et al., “Tc-99m-BrIDA hepatobiliary (HIDA) scan has a low sensitivity for detecting biliary complications after orthotopic liver transplantation in patients with hyperbilirubinemia,” Annals of Nuclear Medicine, vol. 25, no. 10, pp. 762–767, 2011.
- W. de Graaf, S. Häusler, M. Heger et al., “Transporters involved in the hepatic uptake of 99mTc-mebrofenin and indocyanine green,” Journal of Hepatology, vol. 54, no. 4, pp. 738–745, 2011.
Copyright © 2016 Manuel Eckenschwiller et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.