Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Acute Myocardial Infarction Risk in Patients with Coronary Artery Disease Doubled after Upper Gastrointestinal Tract Bleeding: A Nationwide Nested Case-Control Study

  • Chia-Jung Wu ,

    Contributed equally to this work with: Chia-Jung Wu, Hung-Jung Lin

    ‡ These authors are first authors on this work.

    Affiliation Department of Emergency Medicine, Chi-Mei Medical Center, Tainan, Taiwan

  • Hung-Jung Lin ,

    Contributed equally to this work with: Chia-Jung Wu, Hung-Jung Lin

    ‡ These authors are first authors on this work.

    Affiliations Department of Emergency Medicine, Chi-Mei Medical Center, Tainan, Taiwan, Department of Emergency Medicine, Taipei Medical University, Taipei, Taiwan, Department of Biotechnology, Southern Taiwan University of Science and Technology, Tainan, Taiwan

  • Shih-Feng Weng,

    Affiliations Department of Medical Research, Chi-Mei Medical Center, Tainan, Taiwan, Department of Healthcare Administration and Medical Informatics, Kaohsiung Medical University, Kaohsiung, Taiwan

  • Chien-Chin Hsu,

    Affiliations Department of Emergency Medicine, Chi-Mei Medical Center, Tainan, Taiwan, Department of Biotechnology, Southern Taiwan University of Science and Technology, Tainan, Taiwan

  • Jhi-Joung Wang,

    Affiliation Department of Medical Research, Chi-Mei Medical Center, Tainan, Taiwan

  • Shih-Bin Su,

    Affiliations Department of Occupational Medicine, Chi-Mei Medical Center, Tainan, Taiwan, Department of Leisure, Recreation and Tourism Management, Southern Taiwan University of Science and Technology, Tainan, Taiwan, Department of Medical Research, Chi Mei Medical Center, Liouying, Tainan, Taiwan

  • Chien-Cheng Huang ,

    chienchenghuang@yahoo.com.tw (C. C. Huang); hrguo@mail.ncku.edu.tw (HRG)

    Affiliations Department of Emergency Medicine, Chi-Mei Medical Center, Tainan, Taiwan, Department of Occupational Medicine, Chi-Mei Medical Center, Tainan, Taiwan, Department of Environmental and Occupational Health, College of Medicine, National Cheng Kung University, Tainan, Taiwan, Department of Child Care and Education, Southern Taiwan University of Science and Technology, Tainan, Taiwan, Department of Geriatrics and Geronotology, Chi-Mei Medical Center, Tainan, Taiwan

  • How-Ran Guo

    chienchenghuang@yahoo.com.tw (C. C. Huang); hrguo@mail.ncku.edu.tw (HRG)

    Affiliations Department of Environmental and Occupational Health, College of Medicine, National Cheng Kung University, Tainan, Taiwan, Department of Occupational and Environmental Medicine, National Cheng Kung University Hospital, Tainan, Taiwan

Abstract

Prior studies of upper gastrointestinal bleeding (UGIB) and acute myocardial infarction (AMI) are small, and long-term effects of UGIB on AMI have not been delineated. We investigated whether UGIB in patients diagnosed with coronary artery disease (CAD) increased their risk of subsequent AMI. This was a population-based, nested case-control study using Taiwan’s National Health Insurance Research Database. After propensity-score matching for age, gender, comorbidities, CAD date, and follow-up duration, we identified 1,677 new-onset CAD patients with AMI (AMI[+]) between 2001 and 2006 as the case group and 10,062 new-onset CAD patients without (AMI[−]) as the control group. Conditional logistic regression was used to examine the association between UGIB and AMI. Compared with UGIB[−] patients, UGIB[+] patients had twice the risk for subsequent AMI (adjusted odds ratio [AOR] = 2.08; 95% confidence interval [CI], 1.72–2.50). In the subgroup analysis for gender and age, UGIB[+] women (AOR = 2.70; 95% CI, 2.03–3.57) and patients < 65 years old (AOR = 2.23; 95% CI, 1.56–3.18) had higher odds of an AMI. UGIB[+] AMI[+] patients used nonsignificantly less aspirin than did UGIB[−] AMI[+] patients (27.69% vs. 35.61%, respectively). UGIB increased the risk of subsequent AMI in CAD patients, especially in women and patients < 65. This suggests that physicians need to use earlier and more aggressive intervention to detect UGIB and prevent AMI in CAD patients.

Introduction

Upper gastrointestinal bleeding (UGIB) is a common, costly, and potentially life-threatening disease [1]. It must be managed promptly and appropriately to prevent adverse outcomes [1]. Peptic ulcer bleeding is the most common type of UGIB, accounting for 31–67% of all cases, followed by erosive disease, variceal bleeding, esophagitis, malignancies, and Mallory-Weiss tear [1,2]. In the U.S., the annual rate of hospitalization for peptic ulcer disease and UGIB is estimated to be 165 per 100,000 in 1999—more than 300,000 hospitalizations per year, at a cost of $2.5 billion [3,4]. After antimicrobial drugs became available to eradicate H. pylori, the hospitalization rate for peptic ulcer disease decreased to 56.5/100,000 in 2005 (95% CI 54.6–58.3) [5]. Furthermore, despite advances in therapy, the mortality rate has remained unchanged at 7–10% [6]. This may be because today’s patients are older and have more comorbidities than did patients in the past [7].

UGIB can produce hypovolemia, hypotension, and diminished oxygen-carrying capacity, which causes myocardial ischemia and necrosis [811]. Prior studies of UGIB and AMI are small, and long-term effects of UGIB on AMI have not been delineated. In addition, all the previous studies focused on the simultaneous presentation of AMI and UGIB [811], and the subacute and long-term effects of UGIB on the subsequent risk of AMI in CAD patients were still unclear, even though the impact of UGIB is expected to be larger in CAD patients [9,10]. Therefore, we did a population-based, nested case-control study to investigate UGIB and the subsequent AMI risk in CAD patients.

Materials and Methods

Data sources

The Taiwan National Health Insurance (NHI) Program, a universal health care system that covers 99% of the country’s population of 23.3 million [12], has one of the world’s largest and most complete population-based healthcare claims datasets. The NHI Research Database (NHIRD) contains encrypted patient identification numbers, ICD-9-CM (International Classification of Diseases, Ninth Revision, Clinical Modification) codes for applied clinical diagnoses and procedures, details of prescribed drugs, dates of admission and discharge, and basic sociodemographic information, including gender and date of birth. All the expenses of CAD, UGIB, and AMI are covered by NHI.

The present study used a representative subset of the original NHIRD; this subset contains the claims information of 1,000,000 patients randomly selected from the NHI Registry of Beneficiaries 2000. The study was conducted according to the Declaration of Helsinki and was approved by the Chi-Mei Medical Center Institutional Review Board, which waived the need for informed consent because the dataset consists of nationwide, unidentifiable, secondary data released to the public for research. This waiver does not adversely affect the rights and welfare of the patients.

Study population

In this nested case control study, we identified all patients with new-onset CAD (ICD-9 codes 410–414.02) from 2001 to 2006 (n = 61,303) (Fig 1). The cohort entry date for each patient was defined as the date their first ambulatory or inpatient visit. Patients diagnosed with UGIB (ICD-9 codes 578.9, 531.0, 531.2, 531.4, 531.6, 532.0, 532.2, 532.4, 532.6, 533.0, 533.2, 533.4, 533.6, 534.0, 534.2, 534.4, and 534.6) before the study (n = 5,003) and patients with missing variables (n = 37) were excluded (Fig 1). Finally, 56,263 CAD patients without a history of UGIB (UGIB[−]) were enrolled (Fig 1). The cohort members were followed-up until they developed AMI, died, or withdrew from the NHI program, or until December 2011, whichever came first.

thumbnail
Fig 1. Flow diagram of the study.

CAD, coronary artery disease; UGIB, upper gastrointestinal bleeding; DM, diabetes mellitus; HTN, hypertension; CHF, congestive heart failure; COPD, chronic obstructive pulmonary disease; AMI, acute myocardial infarction.

https://doi.org/10.1371/journal.pone.0142000.g001

AMI[+] patients and AMI[−] controls

The study outcome was AMI, which was defined as any admission for AMI based on ICD-9 codes 410.0–410.92. The date of the first AMI claim was defined as the date on which AMI was first clinically diagnosed (index date). The date of AMI onset was the same with the date of AMI claim. For each enrolled AMI patient, we randomly selected 6 propensity-score-matched controls from the new-onset AMI[−] CAD[+]cohort. Controls and AMI[+] patients were matched based on birth year, gender, comorbidities, CAD date (cohort entry date), and index date (Fig 1). Controls had the same index date as their corresponding matched patients. The comorbidities were diabetes mellitus (DM) (ICD-9 code 250), hypertension (HTN) (ICD-9 codes 401–405), congestive heart failure (CHF) (ICD-9 codes 428), renal disease (ICD-9 codes 582, 583, 585, 586, 588), stroke (ICD-9 codes 430–438), cancer (ICD-9 codes 140–208), liver disease (ICD-9 codes 571.2, 571.4, 571.5, 571.6, 456.0–456.2, 572.2–572.8), and chronic obstructive pulmonary disease (COPD) (ICD-9 codes 490–496, 500–505, 506.4). Propensity-score matching was used to reduce selection bias in our hypothesis because it can bundle many confounding covariates that may be present in an observational study with this number of variables. If there was no matching control, the AMI[+] patient was excluded. Finally, 1,677 AMI[+] patients and 10,062 AMI[−] controls (1:6) from 2001 to 2006 were included (Fig 1).

Exposure assessment

This nested case-control study compared the association between UGIB and AMI in new-onset CAD patients.

Subgroup analyses

We analyzed the effect of a UGIB on developing AMI in new-onset CAD patients. Because both gender and age are well known risk factors for AMI, we performed stratified analyses to evaluate whether the possible effects of UGIB on AMI are different between the two genders and whether the effects are larger or smaller on the elderly. Elderly was defined as ≥ 65 years old (Fig 1).

Statistical analysis

The significance of the differences in baseline characteristics and comorbid variables between the two groups was evaluated using Student’s t test for continuous variables and Pearson χ2 tests for categorical variables. The odds ratio (OR) and 95% confidence interval (CI) were calculated using conditional logistic regression adjusted for antiplatelet use to examine the association between UGIB and AMI. The comparison of antiplatelet use between UGIB[+] and UGIB[−] patients in the AMI[+] group was done using a χ2 test. SAS 9.3.1 for Windows (SAS Institute, Inc, Cary, NC, USA) was used for all analyses. Significance was set at P < 0.05.

Results

Demographic data

After propensity-score matching, there were no significant differences in age, follow-up duration, gender, or comorbidities (Table 1). The mean age in the AMI[+] group was 65.46 ± 12.68 years and in the AMI[−] group was 65.63 ± 12.80 years. The combined mean follow-up duration for both groups was 3.30 ± 2.97 years (Table 1).

thumbnail
Table 1. Demographic characteristics of CAD patients.

Data are presented as n (%) or means ± standard deviation. CAD, coronary artery disease; AMI, acute myocardial infarction; DM, diabetes mellitus; HTN, hypertension; CHF, congestive heart failure; COPD, chronic obstructive pulmonary disease.

https://doi.org/10.1371/journal.pone.0142000.t001

UGIB and subsequent risk of AMI

Of the 1,677 AMI[+] patients, 242 (14.43%) had UGIB before AMI (Table 2). In the AMI[−] control group, 890 of 10,062 patients (8.85%) had UGIB before the index date (Table 2). The adjusted OR (AOR) for AMI[+] patients with UGIB was 2.08 (95% CI, 1.72–2.50).

thumbnail
Table 2. UGIB and subsequent risk of AMI in CAD patients.

UGIB, upper gastrointestinal bleeding; AMI, acute myocardial infarction; CAD, coronary artery disease; OR, odds ratio. Adjusted by antiplatelet use.

https://doi.org/10.1371/journal.pone.0142000.t002

Subgroup analyses stratified by gender and age

In the subgroup analysis for gender, the AOR for AMI[+] patients who had UGIB was 1.65 (95% CI, 1.28–2.13) for males and 2.70 (95% CI, 2.03–3.57) for females (Table 3). In the subgroup analysis for age, the AOR for AMI[+] patients who had UGIB was 2.23 (95% CI, 1.56–3.18) for patients < 65 and 2.01 (95% CI, 1.59–2.52) for patients ≥ 65 (Table 4).

thumbnail
Table 3. Gender subgroup of UGIB and subsequent risk of AMI in CAD patients.

UGIB, upper gastrointestinal bleeding; AMI, acute myocardial infarction; CAD, coronary artery disease; OR, odds ratio. Adjusted by antiplatelet use.

https://doi.org/10.1371/journal.pone.0142000.t003

thumbnail
Table 4. Age subgroup of UGIB and subsequent risk of AMI in CAD patients.

UGIB, upper gastrointestinal bleeding; AMI, acute myocardial infarction; CAD, coronary artery disease; OR, odds ratio. Adjusted by antiplatelet use.

https://doi.org/10.1371/journal.pone.0142000.t004

Antiplatelet use in the AMI[+] group

AMI[+] patients who were also UGIB[+] took less aspirin (27.69% vs. 35.61%), more clopidogrel (6.61% vs. 5.85%), and less aspirin + clopidogrel (23.97% vs. 24.32%) than did AMI[+] patients who were UGIB[−] (Table 5). However, the difference was not significant (P = 0.0629).

Proton pump inhibitors and H2 receptor blockers use in the UGIB[+] group

UGIB[+] patients who were also AMI[+] took more proton pump inhibitors (71.07% vs. 49.10%, P <0.0001) and more H2 receptor blockers (6.61% vs. 5.85%, P = 0.0011) than did UGIB[+] patients who were AMI[−] (Table 6).

thumbnail
Table 6. Proton pump inhibitors and H2 receptor blockers use in the UGIB[+] group.

https://doi.org/10.1371/journal.pone.0142000.t006

Discussion

We found that patients with CAD and then UGIB, especially women and those < 65 years old, had twice the risk of developing an AMI than did CAD patients without UGIB. To prevent AMI and subsequent mortality and morbidity, early referral of CAD patients with UGIB for additional evaluation and treatment may be needed.

Other studies have reported that the prevalence of AMI in patients with UGIB ranges from 1% to 14% [811]. There is no general agreement about risk stratification of AMI in patients with UGIB. Some studies [811,13,14] suggest that those with a greater number of coronary risk factors, a history of CAD, lower blood pressure on admission, older age, severe illnesses, or lower hemoglobulin have a greater risk of AMI.

There are two scenarios between UGIB and AMI. The first one is that UGIB predisposes a patient to develop AMI, and the second is that AMI predisposes a patient to develop UGIB. Cappell (2000) suggested that when UGIB precipitates an AMI, it tends to be acute and massive, whereas UGIB precipitated after an AMI has been treated tends to be self-limited and often resolves with the reversal of underlying coagulopathy [15]. We found that UGIB has a continuing potential to induce a subsequent AMI in CAD patients. This may be because of (i) anemia and hypoperfusion: AMI secondary to ischemia may be due to a decrease in the body’s oxygen supply. Bellotto (2005) showed that hemoglobin ≤ 8.2 g/dL was a significant risk factor for myocardial necrosis [8]. Activating the sympathetic nervous system can increase demand for myocardial oxygen and worsen ischemia; or (ii) discontinuing of antiplatelet use: antiplatelet drug therapy, such as aspirin and clopidogrel, should be continued to reduce the risk of plaque rupture and recurrent AMI. In the present study, UGIB[+] AMI[+] patients used less aspirin than did UGIB[+] AMI[−] patients. Aspirin was always discontinued after UGIB because aspirin doubles the risk of bleeding ulcers, even at doses as low as 75 mg daily [16]. Aspirin is first-line, because of its low cost and comparable efficacy, and clopidogrel is reserved for patients who cannot tolerate aspirin [17]. The combination of clopidogrel and aspirin may reduce the risk of cardiovascular events, but it raises the risk of hemorrhage [17]. In total, 64.7% AMI[+] patients have antiplatelet therapy (aspirin, clopidogrel, or both), which was a relative low percentage. There was no report about the compliance of antiplatelet therapy in patients with CAD in Taiwan. However, a study about antihypertensive medication compliance in Taiwan reported only 53% of the patients had high compliance with antihypertensive medication [18], which may be due to the characteristics of this population. The present study also showed UGIB[+] AMI[+] patients took more proton pump inhibitors and more H2 receptor blockers than did UGIB[+] AMI[−] patients, which suggested that both of these two drugs may not reduce the AMI risk in UGIB[+] patients.

In the subgroup analysis, we found that women and patients < 65 years old had twice the risk of developing an AMI than did CAD patients without UGIB, which has never been reported before. Other studies [811,13,14] reported that older age is a risk factor and simultaneous UGIB and AMI occurred most often in men. Although our data do not give us sufficient information to explain this apparent discrepancy, we hypothesize that women and patients < 65 have fewer comorbidities than do men and the elderly; therefore, UGIB is the most likely factor that contributes to AMI.

This study has some limitations. First, the comorbidities relied on the claims data and ICD-9-CM diagnosis codes, which may have resulted in disease misclassification. However, many studies have validated that ICD-9-CM diagnosis codes of NHIRD have a high sensitivity and specificity for the actual diagnosis [1921]. Second, the NHIRD contains no information on the severity of UGIB and AMI; therefore, we were unable to evaluate the severity association between them. Third, some important laboratory data, such as hemoglobin concentrations, and drugs, such as NSAIDs (nonsteroid anti-inflammatory drugs) and SSRI (selective serotonin reuptake inhibitors), were not available in the NHIRD, therefore, we could not interpret the available results fully and adjust for these variables as contributing factors in this study. Further study about this issue is warranted. Fourth, whereas we observed a temporal association between UGIB and AMI, we were unable to provide the risk estimates of AMI within certain periods of time (e.g. 1, 6, or 12 months of the bleed) and what percentage of patients discontinued aspirin or changed antiplatelet therapy which may affects subsequent AMI. However, this study showed that AMI[+] patients who were also UGIB[+] took less aspirin and less aspirin + clopidogrel than did AMI[+] patients who were UGIB[−], which was an indirect evidence of discontinue for aspirin. In addition, while diminished oxygen carrying capacity following UGIB is a plausible explanation, the presentation of AMI in such cases would be acute rather than subacute. A cohort study that recruits a group of CAD patients who have UGIB and follows them over time for AMI episodes after the UGIB including discontinue of aspirin is needed to obtain such estimates. Fifth, we did not identify the origin of UGIB and recurrent UGIB. However, the aim of this study was to evaluate whether CAD patients have a higher risk of developing AMI after UGIB, and therefore further studies that identify the origin of UGIB and recurrent UGIB are warranted for developing more specific prevention strategies. Sixth, although our database was national, our findings may not be generalizable to similar cohorts in other nations.

Conclusions

This is the first nationwide population-based, nested case-control study to clarify that CAD patients, especially women and those < 65 years old, have twice the risk of developing an AMI after UGIB than do CAD patients who do not have UGIB. Therefore, early referral of CAD patients who develop UGIB for additional evaluation and treatment, including a modification of antiplatelet therapy, is needed to lower the risk of developing AMI.

Acknowledgments

This study was supported by grants CMFHR10440 from the Chi-Mei Medical Center. This study is based in part on data from the Taiwan National Health Insurance Research Database provided by the National Health Insurance Administration, Ministry of Health and Welfare, and managed by National Health Research Institutes (Registered number NHIRD-100-057, NHIRD-102-024). The interpretation and conclusions contained herein do not represent those of the National Health Insurance Administration, Ministry of Health and Welfare or National Health Research Institutes. We thank Bill Franke for his invaluable advice and editorial assistance.

Author Contributions

Conceived and designed the experiments: CJW HJL C. C. Huang HRG. Performed the experiments: CJW HJL C. C. Huang HRG. Analyzed the data: SFW. Contributed reagents/materials/analysis tools: SFW. Wrote the paper: CJW HJL C. C. Huang HRG SFW C. C. Hsu JJW SBS.

References

  1. 1. Albeldawi M, Qadeer MA, Vargo JJ. Managing acute upper GI bleeding, preventing recurrences. Cleve Clin J Med. 2010; 77: 131–142. pmid:20124271
  2. 2. Holster IL, Kuipers EJ. Management of acute nonvariceal upper gastrointestinal bleeding: current policies and future perspectives. World J Gastroenterol. 2012; 18: 1202–1207. pmid:22468083
  3. 3. Lewis JD, Bilker WB, Brensinger C, Farrar JT, Strom BL. Hospitalization and mortality rates from peptic ulcer disease and GI bleeding in the 1990s: relationship to sales of non-steroidal anti-inflammatory drugs and acid suppression medications. Am J Gastroenterol. 2002; 97: 2540–2549. pmid:12385436
  4. 4. Viviane A, Alan BN. Estimates of costs of hospital stays for variceal and nonvariceal upper gastrointestinal bleeding in the United States. Value Health. 2008; 11: 1–3. pmid:18237354
  5. 5. Feinstein LB, Holman RC, Yorita Christensen KL, Steiner CA, Swerdlow DL. Trends in hospitalizations for peptic ulcer disease, United States, 1998–2005. Emerg Infect Dis. 2010; 16: 1410–1418. pmid:20735925
  6. 6. Yavorski RT, Wong RK, Maydonovitch C, Battin LS, Furnia A, Amundson DE. Analysis of 3,294 cases of upper gastrointestinal bleeding in military medical facilities. Am J Gastroenterol. 1995; 90: 568–573. pmid:7717312
  7. 7. Kaplan RC, Heckbert SR, Koepsell TD, Furberg CD, Polak JF, Schoen RE, et al. Risk factors for hospitalized gastrointestinal bleeding among older persons. Cardiovascular Health Study Investigators. J Am Geriatr Soc. 2001; 49: 126–133. pmid:11207865
  8. 8. Bellotto F, Fagiuoli S, Pavei A, Gregory SA, Cati A, Silverj E, et al. Anemia and ischemia: myocardial injury in patients with gastrointestinal bleeding. Am J Med. 2005; 118: 548–551. pmid:15866259
  9. 9. Bhatti N, Amoateng-Adjepongg Y, Qamar A, Manthous CA. Myocardial infarction in critically ill patients presenting with gastrointestinal hemorrhage: retrospective analysis of risks and outcomes. Chest. 1998; 114: 1137–1142. pmid:9792589
  10. 10. Emenike E, Srivastava S, Amoateng-Adjepongg Y, al-Kharrat T, Zarich S, Manthous CA. Myocardial infarction complicating gastrointestinal hemorrhage. Mayo Clin Proc. 1999; 74: 235–241. pmid:10089991
  11. 11. Cappell MS. A study of the syndrome of simultaneous acute upper gastrointestinal bleeding and myocardial infarction in 36 patients. Am J Gastroenterol. 1995; 90: 1444–1449. pmid:7661167
  12. 12. Cheng TM. Taiwan’s national health insurance system: high value for the dollar. In: Okma KG, Crivelli L. (eds). Six Countries, Six Reform Models—the Healthcare Reform Experience of Israel, the Netherlands, New Zealand, Singapore, Switzerland and Taiwan. Hackensack, NJ: World Scientific 171–204, 2009.
  13. 13. Gostout CJ, Wang KK, Ahlquist DA, Clain JE, Hughes RW, Larson MV, et al. Acute gastrointestinal bleeding: experience of a specialized management team. J Clin Gastroenterol. 1992; 14: 260–267. pmid:1564303
  14. 14. Zeidman A, Fradin Z, Blecher A, Oster HS, Avrahami Y, Mittelman M. Anemia as a risk factor for ischemic heart disease. Isr Med Assoc J. 2004; 6: 16–18. pmid:14740503
  15. 15. Cappell MS. Gastrointenstinal bleeding associated with myocardial infarction. Gastroenterol Clin North Am. 2000; 29: 423–444. pmid:10836188
  16. 16. Weil J, Colin-Jones D, Langman M, Lawson D, Logan R, Murphy M, et al. Prophylactic aspirin and risk of peptic ulcer bleeding. BMJ. 1995; 310:827–830. pmid:7711618
  17. 17. Peters RJ, Mehta SR, Fox KA, Zhao F, Lewis BS, Kopecky SL, et al. Effects of aspirin dose when used alone or in combination with clopidogrel in patients with acute coronary syndromes: observations from the Clopidogrel in Unstable angina to prevent Recurrent Events (CURE) study. Circulation. 2003; 108: 1682–1687. pmid:14504182
  18. 18. Lee CY, Huang CC, Shih HC, Huang KH. Factors influencing antihypertensive medication compliance in Taiwan: a nationwide population-based study. Eur J Prev Cardiol. 2013; 20: 930–937. pmid:22689418
  19. 19. Lin CC, Lai MS, Syu CY, Chang SC, Tseng FY. Accuracy of diabetes diagnosis in health insurance claims data in Taiwan. J Formos Med Assoc. 2005; 104: 157–163. pmid:15818428
  20. 20. Chou P. Validation of Comorbidity Derived from Health Insurance Data, Science and Technology Policy Research and Information Center, National Applied Research Laboratories Website. 2003. Available: http://grbsearch.stic.gov.tw/tiff/92/rrpg92070589.pdf.
  21. 21. Lai HT, Yaung CL, Fan BY. Study on the quality and its related factors of International Classification of Disease coding system in national health insurance. Chinese Journal of Public Health. 1998; 17: 337–347.