Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

The Clinical Performance of an Office-Based Risk Scoring System for Fatal Cardiovascular Diseases in North-East of Iran

  • Sadaf G. Sepanlou,

    Affiliation Digestive Disease Research Institute, Shariati Hospital, Tehran University of Medical Sciences, Tehran, Iran

  • Reza Malekzadeh ,

    malek@ams.ac.ir

    Affiliation Digestive Disease Research Institute, Shariati Hospital, Tehran University of Medical Sciences, Tehran, Iran

  • Hossein Poustchi,

    Affiliation Digestive Disease Research Institute, Shariati Hospital, Tehran University of Medical Sciences, Tehran, Iran

  • Maryam Sharafkhah,

    Affiliation Digestive Disease Research Institute, Shariati Hospital, Tehran University of Medical Sciences, Tehran, Iran

  • Saeed Ghodsi,

    Affiliation Digestive Disease Research Institute, Shariati Hospital, Tehran University of Medical Sciences, Tehran, Iran

  • Fatemeh Malekzadeh,

    Affiliation Digestive Disease Research Institute, Shariati Hospital, Tehran University of Medical Sciences, Tehran, Iran

  • Arash Etemadi,

    Affiliations Digestive Disease Research Institute, Shariati Hospital, Tehran University of Medical Sciences, Tehran, Iran, Division of Cancer Epidemiology and Genetics, National Cancer Institute, Bethesda, Maryland, United States of America

  • Akram Pourshams,

    Affiliation Digestive Disease Research Institute, Shariati Hospital, Tehran University of Medical Sciences, Tehran, Iran

  • Paul D. Pharoah,

    Affiliation Department of Public Health and Primary Care, University of Cambridge, Cambridge, United Kingdom

  • Christian C. Abnet,

    Affiliation Division of Cancer Epidemiology and Genetics, National Cancer Institute, Bethesda, Maryland, United States of America

  • Paul Brennan,

    Affiliation International Agency for Research on Cancer, Lyon, France

  • Paolo Boffetta,

    Affiliation The Tisch Cancer Institute, and Institute for Translational Epidemiology, Icahn School of Medicine at Mount Sinai, New York, New York, United States of America

  • Sanford M. Dawsey,

    Affiliation Division of Cancer Epidemiology and Genetics, National Cancer Institute, Bethesda, Maryland, United States of America

  • Farin Kamangar

    Affiliations Digestive Disease Research Institute, Shariati Hospital, Tehran University of Medical Sciences, Tehran, Iran, Department of Public Health Analysis, School of Community Health and Policy, Morgan State University, Baltimore, Maryland, United States of America

Abstract

Background

Cardiovascular diseases (CVD) are becoming major causes of death in developing countries. Risk scoring systems for CVD are needed to prioritize allocation of limited resources. Most of these risk score algorithms have been based on a long array of risk factors including blood markers of lipids. However, risk scoring systems that solely use office-based data, not including laboratory markers, may be advantageous. In the current analysis, we validated the office-based Framingham risk scoring system in Iran.

Methods

The study used data from the Golestan Cohort in North-East of Iran. The following risk factors were used in the development of the risk scoring method: sex, age, body mass index, systolic blood pressure, hypertension treatment, current smoking, and diabetes. Cardiovascular risk functions for prediction of 10-year risk of fatal CVDs were developed.

Results

A total of 46,674 participants free of CVD at baseline were included. Predictive value of estimated risks was examined. The resulting Area Under the ROC Curve (AUC) was 0.774 (95% CI: 0.762-0.787) in all participants, 0.772 (95% CI: 0.753-0.791) in women, and 0.763 (95% CI: 0.747-0.779) in men. AUC was higher in urban areas (0.790, 95% CI: 0.766-0.815). The predicted and observed risks of fatal CVD were similar in women. However, in men, predicted probabilities were higher than observed.

Conclusion

The AUC in the current study is comparable to results of previous studies while lipid profile was replaced by body mass index to develop an office-based scoring system. This scoring algorithm is capable of discriminating individuals at high risk versus low risk of fatal CVD.

Introduction

The incidence and overall burden of non-communicable diseases is increasing across the globe [1], and more so in developing countries. In Iran, for example, the share of non-communicable diseases in all-cause mortality increased from 57% in 1990 to 76% in 2010 [2,3]. The major part of this burden is due to ischemic heart disease, stroke, and other vascular diseases, collectively considered as cardiovascular diseases (CVD) [4].

Prevention of CVD is an important step in reducing the burden of these diseases. However, in developing countries, where there are limited resources, prioritizing the allocation of resources based on risk of disease is indeed important. Such risk stratification is possible using a combination of well-established risk factors, such as age, sex, high blood pressure, smoking, dyslipidemia, and diabetes. To provide the best estimate of risk, it is important to use a combination of these risk factors in a model, to avoid over-treatment or under-treatment [5]. Any such model should be clinically useful, methodologically robust, easy to use, clinically addressing relevant risk factors, and resulting in a measurable health gain.

Such risk prediction models have been developed in the past few decades for all CVD combined or their components such as coronary heart disease, stroke, peripheral vascular diseases, and heart failure. These models estimate absolute risk within a certain period of time. The Framingham algorithm has been among the first of this kind developed and re-calibrated [69]. A number of other algorithms have been developed and evaluated in different populations [1022]. The American College of Cardiology / American Heart Association has recently developed sex-specific Pooled Cohort Equations that can be used for non-Hispanic whites and non-Hispanic African Americans, 40–79 years of age [23]. In Iran, two studies have been performed on recalibrating Framingham score, one for estimating 5-year risk of incident CVD and the second on 10-year risk in Tehran. The results have demonstrated that the algorithm is effective in ranking the individuals and quantifying the risk of incident CVD [24,25].

The original and the updated format of Framingham risk scoring and other algorithms adapted from it are based on demographic and life style characteristics as well as laboratory markers of high-density lipoproteins, and either total cholesterol or low density lipoproteins. However, in the setting of primary health care in developing countries, laboratory markers may not always be available. Therefore, algorithms that are based solely on office-based data are preferable. The Framingham algorithm includes an office-based version that is based on age and sex, body mass index (BMI), systolic blood pressure (SBP) stratified by hypertension treatment, current smoking, and diabetes [8]. In the current study, we recalibrated the office-based Framingham algorithm for predicting CVD mortality in the setting of Golestan Cohort in North-East of Iran. If such algorithm is useful and valid, it can be used in the setting of health houses that cover the rural populations with little access to laboratory tests.

Materials and Methods

Golestan Cohort Study Design

The details of Golestan Cohort Study have been described elsewhere [2628]. In brief 50,045 participants aged 40 to 75 years were recruited from January 2004 to June 2008, from those living in Gonbad city and 326 villages in Golestan province, northeast of Iran. Trained interviewers collected data on demographic and life style characteristics, past history, family history, and medication history, using structured questionnaires. Height, weight, and blood pressure were measured.

Nearly all study participants were followed by annual telephone calls. If after seven attempts during a two week period, a participant was not accessible through telephone calls, researchers contacted friends or local health workers. If a death was reported by telephone calls or local health workers or the death registry, a verbal autopsy was completed by a physician and at the same time, all available medical documents were collected within the entire province or the neighboring provinces.

In 35% of cases, the cause of death was determined using verbal autopsy only [27], and for the rest, extensive medical documents were examined in addition to verbal autopsy. Previous studies demonstrated that verbal autopsy was accurate in determining the causes of death, especially for major causes [27]. Using the collected documents, two independent internists determined the cause of death based on ICD-10 codes. If the two were concordant, a diagnosis was made. Otherwise, the final diagnosis was made by a third more senior internist [27].

Exposures and Outcomes of Interest for the Current Analysis

The exposures of interest in the current analysis included age, sex, body mass index, systolic blood pressure, treatment of hypertension, current smoking, and diabetes. Data on these exposures were collected at cohort study baseline. Blood pressure, height and weight were measured in the health center. Blood pressure was recorded after 5 minutes of rest and in sitting position, twice from each arm with 10-minute intervals, using Richter auscultatory sphygmomanometers. Smoking and receiving anti-hypertensive treatment were documented using self-report. Diabetes was recorded if the study participant reported to be a diabetic, or medical documents or medication history showed he/she was being treated for diabetes.

The outcomes of interest were deaths caused due to CVD, which included ischemic heart disease, cerebrovascular diseases, and all other vascular diseases. Using ICD-10, the following three categories constituted the outcomes of interest:

  1. Ischemic Heart Diseases (I20-I25)
  2. Cerebrovascular Diseases (I60-I69)
  3. Other vascular diseases including:
    • Hypertensive Heart Diseases (I10-I15)
    • Pulmonary Heart Diseases (I26-I28)
    • Other forms of Heart Diseases (I30-I52) including a) cardiac arrest b) heart failure
    • Peripheral Vascular Diseases (I70-I89)

Statistical Analysis

The purpose of this analysis was to recalibrate the Framingham office-based risk scoring tool for estimating the absolute 10-year risk of CVD deaths and for differentiating the high risk from low risk individuals at clinic or office.

After confirming the assumption of proportionality of hazards, we fitted overall and sex-specific Cox proportional hazards models to correlate the exposures of interest, described above, to CVD mortality during a maximum follow-up of 10 years. The resulting CVD risk functions were used to estimate the sex-specific 10-year absolute risk of CVD mortality for each individual using the formula: ; where S0(t) is baseline survival at follow-up time t, βi is estimated regression coefficient, Xi is naturally log transformed value of the ith risk factor if continuous, is the corresponding mean, and p is the number of risk factors. We estimated the 10-year baseline survival using a Kaplan-Meier estimate. The statistical methods were adopted from D’Agostino et al [8].

The covariates used in these models were age, sex, body mass index, systolic blood pressure (SBP), blood pressure treatment, current smoking, and diabetes (self-report or history of medication). The continuous variables were naturally logarithmically transformed to improve calibration and minimize the effect of outliers. Beta coefficients and Hazard Ratios (HRs) were estimated for each one unit increase in naturally logarithmic transformed value of BMI and SBP and for each 0.1 unit increase in naturally logarithmic transformed value of age.

Area under the receiver-operating-characteristics (ROC) curve was used to evaluate the ability of the model to discriminate high-risk from low-risk individuals for being prone to CVD death. The observed versus predicted probabilities in deciles of predicted probability were used to determine the calibration in more detail. Kaplan-Meier estimator was used to obtain observed probabilities. To evaluate the clinical usefulness of the model, we used an array of thresholds for predicted probabilities to estimate the sensitivity and specificity of the model. Thresholds between 2% to 5%, with 0.5% intervals were examined to categorize the predicted risk of CVD death.

All statistical analyses were done using Stata statistical software version 11 (StataCorp, College Station, TX).

Ethical Considerations

The Golestan Cohort Study was approved by the Institutional Review Boards of the Digestive Disease Research Institute of Tehran University of Medical Sciences in Iran, the US National Cancer Institute, and the World Health Organization International Agency for Research on Cancer. All study participants signed informed consents. The records and identification of participants were anonymized and de-identified prior to statistical analysis.

Results

Of the 50,045 participants in Golestan cohort, 3,371 participants were excluded due to a history of heart disease or stroke at baseline. The remaining 46,674 participants were followed for a median of 7.1 years (a total of 328,475 person-years of follow-up) and were included in the analyses.

The mean age (SD) of participants at the beginning of the study was 51.6 (8.8) years. A large proportion of the participants were women (57.5%), of Turkmen ethnicity (76.0%), rural dweller (80.8%), married (88.2%), illiterate (69.8%), and currently non-smoker (89.0%). The mean body mass index (SD) was 26.6 (5.4) Kg/m2. The mean systolic blood pressure (SD) was 127.0 (23.9) mmHg. A total of 6,802 participants (14.6%) were receiving anti-hypertensive treatment and a total of 2,920 participants (6.3%) suffered from diabetes. The detailed characteristics by sex are presented in Table 1.

thumbnail
Table 1. Summary statistics of CVD risk factors in the Golestan Cohort.

https://doi.org/10.1371/journal.pone.0126779.t001

A total of 1,438 deaths occurred due to CVD (crude rate = 438/100,000 person years), 653 in women (342/100,000) and 785 in men (570/100,000). The subcategories of causes of death included ischemic heart disease (n = 829), cerebrovascular diseases (n = 483), and other vascular diseases (n = 126).

The adjusted regression coefficients and hazard ratios for determinants of CVD mortality are presented in Table 2. Beta coefficients were positive for all determinants except for natural logarithm of BMI, the coefficient of which was negative in both women and men. However, the negative coefficient was significant only in women and thus, was included in the model. This finding has been reported in previous publications of Golestan Cohort Study as well. We repeated the analyses after excluding the underweight group, and the results did not change.

thumbnail
Table 2. Regression coefficients and hazard ratios for CVD mortality.

https://doi.org/10.1371/journal.pone.0126779.t002

The overall and sex-specific CVD death risk functions were estimated. The area under ROC Curve was 0.774 (95% CI: 0.762–0.787) in all participants, 0.772 (95% CI: 0.753–0.791) in women, and 0.763 (95% CI: 0.747–0.779) in men (Fig 1). The areas under the curve were close for urban areas with AUC of 0.790 (95% CI: 0.766–0.815), and rural areas with AUC (95% CI) of 0.770 (95% CI: 0.756–0.783).

thumbnail
Fig 1. ROC curves of observed 10-year risk versus predicted risk of fatal CVD.

https://doi.org/10.1371/journal.pone.0126779.g001

Fig 2 demonstrates the observed probability of CVD deaths versus the predicted probabilities separately in women and men. The observed and predicted probabilities were similar for women. However, for men, the predicted probabilities were modestly higher than the observed ones, particularly in the categories that had a predicted high risk.

thumbnail
Fig 2. Ten-year predicted versus observed risk of CVD deaths in the Golestan Cohort Study participants.

The X axis shows the deciles of predicted risks. The Y axis shows the mean risk.

https://doi.org/10.1371/journal.pone.0126779.g002

Table 3 demonstrates the clinical performance of the model using 7 thresholds for predicted 10-year risk of fatal CVD: 2%, 2.5%, 3%, 3.5%, 4%, 4.5%, and 5%. In women, the threshold of 3% performs best, while in men the best threshold is 4.5%

thumbnail
Table 3. The sensitivity and specificity of the model in predicting 10-year risk of CVD deaths in the Golestan Cohort Study participants according to different levels of predicted 10-year risk chose as threshold between low risk and high risk individuals.

https://doi.org/10.1371/journal.pone.0126779.t003

Discussion

The aim of the present study was to calibrate an office-based risk scoring system for prediction of 10-year risk of fatal CVD in Iran. The performance of the office-based model is comparable to previously studied lab-based models, with an AUC equal to 0.774 (95% CI: 0.762–0.787) in all participants, 0.772 (95% CI: 0.753–0.791) in women, and 0.763 (95% CI: 0.747–0.779) in men. The predicted and observed 10-year risks of fatal CVD were equivalent in women. However, in men, predicted probabilities were higher than observed.

Whereas previous studies have presented risk scores for CVD, our study is the first large cohort study in the Middle-East with over 50,000 individuals that calibrated the risk scoring system. Furthermore, our study had three distinct characteristics: 1) CVDs were the outcome of interest; 2) mortality was the failure event; and 3) scoring was done using office-based CVD risk factors.

Previous original studies have been mostly done on coronary heart disease as the failure event [7,9,10,13,17], but recent models are based on risk of all CVD combined [8,14,15,19,20,23,25]. This strategy is a reasonable one, as the three main components of CVD (coronary heart diseases, cerebrovascular diseases, and other vascular diseases) are all important causes of burden and share the same set of risk factors. Calculating total CVD risk is also preferred for treatment decisions.

In the current study, mortality has been chosen as the failure event. While both non-fatal and fatal CVD impose substantial medical and economic burden, we used only fatal outcomes. This was in part because, in Golestan Cohort Study, CVD outcomes were recorded much more precisely than non-fatal outcomes. Moreover, mortality results from this cohort can be more easily used and generalized to the country, as mortality by cause is more rigorously reported by the national death registry in Iran. The prominent example of another study that used fatal CVD outcomes, with similar justifications as presented above, is the SCORE project, which was conducted across Europe [11].

The third and the most important characteristic of the present model is the usage of office-based risk factors. In the setting of primary or even secondary care in developing countries, the lab markers of lipids may not be available. Despite excluding serum lipid results from the predictors, our model performed nearly as well as those in other studies that used lipids [11]. The AUC of 0.774 in our study is comparable to the results of SCORE project, in which the reported AUC ranged from 0.67 to 0.82 in different countries in Europe with various levels of CVD risk [11].

In our study, except for BMI, all conventional CVD risk factors were associated with an increased risk of CVD. We strongly believe our findings regarding BMI are correct. Both height and weight were accurately measured at study baseline. The association has been shown in previous studies in Golestan too [29]. Some other cohorts in Asia have also shown relatively weak associations with higher BMI. For example, a large cohort study in China showed a weak association between BMI mortality [30]. This may indicate that the association of BMI with all-cause and CVD mortality may depend on more distal causal factors, i.e., those that lead to higher BMI.

It is not possible to choose a single ideal threshold for 10 year risk of fatal CVD to discriminate high risk from low risk individuals, and optimal thresholds are different by sex and age [31]. In Framingham study, where CVD incidence was the main outcome, thresholds of 10% and 20% were used to discriminate individuals at high risk of incident coronary heart disease from low risk peers, and other studies have followed the rule [8]. In the SCORE project, where CVD death was the main outcome of interest, thresholds of 2% and 5% were chosen to discriminate low- and high-risk individuals. In the current study, a threshold of 3% for women and 4.5% for men performed best. This is consistent with the results of SCORE project, in which the main outcome was similar to ours. However, the thresholds used here, were mostly based on sensitivity and specificity of the model. Decisions on optimal thresholds for action need to consider local economic factors and availability of resources, which is beyond the scope of this paper.

Our study has several points of strength. Data came from a large prospective study with over 99% successful follow-up rate and precise recording of cause-specific deaths using a robustly designed verbal autopsy and detailed collection of existing medical records. Office-based risk factors were measured according to standard methods with intensive training of the staff. Also, the setting of the study is a representative sample consisting of both urban and rural areas.

Our study is prone to a number of limitations. Our estimated risk functions were based on single measurements rather than ‘usual’ levels, which may result in regression dilution bias of our results. There may not be exact concordance between reported use of anti-hypertensive treatments and actual use of these drugs, particularly in rural areas, which may again lead to dilution of the results. Despite these limitations, the risk factors were highly predictive of CVD mortality in this cohort. Furthermore, these results reflected the clinical settings more realistically, where patients may have similar reporting problems.

Our study has several implications for primary and secondary health care in Iran. The rural population of Iran is extensively covered by a primary healthcare system, which is staffed by local health workers called the Behvarz. With the sharp increase in chronic diseases, the functions of this system need to shift toward prevention of chronic diseases, and in particular CVD. Using the risk scoring algorithms makes screening and follow-up of high risk individuals more cost-effective, as differentiating high risk from low risk individuals makes it possible for health care providers to decide on intensity of lifestyle interventions and pharmacologic treatment and intervals of follow-up. The actual function of the scoring algorithm can be evaluated through trials. In fact, clinical trials of Polypills are ongoing in Iran [3234]. If these trials show success in the use of Polypills, risk scoring systems can prioritize their use in individuals with highest risk. Predictions based on this risk scoring system can help maximize the cost-effectiveness of treatment plans by preventing over- or under-treatment. There remain trials at national scale to further optimize the performance of risk scoring algorithms.

Conclusions

We were able to validate a risk scoring system for CVD using data from the largest cohort study in the Middle East. Results could be used for prioritizing prevention efforts in the Iranian health system and other developing countries. These findings should guide the identification of individuals at higher risk of developing cardiovascular diseases, who should be the focus of proven non-drug and drug interventions to prevent cardiovascular diseases.

Supporting Information

S1 Dataset. The underlying data of the present study.

The excel sheet contains: age, sex, hypertension treatment, current smoking, residence, systolic blood pressure, body mass index, diabetes, cardiovascular death, and follow-up time.

https://doi.org/10.1371/journal.pone.0126779.s001

(XLSX)

Acknowledgments

We sincerely thank the Golestan Cohort study staff for their valuable helps. We also thank the study participants for their cooperation and health workers (Behvarz) in the study area for their help.

Author Contributions

Conceived and designed the experiments: SGS RM FK HP AE AP FM PDP CCA P. Brennan P. Boffetta SMD. Performed the experiments: RM HP AE AP FK FM PDP CCA P. Brennan SMD SGS. Analyzed the data: SGS FK MS SMD SG. Contributed reagents/materials/analysis tools: SGS RM FK HP AE AP FM PDP CCA P. Boffetta SMD. Wrote the paper: SGS FK P. Boffetta SMD MS SG RM MS. Managed the entire process of the Golestan Cohort Study: AP HP RM.

References

  1. 1. Murray CJ, Lopez AD. Measuring the global burden of disease. N Engl J Med. 2013; 369: 448–457. pmid:23902484
  2. 2. Naghavi M, Shahraz S, Sepanlou SG, Dicker D, Naghavi P, Pourmalek F, et al. Health transition in Iran toward chronic diseases based on results of Global Burden of Disease 2010. Arch Iran Med. 2014; 17: 321–335. pmid:24784861
  3. 3. Shahraz S, Forouzanfar MH, Sepanlou SG, Dicker D, Naghavi P, Pourmalek F, et al. Population health and burden of disease profile of Iran among 20 countries in the region: from Afghanistan to Qatar and Lebanon. Arch Iran Med. 2014; 17: 336–342. pmid:24784862
  4. 4. Forouzanfar MH, Sepanlou SG, Shahraz S, Dicker D, Naghavi P, Pourmalek F, et al. Evaluating causes of death and morbidity in Iran, global burden of diseases, injuries, and risk factors study 2010. Arch Iran Med. 2014; 17: 304–320. pmid:24784860
  5. 5. Jackson R, Lawes CM, Bennett DA, Milne RJ, Rodgers A. Treatment with drugs to lower blood pressure and blood cholesterol based on an individual's absolute cardiovascular risk. Lancet. 2005; 365: 434–441. pmid:15680460
  6. 6. Anderson KM, Wilson PW, Odell PM, Kannel WB. An updated coronary risk profile. A statement for health professionals. Circulation. 1991; 83: 356–362. pmid:1984895
  7. 7. D'Agostino RB Sr., Grundy S, Sullivan LM, Wilson P. Validation of the Framingham coronary heart disease prediction scores: results of a multiple ethnic groups investigation. JAMA. 2001; 286: 180–187. pmid:11448281
  8. 8. D'Agostino RB Sr., Vasan RS, Pencina MJ, Wolf PA, Cobain M, Massaro JM, et al. General cardiovascular risk profile for use in primary care: the Framingham Heart Study. Circulation. 2008; 117: 743–753. pmid:18212285
  9. 9. Wilson PW, D'Agostino RB, Levy D, Belanger AM, Silbershatz H, Kannel WB. Prediction of coronary heart disease using risk factor categories. Circulation. 1998; 97: 1837–1847. pmid:9603539
  10. 10. Assmann G, Cullen P, Schulte H. Simple scoring scheme for calculating the risk of acute coronary events based on the 10-year follow-up of the prospective cardiovascular Munster (PROCAM) study. Circulation. 2002; 105: 310–315. pmid:11804985
  11. 11. Conroy RM, Pyorala K, Fitzgerald AP, Sans S, Menotti A, De Backer G, et al. Estimation of ten-year risk of fatal cardiovascular disease in Europe: the SCORE project. Eur Heart J. 2003; 24: 987–1003. pmid:12788299
  12. 12. De Backer G, Ambrosioni E, Borch-Johnsen K, Brotons C, Cifkova R, Dallongeville J, et al. European guidelines on cardiovascular disease prevention in clinical practice. Third Joint Task Force of European and Other Societies on Cardiovascular Disease Prevention in Clinical Practice. Eur Heart J. 2003; 24: 1601–1610. pmid:12964575
  13. 13. Ferrario M, Chiodini P, Chambless LE, Cesana G, Vanuzzo D, Panico S, et al. Prediction of coronary events in a low incidence population. Assessing accuracy of the CUORE Cohort Study prediction equation. Int J Epidemiol. 2005; 34: 413–421. pmid:15659467
  14. 14. Hippisley-Cox J, Coupland C, Vinogradova Y, Robson J, Brindle P. Performance of the QRISK cardiovascular risk prediction algorithm in an independent UK sample of patients from general practice: a validation study. Heart. 2008; 94: 34–39. pmid:17916661
  15. 15. Hippisley-Cox J, Coupland C, Vinogradova Y, Robson J, May M, Brindle P. Derivation and validation of QRISK, a new cardiovascular disease risk score for the United Kingdom: prospective open cohort study. BMJ. 2007; 335: 136. pmid:17615182
  16. 16. Jackson R. Updated New Zealand cardiovascular disease risk-benefit prediction guide. BMJ. 2000; 320: 709–710. pmid:10710588
  17. 17. Liu J, Hong Y, D'Agostino RB Sr., Wu Z, Wang W, Sun J, et al. Predictive value for the Chinese population of the Framingham CHD risk assessment tool compared with the Chinese Multi-Provincial Cohort Study. JAMA. 2004; 291: 2591–2599. pmid:15173150
  18. 18. Marrugat J, D'Agostino RB Sr., Sullivan L, Elosua R, Wilson P, Ordovas J, et al. An adaptation of the Framingham coronary heart disease risk function to European Mediterranean areas. J Epidemiol Community Health. 2003; 57: 634–638. pmid:12883073
  19. 19. Menotti A, Lanti M, Agabiti-Rosei E, Carratelli L, Cavera G, Dormi A, et al. Riskard 2005. New tools for prediction of cardiovascular disease risk derived from Italian population studies. Nutr Metab Cardiovasc Dis. 2005; 15: 426–440. pmid:16314229
  20. 20. Ridker PM, Buring JE, Rifai N, Cook NR. Development and validation of improved algorithms for the assessment of global cardiovascular risk in women: the Reynolds Risk Score. JAMA. 2007; 297: 611–619. pmid:17299196
  21. 21. Woodward M, Brindle P, Tunstall-Pedoe H. Adding social deprivation and family history to cardiovascular risk assessment: the ASSIGN score from the Scottish Heart Health Extended Cohort (SHHEC). Heart 2007; 93: 172–176. pmid:17090561
  22. 22. Zhang XF, Attia J, D'Este C, Yu XH, Wu XG. A risk score predicted coronary heart disease and stroke in a Chinese cohort. J Clin Epidemiol. 2005; 58: 951–958. pmid:16085199
  23. 23. Goff DC Jr, Lloyd-Jones DM, Bennett G, Coady S, D'Agostino RB Sr.,Gibbons R, et al. 2013 ACC/AHA guideline on the assessment of cardiovascular risk: a report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines. J Am Coll Cardiol. 2014; 63: 2935–59. pmid:24239921
  24. 24. Bozorgmanesh M, Hadaegh F, Azizi F. Predictive accuracy of the 'Framingham's general CVD algorithm' in a Middle Eastern population: Tehran Lipid and Glucose Study. Int J Clin Pract. 2011; 65: 264–273. pmid:21314863
  25. 25. Khalili D, Hadaegh F, Soori H, Steyerberg EW, Bozorgmanesh M, Azizi F. Clinical usefulness of the Framingham cardiovascular risk profile beyond its statistical performance: the Tehran Lipid and Glucose Study. Am J Epidemiol. 2012; 176: 177–186. pmid:22814370
  26. 26. Islami F, Pourshams A, Vedanthan R, Poustchi H, Kamangar F, Golozar A, et al. Smoking water-pipe, chewing nass and prevalence of heart disease: a cross-sectional analysis of baseline data from the Golestan Cohort Study, Iran. Heart. 2013; 99: 272–278. pmid:23257174
  27. 27. Khademi H, Etemadi A, Kamangar F, Nouraie M, Shakeri R, Abaie B, et al. Verbal autopsy: reliability and validity estimates for causes of death in the Golestan Cohort Study in Iran. PLoS One. 2010 Jun 17; 5(6):e11183. pmid:20567597
  28. 28. Pourshams A, Khademi H, Malekshah AF, Islami F, Nouraei M, Sadjadi AR, et al. Cohort Profile: The Golestan Cohort Study—a prospective study of oesophageal cancer in northern Iran. Int J Epidemiol. 2010; 39: 52–59. pmid:19332502
  29. 29. Etemadi A, Abnet CC, Kamangar F, Islami F, Khademi H, Pourshams A, et al. Impact of body size and physical activity during adolescence and adult life on overall and cause-specific mortality in a large cohort study from Iran. Eur J Epidemiol. 2014; 29: 95–109. pmid:24557643
  30. 30. Gu D, He J, Duan X, Reynolds K, Wu X, Chen J, et al. Body weight and mortality among men and women in China. JAMA. 2006; 295: 776–83. pmid:16478900
  31. 31. Johannesson M. At what coronary risk level is it cost-effective to initiate cholesterol lowering drug treatment in primary prevention? Eur Heart J. 2001; 22: 919–925. pmid:11428815
  32. 32. Malekzadeh F, Marshall T, Pourshams A, Gharravi M, Aslani A, Nateghi A, et al. A pilot double-blind randomised placebo-controlled trial of the effects of fixed-dose combination therapy ('polypill') on cardiovascular risk factors. Int J Clin Pract. 2010; 64: 1220–1227. pmid:20653798
  33. 33. Rastegarpanah M, Malekzadeh F, Thomas GN, Mohagheghi A, Cheng KK, Marshall T. A new horizon in primary prevention of cardiovascular disease, can we prevent heart attack by "heart polypill"? Arch Iran Med. 2008; 11: 306–313. pmid:18426322
  34. 34. Sepanlou SG, Farzadfar F, Jafari E, Danaei G. Cardiovascular disease prevention using fixed dose pharmacotherapy in Iran: updated meta-analyses and mortality estimation. Arch Iran Med. 2012; 15: 531–537. pmid:22924369