Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Predicting In-Hospital Maternal Mortality in Senegal and Mali

  • Cheikh Ndour,

    Affiliations Laboratoire d'Etudes et de Recherches en Statistiques et Développement, Université Gaston Berger, Saint-Louis, Sénégal, Laboratoire de Mathématiques et de leurs Applications – Pau, UMR CNRS 5142, Université de Pau et des Pays de l'Adour, Pau, France

  • Simplice Dossou Gbété,

    Affiliation Laboratoire de Mathématiques et de leurs Applications – Pau, UMR CNRS 5142, Université de Pau et des Pays de l'Adour, Pau, France

  • Noelle Bru,

    Affiliation Laboratoire de Mathématiques et de leurs Applications – Pau, UMR CNRS 5142, Université de Pau et des Pays de l'Adour, Pau, France

  • Michal Abrahamowicz,

    Affiliation Department of Epidemiology and Biostatistics, McGill University, Montreal, Canada

  • Arnaud Fauconnier,

    Affiliation EA 7285 “Risk and Safety in Clinical Medecine for Women and Perinatal Health”, University of Versailles St-Quentin (UVSQ), Versailles, France

  • Mamadou Traoré,

    Affiliation URFOSAME, Referral Health Center of Commune V, Bamako, Mali

  • Aliou Diop,

    Affiliation Laboratoire d'Etudes et de Recherches en Statistiques et Développement, Université Gaston Berger, Saint-Louis, Sénégal

  • Pierre Fournier,

    Affiliation International Health Unit, Centre de Recherche du Centre Hospitalier de l'Université de Montréal, Université de Montréal, Montréal, Canada

  • Alexandre Dumont

    alexandre.dumont@ird.fr

    Affiliation Institut de Recherche pour le Développement, UMR 216 Mère et enfant face aux infections tropicales, Paris, France

Abstract

Objective

We sought to identify predictors of in-hospital maternal mortality among women attending referral hospitals in Mali and Senegal.

Methods

We conducted a cross-sectional epidemiological survey using data from a cluster randomized controlled trial (QUARITE trial) in 46 referral hospitals in Mali and Senegal, during the pre-intervention period of the trial (from October 1st 2007 to October 1st 2008). We included 89,518 women who delivered in the 46 hospitals during this period. Data were collected on women's characteristics, obstetric complications, and vital status until the hospital discharge. We developed a tree-like classification rule (classification rule) to identify patient subgroups at high risk of maternal in-hospital mortality.

Results

Our analyses confirm that patients with uterine rupture, hemorrhage or prolonged/obstructed labor, and those who have an emergency ante-partum cesarean delivery have an increased risk of in-hospital mortality, especially if they are referred from another health facility. Twenty relevant patterns, based on fourteen predictors variables, are used to predict in-hospital maternal mortality with 81.41% sensitivity (95% CI = [77.12%–87.70%]) and 81.6% specificity (95% CI = [81.16%–82.02%]).

Conclusion

The proposed class association rule method will help health care professionals in referral hospitals in Mali and Senegal to identify mothers at high risk of in-hospital death, and can provide scientific evidence on which to base their decisions to manage patients delivering in their health facilities.

Introduction

In Sub-Saharan Africa (SSA), maternal mortality and morbidity are major problems for which progress has been inadequate [1]. The broad strategies that have made it possible to reduce maternal mortality are known: prenatal care, labor and delivery management by qualified birth attendant, and availability of emergency obstetric care (EmOC) [2]. However, their implementation is a major challenge in Sub-Saharan Africa, where health care systems are fragile and still being developed, so that service availability and quality of care in health facilities are very heterogeneous and most often inadequate [3]. The qualification of health personnel working in EmOC services is highly variable, yet it has a major impact on maternal and prenatal outcomes: more the staff is qualified, better is the survival of both the mothers and the newborns [4].

Hospital-based maternal mortality in SSA countries varies markedly between studies (0.1–5%) [5], [6], [7], [8], [9], [10], [11], depending upon the type of hospital (regional or district hospital), the setting (rural or urban), and the characteristics of the women (case mix). Hemorrhage, hypertensive disorders, protracted labor including uterine rupture, puerperal infection and abortion complications are the main cause of hospital-based maternal deaths. The majority of deaths occur in the first two days after the birth [12]. While there are numerous factors that contribute to maternal mortality, most of researchers have focused on those that affect the interval between the onset of obstetric complication and its outcome. These factors are grouped in three categories [13]: factors that affect (1) delay the decision to seek care; (2) delay arrival at a health facility; and (3) delay the provision of adequate care.

However, different studies from SSA countries identified many independent risk factors which differed substantially between authors, probably due to differences in patient populations, setting, variables collected and statistical methods. Thus, it remains difficult to provide health professionals from SSA countries with recommendations to identify clinical signs or symptoms which could help the staff to detect patients with high risk of in-hospital death. Yet, such criteria will help staff to decide whether a patient should be managed as a high priority case by qualified health professionals in comprehensive EmOC [2]. Although the criteria of severe obstetric complications are proposed by the World Health Organization (WHO) as appropriate predictors of maternal mortality [14], difficulties remain in their identification, and there is limited experience with the use of these criteria in low-income countries [15].

The QUARITE trial is an international multi-center cluster randomized trial designed to assess the efficacy of a quality care improvement program in Senegal and Mali, compared with a control ‘usual-care’ group without external intervention [16]. The primary endpoint of the trial is maternal in-hospital mortality. With about 80,000 births occurring annually in 46 referral hospitals, QUARITE is one of the largest cluster randomized trial in maternal and perinatal health ever to be undertaken in low-income countries. Thus, the trial provides an unique opportunity to evaluate in-hospital maternal mortality from a large number of centers, in a variety of contexts and taking into account different maternal and hospital characteristics. In this article, we aimed to measure maternal mortality in referral hospitals in Mali and Senegal before the implementation of the quality care improvement program and to assess predictors of in-hospital mortality in patients attending these health facilities.

Methods

Study design and population

We conducted a cross-sectional epidemiological survey using data collected during the pre-intervention phase of a cluster-randomized controlled trial (QUARITE trial) in 46 referral hospitals (22 in Mali and 24 in Senegal). The study setting and methods were published in detail at the trial's inception [16]. The trial aims to assess the effectiveness of the ALARM international program (AIP) – Which is a multifaceted intervention based on maternal death reviews – in reducing in-maternal mortality. All procedures were approved by the ethics committee of Sainte-Justine Hospital in Montreal, Canada and by the national ethics committees of Mali and Senegal. However data are not made yet available to the scientific community, because all the analyses of the QUARITE trial are not finished. First-level and second-level public referral hospitals with more than 800 deliveries per year that had a functional operating room were eligible to participate. Centers were included on the basis of formal, informed consent on the part of the hospital director and the person in charge of maternity services. All women who delivered in each of the participating facilities from October 1, 2007 to September 30, 2008 in Senegal and from November 1, 2007 to October 31, 2008 in Mali were included. Women who delivered at home or in another centre with postnatal transfer were excluded. Patients were followed up in the hospital until their discharge.

Since this study was carried out during the pre-intervention phase of the trial, there were no specific recommendations from the researchers to the health personnel. It was expected that labor management, diagnosis and treatment of complications were based on national or international standards. Women who died before labor were excluded from analyses because these women usually sought care only after developing severe complications at home. So, it was often too late to prevent death by the time these women were admitted into the referral hospital.

Data collection

Data was collected from medical records by trained midwives who were supervised by the national coordinators of the survey. In each country, data was collected on a daily basis on every woman who gave birth in every selected facility. The database for this study included information on maternal demographic characteristics, obstetric history (gravidity, parity and previous CS), prenatal care (number of antenatal care visits during the current pregnancy), management of labor and delivery, obstetric complications, and the vital status of both mother and child until hospital discharge (Table S1). To avoid under- reporting of hospital-based maternal mortality, a complementary procedure was carried out to identify the eligible maternal deaths among all the female deaths that occurred in the facility using the various registries available (admissions, hospitalizations, operating theatres and morgues).

For the variables related to the diagnosis of clinical signs or symptoms related to obstetric complications, only these which were collected during the first 24 hours after admission were taken into account for the analyses. This specific set of variables was chosen for clinical reasons and was supported by previous work in low-resources countries [17], [18], [19]. We assume that all these potential predictive clinical signs or symptoms should be easily measured by health care staff with various competences.

Quality control was performed on site by the study coordinator, who selected a random sample of 5% of all patient forms in each site, and compared the following data with information available in the clinical records: age, parity, diagnosed pathology or complication, mode of delivery and vital status of the mother at discharge. An agreement rate of 80% or higher between the two sources of information was considered acceptable. If the rate of agreement was between 50% and 80%, the coordinator repeated the procedure with another 10% random sample of forms. If the rate of agreement was less than 50%, he controlled all the forms in a given site. At the end of each trimester, the electronic record containing all relevant clinical data was transmitted to the trial's coordinating center at the University of Montreal for quality control (missing data and inconsistent/implausible values).

Statistical analysis

In-hospital maternal mortality was the outcome of interest. Accordingly, all deaths that occurred during the hospital stay (before hospital discharge) among women who had delivered in the selected centers during the study period were counted as the outcomes. In this study, because of the very low prevalence of the outcome (maternal in-hospital death) in the large data base of the study resulting in highly unbalanced distribution of the dependent variable, standard prediction methods based on logistic regression or classification trees are not appropriate [20], [21]. The method extracts specific multivariate ‘risk patterns’, which identify subgroups of patients for whom the prevalence of the outcome (here: risk of maternal death) is higher than in the entire study population. We describe the method elsewhere [22]. Briefly, the first step on the analysis is a training step which use the Apriori algorithm developed by Agrawal and Coll [23], one of the most widely used algorithms in the data mining literature, to discover frequent ‘risk patterns’. Since the Apriori algorithm results in a very large number of ‘risk patterns’, the second step is a pruning step that aims to produce a smaller set of non redundant ‘risk patterns’. In the third step, we validate and combine the ‘non redundant risk patterns’ in a classification rule. In the last step, we assess the performance of the classification rule by computing its sensibility and specificity (with 95% confidence interval). This process requires to split the database randomly into three subsets, each comprising 33% of all the patients. The first and second steps are run using the ‘training’ dataset. The first step results in 929 frequent rules and the second step results in 575 no redundant rules. The third step is run using the ‘validation’ dataset. After this validation step the number of remaining rules is 20. The fourth step is run using the ‘test’ dataset.

Descriptive analyses were carried out with Epi-Info software (version 3.5.3). All analyses related to the proposed classification method were performed using the packages “arules” in the version 2.15.1 (2012-06-22) of the programming environment R [24].

Results

Among the 89,847 enrolled patients, 329 were excluded (175 women who died before delivery and 154 women transferred to another health facility), leaving 89,518 women for the analyses, 29,840 for the ‘training’ dataset, 29,839 for the ‘validation’ data set and 29,839 for the ‘test’ dataset. Table 1 presents in-hospital maternal mortality rates, according to the type of institution and the country, and some indicators of the risk of the pregnant population served by each type of institution. The proportions of high risk women were higher in hospitals outside the capital that in hospitals located in Dakar or Bamako. In each category of health care facility, the mean length of hospital stay was higher for women with a cesarean section than for women who deliver by vaginal way. Hospital-based mortality rates in district hospitals, regional hospitals and in hospitals in the capitals (Dakar or Bamako) varied between centers, ranging from 0.14% to 3.66% (Median = 1.07%), 0.81% to 3.26% (Median = 1.60%), and 0.06% to 2.01% (Median = 0.26%), respectively. Hemorrhage, pre-eclampsia/eclampasia and indirect causes (anemia, malaria and chronic disease) were the major causes of maternal mortality.

thumbnail
Table 1. Number of patients, in-hospital maternal mortality rate, age, type of admission, complication and caesarean delivery rates and length of stay, by type of hospital and country.

https://doi.org/10.1371/journal.pone.0064157.t001

Since the class of interest has low frequency of occurrence, it is preferable to consider the local support instead of the support [25], [26], [27]. The support of a risk pattern is the probability that a patient belongs to that risk pattern and dies; the local support of a risk pattern is the probability that a patient dies given that the risk pattern holds. We can deduce the support of a rule from its local support. Thus, in our procedure of generation of all the candidate rules we set the training parameters as follows: minimum local support equal to: 9%, 10%, 15%; minimum confidence equal to: 2.1%, 2.8%, 3.5%; and maximum length equal to: 3, 4. Combining these different values of training parameters (local support, confidence, length) has as a result, eighteen (18) sets of representative rules of which each one give a classifier. These classifiers are used to build a ROC curve. This ROC curve is used to select the optimal classifier according to sensitivity and specificity and misclassification rate if necessary. Table 2 presents the selected classification rule build with twenty non redundant ‘risk patterns’. The twenty ‘risk patterns’ composing our optimal classifier, are defined by different combinations of the following fourteen variables: age, parity, previous cesarean section, five variables related to current pregnancy (prenatal care attendance, vaginal bleeding during pregnancy, Malaria, premature rupture of the membranes and multiple pregnancy), and six variables related to the labor or delivery (referral from another health facility, labor induction, mode of delivery (emergency ante-partum cesarean delivery and intra-partum cesarean delivery), hemorrhage, Prolonged/obstructed labor, and uterine rupture). Table 3 presents the operational definitions of these fourteen variables.

thumbnail
Table 2. Classification association rule predicting in-hospital maternal mortality* among patients delivering in 46 hospital in Senegal and Mali.

https://doi.org/10.1371/journal.pone.0064157.t002

thumbnail
Table 3. Definitions of the variables included in the association classification rules.

https://doi.org/10.1371/journal.pone.0064157.t003

The highest relative risks (RR≥28) are related to the following patterns: (i) “Patients with hemorrhage, no vaginal bleeding during pregnancy and referred from another health facility” and (ii) “Patients with hemorrhage, no vaginal bleeding during pregnancy and Parity equal to 5 and more ” (last column of Table 2). The highest ‘risk pattern’ prevalence among women who died before hospital discharge are related to the following ‘risk patterns’: (i) “Patient with hemorrhage, no vaginal bleeding during pregnancy and no malaria diagnosed”; and (ii) “Patient with hemorrhage, Referred from other health facility and No malaria diagnosed”. Hemorrhage and referral from another health facility are the conditions which are included in nineteen of the twenty ‘risk patters’ shown in Table 2. The resulting classification rule predicts in-hospital maternal mortality with 82.41% sensitivity (95% CI = [77.127%–87.70%]) and 81.6% specificity (95% CI = [81.16%–82.02%]) (see table 4).

thumbnail
Table 4. Sensibility and specificity (and 95% CI) associated with the classification association rule among the patients selected in the ‘test’ dataset (N = 29 838).

https://doi.org/10.1371/journal.pone.0064157.t004

For clinical use, the resulting tree structure, shown in Figure 1, can be used to visualize the rules mined. Each branch of the tree constitutes a risk pattern, which relative risk of in-hospital mortality is given at the terminal node of the branch. And for each node, a variable value pair is represented. Immediately below each branch, we show the next split of the sub-population classified to a given branch which is based on a set of new value pair. For example, according to Figure 1, “patients who have hemorrhage and no vaginal bleeding during pregnancy and are referred from another health facility” are 30.70 times more likely to die than the population average. For the patients who have “hemorrhage, no vaginal bleeding during pregnancy and parity equal to 5 and more ”, the relative risk (RR) of in-hospital-death rises to 28.20 and for the patients who are referred from another health facility and have an uterine rupture and a prolonged/obstructed labor, the RR rises to 27.11. Similar interpretation of the tree structure can be made for each main node of the tree that identify, respectively, patients with no antenatal care attendance, patients with emergency ante-partum cesarean delivery or referred from other health facilities.

Discussion

The rules identified by our association rule method provide useful information to health care professionals, and can serve as clinical algorithms for the triage of high-risk patients who are admitted in referral hospitals in Mali and Senegal.

Hospital-based maternal mortality rates varied considerably between centers, ranging from 0.03% to 3.66% of all deliveries. As reported elsewhere in SSA countries, hemorrhages including uterine rupture and hypertensive complications are the major causes of maternal mortality [4], [5], [6], [7], [8], [9], [10], [11]. As expected, the clinical signs or symptoms related to these complications were associated with hospital-based maternal mortality: [3], [4], [5], [6], [7], [8], [9], [10], [11]. Furthermore, the classification approach developed in this study shows that patients who were referred from other health care facilities or had emergency ante-partum cesarean delivery (ante- and intra-partum) also have an increased risk of hospital-based mortality. These results are in accordance with other studies in Latin America, Asia and Africa [7], [8], [9], [10], [17], [18], [19].

This study is one of the largest one on hospital-based maternal mortality in Sub-Saharan Africa. The participant hospitals were representative of the existing health system in both countries, taking into account the full variety of contexts and levels of care. The large database and the system of data control we implemented in all participating hospitals allowed us to obtain reliable information on maternal outcomes [16]. Our findings may be generalized to other countries with similar health care systems and other referral hospitals with similar population.

Potential limitations of this study should be taken into account in interpreting our results. First, data are restricted to in-hospital critical events; therefore maternal mortality and late complications as puerperal infection that occurred after hospital discharge may be underestimated. Second, diagnoses during current pregnancy (e.g., pre-eclampsia) may have been reported differently among the participating hospitals. These potential misclassifications lead to categorizing some ‘exposed’ women (e.g. those with pre-eclampsia) as ‘no exposed’ and might have modified the interactions between the variables. Third, our survey includes only hospitals that have a functional operating room offering comprehensive emergency obstetric care. The results, therefore, cannot be generalized to primary health care facilities or community health centers that offer basic emergency obstetric care. For the same reasons, maternal mortality in the population or in community centers cannot be inferred.

The classification rule established in this study confirms that patients with uterine rupture, hemorrhage, prolonged/obstructed labor or parity equal to 5 and more, should be managed with high priority by qualified health professionals in comprehensive EmOC services [2], especially if the patient is referred from another health facility. Given the shortage of qualified health care professionals (midwives and doctors) in Mali and Senegal, many tasks are shared with less qualified health personnel (students, matrons, nurse-assistants). This personnel may play a crucial role in improving maternal outcomes in referral hospitals if they are involved in the triage of high risk patients. Specifically, our results indicate that they should be trained to detect uterine rupture and hemorrhage. The required tasks and actions are quite specific and simple: ask about pain and contractions, as well as vaginal bleeding during pregnancy, measure blood pressure, protein dipstick, detect excessive blood loss and seizures. Even non-qualified health personnel could detect, at admission or during labor/delivery, the following alarm signs: acute pain and loss of contractions, blood pressure >140/90 mmHg, proteinuria>1+, hemorrhage; and they should then immediately alert qualified professionals if any of these signs are detected.

The early detection of these signs of complication, and immediate management by midwives or doctors would improve maternal outcomes [2], [4], [9]. Moreover, ensuring a prompt access to the emergency obstetric care for women with complications requires that health centers are equipped to deal with the emergencies they are facing, and that timely care in referral hospitals, if needed, is not hindered by delays in transportation. A maternity referral system in Mali, that attempts to remove geographic and financial barriers, that ensured basic and comprehensive emergency obstetric care, transportation to obstetric health services and community cost-sharing schemes, has produced a substantial reduction in maternal mortality rates [10]. Other mechanisms to improve referral and transportation of mothers with complications have also to be explored in low-resources settings in order to improve maternal and prenatal outcomes.

Conclusion

An important advantage of the association rules established in this study might be a timely identification by qualified or non-qualified health professionals of mothers at highest risk of in-hospital mortality, who can be then offered high priority emergency obstetric care. Such strategy should target all pregnant women attending referral hospitals in Senegal and Mali and aim to detect and manage life-threatening complications via evidence-based interventions, with intensive monitoring of the women who have emergency ante-partum cesarean delivery. Additional studies, in other settings, are necessary to assess the impact of this strategy on the reduction of the time-to-care, case-fatality rates and overall in-hospital maternal mortality. This strategy will offer even more benefits if combined with interventions improving maternal referral system.

Supporting Information

Table S1.

List of variables used for predicting in-hospital maternal mortality (Doc).

https://doi.org/10.1371/journal.pone.0064157.s001

(DOCX)

Author Contributions

Conceived and designed the experiments: AD MT. Performed the experiments: AD MT. Analyzed the data: CN SDG NB. Contributed reagents/materials/analysis tools: CN SDG NB. Wrote the paper: CN SDG NB AD. Contribute to improve the article by pointing out several weaknesses of the initial version of the article and by suggesting the introduction of discussion points before the final approval of the version submitted for publication: MA AF AD PF.

References

  1. 1. Salama P, Lawn J, Bryce J, Bustreo F, Fauveau V, et al. (2008) Making the countdown count. Lancet 371(9620): 1219–2.
  2. 2. Campbell OM, Graham WJ (2006) Strategies for reducing maternal mortality: getting on with what works. Lancet 368(9543): 1284–99.
  3. 3. Fauveau V (2007) Program Note Using UN process indicators to assess needs in emergency obstetric services: Gabon, Guinea-Bissau, and the Gambia. Int J Gynaecol Obstet 96(3): 233–40.
  4. 4. Dogba M, Fournier P, Dumont A, Zunzunegui MV, Tourigny C, et al. (2011) Mother and newborn survival according to point of entry and type of human resources in a maternal referral system in Kayes (Mali). Reprod Health 8(1): 13.
  5. 5. Kampikaho A, Irwig LM (1990) Risk factors for maternal mortality in five Kampala hospitals, 1980–1986. Int J Epidemiol 19(4): 1116–8.
  6. 6. Thonneau PF, Matsudai T, Alihonou E, De Souza J, Faye O, et al. (2004) Distribution of causes of maternal mortality during delivery and post-partum: results of an African multicentre hospital-based study. Eur J Obstet Gynecol Reprod Biol 114(2): 150–4.
  7. 7. Dumont A, Gaye A, de Bernis L, Chaillet N, Landry A, et al. (2006) Facility-based maternal death reviews: effects on maternal mortality in a district hospital in Senegal. Bull World Health Organ 84(3): 218–24.
  8. 8. Igberase GO, Ebeigbe PN (2007) Maternal mortality in a rural referral hospital in the Niger Delta, Nigeria. J Obstet Gynaecol 27(3): 275–8.
  9. 9. Mbola Mbassi S, Mbu R, Bouvier-Colle MH (2009) Delay in the management of obstetric complications: Study in 7 maternity units in Cameroon. Med Trop 69(5): 480–4.
  10. 10. Fournier P, Dumont A, Tourigny C, Dunkley G, Drame S (2009) Improved access to comprehensive emergency obstetric care and its effect on institutional maternal mortality in rural Mali. Bull World Health Organ 87: 30–38.
  11. 11. Teguete I, Traore Y, Dennis N, Mounkoro N, Traore M, et al. (2010) A 19-year retrospective investigation of maternal mortality at point g national hospital, bamako, mali. Int J Gynaecol Obstet 108(3): 194–8.
  12. 12. Ronsmans C, Graham WJ (2006) Maternal Survival Series steering group. Maternal mortality: who, when, where, and why. Lancet 368: 1189–200.
  13. 13. Thaddeus S, Maine D (1994) Too far to walk: maternal mortality in context. Soc Sci Med 38(8): 1091–110.
  14. 14. Say L, Souza JP, Pattinson RC (2009) WHO working group on Maternal Mortality and Morbidity classifications (2009) Maternal near miss-towards a standard tool for monitoring quality of maternal health care. Best Pract Res Clin Obstet Gynaecol 23(3): 287–96.
  15. 15. Ronsmans C (2009) Severe acute maternal morbidity in low-income countries. Best Pract Res Clin Obstet Gynaecol 23(3): 305–16.
  16. 16. Dumont A, Fournier P, Fraser W, Haddad S, Traore M, et al. (2009) QUARITE (quality of care, risk management and technology in obstetrics): a cluster-randomized trial of a multifaceted intervention to improve emergency obstetric care in Senegal and Mali. Trials 10: 85.
  17. 17. Villar J, Valladares E, Wojdyla D, Zavaleta N, Carroli G, et al. (2006) Caesarean delivery rates and pregnancy outcomes: the 2005 who global survey on maternal and perinatal health in Latin America. Lancet 367: 1819–29.
  18. 18. Lumbiganon P, Laopaiboon M, Gulmezoglu AM, Souza JP, Taneepanichskul S, et al. (2010) Method of delivery and pregnancy outcomes in Asia: the WHO global survey on maternal and perinatal health 2007–08. Lancet 375: 490–9.
  19. 19. Shah A, Fawole B, M'Imunya JM, Amokrane F, Nafiou I, et al. (2009) Cesarean delivery outcomes from the WHO global survey on maternal and perinatal health in Africa. Int J Gynaecol Obstet 107: 191–7.
  20. 20. Scarpa B, Nicola Torelli N (2005) New developments in classification and data analysis: Selection of the training set in classification problem with rare event. Part 1, 39–46. Available http://link.springer.com/chapter/10.1007%2F3-540-27373-5_5. Accessed 27 Mars 2013.
  21. 21. Menardi G, Torelli N (2012) Training and assessing classification rules with unbalanced data. Data Min Knowl Disc DOI 10.1007s1061801202955/s10618-012-0295-5.
  22. 22. Ndour C, Dossou Gbete S (2012) Classification approach based on association rules mining for unbalanced data. ArXiv: 1202.5514[stat.ML] (February 2012), 14.
  23. 23. Agrawal R, Srikant R (1993) Fast algorithms for mining association rules, IBM Research Report RJ9839, IBM Almaden Research Center, San Jose, CA.
  24. 24. R Development Core Team (2011) R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria, http://www.r-project.org/ edition, 2010. ISBN 3-900051-07-0.
  25. 25. Li J, Ada WF, He H, Chen J, Jin H, et al.. (2005) Mining risk in medical data. KDD 05, Illinois, USA, August 21–24.
  26. 26. Li J, Ada WF, Fahey P (2009) Efficient discovery of risk patterns in medical data. Artificial Intelligence in Medecine 45: 77–89.
  27. 27. Li J, Shen H, Topor R (2002) Mining the optimal class association rule set. Knowledge-Based System 15(7): 399–405.