Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Performance of Health Workers in the Management of Seriously Sick Children at a Kenyan Tertiary Hospital: Before and after a Training Intervention

  • Grace W. Irimu ,

    girimu@nairobi.kemri-wellcome.org

    Affiliations Department of Paediatrics and Child Health, College of Health Sciences, University of Nairobi, Nairobi, Kenya, Centre for Geographic Medicine Research – Coast, KEMRI/Wellcome Trust Research Programme, Kilifi, Kenya

  • David Gathara,

    Affiliation Centre for Geographic Medicine Research – Coast, KEMRI/Wellcome Trust Research Programme, Kilifi, Kenya

  • Dejan Zurovac,

    Affiliations Centre for Geographic Medicine Research – Coast, KEMRI/Wellcome Trust Research Programme, Kilifi, Kenya, Centre for Tropical Medicine, Nuffield Department of Clinical Medicine, University of Oxford, Oxford, United Kingdom, Center for Global Health and Development, Boston University, Boston, Massachusetts, United States of America

  • Harrison Kihara,

    Affiliation Kenyatta National Hospital, Nairobi, Kenya

  • Christopher Maina,

    Affiliation Kenyatta National Hospital, Nairobi, Kenya

  • Julius Mwangi,

    Affiliation Kenyatta National Hospital, Nairobi, Kenya

  • Dorothy Mbori-Ngacha,

    Affiliation Department of Paediatrics and Child Health, College of Health Sciences, University of Nairobi, Nairobi, Kenya

  • Jim Todd,

    Affiliation London School of Hygiene and Tropical Medicine, London, United Kingdom

  • Alexandra Greene,

    Affiliation Child Health, University of Dundee, Dundee, United Kingdom

  • Mike English

    Affiliations Department of Paediatrics and Child Health, College of Health Sciences, University of Nairobi, Nairobi, Kenya, Centre for Geographic Medicine Research – Coast, KEMRI/Wellcome Trust Research Programme, Kilifi, Kenya, Department of Paediatrics, University of Oxford, Oxford, United Kingdom

Abstract

Background

Implementation of WHO case management guidelines for serious common childhood illnesses remains a challenge in hospitals in low-income countries. The impact of locally adapted clinical practice guidelines (CPGs) on the quality-of-care of patients in tertiary hospitals has rarely been evaluated.

Methods and Findings

We conducted, in Kenyatta National Hospital, an uncontrolled before and after study with an attempt to explore intervention dose-effect relationships, as CPGs were disseminated and training was progressively implemented. The emergency triage, assessment and treatment plus admission care (ETAT+) training and locally adapted CPGs targeted common, serious childhood illnesses. We compared performance in the pre-intervention (2005) and post-intervention periods (2009) using quality indicators for three diseases: pneumonia, dehydration and severe malnutrition. The indicators spanned four domains in the continuum of care namely assessment, classification, treatment, and follow-up care in the initial 48 hours of admission. In the pre-intervention period patients' care was largely inconsistent with the guidelines, with nine of the 15 key indicators having performance of below 10%. The intervention produced a marked improvement in guideline adherence with an absolute effect size of over 20% observed in seven of the 15 key indicators; three of which had an effect size of over 50%. However, for all the five indicators that required sustained team effort performance continued to be poor, at less than 10%, in the post-intervention period. Data from the five-year period (2005–09) suggest some dose dependency though the adoption rate of the best-practices varied across diseases and over time.

Conclusion

Active dissemination of locally adapted clinical guidelines for common serious childhood illnesses can achieve a significant impact on documented clinical practices, particularly for tasks that rely on competence of individual clinicians. However, more attention must be given to broader implementation strategies that also target institutional and organisational aspects of service delivery to further enhance quality-of-care.

Introduction

Despite availability of World Health Organization (WHO) case management guidelines, studies in low-income settings continue to identify poor health workers' compliance with evidence-based standards and poor follow-up care as some of the problems facing paediatric service delivery [1], [2]. Perhaps linked to this, mortality rates in some of the hospitals are as high as 15% [2], [3], [4], [5]. Many of these deaths could be averted by giving timely, appropriate and safe hospital care to the seriously sick child [2], [6], [7].

In an effort to reduce childhood mortality in hospitals in Kenya, the Ministry of Health in collaboration with stakeholders developed ‘Basic Paediatric Protocols’ consisting of clinical practice guidelines (CPGs). The guidelines aim to improve paediatric emergency and admission care in the initial 48 hours of hospitalisation [8], [9]. The CPGs were derived and adapted from international and local disease specific guidelines [10], [11]. Subsequently an in-service training programme called “Emergency Triage Assessment and Treatment Plus admission care” (ETAT+), was developed to facilitate implementation of the CPGs. A detailed description of ETAT+ is provided elsewhere [8], [9].

Though the CPGs and ETAT+ were initially intended for district hospitals, they were in demand also at higher level hospitals [12]. Introduction of CPGs and ETAT+ training to KNH initially occurred in response to demand. This was followed by a more deliberate approach to disseminate the CPGs and provide ETAT+ training in partnership with Kenyatta National Hospital (KNH) and University of Nairobi (UoN), but with limited resources. In this study we evaluated effects of their introduction on clinical practices in a university teaching hospital. We address this question by quantitative examination of health workers' clinical performance in accordance with indicators agreed upon by the hospital staff as important markers of correct care.

Methods

Study design

This was an uncontrolled before and after design that included an attempt to explore any intervention dose-effect relationship. We applied this design because of the absence of comparable tertiary hospitals in Kenya.

Study site

The study was conducted in KNH, a tertiary level hospital and a teaching hospital for the University of Nairobi (UoN) Medical School and other healthcare training institutions. KNH is the second largest hospital in Africa with a bed capacity of 1,800. The general paediatric wards have total capacity of 240 beds although the bed occupancy is often over 100%. There are 14,000 paediatric admissions annually. Sixty to seventy five trainee paediatricians who are enrolled in a three year postgraduate paediatric training programme in the UoN, provide most clinical in-patient care. They are normally supervised by 25 paediatricians. There are 126 qualified nurses who provide care on the four general paediatric wards – twelve to twenty nurses per shift. After initial emergency clerkship and initiation of life-saving treatments at the Paediatric Emergency Unit, all seriously sick patients are admitted to the wards and reviewed by a trainee paediatrician who provides the initial management plan.

Selection of the target diseases and study intervention

We focussed on medical records of patients with any of the three discharge diagnoses: pneumonia, dehydration (due to diarrhoea) and severe malnutrition. These three diseases have a high disease burden, high case fatality and explicit WHO/Kenyan guidelines for their case management that have largely remained unchanged since 2000. The primary intervention consisted of provision and wide dissemination of CPG booklets linked to a 5 day ETAT+ training targeting clinical and nursing care providers. CPG booklets and training were provided at no charge to KNH. ETAT+ training was escalated in response to demand rather than as part of an overarching strategy. In this before and after intervention study, we define a pre-intervention period as from January to December 2005 – before any introduction of CPGs or ETAT+ training; and a post-intervention period as from January to December 2009 when all junior clinicians, 70% of consultants, and 60% of nurses were already trained in ETAT+ (Figure 1). To explore the pattern of change, we divided the entire study duration (2005–09) into four interrelated periods defined by the intensity of intervention. Period 0 (2005) is the pre-intervention period and period 1 (2006) is piloting of the intervention. Period 2 (Jan 2007 to June 2008) is scaling up dissemination of the CPGs/training without active promotion of uptake of the best-practice recommendations. Period 3 (July 2008 –Dec 2009) comprised continued scaling up of dissemination of CPGs/training combined with efforts to reinforce adherence to best-practice recommendations. These activities included audit and feedback (17 sessions) and educational sessions (37 sessions) over the 18 months comprising period 3. These were part of additional participatory action research that will be reported in detail elsewhere. In brief, the educational sessions focussed on problems identified in the audit. Audit meetings were not necessarily focused on or tailored to the 15 key indicators reported here but were part of efforts to improve care for acute admissions. The sessions were cadre specific and targeted professionals such as nurses, nutritionists and trainee paediatricians who participated in the care of the seriously ill child.

thumbnail
Figure 1. Coverage of 5 day ETAT+ training among the front-line service providers in the paediatrics wards and Paediatric Emergency Unit (PEU).

https://doi.org/10.1371/journal.pone.0039964.g001

Sample size and sampling

We aimed to study 280 randomly selected medical records per year per disease (70 records per disease per quarter). This would detect an increase in correct practice for each disease from 50% in the pre-intervention period to 65% in the post-intervention period, significant at the 5% level with 90% power (with no adjustment for multiple comparisons). We used a modified multistage random sampling of eligible medical records to select episodes of illness treatment for the three target diseases. It is possible that a re-admitted child or one diagnosed with both pneumonia and dehydration was randomly included in more than one diagnostic group but only one diagnostic episode was assessed per admission. Patients with co-morbidity or complications that rendered treatment in accordance with CPGs inappropriate were excluded. Details of the process of selection of the study population including a full description of the inclusion and exclusion criteria are provided elsewhere (http://idoc-africa.org/documents/download/id/209).

Data collection

Data were collected from free text medical records for the period January 2005– December 2009 using a direct electronic data entry tool and detailed standard operating procedures. Data entry used a web scripting language (Hypertext Pre-processor, PHP) with a Structured Query Language database (MySQL) backend (http://idoc-africa.org/documents/download/id/209). All the data collectors had healthcare backgrounds and undertook one-week training on the use of the study tools until they demonstrated competency in completeness and accuracy of test data entered. A 5% random selection of the case records was independently re-evaluated and cross-checked for accuracy and uniformity weekly during data collection. Agreement rates for data that were independently abstracted were consistently greater than 95%.

Performance indicators

The primary effectiveness measures were 15 disease-specific process of care indicators. Performance indicators for this study were derived from the CPGs and ETAT+ programme after adaptation by the hospital staff in a consensus conference held in July 2008 using the modified nominal group technique [11]. The indicators spanned four domains in the continuum of care namely assessment, classification, treatment, and follow-up care for the initial 48 hours of admission. Composite indicators were developed to assess whether all individual tasks within the domain were performed (Table 1). The desired performance by the hospital staff for each of the individual indicators was set at 100% except for monitoring of intravenous fluid administration whose target was 50% in recognition of existing nurses' shortage.

thumbnail
Table 1. Definition of the composite indicators of processes of care for each diseases.

https://doi.org/10.1371/journal.pone.0039964.t001

Definitions

The definitions of the performance measures were based on KNH's adaptation of WHO/Kenya case management guidelines [9], [10], [13]. An indicator was considered achieved or correct if the care was consistent with CPGs, ETAT+ recommendations or staff consensus (Table 1). To define a population of critically sick children in the study we identified those who died within 5 days of admission. Critically sick patients were considered regularly reviewed by the clinicians if there was evidence from the medical notes that they were reviewed twice a day in the first 48 hours of admission. Likewise, they were regularly reviewed by the nurses if the temperature, respiratory rate and pulse rate were recorded every 6 hours for the first 48 hours of admission.

Statistical analysis

All statistical analyses were carried out in STATA Version 11 (StataCorp, College Station, Texas). We present the results for each domain of care for each disease separately. However, as there were fewer critically sick patients, data for all diseases are combined for these analyses. Written consent was not obtained from the patients for their information to be stored in the hospital database and used for research as no such policy exists in the hospital. The data were thus analyzed anonymously.

Descriptive analysis.

Patient characteristics are summarized as percentages with 95% confidence intervals (95% CI) or medians with inter-quartile range, as appropriate. Chi-square tests were used to compare categorical variables, and parametric (ANOVA) or nonparametric (Kruskal Wallis) tests were used to compare continuous variables with a normal or skewed distribution respectively.

Comparison of pre-intervention and post-intervention periods.

We report performance of the composite indicators, dichotomised as achieved or not achieved, in pre-intervention (2005) and post-intervention (2009) periods with the primary effect being the absolute percentage change. We refer to an effect size of 50% or greater as very large, 20% to 49% as large, 10 to 19% as moderate, and below 10% as small based on previously used classifications [14], [15]. We did not make formal adjustment for multiple hypothesis testing. We therefore suggest interpretation of results from this study should consider the magnitude of the change and its temporal association with intervention rather than just the P-value.

Trend of change.

We used chi-squared tests for trend to explore performance of the disease specific composite indicators across the four study periods. We excluded indicators for follow-up care of the critically sick children in this analysis because of small sample size.

Ethics statement

Ethical approval was provided by the Kenyatta National Hospital/University of Nairobi Ethics and Research Committee (reference number KNH-ERC/01/480). Although case records from which data were abstracted had names, data collected were de-identified and unique study patient identifiers created. Further, this study was classified as audit and therefore informed consent from the participants was not found necessary by the institutional ethics reviews committee.

Results

Sample description

Case records.

The retrieval rate of the sampled medical records was over 80% and there was no major variation across the study quarters for the three target diseases (data not shown). Of the medical records retrieved, 31% (1429/4577) of those with a discharge diagnosis of pneumonia, 51% (1536/3012) with dehydration, and 58% (1119/1922) with severe malnutrition were eligible for the inclusion. Common reasons for exclusion were presence of a co-morbidity that prompted treatment not consistent with the CPGs: i) For pneumonia cases: co-morbidities such as wheezy conditions, possible meningitis and severe malnutrition; ii) For dehydration cases: persistent diarrhoea or severe malnutrition and, iii) For severe malnutrition cases: known HIV infection or possible meningitis.

Severity of illness on admission.

There was a substantial improvement in the use of CPG (and WHO) suggested syndromic classification of illnesses and in the documentation of key clinical signs during the study period (Table 2). This gives a misleading impression that there was an increase in serious forms of pneumonia and dehydration over the study period. This differential documentation of the severity of the target illnesses and key clinical signs over the study period compromises our ability to use documented severity of illness and to describe case-mix in exploratory analyses.

thumbnail
Table 2. Use of terms for severity of illness of the patients consistent with CPG/ETAT+ terms as recorded by clinicians on admission.

https://doi.org/10.1371/journal.pone.0039964.t002

Patients' characteristics.

There were more males than females with pneumonia in the pre-intervention period (59.6%) than in the post-intervention period (46.1%, p = 0.001). This pattern was consistent with that of the hospital data base of all pneumonia patients admitted in the corresponding periods. For dehydration, patients in the pre-intervention period were marginally younger (Kruskal-Wallis test, p = 0.003), of lower weight (Kruskal-Wallis test, p = 0.004) and had a longer duration of diarrhoea (Kruskal-Wallis test, p = 0.016) before seeking care in KNH than those in the post-intervention period. Patients with severe malnutrition in the pre-intervention period were older (p = 0.015) and marginally heavier (Kruskal-Wallis test, p = 0.056) than those in the post-intervention period (Table 3). This variation over time in patients' age and sex observed in our data (and wider hospital data) remains difficult to explain, especially as high quality health service data from other hospitals are not available for comparison.

thumbnail
Table 3. Patients' characteristics (2005–2009) and comparison of characteristics between the pre-intervention (2005) and post-intervention periods (2009).

https://doi.org/10.1371/journal.pone.0039964.t003

Effects of the intervention

Performance of assessment and classification indicators.

The intervention produced large improvement of the composite indicators for assessment of pneumonia (+27.1%, 95% CI: +21.7 to +32.6%) and dehydration (+23.5%, 95% CI: +18.6 to +28.3%). There was also a large improvement in classification of severity of pneumonia syndromes (+58.5%, 95% CI: +51.9 to +65.2) and a modest improvement for dehydration (+15.7%, 95% CI: +9.8 to +21.7). Nevertheless, the signs used in classification were not always consistent with CPGs recommendation. For example, 18/40 (45.0%) and 35/166 (21.1%) of patients classified as severe pneumonia in pre-intervention period and post-intervention periods respectively had one or more features of very severe pneumonia (altered consciousness, inability to drink or cyanosis). The intervention did not result in significant changes in the assessment or classification of patients with severe malnutrition (Table 4).

thumbnail
Table 4. Effects of the intervention on adequacy of assessment and illness classification.

https://doi.org/10.1371/journal.pone.0039964.t004

Performance of treatment indicators.

Among children with pneumonia, prescription of correct dosages of crystalline penicillin improved from 51.7% in 2005 to 90% in 2009 (Table 5). This large increase of +38.2% (95% CI: +31.2 to +45.2) was mainly attributed to reduced under-dosing from 39.2% (95% CI: 33.3–45.4) to 2.1% (95% CI: 0.7–4.4). The correct prescription of gentamicin for pneumonia was observed in 19.9% (95% CI: 14.5–26.3) of children in 2005, and 88% in 2009, showing an absolute improvement of +68.0% (95% CI: +60.1 to +75.8).

thumbnail
Table 5. Effects of intervention on selected treatment practicesa.

https://doi.org/10.1371/journal.pone.0039964.t005

Correct intravenous fluid therapy for dehydrated patients was prescribed for 37.7% of children in 2005 and 61.8% of children in 2009 giving an effect size of +24.2% (95% CI: +16.0 to 32.3). Majority of patients (>85%) with severe malnutrition had feeds prescribed on admission in both the pre-intervention and post-intervention periods. However, the intervention resulted in a very large improvement (+59.5%, 95% CI: +52.1 to +66.7) in the correctness of these prescriptions (Table 5).

Despite improvement in prescription practices, documentation that prescribed treatment was administered in the first 48 hours of admission remained poor in both pre-intervention and post intervention periods (Table 6).

thumbnail
Table 6. Effect of intervention on the administration of the prescribed treatment in the first 48 hours of admission.

https://doi.org/10.1371/journal.pone.0039964.t006

Review of critically sick patients.

Eleven per cent (93/836) of all study patients in the pre-intervention period and 6% (45/784) of patients in the post-intervention period were critically sick. Documented review of the patients by both nurses and clinicians in the first 48hrs of admission was very poor in both pre-intervention and post-intervention periods (Table 7).

thumbnail
Table 7. Effect of intervention on review of patients who died in the first 48 hours of admission.

https://doi.org/10.1371/journal.pone.0039964.t007

Case fatality rates.

Though this study was not designed to evaluate change in mortality rate, the mortality rate for children admitted with pneumonia dropped from 15.1% (40/265) in the pre-intervention period to 6.5% (19/293) in the post-intervention period. Mortality for children admitted with dehydration dropped from 17.9% (53/297) to 8.8% (26/294). Mortality rate for severe malnutrition dropped from 29.9% (82/284) to 22.3% (44/197). However, as explained above, inadequate case data precluded attempts to explore whether changing case-severity contributed to these reductions. Overall, deaths amongst children admitted with the target diseases that occurred in the first 48 hours of admission accounted for 45.1% (79/175) 49.4% (44/89) deaths in the pre-intervention and post-intervention periods respectively.

Trend of change.

There was consistent improvement of performance for 10/13 of the composite indicators assessed over the four sequential periods (Table 8). Results suggest initial improvement in prescription of gentamicin, crystalline penicillin and feeds for malnourished patients during piloting of the CPGs and ETAT+ training (period 1). For seven of the 13 indicators, improvement began in the period of initial scaling up of CPGs and training (period 2) and for five indicators, there was some suggestion of further improvement during the period of reinforcement (period 3). Three indicators (administration of penicillin, and assessment and classification of severe malnutrition) did not show significant variation during any of the four study periods (Table 8).

thumbnail
Table 8. Test for trend of performance of the composite indicators for each target disease across the periods.

https://doi.org/10.1371/journal.pone.0039964.t008

Discussion

Before CPGs/ETAT+ training, care for common serious childhood illnesses in KNH, a university teaching hospital, was largely inconsistent with best-practice recommendations as defined by WHO and endorsed within Kenya. Only 2/15 indicators had baseline performance of over 70%, while 8/15 indicators had performance below 10%, suggesting little impact of any previous efforts to disseminate WHO and local guidelines. This poor uptake of international recommendations for care is consistent with findings in district hospitals in this country [3], [16], [17], earlier studies in KNH [18] and other studies in low-income countries [1], [5]. Our data however indicate that 5/15 indicators achieved performance of over 70% in the post-intervention period which we consider acceptable performance of the composite indicators in this study. We observed an absolute increase in performance of over 20% for 7/15 key indicators, with three improving by over 50% (pneumonia classification, gentamicin dosage and prescription of feeds for the malnourished). All quality-of-care indicators for pneumonia and diarrhoea patients that relied on individual clinicians' adherence showed significant improvement. Yet all the indicators whose achievement was based on more sustained team efforts (evidence of administration of prescribed treatment and regular review of the critically sick patients over 24 to 48 hours) showed no significant improvement. These findings suggest that improvements in areas that require teamwork are less easy to achieve with primarily educational interventions targeting individuals. This is perhaps not surprising as teamwork is socially constructed and shaped by organizational and professional norms and context [2], [19]. In other settings, poor teamwork has resulted from a fragmented division of labour linked to power struggles associated with professional boundaries and hierarchies [19].

Examination of the individual tasks aggregated into composite indicators (data not shown) allowed us to identify suboptimal health workers' practices and gave us insight into specific clinical decision-making processes. There was generally marked improvement in patient assessment. However, for assessment of pneumonia and diarrhoea, the sign ‘ability to drink’ achieved the lowest performance. This sign has not been emphasised in mainstream academic paediatric teaching, despite it being a predictor of death in seriously ill children [20]. We speculate that trainee paediatricians consider it a sign for less well trained health-workers. There were also suggestions from the data that improved use of recommended terms for severity classification was not necessarily associated with better documentation and use of the key physical signs on which severity classification is based. This suggests that clinicians may be assigning classifications intuitively instead of carefully using recommended algorithms.

There was some evidence of improvements in recommended processes of care increasing with intensity (dose) of the interventions. However, the adoption rate of the best practices was variable across diseases and the study periods. Improvement in prescription practices began during piloting of the intervention. This was perhaps related to the attendance at a guidelines development workshop by some paediatric trainees where drug dose guidelines were discussed and endorsed followed by rapid informal dissemination of knowledge and CPGs amongst this clinical group [8]. In addition, staff were perhaps familiar with drug dosage guidelines as KNH had produced these for many years. Changes of prescription behaviour might therefore represent less of a change and be more likely to be consistent with norms promoting correct prescribing. However, changes in prescription of rehydration therapy, perhaps more complex than the other treatments, were observed only after formal dissemination of the guidelines.

Contrary to our expectation, the composite indicator for severe malnutrition assessment, comprising only two individual tasks which we considered to be simple was not adopted and had poorer performance than those for assessment of diarrhoea and pneumonia which spanned five tasks each. This appears to defy the simple premise that the more steps in a pathway, the less likely there is to be success [21]. There were also areas in which the intervention had no significant effect despite there being very poor performance at baseline, though studies elsewhere suggest that educational interventions are more effective in the context of low baseline adherence to guidelines [22]. Taken together our results confirm that even within a single setting the adoption rate of best-practices is unpredictable [23], [24]. These results are consistent with debates drawing on complexity and system theories [25], [26] and underline the value of concurrent qualitative enquiry to understand such variation.

It is hard to interpret the apparently large falls in case fatality rates especially as these cannot be appropriately adjusted for disease severity and there are no comparable control site data. Further, while we demonstrated improvements in domains of care studied independently the effect on patients' outcomes will likely reflect the way multiple domains of care are improved within one patient journey, something our data do not necessarily capture. Despite this our observations do raise the possibility that adherence to simple and low-cost recommendations, as stipulated in WHO case management guidelines, combined with perhaps other improvements in service provision, may reduce case fatality of common serious illnesses in tertiary care facilities, a finding consistent with other studies [27]. Formal investigation of possible effects on mortality may therefore be warranted although this would require appropriately designed, comparative studies that would be challenging to undertake.

Despite some improvements observed in this study, the overall frequency of errors in the management of common serious illnesses at a university teaching hospital expected to train manpower that is responsive to societal needs remains of concern. In particular, it should challenge academic staff and national professional bodies concerned with establishing and maintaining standards of expertise [28] to continue efforts to improve further quality of care.

Poor documentation of the care provided by the health professionals may explain, in part, the observed errors in the management. Simple approaches to improve documentation of illness that might support introduction and use of guidelines could include use of critical care pathways or standardised record forms that have proven valuable in other settings [4], [16]. However, health systems are complex and adoption of best-practices may be determined by multiple causes that may interact in a non-additive fashion. There is clearly a need to understand what constrains better practice and uptake of guidelines. In work to be reported elsewhere, we will attempt to explain the observations reported here in considerably greater detail. Preliminary observations however suggest that there are major challenges in providing an integrated and coordinated approach to leadership and management in what is a complex environment with multiple professions responsible for care. Further challenges include inadequate attention paid to supervision and erosion of professional values linked, perhaps, to poor staff morale.

Limitations.

The study had a number of limitations. First, we acknowledge that a before and after design without control data makes it difficult to infer causal relationships between the intervention and the outcomes [29]. Exploration of dose-effect relationships as we report does, however, provide some ability to strengthen any inferences. Deeper understanding of how and why effects emerged can also be provided by detailed qualitative work, contributing insights that are not gained from an epidemiological design [30], [31], [32], [33], [34]. We will report separately on data collected during the 18 months of reinforcement of CPG uptake to further explain the results we have reported here.

Secondly, when basing work on review of records we assume implicitly that the written records reflect actual practice, a potential limitation. This analysis, however, is based on indicators of practices that hospital staff felt should be documented to avoid compromising the ability of the clinical team to provide effective treatment and follow-up for patients. Further, several indicators were based on treatment prescriptions that were routinely well documented throughout the entire study period. Such prescriptions arguably provide the most robust link between a clinician's intentions and the treatment actually received.

Finally, the intervention used assumed the knowledge embodied in the CPGs is uncontested and that rationally, increased adherence to the guidelines merely requires an increase in dissemination. This model ignores the hidden or poorly illuminated values or needs that influence practitioner and organizational behaviour.

Conclusions.

There are very few published studies evaluating the impact of dissemination of guidelines for multiple serious childhood illnesses in a large teaching hospital in a LIC. Our data complement that at outpatient level [35] and from district hospitals, [1], [3], [4], [5], [16], [17] tending to show a consistent pattern of relatively poor quality care for common, serious diseases in the absence of active efforts to implement recommended practices [4], [16], [17]. Our results demonstrate that active dissemination of a combination of CPGs and ETAT+ training, can result in considerable improvements in adherence to national and international recommendations, impacting on the quality of in-patient care, particularly for tasks that rely on competence of individual clinicians. These findings are consistent with those of a recent cluster randomised trial in Kenya [16]. However, our experience in this study, and published reports [36] suggest that considerably more attention must be given to broader implementation strategies that target institutional and organisational aspects of service delivery to improve team-based quality of care.

Acknowledgments

The authors are grateful to the management and staff of Kenyatta National Hospitals, colleagues from the Department of Paediatrics (University Of Nairobi) and the KEMRI/Wellcome Trust Programme for their assistance in the conduct of this study. This work is published with the permission of the Director of KEMRI.

Author Contributions

Conceived and designed the experiments: GI ME. Performed the experiments: GI ME. Analyzed the data: GI ME JT DZ. Wrote the paper: GI ME DZ JT DG AG HK DM CM JM.

References

  1. 1. Reyburn H, Mwakasungula E, Chonya S, Mtei F, Bygbjerg I, et al. (2008) Clinical assessment and treatment in paediatric wards in the north-east of the United Republic of Tanzania. Bulletin of World Health Organization 86: 132–139.
  2. 2. Puoane T, Cuming K, Sanders D, Ashworth A (2008) Why do some hospitals achieve better care of severely malnourished children than others? Five-year follow-up of rural hospitals in Eastern Cape, South Africa. Health Policy and Planning 23: 428–437.
  3. 3. English M, Esamai F, Wassuna A, Were F, Ogutu B, et al. (2004) Assessment of inpatient paediatric care in the first referral level hospitals in 13 districts in Kenya. The Lancet 363: 1948–1953.
  4. 4. Mwakyusa S, Wamae A, Wassuna A, Were F, Esamai F, et al. (2006) Implementation of a structured paediatric admission record form for district hospitals in Kenya – results of a pilot study BMC International Health and Human Rights. 6: 9.
  5. 5. Nolan T, Angos P, Cunha AJ, Muhe L, Qazi S, et al. (2001) Quality of hospital care for seriously ill children in less-developed countries. The Lancet 357: 106–110.
  6. 6. Ashworth A, Chopra M, McCoy D, Sanders D, Jackson D, et al. (2004) WHO guidelines for management of severe malnutrition in rural South African hospitals: effect on case fatality and the influence of operational factors. The Lancet 363: 1110–1115.
  7. 7. Schofield C, Ashworth A (1996) Why have mortality rates for severe malnutrition remained so high? Bulletin World Health Organization 74: 223–229.
  8. 8. Irimu G, Wamae A, Wasunna A, Were F, Ntoburi S, et al. (2008) Developing and introducing evidence based clinical practice guidelines for serious illness in Kenya. Archives of Disease in Childhood 93: 799–804.
  9. 9. Idoc-africa website: Available ≤http://www.idoc-africa.org≥; Accessed 2012 May 5.
  10. 10. WHO editor (2005) Hospital Care for Children: Guidelines for the management of common illnessses with limited resources. Geneva.
  11. 11. Ministry of Health, Kenya (2004) Guidelines for HIV Testing in Clinical Settings.
  12. 12. English M, Wamae A, Nyamai R, Bevins B, Irimu G (2011) Implementing locally appropriate guidelines and training to improve care of serious illness in Kenyan hospitals: a story of scaling-up (and down and left and right). Archives of Disease in Childhood 96: 285–290.
  13. 13. Ministry of Health, Kenya (2006) Basic Paediatric Protocols.
  14. 14. WHO (2001) Interventions and strategies to improve the use of antimicrobials in developing countries: a review.
  15. 15. Rowe AK, Hamel MJ, Flanders WD, Doutizanga R, Ndoyo J, et al. (2000) Predicators of correct treatment of children with fever seen at outpatient health facilities in the Central Africa Republic. Am J Epidemiol 151: 1029–1035.
  16. 16. Ayieko P, Ntoburi S, Waigai J, Opondo C, Opiyo N, et al. (2011) A Multifaceted intervention to implement guidelines and improve admission care in Kenya District hospitals: a cluster randomized trial PLoS Medicine. 8: e1001018.
  17. 17. Gathara D, Opiyo N, Wagai J, Ntoburi S, Ayieko P, et al. (2011) Quality of hospital care for sick newborns and severely malnourished children in Kenya: A twoyear descriptive study in 8 hospitals. BMC Health Services Research 11: 307.
  18. 18. Nzioki C, Irimu G, Musoke R, English M (2009) Audit of care for children aged 6 to 59 months admitted with severe malnutrition at Kenyatta National Hospital, Kenya. International Health 1: 91–96.
  19. 19. Finn R, Currie G, Martin G (2010) Team Work in Context: Institutional Mediation in the Public-service Professional. Organization Studies 31: 1069–1097.
  20. 20. Paxton LA, Redd SC, Steketee RW, Otieno JO, Nahlen B (1996) An evaluation of clinical indicators for severe paediatric illness. Bulletin of the World Health Organization 74: 613–618.
  21. 21. Rogers EM (2003) editor (2003) Diffusion of innovations New York: The Free Press.
  22. 22. Ferrer R, Artigas A, Levy MM (2008) Improvement in process of care and outcomes after a multicenter severe sepsis educational programme in Spain. JAMA 299: 2294–2303.
  23. 23. Bradley J, Igras S (2005) Improving the quality of child health services: participatory action by providers. Int J Qual Health Care 17: 391–399.
  24. 24. Gustafson DH, Sainfort F, Adams EM (2003) Developing and testing a model to predict outcomes of organizational change. Health Serv Res 38: 751–776.
  25. 25. Stacey R (1995) The science of complexity: An alternative perspective for strategic change processes. Strategic Management Journal 16: 477–495.
  26. 26. Burnes B (2005) Complexity theories and organizational change. International Journal of Management Reviews 7: 73–90.
  27. 27. Theodoratou E, Al-Jilaihawi S, Woodward F, Ferguson J, Jhass A, et al. (2010) The effect of case management on childhood pneumonia mortality in developing countries. International Journal of Epidemiology 39: i155–i171.
  28. 28. Abbott A (1988) editor (1988) The system of professions: An essay on the division of expert labor. Chicago: University of Chicago Press.
  29. 29. Mercer SL, DeVinney BJ, Fine LJ, Green LW, Dougherty D (2007) Study designs for effectiveness and translation research:identifying trade-offs. Am J Prev Med 33: 139–154.
  30. 30. O'Cathain A, Murphy E, Nicholl J (2007) Integration and Publications as Indicators of “Yield” From Mixed Methods Studies. Journal of Mixed Methods Research 1: 147–163.
  31. 31. Victora CG, Habicht JP, Bryce J (2004) Evidence-based public health: moving beyond randomized trials. Am J Public Health 94: 400–405.
  32. 32. Teddlie C, Tashakkori A (2003) Major issues and controversies in the use of mixed methods in social and behavioural sciences. In: Tashakkori A, Teddlie C, editors. Handbook of Mixed Method in Social and Behavioural Sciences. London: Sage Publications Ltd. 4–50.
  33. 33. Lewin S, Glenton C, Oxman AD (2009) Use of qualitative methods alongside randomised controlled trials of complex healthcare interventions: methodological study. BMJ 339: b3496.
  34. 34. Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, et al. (2007) Developing and evaluating complex interventions: new guidance. In: MRC , editor. London.
  35. 35. Osterholt DM, Onikpo F, Lama M, Deming MS, Rowe AK (2009) Improving pneumonia case-management in Benin: a randomized trial of a multi-faceted intervention to support health worker adherence to Integrated Management of Childhood Illness guidelines. Human Resour Health 7: 77.
  36. 36. English M, Nzinga J, Mbindyo P, Ayieko P, Irimu G, et al. (2001) Explaining the effects of a multifaceted intervention to improve inpatient care in rural Kenyan hospitals – interpretation based on retrospective examination of data from participant observation, quantitative and qualitative studies. Implement Science 6: 124.