Figures
Abstract
Background
The past decade has seen several high-level events and documents committing to strengthening the field of health policy and systems research (HPSR) as a critical input to strengthening health systems. Specifically, they called for increased production, capacity to undertake and funding for HPSR. The objective of this paper is to assess the extent to which progress has been achieved, an important feedback for stakeholders in this field.
Methods and Finding
Two sources of data have been used. The first is a bibliometric analysis to assess growth in production of HPSR between 2003 and 2009. The six building blocks of the health system were used to define the scope of this search. The second is a survey of 96 research institutions undertaken in 2010 to assess the capacity and funding availability to undertake HPSR, compared with findings from the same survey undertaken in 2000 and 2008. Both analyses focus on HPSR relevant to low-income and middle-income countries (LMICs). Overall, we found an increasing trend of publications on HPSR in LMICs, although only 4% were led by authors from low-income countries (LICs). This is consistent with findings from the institutional survey, where despite improvements in infrastructure of research institutions, a minimal change has been seen in the level of experience of researchers within LIC institutions. Funding availability in LICs has increased notably to institutions in Sub-Saharan Africa; nonetheless, the overall increase has been modest in all regions.
Conclusion
Although progress has been made in both the production and funding availability for HPSR, capacity to undertake the research locally has grown at a much slower pace, particularly in LICs where there is most need for this research. A firm commitment to dedicate a proportion of all future funding for research to building capacity may be the only solution to turn the tide.
Citation: Adam T, Ahmad S, Bigdeli M, Ghaffar A, Røttingen J-A (2011) Trends in Health Policy and Systems Research over the Past Decade: Still Too Little Capacity in Low-Income Countries. PLoS ONE 6(11): e27263. https://doi.org/10.1371/journal.pone.0027263
Editor: Abdisalan Mohamed Noor, Kenya Medical Research Institute - Wellcome Trust Research Programme, Kenya
Received: May 25, 2011; Accepted: October 12, 2011; Published: November 22, 2011
Copyright: © 2011 Adam et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: The authors have no support or funding to report.
Competing interests: The authors have declared that no competing interests exist.
Introduction
The importance of invigorating the field of health policy and systems research (HPSR) has been increasingly emphasized in several action-oriented reports and events over the past decade. Notable examples include the 2004 Ministerial Summit for Health Research in Mexico and its proceedings [1]–[3], subsequent WHO strategic reports and resolutions [4], [5], the 2008 Global Ministerial Forum on Research for Health in Bamako and its proceedings [6]–[9], the 2010 WHO research strategy [10], [11], recommendations for future funding strategies of major funding entities [12]–[14], and most recently, the 2010 First Global Symposium on Health Systems Research (HSR) [15], [16], see Figure 1.
More specifically, all of these reports and events consistently called for: 1) Increased funding for HSR; 2) Increased institutional capacity for HSR; and 3) Knowledge production in HSR [4], [6], [7], [9], [15]. Health policy research has been explicitly included and linked to health systems research in more recent documents [10], [12], [13], [17].
By HPSR we refer to the production of new knowledge to improve how societies organize themselves in achieving collective health goals, and how different actors interact in the policy and implementation processes to contribute to policy outcomes [18], [19]. HPSR is characterized by the types of questions it addresses rather than any particular methodologies. It focuses primarily upon policies, organizations and programmes but not the clinical management of patients or basic biomedical research. HPSR can address any or several of the health systems building blocks and their ultimate objective to promote the coverage, quality, efficiency and equity of health systems [20].
The objective of this paper is to evaluate how the field of HPSR, particularly on issues relevant to and produced in low and middle income countries (LMICs), has evolved over the past decade with respect to the three dimensions listed above. The findings will inform global and national stakeholders about progress towards achieving their aspirations and commitments. It will also inform the upcoming 2012 World Health Report and the first Global Strategy on Health Systems Research to be published in 2012 with the achievements and gaps in this important area of research.
Methods
We assessed the progress in the field of HPSR with respect to three dimensions: 1) Knowledge production in HPSR; 2) Institutional capacity for HPSR; and 3) Funding for HPSR. Two sources of data were used. The first is a bibliometric analysis to assess the growth of publications on HPSR relevant to LMICs during the past decade. This addresses dimension one above. The second source is a survey of research institutions involved in HPSR relevant to LMICs, to assess the capacity and funding availability for HPSR. The survey addresses dimensions two and three above.
Bibliometric analysis
A bibliometric analysis was conducted in PubMed to retrieve publications relevant to HPSR in LMICs. The six building blocks of the health system as defined by the World Health Organization were used to define the scope of this search. These are: human resources, health financing, service delivery, health information systems, medicines and technologies and governance [20]. Publications between 2003 and 2009 were retrieved– 2003 being one year before the most important reports and events emphasizing the importance of re-invigorating the field of HPSR (Figure 1), and 2009, the latest year for which indexed publications from PubMed could be obtained at the time of this analysis. Only publications focusing on LMIC contexts were included. No language restriction was set.
A detailed and comprehensive list of search terms was developed, building on and updating available search strategies addressing the six building blocks of the health system [21]–[23]. Details of the search terms and the search strategy are available in Annex S1 (Search strategy). The main topic areas searched under each building block is summarized in Table 1. All building blocks were fairly represented except for medicines and technologies, where we focused our search on topics related to medicines.
The retrieved articles were downloaded from PubMed as text files and were converted to a database in Excel using reference manager software [24]. Data were cleaned and analysed in Excel. Retrieved articles were categorized by publication year, country of residence of corresponding author and publication topic. Information on residence of corresponding author was further categorized by income group using the World Bank classification. Trends in volume and nature of publications were analysed with respect to these categories.
Institutional survey
In September 2010, an invitation email was sent to 279 contact persons in research institutions involved in HPSR in LMICs, introducing the objectives of the survey and providing access to it. The mailing list included contact persons in partner institutions of the Alliance for HPSR [19], grantees funded by the Alliance if their institutions are not already included in the first list, and other institutions active in the field of HPSR identified to us through our contacts in the previous two lists. Criteria for inclusion was limited to institutions undertaking HPSR relevant to LMICs regardless of where the institution is based, i.e., institutions in high-income countries (HICs) were also included. Four email reminders were sent to encourage participants to respond to the survey. 112 responses were received (40% response rate) of which 96 were valid.
The survey included sections on human resource availability by type of discipline and professional degree; availability of infrastructure conducive to higher quality research such as availability of computers, internet and access to peer-reviewed publications; total number of publications and presentations on HPSR in the previous year; total number of grants related to HPSR in LMICs in the previous year and details on the latest 5 grants; and finally their perception of the availability of funds for and interest in undertaking HPSR. The survey data were imported, checked, and cleaned using Microsoft Excel and Stata 9 software [25]. Outliers were checked for accuracy and respondents were contacted to confirm any queries. Data was analysed using Stata software.
A similar group of research institutions was previously surveyed in 1999–2001 and 2008 using the same questionnaire, providing a useful metric to compare findings from the 2010 survey [9], [26]. Since 76% of the data from the first survey was from 2000, we consider it the base year for comparison purposes. Institutions based in HICs were only included in the 2008 and 2010 surveys while the 2000 survey was only limited to those based in low-income (LICs) or middle-income countries (MICs). There was minimal overlap (8% and 27% of institutions included in 2010 also responded to the 2000 and 2008 surveys respectively) between institutions included in the three surveys. This can be explained by the expanding list of Alliance partner institutions over the years, where newer partners are more likely to respond than older ones; the generally low response rate; and loss of contact with some institutions due to staff turnover. However, a balanced regional representation was obtained in the three surveys.
The survey data were categorized by income level using the World Bank income classification. To account for inflation, current US dollars in 2000 and 2008 were converted to 2010 prices using GDP deflators [27].
Ethics approval was not sought for this study since the data collected during the institutional survey represented basic information on staffing and funding availability and did not represent any risks to the participants or their institutions.
Results
Bibliometric analysis
Figure 2 shows the total number of HPSR publications on LMICs by topic, classified by residence of lead author. The total publications between 2003 and 2009 ranged from a low of 648 on medicines to a high of 10357 for service delivery. Taken together, they represent 10% of global publications on these topics, i.e., the vast majority of current HPSR evidence is relevant to HICs, see Table 2. Publications by lead authors from LICs represented only 4% of all HPSR publications in LMICs, ranging from 3% on health financing to 7% on medicines and service delivery, Table 2.
Looking at growth in publications over time, there was an increasing trend in publications focusing on LMIC countries in the six topic areas, except for research on health information systems (Figure 3). However, this was mainly driven by articles whose lead authors were from HIC and MICs, see Figure 4.
The number of HPSR publications focussing on LMICs increased at a faster rate than publications on HPSR in total. For example, in 2009 the number of publications on human resources with a LMIC focus was 2.1 times the number published in 2003, compared with a 1.7 times increase between 2003 and 2009 in non-LMIC contexts. Overall, publications on the 6 topic areas increased by an average of 3% over time between 2003 and 2009.
The bibliometric analysis also provided useful information on the research areas of interest as well as research gaps, an important input into priority setting for research (see Table 3). For example, research on human resources for health focused on training (60%) and migration (32%), while research on distribution and retention of human resources, where health systems in LMICs are still struggling, is notably lagging behind (8%). In service delivery, research on quality of care and performance was the main topic of interest (80%), while access to health services (12%) and the role of non-state sector (8%) were relatively neglected. Research on strengthening the governance and leadership roles of the health system, particularly stewardship roles through licensing and accreditation (2%) and auditing (8%), were also considerably neglected compared with studies on health professional's roles and authority, including the scope, content and location of practice (60%). Finally, research on medicines focused on selection of medicines, e.g., development of essential drug lists or formularies (24%), monitoring, e.g., of adverse drug effects and pharmacovigilence (22%), and medicines regulation and quality assurance (15%), while not much was published on prescribing practices and medicines use (3%), or on marketing (1%) and patient information (1%).
Institutional survey
Table 4 summarizes information on sources and funding availability for HPSR, as well as collaboration on funded projects between different stakeholders. The total number of observations is higher than the total number of institutions included in the analysis since respondents were asked to provide information on the five most recent projects on HPSR undertaken by their institution during the previous year. In 2010 prices, the mean grant size in LICs doubled and the median increased 10 folds between 2008 and 2010. No major changes were observed in MICs over time, while funding in HICs decreased in the most recent survey compared to 2008. These findings should be interpreted with caution particularly for HICs, where only 7 out of 16 institutions (44%) provided information on this question, which may suggest under reporting. Similarly, data from LICs were available from 6 out of 16 institutions (37%); all except one were in Africa. This is most likely an indication of lack of funded projects during the requested period rather than under-reporting as most of these institutions were either small institutions or ones that were only recently involved in HPSR.
In terms of funding sources, LICs are still mainly funded by international and bilateral organizations (88% in 2010) while government funding is stagnant at around 11%–15%. As in previous years, multiple sources of funding for projects is a prevalent practice in HICs but virtually non-existent in LICs.
With respect to collaborations between HIC and LMIC institutions and national governments, 93% of HIC projects were in collaboration with at least one or more institutions in LMIC, including the national government (Table 4). This was less so in MIC and LIC institutions were around 25% to 30% were not undertaken in collaboration with others. A notable difference between the 2008 and 2010 surveys is a doubling of projects in LIC undertaken in collaboration with the government (65% in 2010 compared with 29% in 2008). Similarly, collaborations between HIC and MIC institutions almost tripled (53% in 2010 compared with 19.5% in 2008).
These findings are consistent with respondents' perceptions of funding availability and interest to undertake HPSR in 2008 and 2010. While their perception of the interest to undertake HPSR remained high in 2010, their perception of funding availability was reduced in 2010 compared with 2008, particularly for LICs, see Figure 5.
Finally, despite an improvement in the availability of infrastructure for research and access to resources in LICs, there is no change in the level of human resource capacity between 2008 and 2010 in all three indicators, namely, percent of directors with more than 10 years experience, percent of staff with PhD and mean number of professional staff involved in HPSR. Access to peer-reviewed publications is still unacceptably low in LICs (62%), but computer and internet access has improved, Table 5.
Discussion
This paper assessed the progress in the field of HPSR over the past decade with respect to three dimensions: trends in peer-reviewed publications on HPSR relevant to LMICs; capacity to undertake HPSR and; funding availability for HPSR. Despite the limitations in this analysis, it provides the most comprehensive and up-to-date assessment of the development of the field of HPSR over the past decade. Among the most important limitations are the low response rate of the 2008 and 2010 institutional surveys, particularly for LICs and HICs, and the limited set of indicators to assess capacity to undertake HPSR. The low response rate is likely due to the sometimes difficult or time-consuming task of collecting institutional-level data on funding for, and capacity to do, HPSR, where non-respondents may not have had the incentive to pursue.
The bibliometric analysis was limited to PubMed and to peer-reviewed publications. In addition, some of the topics may not have been fully represented. For example, publications surrounding trade and pricing relevant to medicines may be under-represented in PubMed as opposed to other search databases. Nonetheless, PubMed is one of the largest search engines hosting more than 5500 journals from over 80 countries and is subscription free which makes it also the most accessible search engine for publications on HPSR in Low-income and middle-income countries.
The bibliometric analysis showed that while peer-reviewed publications on HPSR increased globally over time, the vast majority is relevant to HICs with only 10% of the evidence from LMICs (Table 2). Out of the HPSR publications focusing on LMICs, only 4% were led by researchers from LICs (Table 2). This demonstrates that the concept of the 10–90 gap is still pertinent, even in this area of research where local capacity and context is particularly important [28]. It highlights the importance of more concerted efforts to invest in research led by, and building capacity of, LIC researchers, where the knowledge base evidence-informed decision making is most needed.
The bibliometric analysis also provided useful indication of areas of research interest and gaps. For example there is a 16 fold difference in the number of publications on medicines policies compared with service delivery (Table 2), with research on medicines policies contributing only 2% of all HPSR relevant to LMICs in the analysis period. The picture is also similar for research on health information systems, where it represented 5% of all HPSR relevant to LMICs in the same analysis period. This may be in part due to what funders perceive as priorities for research and the reason why analysis like this is important to highlight such huge gaps and discrepancies. Some of the important research gaps highlighted in our analysis are research around access to health services, the distribution and retention of human resources; and several topics around governance issues (Table 3). Negligible interest in research around health information systems has been also noted, see Figure 3, an illustration of the historical neglect of this area of research [29]. These findings may well be a reflection of the lack of suitable and adapted methods to address complex topics around HPSR and of sufficient funding to address important topics that may be costly to investigate. While research around basic quantitative or descriptive analysis has grown, e.g., assessment of training needs, quality of care or the roles and scope of practice of different providers, more complex issues such as the role of the non-state sector or sensitive issues such as audit are addressed in lesser extent through research (Table 3). It is also a reflection of the research priorities set, or perceived, by major funding sources for HPSR. Our analysis aspires to redress this imbalance by influencing future research priorities in areas where knowledge gaps were identified.
It is arguable that the increase in HPSR research on LMICs peaked around 2006 onwards, see Figure 4. Assuming that the publication cycle takes around two years, on average, from the onset of research till the study is published; this may imply that high-level events and reports, such as the ministerial summit in 2004 and the world health resolution in 2005 played an important role in catalyzing more research in certain areas. However, the slower progress in the most recent years suggests that pledges and commitments need to be monitored by trusted high-profile organizations and the results fed back to the stakeholders involved to ensure meaningful and sustained progress in achieving set goals and commitments.
The institutional survey provided interesting insights into the dynamics of capacity to undertake and funding availability for HPSR. Compared to the 2000 survey, the mean grant size in both the 2008 and 2010 surveys were considerably higher in LICs than in MICs. In 2010, the median grant size in LICs was very close to that of HICs. Since around 70% to 80% of these funds come from international and bilateral sources, this suggests that there was a conscious effort to increase funding allocation to LICs in recent years. International sources of funding have also increased in MICs in 2010 compared with 2008 while domestic sources decreased by half. The increase in funding was not as substantial as in LICs, however. Seeking multiple funding sources was a common practice in MICs but almost non-existent in LICs, possibly due to the limited capacity of LIC institutions. Finally, research collaboration between northern and southern institutions has increased in the two most recent surveys, a fruitful outcome of encouraging or requiring research collaboration in recent funding practices. This has not yet translated to a notable increase in research being led by LIC authors, however, see Figure 4.
Building capacity for research in LMICs has been a topic of concern for a long time, as reflected in several WHO resolutions and global agenda for action [1], [4], [7], [10]. While evidence on effective approaches to build capacity in LMICs is relatively weak, some common conclusions can be identified. Most notably, the critical role of mentoring, a strategy that is less commonly used in LMICs, as an integral part of both short-term and long-term training; as well as using multi-faceted approaches, e.g., combining training with small funding to conduct a research study and having access to a mentor or facilitator during that process [30]. On the funding front, reforming the way international funds are channeled to LMICs may indirectly help increasing domestic funds allocated to research. For example, involving and empowering local stakeholders in setting research priorities; allocating a proportion of international funds to local research teams as core funding; and building capacity at organizational level to understand and use research evidence are all measures that are likely to increase demand and funding for research at national level [31].
In summary, while recognition of the contribution of HPSR to stronger health systems has grown, the human capacity to carry out the research has not kept pace, particularly in LICs. This analysis highlights two important areas to focus efforts in the next few years. The first is to take a more active role, both at national and international levels to identify and fund mechanisms to build research capacity in LICs [30]–[35]. The second is to re-new the commitment to the recommendation made by the Commission on Health Research for Development in 1990 to invest at least 2% of national health expenditures in research and research capacity strengthening [4], [36] and to continue to develop and strengthen not only north-south but also south-south collaborations.
Supporting Information
Annex S1.
Search strategy for bibliometrics analysis.
https://doi.org/10.1371/journal.pone.0027263.s001
(DOC)
Acknowledgments
We wish to express our gratitude to the participants of the institutional survey for their valuable input to this analysis. The manuscript represents the views of the authors and not necessarily those of the organization they represent.
Author Contributions
Conceived and designed the experiments: TA. Performed the experiments: TA SA. Analyzed the data: TA SA MB. Wrote the paper: TA. Contributed to the interpretation of the results: TA MB AG JAR.
References
- 1.
Global Forum for Health Research (2004) The Ministerial Summit on Health Research: The Mexico Statement on Health Research. Geneva: Global Forum for Health Research.
- 2.
World Health Organization (2004) World Report on Knowledge for Better Health: Strengthening Health Systems. Geneva: World Health Organization.
- 3. Task Force on Health Systems Research (2004) Informed choices for attaining the Millennium Development Goals: Towards an international cooperative agenda for health-systems research. Lancet 364: 1756.
- 4.
World Health Organization (2005) World Health Assembly Resolution (WHA58.34) Ministerial Summit on Health Research. Geneva: World health organization.
- 5.
World Health Organization (2005) Report from the Ministerial Summit on Health Research: Identify challenges, inform actions, correct inequities. Geneva: World Health Organization.
- 6.
Global Forum for Health Research (2008) Global Ministerial Forum on Research for Health: Bamako Call to Action. Geneva: Global Forum for Health Research.
- 7.
World Health Organization (2009) Executive Board, 124th session: WHO's role and responsibilities in health research: Bamako Global Ministerial Forum on Research for Health. Geneva: World Health Organization.
- 8.
World Health Organization (2009) Scaling up research and learning for health systems: Now is the time: Report of a High Level Task Force, presented and endorsed at the Global Ministerial Forum on Research for Health 2008, Bamako, Mali. Geneva: World Health Organization.
- 9. Bennett S, Adam T, Zarowsky C, Tangcharoensathien V, Ranson K, et al. (2008) From Mexico to Mali: progress in health policy and systems research. Lancet 372: 1571–1578.
- 10.
World Health Organization (2010) World Health Resolution (WHA63.21): WHO's Role and Responsibilities in Health Research. Geneva: World Health Organization.
- 11.
World Health Organization (2010) World Health Assembly Resoultion (WHA63/22): WHO's Role and Responsibilities in Health Research: Draft WHO Strategy on Research for Health. Geneva: World Health Organization.
- 12. European Commission (2010) The EU Role in Global Health: Communication from the Commission to the Council, the European Parliament, the European Economic and Social Committee and the Committee of the Regions. European Commission.
- 13.
UK Department for International Development (2008) DFID Research Strategy 2008–2013: Working Paper Series: Better Health. London, UK: DFID.
- 14.
Task Force on Global Action for Health System Strengthening (2009) Global Action for Health System Strengthening. Policy Recommendations to the G8. Japan Center for International Exchange.
- 15.
World Health Organization and Partners (2011) First Global Symposium on Health Systems Research, Montreux: Statement from the Steering Committee. Accessed April 1 2011. Geneva: World Health Organization.
- 16.
World Health Organization and Partners (2011) First Global Symposium on Health Systems Research, Montreux. Accessed April 1, 2011. World Health Organization.
- 17.
Task Force on Innovative Financing for Health Systems (2009) Constraints to scaling up. International health Partnerships (IHP+).
- 18.
Alliance for Health Policy and Systems Research (2007) What is health policy and systems research and why does it matter? Geneva: World Health Organization.
- 19.
Alliance for Health Policy and Systems Research. Geneva: World Health Organization. Available: http://www.who.int/alliance-hpsr Accessed 1April, 2011.
- 20.
World Health Organization (2007) Everybody's Business: Strengthening Health Systems to Improve Health Outcomes: WHO's Framework for Action. Geneva: World Health Organization.
- 21.
Lavis J, Hammill A, Wilson M, Boyko J, Grimshaw J, et al. (2007) Systematic Reviews That Can Inform Health Systems Management and Policymaking. Program in Policy Decision-Making. Hamilton: Canada.
- 22. Ritz LS, Adam T, Laing R (2010) A bibliometric study of publication patterns in access to medicines research in developing countries. Southern Med Review 3: 2–6.
- 23. Ranson MK, Chopra M, Atkins S, Dal Poz MR, Bennett S (2010) Priorities for research into human resources for health in low- and middle-income countries. Bulletin of the World Health Organization 88: 435–443.
- 24.
Reference Manager V10 (2010) Reference Manager Professional Edition Version 10. The Thomson Corporation.
- 25.
Stata 9 (2005) Stata Statistical Software: Release 9. College Station, TX: Stata Corporation.
- 26. Gonzalez-Block MA, Mills A (2003) Assessing capacity for health policy and systems research in low and middle income countries. Health Research Policy and Systems 1:
- 27.
World Bank (2010) World Development Indicators 2010. Washington, DC: World Bank.
- 28.
Global Forum for Health Research (1999) 10/90 Report on Health Research 1999. Geneva: Global Forum for Health Research.
- 29.
Alliance for Health Policy and Systems Research (2008) Neglected Health Systems Research: Health Information Systems. Geneva: World Health Organization.
- 30.
Bennett S, Paina L, Kim C, Agyepong I, Chunharas S, et al. (2010) What must be done to enhance capacity for health systems research. Background paper for the First Global Symposium on Health Systems Research.
- 31. Bennett S, Agyepong IA, Sheikh K, Hanson K, Ssengooba F (2011) Building the Field of Health Policy and Systems Research: An Agenda for Action. PLoS Med 8:
- 32.
Green A, Sara Bennett, editors. (2007) Sound Choices. Enhancing capacity for evidence-informed health policy. Alliance for Health Policy and Systems Research. Geneva: World Health Organization.
- 33. Kolars JC (2011) Taking down ‘the Ivory Tower’: leveraging academia for better health outcomes in Uganda. BMC International Health and Human Rights 11(Suppl 1): S1.
- 34. Okui O, Ayebare E, Nabirye Chalo O, Pariyo G, Groves S, et al. (2011) Building partnerships towards strengthening Makerere University College of Health Sciences: a stakeholder and sustainability analysis. BMC International Health and Human Rights 11(Suppl 1): S14.
- 35. Balabanova D, McKee M, Mills A, Walt G, Haines A (2010) What can global health institutions do to help strengthen health systems in low income countries? Health Research Policy and Systems 8: 22.
- 36.
Commission on Health Research for Development (1990) Health Research: Essential Link to Equity in Development. Oxford University Press. 157 p.