There is conclusive evidence from observational data and three randomized controlled trials that circumcised men have a significantly lower risk of becoming infected with the human immunodeficiency virus (HIV). The aim of this study was to systematically review economic evaluations on adult male circumcision (AMC) for prevention of heterosexual acquisition of HIV in men.
Methods and Findings
Studies were identified from the following bibliographic databases: MEDLINE (Ovid), EMBASE (Ovid), Cochrane Library (Wiley's internet version), NHS EED and DARE Office of Health Economics HEED. The searches were conducted in November 2009. The Drummond 10-point checklist was used for methodological critique of the economic evaluations. Cost data were inflated and converted to 2008 US dollars (US$). Of 264 identified papers, only five met the inclusion criteria and were included in the review. The studies were published between 2006 and 2009. Most of the studies were carried out from the perspective of government healthcare payer. The time horizon ranged from 10 to 20 years. All studies reported that AMC is cost-effective. The reported cost per HIV infection averted ranged from US$174 to US$2808. The key driver of the cost-effectiveness models was circumcision efficacy.
All published economic evaluations offered the same conclusion that AMC is cost-effective and potentially cost-saving for prevention of heterosexual acquisition of HIV in men. On these grounds, AMC may be seen as a promising new form of strategy for prevention of HIV and should be implemented in conjunction with other evidence-based prevention methods.
Citation: Uthman OA, Popoola TA, Uthman MMB, Aremu O (2010) Economic Evaluations of Adult Male Circumcision for Prevention of Heterosexual Acquisition of HIV in Men in Sub-Saharan Africa: A Systematic Review. PLoS ONE 5(3): e9628. doi:10.1371/journal.pone.0009628
Editor: Pieter H. M. van Baal, Erasmus University Rotterdam, Netherlands
Received: December 4, 2009; Accepted: February 18, 2010; Published: March 10, 2010
Copyright: © 2010 Uthman et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: The authors have no support or funding to report.
Competing interests: The authors have declared that no competing interests exist.
Male circumcision is one of the oldest and most common surgical procedures worldwide. It may be undertaken for religious, cultural, social and medical reasons. There is conclusive evidence from observational data , , , , ,  and three randomized controlled trials , ,  that circumcised men have a significantly lower risk of becoming infected with the human immunodeficiency virus (HIV). Several reviews have been reported on the effectiveness of adult male circumcision (AMC) for prevention of heterosexual acquisition of HIV in men , , , , , , , , , , . While the literature has focused on the effectiveness alone, we argue that there has not been commensurate interest in economic evaluations. Economic evaluation provides a useful framework to assist policy makers in allocating resources across competing needs. HIV/AIDS is a considerable burden on society resources, and prevention provides a cost-beneficial solution to address these consequences . Sub-Saharan Africa is more heavily affected by Human immunodeficiency virus (HIV) and acquired immunodeficiency syndrome (AIDS) than any other region of the world . Estimated 22.5 million people were living with HIV at the end of 2007 and approximately 1.7 million additional people were infected with HIV during that year . In just the past year, the AIDS epidemic in Africa had claimed the lives of estimated 1.6 million people in this region. More than 11 million children have been orphaned by AIDS .
To our knowledge, no systematic review of the peer-reviewed economic evaluations literature on AMC for prevention of heterosexual acquisition of HIV in men has been published to date. A goal of systematic review is to provide the clinician, researcher or policy makers with a balanced appraisal of the totality of the evidence in an area by reading one review, contrary to a multitude of individual studies. This allows for a more objective appraisal of the evidence, which may lead to resolution of uncertainty and disagreement. Therefore, the objectives of this systematic review were to identify published economic evaluations on AMC for prevention of heterosexual acquisition of HIV in men and to identify areas that merit further study.
Inclusion and exclusion criteria applied for economic searches are summarised below:
- Study design: cost-effectiveness analysis, cost-utility analysis, or cost-benefit analysis
- Population: adult male in sub-Saharan Africa
- Intervention: adult male circumcision (AMC)
- Comparator: no AMC
Information Sources and Search strategy
A comprehensive search for literature on the cost-effectiveness of AMC versus no AMC for prevention of heterosexual acquisition of HIV in men was conducted. Studies were identified from the following bibliographic databases: MEDLINE (Ovid), EMBASE (Ovid), Cochrane Library (Wiley's internet version), NHS EED and DARE Office of Health Economics HEED. The searches were conducted in November 2009. Searches were not limited by date and there were no language restrictions. Search keywords included male circumcision, circumcision, and adult male circumcision. These keywords were combined with an economic study filter based on the Centre for Review Disseminations model , . We also checked the reference lists of all studies identified by the above methods.
One reviewer applied the inclusion and exclusion criteria. These were checked by a second reviewer. Disagreements were resolved by discussion.
Data Collection Process and Data Items
For each identified study that met the selection criteria, the following data were extracted country, study design, population, intervention, comparator, perspective, model type, primary outcome, discount rate, time horizon, and price year on to an Excel spreadsheet. The main characteristics, quality assessment (see below) and results of included economic evaluations were tabulated. One review author extracted data and the second author checked the extracted data.
Identified economic evaluations were also assessed against the Drummond 10-point checklist . The checklist was developed to assess/critique the quality of an economic evaluation. Drummond checklists consider the following: description of interventions; study design; identification, measurement and valuation of costs and consequences; discounting; a clear results with sensitivity and uncertainty analysis; and discussion of results in the context of policy relevance and existing literature.
For the primary outcome, the preferred measures were cost per HIV infection averted (HIA), and incremental cost-effectiveness ratio (cost per quality adjusted life years (QALY) gained and cost per disability adjusted life years (DALY) averted). Net cost saving was also considered.
In order to make different cost data comparable, the cost data were inflated to 2008 prices using the prices inflation index . For those studies that did not report price year, the year the study was published was used for inflation of cost data. This review was performed according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) , .
The search of electronic databases produced a total of 264 citations (Figure 1). After adjusting for duplicates 205 remained. Of these, 190 studies were discarded because after reviewing the abstracts it appeared that these papers clearly did not meet the inclusion criteria. The full text of the remaining 15 citations was examined in more detail. Ten studies were discarded for the following reasons: cost-analysis (n = 3) , , , neonatal circumcision (n = 3) , , , correspondence (n = 2) , , and population based on high-income country (n = 2) , . Five studies , , , ,  met the inclusion criteria and were included in the systematic review.
Figure 1. Flowchart for study selection.doi:10.1371/journal.pone.0009628.g001
Table 1 shows the characteristics of the included studies. The studies were published between 2006 and 2009. Studies population was from Uganda , South Africa , Mozambique , and Botswana . Auvert et al 2008  included data from the following 16 countries in sub-Saharan Africa: Botswana, Burundi, Central African Republic, Kenya's Nyanza province, Lesotho, Liberia, Malawi, Mozambique, Namibia, Rwanda, South Africa, Swaziland, Tanzania, Uganda, Zambia and Zimbabwe. All studies , , , ,  were cost-effectiveness analyses and primary outcome was cost per HIV infection averted (HIA). Most studies were carried out from the perspective of government healthcare payer. All studies , , , ,  compared cost-effectiveness of adult male circumcision (AMC) versus no AMC. The model types included epidemiologic , , , stochastic , and costing model . Four studies used 3% discount rate , , , . One study did not report discount rate . The time horizon ranged from 10 to 20 years.
Table 1. General characteristics of included studies.doi:10.1371/journal.pone.0009628.t001
Details of the quality of assessments can be found in Table 2.
Table 2. Quality of included studies.doi:10.1371/journal.pone.0009628.t002
1. Was a well-defined question posed in answerable form?
2. Was a comprehensive description of the competing alternatives given?
3. Was the effectiveness of the programmes or services established?
Evidence of effectiveness came from the observational studies or from the trial results , , . Kahn et al 2006  defined effectiveness as the number of HIA, which was estimated by dynamically projecting over 20 years the reduction in HIV incidence observed in the Orange Farm (OF, Gauteng Province, South Africa). Auvert et al 2008  and Fieno et al 2008  also used evidence of effectiveness from OF trial . Bollinger et al 2009  used evidence from three trials , , . Gray et al 2007  effectiveness parameters were based on an observational study in a rural population of Rakai District, south-western Uganda. Gray et al 2007  assumed that circumcision might reduce the incidence of HIV incidence rate ratios (IRR) varying from 0.3 to 0.6. Efficacy, the reduced incidence of HIV afforded by circumcision, was estimated from 1-IRR.
4. Were all the important and relevant costs and consequences for each alternative identified?
All studies , , , ,  considered cost of AMC. Except for Gray et al 2007 , studies , , ,  considered lifetime medical cost of treating HIV. Only one study included complications associated with AMC in the cost-effectiveness model .
5. Were costs and consequences measured accurately in appropriate physical units?
Most studies estimated cost of AMC and lifetime medical treatment of HIV from published studies. Number of HIV infections averted was the primary outcome in all studies. Fieno et al 2008  also valued outcome in DALYs averted. Most studies extrapolated the number of HIV infection averted beyond the trials period.
6. Were costs and consequences valued credibly?
Kahn et al. 2006  cost of performing an AMC was based on the estimate from the OF RCT . Kahn et al. 2006  assumed zero additional training and physical infrastructure development costs in connection with high levels of circumcision coverage. The cost per AMC was varied by ±50% to reflect these potential efficiencies or inefficiencies of scale-up. The cost of adverse events was included and standardized for 1,000 individuals. The lifetime cost of HIV treatment was based on Cleary et al.  data from pilot clinics (in South Africa) for a prospective disease state model. Cleary and colleagues  estimated a lifetime discounted cost of US$11,948 with antiretroviral therapy (ART) and US$3,793 without ART. However, Kahn et al. 2006  used US$8,000 as the base case value, implying 50% access to ongoing ART, and explored a wide range from US $4,000 to US$12,000.
Gray et al 2007  used the estimated cost per surgery in the Rakai trial  (US$69) to estimate the cost per HIA over a period of 10 years. Auvert et al 2008  explored a public cost scenario assuming the use of government health infrastructures only and a private cost scenario assuming reliance on private health care providers only. Program costs were composed of initial and annual costs. In the public cost scenario, initial costs were per circumcision facility (for medical equipment and certification) and for training circumcisers. Annual costs included the oversight and promotion of AMC, the salaries of full-time circumcisers, surgical staff and counsellors, the direct non-salary cost of each AMC (i.e., surgical supplies), facility overhead (i.e., operating costs) and program overhead. In the private cost scenario, all facility-level costs were included in the price per AMC paid to providers. No initial costs were included because these providers were already equipped to perform AMC. The price of each AMC covered salaries of circumcisers, other health staff, counselling, surgical supplies, follow-up, treatment of adverse events and operating costs. In addition to direct provider payments, Auvert et al 2008  also assumed annual program overhead costs of 10% to cover the public promotion of AMC. In order to estimate costs and savings from HIV treatment, Auvert et al 2008  assumed that 30% of HIV-infected individuals eligible for antiretroviral treatment were receiving it. The averted cost of medical treatment for HIV over time was a function of the number of HIV infections averted each year and the rate of disease progression, combined with associated medical costs.
Fieno et al 2008  reported detail breakdown of AMC costing model estimates under different scenarios. The costing model was broken down into seven cost inputs: personnel (salaries and training), surgical equipment and supplies, bandages and cleaning supplies, monitoring and evaluation (M & E), administration, rural coverage, and adverse events due to the surgery. Fieno et al 2008  assumed the value of medical care per HIV infection was to be the cost of two years of anti-retroviral therapy (ART) (US$500) in Mozambique or US$1000. Bollinger et al 2009  used unit cost of an uncomplicated AMC of US$48 in the public sector as provided by Botswana national strategy. In addition, Bollinger et al 2009  also developed three other unit costs: (1) a neonatal circumcision unit cost of US$38 (assumed to be 20% lower than the adult cost, due to lower complication rates and lower costs for commodities), (2) private provider unit costs for both adult and neonatal circumcisions of US$60 and US$48 (assumed to be 5% higher than the relevant public sector costs)., and (3) user fees of US$1 for public sector and US$25 for private providers were assumed.
Kahn et al. 2006  defined effectiveness as the number of HIV infections prevented per 1,000 newly circumcised men over a specified number of years. The effectiveness was calculated as the product of the number of HIV susceptible, the HIV incidence rate, the protective effect of AMC (adjusted for risk compensation), the projection period (in years), and an epidemic multiplier. Kahn et al. 2006  estimated net DALYs by subtracting the increase in DALYs due to adverse events from the reduction in DALYs due to HIA. The reduction in DALYs from HIV was calculated by multiplying HIA by previously reported discounted DALY changes with ART (ten DALYs) and without (21 DALYs), assuming 50% on ART. Gray et al 2007  calculated the number of HIV infections potentially averted by each surgery from the total number of incident cases expected in the population in the absence of a circumcision program minus the number of incident cases estimated with varying circumcision efficacies. Auvert et al 2008  estimated effects of AMC on HIV as a function of time and parameters were based on published studies. Fieno et al 2008  assumed the number of DALYs per HIV/AIDS mortality to be 15.5 years. The benefits of AMC were estimated from the Kahn et al. 2006  cost-effectiveness model. Bollinger et al 2009  calculated number of AMC that are required in order to avert one HIV infection by dividing the increase in the number of AMC performed by the number of HIA over the relevant time period.
7. Were costs and consequences adjusted for differential timing?
8. Was an incremental analysis of costs and consequences of alternatives performed?
9. Was allowance made for uncertainty in the estimates of costs and consequences?
Except for Fieno et al 2008 , studies reported at least one form of sensitivity analyses. Gray et al 2007  explored the effect of variation program coverage and circumcision efficacy on the cost per HIA. Kahn et al 2006  conducted sensitivity analyses to examine the effects of all input uncertainty and program coverage using one-way, three-way and multivariate (using Monte Carlo simulations) sensitivity analyses. Auvert et al 2008  explored a public cost scenario assuming the use of government health infrastructures only and a private cost scenario assuming reliance on the private health care providers only. In addition, Auvert et al 2008  also considered the effect of different time horizon and program coverage on cost per HIA. Bollinger et al 2009  examined the effects in variation in program effectiveness, discount rate, and lifetime cost of ART on the cost per HIA.
10. Did the presentation and discussion of study results include all issues of concern to users?
Most of the studies discussed issue of availability, affordability, and sustainability of their findings.
Table 1 also shows the estimated cost per HIA from the five studies. Gray et al 2007  reported that the cost per HIA over 10 years could range from US$2808 with 60% circumcision efficacy, to US$4173 with 40% circumcision efficacy. Kahn et al. 2006  estimated the cost per HIA over 20 years at US$193. Kahn et al. 2006  also reported that the cost-effectiveness model was sensitive to the cost of AMC, cost of averted HIV treatment, the protective effect of AMC, and HIV prevalence. With an HIV prevalence of 8.4%, the cost of per HIA increased nearly 3-fold to US$588. Cost-effectiveness improves by less than US10$ when AMC intervention coverage is 50% of full coverage. Auvert et al 2008  found that the estimated costs per HIA over 10 and 20 years were US$351 (US$271 to US$473) and US$174 (US$138 to US$232) respectively. Fieno et al 2008  estimated the cost per HIA over 20 years at US$390. Bollinger et al 2009  estimated the cost per HIA with 60% circumcision efficacy at US$642. However, the cost-effectiveness model was sensitive to AMC effectiveness. At 75% and 30% circumcision efficacy, the costs per HIA were US$508 and US$1313 respectively.
The reported cost savings varied across the studies. Kahn et al. 2006  found that after adjustment for averted lifetime HIV medical costs, the net saving was US$2573 per AMC. Auvert et al 2008  found that the estimated net savings over 20 years were US$2.4 billion (95% percentile interval 1.5 to 3.5). Fieno et al 2008  reported that the saving from the AMC in terms of medical costs alone would accrue over 20 years to US$234.0 million. Bollinger et al 2009  estimated net savings over 17 years with 60% circumcision efficacy at US$10,616. Only study reported cost per DALYs averted . Fieno et al 2008  reported that cost was US$7.8 per DALY.
This systematic review of economic evaluations of adult male circumcision (AMC) for prevention of heterosexual acquisition of HIV in men provides compelling evidence that AMC is within the range of what is generally regarded as cost-effective, even cost-saving, intervention. The reported cost per HIA ranged from US$174 in Auvert et al 2008  to as much as US$2808 in Gray et al 2007 . The key driver of cost-effectiveness models was circumcision efficacy. Except for Gray et al 2007 , studies used evidence of effectiveness from OF trial . Thus, possible explanation for the high cost per HIA reported by Gray et al 2007  in comparison to other studies could be due to the fact that the model effectiveness data was based on observational study. However, these findings are comparable with other prevention and treatment strategies in developing countries in terms of economic criteria. Recent reviews of HIV prevention cost-effectiveness suggest a range of $10 to more than $10,000 per HIA , , . Commercial sex worker interventions and mass-media campaign cost just over US$50 per HIA. Second-generation female condom cost US$985 per HIA. Blood safety measures cost US$41–246 per HIA. Diagnosis and treatment of sexually transmitted infections cost US$250 per HIA. Voluntary testing and counselling cost S$264–367 per HIA; and intervention for reducing mother-to-child transmission cost US$84–714 per HIA.
Study Strengths and Limitations
The strengths of this study are that, to our knowledge, it provides the most comprehensive review to date of economic evaluations of male circumcision for prevention of heterosexual acquisition of HIV in men in sub-Saharan; and it is the first review in this area to critique the quality of modelling approaches used in the economic evaluations. The search process was elaborate and to our knowledge no other studies were available for review. In addition, we used a standard checklist to appraise the quality of economic evaluations. The reporting of this review conforms to PRISMA guideline , .
There are number of limitations associated with these studies. Most of these studies did not considered complications associated with AMC in their cost-effectiveness models. It has been reported that high complication rates challenge the implementation of male circumcision for HIV prevention in Africa . Another important limitation of these studies, except for Kahn et al 2006 , most of the authors did not considered multivariate sensitivity analysis. The uncertainty in the evidence base needs to be reflected in the model. To simultaneously assess the implications of uncertainty in all elements of evidence, probabilistic analysis should be used to establish the decision uncertainty associated with each public health intervention being compared , . This informs decision-makers about the probability of each strategy being the most cost-effective conditional on the value that the decision maker places on a unit of health gain. Such methods can also be used to provide an opportunity to apply value of information (VOI) methods to inform priority setting in research , , . Generalizability of the findings is also an important limitation. Most of the studies were based on OF trial . The OF trial  was conducted in a single country and used prevailing or local prices to calculate costs. Economic evaluation carried out alongside a randomised controlled trial may differ significantly from usual practice or care . We recommend that future economic evaluations address these limitations and be guided in part by the checklists available for assessing economic evaluations. Economic evaluation provides a useful framework to assist policy makers in allocating resources across competing needs. HIV/AIDS is a considerable burden on society resources, and prevention provides a cost-beneficial solution to address these consequences. To better inform the decision-making process, researchers must continue to produce high-quality, methodological, comparable and scientifically credible economic evaluations.
All published economic evaluations offered the same conclusion that AMC is cost-effective and potentially cost-saving for prevention of heterosexual acquisition of HIV in men. On these grounds, AMC may be seen as a promising new form of strategy for prevention of HIV. However, we believed like others that AMC should never replace other known methods of HIV prevention. AMC should be considered as part of a comprehensive HIV prevention package, such as, promoting delay in the onset of sexual relations, abstinence from penetrative sex and reduction in the number of sexual partners; providing and promoting the correct and consistent use of male and female condoms; providing HIV testing and counselling services; and providing services for the treatment of sexual transmitted infections.
The authors thank the editor and two anonymous reviewers for critical review of an earlier version of the manuscript.
Analyzed the data: OU TAP MMU OA. Contributed reagents/materials/analysis tools: OU TAP MMU OA. Wrote the paper: OU TAP MMU OA.
- 1. Baeten JM, Richardson BA, Lavreys L, Rakwar JP, Mandaliya K, et al. (2005) Female-to-male infectivity of HIV-1 among circumcised and uncircumcised Kenyan men. J Infect Dis 191: 546–553.
- 2. Drain PK, Halperin DT, Hughes JP, Klausner JD, Bailey RC (2006) Male circumcision, religion, and infectious diseases: an ecologic analysis of 118 developing countries. BMC Infect Dis 6: 172.
- 3. Halperin DT, Bailey RC (1999) Male circumcision and HIV infection: 10 years and counting. Lancet 354: 1813–1815.
- 4. Moses S, Bradley JE, Nagelkerke NJ, Ronald AR, Ndinya-Achola JO, et al. (1990) Geographical patterns of male circumcision practices in Africa: association with HIV seroprevalence. Int J Epidemiol 19: 693–697.
- 5. Quinn TC, Wawer MJ, Sewankambo N, Serwadda D, Li C, et al. (2000) Viral load and heterosexual transmission of human immunodeficiency virus type 1. Rakai Project Study Group. N Engl J Med 342: 921–929.
- 6. Reynolds SJ, Shepherd ME, Risbud AR, Gangakhedkar RR, Brookmeyer RS, et al. (2004) Male circumcision and risk of HIV-1 and other sexually transmitted infections in India. Lancet 363: 1039–1040.
- 7. Auvert B, Taljaard D, Lagarde E, Sobngwi-Tambekou J, Sitta R, et al. (2005) Randomized, controlled intervention trial of male circumcision for reduction of HIV infection risk: the ANRS 1265 Trial. PLoS Med 2: e298.
- 8. Bailey RC, Moses S, Parker CB, Agot K, Maclean I, et al. (2007) Male circumcision for HIV prevention in young men in Kisumu, Kenya: a randomised controlled trial. Lancet 369: 643–656.
- 9. Gray RH, Kigozi G, Serwadda D, Makumbi F, Watya S, et al. (2007) Male circumcision for HIV prevention in men in Rakai, Uganda: a randomised trial. Lancet 369: 657–666.
- 10. Bailey RC, Plummer FA, Moses S (2001) Male circumcision and HIV prevention: current knowledge and future research directions. Lancet Infect Dis 1: 223–231.
- 11. Millett GA, Flores SA, Marks G, Reed JB, Herbst JH (2008) Circumcision status and risk of HIV and sexually transmitted infections among men who have sex with men: a meta-analysis. JAMA 300: 1674–1684.
- 12. Mills E, Cooper C, Anema A, Guyatt G (2008) Male circumcision for the prevention of heterosexually acquired HIV infection: a meta-analysis of randomized trials involving 11,050 men. HIV Med 9: 332–335.
- 13. Moses S, Plummer FA, Bradley JE, Ndinya-Achola JO, Nagelkerke NJ, et al. (1994) The association between lack of male circumcision and risk for HIV infection: a review of the epidemiological data. Sex Transm Dis 21: 201–210.
- 14. O'Farrell N, Egger M (2000) Circumcision in men and the prevention of HIV infection: a ‘meta-analysis’ revisited. Int J STD AIDS 11: 137–142.
- 15. Siegfried N, Muller M, Deeks J, Volmink J, Egger M, et al. (2005) HIV and male circumcision–a systematic review with assessment of the quality of studies. Lancet Infect Dis 5: 165–173.
- 16. Siegfried N, Muller M, Deeks JJ, Volmink J (2009) Male circumcision for prevention of heterosexual acquisition of HIV in men. Cochrane Database Syst Rev. CD003362.
- 17. Siegfried N, Muller M, Volmink J, Deeks J, Egger M, et al. (2003) Male circumcision for prevention of heterosexual acquisition of HIV in men. Cochrane Database Syst Rev. CD003362.
- 18. Van Howe RS (1999) Circumcision and HIV infection: review of the literature and meta-analysis. Int J STD AIDS 10: 8–16.
- 19. Weiss HA, Halperin D, Bailey RC, Hayes RJ, Schmid G, et al. (2008) Male circumcision for HIV prevention: from evidence to action? Aids 22: 567–574.
- 20. Weiss HA, Quigley MA, Hayes RJ (2000) Male circumcision and risk of HIV infection in sub-Saharan Africa: a systematic review and meta-analysis. Aids 14: 2361–2370.
- 21. Bertozzi SM, Padian NS, Wegbreit J, DeMaria LM, Feldman B, et al. (2006) HIV/AIDS Prevention and Treatment. In: Jamison DT, Breman JG, Measham AR, Alleyne G, Claeson M,, et al., editors. Disease control priorities in developing countries. New York; Washington, DC: Oxford University Press; World Bank. pp. 331–370.
- 22. UNAIDS (2008) 2007 Report on the global AIDS epidemic. Geneva: Joint United Nations Programme on HIV/AIDS.
- 23. McKinlay RJ, Wilczynski NL, Haynes RB (2006) Optimal search strategies for detecting cost and economic studies in EMBASE. BMC Health Serv Res 6: 67.
- 24. Royle P, Waugh N (2003) Literature searching for clinical and cost-effectiveness studies used in health technology assessment reports carried out for the National Institute for Clinical Excellence appraisal system. Health Technol Assess 7: iii, ix–x, 1–51.
- 25. Drummond MF, Sculpher MJ, Torrance GW, O'Brien BJ, Stoddart GL (2005) Methods for the economic evaluation of health care programmes. New York: Oxford University Press.
- 26. Bureau of Labor Statistics (BLS) Overview of BLS Statistics on Inflation and Prices. United States of Department of Labor.
- 27. Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, et al. (2009) The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. PLoS Med 6: e1000100.
- 28. Moher D, Liberati A, Tetzlaff J, Altman DG (2009) Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med 6: e1000097.
- 29. Jayanthi VR, Burns JE, Koff SA (1999) Postneonatal circumcision with local anesthesia: a cost-effective alternative. Journal of Urology 161(4): 1301–1303.
- 30. McAllister RG, Travis JW, Bollinger D, Rutiser C, Sundar V (2008) The cost to circumcise Africa. International Journal of Men's Health 7(3): 307–316.
- 31. Raja V, Sharma DM, Lipp A, Webb RJ (2007) Adult circumcision under local anaesthesia: patient satisfaction and cost analysis. Journal of One Day Surgery 17:
- 32. Ganiats TG, Humphrey JB, Taras HL, Kaplan RM (1991) Routine neonatal circumcision: a cost-utility analysis. Med Decis Making 11: 282–293.
- 33. Schoen EJ, Colby CJ, To TT (2006) Cost analysis of neonatal circumcision in a large health maintenance organization. Journal of Urology 175(3): 1111–1115.
- 34. Van Howe RS (2004) A cost-utility analysis of neonatal circumcision. Medical Decision Making 24: 584–601.
- 35. Moses S, Bailey RC, Ronald AR (1998) Male circumcision: assessment of health benefits and risks. Sex Transm Infect 74: 368–373.
- 36. Wamai RG, Weiss HA, Hankins C, Agot K, Karim QA, et al. (2008) Male circumcision is an efficacious, lasting and cost-effective strategy for combating HIV in high-prevalence AIDS epidemics. Future HIV Therapy 2: 399–405.
- 37. Anderson J, Wilson D, Templeton DJ, Grulich A, Carter R, et al. (2009) Cost-effectiveness of adult circumcision in a resource-rich setting for HIV prevention among men who have sex with men. J Infect Dis 200: 1803–1812.
- 38. Cohen DA, Wu SY, Farley TA (2004) Comparing the cost-effectiveness of HIV prevention interventions. Journal of Acquired Immune Deficiency Syndromes 37(3): 1404–1414.
- 39. Kahn JG, Marseille E, Auvert B (2006) Cost-effectiveness of male circumcision for HIV prevention in a South African setting. PLoS Medicine 3(12): 2349–2358.
- 40. Gray RH, Li X, Kigozi G, Serwadda D, Nalugoda F, et al. (2007) The impact of male circumcision on HIV incidence and cost per infection prevented: a stochastic simulation model from Rakai, Uganda. Aids 21(7): 845–850.
- 41. Auvert B, Marseille E, Korenromp EL, Lloyd-Smith J, Sitta R, et al. (2008) Estimating the resources needed and savings anticipated from roll-out of adult male circumcision in sub-Saharan Africa. Plos One 3(8):
- 42. Fieno JV (2008) Costing adult male circumcision in high HIV prevalence, low circumcision rate countries. Aids Care 20(5): 515–520.
- 43. Bollinger LA, Stover J, Musuka G, Fidzani B, Moeti T, et al. (2009) The cost and impact of male circumcision on HIV/AIDS in Botswana. J Int AIDS Soc 12: 7.
- 44. Cleary SM, McIntyre D, Boulle AM (2006) The cost-effectiveness of antiretroviral treatment in Khayelitsha, South Africa–a primary data analysis. Cost Eff Resour Alloc 4: 20.
- 45. Gray RH, Kiwanuka N, Quinn TC, Sewankambo NK, Serwadda D, et al. (2000) Male circumcision and HIV acquisition and transmission: cohort studies in Rakai, Uganda. Rakai Project Team. Aids 14: 2371–2381.
- 46. Galárraga O, Colchero MA, Wamai RG, Bertozzi SM (2009) HIV prevention cost-effectiveness: a systematic review. BMC Public Health 9: suppl 1s5.
- 47. Hogan DR, Baltussen R, Hayashi C, Lauer JA, Salomon JA (2005) Cost effectiveness analysis of strategies to combat HIV/AIDS in developing countries. BMJ 331: 1431–1437.
- 48. Walker D (2003) Cost and cost-effectiveness of HIV/AIDS prevention strategies in developing countries: is there an evidence base? Health Policy Plan 18: 4–17.
- 49. Kim HH, Goldstein M (2009) High complication rates challenge the implementation of male circumcision for HIV prevention in Africa. Nat Clin Pract Urol 6: 64–65.
- 50. Briggs AH, Goeree R, Blackhouse G, O'Brien BJ (2002) Probabilistic analysis of cost-effectiveness models: choosing between treatment strategies for gastroesophageal reflux disease. Med Decis Making 22: 290–308.
- 51. Doubilet P, Begg CB, Weinstein MC, Braun P, McNeil BJ (1985) Probabilistic sensitivity analysis using Monte Carlo simulation. A practical approach. Med Decis Making 5: 157–177.
- 52. Claxton K (1999) The irrelevance of inference: a decision-making approach to the stochastic evaluation of health care technologies. J Health Econ 18: 341–364.
- 53. Claxton K, Ginnelly L, Sculpher M, Philips Z, Palmer S (2004) A pilot study on the use of decision theory and value of information analysis as part of the NHS Health Technology Assessment programme. Health Technol Assess 8: 1–103, iii.
- 54. Claxton K, Sculpher M, Drummond M (2002) A rational framework for decision making by the National Institute For Clinical Excellence (NICE). Lancet 360: 711–715.
- 55. UNAIDS (2005) Resource needs for an expanded response to AIDS in low and middle income countries–“Making the money work”: The three “ones” in action. Discussion paper 9. Geneva: UNAIDS.