Figures
Abstract
Background
In Norway, women with low-grade squamous intraepithelial lesions (LSIL) are followed up after six months in order to decide whether they should undergo further follow-up or be referred back to the screening interval of three years. A high specificity and positive predictive value (PPV) of the triage test is important to avoid unnecessary diagnostic and therapeutic procedures.
Materials and Methods
At the University Hospital of North Norway, repeat cytology and the HPV mRNA test PreTect HPV-Proofer, detecting E6/E7 mRNA from HPV types 16, 18, 31, 33 and 45, are used in triage of women with ASC-US and LSIL. In this study, women with LSIL cytology in the period 2005–2008 were included (n = 522). Two triage methods were evaluated in two separate groups: repeat cytology only (n = 225) and HPV mRNA testing in addition to repeat cytology (n = 297). Histologically confirmed cervical intraepithelial neoplasia of grade 2 or worse (CIN2+) was used as the study endpoint.
Results
Of 522 women with LSIL, 207 had biopsies and 125 of them had CIN2+. The sensitivity and specificity of repeat cytology (ASC-US or worse) were 85.7% (95% confidence interval (CI): 72.1, 92.2) and 54.4 % (95% CI: 46.9, 61.9), respectively. The sensitivity and specificity of the HPV mRNA test were 94.2% (95% CI: 88.7, 99.7) and 86.0% (95% CI: 81.5, 90.5), respectively. The PPV of repeat cytology was 38.4% (95% CI: 29.9, 46.9) compared to 67.0% (95% CI: 57.7, 76.4) of the HPV mRNA test.
Citation: Sørbye SW, Arbyn M, Fismen S, Gutteberg TJ, Mortensen ES (2011) Triage of Women with Low-Grade Cervical Lesions - HPV mRNA Testing versus Repeat Cytology. PLoS ONE 6(8): e24083. https://doi.org/10.1371/journal.pone.0024083
Editor: Maria G. Masucci, Karolinska Institutet, Sweden
Received: May 26, 2011; Accepted: July 29, 2011; Published: August 30, 2011
Copyright: © 2011 Sørbye et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This research was supported by the University Hospital of North Norway (http://www.unn.no/). M. Arbyn received financial support from: (1) the European Commission (Directorate of SANCO, Luxembourg, Grand-Duchy of Luxembourg), through the ECCG project (European Cooperation on development and implementation of Cancer screening and prevention Guidelines, IARC, Lyon, France) and the 7th Framework Programme of DG Research through the PREHDICT project (grant No. 242061, coordinated by the Vrije Universiteit Amsterdam, The Netherlands); (2) the Belgian Foundation Against Cancer (Brussels, Belgium). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Infection Human Papillomavirus (HPV) is a necessary cause of cervical cancer. In Norway, the cervical cancer screening program is based on cytology. The rationale of cervical cancer cytological screening is to identify and treat high-grade cervical intraepithelial neoplasia (CIN) (precancerous lesions) in order to prevent its progression to invasive cancer. Women with high-grade intraepithelial squamous lesions (HSIL) detected at cytological screening are referred to further assessment with colposcopy and biopsy[1], [2]. Women with minor cervical lesions have a small but significantly increased risk of developing cervical cancer compared to women with normal smears. The purpose of triage is to identify women needing further follow-up by colposcopy and biopsy to detect high grade cervical dysplasia or cancer (CIN2+). In case of atypical squamous cell of undetermined significance (ASC-US), it is now widely recognized that triage with an HPV DNA test is more sensitive, but less specific than repeat cytology[3], [4]. For low-grade squamous intraepithelial lesions (LSIL) however, recommendations regarding the best triage method are conflicting and vary from repeat cytology, HPV testing or direct referral to colposcopy[5], [6]. Meta-analyses indicate that triage of LSIL with a high-risk HPV DNA test is not more sensitive and substantially less specific than repeat cytology[3], [4]. In some studies, HPV-based triage of LSIL in women older than 30–35 years has been suggested[7], [8], but other studies have not confirmed this[9], [10]. Defining the best strategy to triage LSIL lesions is therefore identified as a priority for research.
In Norway, HPV testing has been included in triage since 2005. If the cytological findings are defined as ASC-US or LSIL, women are referred to repeat cytology and HPV test after 6 months. If the repeat cytology reveals ASC-US or LSIL and the HPV test is positive, the patient is referred to colposcopy and biopsy. Women with normal Pap-smear at repeat cytology, but with a positive HPV result, are tested for HPV persistence and if positive, referred to colposcopy. Women with cytological findings defined as high grade squamous intraepithelial lesion (HSIL) or atypical squamous cell cannot exclude HSIL (ASC-H) at triage are referred to colposcopy and biopsy independent of the HPV result. The flow-chart showing the guidelines for follow-up of minor cytological lesions is presented in Sørbye et al., 2010b[11].
In the routine diagnostic practice at the University Hospital of North Norway (UNN), the HPV E6/E7 mRNA test PreTect HPV-Proofer is used in the triage of women with ASC-US or LSIL. In the current study, the accuracy of two triage methods to predict underlying or incipient CIN2+ was assessed, in women with a first result of LSIL. The first group was triaged with repeat cytology only whereas the second group was triaged with repeat cytology and HPV mRNA testing with PreTect HPV-Proofer.
Materials and Methods
Ethics Statement
The Regional Committee for Research Ethics (REK Sør-Øst C) has approved the study. Written consent from the patients for their information to be stored in the hospital database and used for research was not needed because the data were obtained and analyzed anonymously.
In the routine diagnostic practice at the University Hospital of North Norway, the HPV E6/E7 mRNA test PreTect HPV-Proofer (detecting E6/E7 mRNA from the HPV types 16, 18, 31, 33 and 45; NorChip AS, Norway) is used in the triage of women with a Pap-smear showing ASC-US or LSIL. The Department of Clinical Pathology receives cervical smears from the population of Troms and Finnmark County. Approximately 23 000 cervical smears are analysed each year. In 2005–2008, smears from 57 560 women aged 25–69 years were processed. During that period, 849 women (1.5%) had a cytological result of LSIL.
Some patients were excluded from the study population. First of all, women with previous treatment of CIN2+ were excluded (n = 41). Also, women with a previous abnormal smear were excluded (n = 209), since they are managed differently and because they are at higher risk of having a high-grade lesion compared to women with a first LSIL result. According to the national guidelines, women with LSIL should be followed up with two normal Pap-smears at least 12 months apart or alternatively, with one normal liquid based cytology (LBC) and a negative HPV-test, before returning to routine screening at an interval of three years[11]. Due to this, women with only one normal Pap-smear during follow-up (n = 23) were excluded from the study. Lastly, women with one or several abnormal Pap-smears and/or a positive HPV-test at follow-up but without biopsy were excluded (n = 54).
Considering the criteria above, 522 of 849 (61.5%) women with LSIL were included in the study. Among these 522 women, an LBC follow-up sample was taken for 297 women (56.9%), allowing for additional HPV mRNA testing. From the other 225 women (43.1%), a conventional Pap-smear was received not allowing for HPV analysis (see Figure 1 and Table 1).
In LBC, cells were extracted from the ThinPrep® 2000 (Cytyc Corporation, Marlborough, MA, USA) for cytological examination. Of the remnant liquid with cervical cells, DNA/RNA was isolated from 5 ml sample and eluted in 50 µl elution buffer and analysed with PreTect HPV-Proofer. The mRNA testing was performed according to the manufacturer's instructions (NorChip AS) and in accordance with national guidelines for HPV testing[11].
Cytological and histological diagnoses were obtained from the diagnostic database (SymPathy) at the Department of Clinical Pathology, UNN. Biopsies were evaluated by experienced pathologists and histological results were reported using CIN terminology[12]. In Norway, the threshold for treatment by conisation is CIN2. Women with benign or CIN1 histology are advised to be followed up with a new Pap-smear and HPV testing after 6–12 months. Biopsies with uncertain cellular changes are analyzed with p16(INK4a) immunostaining (CINtec® Histology, MTM, Heidelberg, Germany) in order to detect occult CIN lesions.
Outcome assessment was based on the histological result of biopsies, where CIN2+ was considered as the target disease and CIN1 and CIN0 (no CIN) were considered as absence of disease. Moreover, women with a complete negative follow-up (two consecutive negative Pap-smears or double negative LBC/mRNA HPV result) were assumed to be free of disease. The clinical sensitivity, specificity, positive predictive value (PPV) and negative predictive value (NPV) were calculated in 2×2 tables for cytology (with cut-off ASC-US+ and ASC-H+, respectively), for the HPV-test alone, and HPV-test in combinations with cytology (with cut-off ASC-US+ and ASC-H+). Pearson's Chi square was used to assesses differences in the accuracy of repeat cytology alone, HPV-testing alone and HPV-testing in combination with cytology.
The statistical computations were performed with the software R version 2.9.0 (2009-04-17), http://www.r-project.org/. P-value <0.05 was considered statistically significant.
Results
In Table 1, outcomes by triage cytology 6 months after the index LSIL diagnosis are presented for all the 522 women included. Furthermore, the PPVs for the different cytological triage results are presented.
Of the 225 women in the “repeat cytology only” group (Tables 2 and 3), 85 women were referred to biopsy; 56 women (24.9%) had CIN2+; 29 women had CIN1 or CIN0. Hundred and forty women were not referred to histology due to two normal Pap-smears 6 months apart or alternatively one normal LBC and a negative HPV result which was considered as equivalent to “no disease”. Altogether, 169 women showed a negative outcome (29 with a negative biopsy and 140 with negative follow-up with cytology and HPV testing). The accuracy for CIN2+ of triage with cytology with cut-off ASC-US+ is presented in Table 2. The estimates of sensitivity, specificity, PPV and NPV were 85.7%, 54.4%, 38.4% and 92.0%, respectively. With cut-off ASC-H+, the sensitivity was 33.9 %, the specificity 97.6%, the PPV 82.6% and the NPV 81.7% (Table 3).
Of the 297 women with HPV mRNA test (Tables 4Table 5Table 6), 122 women were referred to biopsy; 69 women (23.2%) had CIN2+; 53 women had CIN1 or CIN0. Altogether, 228 had a negative outcome (53 with a negative biopsy and 175 with negative follow-up with cytology and HPV testing). The accuracy parameters for triage with HPV mRNA only are shown in Table 4. The estimates of sensitivity, specificity, PPV and NPV were 94.2%, 86.0%, 67.0%, and 98.0%, respectively. HPV mRNA test in combination with cytology with cut-off ASC-US+ has a specificity of 47.4% and a PPV of 36.5% (Table 5). Sensitivity and NPV were not evaluated for the combination since by design they must be 100%. The HPV mRNA test in combination with cytology with cut-off ASC-H+ had sensitivity 98.6%, specificity 83.8% and PPV 64.8% (Table 6).
In total, 7 of the 522 women (1.3%) with LSIL were diagnosed with cervical cancer in the follow-up. Two were detected in the “repeat cytology only” group and five were detected in the HPV group. The five women with cervical cancer in the HPV group were all HPV mRNA positive for HPV type 16 (data not shown).
Discussion
The main cause of invasive cervical cancer is the deregulated and persistent production of HPV E6 and E7 oncoproteins[13]. Hence, HPV E6/E7 mRNA is a rational target for detecting HPV infections leading to cellular transformation. PreTect HPV-Proofer detects E6/E7 mRNA of the five main high-risk HPV types 16, 18, 31, 33, and 45. Due to the higher clinical specificity and PPV of this method compared to other HPV tests[14]–[18], this was the method of choice at our hospital when HPV testing was introduced in triage of women with minor cytological lesions in Norway.
When summarizing results from all women included in the study (Table 1), 125 of 522 women (23.9%) had CIN2+ confirmed by biopsy. Further, the PPV of ASC-US and LSIL in repeat cytology after an LSIL diagnosis was relatively low, i.e., the chance of having disease even with a 6 months persistent low-grade diagnosis was concordantly relatively low. Previously, before HPV testing was included in clinical practice, all women with persistent ASC-US/LSIL were referred to follow-up after one year. In current practice, this is still the case for women with repeated ASC-US/LSIL and a negative HPV mRNA result. Women with a positive HPV result however, are referred directly to colposcopy and biopsy[11]. A high PPV of the HPV test is therefore important in order to avoid unnecessary follow-up, both with regard to follow-up costs to the health care system and with regard to unnecessary psychological stress among patients. In addition, it is known that HPV tests identify lesions not found by cytology and thereby contribute in increasing the overall clinical sensitivity of the screening program[3], [4], [19]–[23].
It is also important to have in mind that in clinical practice, the cytological diagnosis is commonly influenced by the HPV result. We see a tendency that a preliminary diagnosis of for example normal or ASC-US is upgraded when a positive HPV mRNA result is acknowledged. As a result, the clinical sensitivity of cytology as such will be over-estimated. In order to get two groups for comparison, a study with two separate arms was conducted. One arm with repeat cytology only and one arm with both repeat cytology and HPV test. National guidelines recommend that a woman with LSIL should be followed up with repeat cytology and an HPV test. The HPV-test however is not always performed due to use of traditional Pap-smears instead of LBC, a method not allowing for HPV testing. This made it possible to get a separate arm with repeat cytology only. The HPV test result is objective and is not dependent on the cytological diagnosis. Women referred to histology based on the cytological result alone (i.e., having a negative HPV result) made it possible to calculate clinical properties also including HPV negative results.
Until 2006, only conventional Pap-smears were used. When HPV-testing was introduced, liquid based cytology was recommended, but still almost half of the samples for repeat cytology are conventional Pap-smears. This can partly be explained by the fact that doctors are not properly informed about the possibility to perform concomitant HPV-test using LBC. Thus, the physician, and not the patient, is the reason for HPV-testing not being performed. Based on the above, one limitation of the study is the absence of formal randomization, which can result in imbalanced groups. Still, one argument about comparability is the similar age and similar prevalences of CIN2+. The age was similar of the two groups with overlapping confidence intervals. In the group with repeat cytology only the average age was 36.7 years (95 % CI: 35.6, 37.8); the median age was 34 years. In the HPV group the average age was 37.8 years (95 % CI: 36.5, 39.1); the median age was 36 years. The prevalence of CIN2+ was similar in the two groups (24.9% and 23.2%, respectively).
Another limitation of the study is a relatively young study population due to the exclusion of women with previous abnormal smears or HPV tests and the population will therefore not reflect a general LSIL population.
Referral to biopsy in the HPV-category is based on both the cytology and the HPV result and therefore does not represent the true number of women referred to biopsy based on HPV testing alone. For example, women with HSIL and ASC-H are always referred to biopsy independent of the HPV result. An argument against differential intensity of verification in the repeat cytology only group and the HPV group is the similar biopsy referral rate. The referral rate for biopsy was similar in the two groups (37.8% and 41.1%, respectively).
With regard to repeat cytology, statistical parameters were calculated both at cutoff ASC-US+ and ASC-H+. The reason for this is different follow up in the two groups. Women with ASC-H+ are referred to further assessment with colposcopy and biopsy. Women with ASC-US and LSIL are followed up with cytology and HPV-test. Repeat cytology with cut-off ASC-US+ has a high sensitivity (85.7%) for CIN2+, but only a moderate specificity (54.4%). In contrast, repeat cytology with cut-off ASC-H+ has a low sensitivity (33.9%), but a high specificity (97.6%). The combination of HPV mRNA testing and cytology with cut-off ASC-H+ has both high sensitivity (98.6%) and high specificity (83.8%). For comparison, the average specificity of the Hybrid Capture 2 HPV DNA test in triage of LSIL is 28.6% (95% CI: 22.2, 35.0)[24] and generally, high HPV positivity among women with LSIL explains why HPV DNA testing is not recommended in triage of women with LSIL[9].
In the present study, the HPV mRNA test shows a specificity of 86.0 % (95% CI: 81.5, 90.5) and has previously been shown to have a low positivity rate in woman with LSIL[25]. Also, previous data on HPV mRNA testing in the triage of ASC-US and LSIL[11], [25] show that the HPV mRNA test, due to a high specificity and positive predictive value (PPV), is valuable in the triage of women with minor cytological cervical lesions as it gives important information in terms of further follow-up. In fact, when the HPV result is positive, the data suggest direct treatment for women above 40 years of age or for women with a concurrent cytological HSIL diagnosis, contributing to better clinical safety for these women[11].
In the present study, the HPV mRNA test is more sensitive and significantly more specific than repeat cytology in triage of women with LSIL cytology. In addition, the HPV mRNA test has a significantly higher PPV and NPV than cytology alone. A high Chi square indicates high accuracy for the triage test. The HPV mRNA test alone and HPV mRNA test in combination with ASC-H+ had high Chi square values. These data indicate that the HPV mRNA test is a better triage test for women with LSIL than repeat cytology. The use of HPV mRNA test can reduce the time from abnormal smear to diagnosis and treatment for CIN2+. Further studies are needed in order to reveal whether HPV mRNA testing and E6/E7 detection may replace repeat cytology in follow-up of women with cytological low-grade lesions.
Author Contributions
Conceived and designed the experiments: SWS SF TJG ESM. Performed the experiments: SWS SF TJG ESM. Analyzed the data: SWS MA SF TJG ESM. Contributed reagents/materials/analysis tools: SWS MA SF TJG ESM. Wrote the paper: SWS MA SF TJG ESM.
References
- 1. ACOG. ACOG Practice Bulletin No. 99 (2008) Management of abnormal cervical cytology and histology. Obstet Gynecol 112: 1419–1444.
- 2. Jordan J, Arbyn M, Martin-Hirsch P, Schenck U, Baldauf JJ, et al. (2008) European guidelines for quality assurance in cervical cancer screening: recommendations for clinical management of abnormal cervical cytology, part 1. Cytopathology 19: 342–354.
- 3. Arbyn M, Buntinx F, Van Ranst M, Paraskevaidis E, Martin-Hirsch P, et al. (2004) Virologic versus cytologic triage of women with equivocal Pap-smears: a meta-analysis of the accuracy to detect high-grade intraepithelial neoplasia. J Natl Cancer Inst 96: 280–293.
- 4. Arbyn M, Paraskevaidis E, Martin-Hirsch P, Prendiville W, Dillner J (2005) Clinical utility of HPV-DNA detection: triage of minor cervical lesions, follow-up of women treated for high-grade CIN: an update of pooled evidence. Gynecol Oncol 99(3): Suppl 1S7–11.
- 5. Boardman LA, Kennedy CM (2008) Management of atypical squamous cells, low-grade squamous intraepithelial lesions, and cervical intraepithelial neoplasia 1. Obstet Gynecol Clin North Am 35: 599–614.
- 6. Wright TC Jr, Massad LS, Dunton CJ, Spitzer M, Wilkinsonet EJ, et al. (2007) 2006 consensus guidelines for the management of women with abnormal cervical cancer screening tests. Am J Obstet Gynecol 197: 346–355.
- 7. Ronco G, Cuzick J, Segnan N, Brezzi S, Carozzi F, et al. (2007) HPV triage for low grade (L-SIL) cytology is appropriate for women over 35 in mass cervical cancer screening using liquid based cytology. Eur J Cancer 43: 476–480.
- 8. Thrall MJ, Smith DA, Mody DR (2010) Women >or = 30 years of age with low grade squamous intraepithelial lesion (LSIL) have low positivity rates when cotested for high-risk human Papillomavirus: should we reconsider HPV triage for LSIL in older women? Diagn Cytopathol 38: 407–412.
- 9. Arbyn M, Martin-Hirsch P, Buntinx F, Van Ranst M, Paraskevaidis E, et al. (2009) Triage of women with equivocal or low-grade cervical cytology results: a meta-analysis of the HPV test positivity rate. J Cell Mol Med 13: 648–659.
- 10. Arbyn M, Martin-Hirsch P, Buntinx F (2010) Immediate colposcopy referral in women with low-grade abnormal results on cervical cytology detects more CIN2 or worse lesions than cytological surveillance in primary care, but might lead to overtreatment. Evid Based Med 15: 13–14.
- 11. Sorbye SW, Fismen S, Gutteberg T, Mortensen ES (2010) Triage of women with minor cervical lesions: data suggesting a "test and treat" approach for HPV E6/E7 mRNA testing. PLoS One 5(9): e12724.
- 12. Richart RM (1973) Cervical intraepithelial neoplasia. Pathol Annu 8: 301–328.
- 13. zur Hausen H (2002) Papillomaviruses and cancer: from basic studies to clinical application. Nat Rev Cancer 2: 342–350.
- 14. Cattani P, Zannoni GF, Ricci C, D'Onghia S, Trivellizzi IN, et al. (2009) Clinical performance of human Papillomavirus E6 and E7 mRNA testing for high-grade lesions of the cervix. J Clin Microbiol 47: 3895–3901.
- 15. Molden T, Kraus I, Karlsen F, Skomedal H, Nygard JF et al (2005) Comparison of human Papillomavirus messenger RNA and DNA detection: a cross-sectional study of 4,136 women >30 years of age with a 2-year follow-up of high-grade squamous intraepithelial lesion. Cancer Epidemiol Biomarkers Prev 14: 367–372.
- 16. Molden T, Nygard JF, Kraus I, Karlsen F, Nygard M, et al. (2005) Predicting CIN2+ when detecting HPV mRNA and DNA by PreTect HPV-proofer and consensus PCR: A 2-year follow-up of women with ASCUS or LSIL Pap-smear. Int J Cancer 114: 973–976.
- 17. Szarewski A, Ambroisine L, Cadman L, Austin J, Ho L, et al. (2008) Comparison of predictors for high-grade cervical intraepithelial neoplasia in women with abnormal smears. Cancer Epidemiol Biomarkers Prev 17: 3033–3042.
- 18. Trope A, Sjoborg K, Eskild A, Cuschieri K, Eriksen T, et al. (2009) Performance of human Papillomavirus DNA and mRNA testing strategies for women with and without cervical neoplasia. J Clin Microbiol 47: 2458–2464.
- 19. Bjerre P, Silfverdal L, Dillner L, Hagmar B, Edvardsson H, et al. (2008) A randomized trial of basing treatment on human Papillomavirus and/or cytology results in low-grade cervical lesion triage. Am J Obstet Gynecol 199: 24–27.
- 20. Brismar-Wendel S, Froberg M, Hjerpe A, Andersson S, Johansson B (2009) Age-specific prevalence of HPV genotypes in cervical cytology samples with equivocal or low-grade lesions. Br J Cancer 101: 511–517.
- 21. Dillner L, Kemetli L, Elfgren K, Bogdanovic G, Andersson P, et al. (2011) Randomized healthservices study of human Papillomavirus-based management of low-grade cytological abnormalities. Int J Cancer 129: 151–159.
- 22. The ASCUS-LSIL Triage Study (ALTS) Group (2003) Results of a randomized trial on the management of cytology interpretations of atypical squamous cells of undetermined significance. AJOG 188: 1383–1392.
- 23. The ASCUS-LSIL Triage Study (ALTS) Group (2003) A randomized trial on the management of low-grade squamous intraepithelial lesion cytology interpretations. AJOG 188: 1393–1400.
- 24. Arbyn M, Sasieni P, Meijer CJ, Clavel C, Koliopoulos G, et al. (2006) Chapter 9: Clinical applications of HPV testing: a summary of meta-analyses. Vaccine. (24).(Suppl 3) S3-78-S3/89.
- 25. Sorbye SW, Fismen S, Gutteberg TJ, Mortensen ES (2010) HPV mRNA test in women with minor cervical lesions: experience of the University Hospital of North Norway. J Virol Methods 169: 219–222.