Improved methods for the accurate identification of both the presence and severity of cervical intraepithelial neoplasia (CIN) and extent of spread of invasive carcinomas of the cervix (IC) are needed. Differential scanning calorimetry (DSC) has recently been shown to detect specific changes in the thermal behavior of blood plasma proteins in several diseases. This methodology is being explored to provide a complementary approach for screening of cervical disease. The present study evaluated the utility of DSC in differentiating between healthy controls, increasing severity of CIN and early and advanced IC. Significant discrimination was apparent relative to the extent of disease with no clear effect of demographic factors such as age, ethnicity, smoking status and parity. Of most clinical relevance, there was strong differentiation of CIN from healthy controls and IC, and amongst patients with IC between FIGO Stage I and advanced cancer. The observed disease-specific changes in DSC profiles (thermograms) were hypothesized to reflect differential expression of disease biomarkers that subsequently bound to and affected the thermal behavior of the most abundant plasma proteins. The effect of interacting biomarkers can be inferred from the modulation of thermograms but cannot be directly identified by DSC. To investigate the nature of the proposed interactions, mass spectrometry (MS) analyses were employed. Quantitative assessment of the low molecular weight protein fragments of plasma and urine samples revealed a small list of peptides whose abundance was correlated with the extent of cervical disease, with the most striking plasma peptidome data supporting the interactome theory of peptide portioning to abundant plasma proteins. The combined DSC and MS approach in this study was successful in identifying unique biomarker signatures for cervical cancer and demonstrated the utility of DSC plasma profiles as a complementary diagnostic tool to evaluate cervical cancer health.
Citation: Garbett NC, Merchant ML, Helm CW, Jenson AB, Klein JB, et al. (2014) Detection of Cervical Cancer Biomarker Patterns in Blood Plasma and Urine by Differential Scanning Calorimetry and Mass Spectrometry. PLoS ONE 9(1): e84710. doi:10.1371/journal.pone.0084710
Editor: Jose M. Sanchez-Ruiz, Universidad de Granada, Spain
Received: August 31, 2013; Accepted: November 18, 2013; Published: January 8, 2014
Copyright: © 2014 Garbett et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This material is based on work supported by the Office of Research and Development, Medical Research Service, Department of Veterans Affairs, the Department of Energy Office of Science Financial Assistance Program (DE-FG02-05ER6406 to MLM and JBK), and the NIEHS grant P30ES014443 (to MLM and JBK). This work was also supported by a subcontract awarded to JBC from National Cancer Institute grant R44 CA103437 and by a grant to JBC from the Elsa. U. Pardee Foundation. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: NCG, ABJ and JBC are co-inventors on patent applications describing the DSC plasma thermogram technology for which Louisville Bioscience, Inc. (LBI) holds an exclusive license from the University of Louisville. JBC and ABJ are founders and shareholders of LBI; NCG is a founder, shareholder and employee of LBI. This does not alter the authors’ adherence to all PLOS ONE policies on sharing data and materials.
Invasive carcinoma of the uterine cervix (IC) is the third most common cancer affecting women with an estimated 529,000 cases diagnosed worldwide in 2008 and 274,000 deaths . In recent decades routine screening has helped to significantly reduce both the incidence and deaths from IC in the USA but, nevertheless, an estimated 12,340 new cases will be diagnosed with 4,030 deaths in 2013 . Invasive cervical cancer is preceded by a precancerous condition, cervical intraepithelial neoplasia (CIN), in which abnormal cell growth occurs in the epithelial lining of the cervix. CIN is divided into grades (1 = mild, 2 = moderate, 3 = severe) based on histologic features including nuclear changes and the extent of involvement of the epithelium. The risk for progression of CIN to IC over time rises by grade, being highest for CIN 3 , . CIN can be treated to greatly reduce the chance of IC developing. Partly to help with treatment planning, CIN 2 and CIN 3 are commonly grouped together as high-grade squamous intraepithelial lesion (HSIL) which would be treated and CIN 1 and HPV condyloma as low-grade squamous intraepithelial lesion (LSIL) which would be untreated. Once IC is detected the principal need is to determine whether there is early stage disease (FIGO Stage I) which is confined to the cervix or if there is more advanced metastatic disease. Only disease confined to the cervix and of sufficiently small size is considered treatable with surgery.
Reliable methods to accurately detect CIN and IC are critical. Current screening cannot differentiate low-grade from higher grade CIN, CIN from IC, early from more advanced stages of IC, or determine additional disease status indicators such as the presence of nodal involvement. For many years the initial screening method for CIN has been the Pap smear test which enables cytologic abnormalities to be detected on scrapings from the cervix. Women with Pap smears suggesting squamous intraepithelial lesions would then be evaluated, including by clinical examination and colposcopy and biopsy, to determine the grade and extent of any CIN present and to exclude (or diagnose) the presence of IC. Pap smear screening is now being integrated with testing for high-risk genotypes of human papilloma virus (HPV HR) which can be detected in the same cytologic Pap smear sample using liquid-based Hybrid Capture II technology . All grades of CIN are associated with a high likelihood of the presence of HPV HR. In women between 30 and 65 years HPV HR testing improves the detection rate of CIN 3 or greater by 17–31% in the first round of screening and reduces the incidence of IC in the second round of screening , , , . HPV HR testing is now also being integrated into the follow-up of women who have previously been shown to have HPV HR infection or CIN, since persistent HPV HR infection is associated with an increased risk for the development of recurrent CIN and IC , . Although testing for HPV HR can improve the detection of CIN it cannot differentiate between CIN lesions having a higher likelihood of progressing from those that do not. Biomarkers have been investigated in this regard but have not yet proven useful , , , . Work-up and treatment for women with abnormal Pap smears is traumatic physically, emotionally and financially and, unfortunately, because of the inability to differentiate CIN lesions having a higher likelihood of progression to IC many women still get over treated.
Here we describe the application of a combined approach using differential scanning calorimetry (DSC) and mass spectrometry (MS) for the characterization of cervical disease. DSC is commonly used to measure the denaturation profiles of biomolecules, known as thermograms, by directly monitoring the heat changes associated with molecular events as a function of temperature. Under given solution conditions, a thermogram provides a unique signature for a given protein reflecting specific structural motifs and molecular forces. It has recently been shown that DSC can be applied to the analysis of blood plasma to provide an indication of an individual’s clinical status , , , , , , , , , . The thermogram of plasma from healthy individuals reflected the weighted sum of the denaturation profiles of the most abundant plasma proteins; however, thermograms from individuals with various conditions or diseases were significantly changed , , , . Thermogram changes appeared to be sensitive to the particular disease state and indicated that plasma DSC might have utility as a clinical diagnostic screening method. Mechanisms for disease-specific changes in thermograms are currently under investigation in our laboratory but we hypothesize that they reflect the presence of disease biomarkers that modify or interact with plasma proteins thereby affecting their denaturation properties. Such biomarker interactions would support the “interactome” concept that proposes that low molecular weight peptides present in the plasma proteome are complexed with more abundant plasma proteins creating a network of protein-protein and peptide-protein interactions . Although the presence of putative low molecular weight biomarkers can be inferred through changes in the thermogram no direct identification can be made by this method. We have applied a MS peptidomic approach to investigate the nature of plasma thermogram profiles associated with cervical disease.
MS has been used as a tool to aid in the understanding of disease pathogenesis and the generation of candidate biomarkers of disease , , , , , , . One application of MS has been the quantitative and qualitative analysis of low molecular weight protein fragments found in plasma and/or urine, referred to as a peptidomic approach , with the goal to correlate abundance with detection or prognosis of disease. The peptides observed in these studies are reflective of the metabolic turnover of the parent proteins with abundance changes between case (disease) and control conditions related to an alteration(s) to the protein’s normal catabolic or anabolic metabolic half-life. These peptidomic studies have in some cases successfully demonstrated correlations between amounts or patterns of several peptides with the disease or the disease progression. With respect to cervical disease, the metastatic potential of CIN has been correlated to the expression of three proteins including matrix metalloproteinase-2 (MMP-2), MMP-9, and urokinase-type plasminogen activator . Because of the primary involvement of peptide generating metalloproteinases in the disease progression, this correlation of CIN could be extended to the peptidomic phenotype. As such, the presence of unique plasma and/or urinary peptide profile(s) could be established by MS approaches and be correlated with thermogram profiles reflecting the presence and extent of cervical disease. We describe results demonstrating sensitivity of DSC thermograms to clinical status and evidence for the association of thermogram profiles with interacting peptide biomarkers identified by MS.
Materials and Methods
The study protocol and patient consent procedures were approved by the University of Louisville Institutional Review Board (IRB# 08.0108, 608.03). Women attending the clinics of the Division of Gynecologic Oncology with biopsy-proven cervical intra-epithelial neoplasia and invasive cervical carcinoma were eligible and gave written informed consent for their blood and tissues to be entered into a tissue repository (IRB# 608.03) and utilized for research purposes. The IRB specifically approved the use of tissues from the tissue repository for use in this study without the need for further consent (IRB# 08.0108). Women known to be HIV positive were ineligible. Blood and spot urine samples were collected from recruited patients during their initial clinic visit at the time of evaluation and before receiving therapy. Urine samples were aliquoted and immediately stored at −80°C until analysis. Blood was drawn into 5 mL purple top (plasma; K2-EDTA anticoagulant) vacutainers. Tubes were gently mixed by inversion 8–10 times immediately after blood collection to evenly distribute the anticoagulant additive followed by centrifugation at 3200 rpm for 10 minutes (BD-Clay Adams Compact II centrifuge). Separated plasma was carefully aspirated to avoid hemolysis or contamination of the separated blood phases, aliquoted and immediately stored at −80°C until analysis. Control blood and urine specimens were collected under the same study procedures from healthy volunteers with no history of abnormal Pap smears or cancer. As above, the study protocol and consent procedures were approved by the University of Louisville Institutional Review Board (IRB# 08.0108, 608.03). All volunteers gave written, informed consent for their blood and tissues to be entered into a tissue repository (IRB# 608.03) and utilized for research purposes. The IRB specifically approved the use of tissues from the tissue repository (IRB# 608.03) for use in this study without the need for further consent (IRB# 08.0108). Specimen aliquots were thawed for analysis and the remainder discarded. All handling of specimens and specimen waste was in accordance with OSHA bloodborne pathogen procedures. All specimens collected for the study were deidentified and stored in the Gynecologic Oncology Tissue Bank at the James Graham Brown Cancer Center. Associated demographic and clinical information was collected by clinical study personnel and securely stored on the study computer. The tissue bank was approved by the University of Louisville Institutional Review Board (IRB# 608.03) and was fully HIPAA compliant. Specimens provided to basic science study personnel (NCG, MLM, ABJ, JBK, JBC) for DSC and MS studies were coded by tissue bank collection number. In this form specimens were deidentified and blinded for both demographic and pathologic disease status for unbiased data collection. Demographic and disease status was subsequently provided for data sorting and interpretation.
Sample preparation for DSC studies.
Plasma samples (100 µL) were dialyzed against a standard phosphate buffer (1.7 mM KH2PO4, 8.3 mM K2HPO4, 150 mM NaCl, 15 mM sodium citrate, pH 7.5) for 24 hours at 4°C in order to achieve normalization of buffer conditions for all samples. Frozen plasma samples were thawed overnight at 4°C the day before dialysis. On the morning of dialysis, samples were loaded into Slide-A-Lyzer mini dialysis units (MWCO 3,500; Pierce, Rockford, IL) that had been equilibrated against dialysis buffer overnight. Based on cost and reliability we routinely re-assembled washed dialysis units replacing the original dialysis membrane with cut-to-size Snakeskin Pleated Dialysis Tubing (Pierce, Rockford, IL). Samples were dialyzed against 1 L of phosphate buffer with buffer changes after three hours of dialysis, then after two periods of four hours with a final overnight dialysis period. Samples were recovered from dialysis and filtered to remove particulates using a Spin-X centrifuge tube filter (0.45 µm cellulose acetate; Corning Incorporated, Corning, NY). The final dialysis buffer was also filtered (0.2 µm polyethersulfone; Pall Corporation, Ann Arbor, MI) and used for all sample dilutions and as a reference solution for DSC studies.
DSC data were collected with a MicroCal VP-Capillary DSC instrument with integrated autosampler (MicroCal, LLC, Northampton, MA, now part of GE Healthcare). Electrical calibration of the differential power signal and temperature calibration using hydrocarbon temperature standards were performed as part of the manufacturer annual instrument maintenance. Manufacturer performance specifications for the temperature standards are ±0.2°C. Interim instrument performance was assessed using biological standards lysozyme and RNaseA. Manufacturer performance specifications for biological standards are ±0.5°C. Dialyzed plasma samples were diluted 25-fold to obtain a suitable protein concentration for DSC analysis. Samples and dialysate were transferred to 96-well plates and then loaded into the instrument autosampler thermostated at 5°C until analysis. Sample volumes of 400 µL were required to provide sufficient volume for loading of the instrument capillary and ensure proper filling of the 135 µL thermal sensing area. DSC scans were recorded from 20°C to 110°C at a scan rate of 1°C/min with a pre-scan thermostat of 15 minutes, mid feedback mode and a filtering period of 2 seconds. Duplicate DSC scans were obtained for each plasma sample. For each experiment set, we batched samples to ensure the analysis was completed within a seven day window after initial thawing of samples. In developing our experimental procedure we have carefully evaluated sample and buffer scans as a function of run sequence, instrument chamber rinsing and cleaning protocol, and time since preparation. We have examined buffer scans collected at the beginning and end of a sample set and after single or consecutive sample scans and determined acceptable reproducibility and effective cleaning of instrument chambers. We have compared duplicate sample scans collected after a buffer or sample scan and found it is possible to collect consecutive sample scans after extensive rinsing of the instrument chambers with no effect on thermogram profile. We routinely compared duplicate sample scans collected under different run sequences and at different time points to ensure the thermogram profile was reproducible.
DSC data were analyzed using Origin 7 (OriginLab Corporation, Northampton, MA). Raw DSC data were corrected for the instrumental baseline by subtraction of a suitable buffer reference scan. Corrected scans were normalized for the total protein concentration which was determined colorimetrically using the bicinchoninic acid protein assay kit and microplate procedure from Pierce (Pierce, Rockford, IL), with minor modifications to the manufacturer’s protocol. Absorbance readings were taken using a Tecan Sunrise microplate absorbance reader (Tecan U.S., Research Triangle Park, NC). Following normalization, plasma DSC scans were corrected for non-zero baselines by application of a linear baseline fit. Choice of an appropriate sample baseline correction is complicated by the presence of a limited region of post-transition baseline followed by aggregation and precipitation events occurring after the thermal denaturation envelope. We have evaluated all available baseline correction options within the analysis software and found the linear baseline option to give the most consistent results when tested on repeated measurements, different samples and by independent user determinations. We accept that our approach might have limitations but have selected the most consistent baseline correction method that can be applied across all of our studies. Final thermograms were plotted as excess specific heat capacity (cal/°C.g) versus temperature (°C).
Statistical analysis of DSC data.
Examination of all thermogram data revealed that the temperature range 45–90°C spanned the complete denaturation profile for all samples and scans were truncated to this range for all subsequent analyses. Quantitative comparison of thermograms was achieved through calculation of a number of shape and feature metrics. Parameters considered were total peak area; peak height; peak width at half height; temperature of the peak maximum (Tmax); heat capacity of the primary transition in the range 60–65°C [Cpex (Peak 1)]; heat capacity of the secondary transition at 68–72°C [Cpex (Peak 2)]; ratio of the first and second transition amplitudes [Cpex (Peak 1)]/[Cpex (Peak 2)]. Because of the complexity of thermogram shapes, an additional parameter was calculated to provide a measure of the distribution of the area of the denaturation profile relative to the temperature axis. The first moment temperature (TFM) was determined according to equation 1:(1)
Thermograms were grouped by pathologic disease status into five groups: healthy controls, LSIL (CIN 1), HSIL (CIN 2, CIN 3), early stage IC (Stage I) and advanced IC (Stage II-IV). Mean thermograms with standard deviations were determined for each study group.
Differences in thermogram shape and feature metrics were assessed by non-parametric methods. First, box charts were used to compare differences in the distributions between each study group. Box charts were constructed with the following form: the bottom and top of the box represented the 25th and 75th percentile, respectively, and the 50th percentile was represented by the band in the middle of the box. The bottom and top ends of the whiskers denoted the 5th and 95th percentiles, respectively. Horizontal lines indicated the minimum and maximum of all the data and the crosses represented the 1st and 99th percentiles. The mean was denoted by an open square. Differences in thermogram metrics for each clinical group were tested for significance using the non-parametric Mann-Whitney U test for unequal medians .
Experimental design of MS studies.
The order of sample handling and analysis (sample number, order of sample preparation, lyophilization, MALDI-TOF plate spotting, and TOF data acquisition) was randomized to minimize systematic variability during data acquisition. Samples were processed to isolate free peptides (Fraction 1 or FX1), isolate peptides that were bound to total plasma proteins (Fraction 2 or FX2), isolate peptides released during the immunodepletion of albumin and IgG from plasma (Fraction 3 or FX3), and isolate peptides selectively bound to the highly abundant proteins, albumin and IgG (Fraction 4 or FX4). Samples were spotted in triplicate, MALDI-TOF MS data acquired and signal averaged across the three spots. Analysis of averaged data for differentially abundant peptides was conducted using principal component analysis (PCA) and Student’s t-test, followed by manual review of ion intensities for selected peptides. Manual review was performed to ensure that peptides were not excluded as a result of incorrect baseline normalization or baseline subtraction.
Samples were thawed once to aliquot into 100 µL volumes for storage at −80°C and once for sample preparation for peptide quantification. Samples were analyzed using two separate aliquots and individual aliquots were analyzed in triplicate. Plasma samples were depleted of albumin and IgG using commercially available affinity spin columns (Sartorius N.A. Inc, Edgewood, NY) according to the manufacturer’s guidelines. Peptides not bound to plasma proteins were isolated using a modification of the precipitation method of Chertov et al . Peptides bound to albumin and IgG were recovered from the albumin/IgG affinity resin by acid stripping with 10% acetic acid. Peptides bound to plasma proteins were recovered from the organic solvent-coagulated proteins by salt or acid ionization. Recovered peptide solutions were lyophilized and resuspended in 0.1% trifluoroacetic acid (TFA) prior to MALDI-TOF MS analysis. Spot urine samples were thawed from −80°C on ice. Urine samples were spun at 1,500×g for 15 minutes at 4°C to pellet cell debris and particulate matter. Urine peptides were isolated using Amicon Ultra-4 (10,000 NMWCO) (Millipore, Billerica, MA) as previously described .
MS analysis of isolated plasma and urine peptides.
All samples were desalted and concentrated for MALDI-TOF MS analysis using C18 ZipTips (Millipore, Billerica, MA). Peptides were eluted from the C18 resin using sample matrix, 5 mg/mL 4-hydroxy-α-cyanocinnamic acid (α-CN), and directly spotted in triplicate onto the MALDI plate. Positive ion MALDI-TOF mass spectra were acquired as described . Peptides selected for further studies were analyzed using the AB4700 in TOF/TOF mode and interpretation of fragmentation data using Mascot (Matrix Science, Boston, MA) ver1.9 as described previously .
Statistical analysis of MS data.
Data files (.t2d) were exported from the AB4700 Proteomics Analyzer and imported into MarkerView software. This software can find spectral peaks by user defined mass tolerance limits or bin spectra via user defined bin sizes. In addition, the user may define minimum and maximum signal responses, which assists in dealing with high-dimensional mass spectral data sets. Data were analyzed using data binning, which allowed for baseline subtraction. Peptide expression data were first examined using PCA. Following data import, the data were preprocessed using no-weighting and either mean-centered or Pareto data scaling prior to PCA. PCA is a method of exploratory data analysis that reduces the complexity of data, while retaining their variability, by transforming the data into a new group of variables, referred to as the principal components. PCA was used to obtain an unbiased assessment of whether or not the MALDI-TOF MS peptide expression data self-sorted into groups corresponding to patients with CIN, cervical cancer and healthy controls without CIN/cervical cancer. Differential peptide and protein expression was compared by unpaired, two-tailed Student’s t-test using aligned MALDI spectra and the averaged peak cluster area for individual peptides. A p-value of <0.05 was considered significant. Differentially expressed peptides were selected for tandem MS analysis using the AB4700 Proteomics Analyzer.
Plasma specimens from 67 women attending the Division of Gynecologic Oncology clinic and 4 healthy volunteers were collected for DSC analysis. The breakdown of specimen numbers was as follows: control = 4, CIN 1 = 3, CIN 2 = 4, CIN 2–3 = 3; CIN 3 = 22, IC = 35 (FIGO Stage I = 14, II = 10, IIIb = 7, IV = 4); age range = 18–69 years (mean 38.7 years) (Table S1). Complete demographic and clinical information, including biopsy-proven CIN and IC status, was collated for all specimens by members of the clinical study team. Samples provided to the basic science study team were deidentified and devoid of all demographic and clinical information. DSC analysis of plasma samples yielded normalized, baseline-corrected duplicate thermograms for each sample. At this stage, clinical and demographic information was provided to the basic science team for subsequent analyses.
We have previously shown that the thermogram of plasma obtained from healthy individuals is representative of the thermal denaturation of the most abundant plasma proteins weighted according to their average normal plasma concentrations . For the current study, thermograms of plasma obtained from healthy volunteers were averaged to obtain a study-specific ‘healthy control’ profile which accounts for the specific collection and handling protocols employed in the current study. By way of comparison, the previously published mean thermogram was obtained from 15 healthy individuals: 9 males and 6 females (11 African American and 4 Caucasian) ranging in age from 22 to 50 years (mean 37.0 years). The mean thermogram has an area of 5.02±0.23 cal/g and a first moment temperature (TFM) of 67.4±0.8°C. The study-specific ‘healthy control’ profile obtained from 4 Caucasian females with a similar age range to the previous study (25–50 years; mean 39.3 years) compares well with similar area (4.94±0.19 cal/g) and TFM (66.3±0.3°C) values.
Thermograms were averaged within five clinical groups: control, LSIL, HSIL, Stage I and Stage II-IV. The mean thermograms are distinct from each other and show a progressive change in profile shape (Figure 1A). The main transition in the range 60–65°C becomes progressively lower with an increase in amplitude of the second transition around 70°C. Each clinical group was examined for the effect of patient demographic factors, specifically age, ethnicity, smoking status and parity with no significant effect found on the mean thermograms. The variance associated with each group profile was examined through calculation of standard deviations at each temperature and construction of a plot of standard deviation of heat capacity as a function of temperature (Figure 1B). The healthy control group shows the smallest variance over the entire temperature range. The other clinical groups show higher variance associated primarily with the major transition ~65°C as well as the second transition ~70°C and its higher temperature shoulders. The observed thermogram variance is similar to our previous observations  and reflects both expected clinical variation in plasma protein levels as well as disease associated protein modifications.
Figure 1. Thermogram profiles associated with progressive cervical disease.
Mean thermogram profiles of excess specific heat capacity (Cpex) versus temperature (Panel A) and standard deviation (Panel B) of each clinical group: controls (black); LSIL (red); HSIL (green); early stage IC [FIGO Stage I] (blue); and advanced IC [FIGO Stage II-IV] (cyan). Thermograms show a progressive shift towards higher denaturation temperatures with increasing disease burden. Difference plots of clinical group thermograms compared to the control group (Panel C) show negative difference peaks ~62°C and increasing shift and magnitude of higher temperature positive difference peaks. These are hypothesized to reflect the interaction of disease specific components with abundant plasma proteins, principally albumin, with resultant thermal stabilization and alteration of plasma thermogram profiles.doi:10.1371/journal.pone.0084710.g001
Changes in thermogram profiles associated with disease burden were examined through DSC difference plots which reflect changes in group thermograms relative to the healthy control group (Figure 1C). For each CIN grade or IC stage, there was a negative difference peak centered ~62°C with higher temperature positive difference peaks. The positive difference peaks shifted to higher temperature and increased in magnitude with increased disease burden. The LSIL group does not follow this trend in positive difference peaks; this could reflect poor definition of this clinical group given the low sample numbers (n = 3) available for evaluation. While these changes in thermogram profile remain under investigation in our laboratory they suggest the thermal stabilization of plasma protein(s) with a denaturation profile appearing ~62°C. Our previous studies on healthy control samples have shown this thermogram region to be dominated by albumin denaturation and suggest thermal stabilization of albumin in the disease state . This observation could be consistent with stabilizing modifications or interactions with disease components and would be supportive of the interactome hypothesis.
To provide a more quantitative assessment of the observed changes in thermogram with cervical disease status, a comparison was made of the key thermogram parameters (Table 1 and Figure 2). Thermogram profiles are sensitive to changes in solution composition and the stability of components which can be affected by modifications and interactions. As such, the correlation of thermogram profile and their descriptive parameters with clinical status could provide surrogate indicators of disease-associated changes of the plasma proteome. In this vein, we examined thermogram parameters for each clinical group to assess their value as serological disease indicators. Table 1 and Figure 2 show that there is a range of parameter values associated with each clinical group. There is clearly some overlap between groups but clear trends of parameter values are correlated with disease burden. As discussed earlier, the LSIL group is poorly defined by low sample numbers. This group shows significant variation in thermogram parameters and does not follow the general trends exhibited by the other cervical disease groups.
Figure 2. Box charts showing thermogram shape and feature parameters for each clinical group.
Trends in thermogram parameters are observed with increasing disease burden from healthy controls (black); LSIL (red); HSIL (green); early stage IC [FIGO Stage I] (blue); and advanced IC [FIGO Stage II-IV] (cyan). Increased width with concomitant decreased height reflects the change in profile shape with disease progression seen in Figure 1A. TFM, the first moment temperature corresponding to the geometric center of the thermogram, provided a measure of this shape redistribution. TFM proved superior to Tmax, the temperature of the peak maximum, as a discriminatory metric for advanced IC where large distribution of Tmax values was correlated with significant variability in the heights of the major profile peaks. Profile width and the ratio of the major transition amplitudes, Cpex (Peak 1) and Cpex (Peak 2), provided the best metrics for discrimination of clinical status. Summary of statistical analyses of these parameters is shown by Tables 1 and 2. In each box chart the median value is indicated by the horizontal line within the box while the 25th and 75th percentiles are indicated by the lower and upper box edge, respectively. The mean value is indicated by the square within the box. The upper and lower “whiskers” define the 95th and 5th percentiles, respectively. The 99th and 1st percentiles are shown by the crossed symbols and the horizontal lines denoted the minimum and maximum of the data set.doi:10.1371/journal.pone.0084710.g002
Table 1. Thermogram shape and feature parameters for each clinical group.doi:10.1371/journal.pone.0084710.t001
All eight thermogram parameters showed distinct differences across all disease groups compared with the control group. Thermogram area decreased for all disease groups compared with the control group but showed only small deviations across disease groups. Opposite trends in width and height were observed where width increased concomitant with decreased height associated with disease progression. This width-height compensation with little change in area reflected the redistribution of thermogram area with disease status shown by Figure 1A. TFM, the temperature corresponding to the geometric center of the thermogram, provided a measure of the changing distribution of thermogram shape and showed a general increase with disease progression. A wide distribution of Tmax values was observed for advanced disease groups (Stage II-IV) resulting from variability in the amplitudes of the major transitions. The amplitude of the main transition [Cpex (Peak 1)] decreased with disease burden while that of the second transition [Cpex (Peak 2)] increased. The ratio of these transitions presented the clearest distinction between disease groups. Differences in thermogram parameter values were tested for statistical significance using the nonparametric Mann-Whitney U test for unequal medians and are summarized in Table 2. Overall, the control group profile was clearly distinct from all disease groups. LSIL did not exhibit statistically significant distinction from the other groups except for the most advanced IC for select thermogram parameters. Again, this might be because of the limited definition of this clinical group. HSIL groups could be distinguished from IC across most thermogram parameters and early stage (Stage I) could also be distinguished from advanced IC (Stage II-IV) by some parameters. Certain thermogram parameters did not display significant sensitivity to clinical status, namely, area and Tmax. TFM was a modestly significant discriminator. The best discrimination was given by profile width and the ratio of the heights of the main and second transitions. Overall profile height was not a good discriminator but heights of the major transitions, and specifically their ratio, provided a good metric for clinical discrimination.
Table 2. Statistical comparison of differences in thermogram parameters between clinical groups.doi:10.1371/journal.pone.0084710.t002
A subset of patient samples analyzed by DSC was selected for MS analysis. Both urine and plasma peptide samples from three groups of patients (four control samples; four CIN 2 samples; four cervical cancer samples) were analyzed using MALDI-TOF MS and computer-assisted methods to compare MS feature data. More peptides were detected collectively within the 12 urine samples (nurine = 240) than found in the collective serum peptide panels (nFX1 = 87; nFX2 = 49; nFX3 = 75; nFX4 = 23). As shown in Figures 3, 4 and S1–3, the peptide expression data self-sorted, suggesting differences in peptide expression between patients with CIN, cervical cancer and patients without CIN 2/cervical cancer (control samples). The discriminate PCA (dPCA or DA) of the urine peptidome and the plasma samples identified the strongest principal components sufficient to sort sample MS data into groups (Figures 3, 4 and S1–3). A total of 15 peptides were differentially abundant at p-values ≤0.05 (Table 3). Using MALDI-TOF/TOF MS methods partial amino acid sequence information was obtained for seven peptides including four peptide fragments of kininogen, two peptide fragments of collagen I-alpha-I and one peptide fragment of collagen XVII-alpha-I. Three kininogen fragments of the light chain of high molecular weight kininogen were present in greater amounts in the FX2 (interactome) fraction of control plasma samples. The largest of these peptides has a sequence of R.KHNLGHGHKHERDQGHGHQ.R. The second and third peptides represent N-terminal shortened peptides of sequences: K.HNLGHGHKHERDQGHGHQ.R and H.NLGHGHKHERDQGHGHQ.R. One kininogen peptide, des-Arg9-bradykinin (K.RPPGFSPF.R), was absent in the FX3 fraction of control plasma samples and was equal abundance in the FX3 fractions of cervical cancer and CIN 2 samples. Two collagen 1-alpha-1 fragments (P.GP(OH)P(OH)GPPGPP(OH)GLGG.N and A.GQDGRP(OH)GPP(OH)GPP(OH)G.A) were differentially presenting in the urine increased in CIN 2 over cervical cancer and control samples. One collagen XVII-alpha-1 peptide (E.GLPGPP(OH)GPP(OH)GSFLSN.S) was increased in the urine of CIN 2 patients over cervical cancer patients and absent from control samples.
Figure 3. Discriminate principal components analysis (dPCA) of MALDI-TOF MS peptidomic data.
MALDI-TOF MS spectra were aligned and binned using Markerview software version 1.2 (Applied Biosystems, Framingham, MA) and analyzed using discriminant Principal Component Analysis (dPCA). The top two principal components from the dPCA analysis of MALDI-TOF MS data for free urine peptides sort cervical cancer (asterisks), CIN 2 (triangles) and control cervix (circles) urine samples into discriminate groups.doi:10.1371/journal.pone.0084710.g003
Figure 4. Discriminate principal components analysis (dPCA) of MALDI-TOF MS peptidomic data.
MALDI-TOF MS spectra were aligned and binned using Markerview software version 1.2 (Applied Biosystems, Framingham, MA) and analyzed using discriminant Principal Component Analysis (dPCA). The top two principal components from the dPCA analysis of MALDI-TOF MS data for peptides released following precipitation of plasma proteins by addition of acetonitrile/acetic acid. (FX2; Fraction 2) sort cervical cancer (asterisks), CIN 2 (triangles) and control cervix (circles) plasma samples into discriminate groups.doi:10.1371/journal.pone.0084710.g004
This study provided support for the utility of DSC and MS approaches in characterizing cervical disease. Using DSC methodology we have demonstrated distinct thermogram profiles that not only differentiated healthy control subjects from precancerous CIN and IC but also showed a clear distinction between HSIL from both controls and IC and FIGO Stage I IC from more advanced IC (Stage II–IV). The DSC method has value in determining which CIN lesions require treatment and in determining the stage of disease once progression to invasive cancer has taken place. MS analyses identified differentially abundant peptides in both plasma and urine correlated with clinical status. As such, these peptides could serve as surrogate biomarkers of cervical disease.
The pivotal distinction in the management of patients with CIN is between HSIL and LSIL. Accurate identification of HSIL, which carries a higher risk of progression, enables a patient to receive appropriate ablative or excisional surgery whereas those with LSIL can be followed without treatment. Treatment options for IC are dependent on establishing the stage of disease with the important need to determine if the disease is confined to the cervix or has spread locally or regionally. Disease which is confined to the cervix, particularly if 4 cm or less, may be treated with radical surgery, whereas locally advanced disease and greater is treated with chemoradiation. This study examined the utility of DSC in accurately determining cervical disease at the time of patient presentation which could then be used to guide subsequent treatment. DSC thermograms exhibited clear distinction of local disease (FIGO Stage I) from disseminated advanced disease (FIGO Stage II–IV). One downside of our study was the limited availability of CIN 1 (LSIL) clinical specimens and the thermogram for this study group needs further refinement. In addition, CIN 2 (n = 4) and CIN 2–3 (n = 3) had lower representation compared with CIN 3 (n = 22). Thermograms for CIN 2 and CIN 3 were similar in appearance and were grouped together to yield a thermogram for HSIL, an important clinical intervention point. The HSIL thermogram was clearly distinct from both controls and IC suggesting that within the representative sample population included in this study, DSC has potential utility for the identification of HSIL. In order to determine the sensitivity of DSC to discriminate LSIL from HSIL a future study is needed with increased numbers of CIN patient samples representing all grades of CIN.
This study has provided a preliminary demonstration of the diagnostic utility of DSC thermograms in the cervical disease setting. Clear trends in thermogram features are observed between study groups which provide support for the sensitivity of thermograms to disease processes. Differences in sample numbers between groups was not ideal but was dictated by clinical operations. Importantly, the same trends in thermogram parameters were maintained when considering each group as a whole or identical numbers of samples within each group. More work is needed to understand the significance of thermogram profile differences both within and between demographic and clinical groups and this is an area of active investigation in our laboratory. We have observed the sensitivity of thermograms to demographic factors, such as gender and race (unpublished data). Within the current study, the control group displayed the lowest standard deviation of all groups despite have one of the lowest sample numbers (n = 4). This was unrelated to any difference in sample collection protocol which was the same for all control and clinical groups. Demographic variation within the control group was lower than within the clinical groups and this might have contributed to the lower standard deviation. Further, greater variation might be expected within the clinical groups reflective of differences in disease processes or treatment regimens. The development of standardized clinical and analytical procedures and control reference groups for DSC analysis are areas of ongoing work in our laboratory which would enhance the clinical application of DSC.
The basis of the observed changes in thermograms for each clinical group suggests disease specific modulation in the denaturation behavior of the most abundant plasma proteins. We hypothesize that this results from their disease modification or interaction with disease components. One manifestation of this hypothesis is that thermogram changes arise from the interaction of low molecular weight peptides resulting from molecular disease processes. To address these effects, thermogram changes were examined through difference plots for each study group. These showed the shift of denaturating specie(s) centered ~62°C to higher denaturation temperatures. We have shown previously  that the denaturation peak ~62°C in healthy control samples is dominated by albumin. The changes seen in the difference plots may be consistent with the thermal stabilization of albumin through interaction or modification by disease components which result in the shift of the albumin transition from the unligated temperature of 62°C to higher temperatures. With greater disease progression, increased shifting and magnitude of the positive difference peaks suggest a greater extent of interactions with albumin. The suggestion of disease specific interactions with components of the plasma proteome, that manifests as changes in plasma thermograms, are supportive of the interactome hypothesis but provide no direct evidence. To further investigate the nature of these proposed interactions and provide more direct evidence of the interactome hypothesis, MS peptidomic analyses were employed on a subset of the study samples used for DSC analysis.
MALDI-TOF MS based peptidomic analyses of serum, plasma and urine has previously been demonstrated to have the potential to generate surrogate biomarkers of disease complications  and progression of cancer , , , , . This study identified a small list of peptides whose abundance was associated with a disease condition. We present here novel data for plasma and urine peptides as surrogate biomarkers of cervical cancer and CIN 2. In these studies urinary collagen I-alpha-I fragments are increased in CIN 2 over cervical cancer over control samples. Additionally a collagen XVII-alpha-I fragment that is increased in CIN 2 over cervical cancer samples is also absent in control samples. The most striking plasma peptidome data supports the interactome theory of peptide portioning to abundant plasma proteins. Here three kininogen light chain fragments proximal to the C-terminus of bradykinin were detected more frequently and in larger amounts in peptides stripped from plasma proteins of control samples. Two of these kininogen peptides (R.KHNLGHGHKHERDQGHGHQ.R and K.HNLGHGHKHERDQGHGHQ.R) have previously been associated with urinary peptidome signatures of prostate and bladder cancer . It is unclear if these reports are correlative to our observation of increased kininogen in plasma.
Taken together, the MS and DSC data support the notion of the differential expression of disease-specific peptides associated with cervical cancer which are observed as changes in plasma thermograms. Although the basis of these changes is open to further investigation, their observation by DSC offers immediate utility in terms of disease detection and monitoring as a complementary approach to existing cervical cancer diagnostic tools. In particular, “spiking” experiments in which the effects of addition of the isolated peptides identified by MS on the thermograms of normal plasma would be a clear extension of this work but is beyond the scope of the current investigation. Regardless of their origin, the thermogram parameters described provide important measures of the statistical significance of differences between disease profiles. DSC and MS offer unique contributions as diagnostic tools. While MS can identify specific peptide biomarkers in plasma, doing so is laborious and time consuming. The advantage of DSC is that it provides, comparatively quickly, a signature thermogram indicative of a disease state. While this signature may lack the fine detail that MS provides, all indications are that the changes in thermograms arise from interactions of the biomarkers with abundant plasma proteins that are sought by MS. MS and DSC are based on different fundamental properties (charge and shape versus thermal stability) and reveal the presence of biomarkers in different ways that are mutually complementary. Thermogram profiles and associated feature parameters could have utility as clinical metrics, in much the same way as current serological analytes, and could provide important complementary measurement of health status and to guide therapeutic assessment.
Discriminate principal components analysis (dPCA) of MALDI-TOF MS peptidomic data. MALDI-TOF MS spectra were aligned and binned using Markerview software version 1.2 (Applied Biosystems, Framingham, MA) and analyzed using discriminant Principal Component Analysis (dPCA). The top two principal components from the dPCA analysis of MALDI-TOF MS data for free plasma peptides (Fraction 1 or FX1) sort cervical cancer (asterisks), CIN 2 (triangles) and control cervix (circles) plasma samples into discriminate groups.
Discriminate principal components analysis (dPCA) of MALDI-TOF MS peptidomic data. MALDI-TOF MS spectra were aligned and binned using Markerview software version 1.2 (Applied Biosystems, Framingham, MA) and analyzed using discriminant Principal Component Analysis (dPCA). The top two principal components from the dPCA analysis of MALDI-TOF MS data for peptides released during the immunodepletion of albumin and IgG from plasma (Fraction 3 or FX3) sort cervical cancer (asterisks), CIN 2 (triangles) and control cervix (circles) plasma samples into discriminate groups.
Discriminate principal components analysis (dPCA) of MALDI-TOF MS peptidomic data. MALDI-TOF MS spectra were aligned and binned using Markerview software version 1.2 (Applied Biosystems, Framingham, MA) and analyzed using discriminant Principal Component Analysis (dPCA). The top two principal components from the dPCA analysis of MALDI-TOF MS data for peptides selectively bound to the highly abundant proteins, albumin and IgG (Fraction 4 or FX4) sort cervical cancer (asterisks), CIN 2 (triangles) and control cervix (circles) plasma samples into discriminate groups.
Demographic and clinical characteristics of the study population.
The authors would like to thank Daniel S. Metzinger and Lynn P. Parker for specimen procurement; Danyelle M. Clark for sample processing and collation of demographic and clinical data; Daniel W. Wilkey for aiding peptidome sample processing and MALDI-TOF MS data collection; and Daniel J. Fish for helpful discussions and critical reading of the manuscript. We thank Raymond Lloyd and Robert Rounsavall for their early support of the development of plasma thermograms.
Conceived and designed the experiments: NCG MLM ABJ JBK JBC. Performed the experiments: NCG MLM. Analyzed the data: NCG MLM CWH JBC. Contributed reagents/materials/analysis tools: NCG CWH MLM JBK JBC. Wrote the paper: NCG MLM CWH ABJ JBK JBC.
- 1. Ferlay J, Shin H-R, Bray F, Forman D, Mathers C, et al. (2010) Estimates of worldwide burden of cancer in 2008: GLOBOCAN 2008. Int J Cancer 127: 2893–2917.
- 2. American Cancer Society (2013) Cancer Facts and Figures 2013. Atlanta, GA: American Cancer Society. Available: http://www.cancer.org/acs/groups/content/@epidemiologysurveilance/documents/document/acspc-036845.pdf.Accessed 1 April 2013.
- 3. Mitchell MF, Tortolero-Luna G, Wright T, Sarkar A, Richards-Kortum R, et al. (1996) Cervical human papillomavirus infection and intraepithelial neoplasia: a review. J Natl Cancer Inst Monogr 21: 17–25.
- 4. McIndole WA, McLean MR, Jones RW, Mullins PR (1984) The invasive potential of carcinoma in situ of the cervix. Obstet Gynecol 64: 451–458.
- 5. Solomon D, Schiffman M, Tarone R (2001) Comparison of three management strategies for patients with atypical squamous cells of undetermined significance: baseline results from a randomized trial. J Natl Cancer Inst 93: 293–299.
- 6. Saslow D, Solomon D, Lawson HW, Killackey M, Kulasingam SL, et al. (2012) American Cancer Society, American Society for Colposcopy and Cervical Pathology, and American Society for Clinical Pathology screening guidelines for the prevention and early detection of cervical cancer. CA Cancer J Clin 62: 147–172.
- 7. Naucler P, Ryd W, Tornberg S, Strand A, Wadell G, et al. (2007) Human papillomavirus and Papanicolaou tests to screen for cervical cancer. N Engl J Med 357: 1589–1597.
- 8. Bulkmans NW, Berkhof J, Rozendaal L, van Kemenade FJ, Boeke AJ, et al. (2007) Human papillomavirus DNA testing for the detection of cervical intraepithelial neoplasia grade 3 and cancer: 5-year follow-up of a randomised controlled implementation trial. Lancet 370: 1764–1772.
- 9. Ronco G, Giorgi-Rossi P, Carozzi F, Confortini M, Dalla Palma P, et al. (2010) Efficacy of human papillomavirus testing for the detection of invasive cervical cancers and cervical intraepithelial neoplasia: a randomised controlled trial. Lancet Oncol 11: 249–257.
- 10. Massad LS, Einstein MH, Huh WK, Katki HA, Kinney WK, et al. (2013) 2012 updated consensus guidelines for the management of abnormal cervical cancer screening tests and cancer precursors. J Low Genit Tract Dis 17: S1–S27.
- 11. Murphy N, Ring M, Killalea AG, Uhlmann V, O’Donovan M, et al. (2003) p16INK4A as a marker for cervical dyskaryosis: CIN and cGIN in cervical biopsies and ThinPrep smears. J Clin Pathol 56: 56–63.
- 12. Moore GD, Lear SC, Wills-Frank LA, Martin AW, Snyder JW, et al. (2005) Differential expression of cdk inhibitors p16, p21cip1, p27kip1, and cyclin E in cervical cytological smears prepared by the ThinPrep method. Diagn Cytopathol 32: 82–87.
- 13. del Pino M, Garcia S, Fuste V, Alonso I, Fuste P, et al.. (2009) Value of p16(INK4a) as a marker of progression/regression in cervical intraepithelial neoplasia grade 1. Am J Obstet Gynecol 201: 488 e481–487.
- 14. No JH, Jo H, Kim SH, Park IA, Kang D, et al. (2009) Expression of MMP-2, MMP-9, and urokinase-type plasminogen activator in cervical intraepithelial neoplasia. Ann N Y Acad Sci 1171: 100–104.
- 15. Garbett NC, Mekmaysy CS, Helm CW, Jenson AB, Chaires JB (2009) Differential scanning calorimetry of blood plasma for clinical diagnosis and monitoring. Exp Mol Pathol 86: 186–191.
- 16. Garbett NC, Miller JJ, Jenson AB, Chaires JB (2007) Calorimetric Analysis of the Plasma Proteome. Semin Nephrol 27: 621–626.
- 17. Garbett NC, Miller JJ, Jenson AB, Miller DM, Chaires JB (2007) Interrogation of The Plasma Proteome with Differential Scanning Calorimetry. Clin Chem 53: 2012–2014.
- 18. Garbett NC, Miller JJ, Jenson AB, Chaires JB (2008) Calorimetry outside the box: a new window into the plasma proteome. Biophys J 94: 1377–1383.
- 19. Ferencz A, Fekecs T, Lőrinczy D (2011) Differential Scanning Calorimetry, as a New Method to Monitor Human Plasma in Melanoma Patients with Regional Lymph Node or Distal Metastases. In: Xi Y, editor. Skin Cancer Overview: InTech. pp. DOI: 10.5772/25606. Available: http://www.intechopen.com/books/skin-cancer-overview/differential-scanning-calorimetry-as-a-new-method-to-monitor-human-plasma-in-melanoma-patients-with-.
- 20. Zapf I, Fekecs T, Ferencz A, Tizedes G, Pavlovics G, et al. (2011) DSC analysis of human plasma in breast cancer patients. Thermochim Acta 524: 88–91.
- 21. Todinova S, Krumova S, Gartcheva L, Robeerst C, Taneva SG (2011) Microcalorimetry of blood serum proteome: a modified interaction network in the multiple myeloma case. Anal Chem 83: 7992–7998.
- 22. Todinova S, Krumova S, Kurtev P, Dimitrov V, Djongov L, et al. (2012) Calorimetry-based profiling of blood plasma from colorectal cancer patients. Biochim Biophys Acta 1820: 1879–1885.
- 23. Michnik A, Drzazga Z, Michalik K, Barczyk A, Santura I, et al. (2010) Differential scanning calorimetry study of blood serum in chronic obstructive pulmonary disease. J Therm Anal Calorim 102: 57–60.
- 24. Chagovetz AA, Jensen RL, Recht L, Glantz M, Chagovetz AM (2011) Preliminary use of differential scanning calorimetry of cerebrospinal fluid for the diagnosis of glioblastoma multiforme. J Neurooncol 105: 499–506.
- 25. Zhou M, Lucas DA, Chan KC, Issaq HJ, Petricoin I, E.F., et al (2004) An investigation into the human serum “interactome”. Electrophoresis 25: 1289–1298.
- 26. Merchant ML, Perkins BA, Boratyn GM, Ficociello LH, Wilkey DW, et al. (2009) Urinary peptidome may predict renal function decline in type 1 diabetes and microalbuminuria. J Am Soc Nephrol 20: 2065–2074.
- 27. Beck LH Jr, Bonegio RG, Lambeau G, Beck DM, Powell DW, et al. (2009) M-type phospholipase A2 receptor as target antigen in idiopathic membranous nephropathy. N Engl J Med 361: 11–21.
- 28. Villanueva J, Martorella AJ, Lawlor K, Philip J, Fleisher M, et al. (2006) Serum peptidome patterns that distinguish metastatic thyroid carcinoma from cancer-free controls are unbiased by gender and age. Mol Cell Proteomics 5: 1840–1852.
- 29. Diamandis EP (2006) Peptidomics for cancer diagnosis: present and future. J Proteome Res 5: 2079–2082.
- 30. Diamandis EP (2006) Serum proteomic profiling by matrix-assisted laser desorption-ionization time-of-flight mass spectrometry for cancer diagnosis: next steps. Cancer Res 66: 5540–5541.
- 31. Diamandis EP (2006) Validation of breast cancer biomarkers identified by mass spectrometry. Clin Chem 52: 771–772; author reply 772.
- 32. Villanueva J, Nazarian A, Lawlor K, Yi SS, Robbins RJ, et al. (2008) A sequence-specific exopeptidase activity test (SSEAT) for “functional” biomarker discovery. Mol Cell Proteomics 7: 509–518.
- 33. Menschaert G, Vandekerckhove TT, Baggerman G, Schoofs L, Luyten W, et al. (2010) Peptidomics Coming of Age: A Review of Contributions from a Bioinformatics Angle. J Proteome Res 9: 2051–2061.
- 34. Conover WJ (1999) Practical Nonparametric Statistics. New York: Wiley.
- 35. Chertov O, Biragyn A, Kwak LW, Simpson JT, Boronina T, et al. (2004) Organic solvent extraction of proteins and peptides from serum as an effective sample preparation for detection and identification of biomarkers by mass spectrometry. Proteomics 4: 1195–1203.
- 36. Smith C, Merchant M, Fekete A, Nyugen HL, Oh P, et al. (2009) Splice variants of neuronal nitric oxide synthase are present in the rat kidney. Nephrol Dial Transplant 24: 1422–1428.
- 37. Villanueva J, Philip J, Chaparro CA, Li Y, Toledo-Crow R, et al. (2005) Correcting common errors in identifying cancer-specific serum peptide signatures. J Proteome Res 4: 1060–1072.
- 38. Villanueva J, Philip J, DeNoyer L, Tempst P (2007) Data analysis of assorted serum peptidome profiles. Nat Protoc 2: 588–602.
- 39. Villanueva J, Philip J, Entenberg D, Chaparro CA, Tanwar MK, et al. (2004) Serum peptide profiling by magnetic particle-assisted, automated sample processing and MALDI-TOF mass spectrometry. Anal Chem 76: 1560–1570.
- 40. Villanueva J, Shaffer DR, Philip J, Chaparro CA, Erdjument-Bromage H, et al. (2006) Differential exoprotease activities confer tumor-specific serum peptidome patterns. J Clin Invest 116: 271–284.
- 41. Tempst P, Villanueva J (2009) Methods of Detection of Cancer using Peptide Profiles. Sloan-Kettering Institute for Cancer Research, Boston, MA. Application number 20090208921. Available: http://www.faqs.org/patents/app/20090208921#ixzz20090208920nYDVGvlt.