Nicotiana benthamiana is the most widely-used experimental host in plant virology. The recent release of the draft genome sequence for N. benthamiana consolidates its role as a model for plant–pathogen interactions. Quantitative real-time PCR (qPCR) is commonly employed for quantitative gene expression analysis. For valid qPCR analysis, accurate normalisation of gene expression against an appropriate internal control is required. Yet there has been little systematic investigation of reference gene stability in N. benthamiana under conditions of viral infections. In this study, the expression profiles of 16 commonly used housekeeping genes (GAPDH, 18S, EF1α, SAMD, L23, UK, PP2A, APR, UBI3, SAND, ACT, TUB, GBP, F-BOX, PPR and TIP41) were determined in N. benthamiana and those with acceptable expression levels were further selected for transcript stability analysis by qPCR of complementary DNA prepared from N. benthamiana leaf tissue infected with one of five RNA plant viruses (Tobacco necrosis virus A, Beet black scorch virus, Beet necrotic yellow vein virus, Barley stripe mosaic virus and Potato virus X). Gene stability was analysed in parallel by three commonly-used dedicated algorithms: geNorm, NormFinder and BestKeeper. Statistical analysis revealed that the PP2A, F-BOX and L23 genes were the most stable overall, and that the combination of these three genes was sufficient for accurate normalisation. In addition, the suitability of PP2A, F-BOX and L23 as reference genes was illustrated by expression-level analysis of AGO2 and RdR6 in virus-infected N. benthamiana leaves. This is the first study to systematically examine and evaluate the stability of different reference genes in N. benthamiana. Our results not only provide researchers studying these viruses a shortlist of potential housekeeping genes to use as normalisers for qPCR experiments, but should also guide the selection of appropriate reference genes for gene expression studies of N. benthamiana under other biotic and abiotic stress conditions.
Citation: Liu D, Shi L, Han C, Yu J, Li D, et al. (2012) Validation of Reference Genes for Gene Expression Studies in Virus-Infected Nicotiana benthamiana Using Quantitative Real-Time PCR. PLoS ONE 7(9): e46451. doi:10.1371/journal.pone.0046451
Editor: Boris Alexander Vinatzer, Virginia Tech, United States of America
Received: May 16, 2012; Accepted: August 30, 2012; Published: September 28, 2012
Copyright: © Liu et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This work was supported partly by the National Natural Science Foundation of China (Grant No. 31100115 and 30730006), the Fundamental Research Funds for the Central Universities of China (Grant No. 2010JS074) and an earmarked Fund for China Agricultural Research System (CARS-210202). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Nicotiana benthamiana has become a very important subject for the study of host–pathogen interactions, particularly those involving plant viruses. Many laboratories throughout the world undertake their research work on N. benthamiana and the number of published reports involving N. benthamiana has increased significantly over the past score years (Figure S1) , . It is most likely that N. benthamiana has been adopted as a model plant primarily due to its unparalleled susceptibility to viruses, which is associated with the naturally occurring mutation in the RNA-dependent RNA polymerase gene, NbRdRP1m . Three major technical advances have contributed to increased utilisation of N. benthamiana in the field of plant biology: plant virus-based expression vector systems, virus-induced gene silencing (VIGS) and agro-infiltration.
Plant virus-based transient expression systems provide attractive alternatives for the production of antibodies, vaccines, growth factors and many other proteins of pharmaceutical importance, because they offer several potential advantages compared to the traditional transgenic approach, including easy manipulation, high yield and fast manufacturing , , , . In most cases, N. benthamiana has been used as the experimental host for the development of plant virus-based expression systems, such as Tobacco mosaic virus-based MagnICON vectors, Cowpea mosaic virus-based expression systems, and others , , .
Along with the advances in plant virus-based transient expressions, another recent major technological breakthrough for plant viral amplicon is now known as virus-induced gene silencing (VIGS), which dramatically accelerated the process by which plant molecular biologists are able to unravel the functions of genes in a large number of plant species , , , , , . Furthermore, N. benthamiana has provided a critical platform for the construction and application of VIGS vectors. Almost without exception, N. benthamiana is also the preferred host plant for testing the effectiveness of currently available VIGS vectors in silencing marker genes (e.g. NbPDS), followed by procedures that extend the VIGS to economically important plants , . In addition, VIGS mediates the homology-based post-transcriptional degradation of selected plant RNA, leading to a loss-of-function phenotype . Senthil-Kumar et al. (2007) found that tobacco rattle virus (TRV)-mediated VIGS can be performed on a wide range of solanaceous plant species and that heterologous gene sequences from distantly-related plant species can be used to silence their respective orthologs in the VIGS-efficient plant, N. benthamiana , . In 2012, scientists at the Boyce Thompson Institute for Plant Research (BTI) released a draft sequence of the N. benthamiana genome , which has made it easier to identify orthologous genes of tomato, potato and other plant species. All these advancements have transformed N. benthamiana into a powerful reverse-genetics system for rapid identification of genes of interest from a wide range of plant species , , , .
The third technological advancement that has served to popularise N. benthamiana as a research model was agro-infiltration , , . Firstly, whole genomes of many plant viruses, such as the viral vectors mentioned above, were cloned into binary vectors and delivered into plants via agro-infiltration, which is clearly superior to inoculation with in vitro transcripts of full-length viral cDNA , , . Secondly, agro-infiltration works exceptionally well in N. benthamiana but poorly in other plants, including Arabidopsis thaliana . The transgenic N. benthamiana line 16C has been instrumental in elucidating the mechanism of RNA silencing and for the identification of virus-encoded suppressors of silencing , , , . Proteins of interest were often expressed as fusions to auto-fluorescent proteins by agro-infiltrating the leaf tissue of N. benthamiana to study their subcellular localisation , . Additionally, sufficient leaf tissue of N. benthamiana can be infiltrated to permit small-scale protein purification needed for biochemical analysis , and co-infiltration of N. benthamiana is also widely used to identify protein–protein interactions through bimolecular fluorescence complementation (BiFC), pull-down assays and co-immunoprecipitation (Co-IP) , , , , .
Taken together, the methods described above, or combinations thereof, illustrate the importance of N. benthamiana as an indispensable research model in plant virology and its increasing usefulness in many aspects of plant biology , .
To date, a VIGS-cDNA library has been constructed for large-scale gene function analyses of N. benthamiana , , , , , . Comparative analysis of transcriptomic and proteomic responses of N. benthamiana–virus interactions have been performed , , ,  and a microarray platform suitable for RNA profiling of virus-infected N. benthamiana (the Nb-array) is also available . Although a large number of differently-expressed genes have been identified using the methods described above, more accurate quantitative analysis of target genes, in order to further confirm their transcription levels within particular contexts, is absolutely necessary before taking the next step.
Quantitative real-time reverse transcription–polymerase chain reaction (qRT–PCR) is the most common method for either characterising or confirming gene expression patterns, and comparing mRNA levels across different sample populations, due to its high sensitivity, specificity, accuracy and reproducibility , , . The most prominent problem with quantitative mRNA analysis, however, is the selection of an appropriate control gene for accurately normalising gene expression data , . An ideal endogenous control gene, also called a reference or housekeeping gene, is one that is stably expressed within the samples to be compared, regardless of tissue differences, experimental conditions or treatments. The use of reference genes that are neither valid nor stable can have a significant impact on the results obtained, possibly leading to erroneous conclusions , , . Thus, the choice of an appropriate housekeeping gene for normalisation purposes is a prerequisite in qRT–PCR experiments. This is of particular importance when using qRT–PCR to measure viral and cellular gene transcription levels in the context of viral infections, since viruses can significantly interfere with host cell pathways, the components of which are often encoded by traditional housekeeping genes . Moreover, different viruses are likely to manipulate different transcription pathways, and the stability of a selected reference gene often fluctuates according to variations in virus and host species, as well as the timing of a virus infection and the cell type infected , , , .
Many studies have been undertaken to determine reliable reference genes in plant cells across various plant species, developmental stages, and root and shoot abiotic and biotic stresses . For N. benthamiana. Rotenberg et al. evaluated the suitability of three genes, ubi3, EF-1 and actin as internal controls for quantifying gene expression when using TRV-based VIGS vectors, although EF-1 and ubi3 were found to be least variable among rTRV-infected and rTRV::tPDS-infected N. benthamiana, both genes were induced two- to three-fold by TRV infection compared to the non-infected plants, thus a reference gene that is not altered by TRV infection hadn’t been identified . As N. benthamiana had become the most popular platform for the study of virus–host interactions and accurate quantification of functional genes involved in the interaction is critical , , there is now an urgent need to systematically analyse the reference gene stability for qRT–PCR on N. benthamiana plants in the context of viral infection. In this study, we aimed to evaluate different reference genes for qRT–PCR gene expression experiments on cDNA from N. benthamiana leaf tissue, which was either uninfected or infected with one of five RNA plant viruses. We selected 16 candidate reference genes, some of which were commonly used as normalisation factors in qRT–PCR analysis, such as GAPDH, 18S, EF1α, ACT and TUB , and other genes showed a high expression stability in plant species under viral infection or other experimental settings. The suitability of those candidate reference genes with acceptable expression levels was then statistically evaluated with geNorm , NormFinder  and BestKeeper algorithms . Finally, the effects of using these internal control genes with good rankings in the statistical analyses were further assessed through relative quantification of AGO2 and RdR6 gene expression levels in virus-infected N. benthamiana.
Assessment of Target Specificity and Amplification Efficiencies in qRT–PCR Reactions
The stabilities of 16 N. benthamiana candidate internal controls were tested under different biotic stress conditions, as determined by the infection of five pathogenic viruses. The five viruses belonged to four different genera: Necrovirus (TNV-A and BBSV), Benyvirus (BNYVV), Hordeivirus (BSMV) and Potexvirus (PVX). Infections were confirmed by Western blotting (Figure S2). Using the primer pairs designed for each of the 16 candidate reference genes (Table 1), gene-specific amplification was confirmed by the appearance of a single peak in melting curve analyses following qRT–PCR (Figure S3). Agarose gel electrophoresis of the amplicons produced single fragments of the expected size (83–149 bp) in all cases (Figure S4A). No band was detected in the negative control, demonstrating the absence of genomic DNA contamination (Figure S4B). Sequencing analyses showed that all genes were 100% identical to those deposited in public databases (unpublished data). Amplification efficiencies ranged from 90.4% to 104.7% (Table 1), which is well within the acceptable range of 90–105%, as suggested in a qRT–PCR optimisation guide from Bio-Rad Laboratories, Inc. (http://www.gene-quantification.de/real-time-pcr-guide-bio-rad.pdf). Furthermore, the standard curves demonstrated good linear relationships (R2>0.980) between the cycle threshold (Ct) values and the log-transformed copy numbers for all tested reference genes (Table 1), confirming the suitability of the primer pairs and target sequences in the qRT–PCR-based quantification.
Table 1. Primers and amplicon characteristics for candidate internal control genes, AGO2 and RdR6.doi:10.1371/journal.pone.0046451.t001
Expression Levels of Candidate References Genes
In order to provide an overview of the relative abundance of the 16 candidate reference genes in N. benthamiana, we determined Ct values for all of these genes except TIP41 from five different viral infections using three biological and three technical replicates (n = 54 for each gene). From the graph, the median Ct values of the mRNAs that were selected as candidates ranged from 21.22 (GAPDH) to 34.97 (PPR) (Figure 1), which respectively represented the highest and lowest accumulation levels in virus-infected N. benthamiana leaf tissue. In a preliminary experiment, TIP41 was excluded from further analyses due to very low transcript accumulation (>35 cycles). In this study, we used 40 cycles of amplification for the qRT–PCR; therefore, Ct values of 35 were late to amplify (i.e. late call) and considered unreliable. Consequently, PPR was also removed from further analysis, despite its narrow range of Ct values (Table S1). This is consistent with a previous study, in which TIP41 and PPR also showed the lowest expression levels in virus-infected A. thaliana . The exclusion of TIP41 and PPR resulted in a final list of 14 candidate reference genes for further transcript stability analysis.
Figure 1. Expression levels of candidate reference genes in healthy and virus-infected leaf tissue samples of Nicotiana benthamiana.
Values are given as the cycle threshold (Ct, mean of triplicate samples) and are inversely proportional to the amount of template. Global expression levels of the different genes tested are shown as the 25th and 75th quartiles (horizontal lines), median (central horizontal line) and whiskers. Whiskers go either from the minimal to maximal value or, if the distance from the first quartile to the minimum value is more than 1.5 times the interquartile range (IQR), from the smallest value included within the IQR to the first quartile. Outliers, values smaller (Min) or larger (Max) than 1.5 times the IQR, are indicated. Genes are in order from the most (lower Ct, on the left) to the least abundantly expressed (higher Ct, on the right).doi:10.1371/journal.pone.0046451.g001
The range of Ct values under different treatments indicated a considerable variability among the 14 candidate reference genes. The least amount of variation in gene expression across all 54 tested samples occurred in GBP and PP2A (<2 cycles), while TUB was the most variable (>4 cycles) (Table S1). A simple comparison of the raw Ct values, however, is not sufficient for evaluating expression stability of the candidate reference genes. Consequently, a sophisticated statistical analysis, as described below, was needed to provide a more accurate assessment of the reference genes.
Analysis of Candidate Reference Gene Stability
To further evaluate the expression stability of the candidate reference genes, we applied three commonly-used algorithms to calculate expression stabilities individually, namely geNorm , NormFinder  and BestKeeper .
The raw Ct values were transformed into quantities for relative comparison. Average gene expression stability (M value) of the 14 candidate reference genes was calculated with the geNorm applet, and all candidates were ranked based on the M values (Figure 2). A lower value of average expression stability (M) indicated a more stable expression. Pairwise variation (V) was implemented to calculate the optimal number of genes to include when performing normalisation using multiple reference genes . The 14 selected candidate genes all achieved high expression stability criterion, with M <0.92, which is well below the default limit of 1.5 suggested by geNorm (Figure 2A).
Figure 2. Expression stability of the candidate reference genes analysed by geNorm.
(A) Average expression stability values (M) following stepwise exclusion of the least stable reference genes across all treatment groups. A lower M value indicates more stable gene expression. (B) The optimal number of reference genes required for effective qRT–PCR data normalisation. The pairwise variation (Vn/Vn+1) was analysed between the normalisation factors NFn and NFn+1 using geNorm software to determine whether inclusion of an additional reference gene adds to the stability of the normalisation factor.doi:10.1371/journal.pone.0046451.g002
We also determined the optimal number of reference genes, according to the pairwise variation value (Vn/n+1 value) (Figure 2B). The most stably expressed genes of the pool (F-BOX, PP2A and L23) produced an optimal normalisation of the qRT–PCR data, and the addition of a fourth, less stable normalisation factor (SAND) did not significantly increase the statistical reliability of this calculation (Figure 2B). Indeed, the V2/3 value of F-BOX and PP2A (i.e. pairwise variation when the number of normalisation factors is increased from two to three) was 0.152 (Figure 2B), which was very close to the proposed cut-off value of V = 0.15 . The inclusion of the third housekeeping gene (L23), in addition to F-BOX and PP2A, may have reduced the V value to below the cut-off threshold of 0.15, which would have suggested that the top three reference genes (F-BOX, PP2A and L23) would be adequate in our qRT–PCR normalisation of different viral infections, and an additional reference gene was not required.
NormFinder is another Microsoft Excel-based Visual Basic application that assigns stability values to single candidate reference genes. The NormFinder algorithm uses a model-based approach for the estimation of expression variation among candidate genes, taking into account intra- and intergroup variation for normalisation factor calculations and avoiding misinterpretations caused by artificial selection of co-regulated genes .
We applied a NormFinder analysis to our data (Figure 3). In doing so, the entire ranking order of genes was repeated, and we found limited differences between the geNorm and NormFinder results. PP2A, F-BOX and L23 still occupied the three top positions, demonstrating higher stability in virus-infected leaf tissues, with stability values ranging from 0.0132 to 0.0146, whereas GAPDH, ACT and SAMD were again shown to be the least stable genes, with stability values ranging from 0.0312 to 0.0521 (Table 2). The ranking of moderately stable genes according to NormFinder differed slightly from that calculated by geNorm. This was as expected, given that the two statistical algorithms are distinct. Overall, the results of the NormFinder analysis were highly consistent with those obtained from geNorm.
Figure 3. Expression stability of the candidate reference genes analysed by NormFinder.
Error bars represent ± standard errors.doi:10.1371/journal.pone.0046451.g003
Table 2. Ranking of the candidate reference genes according to their stability value using geNorm, NormFinder and BestKeeper analyses.doi:10.1371/journal.pone.0046451.t002
BestKeeper evaluates gene expression stability for all individual reference genes based on three variables: standard deviation (SD), coefficient of correlation (r) and percentage covariance (CV). All reference genes are combined into an index (BestKeeper). The correlation between each reference gene and the index is calculated, based on individual Ct values, as the geometric mean of a number of candidate reference genes. Reference genes with SD values >1 are considered inconsistent and should be excluded .
Initial analysis of the data using variations (SD [± Ct] and CV [%Ct]) for all the candidate reference genes showed that all candidate reference genes had SD values <1, except for GAPDH (SD = 1), indicating that most were suitable to be considered for selection as reference genes (Table 3).
Table 3. Descriptive statistics of the fourteen candidate reference genes based on their cycle threshold (Ct) values as calculated by BestKeeper.doi:10.1371/journal.pone.0046451.t003
As was the case with geNorm and NormFinder, BestKeeper also ranked TUB, ACT and SAMD as the least stable reference genes after GAPDH, with relatively high CV and SD values (>2.5 and >0.75, respectively) (Table 3). Therefore, GAPDH, SAMD, ACT and TUB were excluded from further analysis, leaving 10 reference genes for subsequent assessment using pairwise correlation and regression analysis.
Compared with the geNorm and NormFinder results, BestKeeper found small differences in the ranking of the most stable genes (Table 3). EF1α was the most stable gene, with the highest correlation coefficient (r = 0.858). This was followed by L23, PP2A and F-BOX (0.731< r <0.833; p value = 0.001), which were the three most stable genes identified by geNorm and NormFinder. This difference may have occurred because the statistical algorithms used by these three methods were distinct. geNorm detects the two reference genes whose expression ratios show the least variation from those of the other tested genes, NormFinder takes intra- and intergroup variation into account for normalisation factor calculations, whereas BestKeeper considers the least variation of a single reference gene.
In summary, regardless of the ranking order (Table 2), a comparison of the three methods (geNorm, NormFinder and BestKeeper) suggests that PP2A, F-BOX and L23 could be the most suitable reference genes for normalising mRNA levels within the context of the different viral infections tested in this study. Conversely, APR, TUB, SAMD, ACT and GAPDH showed relatively low expression stability in leaf tissues of N. benthamiana during viral infections.
APR and EF1α are the Most Suitable Reference Genes for Normalising the Transcripts from TRV-infected N. benthamiana
The TRV-based VIGS vector is a powerful reverse genetics tool for functional gene analysis in plants , . A previous report showed that UBI3 and EF1α were suitable for comparing rTRV-infected to rTRV::tPDS-infected plants based on BestKeeper software analysis, but a reference gene unaltered by TRV infection in non-infected plants was not identified . To further test possible benefits of using TRV-based VIGS, the 10 most stable reference genes, as determined above, were analysed using qRT–PCR to evaluate their stability in N. benthamiana under infection with TRV. We did not comprehensively analyse gene expression stability under TRV infection in conjunction with the results from the other five viruses described above, since TRV infection can lead to severe fluctuations in the expression levels of some internal controls, as has been previously noted .
Both geNorm and NormFinder analyses revealed that APR and EF1α were the most stable reference genes in N. benthamiana during TRV infection, and that these two genes were also sufficient for accurate normalisation in TRV-infected leaf tissue, with a V value (0.116) lower than the default cut-off point of 0.15 (Figure S5A, B, C). UBI3, however, was ranked lowest in our study (Figure S5A, C), which was inconsistent with a previous report . This result was not surprising because the statistical algorithms and primers used in our study were different from those used previously , . BestKeeper analysis of TRV-infected N. benthamiana showed a slightly different ranking order from that obtained by geNorm and NormFinder (Figure S5D), which was also not unexpected, as discussed above.
In summary, we are the first to identify, APR and EF1α as the most suitable reference genes for normalising transcripts from TRV-infected N. benthamiana.
Validation of Reference Genes for Determining the Expression of AGO2 and RdR6 in Response to Viral Infection
To further evaluate the reliability of the top three reference genes (F-BOX, PP2A and L23), we selected AGO2 and RdR6 for additional qRT–PCR analysis, since they play crucial roles in RNA-based antiviral immunity . F-BOX, PP2A and L23 were used in combination as reference genes for expression normalisation. In our previous study, Northern blot analysis showed that the transcription level of AGO2 could be up-regulated during BBSV infection (Figure S6); therefore, BBSV-infected N. benthamiana plants could serve as a positive control.
Relative quantification analysis revealed a significant up-regulation of the AGO2 expression in all virus-infected N. benthamiana leaf tissue. Among them, BNYVV and TNV-A infected leaves presented the highest AGO2 expression levels compared with mock-inoculated plants, with 12.5- and 11.0-fold increases, respectively. Next came BBSV and BSMV, which caused 7.7- and 7.3-fold changes in AGO2 expression, respectively.
qRT–PCR analysis of the AGO2 expression level in BBSV-infected N. benthamiana matched that of Northern blotting (Figure S6). PVX also induced a 3.7-fold increase of the AGO2 mRNA level in the leaves of N. benthamiana (Figure 4A). These results suggest that AGO2 plays a general role in mediating RNA silencing-based defences against plant viruses, and also confirm the suitability of F-BOX, PP2A and L23 as internal controls.
Figure 4. Relative quantification of AGO2 and RdR6 expression in Nicotiana benthamiana infected with different viruses, with PP2A, F-BOX and L23 in combination as reference genes.
Error bars represent mean standard error calculated from three biological replicates. Normalisation factors were calculated as the geometric mean of the expression levels of the three most stable reference genes (F-BOX, PP2A and L23) as determined by geNorm analysis. A control mock-inoculated sample was used as the calibrator ( = 1).doi:10.1371/journal.pone.0046451.g004
In contrast to the expression pattern of AGO2, there was no obvious decrease in RdR6 expression between virus-infected and mock-inoculated groups, with relative quantification values ranging from 0.62 to 1.02. BBSV, BSMV and TNV-A triggered a weak down-regulation of RdR6 in N. benthamiana, while the PVX and BNYVV-infected group showed almost no change (Figure 4B). The expression profile of RdR6 in this study was similar to that from virus-infected A. thaliana, as previously described .
Quantitative Real-time PCR
Quantitative reverse transcription–polymerase chain reaction (qRT–PCR) is one of the best methods available for determining changes in gene expression . Prior to analysis of target gene expression, it is essential to select an appropriate normalisation strategy to control for non-specific variation between samples. Reference genes that have stable expressions at different biological and physiological states can be effectively used for normalisation . However, there is no universal reference gene that can be stably expressed under all experimental conditions. A well-tested housekeeping gene demonstrating significant expression stability in one plant species or tissue type may not show the same stability if used in different experimental situations, species or tissues , . Thus, it is essential that prior validation of all reference genes should be performed to confirm their expression stabilities either under certain experimental conditions or for different tissues/cells, in order to prevent inaccurate data interpretation and subsequent false conclusions , , .
The Necessity and Urgency of Validating Reference Genes for Gene Expression Studies in Nicotiana benthamiana
Nicotiana benthamiana possess the unique trait of being susceptible to a vast number of plant viruses, and consequently, has become a cornerstone for the study of virus–host interactions in plants. Meanwhile, N. benthamiana is also rapidly gaining popularity in general plant biology due to its superiority as a platform for virus-induced gene silencing, transient protein expression, protein localisation and so on , . However, despite being an indispensable research model, there is limited information on the expression stability of reference genes in N. benthamiana under specific conditions. Schmidt et al. studied 8 potential reference genes for normalisation of qRT-PCR in Nicotiana tabacum during development and abiotic stress , however, N. tabacum differs from N. benthamiana after all, plus that the external conditions used for examine the stability of the candidate reference genes were different from that of our study, so it is improper to apply the stable reference genes obtained in N. tabacum for N. benthamiana mechanically. In addition, although Rotenberg found suitable reference genes for target gene normalisation when using TRV-VIGS vector in N. benthamiana , the selected internal controls could only be used for comparing the dynamics of gene expression level between TRV-VIGS-infected and TRV-infected N. benthamiana and were not appropriate for normalising gene expression between TRV-infected and non-inoculated plants.
In our study, we systematically evaluated the accumulation and stability of 14 candidate reference genes in N. benthamiana subjected to five diverse plant viral infections. In theory, the diversity of these selected viruses should be favourable for the screening of suitable reference genes in N. benthamiana. Reference genes identified in our study could be used not only for gene expression quantification when probing gene function by VIGS (eg. TRV, PVX and BSMV-based VIGS vectors) in N. benthamiana , , , but also for the study of these genes involved in the interaction between N. benthamiana and a particular virus, thus providing convenience and preferred alternative for quantifying gene expression in N. benthamiana during viral infection.
Reference Gene Stability in Nicotiana benthamiana during Viral Infections
We analysed the expression of 14 candidate reference genes using three different software packages: geNorm, NormFinder and BestKeeper. Analysis using geNorm was an easy method to determine the optimal number of stable housekeepinggenes for accurate normalisation , whereas NormFinder and BestKeeper were used to assess the quality of the ranking obtained by geNorm , . The top three reference gene positions in virus-infected samples as defined by geNorm were similar to those determined by NormFinder, yet slightly different from those of the BestKeeper analysis. EF1α was ranked first by BestKeeper, but had relative high CV [%Ct] and SD [±Ct] values. The second to fourth positions in the BestKeeper ranking matched the three most stable reference genes according to the geNorm and NormFinder analyses. This variation wasn’t surprising, since the three software packages use different calculation algorithms. Comparable results have also been encountered and discussed in many previous studies , , .
Taken together, the three software packages showed that PP2A, F-BOX and L23 were overall the most stable reference genes. Our results corroborate a paper recently published by Lilly et al. , which tested reference genes for normalising transcripts from virus-infected A. thaliana. They found that F-BOX and PP2A demonstrated the most stable transcript accumulation. Similar results for the Manihot esculenta Crantz were observed by Moreno et al., whereby the expression patterns of PP2A, along with those of UBQ10 and GBP, appeared to be the most stable in assorted Cassava brown streak virus-infected tissues and cassava varieties . In addition, F-BOX was found to be one of the most stably expressed genes in citrus under diverse experimental conditions, such as tissues versus organs, and various biotic stresses (virus, fungi, or bacteria) . L23 demonstrated the highest expression stability in our study, which is consistent with the results observed in N. tabacum during its development and under abiotic stress . However, it should be pointed out that there is no universal control gene that is expressed at a constant level under all conditions and in all tissues, and PP2A, F-BOX and L23 are no exception. For example, F-BOX was revealed as the worse gene by all three approaches for qPCR in Fagopyrum esculentum based on transcriptome sequence data , PP2A was not a good choice for normalization of gene expression levels during berry development , and the expression level of L23 was found to be up-regulated in Tortula ruralis under rehydration . Despite the unsatisfactory performance of PP2A, F-BOX and L23 in other plants under particular conditions, we believe that these three reference genes have the potential to be extensively used as internal controls for target gene normalisation in the study of virus–host interaction.
All three software packages ranked SAND, GBP, UK, 18S and UBI3 in middle positions for all samples of virus-infected N. benthamiana. The novel reference gene, SAND, was not ideal for analysing gene expression in virus-infected N. benthamiana, yet it was the recommended reference gene for normalisation of transcripts from citrus and virus-infected A. thaliana , . GBP showed very stable expression in Cassava brown streak virus-infected cassava as described above . UK and UBI3 were stably expressed throughout virus-infected tissues of tomato plants . It also should be noted that the CV [%Ct] and SD [±Ct] values were very low for UK and GBP in the BestKeeper analysis of this study.
18S and EF1α are commonly-used housekeeping genes in qRT–PCR experiments. Previously, EF1α has been reported to be stably expressed in potato during biotic and abiotic stress  and 18S is suitable for normalisation in Barley yellow dwarf virus-infected cereals . In this study, however, the performance of EF1α and 18S was unsatisfactory, even though EF1α was ranked top by the BestKeeper analysis. Our results were consistent with earlier studies in Cicer arietinum and virus-infected tomato, both of which showed considerable regulation for 18S and EF1α , . Taken together, our data again demonstrates that the widely-used reference genes 18S and EF1α, may not be the optimal choices for testing transcript abundance in N. benthamiana during viral infection.
APR and SAMD were found to be the most suitable reference genes in Brassica rapa and Brachypodium distachyon, respectively , . However, in our study both displayed high variation in their expression levels, possibly because they implement certain functions during viral infections. These results suggest that it is necessary to collect as much gene expression data as possible in different organisms, organs and experimental conditions, in order to avoid selecting a reference gene which is itself involved in the regulation of the gene of interest under its particular conditions. For example, the DNAJ-like protein, a traditional housekeeping gene used in previous studies , was excluded from our analysis during the initial experimental design because its expression is associated with replication of plant virus . This may also explain why UBI3 exhibited poor performance during our study.
GAPDH, ACT and TUB have traditionally been the three most widely-used reference genes for transcript expression analysis in various plant species , , . However, their suitability as internal standards has recently come into question, especially due to their potential regulation in a wide variety of physiological states , , . In this study, analyses using all three software packages ranked TUB, ACT and GAPDH in the bottom positions. GAPDH, the lowest ranked gene, showed the highest expression variability of all samples. Our results again suggest plant virologists should be cautious when using TUB, ACT or GAPDH as internal controls for accurate normalisation of a target gene in virus-infected N. benthamiana.
It is also worth noting that the samples of BBSV-infected leaf tissue derived from a temperature controlled greenhouse at 18°C, a relatively low temperature compared to the 24°C used for the other four viruses. That being said, all the samples were analysed together without distinction, so it is reasonable to speculate that the stable reference genes identified in our study may be suitable for normalising gene expression data in N. benthamiana under low-temperature stress. These results suggest a benefit for further quantitative gene expression analysis in N. benthamiana.
In summary, the results presented above further emphasise the necessity of identifying and validating a reference gene for a given plant under a particular set of experimental conditions prior to its use for normalisation, as there is no universal reference gene suitable for all experimental situations , , . More importantly, we believe our study will provide researchers with a convenient and reliable data resource when undertaking gene expression studies in N. benthamiana.
Normalisation to a Single Reference Gene or Multiple Reference Genes
Many previous reports have stated the importance of choosing the correct internal controls in their experiments, through comparison of the expression levels of target genes normalised by the most- and least-stable reference genes. They further highlight that incorrect use of reference genes that lack validation can introduce bias in an analysis (i.e., over- and underestimation) and lead to misinterpretation of data , , , , . Furthermore, they found patterns of target gene expression to be similar, whether two (or more) of their most stable reference genes were used either individually or in combination. This suggests that one suitable, verified reference gene may be sufficient for normalising data to roughly approximate the expression of a gene of interest , . In our study, for example, the expression patterns of AGO2 and RdR6 showed similar trends to those of PP2A, F-BOX and L23 as internal controls either singly or in combination (Figure 4 and Figure S7), which further indicated that PP2A, F-BOX and L23 were suitable as reference genes. However, increasing the number of reference genes for normalisation will improve analytical accuracy. Consequently, two or more reliable reference genes should be used in parallel as internal standards when normalising subtle but significant variations among different samples, despite the fact this is expensive and time-consuming , , .
In the current study, based on V ≤0.15, three reference genes were sufficient for the normalisation of qRT–PCR data from virus-infected N. benthamiana. One of the factors that may have made it more difficult for us to achieve V ≤0.15 was the large number of samples and treatments tested, an issue consistent with previous observations . Datasets containing small numbers of samples and treatments have tended to require fewer reference genes for accurate normalisation than larger datasets (e.g., >50 samples; 2–4 treatments). In our study, for example, when the expression stability was analysed separately for each sample treated with a particular virus, it would be easy to obtain the optimal reference genes from among the 14 candidates, and each individual viral infection could be normalised by just two reference genes, whose V values were all lower than the geNorm threshold of 0.15 (unpublished data). In addition, it should also be noted that the proposed 0.15 V value was not an absolute cut-off, as emphasised previously , , . Our results indicated that combining the two most stable reference genes (PP2A and F-BOX) gave a V value (0.152) close to 0.15, implying that the use of these two reference genes was sufficient for the normalisation of qRT–PCR data in virus-infected N. benthamiana.
Although APR and EF1α were considered to be optimal reference genes when analysing samples from TRV-infected N. benthamiana individually by different algorithms, it didn’t contradict the combined results of PP2A, F-BOX and L23 as suitable reference genes across all other virus-infected N. benthamiana samples, because the ranking of the reference gene stability was often not uniform when considering data from all the samples versus from each sample, which had been observed in previous reports , .
Overall, all of the tested reference genes showed relatively high stability with low average expression stability M values less than 0.92, which is far below the default limit of M ≤1.5, evaluation of all expression data from five different viruses-treated samples revealed that PP2A, F-BOX and L23 were the most stably expressed genes, suggesting that these may be suitable reference genes for analyses of gene expression in N. benthamiana infected with a wide variety of viruses. Our results are a valuable resource for others who seek accurate normalisation of gene expression in experiments on N. benthamiana under conditions of viral infection.
Expression of AGO2 and RdR6 in Response to Viral Infection
To further validate the applicability of the screened reference genes, we assessed the expression profile of AGO2 and RdR6 genes in virus-infected N. benthamiana leaf tissue. AGO2 and RdR6 play important roles in RNA silencing-based antiviral defence . Recent studies have shown that the down-regulation of RdR6 in N. benthamiana leads to superinfection with PVX and Plum pox virus, while no such effect is observed for TRV or Tobacco mosaic virus , . A similar phenomenon also occurs in the Arabidopsis AGO2 mutants infected with Turnip crinkle virus or Cucumber mosaic virus . Moreover, Jaubert et al. found that AGO2 mediated RNA-silencing antiviral defences against PVX in Arabidopsis sp., whereas Scholthof et al. concluded the same in N. benthamiana during Tomato bushy stunt virus infection , .
In this study, we normalised our potential genes of interest, AGO2 and RdR6, using the normalisation factor generated for the three most stable candidate reference genes, PP2A, F-BOX, and L23. Results showed that AGO2 expression was evidently up-regulated in virus-infected leaf tissue when compared with the control group, suggesting a more general role for AGO2 in plant innate immune responses. RdR6 showed a different expression pattern from that of AGO2: only three viruses caused a slight down-regulation of RdR6. The RdR6 expression profile in our study was consistent with that in virus-infected Arabidopsis sp. . In addition, Ren et al. found that the OsRDR6 mRNA levels in Rice dwarf virus-infected plants decreased to nearly 34% that in non-infected plants . As such, expression of RdR6 during virus–host interactions is likely associated with pathological traits of a given virus.
In summary, our results further confirm that the three most stable reference genes identified in our study (PP2A, F-BOX and L23) could be used for accurate normalisation of a target gene in virus-infected N. benthamiana.
To the best of our knowledge, this article describes the first attempt to validate a set of commonly-used candidate reference genes, in N. benthamiana, that can be used for the normalisation of gene expression analysis using qRT–PCR. We identified 14 reference genes that were suitable for the normalisation of qRT–PCR data, which were obtained from N. benthamiana leaf samples subjected to five different viral infections. Evaluations using geNorm, NormFinder and BestKeeper identified the three most suitable reference genes in N. benthamiana as PP2A, F-BOX and L23. The least suitable reference gene was GAPDH, which may be unsuitable in future N. benthamiana studies.
Our results not only provide researchers interested in these viruses with a shortlist of potential housekeeping genes to use as normalisers for qRT–PCR experiments, but also should guide the selection of appropriate reference genes for gene expression studies in N. benthamiana under conditions other than those tested here, or in other plant species under similar treatment conditions.
Materials and Methods
Virus Inoculation and Sample Preparation
Seedlings of N. benthamiana were grown in a glasshouse and were infected with one of five viruses at 4 weeks of age. Virus inocula were first prepared in N. benthamiana as follows: BBSV and TNV-AC were mechanically inoculated into N. benthamiana with previously described in vitro transcripts , ; BSMV and PVX were agro-inoculated into N. benthamiana according to published methods ; and BNYVV was propagated on N. benthamiana, and its total RNA was extracted from symptomatic leaves to be used as the inoculum . At 7–14 dpi, systemic leaves that had typical symptoms of the corresponding viruses were sampled. These samples were ground in 20 vol. 0.1 M potassium phosphate (K2HPO4) buffer (pH 7.4) containing carborundum (as an abrasive). Mechanical inoculations were then undertaken using the sap from systemically infected N. benthamiana leaf tissue for the test. Simultaneously, mock-inoculated plants without infectious homogenate were created as controls.
All the N. benthamiana plants, except those inoculated with BBSV, were maintained in a controlled environmental climate chamber at 24±0.5°C with a photoperiod of 14-hours light (~75 µmol/m2/s) and 10-hours dark. Plants infected by BBSV, together with four mock-inoculated controls, were grown at 18°C, since relatively low temperatures is required for BBSV to establish systemic infection in N. benthamiana . At least 12 plants were inoculated for each virus. On days 7–14, typical symptoms appeared in the upper leaves and the infection was further confirmed by Western blotting using virus-specific antiserum (Figure S2). For each of the five viruses, three biological replicates were collected and subjected to RNA extraction. Each replicate consisted of upper leaf tissue pooled from four N. benthamiana plants.
Selection of Candidate Reference Genes
Sixteen genes commonly used as internal controls in previous studies , , , , were selected for investigation in order to identify the most stably expressed reference gene(s) in virus-infected N. benthamiana (Table 1). Specifically, the N. benthamiana orthologs of Arabidopsis sp. EF1α, 18S, GAPDH, L23, APR, PP2A, UBI3, GBP and SAMD nucleotide sequences were obtained by querying the DFCI N. benthamiana Gene Index  using BLASTN. Nicotiana benthamiana nucleotide sequences of ACT, TUB, UK, TIP41 and PPR were available from the GenBank database. For F-BOX and SAND genes, only a sequence of A. thaliana was found. Based on the recently released N. benthamiana whole genome sequence, a BLAST against the SOL Genomics Network database allowed us to identify the nucleotide sequences of N. benthamiana corresponding to F-BOX and SAND .
Total RNA Isolation and First Strand cDNA Synthesis
Total RNA was extracted from approximately 200 mg of freshly sampled leaf tissue using TRIzol reagent (Invitrogen, Carlsbad, CA, USA), according to the manufacturer’s instructions. Any genomic contamination was removed before cDNA synthesis using RNase-free DNase I (TaKaRa, Dalian, China), and according to the manufacturer’s protocols. Nucleic acid quality was estimated by visual analysis on 1.2% agarose gel electrophoresis, according to standard procedures . RNA concentrations were measured using a Nanodrop ND-1000 spectrophotometer (Nanodrop Technologies, Rockland, DE, USA) and only RNA samples with an A260/A280 ratio in the range 1.8–2.0 were used, in order to minimise the effects of PCR inhibitors. All RNA samples were stored at −80°C.
The first strand of cDNA was synthesised from 1.5 µg total RNA with the M-MLV reverse transcriptase and oligo (dT)15 primer (Promega, Madison, WI, USA) according to user instructions. In brief, total RNA samples were denatured at 95°C for 3 minutes in the presence of 10 pM oligo (dT)15 primer and then quickly cooled on ice. M-MLV reverse transcriptase and other reaction components were added to the samples. These were then incubated for 10 minutes at 37°C (primer annealing), followed by 90 minutes at 42°C and finally 10 minutes at 70°C to inactivate the enzyme. Reverse transcription (RT) negative controls, without the inclusion of the reverse transcriptase enzyme, were performed in parallel to test for the presence of genomic DNA contamination in RNA samples. Amplification was then conducted for all genes using RT-PCR, followed by assessment on a 4% agarose gel. No visible amplification was detected in any of the control samples (Figure S4B).
Primer Design, Verification of Selected Gene Amplicons and Gene-specific PCR Amplification Efficiency
For all genes, qRT–PCR primers were designed using the Primer Premier 5.0 software (Premier Biosoft International, Palo Alto, CA, USA) and Oligo 6 software (Molecular Biology Insights, Inc., Cascade, CO, USA). To ensure maximum specificity and efficiency during PCR amplification, a stringent set of criteria was used for primer design . This included predicted melting temperatures (Tm) of 58–60°C, primer lengths of 20–24 nucleotides, GC contents of 50–60% and PCR amplicon lengths of 80–150 bp. All primers were custom-ordered from a commercial supplier (Invitrogen, Shanghai, China).
To check the specificity of all primers, PCR was performed on cDNA and the size of all PCR products was verified on a 4% agarose gel (Figure S4A). PCR products were then purified using a QIAquick Gel Extraction Kit (Qiagen, Hilden, Germany), according to the manufacturer’s instructions, and cloned into pGEM-T Easy Vector (Promega, Madison, WI, USA), followed by sequencing.
The PCR amplification efficiency of each primer was calculated using the equation: Efficiency% = (10[-1/slope] −1)×100%, according to the MIQE guidelines for qRT–PCR experiments . This was presented using Bio-Rad CFX Manager software (version 1.6) on a standard curve generated from a two-fold dilution series of one sample at five dilution points for three technical replicates.
Quantitative Real-Time PCR
qRT–PCR was performed in 96-well plates using the CFX96 real-time PCR detection system (Bio-Rad, Hercules, CA, USA). Three different biological replicates for each virus infection (n = 12) were used (i.e. reverse-transcribed RNA extracted from four individual plants were pooled together). All cDNA samples were amplified in triplicate from the same RNA preparation and the mean value was considered (i.e. three technical replicates). Each reaction mixture consisted of 1 µl cDNA, 7 µl SsoFast EvaGreen Supermix (Bio-Rad, Hercules, CA, USA), 1.5 µl (3 pmol/µl) of both forward and reverse primers, and 3 µl PCR-grade water (TaKaRa, Dalian, China), equating to a final volume of 14 µl. The thermal profile of the reaction was an initial denaturation at 95°C for 3 minutes, followed by 40 cycles at 95°C for 10 seconds and 60°C for 10 seconds. This was followed by fluorescence acquisition after each cycle. Finally, a dissociation curve was generated by increasing temperature from 65 to 95°C, in order to verify primer specificity (Figure S3). All samples for each reference gene were run on the same plate to avoid between-run variations. Baseline and Ct values were automatically calculated by the CFX Manage version 1.6 software (Bio-Rad, Hercules, CA, USA) with default parameters.
Determination of Reference Gene Expression Stability Using GeNorm, NormFinder and BestKeeper
To identify the most appropriate genes in each experimental set, the stability of the mRNA expression of each reference gene was statistically analysed using three different types of Microsoft Excel-based software: geNorm , NormFinder , and BestKeeper . All three software packages were used according to the manufacturer’s instructions.
For geNorm, the raw Ct values were transformed into the required data input format. The maximum expression level (i.e. the lowest Ct value) of each gene was used as a control and was set = 1. Next, relative expression levels were calculated from Ct values using the formula: 2−ΔCt, in which ΔCt = each corresponding Ct value - minimum Ct value. Resultant data were further analysed using the geNorm program to calculate the mean pair-wise variation between an individual gene and all other tested candidate reference genes, the results were shown as expression stability (M). Candidate genes with the lowest M value were considered to be most stable under tested experimental conditions. Stepwise exclusion of the gene with the highest instability (highest M value) was performed and a new M value (average expression stability) for each remaining reference gene is calculated until the two most stable genes were left (Figure 2A). Since these calculations are based on ratios, the final two genes cannot be resolved from each other. NormFinder adopted the same input file format as the geNorm before calculation, while BestKeeper analyses were based on untransformed Ct values.
Relative Quantification of AGO2 and RdR6
AGO2 and RdR6 were chosen as genes of interest. PP2A, F-BOX and L23, the three most stably expressed genes identified by geNorm analysis, were also used in combination as a reference genes for the quantification of AGO2 and RdR6 expression. The normalisation factor was calculated as the geometric mean of PP2A, F-BOX and L23 for each sample. Mock-inoculated plants (treated with sap from healthy plants) were used as a control and calibrator sample. Relative quantification was performed using the Bio-Rad CFX Manager software (version 1.6), which employs a ΔΔC(t) algorithm with a PCR efficiency correction. Results can be automatically generated at the end of qRT–PCR.
Rapid increase in the number of research publications using N. benthamiana. Data were obtained from the WEB OF KNOWLEDGE database on the search term “nicotiana benthamiana”.
Molecular detection of different viruses in mock and upper un-inoculated leaves (Samples) of N. benthamiana. Western blot analysis of N. benthamiana leaves to confirm infection by six different RNA plant viruses. Proteins from systemically infected leaves were separated by SDS-PAGE and subject to Western blot using specific antiserum against the coat protein of TNV-AC, BBSV, BNYVV, BSMV, PVX and TRV, respectively. The molecular weights of the coat proteins of 6 plant viruses are indicated on the right side of each panel.
Specificity of qRT–PCR amplification. Dissociation curves of the 18 amplicons after the qRT–PCR reactions, all showing one peak.
Analysis of the performance of the designed primers listed in Table 1 by regular RT-PCR reactions. 4% agarose gel electrophoresis showing specific reverse transcription PCR products of the expected size for each reference gene, AGO2 and RdR6. M represents DNA size marker. (B) RT-PCR control reactions to assay for genomic DNA contamination by using an equivalent amount of total RNA without reverse transcription. No specific bands were detected. DNA markers are to the right (M).
Analysis of gene expression stability in N. benthamiana during TRV infection. (A) Average expression stability values (M) of 10 candidate reference genes calculated by geNorm. (B) Pairwise (V) to determine the optimal number of reference genes for normalisation. (C) Expression stability values of the candidate reference genes analysed by NormFinder. (D) The average Ct value of each triplicate reaction was used (without conversion) to analyse the candidate reference genes using BestKeeper. Bold characters indicate the basis for assessment of gene expression stability.
Northern blot analysis of the AGO2 RNA accumulation in systemic leaves of BBSV-infected N. benthamiana. “10” and “25” indicated that 10 µg and 25 µg of total RNA were used for Northern blot detection, respectively. Ethidium bromide staining of total RNA is shown below as a loading control.
The expression profile of AGO2 and RdR6 responsive to viral infections in N. benthamiana.(studied by qRT-PCR with PP2A, F-BOX and L23 as reference genes, respectively). Error bars represent the mean ± standard deviation for n = 12 (biological triplicate, each with technical triplicate).
Raw Ct data. The Excel spreadsheet contains the raw Ct data used for statistical analysis in this study.
Conceived and designed the experiments: JY LS YZ. Performed the experiments: D. Liu LS YZ. Analyzed the data: D. Liu YZ LS. Contributed reagents/materials/analysis tools: D. Liu YZ D. Li CH JY. Wrote the paper: YZ.
- 1. Bombarely A, Rosli HG, Vrebalov J, Moffett P, Mueller L, et al.. (2012) A draft genome sequence of Nicotiana benthamiana to enhance molecular plant-microbe biology research. Mol Plant Microbe Interact doi: 10.1094/mpmi-06-12-0148-ta.
- 2. Goodin M, Zaitlin D, Naidu R, Lommel S (2008) Nicotiana benthamiana: its history and future as a model for plant-pathogen interactions. Mol Plant Microbe Interact 21: 1015–1026. doi: 10.1094/MPMI-21-8-1015
- 3. Yang S-J, Carter SA, Cole AB, Cheng N-H, Nelson RS (2004) A natural variant of a host RNA-dependent RNA polymerase is associated with increased susceptibility to viruses by Nicotiana benthamiana. Proc Natl Acad Sci U S A 101: 6297–6302. doi: 10.1073/pnas.0304346101
- 4. Wang A (2012) Plant Virus-Mediated Expression in Molecular Farming. In: Wang A, Ma S, editors. Molecular Farming in Plants: Recent Advances and Future Prospects: Springer Netherlands. 199–216.
- 5. Lico C, Chen Q, Santi L (2008) Viral vectors for production of recombinant proteins in plants. J Cell Physiol 216: 366–377. doi: 10.1002/jcp.21423
- 6. Hefferon K (2011) Plant virus expression vectors as production platforms for biopharmaceutical proteins. Current Topics in Virology 9: 61–68. doi: 10.1016/j.virol.2012.06.012
- 7. Wang ZH, Fang SG, Xu JL, Sun LY, Li DW, et al. (2003) Sequence analysis of the complete genome of rice black-streaked dwarf virus isolated from maize with rough dwarf disease. Virus Genes 27: 163–168. doi: 10.1023/A:1025776527286
- 8. Sainsbury F, Cañizares MC, Lomonossoff GP (2010) Cowpea mosaic virus: the plant virus–based biotechnology workhorse. Annu Rev Phytopathol 48: 437–455. doi: 10.1146/annurev-phyto-073009-114242
- 9. Godge M, Purkayastha A, Dasgupta I, Kumar P (2008) Virus-induced gene silencing for functional analysis of selected genes. Plant Cell Rep 27: 209–219. doi: 10.1007/s00299-007-0460-2
- 10. Senthil-Kumar M, Mysore KS (2011) New dimensions for VIGS in plant functional genomics. Trends Plant Sci 16: 656–665. doi: 10.1016/j.tplants.2011.08.006
- 11. Becker A, Lange M (2010) VIGS – genomics goes functional. Trends Plant Sci 15: 1–4. doi: 10.1016/j.tplants.2009.09.002
- 12. Purkayastha A, Dasgupta I (2009) Virus-induced gene silencing: A versatile tool for discovery of gene functions in plants. Plant Physiol Biochem 47: 967–976. doi: 10.1016/j.plaphy.2009.09.001
- 13. Robertson D (2004) VIGS vectors for gene silencing: many targets, many tools. Annu Rev Plant Biol 55: 495–519. doi: 10.1146/annurev.arplant.55.031903.141803
- 14. Lu R, Martin-Hernandez AM, Peart JR, Malcuit I, Baulcombe DC (2003) Virus-induced gene silencing in plants. Methods 30: 296–303. doi: 10.1016/S1046-2023(03)00037-9
- 15. Senthil-Kumar M, Hema R, Anand A, Kang L, Udayakumar M, et al. (2007) A systematic study to determine the extent of gene silencing in Nicotiana benthamiana and other Solanaceae species when heterologous gene sequences are used for virus-induced gene silencing. New Phytol 176: 782–791. doi: 10.1111/j.1469-8137.2007.02225.x
- 16. Liu Y, Schiff M, Dinesh-Kumar SP (2002) Virus-induced gene silencing in tomato. Plant J 31: 777–786. doi: 10.1046/j.1365-313X.2002.01394.x
- 17. Ratcliff F, Martin-Hernandez AM, Baulcombe DC (2001) Technical Advance: Tobacco rattle virus as a vector for analysis of gene function by silencing. Plant J 25: 237–245. doi: 10.1046/j.0960-7412.2000.00942.x
- 18. Dong Y, Burch-Smith T, Liu Y, Mamillapalli P, Dinesh-Kumar S (2007) A ligation-independent cloning tobacco rattle virus vector for high-throughput virus-induced gene silencing identifies roles for NbMADS4–1 and-2 in floral development. Plant Physiol 145: 1161–1170. doi: 10.1104/pp.107.107391
- 19. Vaghchhipawala Z, Rojas CM, Senthil-Kumar M, Mysore KS (2011) Agroinoculation and agroinfiltration: simple tools for complex gene function analyses. In: Pereira A, editor. Plant Reverse Genetics. 65–76.
- 20. Grimsley N, Hohn B, Hohn T, Walden R (1986) “Agroinfection,” an alternative route for viral infection of plants by using the Ti plasmid. Proc Natl Acad Sci U S A 83: 3282–3286. doi: 10.1073/pnas.83.10.3282
- 21. Liu L, Lomonossoff GP (2002) Agroinfection as a rapid method for propagating Cowpea mosaic virus-based constructs. J Virol Methods 105: 343–348. doi: 10.1016/S0166-0934(02)00121-0
- 22. Leiser RM, Ziegler-Graff V, Reutenauer A, Herrbach E, Lemaire O, et al. (1992) Agroinfection as an alternative to insects for infecting plants with beet western yellows luteovirus. Proc Natl Acad Sci U S A 89: 9136–9140. doi: 10.1073/pnas.89.19.9136
- 23. Hackbusch J, Richter K, Müller J, Salamini F, Uhrig JF (2005) A central role of Arabidopsis thaliana ovate family proteins in networking and subcellular localization of 3-aa loop extension homeodomain proteins. Proc Natl Acad Sci U S A 102: 4908. doi: 10.1073/pnas.0501181102
- 24. Burgyán Jz, Havelda Zn (2011) Viral suppressors of RNA silencing. Trends Plant Sci 16: 265–272. doi: 10.1016/j.tplants.2011.02.010
- 25. Brigneti G, Voinnet O, Li WX, Ji LH, Ding SW, et al. (1998) Viral pathogenicity determinants are suppressors of transgene silencing in Nicotiana benthamiana. EMBO J 17: 6739–6746. doi: 10.1093/emboj/17.22.6739
- 26. Voinnet O, Rivas S, Mestre P, Baulcombe D (2003) An enhanced transient expression system in plants based on suppression of gene silencing by the p19 protein of tomato bushy stunt virus. Plant J 33: 949–956. doi: 10.1046/j.1365-313X.2003.01676.x
- 27. Moissiard G, Voinnet O (2004) Viral suppression of RNA silencing in plants. Mol Plant Pathol 5: 71–82. doi: 10.1111/j.1364-3703.2004.00207.x
- 28. Goodin MM, Dietzgen RG, Schichnes D, Ruzin S, Jackson AO (2002) pGD vectors: versatile tools for the expression of green and red fluorescent protein fusions in agroinfiltrated plant leaves. Plant J 31: 375–383. doi: 10.1046/j.1365-313X.2002.01360.x
- 29. Beauchemin C, Boutet N, Laliberté J-F (2007) Visualization of the interaction between the precursors of VPg, the viral protein linked to the genome of Turnip mosaic virus, and the translation eukaryotic initiation factor iso 4E in planta. J Virol 81: 775–782. doi: 10.1128/JVI.01277-06
- 30. Kobayashi M, Ohura I, Kawakita K, Yokota N, Fujiwara M, et al. (2007) Calcium-dependent protein kinases regulate the production of reactive oxygen species by potato NADPH oxidase. Plant Cell 19: 1065–1080. doi: 10.1105/tpc.106.048884
- 31. Bracha-Drori K, Shichrur K, Katz A, Oliva M, Angelovici R, et al. (2004) Detection of protein–protein interactions in plants using bimolecular fluorescence complementation. Plant J 40: 419–427. doi: 10.1111/j.1365-313X.2004.02206.x
- 32. Walter M, Chaban C, Schütze K, Batistic O, Weckermann K, et al. (2004) Visualization of protein interactions in living plant cells using bimolecular fluorescence complementation. Plant J 40: 428–438. doi: 10.1111/j.1365-313X.2004.02219.x
- 33. Park SY, Yu JW, Park JS, Li J, Yoo SC, et al. (2007) The senescence-induced staygreen protein regulates chlorophyll degradation. Plant Cell 19: 1649–1664. doi: 10.1105/tpc.106.044891
- 34. Zhang X, Yuan Y-R, Pei Y, Lin S-S, Tuschl T, et al. (2006) Cucumber mosaic virus-encoded 2b suppressor inhibits Arabidopsis Argonaute1 cleavage activity to counter plant defense. Genes Dev 20: 3255–3268. doi: 10.1101/gad.1495506
- 35. Nomura K, DebRoy S, Lee YH, Pumplin N, Jones J, et al. (2006) A bacterial virulence protein suppresses host innate immunity to cause plant disease. Science 313: 220–223. doi: 10.1126/science.1129523
- 36. Liu E, Page JE (2008) Optimized cDNA libraries for virus-induced gene silencing (VIGS) using tobacco rattle virus. Plant Methods 4: 1–13. doi: 10.1186/1746-4811-4-1
- 37. Lu R, Malcuit I, Moffett P, Ruiz MT, Peart J, et al. (2003) High throughput virus-induced gene silencing implicates heat shock protein 90 in plant disease resistance. EMBO J 22: 5690–5699. doi: 10.1093/emboj/cdg546
- 38. Takahashi Y, Nasir KHB, Ito A, Kanzaki H, Matsumura H, et al. (2007) A high-throughput screen of cell-death-inducing factors in Nicotiana benthamiana identifies a novel MAPKK that mediates INF1-induced cell death signaling and non-host resistance to Pseudomonas cichorii. Plant J 49: 1030–1040. doi: 10.1111/j.1365-313X.2006.03022.x
- 39. Anand A, Vaghchhipawala Z, Ryu C-M, Kang L, Wang K, et al. (2007) Identification and characterization of plant genes involved in Agrobacterium-mediated plant transformation by virus-induced gene silencing. Mol Plant Microbe Interact 20: 41–52. doi: 10.1094/MPMI-20-0041
- 40. Pineda M, Sajnani C, Barón M (2010) Changes induced by the Pepper mild mottle tobamovirus on the chloroplast proteome of Nicotiana benthamiana. Photosynth Res 103: 31–45. doi: 10.1007/s11120-009-9499-y
- 41. Zhang Y, Zhang X, Niu S, Han C, Yu J, et al. (2011) Nuclear localization of Beet black scorch virus capsid protein and its interaction with importin α. Virus Res 155: 307–315. doi: 10.1016/j.virusres.2010.10.029
- 42. Dardick C (2007) Comparative expression profiling of Nicotiana benthamiana leaves systemically infected with three fruit tree viruses. Mol Plant Microbe Interact 20: 1004–1017. doi: 10.1094/MPMI-20-8-1004
- 43. Senthil G, Liu H, Puram VG, Clark A, Stromberg A, et al. (2005) Specific and common changes in Nicotiana benthamiana gene expression in response to infection by enveloped viruses. J Gen Virol 86: 2615–2625. doi: 10.1099/vir.0.81043-0
- 44. Nolan T, Hands RE, Bustin SA (2006) Quantification of mRNA using real-time RT-PCR. Nat Protoc 1: 1559–1582. doi: 10.1038/nprot.2006.236
- 45. Bustin S, Benes V, Nolan T, Pfaffl M (2005) Quantitative real-time RT-PCR– a perspective. J Mol Endocrinol 34: 597–601. doi: 10.1677/jme.1.01755
- 46. Bustin S (2002) Quantification of mRNA using real-time reverse transcription PCR (RT-PCR): trends and problems. J Mol Endocrinol 29: 23–39. doi: 10.1677/jme.0.0290023
- 47. Huggett J, Dheda K, Bustin S, Zumla A (2005) Real-time RT-PCR normalisation; strategies and considerations. Genes Immun 6: 279–284. doi: 10.1038/sj.gene.6364190
- 48. Pfaffl MW (2001) A new mathematical model for relative quantification in real-time RT–PCR. Nucleic Acids Res 29: e45–e45. doi: 10.1093/nar/29.9.e45
- 49. Guénin S, Mauriat M, Pelloux J, Van Wuytswinkel O, Bellini C, et al. (2009) Normalization of qRT-PCR data: the necessity of adopting a systematic, experimental conditions-specific, validation of references. J Exp Bot 60: 487–493. doi: 10.1093/jxb/ern305
- 50. Gutierrez L, Mauriat M, Guénin S, Pelloux J, Lefebvre J-F, et al. (2008) The lack of a systematic validation of reference genes: a serious pitfall undervalued in reverse transcription-polymerase chain reaction (RT-PCR) analysis in plants. Plant Biotechnol J 6: 609–618. doi: 10.1111/j.1467-7652.2008.00346.x
- 51. Watson S, Mercier S, Bye C, Wilkinson J, Cunningham AL, et al. (2007) Determination of suitable housekeeping genes for normalisation of quantitative real time PCR analysis of cells infected with human immunodeficiency virus and herpes viruses. Virol J 4: 130. doi: 10.1186/1743-422X-4-130
- 52. Lilly ST, Drummond RSM, Pearson MN, MacDiarmid RM (2011) Identification and validation of reference genes for normalization of transcripts from virus-infected Arabidopsis thaliana. Mol Plant Microbe Interact 24: 294–304. doi: 10.1094/MPMI-10-10-0236
- 53. Mascia T, Santovito E, Gallitelli D, Cillo F (2010) Evaluation of reference genes for quantitative reverse-transcription polymerase chain reaction normalization in infected tomato plants. Mol Plant Pathol 11: 805–816. doi: 10.1111/j.1364-3703.2010.00646.x
- 54. Jarošová J, Kundu J (2010) Validation of reference genes as internal control for studying viral infections in cereals by quantitative real-time RT-PCR. BMC Plant Biol 10: 146. doi: 10.1186/1471-2229-10-146
- 55. Dean J, Goodwin P, Hsiang T (2002) Comparison of relative RT-PCR and northern blot analyses to measure expression of β-1,3-glucanase in Nicotiana benthamiana infected with Colltotrichum destructivum. Plant Mol Biol Report 20: 347–356.
- 56. Kumar V, Sharma R, Trivedi P, Vyas GK, Khandelwal V (2011) Traditional and novel references towards systematic normalization of qRT-PCR data in plants. Aust J Crop Sci 5: 1455.
- 57. Miranda GJ, Azzam O, Shirako Y (2000) Comparison of nucleotide sequences between northern and southern Philippine isolates of rice grassy stunt virus indicates occurrence of natural genetic reassortment. Virology 266: 26–32. doi: 10.1006/viro.1999.0068
- 58. Vandesompele J, De Preter K, Pattyn F, Poppe B, Van Roy N, et al. (2002) Accurate normalization of real-time quantitative RT-PCR data by geometric averaging of multiple internal control genes. Genome biology 3: research0034. doi: 10.1186/gb-2002-3-7-research0034
- 59. Andersen CL, Jensen JL, Ørntoft TF (2004) Normalization of real-time quantitative reverse transcription-PCR data: A model-based variance estimation approach to identify genes suited for normalization, applied to bladder and colon cancer data sets. Cancer Res 64: 5245–5250. doi: 10.1158/0008-5472.CAN-04-0496
- 60. Pfaffl MW, Tichopad A, Prgomet C, Neuvians TP (2004) Determination of stable housekeeping genes, differentially regulated target genes and sample integrity: BestKeeper – Excel-based tool using pair-wise correlations. Biotechnol Lett 26: 509–515. doi: 10.1023/B:BILE.0000019559.84305.47
- 61. Rotenberg D, Thompson TS, German TL, Willis DK (2006) Methods for effective real-time RT-PCR analysis of virus-induced gene silencing. J Virol Methods 138: 49–59. doi: 10.1016/j.jviromet.2006.07.017
- 62. Lee JM, Roche JR, Donaghy DJ, Thrush A, Sathish P (2010) Validation of reference genes for quantitative RT-PCR studies of gene expression in perennial ryegrass (Lolium perenne L.). BMC Mol Biol 11: 8. doi: 10.1186/1471-2199-11-8
- 63. Ding SW (2010) RNA-based antiviral immunity. Nat Rev Immunol 10: 632–644. doi: 10.1038/nri2824
- 64. Artico S, Nardeli S, Brilhante O, Grossi-de-Sa M, Alves-Ferreira M (2010) Identification and evaluation of new reference genes in Gossypium hirsutum for accurate normalization of real-time quantitative RT-PCR data. BMC Plant Biol 10: 49. doi: 10.1186/1471-2229-10-49
- 65. Yuan C, Li C, Yan L, Jackson AO, Liu Z, et al. (2011) A high throughput Barley stripe mosaic virus vector for virus induced gene silencing in monocots and dicots. PLoS ONE 6: e26468. doi: 10.1371/journal.pone.0026468
- 66. Mafra Vr, Kubo KS, Alves-Ferreira M, Ribeiro-Alves M, Stuart RM, et al. (2012) Reference genes for accurate transcript normalization in citrus genotypes under different experimental conditions. PLoS ONE 7: e31263. doi: 10.1371/journal.pone.0031263
- 67. Tu LL, Zhang XL, Liu DQ, Jin SX, Cao JL, et al. (2007) Suitable internal control genes for qRT-PCR normalization in cotton fiber development and somatic embryogenesis. Chin Sci Bull 52: 3110–3117. doi: 10.1007/s11434-007-0461-0
- 68. Demidenko NV, Logacheva MD, Penin AA (2011) Selection and validation of reference genes for quantitative real-time PCR in buckwheat (Fagopyrum esculentum) based on transcriptome sequence data. PLoS ONE 6: e19434. doi: 10.1371/journal.pone.0019434
- 69. Reid K, Olsson N, Schlosser J, Peng F, Lund S (2006) An optimized grapevine RNA isolation procedure and statistical determination of reference genes for real-time RT-PCR during berry development. BMC Plant Biol 6: 27. doi: 10.1186/1471-2229-6-27
- 70. Wood AJ, Duff RJ, Oliver MJ (2000) The translational apparatus of Tortula ruralis: polysomal retention of transcripts encoding the ribosomal proteins RPS14, RPS16 and RPL23 in desiccated and rehydrated gametophytes. J Exp Bot 51: 1655–1662. doi: 10.1093/jexbot/51.351.1655
- 71. Wan H, Zhao Z, Qian C, Sui Y, Malik AA, et al. (2010) Selection of appropriate reference genes for gene expression studies by quantitative real-time polymerase chain reaction in cucumber. Anal Biochem 399: 257–261. doi: 10.1016/j.ab.2009.12.008
- 72. Castro P, Román B, Rubio J, Die JV (2012) Selection of reference genes for expression studies in Cicer arietinum L.: analysis of cyp81E3 gene expression against Ascochyta rabiei. Mol Breed 29: 261–274. doi: 10.1007/s11032-010-9544-8
- 73. Paolacci A, Tanzarella O, Porceddu E, Ciaffi M (2009) Identification and validation of reference genes for quantitative RT-PCR normalization in wheat. BMC Mol Biol 10: 11. doi: 10.1186/1471-2199-10-11
- 74. Hong SY, Seo P, Yang MS, Xiang F, Park CM (2008) Exploring valid reference genes for gene expression studies in Brachypodium distachyon by real-time PCR. BMC Plant Biol 8: 112. doi: 10.1186/1471-2229-8-112
- 75. Chang E, Shi S, Liu J, Cheng T, Xue L, et al. (2012) Selection of reference genes for quantitative gene expression studies in Platycladus orientalis (Cupressaceae) using real-time PCR. PLoS ONE 7: e33278. doi: 10.1371/journal.pone.0033278
- 76. Aranda MA, Escaler M, Wang D, Maule AJ (1996) Induction of HSP70 and polyubiquitin expression associated with plant virus replication. Proc Natl Acad Sci U S A 93: 15289–15293. doi: 10.1073/pnas.93.26.15289
- 77. Brunner A, Yakovlev I, Strauss S (2004) Validating internal controls for quantitative plant gene expression studies. BMC Plant Biol 4: 14. doi: 10.1186/1471-2229-4-14
- 78. Hu R, Fan C, Li H, Zhang Q, Fu Y-F (2009) Evaluation of putative reference genes for gene expression normalization in soybean by quantitative real-time RT-PCR. BMC Mol Biol 10: 93. doi: 10.1186/1471-2199-10-93
- 79. Li H, Qin Y, Xiao X, Tang C (2011) Screening of valid reference genes for real-time RT-PCR data normalization in Hevea brasiliensis and expression validation of a sucrose transporter gene HbSUT3. Plant Sci 181: 132–139. doi: 10.1016/j.plantsci.2011.04.014
- 80. Marum L, Miguel A, Ricardo CP, Miguel C (2012) Reference gene selection for quantitative real-time PCR normalization in Quercus suber. PLoS ONE 7: e35113. doi: 10.1371/journal.pone.0035113
- 81. Vaistij FE, Jones L (2009) Compromised virus-induced gene silencing in RDR6-deficient plants. Plant Physiol 149: 1399–1407. doi: 10.1104/pp.108.132688
- 82. Ying XB, Dong L, Zhu H, Duan CG, Du QS, et al. (2010) RNA-dependent RNA polymerase 1 from Nicotiana tabacum suppresses RNA silencing and enhances viral infection in Nicotiana benthamiana. Plant Cell 22: 1358–1372. doi: 10.1105/tpc.109.072058
- 83. Harvey JJW, Lewsey MG, Patel K, Westwood J, Heimstädt S, et al. (2011) An antiviral defense role of AGO2 in plants. PLoS ONE 6: e14639. doi: 10.1371/journal.pone.0014639
- 84. Jaubert M, Bhattacharjee S, Mello AFS, Perry KL, Moffett P (2011) ARGONAUTE2 Mediates RNA-Silencing Antiviral Defenses against Potato virus X in Arabidopsis. Plant Physiol 156: 1556. doi: 10.1104/pp.111.178012
- 85. Scholthof HB, Alvarado VY, Vega-Arreguin JC, Ciomperlik J, Odokonyero D, et al. (2011) Identification of an ARGONAUTE for antiviral RNA silencing in Nicotiana benthamiana. Plant Physiol 156: 1548. doi: 10.1104/pp.111.178764
- 86. Ren B, Guo Y, Gao F, Zhou P, Wu F, et al. (2010) Multiple functions of Rice fwarf phytoreovirus Pns10 in suppressing systemic RNA silencing. J Virol 84: 12914–12923. doi: 10.1128/JVI.00864-10
- 87. Yuan X, Cao Y, Xi D, Guo L, Han C, et al. (2006) Analysis of the subgenomic RNAs and the small open reading frames of Beet black scorch virus. J Gen Virol 87: 3077–3086. doi: 10.1099/vir.0.81928-0
- 88. Li J, Li M, Li C, Gao Y, Li D, et al. (2008) Effects on the local symptoms of subgenomic RNAs expressions and their translational products of Tobacco necrosis virus A Chinese isolate. Chin Sci Bull 53: 1682–1690. doi: 10.1111/j.0014-3820.2000.tb00553.x
- 89. Wang Y, Fan H, Wang X-B, Li M, Han C, et al. (2011) Detection and characterization of spontaneous internal deletion mutants of Beet Necrotic yellow vein virus RNA3 from systemic host Nicotiana benthamiana. Virol J 8: 335. doi: 10.1186/1743-422X-8-335
- 90. Zhou B, Zhang Y, Wang X, Dong J, Wang B, et al. (2010) Oral administration of plant-based rotavirus VP6 induces antigen-specific IgAs, IgGs and passive protection in mice. Vaccine 28: 6021–6027. doi: 10.1016/j.vaccine.2010.06.094
- 91. Computational Biology and Functional Genomics Laboratory at the Dana-Farber Cancer Institute and Harvard School of Public Health website. Available: http://compbio.dfci.harvard.edu/cgi-bin/tgi/gimain.pl?gudb=n_benthamiana. Accessed 2012 Sept 5.
- 92. Sol Genomics Network website. Available: http://solgenomics.net/organism/Nicotiana_benthamiana/genome. Accessed 2012 Sept 5.
- 93. Sambrook J, Russell DW (2001) Molecular Cloning: A Laboratory Manual. New York: Cold Spring Harbor Laboratory Press.
- 94. Udvardi MK, Czechowski T, Scheible WR (2008) Eleven golden rules of quantitative RT-PCR. Plant Cell 20: 1736–1737. doi: 10.1105/tpc.108.061143
- 95. Bustin SA, Benes V, Garson JA, Hellemans J, Huggett J, et al. (2009) The MIQE guidelines: minimum information for publication of quantitative real-time PCR experiments. Clin Chem 55: 611–622. doi: 10.1373/clinchem.2008.112797