Figures
Abstract
Constraints arise naturally in many scientific experiments/studies such as in, epidemiology, biology, toxicology, etc. and often researchers ignore such information when analyzing their data and use standard methods such as the analysis of variance (ANOVA). Such methods may not only result in a loss of power and efficiency in costs of experimentation but also may result poor interpretation of the data. In this paper we discuss constrained statistical inference in the context of linear mixed effects models that arise naturally in many applications, such as in repeated measurements designs, familial studies and others. We introduce a novel methodology that is broadly applicable for a variety of constraints on the parameters. Since in many applications sample sizes are small and/or the data are not necessarily normally distributed and furthermore error variances need not be homoscedastic (i.e. heterogeneity in the data) we use an empirical best linear unbiased predictor (EBLUP) type residual based bootstrap methodology for deriving critical values of the proposed test. Our simulation studies suggest that the proposed procedure maintains the desired nominal Type I error while competing well with other tests in terms of power. We illustrate the proposed methodology by re-analyzing a clinical trial data on blood mercury level. The methodology introduced in this paper can be easily extended to other settings such as nonlinear and generalized regression models.
Citation: Farnan L, Ivanova A, Peddada SD (2014) Linear Mixed Effects Models under Inequality Constraints with Applications. PLoS ONE 9(1): e84778. https://doi.org/10.1371/journal.pone.0084778
Editor: Xiaofeng Wang, Cleveland Clinic Lerner Research Institute, United States of America
Received: June 17, 2013; Accepted: November 18, 2013; Published: January 21, 2014
This is an open-access article, free of all copyright, and may be freely reproduced, distributed, transmitted, modified, built upon, or otherwise used by anyone for any lawful purpose. The work is made available under the Creative Commons CC0 public domain dedication.
Funding: The research of SDP was supported by the Intramural Research Program of the NIEHS, National Institutes of Health (Z01 ES102345-04). LF and AI work was supported in part by National Institutes of Health grant RO1 CA120082-01A1. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: Dr. Peddada is a PLOS ONE Editorial Board member and also currently serving as an Academic Editor of PLOS ONE. Dr. Peddada confirms that this does not alter the authors' adherence to all the PLOS ONE policies on sharing data and materials.
Introduction
In many applications researchers are typically interested in testing for trends or patterns in mean response among two or more experimental or study groups rather than just testing if the groups are different or not. For instance, toxicologists are typically interested in detecting dose-related trends in mean response such as trends in tumor incidence as the dose of a toxin increases [1]–[2]. In cell and circadian biology researchers are often interested in the phase order of genes participating in cell cycle or the circadian clock [3]–[10]. In all such situations researchers are interested in testing for an order among statistical parameters. By performing standard statistical procedures, e.g. the F-test in the case of Euclidean space data, all a researcher can conclude is that there is at least one group which is different from the rest of the experimental groups (in the parameter of interest). Such a conclusion is not very useful if the researcher is interested in proving that the mean response is increasing with dose of the toxin. Furthermore, as noted from the simulation study reported in Figure 1, the power of the standard ANOVA based F-test can be substantially smaller than the power of a test that is designed to detect trend in mean response. For example, note that for a total sample size of 48 (i.e. n = 12 per group), the standard ANOVA based F-test yields of power of 0.58 whereas the Williams’ constrained test for trend (which will be described in detail later in this article) yields a power 0.81. Conversely, as also noted in Figure 1, the sample size needed by Williams’ constrained test for a power of approximately 0.80 is 48 whereas the F-test would require a total sample size of 76. This simple motivating example illustrates our point that, in addition to being scientifically relevant, a greater efficiency can be achieved by using statistical methods that take into consideration the investigator’s true hypothesis of interest rather than performing a generic methodology, as often done in scientific literature.
The power of the Williams test was estimated by averaging 1000 simulated where the critical values are estimated using 10,000 bootstrap samples. The power for F-test was determined using PROC POWER in SAS (9.0). The null hypothesis was that the means of the four dose groups were equal (and zero) and the alternative hypothesis was that the means of the four dose groups have an increasing trend with dose. Data representing the four dose groups were simulated from normal populations with dose means taken to be 0, 0.1, 0.5 and 1, respectively. The actual values of the doses are irrelevant for the two methods described here. The population standard deviation for the four populations was taken to be 1. Corresponding to the 14 different patterns of total sample sizes, namely, 20, 24, 28, 32, 36, 40, 44, 48, 52, 60, 76, 80, 100, 116, the powers of the two methods are plotted. The Type I error was set to 0.05.
The field of statistics that deals with statistical methods designed to test ordered or constrained hypotheses is commonly called order restricted inference or constrained statistical inference. There exists a very large body of literature on order restricted (constrained inference) spanning nearly sixty years with four books written on the subject, including a recent book by Silvapulle and Sen [11]. Furthermore, for testing for some commonly encountered inequalities in the absence of any covariates in high dimensional data (e.g. gene expression studies), a freely downloadable software called ORIOGEN (Order Restricted Inference for Ordered Gene Expression) (http://www.niehs.nih.gov/research/resources/software/biostatistics/oriogen/) was developed in [12], [13].
In many applications it is common for researchers to be interested in comparing the population means of two or more experimental conditions or groups after adjusting for covariates. Depending upon the study design, as in repeated measurement designs, it is common to use linear mixed effects models to account for the underlying dependence structure as well as the covariates. There exists several decades of literature on statistical inference in linear mixed effects models and numerous books have been written on the subject [14]. The standard statistical test for comparing several population means in a linear mixed effects model framework is the classical F-test which is widely used and is available in most standard software packages such as SAS, R and others. However, as noted earlier, by rejecting the null hypothesis using the standard F-test one can only infer that at least one population mean is different from the others and hence it may not be ideal for ordered alternatives.
In the absence of any covariates, especially continuous covariates, Mukerjee [15] noted that the usual tests for order restrictions on the means of independent normal populations can be extended to the case when normal populations are correlated as in a repeated measurements design. Later Silvapulle [16] generalized the methodology of [15] to some unbalanced designs with incomplete data. He noted that within-subject correlations make it difficult to generalize some tests into repeated measurement models. Earlier, Singh and Wright [17] considered order-restricted inference on fixed effects in a two-factor mixed model. They presented an analogue to the usual F-test for homogeneity and obtained several closed-form results.
It was not until [18]–[20] that statistical inference under inequality constraints in linear mixed effects models was formally addressed. In particular [18] developed an asymptotic likelihood ratio test (LRT) for linear mixed effects model under homoscedastic errors. Since the asymptotic null distribution of LRT depends upon nuisance parameters, they also provided suitable bounds for the distribution using central chi-square distributions with appropriate degrees of freedom. Although these bounds are convenient, our simulation studies suggest that they could potentially be too conservative, especially when the sample sizes are small. Also, the basic assumption made in [18] is that the random effects as well as random errors of the linear model are homoscedastic and normally distributed. In practice this may not necessarily be true. Motivated by the need for a methodology that is robust to non-normality and heteroscedasticity, in Section 2 we provide a general framework using the MINQUE ([14], [21], [22]) and EBLUP type residual based bootstrap [23] to test for any arbitrary linear inequality among means in a linear mixed effects model with possibly heteroscedastic errors.
We present the methodology in Section 2. Results of our simulation study are reported in Section 3. The proposed methodology is illustrated in Section 4 using data from a clinical trial comparing succimer treatment to placebo in children exposed to mercury [24].
Statistical inference under constraints
2.1 The model and notations
denote a linear mixed effects models where is the vector of treatment effects of the order
,
is a design matrix of the order
consisting of 0s and 1s,
is a known matrix of covariates of the order
with corresponding (unknown) regression parameter vector
of the order
, and
is a
matrix of known design constants. For convenience, we denote
and
, where
is of order
, with
, and
of order
, where
. The observation vector
is of the order
and the unobservable random vectors
and
are independently distributed with mean
and covariance matrices
and
, respectively, with
. Each
,
is a random vector of order
Motivated by applications and for generality we assume a heteroscedastic error structure for
, where
and
are unknown variances with
.
Let denote a
matrix of known constants, such that
is an
estimable linear function (i.e.
, where
denotes the column space of a matrix). The problem of interest is to test hypotheses of the form:
, (2)
where the inequalities are component-wise, with at least one strict inequality. For example, if one is interested in testing a simple order among the components of
, then
where
is the null matrix of suitable order and
The matrix A can be suitably defined in the case of simple tree order
or the umbrella order
, for some r, etc.
2.2 The likelihood ratio test
Suppose and
are independently and multivariate normally distributed with log-likelihood function denoted by
. Let (
) denote the maximum likelihood estimators (MLE) of
under no constraints and let (
) denote the restricted MLE (RMLE) under the alternative hypothesis (2). Then the likelihood ratio test (LRT) statistic is given by
. Following the arguments in [18] asymptotically, under the null hypothesis, we obtain the following limiting distribution for LRT:
(3)
The weights in (3) involve unknown variance components
and
. Since in practice one does not know the variance components, one may plug in the estimated values for the unknown variance components in the above limiting distribution [11]. Such plug-in estimators do not perform well unless the sample size is very large. Furthermore, as the number of treatment groups increases, the computation of the weights
in (3) is a challenging problem. Recognizing this challenge, simple central chi-square distribution based bounds for the limiting probability in (3) were derived in [18]. These probabilities can be used for deriving bounds for the asymptotic p-values.
2.3 The residual bootstrap based test
There are three differences between our approach and the above LRT approach. Firstly, rather than using the RMLE which, at each step of the iteration, projects the unconstrained estimator onto the set of constraints in the alternative hypothesis, we use the algorithm described in [25]. The estimation algorithm in [25] is identical to the pool adjacent violators algorithm (PAVA) when the constraint is a simple order, otherwise it is a modification of PAVA. Our choice of PAVA is motivated by the fact that RMLE can potential fail under some conditions [25]. Briefly, the PAVA is implemented as follows. Consider a sequence of three numbers
,
and
, and suppose in theory these numbers are expected to be non-decreasing. However, suppose the observed values are 3, 1 and 4, respectively. The expected order is violated by the first two numbers and therefore the PAVA averages the two violators, resulting in the ordered numbers
and 4. Depending upon the situation, one could use weighted averages rather than simple average. As noted in the flow chart provided in Figure 2, our constrained estimation algorithm is flexible as one can replace PAVA type estimator [25] by the orthogonal projection estimator along the lines of [18]. Details of our algorithm (Algorithm A.1) are provided in the Appendix S1. Secondly, as noted above, because the asymptotic distribution of the LRT is non-trivial to use in practice we use a computationally simple non-parametric bootstrap to derive the p-values. Lastly, as an alternative to LRT statistic we use a Williams’ type test statistic [26]–[28]. Intuitively, the Williams’ test for monotonic order is a generalization to the idea of standard t-test with the exception that the numerator is the difference between the estimates of the largest parameter and smallest parameter, where the estimates are obtained by using the PAVA.
Let denote the PAVA type constrained estimator derived according to the algorithm proposed in this paper (Figure 2). Then as in [29] we may define Williams’ type test statistic [26]–[28] for various order restrictions. In the following we provide the test statistic for three commonly encountered order restrictions. In each case the null hypothesis is
. For the others one may appeal to the general framework provided in [26].
Umbrella order (
).
where is the estimated variance of the contrast
.
The bootstrap methodology to obtain the p-values is described in the flow chart in Figure 3 and the details are provided in Algorithm A.2 in the Appendix S1. Although in this paper we are using the Williams’ type statistic W, one may use a likelihood ratio type statistic (or any other constrained test statistic of user’s choice) instead of W but use residual bootstrap described in this paper for deriving the p-values. Such a strategy may result in a better power for some patterns of the mean parameters. Thus the framework developed in this paper is fairly flexible.
Simulation study
3.1 Study design
We evaluated the Type I error and power of the proposed EBLUP bootstrap test for the case of simple order using the proposed statistic (4). We compared our method with the asymptotic likelihood ratio test [18] using the upper bound in the equation (4.6) of [18] for deriving the critical values. We considered a variety of patterns of parameters and covariance matrices as follows:
Normally distributed data.
The data were simulated using model (1) with the number of subjects per each treatment ,
,
, a
design matrix consisting of 0’s and 1’s,
, where u was generated as a
vector, with its components uniformly distributed in [0, 2],
, a corresponding regression parameter,
,
, a
vector of independent subject random effects, and
a
vector of 1s. The random vectors
were independently and normally distributed with means 0 and covariance matrices
and
, where
. Simulations were performed for
= 3, 5 treatment groups,
subjects per each treatment and five different patterns of treatment means
: (P1) (0,0,..., 0), (P2) (0,..., 0, a), (P3) (0, a,..., a), (P4) (a, 2a,...,
a), (P5) (0, a,..., a, 2a).
Here different values of a in the interval [0, 2] were chosen arbitrarily to get a sense of power for a variety of patterns. Note that pattern (P1) corresponds to the null pattern for computing Type I error. Patterns (P2) to (P5) are patterns of where the components satisfy a simple order constraint
for evaluating the power of the two test procedures. Two different structures of
were considered, namely, homoscedastic error structure with
and heteroscedastic error structure with
, where
is the number of treatments, and
are unknown variances with
. The patterns of
and
considered in our simulations are as follows:
- Homoscedastic case: We fixed
and considered three patterns of
, namely
.
- Heteroscedastic case: We fixed
and, as commonly done, we chose the error variance to be a function of the mean, namely
, where
. In the case of null hypothesis, i.e.,
we chose
3.2 Results
Complete simulation scenarios and results are presented in Tables 1–6. Both tests operate at the desired nominal Type I error rate, although sometimes the asymptotic likelihood ratio test tends to be slightly conservative. Generally the proposed test is substantially more powerful than the asymptotic likelihood ratio test. In some cases the gains in power are as much as 0.36, e.g. 0.78 vs. 0.42 for heteroscedastic normally distributed data with .
Illustration
We illustrate the proposed methodology using data from patients in a randomized placebo-controlled, double-blind clinical trial the Treatment of Lead-exposed Children trial, or TLC [30]. In TLC, 384 children aged 12–33 months were assigned to the placebo group and 396 to the succimer group. In the succimer group, up to three 26-day courses were administered. Cao et al. [24] measured and analyzed mercury levels in pre-treatment to investigate whether succimer, a mercaptan compound known to reduce blood lead concentration in children, also reduces blood mercury concentration. At the baseline, blood mercury levels were quantified in 657 samples (338 succimer and 319 placebo). At 1-week post treatment, total mercury concentration was quantified in 623 samples (313 succimer and 310 placebo). After 5 months of treatment, blood mercury levels were quantified in 61 samples: 30 succimer treated children and 31 placebo treated children. To investigate the efficacy of succimer treatment relative to placebo, Cao et al. [24] tested for an increasing trend over time in the difference between the mean mercury concentrations in the succimer group and the placebo group, after adjusting for child’s age, sex, race and the study center. The authors concluded that there was no significant trend in the mean difference in mercury concentrations in the succimer group and the placebo group. Since their analysis ignored the covariance structure induced by repeated measurements, we reanalyzed the data using the proposed methodology which accounts for the repeated measurements in the data. We fitted a linear mixed effects model with log organic mercury as a dependent variable, treatment, race, gender, center and age as fixed effects, and subject as a random effect. The normal quantile-quantile plots (Figure 4) of resulting studentized residuals in the placebo and succimer groups suggest that the data are potentially non-normally distributed.
Denoting the difference in the mean log mercury levels at the tth time between placebo and succimer groups as by (t = 1 for baseline, t = 2 for 1-week and t = 3 for 5-months) we tested the following hypothesis:
with at least one strict inequality. The three UMLEs were 0.59, 0.92, 0.73 and the MINQUE-based constrained estimates were 0.59, 0.82, 0.82. Using the proposed test we obtained a bootstrap p-value of 0.109. Thus, we are not able to reject the null hypothesis in favor of a trend in the difference in means. These results are consistent with conclusions of [24], that succimer chelation for low level organic mercury exposure in children has limited efficacy.
Summary and Concluding Remarks
Inequality constraints arise naturally in many applications, such as toxicology, where researchers are interested in studying dose-response of a chemical, or gene expression studies in oncology, where a researcher may be interested in understanding the changes in gene expression according to cancer stage. We proposed a new method to test for inequality constraints. Since the method uses Rao’s MINQUE theory (cf. [22]) for estimating variance components and PAVA for estimating the means, it does not necessarily require normality. In the simple order restriction, our extensive simulation studies suggest that the proposed methodology provides a better control of type I error than the asymptotic likelihood ratio test of [18] when the data are non-normally distributed. Our proposed methodology seems to control the Type I error at the desired nominal level.
In the manuscript we considered one-dimensional order constraints. In toxicology, researchers are often interested in dose time response surfaces, which results in a two-way classification that can be expressed as a constrained inference problem with constraints on rows and columns of a matrix. The proposed testing procedure can be easily extended to deal with such cases.
Supporting Information
Appendix S1.
Description of Algorithms A.1 and A.2.
https://doi.org/10.1371/journal.pone.0084778.s001
(DOCX)
Acknowledgments
Authors thank Grace Kissling and Bahjat Qaqish for their careful reading of the manuscript and for their comments that helped improve the presentation of the paper. Authors also thank Drs. Rogan and Cao for providing us the data that were analyzed in this paper.
Author Contributions
Conceived and designed the experiments: SDP. Performed the experiments: LF. Analyzed the data: LF. Wrote the paper: SDP LF AI.
References
- 1.
Dinse GE (1985) Testing for a trend in tumor prevalence rates: I. Nonlethal tumors. Biometrics, 41, : 751–770.
- 2. Peddada SD, Dinse G, Kissling G (2007) Incorporating Historical Control Data When Comparing Tumor Incidence Rates. . J. Amer. Stat. Assoc. 102: 1212–1220.
- 3. Lelandais G, Saint-Georges Y, Geneix C, Al-Shikhley L, Dujardin G, et al. (2009) Spatio-Temporal Dynamics of Yeast Mitochondrial Biogenesis: Transcriptional and Post-Transcriptional mRNA Oscillatory Modules. PLoS Comput Biol 5(6): e1000409
- 4.
Jensen LJ, Jensen TS, de Lichtenberg U, Brunak S, Bork P (2006) Co-evolution of transcriptional and posttranslational cell-cycle regulation. Nature. 443|5. doi:10.1038/nature05186.
- 5. Rustici G, Mata J, Kivinen K, Lio P, Penkett CJ, et al. (2004) Periodic gene expression program of the fission yeast cell cycle. . Nature Genet. 36: 809–817.
- 6. Bahler J (2005) Cell-cycle control of gene expression in budding and fission yeast. . Annu. Rev. Genet. 39: 69–94.
- 7. Oliva A, Rosebrock A, Ferrezuelo F, Pyne S, Chen H, et al. (2005) The cell cycle-regulated genes of Schizosaccharomyces pombe. PLoS Biol. 3(7): 1239–1260.
- 8.
Fernandez M, Rueda C, Peddada SD (2012) Identification of a core set of signature cell-cycle genes whose relative order of time to peak expression is conserved across species. Nucleic Acids Research, 40: : 2823–32. Epub 2011/12/03. doi: 10.1093/nar/gkr1077.
- 9.
Kondratova AA, Kondratov RV (2012) The circadian clock and pathology of the ageing brain. Nature Reviews Neuroscience, doi:10.1038/nrn3208
- 10. Hastings MH, Reddy AB, Maywood ES (2003) A clockwork web: circadian timing in brain and periphery, in health and disease. Nature Reviews Neuroscience 4: 649–661.
- 11.
Silvapulle MJ, Sen PK (2005) Constrained statistical inference: Inequality, order, and shape restrictions. Hoboken, N.J.: Wiley-Interscience.
- 12. Peddada SD, Lobenhofer L, Li L, Afshari C, Weinberg C, et al. (2003) Gene selection and clustering for time-course and dose-response microarray experiments using order-restricted inference. Bioinformatics 19: 834–841.
- 13. Peddada SD, Harris S, Zajd J, Harvey E (2005) ORIOGEN: Order Restricted Inference for Ordered Gene Expression data. Bioinformatics 21: 3933–3934.
- 14.
Khuri AI, Mathew T, Sinha BK (1998) Statistical tests for mixed linear models. New York: Wiley.
- 15. Mukerjee H (1988) Order restricted inference in a repeated measures model. Biometrika 75: 616–617.
- 16. Silvapulle MJ (1997) On order restricted inference in some mixed linear models. Statistics & Probability Letters 36: 23–27.
- 17. Singh B, Wright FT (1990) Testing for and against an order restriction in mixed-effects models. Statistics & Probability Letters 9: 195–200.
- 18. Davidov O, Rosen S (2011) Constrained inference in mixed-effects models for longitudinal data with application to hearing loss. Biostatistics 12: 327–340.
- 19. Rosen S, Davidov O (2012) Order-restricted inference for multivariate longitudinal data with applications to the natural history of hearing loss. Statistics in Medicine 31: 1761–1773.
- 20. Davis KA, Park CG, Sinha SK (2012) Testing for generalized linear mixed models with cluster correlated data under linear inequality constraints. Canadian Journal of Statistics 40: 243–258.
- 21. Rao CR (1972) Estimation of variance and covariance components in linear models. Journal of the American Statistical Association 67: 112–115.
- 22.
Rao CR, Kleffe J (1988) Estimation of variance components and applications. Amsterdam; New York; New York, N.Y., U.S.A.: North-Holland.
- 23.
Searle SR, Casella G, McCulloch CE (1992) Variance components. New York: Wiley.
- 24. Cao Y, Chen A, Jones RL, Radcliffe J, Diethrich KN, et al. (2011) Efficacy of succimer chelation of mercury at background exposures in toddlers: A randomized trial. The Journal of Pediatrics 158: 480–485.
- 25. Hwang JTG, Peddada SD (1994) Confidence Interval Estimation Subject to Order Restrictions. Annals of Statistics 22: 67–93.
- 26. Williams DA (1971) A test for differences between treatment means when several dose levels are compared with a zero dose control. Biometrics 27: 103–117.
- 27. Williams DA (1972) The comparison of several dose levels with a zero dose control. Biometrics 28: 519–531.
- 28. Williams DA (1977) Some inference procedures for monotonically ordered normal means. Biometrika 64: 9–14.
- 29. Peddada SD, Prescott KE, Conaway M (2001) Tests for order restrictions in binary data. Biometrics 57: 1219–1227.
- 30. Rogan WJ (1998) The treatment of lead-exposed children (TLC) trial: Design and recruitment for a study of the effect of oral chelation on growth and development in toddlers. Paediatric and Perinatal Epidemiology 12: 313–333.