Figures
Abstract
Background
There are no risk algorithms for the onset of anxiety syndromes at 12 months in primary care. We aimed to develop and validate internally a risk algorithm to predict the onset of anxiety syndromes at 12 months.
Methods
A prospective cohort study with evaluations at baseline, 6 and 12 months. We measured 39 known risk factors and used multilevel logistic regression and inverse probability weighting to build the risk algorithm. Our main outcome was generalized anxiety, panic and other non-specific anxiety syndromes as measured by the Primary Care Evaluation of Mental Disorders, Patient Health Questionnaire (PRIME-MD-PHQ). We recruited 3,564 adult primary care attendees without anxiety syndromes from 174 family physicians and 32 health centers in 6 Spanish provinces.
Results
The cumulative 12-month incidence of anxiety syndromes was 12.2%. The predictA-Spain risk algorithm included the following predictors of anxiety syndromes: province; sex (female); younger age; taking medicines for anxiety, depression or stress; worse physical and mental quality of life (SF-12); dissatisfaction with paid and unpaid work; perception of financial strain; and the interactions sex*age, sex*perception of financial strain, and age*dissatisfaction with paid work. The C-index was 0.80 (95% confidence interval = 0.78–0.83) and the Hedges' g = 1.17 (95% confidence interval = 1.04–1.29). The Copas shrinkage factor was 0.98 and calibration plots showed an accurate goodness of fit.
Citation: Moreno-Peral P, Luna JdD, Marston L, King M, Nazareth I, Motrico E, et al. (2014) Predicting the Onset of Anxiety Syndromes at 12 Months in Primary Care Attendees. The PredictA-Spain Study. PLoS ONE 9(9): e106370. https://doi.org/10.1371/journal.pone.0106370
Editor: Una Macleod, Supportive care, Early DIagnosis and Advanced disease (SEDA) research group, United Kingdom
Received: March 11, 2014; Accepted: July 25, 2014; Published: September 3, 2014
Copyright: © 2014 Moreno-Peral et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: The authors confirm that all data underlying the findings are fully available without restriction. The transcriptome data is deposited at NCBI/Gene Bank as the TSA accession SRR1151079 and SRR1151080.
Funding: This study was supported by the Spanish Ministry of Health (grant FIS references: PI041980, PI041771, PI042450 and PI06/1442) and the Andalusian Council of Health (grant references: 05/403 and 06/278); as well as the Spanish Network of Primary Care Research ‘redIAPP’ (RD06/0018), the ‘Aragón group’ (RD06/0018/0020), the ‘Baleares group’ (RD07/0018/0033), and the ‘SAMSERAP group’ (RD06/0018/0039). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Anxiety disorders occur in 6–12% of the general population [1]–[2], reaching 18.5% in primary care attendees [3]. Of patients with an anxiety disorder, 50% have another comorbid psychiatric condition such as depression or another anxiety disorder [4]. This results in a loss of 805 quality-adjusted life-years annually per 100,000 primary care patients, thus surpassing chronic physical illnesses such as cardiovascular diseases, hypertension, diabetes or chronic obstructive pulmonary disease [5].
Whilst great progress has been made in the development of effective psychological and pharmacological therapies for anxiety [6], these are either not accessed by most persons [7] or they are not applied correctly [8]. Accordingly, in addition to improving the process of the clinical care of patients with anxiety, recommendations suggest developing preventive programs. The latter require a clear understanding of the associated risk factors [9]. A prospective study of these risk factors, followed over time and modeled on large population-based samples, enables the development of a risk model for developing an anxiety disorder. This can inform individualized preventive therapies based on this perception of overall risk [10]. A risk algorithm (PredictA-Europe) to predict the onset of generalized anxiety and panic syndromes at 6 and 24 months already exists for European primary care attendees [11]. However, a prediction period of 6 months may be too short if we consider that the symptoms must last at least 6 months to fulfill the DSM-IV diagnosis of generalized anxiety disorder. Furthermore, a period greater than 12 months may include people who have developed more than one episode of anxiety. We therefore aimed to develop and internally validate a risk algorithm to predict the onset of anxiety syndromes at 12 months in primary care attendees.
Method
Design and setting
We undertook a prospective cohort study with evaluations at baseline, 6 and 12 months. Although this cohort was originally recruited with the aim of developing a risk model for the onset of major depression [12], in this analysis we aimed to predict the onset of anxiety syndromes.
The method has been described in detail elsewhere [12]. The predictA-Spain study was conducted with the participation of 32 health centers and 174 family physicians (FPs) distributed throughout Spain: Granada in southern Spain; Saragossa and La Rioja in northern Spain; Madrid, capital of Spain, situated in the center; Las Palmas in the Canary Islands; and Majorca in the Balearic Islands. Each health center covers a population of 15,000–30,000 inhabitants from a geographically defined area. The physicians in each health center work as a group, with extensive primary care teams. The Spanish National Health Service provides free medical cover to 95% of the population. Patients can visit their FP as often as they wish without having to pay for it, even when they do so for preventive reasons. Each patient is assigned to only one FP, who has gatekeeper functions. The health centers taking part cover urban and rural settings in each province.
Sampling and exclusion criteria
In the six Spanish provinces, systematic random samples from physician appointment lists were taken at regular intervals of between four and six attendees with random starting points for each day. The FPs introduced the study to the selected patients and requested their permission before contacting the researcher. Participants who gave informed consent undertook a research interview within two weeks. The study population was recruited between October 2005 and February 2006. Exclusion criteria were an inability to understand or speak Spanish, severe mental disorder (e.g. psychosis, bipolar), dementia or severe neurological/sensory illness, terminal illness, the person was scheduled to be out of the city for more than three months during the 12 months of follow-up, and persons (representatives) who attended the surgery on behalf of the person who had the appointment.
Variables
Outcome measure.
The outcome of interest was anxiety syndromes over the preceding 6 months as defined by the anxiety section of the Primary Care Evaluation of Mental Disorders, Patient Health Questionnaire (PRIME-MD-PHQ) [13], [14]. The Spanish version of the PRIME-MD classifies patients who test positive for panic, generalized anxiety and other anxiety disorders [14]. The first two diagnoses match the DSM-IV criteria exactly, but the third is nonspecific. We used a dichotomous anxiety variable to indicate when any of the three diagnoses of anxiety were present in a given patient.
Potential risk factors measure.
We selected 39 potential risk factors for which there was evidence of reliability and validity in the questionnaires used to evaluate them [12]. Baseline measurements were made of all the potential risk factors:
- Socio-demographic factors: (1) age, (2) sex, (3) marital status, (4) occupation, (5) employment status, (6) ethnicity, (7) nationality, (8) country of birth, (9) educational level, (10) income, (11) owner-occupier of their accommodation, (12) living alone or with others.
- Controls, demands and rewards for (13) paid and (14) unpaid work, using an adapted version of the job content instrument with 7 items each [12], [15].
- (15) Debt and financial strain by means of three questions with Likert responses [16]: 1) General financial strain: “How well would you say you are managing financially these days?” (4-Likert); 2) Basic financial strain: “How often does it happen that you do not have enough money to afford the kind of food or clothing you/your family should have?” (5-Likert); and 3) Coping with debts: “How much difficulty do you have in meeting the payments of household and other bills?” (6-Likert).
- (16) Physical and (17) mental well-being, assessed by the 12-item Short Form (SF-12) [17], [18] and (18) a question on the presence of long-standing illness, disability or infirmity.
- (19) Alcohol misuse, assessed by the Alcohol Use Disorders Identification Test (AUDIT) [19]–[21].
- (20) A screen for lifetime depression based on the first two questions of the Composite International Diagnostic Interview (CIDI) [22].
- (21) Lifetime use of recreational drugs (CIDI) [23].
- Brief questions on the quality of (22) sexual and (23) emotional relationships with a partner, adapted from a standardized questionnaire [24].
- (24) DSM-IV diagnosis of major depression in the preceding 6 months using the CIDI [23], [25], [26].
- (25) A question on taking medication for anxiety, depression or stress.
- Childhood experiences of (26) physical, (27) emotional or (28) sexual abuse [27].
- (29) Nature and strength of spiritual beliefs [28].
- (30) Presence of serious physical or psychological disorder, or substance misuse problems, or any serious disability in persons who were close friends or relations of participants.
- (31) Difficulty getting on with people and maintaining close relationships, assessed using questions from a social functioning scale [29].
- (32) History of serious psychological problems or (33) suicide in first-degree relatives [30].
- (34) Satisfaction with the neighborhood and (35) perceived safety inside/outside the home using questions from the Health Survey for England [31].
- (36) Threatening events in the preceding 6 months using the List of Threatening Experiences Questionnaire [32], [33].
- (37) Experiences of discrimination in the preceding 6 months on grounds of sex, age, ethnicity, appearance, disability, or sexual orientation, using questions from a European study [34].
- (38) Adequacy of social support from family and friends [35].
- (39) Two questions about smoking habits [36].
Statistical Analysis
Participants with missing anxiety diagnoses at both follow-up points (at 6 and 12 months) were excluded. We also excluded those with missing anxiety diagnoses at one follow-up point who had no anxiety syndromes at the other. However, we included patients with anxiety syndromes at one follow-up point and missing diagnoses at the other (at 6 or 12 months), as they met the outcome criterion of anxiety at some point over the 12 months. We performed multilevel logistic regression with cumulative anxiety incidence as the dependent variable and health center as a random component. To test the hierarchical data structure we used the likelihood-ratio test of the null model taking cumulative incidence of anxiety syndromes at 12 months as the dependent variable and health center as a random factor versus usual logistic regression [Chi2 = 28.94; p<0.0001]. The Intraclass Correlation Coefficient for Health Center was 0.082 (95% Confidence Interval: 0.039–0.166). The likelihood-ratio test of the null model with the variable doctor as a random factor versus usual logistic regression was also significant [Chi2 = 12.81; p = 0.0002]. The Intraclass Correlation Coefficient of the variable doctor was 0.091 (95% Confidence Interval: 0.044–0.180). We then checked the likelihood-ratio test of the null model with health center and doctor as random factors versus the null model with only health center [Chi2 = 0.71; p = 0.2002]. We therefore decided to use multilevel logistic regression with health center as the random component.
We selected variables using a threshold for inclusion of p<0.20 to ensure that information lost as a result of exclusion of a variable from the equation was minimal [37]. From the model thus obtained, those variables with p>0.05 were extracted step by step to obtain a more parsimonious model. The usefulness of including first-degree interactions was considered, especially the interaction age*sex because it has been found previously in depression [38], [39] and anxiety [40], as well as the different combinations of age and sex with the other variables included in the model. We decided to include an interaction in the model when the likelihood ratio test was significant at p<0.05. We used inverse probability weighting [41], [42] to adjust for a possible attrition bias due to participants lost to follow-up. All reported P values were two-sided.
The ability to distinguish those who would develop anxiety syndromes from those who would not was assessed using the C-index [43]. To compare the discriminative validity between two risk algorithms we performed the test for two correlated C-index. Prediction models derived with multivariable regression analysis are known for overestimating regression coefficients. We used a calculation proposed by Copas [44] to estimate overfitting of our prediction models. We calculated effect sizes using Hedges' g [45]. Calibration, which is the agreement between the observed proportions of major depressive disorder and the predicted risks, was studied with calibration plots taking deciles of risk. We conducted all analyses using STATA, release 12 [46].
Ethics Statement
The predictA-Spain study has been conducted according to the principles expressed in the Declaration of Helsinki. This study complies with the Code of Ethics of the World Medical Association and was approved by the ethics committees: Ethics Committee on Human Research of the University of Granada, Ethics and Research Committee of Primary Health District of Malaga, Ethics Committee for Clinical Research of Aragon (CEICA). Research assistants explained to patients the predictA-Spain study in detail, their commitments and rights, and answered all questions that patients wanted to ask. All the participants read an information sheet and signed consent forms to take part in the study.
Results
Of the 6,299 primary care attendees approached, 1,251 (19.9%) were excluded: 506 (8.03%) were outside the age range (18–75 years); 446 (7.1%) were either representatives of patients or did not attend the appointment; 156 (2.5%) had severe mental disorder, dementia or severe neurological/sensory illness; 63 (1.0%) terminal illness; 47 (0.75%) trouble communicating in Spanish; and 33 (0.52%) were scheduled to be out of the city for longer than three months during the 12 months of follow-up. Of the remaining 5,048 patients asked to take part in the study 4,166 (82.5%) gave their consent. These were then interviewed at baseline, but 585 (14.0%) had a positive diagnosis of anxiety syndrome (by PRIME-MD-PHQ) and 17 (0.41%) had a missing diagnosis, so they were also excluded. Thus, our at-risk population comprised 3,564 patients (Figure 1).
Footnote to Figure 1: DNA: did not attend; T0, T6 and T12: baseline, 6 and 12 months interview. Anxiety syndromes measured by the Primary Care Evaluation of Mental Disorders, Patient Health Questionnaire (PRIME-MD-PHQ). 12,13
Patients' socio-demographic characteristics are shown in Table 1.
Of the 3,564 patients, 2,420 (68%) were interviewed at 6 months and 2,294 (64.4%) at 12 months. The variables associated with drop-outs were province (Madrid and Majorca), sex (male), lower age, lower educational level, seldom having enough money to afford food or clothing (basic financial strain), discrimination due to age, daily smoker, and lifetime depression (see Table 2). There were only nine missing values for predictor variables in the final models to predict the onset of anxiety syndromes. The cumulative 12-month incidence of anxiety syndromes was 12.2% (panic disorder 4.5%, generalized anxiety disorder 4.1%, other anxiety disorders 5%).
The final model to predict anxiety syndromes included 9 variables and 3 interactions (Table 3): province; sex (female); lower age; taking medicines for anxiety, depression or stress; worse physical and mental life quality (SF-12); dissatisfaction with paid and unpaid work; perceived general financial strain; and the interactions sex*age, sex*perceived financial strain, and age*dissatisfaction with paid work. From the 15 interactions tested we selected the three that had a p<0.05. Firstly, we compared the nine-variable model plus the interaction sex*age and the nine-variable model plus the interactions sex*age and sex*financial strain [chi2 = 13.90; p = 0.003]. Secondly, we compared the nine-variable model plus the interaction sex*age with the nine-variable model plus the interactions sex*age and age*paid work [chi2 = 11.55; p = 0.009]. Thirdly, we compared the nine-variable model plus the interactions sex*age and sex*financial strain with the nine-variable model plus the interactions sex*age, sex*financial problems, and age*paid work [chi2 = 11.76; p = 0.008]. The likelihood ratios for the interactions analyzed are described in Table 4 and charts of the three interactions are shown in Figures 2–3–4.
Concerning the interaction sex*age, whereas the tendency for the incidence of anxiety in women could be drawn with a more or less descending line with effect from the age of 25 years, the tendency for the men rose from the age of 25 years up to 54 years, with the peak between 45–54 years (Figure 2).
The interaction sex*financial strain showed that in men with many financial problems the risk for the incidence of anxiety was increased four-fold (Figure 3).
The interaction age*dissatisfaction at work had an antagonistic effect, with dissatisfaction at work in the younger patients increasing the incidence of anxiety (Figure 4).
The shrinkage factor was 0.9793 (shrinkage = 1 indicates that there is no overestimation). The C-index and effect size (Hedges' g) were 0.80 [95% confidence interval (CI) = 0.78–0.83] and 1.17 (95%CI = 1.04–1.29), respectively, and the C-index data are represented in Figure 5. There was a slight improvement in the C-index in the model with interactions (0.8024; 95%CI = 0.7763–0.8284) versus the model without interactions (0.7917; 95%CI = 0.7653–0.8181); Chi2 = 5.11(DF = 1) and p = 0.0238 (Figure 5).
Footnote toFigure 5: predictA: model without interactions predictA3: model with 3 interactions.
We incorporated depression (measured by the CIDI at baseline) as a risk factor candidate to be included in the model to predict the onset of anxiety syndromes but, although it was statistically significant in bivariate analysis (OR = 2.83; 95% CI = 1.70–4.71; p<0.0001), it did not remain in the final model after adjustment. If we removed from the final model the variables “worse mental life quality (SF-12-mental) and taking medication for anxiety, depression or stress” and then included major depression (CIDI), the latter reached statistical significance (OR = 1.88; 95%CI = 1.18–2.99; p = 0.008); but if we just removed only one of them (SF12-mental or taking psychotropic agents) then major depression was not significant. Our final model was clearly more discriminant (C-index = 0.80; 95%CI = 0.78–0.83) than the model excluding SF12-mental and taking psychotropic agents and including major depression (C-index = 0.77; 95%CI = 0.74–0.79); with the test for its difference being statistically significant [chi2(1) = 14.54; P = 0.0001].
The calibration showed an accurate goodness of fit (Figure 6). The predicted probability cut-point of 10% was associated with the greatest Youden's J statistic (J = Sensitivity + Specificity -1), which had good sensitivity (80.2%) but poor specificity (66.5%). The predicted probability of 11% reached a specificity of 70% and a sensitivity of 75%; while the predicted probability of 13% had more specificity (75%) than sensitivity (approximately 69%), see Table 5.
Differences (variations in coefficients >10%) were found between the final model and the same model weighted for the inverse probability of remaining in the follow-up to 12 months (Table 6). Examples of the kinds of participants scoring at increasing levels of predicted probability of anxiety syndromes are shown in Table 7.
Discussion
The predictA-Spain risk algorithm is valid. To our knowledge, it is the first algorithm that has been developed and internally validated to predict the onset of anxiety syndromes at 12 months in primary care attendees. From the shrinkage factor obtained, it can be deduced that coefficients were minimally over-estimated in the internal validation process. However, external validations are required to apply this risk algorithm in different populations. We used multi-level regression because of the hierarchical structure of the data. This approach improves the accuracy of estimates of coefficients and standard errors [47]. Our large sample size and the number of events (people developing anxiety syndromes) per variable included in the model reduced the risk of selecting unimportant variables and failing to include important variables [48]. However, the sample size was not large enough to address external validation in this study, derivating the algorithm in some provinces and validating in the others. Though our sample possibly under-represented patients who attend infrequently [49], frequent attendees are more likely to suffer from anxiety disorders [50] and therefore are most in need of prevention.
Important differences were seen between the predictA-Spain models with and without inverse probability weighting, indicating that loss to follow-up might lead to attrition bias and that this strategy could provide unbiased estimates of coefficients, even in the presence of attrition bias [41].
The questionnaire used to evaluate our outcome, PRIME-MD, has good reliability and validity indices [14], but we cannot rule out classification bias. Moreover, we only considered generalized anxiety and panic disorders as defined by the PRIME-MD. Our data do not concern other anxiety disorders such as post-traumatic stress, obsessive compulsive or phobic anxiety disorders.
In terms of C-index and effect size (Hedges' g), the predictA-Spain risk score compares favorably with the predictA-Europe, although the differences between the two risk scores might be explained in part by the greater homogeneity of the sample in Spain. The predictA-Spain is also similar to other risk algorithms for the onset of major depression [39], [51] as well as for risk indices for cardiovascular events [52].
The predictA-Spain risk algorithm shared some risk factors with the predictA-Europe [11] (sex, age, physical and mental quality of life, and dissatisfaction with paid and unpaid work) but differed in others: (1) taking medicines for anxiety, depression or stress, (2) perceived financial problems, and (3) the interactions. Moreover, the variable dissatisfaction with paid and unpaid work was measured differently (a dichotomous combined variable in the predictA-Europe and two separate scales in the predictA-Spain). The first difference (1) might, in theory, be because that variable was not included as a candidate in the stepwise selection process in predictA-Europe.
We are quite sure that our population at risk had no anxiety syndromes at baseline, at least during the preceding 6 months as defined by the anxiety section of the PRIME-MD. However, we cannot rule out that some patients had suffered anxiety syndromes prior to that date. In addition, our population at risk could have had depression or dysthymia at baseline or before. For any of these reasons, patients might be taking (appropriately or inappropriately) antidepressants and/or anxiolytics at baseline. There may also be patients (without diagnostic criteria for anxiety or depression disorders) who had insomnia and for whom a doctor could have prescribed pills to sleep. In the case of taking anxiolytics over a long time, along with insomnia, a percentage of the patients could also have an addiction disorder. Moreover, the question is phrased in such a way that it might include those taking anxiolytics-antidepressants or other medicines (vitamins, placebos, etc.), often inadequately, for minor emotional problems.
Including this variable in the final model does not mean that taking psychotropic drugs causes anxiety syndromes. If our objective is to obtain a risk algorithm, all variables potentially associated with the outcome, not necessarily causally, can be considered in order to predict as accurately as possible [53]. We believe that when patients respond that they are taking medication for anxiety, depression or stress, it should be understood as an intermediate variable related to one or more mental health disorder, such as depression, dysthymia, insomnia, addictions, personality disorders, adjustment disorders or other minor emotional problems. We have checked this with our data and this may be true at least in the case of major depression (see the results section); additionally, suffering other mental disorders is a well known risk factor for anxiety disorders [54].
One hypothesis to explain the inclusion of this variable in the predictA-Spain risk algorithm might be that Spanish patients have a tendency to ask their FPs for more psychotropic drugs for emotional problems encountered in everyday life and Spanish FPs tend to give them more medication. There is some support for this hypothesis because Spain is among those European countries having a higher use of psychotropic drugs [55].
The question “taking medication for anxiety, depression or stress” is a little ambiguous, but it is a good and independent predictor of the onset of anxiety syndromes and it is also very easy to obtain an answer.
The second difference (2) may be related with the fact that the economic indicators for Spain are below those of the European mean [56]. Finally, (3) the fact that the interactions were not included in the predictA-Europe might be explained because only the interactions between time and variables were explored in the model [11].
The selection of risk factors was performed with the aim of building a predictive model for major depression. However, it is known that anxiety and depression share most of their risk factors [11], [39], [51], [57]. The predictA-Spain shared seven risk factors with the predictD-Spain [39] risk algorithm to predict the onset of major depression in primary care, although their coefficients were different. However, five risk factors were only included in the predictD-Spain, whilst a further four were included in the predictA-Spain. We highlight the inclusion of dissatisfaction with paid work and the perception of financial strain, which were good predictors of anxiety but not depression [39]. Furthermore, the perception of many financial difficulties by men (interaction financial strain*sex) quadrupled the incidence of anxiety at 12 months, reaching 80% (see Figure 3); which might trigger a priority prevention for these cases. This may possibly be explained by the predominant role of the male in Spanish culture to maintain the family financially. Thus, given a situation of maximum hardship the male could either be affected more or have less capacity than the female to cope adequately. Concerning the antagonistic interaction sex*age (see Figure 2), a similar result was found in a study of the prevalence of anxiety in Europe [58]. The interaction age*dissatisfaction at work also had an antagonistic effect (Figure 4), a possible reason for which is that younger persons have less work experience and may therefore have less efficient coping strategies for work problems. The fact that anxiety and depression share many risk factors could be explained in part by their frequent co-occurrence, although it is also possible that both are expressions of a latent pathological process [59]. Their different phenotypes may be associated with the interaction between different risk factors in each case, including those not measured in this study (e.g. genes, personality, coping).
The predicted probability of the onset of anxiety syndromes at 12 months in an individual could be calculated from the equation in Table 3, adding the constant and the corresponding shrunk coefficients for each patient and then inverting the “logit” of the sum obtained. As these calculations are relatively complex, the most reasonable option is a spreadsheet or a web-based calculator. Our web-based calculator is available for the onset of major depression at 12 months [39], and on the same website (http://www.rediapp.org/predict/Index.php), a calculator will be available in the coming months for the onset of anxiety syndromes at 12 months.
Our results do not address how the predictA-Spain algorithm might be implemented in primary care, though this aspect can be studied in future research. Recognition by FPs of those patients with a greater overall risk (quantitative risk information) as well as their risk factors (qualitative risk information) may lead, as in cardiovascular disease, to the development of interventions tailored for intensity (level) and specificity (profile) of risk. The FPs could inform patients about their risk and provide tailored counseling and support, thus increasing the patients' empowerment and self-efficacy perception to prevent anxiety syndromes [10].
The choice of a predicted probability cut-point for making clinical decisions depends mostly on three factors: 1) the validity of each cut-point; 2) the available evidence on the effectiveness of interventions to prevent anxiety and whether this effectiveness is greater for a given predicted probability cut-point; and 3) the available evidence on the consequences of false positives and negatives regarding patients' health and quality of life and costs for patients, health services and society. For example, if an effective intervention to prevent anxiety is implemented by FPs, since FPs are usually very busy a more specific cut-point to intervene might be preferable (e.g., a predicted probability of 13–14% or greater); although this decision should be reconsidered in light of the available data on the consequences to health and cost of false negative predictions. Nonetheless, if we provide a low cost intervention to prevent depression (e.g., an internet-based guided self-help) and the consequences linked to the false positives are acceptable, a more sensitive cut-point might be interesting (e.g., a predicted probability of 10%). Interventions to prevent anxiety disorders have been developed mainly in children and adolescents [60], [61], and less frequently in the elderly [62], [63]. However, further evaluations are needed of the effectiveness of interventions to prevent anxiety disorders in general adult populations.
Conclusion
The predictA-Spain risk algorithm is valid to predict anxiety syndromes at 12 months. Although external validation is required, the predictA-Spain is available for use as a predictive tool in the prevention of anxiety syndromes in primary care.
Acknowledgments
The authors thank the Primary Care District of Malaga, particularly Jose Miguel Morales, Javier Navarro and Maximiliano Vilaseca for their support. Finally, we also thank all the interviewers, physicians and patients for their participation in the predictA-Spain Study.
Author Contributions
Conceived and designed the experiments: JAB FTG CMF EM MJGdGB MSC MADB CV JDL PMP MK IN LM CMB. Performed the experiments: JAB FTG CMF EM MJGdGB MSC MADB CV PMP. Analyzed the data: JAB PMP LM JDL MK IN. Contributed reagents/materials/analysis tools: None. Wrote the paper: JAB PMP.
References
- 1.
Alonso J, Angermeyer MC, Bernert S, Bruffaerts R, Brugha TS, et al.. (2004) Prevalence of mental disorders in Europe: results from the European Study of the Epidemiology of Mental Disorders (ESEMeD) Project. Acta Psychiatr Scand Suppl 420: 21–27.
- 2. Somers JM, Goldner EM, Waraich P, Hsu L (2006) Prevalence and Incidence Studies of Anxiety Disorders: A Systematic Review of the Literature. Can J Psychiatry 51: 100–113.
- 3. Serrano-Blanco A, Palao D, Luciano JV, Pinto-Meza A, Luján L, et al. (2010) Prevalence of mental disorders in primary care: results from the diagnosis and treatment of mental disorders in primary care study (DASMAP). Soc Psychiatry Psychiatr Epidemiol 45: 201–210.
- 4. Mergl R, Seidschek I, Allgaier AK, Möller HJ, Hegerl U, et al. (2007) Depressive, anxiety and somatoform disorders in primary care: prevalence and recognition. Depress Anxiety 24: 185–195.
- 5. Fernández A, Bellón JA, Pinto-Meza A, Luciano JV, Autonell J, et al. (2010) Burden of chronic physical conditions and mental disorders in primary care. Br J Psychiatry 196: 302–309.
- 6. Barlow DH, Lehman CL (1996) Advances in the psychosocial treatment of anxiety disorders: Implications for national health care. Arch Gen Psychiatry 53: 727–735.
- 7. Kessler RC, Zhao S, Katz SJ, Kouzis AC, Frank RG, et al. (1999) Past-year use of outpatient services for psychiatric problems in the national comorbidity survey. Am J Psychiatry 156: 115–123.
- 8. Fernández A, Haro JM, Martinez-Alonso M, Demyttenaere K, Brugha TS, et al. (2007) Treatment adequacy for anxiety and depressive disorders in six European countries. Br J Psychiatry 190: 172–173.
- 9. Schmidt NB, Zvolensky MJ (2007) Risk factor research and prevention for anxiety disorders: introduction to the special series on risk and prevention of anxiety pathology. Behav Modif 31: 3–7.
- 10. Bellón JA, Conejo-Cerón S, Moreno-Peral P, King M, Nazareth I, et al. (2013) Preventing the onset of major depression based on the level and profile of risk of primary care attendees: protocol of a cluster randomised trial (the predictD-CCRT study). BMC Psychiatry 13: 171.
- 11. King M, Bottomley C, Bellón JA, Torres-Gonzalez F, Švab I, et al. (2011) An international risk prediction algorithm for the onset of generalized anxiety and panic syndromes in general practice attendees: predictA. Psychol Med 41: 1625–1639.
- 12. Bellón JA, Moreno-Küstner B, Torres-González F, Montón-Franco C, GildeGómez-Barragán MJ, et al. (2008) Predicting the onset and persistence of episodes of depression in primary care: the PREDICT-Spain Study. Methodology. BMC Public Health 8: 256.
- 13. Spitzer RL, Kroenke K, Williams JBW (1999) Validation and Utility of a Self-report Version of PRIME-MD. The PHQ Primary Care Study. JAMA 282: 1737–1744.
- 14. Baca E, Saiz J, Agüera L, Caballero L, Fernández-Liria A, et al. (1999) Validación de la versión española del PRIME-MD: un procedimiento para el diagnóstico de trastornos mentales en atención primaria. Actas Esp Psiquiatr 27: 375–383.
- 15.
Karasek RA, Theorell T (1990) Healthy Work: Stress, Productivity, and the Reconstruction of Working Life. New York, NY: Basic Books.
- 16. Weich S, Lewis G (1998) Poverty, unemployment, and common mental disorders: population based cohort study. BMJ 317: 115–119.
- 17. Jenkinson C, Layte R, Jenkinson D, Lawrence K, Petersen S, et al. (1997) A shorter form ealth survey: can the SF-12 replicate results from the SF-36 in longitudinal studies? J Public Health Med 19: 179–186.
- 18. Gandek B, Ware JE, Aaronson NK, Apolone G, Bjorner JB, et al. (1998) Cross-validation of item selection and scoring for the SF-12. Health Survey in nine countries: results from the IQOLA Project. International Quality of Life Assessment. J Clin Epidemiol 51: 1171–1178.
- 19.
Barbor TF, de la Fuente JR, Saunders J, Grant M (1989) The Alcohol Use Disorders Identification Test: Guidelines for the Use in Primary Health Care. Genova: World Health Organization.
- 20. Rubio Valladolid G, Bermejo Vicedo J, Caballero Sánchez-Serrano MC, Santo-Domingo Carrasco J (1998) Validation of the alcohol use disorders identification test (AUDIT) in primary care. Rev Clin Esp 198: 11–14.
- 21. Pérula-de Torres LA, Fernández-García JA, Arias-Vega R, Muriel-Palomino M, Márquez-Rebollo E, et al. (2005) Validity of AUDIT test for detection of disorders related with alcohol consumption in women. Med Clin (Barc) 125: 727–730.
- 22. Arroll B, Khin N, Kerse N (2003) Screening for depression in primary care with two verbally asked questions: cross sectional study. BMJ 327: 1144–1146.
- 23.
WHO. Composite International Diagnostic Interview (CIDI) (1997) Version 2.1. Geneva: World Health Organization.
- 24. Reynolds CF, Frank E, Thase ME, Houck PR, Jennings JR, et al. (1988) Assessment of sexual function in depressed, impotent, and healthy men: factor analysis of a Brief Sexual Function Questionnaire for men. Psychiatry Res 24: 231–250.
- 25. Robins LN, Wing J, Wittchen HU, Helzer JE, Babor TF, et al. (1988) The Composite International Diagnostic Interview. An epidemiologic instrument suitable for use in conjunction with different diagnostic systems and in different cultures. Arch Gen Psychiatry 45: 1069–1077.
- 26. Rubio-Stipec M, Bravo M, Canino G (1991) The Composite International Diagnostic Interview (CIDI): an epidemiologic instrument suitable for using in conjunction with different diagnostic systems in different cultures. Acta Psiquiatr Psicol Am Lat 37: 191–204.
- 27. Fink LA, Bernstein D, Handelsman L, Foote J, Lovejoy M (1995) Initial reliability and validity of the childhood trauma interview: a new multidimensional measure of childhood interpersonal trauma. Am J Psychiatry 152: 1329–1335.
- 28. King M, Speck P, Thomas A (1995) The Royal Free interview for religious and spiritual beliefs: development and standardization. Psychol Med 25: 1125–1134.
- 29.
Tyrer P (1990) Personality disorder and social functioning. In Peck DF, Shapiro CM, editors. Measuring Human Problems: A Practical Guide. Chichester: Wiley & Sons. 119–142 p.
- 30. Qureshi N, Bethea J, Modell B, Brennan P, Papageorgiou A, et al. (2005) Collecting genetic information in primary care: evaluating a new family history tool. Fam Pract 22: 663–669.
- 31.
Sproston K, Primatesta P (2003) Health Survey for England 2002: a Survey Carried out on Behalf of the Department of Health. Volume 1: The Health of Children and Young People. London, England: The Stationery Office.
- 32. Brugha T, Bebbington P, Tennant C, Hurry J (1985) The List of Threatening Experiences: a subset of 12 life event categories with considerable long-term contextual threat. Psychol Med 15: 189–194.
- 33. Motrico E, Moreno-Küstner B, Luna JD, Torres-González F, King M, et al. (2013) Psychometric properties of the List of Threatening Experiences-LTE and its association with psychosocial factors and mental disorders according to the different scoring methods. J Affect Disord 150: 931–940.
- 34. Janssen I, Hanssen M, Bak M, Bijl RV, de Graaf R, et al. (2003) Discrimination and delusional ideation. Br J Psychiatry 182: 71–76.
- 35.
Blaxter M (1990) Health and Lifestyles. London, England: Routledge.
- 36. Heatherton TF, Kozlowski LT, Frecker RC, Rickert W, Robinson J (1989) Measuring the heaviness of smoking: Using self-reported time to the first cigarette of the day and number of cigarettes per day. Br J Addict 84: 791–799.
- 37. Greenland S (1989) Modeling variables selection in epidemiologic analysis. Am J Public Health 79: 340–349.
- 38. Bebbington P, Dunn G, Jenkins R, Lewis G, Brugha T, et al. (2003) The influence of age and sex on the prevalence of depressive conditions: report from the National Survey of Psychiatric Morbidity. Int Rev Psychiatry 15: 74–83.
- 39. Bellón JA, Luna J, King M, Moreno-Küstner B, Nazareth I, et al. (2011) Predicting the onset of major depression in primary care: international validation of a risk prediction algorithm from Spain. Psychol Med 41: 2075–2088.
- 40. Hinz A, Kittel J, Karoff M, Schwarz R (2004) Age and sex dependencies of anxiety and depression in cardiologic patients compared with the general population. Psychosoc Med 1: Doc09.
- 41. Hernan MA, Hernández-Díaz S, Robins JM (2004) A structural approach to selection bias. Epidemiology 15: 615–625.
- 42. Bellón JA, Luna JD, Moreno-Küstner B, Montón-Franco C, GildeGómez-Barragán MJ, et al. (2010) Psychosocial and sociodemographic predictors of attrition in a longitudinal study of major depression in primary care: The predictD-Spain study. J Epidemiol Community Health 64: 874–884.
- 43.
Harrell FE (2001) Regression Modelling Strategies. New York, NY: Springer.
- 44. Copas JB (1983) Regression, prediction and shrinkage. J R Statist Soc B 45: 311–354.
- 45.
Cooper H, Hedges LV (1994) The Handbook of Research Synthesis. New York, NY: Russell Sage Foundation.
- 46.
StataCorp (2011) Stata statistical software: Release 12. In Station C, editor. Texas: StataCorp LP.
- 47.
Snijders TAB, Bosker RJ (1999) Multilevel Analysis: An Introduction to Basic and Advanced Multilevel Modelling. London: Sage Publications.
- 48. Altman DG, Royston P (2000) What do we mean by validating a prognostic model? Stat Med 19: 453–473.
- 49. Lee ML, Yano EM, Wang M, Simon BF, Rubenstein LV (2002) What patient population does visit-based sampling in primary care setting represent? Med Care 40: 761–770.
- 50. Wyke S, Hunt K, Walker J, Wilson P (2003) Frequent attendance, socioeconomic status and burden of ill health. An investigation in the west of Scotland. Eur J Gen Pract 9: 48–55.
- 51. King M, Walker C, Levy G, Bottomley C, Royston P, et al. (2008) Development and validation of an international risk prediction algorithm for episodes of major depression in general practice attendees: the PredictD study. Arch Gen Psychiatry 65: 1368–1376.
- 52. Conroy RM, Pyorala K, Fitzgerald AP, Sans S, Menotti A, et al. (2003) Estimation of ten-year risk of fatal cardiovascular disease in Europe: the SCORE project. Eur Heart J 24: 987–1003.
- 53. Moons KG, Royston P, Vergouwe Y, Grobbee DE, Altman DG (2009) Prognosis and prognostic research: what, why, and how? BMJ 338: b375.
- 54. Moreno-Peral P, Conejo-Cerón S, Motrico E, Rodríguez-Morejón A, Fernández A, et al. (2014) Risk factors for the onset of panic and generalized anxiety disorders in the general adult population. A systematic review of cohort studies. J Affect Disord 168: 337–348.
- 55.
Alonso J, Angermeyer MC, Bernert S, Bruffaerts R, Brugha TS, et al.. (2004) Psychotropic drug utilization in Europe: results from the European Study of the Epidemiology of Mental Disorders (ESEMeD) project. Acta Psychiatr Scand Suppl 420: 55–64.
- 56.
European Commission EUROSTAT (2013) Income distribution statistics. http://epp.eurostat.ec.europa.eu/statistics_explained/index.php/Income_distribution_statistics. Accessed 1 October 2013.
- 57. Keyes CLM, Dhingra SS, Simoes EJ (2010) Change in Level of Positive Mental Health as a Predictor of Future Risk of Mental Illness. Am J Public Health 100: 2366–2371.
- 58. King M, Nazareth I, Levy G, Walker C, Morris R, et al. (2008) Prevalence of common mental disorders in general practice attendees across Europe. Br J Psychiatry 192: 362–367.
- 59. Mennin DS, Heimberg RG, Fresco DM, Ritter MR (2008) Is generalized anxiety disorder an anxiety or mood disorder? Considering multiple factors as we ponder the fate of GAD. Depress Anxiety 25: 289–299.
- 60. Christensen H, Pallister E, Smale S, Hickie IB, Calear AL (2010) Community-based prevention programs for anxiety and depression in youth: a systematic review. J Prim Prev 31: 139–170.
- 61. Calear AL, Christensen MJA (2010) Review of internet-based prevention and treatment programs for anxiety and depression in children and adolescents. Med J Aust 192: S12–S14.
- 62. Van't Veer-Tazelaar PJ, van Marwijk HWJ, van Oppen P, van Hout HP, van der Horst HE, et al. (2009) Stepped-Care prevention of anxiety and depression in late life. Arch Gen Psychiatry 66: 297–304.
- 63. Van't Veer-Tazelaar PJ, van Marwijk HWJ, van Oppen P, van der Horst HE, Smit F, et al. (2011) Anxiety and Depression Has Sustained Effects Over 24 Months: A Pragmatic Randomized Trial. Am J Geriatr Psychiatry 19: 230–239.