Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Cross-cultural adaptation and psychometric evaluation of the French version of the Gilles de la Tourette Syndrome Quality of Life Scale (GTS-QOL)

  • Isabelle Jalenques ,

    Roles Conceptualization, Formal analysis, Funding acquisition, Investigation, Methodology, Supervision, Validation, Writing – original draft, Writing – review & editing

    ijalenques@chu-clermontferrand.fr

    Affiliation Centre de Compétence Gilles de la Tourette, Service de Psychiatrie de l’Adulte A et Psychologie Médicale, CHU Clermont-Ferrand, Université Clermont Auvergne, Clermont-Ferrand, France

  • Diane Cyrille,

    Roles Formal analysis, Investigation

    Affiliation Centre de Compétence Gilles de la Tourette, Service de Psychiatrie de l’Adulte A et Psychologie Médicale, CHU Clermont-Ferrand, Université Clermont Auvergne, Clermont-Ferrand, France

  • Philippe Derost,

    Roles Investigation, Validation

    Affiliation Service de Neurologie, CHU Clermont-Ferrand, Clermont-Ferrand, France

  • Andreas Hartmann,

    Roles Investigation, Validation, Writing – review & editing

    Affiliation Assistance Publique-Hôpitaux de Paris (AP-HP), Pitié-Salpêtrière Hospital, National Reference Center for Tourette Syndrome, Paris, France

  • Sophie Lauron,

    Roles Conceptualization, Writing – review & editing

    Affiliation Centre de Compétence Gilles de la Tourette, Service de Psychiatrie de l’Adulte A et Psychologie Médicale, CHU Clermont-Ferrand, Université Clermont Auvergne, Clermont-Ferrand, France

  • Clara Jameux,

    Roles Investigation

    Affiliation Centre de Compétence Gilles de la Tourette, Service de Psychiatrie de l’Adulte A et Psychologie Médicale, CHU Clermont-Ferrand, Université Clermont Auvergne, Clermont-Ferrand, France

  • Urbain Tauveron-Jalenques,

    Roles Writing – review & editing

    Affiliation Centre de Compétence Gilles de la Tourette, Service de Psychiatrie de l’Adulte A et Psychologie Médicale, CHU Clermont-Ferrand, Université Clermont Auvergne, Clermont-Ferrand, France

  • Candy Guiguet-Auclair,

    Roles Data curation, Formal analysis, Software, Writing – original draft, Writing – review & editing

    Affiliation Université Clermont Auvergne, CHU Clermont-Ferrand, CNRS, SIGMA Clermont, Institut Pascal, Clermont-Ferrand, France

  • Fabien Rondepierre,

    Roles Data curation, Formal analysis, Funding acquisition, Methodology, Project administration, Resources, Writing – original draft

    Affiliation Centre de Compétence Gilles de la Tourette, Service de Psychiatrie de l’Adulte A et Psychologie Médicale, CHU Clermont-Ferrand, Université Clermont Auvergne, Clermont-Ferrand, France

  • for The Syndrome de Gilles de La Tourette Study Group

    Membership of The Syndrome de Gilles de La Tourette Study Group is provided in the Acknowledgments.

Abstract

Introduction

The Gilles de la Tourette Syndrome–Quality of Life Scale (GTS-QOL) is a self-rated disease-specific questionnaire to assess health-related quality of life of subjects with GTS.

Our aim was to perform the cross-cultural adaptation of the GTS-QOL into French and to assess its psychometric properties.

Methods

The GTS-QOL was cross-culturally adapted by conducting forward and backward translations, following international guidelines. The psychometric properties of the GTS-QOL-French were assessed in 109 participants aged 16 years and above with regard to factor structure, internal consistency, reliability and convergent validity with the MOVES (Motor tic, Obsessions and compulsions, Vocal tic Evaluation Survey) and the WHOQOL-BREF (World Health Organization Quality of Life Brief).

Results

Exploratory factor analysis of the GTS-QOL-French resulted in a 6-factor solution and did not replicate the original structure in four subscales. The results showed good acceptability (missing values per subscale ranging from 0% to 0.9%), good internal consistency (Cronbach’s alpha ranging from 0.68 to 0.94) and good test–retest reliability (intraclass correlation coefficients ranging from 0.70 to 0.81). Convergent validity with the MOVES and WHOQOL-BREF scales showed high correlations.

Discussion

Our study provides evidence of the good psychometric properties of the GTS-QOL-French. The cross-cultural adaptation and validation of this specific instrument will make it possible to assess health-related quality of life in French-speaking subjects with GTS. The GTS-QOL-French could be recommended for use in future research.

Introduction

Gilles de la Tourette syndrome (GTS) is a neuropsychiatric disorder characterized by multiple motor and one or more vocal tics that wax and wane in frequency but have persisted for more than one year since the first tic onset [1]. A recent population-based study found a prevalence of diagnosed GTS in adults of around 0.1% [2]. Some studies report that adults with GTS perceive their health-related quality of life (HRQoL) as poor [35]. Early studies used a variety of generic quality of life scales [69]. However, generic questionnaires do not collect information on important aspects of HRQoL that apply to subjects with GTS. Disease-specific questionnaires are more relevant and more clinically sensitive as they include items focused on issues or aspects of health commonly affected by the disease [10]. A self-rated disease-specific questionnaire assessing HRQoL for subjects with GTS, the Gilles de la Tourette Syndrome–Quality of Life Scale (GTS-QOL), has been developed and validated in English [11].

The original GTS-QOL comprises 27 items referring to the past 4 weeks and rated on a 5-point Likert scale, from 0 (no problem) to 4 (extreme problem), grouped into four subscales: ‘Psychological’ (11 items), ‘Physical and activities of daily living’ (7 items), ‘Obsessive-compulsive’ (5 items), and ‘Cognitive’ (4 items). Subscale scores are calculated by adding the individual scores of the items making up the subscale, and then normalized to a 0–100 range, with higher scores representing lower HRQoL. The questionnaire also includes a visual analogue scale (VAS) ranging from 0 (representing extreme dissatisfaction with life) to 100 (extreme satisfaction). The GTS-QOL can be completed in 15 minutes or less. The questionnaire can be downloaded free of charge from the original article by Cavanna et al (2008) [11]. The psychometric properties of the questionnaire were studied among 136 subjects with GTS with a mean age of 25.9 years (SD 16.6) [11]. It had good acceptability, validity (inter-subscales correlations ranging from 0.5 to 0.7), internal consistency (Cronbach’s alpha ≥ 0.8) and test-retest reliability (intraclass correlation coefficients ≥ 0.8).

The GTS-QOL is recommended in the European Clinical Guidelines for Tourette Syndrome and Other Tic Disorders for the assessment of HRQoL in adults with GTS [12]. However, studies in which HRQoL of adults with GTS is assessed by a disease-specific questionnaire as primary outcome measure are scarce. To our knowledge, there has been only one study in France whose aim was to assess HRQoL of adults with GTS, but it used a generic questionnaire [8].

Thus, we decided to perform a study to cross-culturally adapt and validate a French version of the GTS-QOL assessing its psychometric properties, to better understand HRQoL in subjects with GTS aged 16 years and above living in France. Associations between sociodemographic and clinical characteristics and HRQoL assessed by the French version of the GTS-QOL were also evaluated.

Methods

After obtaining ethical approval, the study was conducted in two phases: 1) cross-cultural adaptation of the GTS-QOL into French and 2) psychometric properties evaluation of the GTS-QOL-French.

Phase 1—Translation and cross-cultural adaptation of the French version of the GTS-QOL

The GTS-QOL was adapted from English into French following established international guidelines [13, 14]. First, the forward-backward procedure was applied to translate the GTS-QOL from English to French (Stage 1: scale translation). Three informed bilingual translators (2 psychiatrists and 1 neurologist) experienced in GTS research and one bilingual translator naive to the outcome measure independently translated the questionnaire into French (“forward translation”). All had French as their mother tongue and are fluent in English. The resultant version was translated back to English (“backward translation”) by a native English professional translator fluent in French, blinded to the original English version and with a medical background. The authors compared the translated versions with the original English version to yield the linguistic validation of the provisional questionnaire in French. They discussed item-translation, semantic, idiomatic, experiential, and conceptual equivalents. In order to check the French-speaking adult’s understanding and interpretation of the translated items, the questionnaire was pre-tested on 10 adults with GTS (clinical sample). The results were discussed between experts and patients.

Secondly, this scale was adapted for adolescents (Stage 2: scale adaptation) by three clinicians with expertise in the management of adolescents with GTS. They suggested how to simplify and rephrase items that they considered to be confusing for adolescents. The questionnaire was administered to 10 adolescents. They were asked to comment on the comprehensibility of the items. Their responses and comments were reviewed. The same experts did not suggest any wording adjustments. The French version was tested on a sample of GTS subjects (4 adults and 3 adolescents) to evaluate the comprehensibility of instructions and items. No understanding difficulty was noticed. Consequently, the expert committee adopted this version as the pre-final cross-cultural adaptation (S1 File). We named this version the GTS-QOL-French.

Thirdly, the psychometric properties of the GTS-QOL-French were examined in an independent sample of 109 people with GTS (80 males; age range: 16–64 years) (Stage 3: scale evaluation).

Phase 2—Evaluation of the psychometric properties

Study design.

The study was approved by the French regional ethics committee “Comité d’Ethique des Centres d’Investigation Clinique de l’inter-région Rhône-Alpes-Auvergne–CE-CIC Grenoble” (n° IRB 0005921, 20 September 2012). All subjects who accepted to participate received clear information on the aims and procedures of the study. All gave their written informed consent. Consent for minors, aged between16 and 18 years, was also obtained from their parents.

A set of questionnaires were given to participants during a routine consultation or mailed to them with a return envelope. To assess the test-retest reliability of the GTS-QOL-French, the questionnaire was mailed a second time to a subsample of participants (simple random sampling using random number tables) 15 days after the first assessment. Respondents who declared any change in their health status or treatment modifications since the first evaluation or who mentioned any event that could have disrupted their quality of life between test and retest were excluded from the reliability analysis.

The sample size of the study was determined according to quality criteria established by COSMIN [15] and Terwee et al. (2007) [16] that recommend a minimum number of 100 subjects to ensure satisfactory factor analysis and internal consistency evaluation and a sample size of at least 50 subjects in order to guarantee an acceptable assessment for reliability.

Participants.

The sample was recruited from two French specialist centres [GTS Reference Centre (Paris), GTS Competence Centre (Clermont- Ferrand)] and the “Association Française Syndrome Gilles de la Tourette”. Participants were aged 16 years and above. They met DSM-IV-TR criteria for the diagnosis of GTS and were able to complete the questionnaires without help. A neurologist with substantial expertise in the management of GTS evaluated all participants and performed the neurological examination. The GTS subjects with a postal address who consented to participate then received a set of questionnaires to self-complete.

Of the 136 questionnaires sent to GTS subjects who had agreed to participate in the study, 109 (80%) were returned. The sociodemographic and clinical characteristics of the participants are given in Table 1. They were predominantly male (73.4%) with a mean age of 27.5 years (SD 11.5). Most declared they had tics (94.4%), medical monitoring (74.3%) and treatment for GTS (67.0%, mainly antipsychotics) in the past month.

thumbnail
Table 1. Sociodemographic and clinical characteristics of the participants.

https://doi.org/10.1371/journal.pone.0243912.t001

Study variables and instruments.

The French validated versions of the GTS-QOL, WHOQOL-BREF (World Health Organization Quality of Life Brief) and MOVES (Motor tic, Obsessions and compulsions, Vocal tic Evaluation Survey) questionnaires were self-administered.

The generic WHOQOL-BREF questionnaire comprised 26 items of which two concern overall perception of HRQoL and health, while the remaining 24 items are grouped into four subscales: ‘Physical health’ (7 items), ‘Psychological health’ (6 items), ‘Social relationships’ (3 items), and ‘Environment’ (8 items) [17]. For each subscale, scores are rated between 0 and 100, with higher values indicating better HRQoL, contrary to GTS-QOL. The WHOQOL-BREF is a cross-culturally valid assessment of HRQoL, with good to excellent reliability and validity in neuropsychiatric patients [17]. Its French version [18] has already been used very satisfactorily during a previous study in French-speaking adults with GTS [8].

The MOVES is a self-report scale measuring the severity of tics and other phenomena observed in GTS [19]. It comprises 20 items grouped into five subscales: ‘Motor tics’, ‘Vocal tics’, ‘Obsessions’, ‘Compulsions’ and ‘Other associated symptoms’ such as copro-, pali- and echophenomena. For each subscale, a score is obtained by adding the scores of the items listed in the subscale. A total score is calculated by adding the scores of the five subscales, which range from 0 (no symptom) to 60 (the worst condition). For clinical scoring, the ‘Motor tics’ and ‘Vocal tics’ scores are added to obtain a ‘Tics’ subscale score. The ‘Obsessions’ and ‘Compulsions’ scores are added to form an ‘Obsessive-compulsive’ subscale score. The MOVES is suggested as a severity scale for tics and related sensory phenomena and recommended as a screening instrument by the Committee on Rating Scale Development of the International Parkinson’s Disease and Movement Disorder Society [20]. It has been used by Cavanna et al [11] to evaluate the GTS-QOL. A previous study in French-speaking persons with GTS aged 12 years and over provided evidence of the good psychometric properties of the French version of the MOVES [21].

Sociodemographic (age, gender, way of life, education, activity, financial aid) and medical (age at diagnosis and at onset of symptoms, tics localisation, medical monitoring, treatment, comorbidities) data were also collected. All data are available at Mendeley [22].

Statistical analysis

Statistical analyses were performed with SAS v9.4 software (SAS Institute) and conducted at a two-sided alpha = 0.05 significance level.

Data completeness.

The respondent acceptability of the questionnaire was assessed by looking at the frequency of missing values. Data quality was considered satisfactory if less than 5% of the item data were missing.

Factor analysis.

Factor analysis with the principal axis extraction method and oblique promax rotation, allowing the factors to correlate, were performed to study the multidimensionality and distribution of the items in subscales [23]. As the perception and definition of HRQoL vary from culture to culture there was no guarantee that the French version reproduced the subscales of the original questionnaire. Hence, we chose an exploratory analysis of the structure of the items [13, 2426]. The Kaiser-Meyer-Olkin (KMO) statistic and Bartlett’s test of sphericity were used to check the appropriateness of running the factor analysis. KMO values higher than 0.5 are acceptable [27]. Bartlett’s test requires to yield significant result (p<0.05). Eigenvalues higher than 1 (Kaiser criterion) and Cattell’s scree plot [28] were used for factor retention. The solution giving the most adequate factor structure (item loadings greater than 0.32, no or few item cross loadings, i.e. no or few items with loadings at 0.32 or higher on two or more factors) was retained [23].

Descriptive statistics and score distributions.

Mean, standard deviation, median, range and coefficient of skewness were used. The variability of the GTS-QOL-French scores was investigated for each subscale with the floor and ceiling effects. These effects were considered to be present if more than 15% of the subjects obtained the lowest or highest possible score [29].

Internal consistency.

Cronbach’s α coefficient was used to evaluate the internal consistency of each subscale [30]. The minimum required for the coefficient was 0.70, according to the standard used for group comparisons [31].

Item-total correlations.

Item-total consistency was used to evaluate the extent of the linear relationship between an item and its subscale, corrected for overlap (the item which is to be correlated with the scale was omitted from the scale total) [26]. A minimum correlation coefficient of 0.40 was considered indicative of good item-total consistency [32].

Inter-subscale correlations.

Spearman’s coefficients were used to evaluate inter-subscale correlations. Correlations were considered very small for coefficients lower than 0.30, small for coefficients between 0.30 and 0.50, moderate from 0.50 to 0.70 and strong if higher than 0.70 [33].

Reliability.

Stability over time was assessed by the test-retest method. Reliability of the subscales was estimated by intraclass correlation coefficient (ICC), based on the two-way random effect model. Coefficients higher than 0.70 were considered satisfactory [16].

Convergent validity.

The relationships between GTS-QOL-French and (1) WHOQOL-BREF, (2) MOVES subscales and (3) GTS-QOL-French VAS were studied, by calculating Spearman ρ correlation coefficients. Negative correlations were expected between GTS-QOL-French subscales, WHOQOL-BREF subscales, and GTS-QOL-French VAS since low scores indicated good conditions for the GST-QOL-French but bad conditions for the WHOQOL-BREF and GTS-QOL-French VAS. Positive correlations were expected between GTQ-QOL-French and MOVES subscales because low scores indicated good conditions for the two questionnaires. Correlations were considered very small for coefficients lower than 0.30, small for coefficients between 0.30 and 0.50, moderate from 0.50 to 0.70 and strong if higher than 0.70 [33].

Associations between sociodemographic and clinical characteristics and HRQoL.

The GTS-QOL-French subscale scores were compared according to age, gender, disease duration, school attendance, professional activity, financial aid, motor and/or vocal tics, medical monitoring, comorbidities, treatment. Effect sizes (ES) were calculated by Hedges’ g (a variation of Cohen’s d ES that corrects for bias due to small sample sizes) and its 95% confidence interval [34]. Absolute values of 0.20 or more commonly indicated a small ES, 0.50 or more, moderate ES, and 0.80 or more, large ES [35]. For all subscales of GTS-QOL-French, a high positive ES indicated an important negative impact on HRQoL.

Results

Participants

The severity of tics and other symptoms, and HRQoL based on responses to MOVES and WHOQOL-BREF questionnaires, respectively, are given in Table 2.

thumbnail
Table 2. Severity of tics (MOVES questionnaire) and health-related quality of life assessed by a generic questionnaire (WHOQOL-BREF).

https://doi.org/10.1371/journal.pone.0243912.t002

Data completeness

The percentage of missing values per item was low, with values ranging from 0% to 1.8%. However, 25 participants (22.9%) reported having received help to fill in the questionnaire (reading or writing).

Factor analysis

KMO measure of sampling adequacy was 0.873 and the significance value of Bartlett’s test of sphericity was <0.0001 (χ2 = 1834.7), indicating that the data were suitable for factor analysis. The factor analysis (promax rotation) of the 27 items of the GTS-QOL-French identified six factors with eigenvalues higher than one and accounting for 69.9% of the total variance (Table 3). The six subscales identified differed from the original version of GTS-QOL and were named: ‘Psychological’ (9 items), ‘Echo-coprophenomena’ (4 items), ‘Social’ (3 items), ‘Cognitive’ (4 items), ‘Physical/ADL’ (4 items), and ‘Obsessive-compulsive’ (3 items). All items loaded higher than 0.32 on its subscale. Five items loaded at 0.32 or higher on two factors: item 18 loaded on factors 1 and 3 (0.37 and 0.34 respectively); item 7 on factors 2 and 6 (0.76 and 0.34 respectively); item 27 on factors 1 and 3 (0.47 and 0.58 respectively); item 2 on factors 3 and 5 (0.32 and 0.51 respectively); and item 4 on factors 2 and 5 (0.44 and 0.42 respectively). After evaluation of internal consistency and item-total correlations, items were conserved in the subscale where they loaded higher, except for item 4 which was kept in factor 5 (‘Physical/ADL’ subscale).

thumbnail
Table 3. Factor loadings from the factor analysis of the GTS-QOL-French questionnaire.

https://doi.org/10.1371/journal.pone.0243912.t003

Descriptive statistics, score distribution, floor and ceiling effects

The descriptive statistics and score distributions for the GTS-QOL-French subscales are given in Table 4. No ceiling effect was found. Important floor effects were found for ‘Echo-coprophenomena’ and ‘Social’ subscales and a slight one for the ‘Obsessive-compulsive’ subscale. Lower scores, corresponding to better HRQoL, were observed for the ‘Echo-coprophenomena’ and ‘Social’ subscales. Coefficients of skewness were the highest for these subscales, with a positive distribution towards good health. Higher scores, corresponding to lower HRQoL, were found for the ‘Psychological’ subscale.

thumbnail
Table 4. Descriptive statistics and score distributions of the GTS-QOL-French subscales.

https://doi.org/10.1371/journal.pone.0243912.t004

Internal consistency

The GTS-QOL-French subscales showed good internal consistency, with Cronbach’s α ranging from 0.68 to 0.94 (Table 5). Only the ‘Obsessive-compulsive’ subscale did not obtain the minimum required coefficient of 0.70, having nevertheless a very close coefficient of 0.68.

thumbnail
Table 5. Internal consistency and corrected item-total correlations for the GTS-QOL-French subscales.

https://doi.org/10.1371/journal.pone.0243912.t005

Item-total correlations

All corrected item-total correlations were higher than the required 0.40. They ranged from 0.48 to 0.81, except for item 9 with a value of 0.39, very close to that of 0.40, and indicative therefore of good item-total consistency (Table 5).

In addition, each item correlated better with its parent subscale (corrected for overlap) than with the other subscales, except for two items of the ‘Obsessive-compulsive’ subscale (Table 5). For item 9 (repeating actions), the item-total correlation with its subscale was 0.39 and the correlation with the ‘Echo-coprophenomena’ subscale was 0.46. For item 10 (unpleasant thoughts), the item-total correlation with its subscale was 0.56 and the correlation with the ‘Psychological’ subscale was 0.63.

Inter-subscale correlations: Spearman coefficients

Correlations between GTS-QOL-French subscales were all positive and significant (p<0.001), ranging from 0.33 to 0.67 (Table 6). The ‘Psychological’ subscale had a small correlation with the ‘Echo-coprophenomena’ subscale (r = 0.44) and moderate correlations with the other subscales (from 0.56 to 0.67). The ‘Echo-coprophenomena’ subscale had small correlations with the other subscales (from 0.39 to 0.49). The ‘Social’ subscale had a moderate correlation with the ‘Psychological’ subscale (r = 0.67) and small correlations with the others (from 0.33 to 0.46). The ‘Cognitive’ subscale had small correlations with ‘Echo-coprophenomena’, ‘Social’, ‘Physical/ADL’ subscales (r = 0.40, 0.46 and 0.43 respectively), and moderate correlations with ‘Psychological’ (r = 0.66) and ‘Obsessive-compulsive’ (r = 0.57) subscales. The ‘Physical/ADL’ subscale had a moderate correlation with the ‘Psychological’ subscale (r = 0.56) and small correlations with the others (from 0.33 to 0.44).

thumbnail
Table 6. Inter-subscale correlations and test-reliability for the GTS-QOL-French subscales.

https://doi.org/10.1371/journal.pone.0243912.t006

Reliability.

A retest was sent to 58 participants. Of the 48 (82.8%) who returned completed questionnaires, 19 reported changes in their health status and events that had disrupted their quality of life between test and retest. Finally, 29 respondents were retained for reliability analysis. All ICCs for GTS-QOL-French subscales were greater than 0.70, ranging from 0.70 to 0.81 (Table 6).

Convergent validity

As expected, correlations between GTS-QOL-French and WHOQOL-BREF subscales were negative (Table 7). All were significant except between the GTS-QOL-French ‘Physical/ADL’ and WHOQOL-BREF ‘Social relationships’ and ‘Environment’ subscales, and between the GTS-QOL-French ‘Obsessive-compulsive’ and WHOQOL-BREF ‘Environment’ subscales. Higher correlations were found between the GTS-QOL-French ‘Psychological’ and WHOQOL-BREF ‘Physical health’ and ‘Psychological health’ subscales (r = -0.64 and -0.67, respectively). The GTS-QOL-French ‘Social’ subscale was moderately correlated with WHOQOL-BREF ‘Physical health’ (r = -0.55), ‘Psychological health’ (r = -0.57) and ‘Social relationships’ (r = -0.61) subscales. The GTS-QOL-French ‘Cognitive’ subscale was moderately correlated with the WHOQOL-BREF ‘Psychological health’ subscale (r = -0.51). The correlation between the ‘Physical’ subscales of GTS-QOL-French and WHOQOL-BREF was moderate (r = -0.52). Other significant correlation coefficients ranged from -0.23 to -0.48, with the lower ones being observed for the GTS-QOL-French ‘Echo-coprophenomena’ subscale.

thumbnail
Table 7. Spearman’s correlation coefficients between the GTS-QOL-French and the WHOQOL-BREF, the MOVES, the GTS-QOL-French VAS subscales.

https://doi.org/10.1371/journal.pone.0243912.t007

All correlations were positive and significant between GTS-QOL-French and MOVES subscales. Results showed moderate to almost strong correlations between all GTS-QOL-French subscales and the total MOVES score. Strong correlations (r ≥ 0.70) were found between the GTS-QOL-French ‘Psychological’ subscale and the MOVES ‘Obsessions’ and ‘Obsessive-compulsive’ subscales; between the GTS-QOL-French ‘Echo-coprophenomena’ and MOVES ‘Other associated symptoms’ subscales; between the GTS-QOL-French ‘Physical/ADL’ subscale and MOVES ‘Motor tics’ and ‘Tics’ subscales; and between GTS-QOL-French ‘Obsessive-Compulsive’ and MOVES ‘Obsessions’ subscales.

Correlations between GTS-QOL-French subscales and VAS (satisfaction with life) ranged from -0.33 with the ‘Echo-coprophenomena’ subscale to -0.66 with the ‘Psychological’ subscale. The GST-QOL-French VAS was also highly correlated with the ‘Social’ subscale.

Association between sociodemographic and clinical characteristics and GTS-QOL-French subscale scores

No significant correlation was observed between GTS-QOL-French subscale scores and age or disease duration. GTS-QOL-French subscale scores were not significantly different according to gender, school attendance and physical comorbidities (Fig 1).

thumbnail
Fig 1. Effect size of sociodemographic and clinical factors on GTS-QOL-French subscales.

Effect sizes (ES) are presented as forest plot with 95% confidence interval [95% CI] for each GTS-QOL-French subscale. Except for gender, the ES are given for ‘Yes’ versus ‘No’ values of the sociodemographic and clinical factors. Positive ES indicates worse health-related quality of life (HRQoL) and negative ES better HRQoL. Dotted lines represent the threshold for small (0.2), moderate (05) and large (0.8) ES.

https://doi.org/10.1371/journal.pone.0243912.g001

Working adults had a significantly better HRQoL, except for the ‘Echo-coprophenomena’ subscale. The negative corresponding ES were moderate for the ‘Obsessive-compulsive’ subscale and large for the other subscales.

Participants who were receiving a disabled adult allowance had a significantly poorer quality of life, with moderate ES for ‘Physical/ADL’ and ‘Obsessive-compulsive’ subscales and large ES for the other subscales.

Vocal tics were associated with worse HRQoL. In contrast, motor tics only (that is without vocal tics) were associated with better HRQoL except for the ‘Social’ subscale, on which motor tics had no significant effect. The corresponding ES were small for the ‘Social’ subscale, moderate for the ‘Echo-coprophenomena’, ‘Cognitive’, ‘Physical/ADL’ and ‘Obsessive-compulsive’ subscales, and large for the ‘Psychological’ subscale.

Participants with no medical monitoring had a significantly better HRQoL, with small ES for ‘Echo-coprophenomena’, ‘Social’, and ‘Cognitive’ subscales and a moderate ES for the ‘Physical/ADL’ subscale. In contrast, multidisciplinary medical monitoring was associated with worse HRQoL, with moderate ES for the ‘Psychological’, ‘Echo-coprophenomena’, ‘Social’, ‘Cognitive’ and ‘Obsessive-compulsive’ subscales and with large ES for the ‘Physical/ADL’ subscale.

Having psychological comorbidities was associated with significantly worse HRQoL, with moderate ES for the ‘Echo-coprophenomena’, ‘Social’ and ‘Obsessive-compulsive’ subscales and large ES for the ‘Psychological’ and ‘Cognitive’ subscales.

Participants on antidepressants had a significantly poorer HRQoL for the ‘Psychological’, ‘Cognitive’ and ‘Obsessive-compulsive’ subscales, with moderate associated ES.

Discussion

The present study describes the cross-cultural adaptation and validation of the GTS-QOL-French, including assessment of the convergent validity with the WHOQOL-BREF, which was not explored in the original UK study [11]. Our study is the first to use a disease-specific questionnaire to evaluate the HRQoL of a large sample of GTS subjects aged 16 years and over living in France.

HRQoL, taking into account the subjective point of view of subjects with GTS, contributes to a critical measure of the clinical outcome. A number of studies highlighted the phenotypic heterogeneity of GTS and the various course and prognostic. The GTS-QOL can help clinicians and researchers capture the impact of tics and other associated symptoms on patients’ lives [36]. Therefore, the GTS-QOL-French offers these possibilities to French-speaking GTS subjects. The GTS-QOL could also allow the French-speaking caregivers of GTS population to be more directly informed about the HRQoL of their adolescents and adults. Additionally, it will enable investigators to propose French-speaking GTS subjects as participants in collaboration research projects using this scale.

Our GTS population can be considered as fully representative since it was similar to GTS populations described elsewhere in terms of male-female ratio and age at first symptoms [1, 11, 21, 37, 38]. Our GTS subjects were recruited from a Reference Center (tertiary referral center), a Competence Center (secondary referral center) and a patient association. Thus, they might be more representative of different levels of severity in GTS and of a wider community than subjects recruited solely in tertiary referral centers that receive patients with the most severe GTS. This is suggested when comparing the MOVES scores of the participants in our study to those in other studies [3941]. Our GTS subjects also had a psychiatric comorbidity rate lower than that in studies that recruited persons exclusively in tertiary centers [40, 42]. This difference in rate could be due to the greater diversity of recruitment. However, although we took the precaution of estimating the rate from both patient-declared comorbidities and medical treatments, we cannot rule out that the rate was slightly underestimated. Likewise, we cannot rule out that subjects with GTS who had a greater number of tics and comorbidities, in particular psychiatric comorbidities, did not take part in the survey. Medical treatment of the participants was consistent with guidelines on pharmacotherapy in GTS including for behavioral disturbances [43, 44].

Our study, by assessing data completeness, provides more detailed results for respondent acceptability than in the original article. The GTS-QOL-French had good acceptability with excellent response rates and good response distribution, all of which indicate that the questionnaire was adapted to the population studied. However, 25 younger participants with a median age of 22.4 vs 29.0 years (p = 0.0250), who had higher MOVES scores [vocal tics (p = 0.0006), obsessions (p = 0.0250), compulsions (p = 0.0034), total score (p = 0.01)] and a more frequent multidisciplinary follow-up [45 vs 18% (p = 0.009)] took part in the study but declared having received help (reading or writing) to fill in the questionnaire.

The six-factor structure of the GTS-QOL-French differs from the four-factor structure of the original version of the GTS-QOL. The French version includes two additional subscales, ‘Echo-coprophenomena’ and ‘Social’, and the other four subscales were not exactly composed of the same items. The cross-culturally validated version of the GTS-QOL for children and adolescents (C&A-GTS-QOL), adapted from Italian to English, also identified six subscales, with additional ‘Copro-phenomena’ and ‘Activities of daily living’ subscales [45]. Neither the original validation of GTS-QOL [11] nor the English and Italian C&A-GTS-QOL validations [14, 45] indicated whether items loaded on several subscales.

The ‘Echo-coprophenomena’ subscale groups together two items from the ‘Physical/ADL’ subscale and two items from the ‘Obsessive-Compulsive’ subscale of the original version. The item ‘Difficulty seeing friends’ grouped with the item ‘Difficulty taking part in social activities’ led to the establishment of the ‘Social’ subscale, which appears in the GTS-QOL-French. The item ‘Loneliness/isolation’ overlaps between factors 1 and 3 in the French version but we opted to place it in the ‘Social’ subscale, because in the resulting configuration, we observed better psychometric qualities. Unlike in the original GTS-QOL, the ‘Psychological’ subscale does not include the items ‘Difficulty seeing friends’ and ‘Loneliness/isolation’. The item ‘Phonic tics’ was placed in the ‘Physical/ADL’ subscale because it is logical from a clinical point of view. This item evaluates vocal tics, but it does not evaluate the coprolalia and echolalia which are complex vocal tics including fully formed words with a semantically relevant content which are grouped with the complex motor tics which resemble intentional actions [36]. Moreover, in the resulting configuration, internal consistency of the ‘Physical/ADL’ subscale was better when it comprises item 4. Cronbach’s alpha raised from 0.71 to 0.75 for the ‘Physical/ADL’ subscale if item 4 was added, and it remained almost constant for the ‘Echo-coprophenomena’ subscale if item 4 had been deleted (0.83 versus 0.84). Only the ‘Cognitive’ subscale remained identical between the original version and the GTS-QOL-French.

As in the original GTS-QOL study [11], we observed no ceiling effect. However, a clear-cut floor effect was observed for two subscales which did not exist in the original version. The floor effect of the ‘Echo-coprophenomena’ subscale was probably due to the lack of certain symptoms in our participants. The ‘Other associated symptoms’ MOVES score, such as copro- and echophenomena, were low in our participants compared to the scores reported in the study of Gaffney et al. (1994) [19] and in that which validated the original version of the GTS-QOL [11]. This could be explained by the low prevalence of coprophenomena and echophenomena in GTS subjects (4.9–25%) [4648]. The floor effect of the ‘Social’ subscale is probably related to the absence of problems in the social sphere reported by a large number of participants in our study, who replied “satisfied” or “very satisfied” to items 20, 21 and 22 of the ‘Social relationship’ subscale of the WHOQOL-BREF (66%, 35% and 61%, respectively). Our more representative GTS population (not recruited solely in tertiary referral centers) could partly explain both. Additionally, the low prevalence of copro/echophenomena could partly explain the absence of problems in the social sphere reported by a large number of participants.

Internal consistency was good, which attests to the good homogeneity of the French version of GTS-QOL. The small to moderate correlations between the subscales imply that the GTS-QOL-French measures related but relatively different health constructs.

Lastly, the GTS-QOL-French had good convergent validity when compared to the MOVES questionnaire. However, because the original study does not give detailed results we cannot make a comparison of the two. Cavanna et al. (2008) compared the GTS-QOL with the EuroQol-5D (EQ-5D) [11]. The EQ-5D, is a very simple tool allowing for a very general assessment of quality of life and possesses only five items, with one item per dimension. It is mostly used in medico-economic studies [49]. We suggest a different approach that shows a good convergent validity of the GTS-QOL-French with the WHOQOL-BREF. The WHOQOL-BREF was used in a first study of the HRQoL of adults with GTS [8] and subsequently in a study of adolescents [50]. The ‘Physical /ADL’ subscale of the GTS-QOL-French groups together four items relating to involuntary movements, pain or physical injury due to tics, vocal tics and the impact on ADL and leisure activities. There are no common characteristics between the ‘Environment’ subscale of the WHOQOL-BREF and the ‘Physical /ADL’ and ‘Obsessive/compulsive’ subscales of the GTS-QOL-French and consequently no significant correlation between them in our study. The ‘Social relationships’ subscale of the WHOQOL-BREF deals with personal relationships, sex life and the support the subject gets from his/her friends. Hence, there are no common characteristics between this subscale and the ‘Physical/ADL’ subscale of the GTS-QOL-French and therefore no significant correlation between them. As pointed out by Balsamo, Innamorati, & Lamis (2019) [51], we can underline the difficulty for integrating psychometrics and clinical views when inter-scales analysis allows us to go further and against apparent conclusions.

To the best of our knowledge, the present study is the first using a disease-specific questionnaire as primary outcome measure to give data on the HRQoL of GTS subjects living in France aged 16 years and above. The HRQoL of these participants was overall impaired, whether assessed by the GTS-QOL-French or WHOQOL-BREF. This finding confirms the results of the first study made in France with a generic scale [8] and those of other studies using the GTS-QOL in various European countries [11, 4042, 52] or using generic scales in Europe and the USA [6, 7, 9].

The perception of HRQoL was mainly affected by psychological problems, followed by cognitive, physical and obsessive-compulsive aspects, as in the initial study [11] and in agreement with the meta-analysis of Evans et al. (2016) [3]. In addition, we show that participants with psychiatric comorbidities or antidepressant treatment had a poorer quality of life, with respectively large or moderate ES. These observations are evidence that psychological considerations (i.e. psychiatric/behavioral comorbidities or direct psychological consequences of the severity of GTS) are those that have the greatest influence on the HRQoL of GTS subjects. They are in line with those of the review of Evans et al. (2016) [3] and of previous studies of French people with GTS [8] and with the assessment of the effect of depression on EQ-5D scores [5]. Our study, complementary to the results of Eapen et al. (2016) [4], also measures the often significant impact of other factors, since the participants who were receiving a disabled adult allowance, who had vocal tics and multidisciplinary medical monitoring had worse HRQoL for all subscales.

Our study has certain limitations. Bias could have been introduced via the self-completion questionnaires because certain sociodemographic and medical data were supplied by the participants themselves. However, we took care to assess comorbidities both from those declared by the subjects and on the basis of the treatments they were receiving. For the reliability test, after exclusion of the respondents who had not maintained stable health status and treatment, or had experienced life events that could have disrupted their life between the two evaluations, 29 respondents were retained, a number close to the 28 subjects in the original study of Cavanna et al. (2008) [11], but lower than the 50 subjects recommended by Terwee et al. (2007) [16]. Nevertheless, we obtained ICC greater than the recommended 0.70. Finally, we did not study sensitivity to change after treatment.

Conclusion

The GTS-QOL-French demonstrated satisfactory internal consistency, convergent validity and reliability. Further studies on responsiveness to change in longitudinal studies with therapeutic interventions are needed. The factor structure of the French version did not reflect the original structure of the GTS-QOL and further investigation on larger sample is required. Nevertheless, the cross-cultural adaptation of this specific instrument will now make it possible to assess with a disease-specific questionnaire the HRQoL of French-speaking GTS subjects aged 16 years and over.

Supporting information

S1 File. The GTS-QOL-French questionnaire.

https://doi.org/10.1371/journal.pone.0243912.s001

(PDF)

Acknowledgments

Members of the The Syndrome de Gilles de La Tourette Study Group are Diane Cyrille, Philippe Derost, Loïc Duron, Candy Guiguet-Auclair, Isabelle Jalenques (leader of the group, ijalenques@chu-clermontferrand.fr), Sophie Lauron, Guillaume Legrand and Fabien Rondepierre (CHU Clermont-Ferrand, Clermont-Ferrand, France); Clara Jameux, Urbain Tauveron-Jalenques and Jeffrey Watts (Université Clermont Auvergne, Clermont-Ferrand, France); Andreas Hartmann (Assistance Publique-Hôpitaux de Paris AP-HP, Paris, France).

The authors thank the participants, the “Association Française Syndrome Gilles de la Tourette” and J Watts for advice on the English version of the manuscript.

References

  1. 1. American Psychiatrist Association. Diagnostic and Statistical Manual of Mental Disorders (DSM). Fifth Edition. American Psychiatrist Association; 2013.
  2. 2. Yang J, Hirsch L, Martino D, Jette N, Roberts J, Pringsheim T. The prevalence of diagnosed tourette syndrome in Canada: A national population-based study. Mov Disord. 2016;31:1658–63. pmid:27548401
  3. 3. Evans J, Seri S, Cavanna AE. The effects of Gilles de la Tourette syndrome and other chronic tic disorders on quality of life across the lifespan: a systematic review. Eur Child Adolesc Psychiatry. 2016;25:939–48. pmid:26880181
  4. 4. Eapen V, Cavanna AE, Robertson MM. Comorbidities, Social Impact, and Quality of Life in Tourette Syndrome. Front Psychiatry. 2016;7:97. pmid:27375503
  5. 5. Huisman‐van Dijk HM, Matthijssen SJMA, Stockmann RTS, Fritz AV, Cath DC. Effects of comorbidity on Tourette’s tic severity and quality of life. Acta Neurologica Scandinavica. 2019;140:390–8. pmid:31418815
  6. 6. Elstner K, Selai CE, Trimble MR, Robertson MM. Quality of Life (QOL) of patients with Gilles de la Tourette’s syndrome. Acta Psychiatr Scand. 2001;103:52–9. pmid:11202129
  7. 7. Müller-Vahl K, Dodel I, Müller N, Münchau A, Reese JP, Balzer-Geldsetzer M, et al. Health-related quality of life in patients with Gilles de la Tourette’s syndrome. Mov Disord. 2010;25:309–14. pmid:20063404
  8. 8. Jalenques I, Galland F, Malet L, Morand D, Legrand G, Auclair C, et al. Quality of life in adults with Gilles de la Tourette Syndrome. BMC Psychiatry. 2012;12:109. pmid:22888766
  9. 9. Conelea CA, Woods DW, Zinner SH, Budman CL, Murphy TK, Scahill LD, et al. The impact of Tourette Syndrome in adults: results from the Tourette Syndrome impact survey. Community Ment Health J. 2013;49:110–20. pmid:22052430
  10. 10. Guyatt GH. Measuring Health-Related Quality of Life: General Issues [Internet]. Vol. 4, Canadian Respiratory Journal. Hindawi; 1997 [Cited 2020 May 4]. p. e271269. https://www.hindawi.com/journals/crj/1997/271269/
  11. 11. Cavanna AE, Schrag A, Morley D, Orth M, Robertson MM, Joyce E, et al. The Gilles de la Tourette syndrome-quality of life scale (GTS-QOL): development and validation. Neurology. 2008;71:1410–6. pmid:18955683
  12. 12. The ESSTS Guidelines Group, Cath DC, Hedderly T, Ludolph AG, Stern JS, Murphy T, et al. European clinical guidelines for Tourette Syndrome and other tic disorders. Part I: assessment. European Child & Adolescent Psychiatry. 2011;20:155–71. pmid:21445723
  13. 13. Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine. 2000;25:3186–91. pmid:11124735
  14. 14. Cavanna AE, Chiara L, Claudia S, Rosanna B, Eddy CM, Silvestri PR, et al. The Gilles de la Tourette Syndrome-Quality of Life Scale for children and adolescents (C&A-GTS-QOL): Development and validation of the Italian version. Behavioural Neurology. 2013;1:95–103.
  15. 15. COSMIN—Improving the selection of outcome measurement instruments [Internet]. COSMIN. [Cited 2020 April 14]. https://www.cosmin.nl/
  16. 16. Terwee CB, Bot SDM, de Boer MR, van der Windt DAWM, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60:34–42. pmid:17161752
  17. 17. Skevington SM, Lotfy M, O’Connell KA, WHOQOL Group. The World Health Organization’s WHOQOL-BREF quality of life assessment: psychometric properties and results of the international field trial. A report from the WHOQOL group. Qual Life Res. 2004;13:299–310. pmid:15085902
  18. 18. Leplège A, Réveillère C, Ecosse E, Caria A, Rivière H. [Psychometric properties of a new instrument for evaluating quality of life, the WHOQOL-26, in a population of patients with neuromuscular diseases]. Encephale. 2000;26:13–22.
  19. 19. Gaffney GR, Sieg K, Hellings J. The MOVES: A Self-Rating Scale for Tourette’s Syndrome. Journal of Child and Adolescent Psychopharmacology. 1994;4:269–80.
  20. 20. Martino D, Pringsheim TM, Cavanna AE, Colosimo C, Hartmann A, Leckman JF, et al. Systematic review of severity scales and screening instruments for tics: Critique and recommendations. Mov Disord. 2017;32:467–73. pmid:28071825
  21. 21. Jalenques I, Guiguet-Auclair C, Derost P, Joubert P, Foures L, Hartmann A, et al. The MOVES (Motor tic, Obsessions and compulsions, Vocal tic Evaluation Survey): cross-cultural evaluation of the French version and additional psychometric assessment. J Neurol. 2018;265:678–87. pmid:29392455
  22. 22. Jalenques I, Cyrille D, Derost P, Hartmann A, Jameux C, Guiguet-Auclair C, et al. “The GTS-QOL (Gilles de la Tourette Syndrome–Quality of Life Scale): cross cultural evaluation of the French version”, Mendeley Data, V3. 2020.
  23. 23. Costello AB, Osborne JW. Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. Practical Assessment, Research & Evaluation. 2005;10.
  24. 24. Bullinger M, Alonso J, Apolone G, Leplège A, Sullivan M, Wood-Dauphinee S, et al. Translating health status questionnaires and evaluating their quality: the IQOLA Project approach. International Quality of Life Assessment. J Clin Epidemiol. 1998;51:913–23. pmid:9817108
  25. 25. Ware JE, Gandek B. Methods for testing data quality, scaling assumptions, and reliability: the IQOLA Project approach. International Quality of Life Assessment. J Clin Epidemiol. 1998;51:945–52. pmid:9817111
  26. 26. Gandek B, Ware JE. Methods for validating and norming translations of health status questionnaires: the IQOLA Project approach. International Quality of Life Assessment. J Clin Epidemiol. 1998;51:953–9. pmid:9817112
  27. 27. Kaiser HF, Rice J. Little Jiffy, Mark Iv. Educational and Psychological Measurement. 1974;34:111–7.
  28. 28. Cattell RB. The Scree Test For The Number Of Factors. Multivariate Behav Res. 1966;1:245–76. pmid:26828106
  29. 29. McHorney CA. Methodological Inquiries in Health Status Assessment: Medical Care. 1998;36:445–8. pmid:9544585
  30. 30. Cronbach LJ. Coefficient alpha and the internal structure of tests. Psychometrika. 1951;16:297–334.
  31. 31. Nunnally JC, Bernstein IH. Psychometric theory (3rd ed.)). McGraw-Hill, Inc. New Tork: NY; 1994.
  32. 32. Ware JE, Brook R, Williams K, Stewart A, Davies-Avery A. Conceptualisation and Measurement of Health for Adults in the Health Insurance Study. In: Model of Health and Methodology. Santa Monica, USA: RAND Corporation; 1980.
  33. 33. Hinkle DE, Wiersma W, Jurs SG. Applied statistics for the behavioral sciences [Internet]. 5th ed. Boston, Mass.: Houghton Mifflin; London: Hi Marketing; 2002 [Cited 2018 November 21]. https://trove.nla.gov.au/version/27775005
  34. 34. Hedges LV. Distribution Theory for Glass’s Estimator of Effect Size and Related Estimators. Journal of Educational Statistics. 1981;6:107–28.
  35. 35. Cohen J. Statistical power analysis for the behavioral sciences. 2nd ed. Hillsdale, N.J: L. Erlbaum Associates; 1988. 567 p.
  36. 36. Cavanna AE. The neuropsychiatry of Gilles de la Tourette syndrome: The état de l’art. Revue Neurologique. 2018;174:621–7. pmid:30098800
  37. 37. Robertson MM. The prevalence and epidemiology of Gilles de la Tourette syndrome. Part 1: the epidemiological and prevalence studies. J Psychosom Res. 2008;65:461–72. pmid:18940377
  38. 38. Worbe Y, Mallet L, Golmard J-L, Béhar C, Durif F, Jalenques I, et al. Repetitive behaviours in patients with Gilles de la Tourette syndrome: tics, compulsions, or both? PLoS ONE. 2010;5:e12959. pmid:20885982
  39. 39. Crossley E, Cavanna AE. Sensory phenomena: clinical correlates and impact on quality of life in adult patients with Tourette syndrome. Psychiatry Res. 2013;209:705–10. pmid:23684051
  40. 40. Eddy CM, Cavanna AE. On being your own worst enemy: an investigation of socially inappropriate symptoms in Tourette syndrome. J Psychiatr Res. 2013;47:1259–63. pmid:23768869
  41. 41. Eddy CM, Cavanna AE. Premonitory Urges in Adults With Complicated and Uncomplicated Tourette Syndrome. Behav Modif. 2014;38:264–75. pmid:24042069
  42. 42. Trillini MO, Müller-Vahl KR. Patients with Gilles de la Tourette syndrome have widespread personality differences. Psychiatry Research. 2015;228:765–73. pmid:26112450
  43. 43. The ESSTS Guidelines Group, Roessner V, Plessen KJ, Rothenberger A, Ludolph AG, Rizzo R, et al. European clinical guidelines for Tourette syndrome and other tic disorders. Part II: pharmacological treatment. European Child & Adolescent Psychiatry. 2011;20:173–96. pmid:21445724
  44. 44. Pringsheim T, Okun MS, Müller-Vahl K, Martino D, Jankovic J, Cavanna AE, et al. Practice guideline recommendations summary: Treatment of tics in people with Tourette syndrome and chronic tic disorders. Neurology. 2019;92:896–906. pmid:31061208
  45. 45. Su MT, McFarlane F, Cavanna AE, Termine C, Murray I, Heidemeyer L, et al. The English Version of the Gilles de la Tourette Syndrome-Quality of Life Scale for Children and Adolescents (C&A-GTS-QOL). J Child Neurol. 2017;32:76–83. pmid:27686095
  46. 46. Cavanna AE, Servo S, Monaco F, Robertson MM. The Behavioral Spectrum of Gilles de la Tourette Syndrome. JNP. 2009;21:13–23. pmid:19359447
  47. 47. Freeman RD, Zinner SH, Müller-Vahl KR, Fast DK, Burd LJ, Kano Y, et al. Coprophenomena in Tourette syndrome. Dev Med Child Neurol. 2009;51:218–27. pmid:19183216
  48. 48. Kobierska M, Sitek M, Gocyła K, Janik P. Coprolalia and copropraxia in patients with Gilles de la Tourette syndrome. Neurol Neurochir Pol. 2014;48:1–7. pmid:24636763
  49. 49. Rabin R, de Charro F. EQ-5D: a measure of health status from the EuroQol Group. Ann Med. 2001;33:337–43. pmid:11491192
  50. 50. Blázquez A, Ortiz AE, Castro-Fornieles J, Morer A, Baeza I, Martínez E, et al. Five-year diagnostic stability among adolescents in an inpatient psychiatric unit. Compr Psychiatry. 2019;89:33–9. pmid:30583125
  51. 51. Balsamo M, Innamorati M, Lamis DA. Editorial: Clinical Psychometrics: Old Issues and New Perspectives. Front Psychol [Internet]. 2019 [Cited 2020 November 3];10. Available from: https://www.frontiersin.org/articles/10.3389/fpsyg.2019.00947/full
  52. 52. Cavanna AE, David K, Orth M, Robertson MM. Predictors during childhood of future health-related quality of life in adults with Gilles de la Tourette syndrome. Eur J Paediatr Neurol. 2012;16:605–12. pmid:22381812