Figures
Abstract
Background
Guidelines recommend implementation of multimodal interventions to help prevent recurrent TIA/stroke. We undertook a systematic review to assess the effectiveness of behavioral secondary prevention interventions.
Strategy
Searches were conducted in 14 databases, including MEDLINE (1980-January 2014). We included randomized controlled trials (RCTs) testing multimodal interventions against usual care/modified usual care. All review processes were conducted in accordance with Cochrane guidelines.
Results
Twenty-three papers reporting 20 RCTs (6,373 participants) of a range of multimodal behavioral interventions were included. Methodological quality was generally low. Meta-analyses were possible for physiological, lifestyle, psychosocial and mortality/recurrence outcomes. Note: all reported confidence intervals are 95%. Systolic blood pressure was reduced by 4.21 mmHg (mean) (−6.24 to −2.18, P = 0.01 I2 = 58%, 1,407 participants); diastolic blood pressure by 2.03 mmHg (mean) (−3.19 to −0.87, P = 0.004, I2 = 52%, 1,407 participants). No significant changes were found for HDL, LDL, total cholesterol, fasting blood glucose, high sensitivity-CR, BMI, weight or waist:hip ratio, although there was a significant reduction in waist circumference (−6.69 cm, −11.44 to −1.93, P = 0.006, I2 = 0%, 96 participants). There was no significant difference in smoking continuance, or improved fruit and vegetable consumption. There was a significant difference in compliance with antithrombotic medication (OR 1.45, 1.21 to 1.75, P<0.0001, I2 = 0%, 2,792 participants) and with statins (OR 2.53, 2.15 to 2.97, P< 0.00001, I2 = 0%, 2,636 participants); however, there was no significant difference in compliance with antihypertensives. There was a significant reduction in anxiety (−1.20, −1.77 to −0.63, P<0.0001, I2 = 85%, 143 participants). Although there was no significant difference in odds of death or recurrent TIA/stroke, there was a significant reduction in the odds of cardiac events (OR 0.38, 0.16 to 0.88, P = 0.02, I2 = 0%, 4,053 participants).
Citation: Lawrence M, Pringle J, Kerr S, Booth J, Govan L, Roberts NJ (2015) Multimodal Secondary Prevention Behavioral Interventions for TIA and Stroke: A Systematic Review and Meta-Analysis. PLoS ONE 10(3): e0120902. https://doi.org/10.1371/journal.pone.0120902
Academic Editor: Rudolf Kirchmair, Medical University Innsbruck, AUSTRIA
Received: August 15, 2014; Accepted: January 27, 2015; Published: March 20, 2015
Copyright: © 2015 Lawrence et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited
Data Availability: All relevant data are within the paper and its Supporting Information files.
Funding: This review was undertaken as part of the Stroke Association Senior Research Training Fellowship (2012–2015) held by Dr. Maggie Lawrence. Dr. Pringle’s post was funded by the fellowship. Stroke Association: http://www.stroke.org.uk/. Project Ref No: TSA SRTF 2011/02. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: Dr. Maggie Lawrence was funded to undertake this review work by a Senior Research Training Fellowship (2012–2015), awarded by the Stroke Association (UK). The Fellowship enabled the employment of a project researcher, Dr. Jan Pringle. This does not alter the authors' adherence to PLOS ONE policies on sharing data and materials.
Introduction
Stroke, a chronic, debilitating condition, is projected to remain one of the leading causes of death and adult disability for the foreseeable future [1]. Annually, approximately 15 million people worldwide have a stroke; approximately one third will die and one third will be left permanently disabled [1]. Without intervention, it is projected that, globally, deaths caused by stroke will rise to 7.8 million in 2030 [2]; the number of living stroke survivors is expected to rise to 77 million [2]. Following transient ischaemic attack (TIA) or stroke, rates of recurrence are high: 8.1% within 48 hours following TIA [3], and at 10 years following stroke the cumulative risk of recurrence is 39.2% [4]. Such high rates of recurrence indicate the need for early implementation of effective secondary prevention measures that address modifiable risk factors including: hypertension, abnormal blood lipids, smoking, diet, physical activity, alcohol consumption, and psychosocial stress and depression [5]. Evidence-based clinical guidelines recommend implementation of multimodal approaches to secondary prevention [6,7] i.e. complex interventions that address all of the following: prescription of appropriate medication in conjunction with active provision of information and education regarding stroke, lifestyle (behavioral) risk factors, and medication adherence. To enhance effectiveness and maximise the potential for patient compliance, it is further recommended that such interventions be informed by behavior change theory and make use of behavior change techniques, such as motivational interviewing [8].
While there is a strong impetus for the implementation of multimodal interventions, understanding of the effectiveness of such interventions and the processes involved in supporting the initiation and subsequent maintenance of behavior change is limited [9]. Previously published literature reviews have been narrow in scope, or have focussed only on particular elements of intervention e.g. exercise [9, 10–13]. Consequently, there remains a gap in knowledge regarding the effectiveness of multimodal interventions. Therefore, to begin to address this evidence gap, we undertook a systematic review to determine the effectiveness of multimodal secondary prevention interventions following TIA and/or stroke. Future work will focus on unpicking the detail of the prcesses and mechanisms of action.
Methods
The review was conducted as described in a protocol registered with PROSPERO (CRD42012002538; S1 Text) using Cochrane Collaboration methods [14], and is reported here in accordance with PRISMA guidelines [15] (S1 PRISMA Checklist). All screening, extraction and assessment processes were conducted by two of four reviewers (ML, JP, SK, JB) working independently; any disagreements were resolved by consensus, with arbitration by a third reviewer, if necessary.
Inclusion criteria
We determined inclusion criteria relating to Participants, Interventions, Comparator and Outcomes (PICO; S1 Box) [16]; all included studies were randomized controlled trials (RCTs). Study participants were required to be adults aged ≥18 years who had had a stroke. A broad definition of stroke was adopted, to include ischaemic stroke, haemorrhagic stroke, subarachnoid haemorrhage and TIA [17] (Hanto, 1976). In terms of intervention, stroke secondary prevention interventions were required to be ‘multimodal’. Multimodal was defined as a complex intervention which addresses: 1) medication education and/or medication compliance education; 2) education or active information provision e.g. about stroke, stroke (lifestyle) risk factors; and 3) one or more of four specified lifestyle behaviors i.e. smoking, diet, physical inactivity, and alcohol consumption, and/or behaviors associated with amelioration of lifestyle risk factors i.e. medication compliance and management of perceived psychosocial stress. Comparator was usual care or modified usual care e.g. a schedule of phone calls that mimics the schedule of ‘intervention’ calls made to the intervention group. Primary outcomes of interest included physiological outcomes e.g. blood pressure, blood lipids, and lifestyle behavior change. Secondary outcomes of interest were psychosocial outcomes e.g. anxiety, learning outcomes e.g. knowledge of lifestyle risk factors for stroke, and incidence of vascular events and mortality. The latter were described as secondary outcomes rather than primary outcomes because, despite their clinical importance, few studies report long-term follow-up data, 3–6 months being the most frequently reported follow-up period.
Database and Search Strategies
In January 2014, searches were conducted in a comprehensive range of electronic databases i.e. AMED, ASSIA, CINAHL, Cochrane Central Register of Controlled Trials, Cochrane DARE, DORIS, Embase, ERIC, EThOS, Health Management Information Consortium, Medline, PsycINFO, Social Services Abstracts, and ZETOC. Selected medical subject headings (MeSH) were combined with keywords relating to stroke, secondary prevention, and specific lifestyle behaviors i.e. smoking, physical inactivity, diet, alcohol and perceived psychosocial stress, to create a search strategy, finalised for use in MEDLINE (S2 Text), and amended for use in the other databases, using appropriate controlled vocabulary, Boolean operators and search symbols. Delimiters were: dates searched (1980–2014); research subjects (human); and language (English). In addition, we scanned the reference lists of relevant papers, including systematic reviews, for potentially relevant studies. Bibliographic management software, RefWorks, was used to store and manage the results of the database searches.
Data Extraction and Quality Assessment
Data, including details of study design and methods, study populations, interventions (delivery and content), and primary and secondary outcomes, were extracted from papers using a data extraction tool adapted for this review from our earlier review [11] (S3 Text). Authors were contacted to request provision of any missing data. Methodological quality was assessed using the Cochrane Risk of Bias tool [14]. Quality was assessed as being of low/unclear/high risk of bias against seven criteria: random sequence generation (selection bias), allocation concealment (selection bias), blinding of assessors (performance bias), blinding of outcome assessment (detection bias), incomplete outcome data (attrition bias), selective reporting (reporting bias), and ‘other’.
Data analysis
We calculated the differences between intervention and control groups, post-intervention. Continuous outcome measures were expressed as mean value post treatment in each group and variances were derived from standard deviations. These data were analysed using fixed effects inverse-variance meta-analysis for difference in means between intervention and control groups with 95% confidence interval (CI). The fixed effect model is the best model to use if (a) there is reason to believe that all the studies are functionally identical, (b) our goal is to compute the common effect size, which would then be generalized to other examples of this same population, (c) there are no studies with extreme effect sizes that could influence the results, or (d) the number of studies is very small, meaning it may be difficult to estimate the between-studies variance (the extra variance added in the random effects model) with any precision. It is reasonable to assume that the studies included in our analysis are estimating the same effect size, and our goal is to compute this common effect.
Where post treatment outcomes were measured more than once, we used the later measurement. To determine long-term effectiveness of interventions, we conducted sub-analysis for the follow-up point for which most data were available i.e. 12 months. Dichotomous outcomes were analysed using fixed effects Mantel-Haenszel meta-analysis with odds ratios (ORs) and 95% CI. Heterogeneity was assessed using I2; heterogeneity >50% was considered noteworthy [14]. We used Review Manager v.5.1 [18] to perform our statistical analyses. The focus of secondary prevention intervention is on initiation of behaviors that will help to reduce the risk of recurrence of stoke and other cardiovascular events, with the aim of sustaining the benefits of intervention in the long-term. Therefore meta-analyses were conducted on all available data, irrespective of data collection time point and sub-analyses were conducted where 12-month data were available. Note: all data are reported with 95% CIs.
Results
Description of Included Trials
Database searches identified 9,098 unique bibliographic references. Review of title and abstracts resulted in the exclusion of 9,028 papers that did not meet the broad inclusion criteria (TIA/stroke; RCT). Full texts were retrieved for the remaining 70 papers, and for an additional 26 papers identified by the grey literature searches (i.e. n = 96). These papers were screened for eligibility using the detailed PICO criteria. This resulted in the exclusion of 73 papers; 23 papers were included in the review (Fig. 1). Papers were rejected because they were not RCTs (n = 24), included populations other than stroke (n = 1), were not multimodal secondary prevention interventions (n = 22), or did not report relevant outcomes (n = 26).
The 23 papers reported 20 RCTs. Extracted data from the 23 papers are presented in the evidence table (Table 1), however not all of these papers reported data in a format that facilitated inclusion in the meta-analyses reported below. Ellis et al., (2005) and McManus et al., (2009) reported the same nurse-led study, Ellis et al., at three-month follow-up, McManus et al., at 36-months, therefore, for the purposes of this review, they were considered as one paper [19,20]. Faulkner et al., (2103a) and Faulkner et al., (2013b) both reported HEPAP, an exercise-based intervention [21,22]. Intervention details were extracted from both papers; results were taken from the 2013b paper [22]. Goldfinger et al., (2012) and Horowitz et al., (2013) reported the same community-based intervention (PRAISE) [23,24]. Intervention details were extracted from both papers; previously unpublished results were provided by the authors [25].
Of the 20 trials (6,373 participants at baseline), four were conducted in Asia [26–30], four in Australasia [21,22,30–32], seven in Europe [19,20,33–38] and five in North America [23–25,39–42]. Reported mean ages of participants ranged from 55–74 years. Nineteen trials included participants of both sexes; one did not report the gender of participants [40]. ‘Usual care’ was the comparator in 16 trials; however, in one six-month long intervention, control participants were provided with study information and educational materials at two-monthly intervals [39]. In a ‘telephone support’ trial, Damush et al., (2011) made placebo telephone calls that mimicked the intervention schedule [41]. Goldfinger et al., (2012) conducted risk factor assessments for control participants and made subsequent medical referrals, as appropriate [23]. Kono et al., (2013), in their exercise and education trial, provided control participants with usual care augmented by healthy lifestyle advice at baseline, 3 and 6 months [27].
Intervention duration ranged from ‘one off’ sessions to 6 weeks to 12 months. Five interventions comprised a discrete educational intervention with no follow-up (other than for data collection purpose) [22,23,29,31,36], one provided education and follow-up, in the form of counselling, at 3 and 6 months post-intervention [27]. Ten interventions comprised an initial session (e.g. assessment, education, information giving, counselling) followed by structured follow-up [31–35,38–42]. Two were monthly interventions with lasted for 3 months [19,30], and one computer-based intervention occurred on an individual basis [37]. Peng et al. [28] provided no details regarding intervention duration. Delivery methods included computer software, one-to-one sessions, and group work. Of the 19 interventions that specified delivery format, eight were delivered one-to-one [27,28,33–35,39,40,42]; four were delivered one-to-one and to a carer/family member [19,20,30–32], five used groups/workshops [21–24,26, 29,36]—one of these [23,24] used a peer-led model, the only example of peer-led delivery, and two used computer software to deliver intervention content [37,38].
Five studies reported overt family involvement/participation in the intervention [19,20, 26,31,32,38]; three studies reported involving family members, but only if this was required and/or desired by the stroke survivor [30,34,40].
Six of the twenty behavioral interventions reported that intervention design and/or delivery was informed by a psychological theory of behavior change i.e. Social Cognitive Theory [43] [26,33,41], the Health Belief Model [44] [21,22,30] and the Transtheoretical model [45] [34]. Other theories or approaches were also described including self-management [23,29,41], self-regulation [26], and self-education [27].
Methodological Quality
Overall the risk of bias was high or unclear. Lack of detailed reporting resulted in many papers being appraised as ‘unclear’. Principal sources of bias were block randomisation, poor allocation concealment, lack of allocation blinding and selective outcome reporting particularly in relation to attrition. Sixteen papers reported data that could be used in meta-analysis. Of these, 10 performed ITT for all outcomes [20,22,25,27,30,33,34,36,38,39], 1 trial performed ITT for mortality and vascular outcomes but not for medical adherence [28], in 1 trial it was unclear what type of analysis was performed [26], and 4 trials did not use ITT analysis [32,35,37,42] (see Table 2).
Meta-analyses: Physiological outcomes
Sufficient data were extracted to enable meta-analysis of a range of physiological outcomes of interest including blood pressure, blood lipids, and anthropomorphic measurements.
Blood pressure.
Data were pooled from 10 studies reporting blood pressure [20,22,25–27,32,33,35,36,42] (Fig. 2). Compared to control, meta-analysis demonstrated that the mean effect of intervention on systolic blood pressure post-treatment was a significant reduction of 4.21 mmHg (−6.24 to −2.18, P<0.0001, I2 = 58%, 1,407 participants), however, there was moderate heterogeneity. The mean effect on diastolic blood pressure was a significant reduction of 2.03 mmHg (−3.19 to −0.87, P = 0.006, I2 = 37%, 1,407 participants); heterogeneity was moderate.
Blood lipids.
Data were pooled from three studies reporting HDL results [22,27,36]. Meta-analysis demonstrated that the mean effect of intervention was a non-significant increase of 0.11 mmol (−0.02 to 0.23, P = 0.11, I2 = 0%, 154 participants; Fig. 3). Data were pooled from three studies reporting LDL results [25,27,42]. Meta-analysis demonstrated that the mean effect of intervention was a non-significant reduction of 0.02 mmol (−0.15 to 0.12, P = 0.37, I2 = 0%, 614 participants; Fig. 3). Data were pooled from six studies reporting total cholesterol [20,22,26,32,33,36]. Meta-analysis demonstrated that there was a non-significant effect of intervention compared to control on total cholesterol post-treatment (−0.07 mmol, −0.26 to 0.11, P = 0.42, I2 = 0%, 490 participants; Fig. 3). Data were pooled from two studies reporting total cholesterol:HDL ratio [22,36]. Meta-analysis demonstrated that there was a non-significant effect of intervention compared to control post-treatment (−0.19 mmol, −0.73 to 0.36, P = 0.50, I2 = 0%, 84 participants; Fig. 3).
Other blood tests.
Data were pooled from three studies reporting fasting blood glucose [22,36,42]. Meta-analysis demonstrated that there was no significant effect of intervention compared to control post-treatment (−0.07 mmol/l, −0.16 to 0.02, P = 0.11, I2 = 0%, 120 participants; Fig. 4). Data were pooled from two studies reporting high sensitivity-CRP (a cardiac risk marker) [27,36]. Meta-analysis demonstrated that there was no significant effect of intervention compared to control post-treatment (−0.03 mg/l, −0.08 to 0.02, P = 0.18, I2 = 0%, 94 participants; Fig. 5). Data were pooled from two studies reporting HbA1c [20,27]. Meta-analysis demonstrated that there was no significant effect of intervention compared to control post-treatment (−0.02, −0.28 to 0.24, P = 0.89, I2 = 63%, 172 participants; Fig. 6), however, heterogeneity was high. Data were pooled from two studies reporting fibrinogen results [26,36]. Meta-analysis demonstrated that there was no significant effect of intervention compared to control post-treatment (−0.19 g/l, −0.60 to 0.23, P = 0.37, I2 = 89%, 86 participants; Fig. 7), however, heterogeneity was high.
Anthropomorphic measurements.
Data were pooled from six studies reporting total BMI results [22,27,32,36,37,42]. Meta-analysis demonstrated that post-treatment there was a non-significant reduction 0.25 kg/m2 (−1.04 to 0.54, P = 0.53, I2 = 0%, 433 participants; Fig. 8). Data were pooled from three studies reporting weight [22,27,33]. Meta-analysis demonstrated that post-treatment there was a non-significant reduction of −1.53 kg (−4.48 to 1.43, P = 0.31, I2 = 0%, 186 participants; Fig. 9). Data were pooled from two studies reporting waist circumference [22,36]. Meta-analysis demonstrated that post-treatment there was a significant reduction in waist circumference in intervention compared to control post-treatment (−6.69 cm, −11.44 to −1.93, P = 0.006, I2 = 0%, 96 participants; Fig. 10). Data were pooled from two studies reporting waist:hip ratio [22,36]. Meta-analysis demonstrated that post-treatment there was no significant effect of intervention compared to control post-treatment (−0.02 cm, −0.06 to 0.01, P = 0.17, I2 = 0%, 84 participants; Fig. 11).
Meta-analyses: Lifestyle behavior outcomes
No meta-analyses were possible for physical activity or stress management due to the heterogeneity of the outcome measures used and the outcomes reported. However, meta-analyses were conducted for smoking status, diet, and medication compliance.
Smoking status.
Data were pooled from five studies reporting current smoking status post treatment [33,34,38,39,42]. Meta-analysis suggested there was no significant difference in odds of an individual being a current smoker post-treatment in intervention group compared to control (OR 1.15, 0.67 to 1.99, P = 0.61, I2 = 0%, 253 participants; Fig. 12). It should be noted that four studies reported similar smoking levels at baseline in both groups. However, in the study by Adie et al., (2010) over recruitment of smokers to the control group was acknowledged [33].
Diet.
Data were pooled from two studies reporting daily fruit and vegetable consumption [34,36]. Meta-analysis suggested there was no significant difference in fruit and vegetable consumption in intervention group compared to control (0.46, −0.27 to 1.19, P = 0.22, I2 = 0%, 74 participants; Fig. 13).
Medication compliance.
Data were pooled from two studies that had measured compliance with all relevant, prescribed medication [20,39]. Meta-analysis suggested there was no significant difference in odds of an individual complying with medication post-treatment in intervention group compared to control (OR 1.10, 0.71 to 1.71, P = 0.67, I2 = 73%, 456 participants; Fig. 14), with high heterogeneity. However, some studies reported compliance with specific medications and the findings varied. Data were pooled from two studies reporting compliance with antithrombotic medication [20,28]. Meta-analysis suggested there was a significant increase in odds of an individual complying with antithrombotic medication post-treatment in intervention group compared to control (OR 1.45, 1.21 to 1.75, P<0.0001, I2 = 0%, 2,792 participants; Fig. 14). Data were pooled from three studies reporting compliance with antihypertensive medication [20,28,35]. Meta-analysis suggested there was no significant difference in odds of an individual complying with antihypertensive medication post-treatment in intervention group compared to control (OR 0.93, 0.76 to 1.13, P = 0.45, I2 = 0%, 2,028 participants; Fig. 14). Data were pooled from three studies reporting compliance with statins [20,28,42]. Meta-analysis suggested there was a significant difference in odds of an individual complying with statin medication post-treatment in intervention group compared to control (OR 2.53, 2.15 to 2.97, P< 0.00001, I2 = 0%, 2636 participants; Fig. 14).
Meta-analyses: Stroke knowledge
Due to the heterogeneity of the outcomes reported across the 20 studies and the heterogeneity of the outcome measures used, there were insufficient data relating to changes in stroke knowledge to allow meta-analysis.
Meta-analyses: Psychosocial outcomes
Sufficient data were extracted from two studies [30,36] to enable pooling of anxiety data, as measured using the Hospital Anxiety and Depression Scale [46]. Meta-analysis demonstrated that post-treatment there was a significant reduction in anxiety in the intervention group compared to control post-treatment (−1.20, −1.77 to −0.63, P<0.0001, I2 = 85%, 143 participants; Fig. 15), however, heterogeneity was high.
Meta-analyses: Recurrent Events and Mortality
Recurrent TIA/Stroke.
Data were pooled from four papers reporting recurrence of TIA/stroke events [20,22,27,28]. Meta-analysis suggested that there was no significant difference in odds of recurrence of TIA/stroke in the intervention group compared to control post-treatment (OR 1.14, 0.81 to 1.60, P = 0.46, I2 = 68%, 4,053 participants; Fig. 16), however, heterogeneity was high.
Recurrent cardiac events.
Data were pooled from four papers reporting recurrence of cardiac events [20,22,27,28]. Meta-analysis suggested that there was a significant reduction in odds of cardiac events in the intervention group compared to control post-treatment (OR 0.38, 0.16 to 0.88, P = 0.02, I2 = 0%, 4,053 participants; Fig. 17).
Mortality.
Data were pooled from four papers reporting mortality [20,22,28,39]. Meta-analysis suggested that there was no significant difference in odds of death in the intervention group compared to control post-treatment (OR 0.91, 0.52 to 1.59, P = 0.74, I2 = 0%, 4,354 participants; Fig. 18).
Meta-analyses: Long-term outcomes (sub-group analysis) 12-month data
In terms of long-term effects of intervention, the longest follow-up time for which there were sufficient data to enable meta-analyses was 12 months. Data from this time point were available for only two outcomes i.e. BP and BMI.
Data were pooled from three studies reporting blood pressure (systolic and diastolic) results at 12-months [32,35,42]. Compared to control, meta-analysis demonstrated that the mean effect of intervention on systolic blood pressure post-treatment was a significant reduction of 4.19 mmHg (−7.46 to −0.93, P = 0.01, I2 = 0%, 525 participants; Fig. 19). Compared to control, meta-analysis demonstrated that the mean effect of intervention on diastolic blood pressure post-treatment was a significant reduction of 2.49 mmHg (−4.27 to −0.70, P = 0.01, I2 = 0%, 525 participants; Fig. 19).
Data were pooled from three studies reporting BMI results at 12-months [32,36,42]. Compared to control, meta-analysis demonstrated that the mean effect of intervention on BMI post-treatment was a non-significant reduction of 1.04 kg (−2.40 to 0.32, P = 0.13, I2 = 0%, 246 participants; Fig. 20).
Discussion
This systematic review and meta-analysis of multimodal interventions for the prevention of secondary stroke included 20 RCTs (6,373 participants). Where data were available, meta-analyses were conducted for physiological, lifestyle and psychosocial outcomes, and for recurrence and mortality. Meta-analysis showed a significant effect of intervention on the reduction of systolic and diastolic blood pressure; these results had large numbers of participants. Positive trends were noted in relation to blood lipids and anthropomorphic measures. In terms of lifestyle factors, there was significant positive effect of intervention on medication compliance, specifically for antithrombotic and statins, and both with large numbers of participants. A significant positive effect was demonstrated in relation to anxiety, as measured by HADS; however participant numbers were small, and this result should be treated with caution. And, although meta-analysis demonstrated no significant effect of intervention on mortality or recurrence of stroke/TIA, a significant reduction in recurrence of cardiac events was noted.
The review included only studies published in the English language and therefore may have excluded other potentially relevant studies. And, as with any systematic literature review, it is possible that the searches did not identify all relevant English language studies, however the searches were extensive and included a comprehensive grey literature search strategy. A detailed definition of ‘multimodal intervention’ was applied, however the studies included in the review varied considerably in many respects, e.g. terms of length of intervention and follow up, format, time post-stroke. This heterogeneity was not accounted for in the analyses, although the 12-month follow-up data indicate that the effect of intervention persists beyond the short-term. Meta-analysis was possible for only a limited range of outcomes of interest. There were several reasons for this: lack of consistency in measures used across the studies; lack of use of/availability of standardised outcomes measures, particularly in relation to behavioral outcomes; lack of consistency of reporting across the studies e.g. mean and deviation or change; and selective reporting i.e. not reporting or making available the results of outcomes for which data were collected. As described in the results section, data from only 16 of papers were included in the various meta-analyses. Of these 1 trial performed ITT for mortality and vascular outcomes but not for medical adherence, in 1 trial it was unclear what type of analysis was performed, and 4 trials did not use ITT analysis. Although we acknowledge that poorer quality studies i.e. studies that do not report ITT data, may introduce bias to the results, sensitivity analysis could not be performed due to the small number of trials in some analysis. Therefore, if had we excluded trials based on quality, some analysis would not have been possible due to lack of data. A further limitation of the studies included in the review was the lack of completeness of intervention description. Such lack of detail prohibits replication or development of the intervention by subsequent researchers and/or clinicians thus wasting already limited research resources [47].
Due to the paucity of available data, all relevant studies were included, irrespective of methodological quality. Most of the studies in this review rated poorly, however this, in part, reflects some Risk of Bias criteria that, with hindsight, are not best suited to the appraisal of RCTs reporting behavioral interventions. For example, behavioral studies often rely on self-report to measure outcomes, and participants and interventionists cannot be blinded to the intervention.
Meta-analysis showed a significant effect of intervention on reduction of blood pressure. As indicated above, these analyses had large participant numbers and therefore are of worthy of note. Controlling blood pressure to within recommended parameters (<140/85mmHg; 130/80 mmHg for people with diabetes) may reduce the risk of stroke by approximately 40% [48,49]; therefore controlling blood pressure represents an important secondary prevention outcome target.
In terms of blood lipids, meta-analysis demonstrated a non-significant reduction in total cholesterol as a result of intervention; a finding echoed by Lennon et al., (2013) in their review of lifestyle interventions, who noted that a lack of detailed reporting of data regarding full lipid profiles excludes the possibility of looking at the effect of intervention on HDL ratio, which is a more sensitive indicator of risk and risk reduction [13]. Contemporary guidelines suggest that reduction of total cholesterol with a statin, reduces the relative risk of ischaemic stroke to 0.8 (0.70 to 0.92), indicating the importance of cholesterol as a secondary prevention outcome target, following TIA and ischaemic stroke [49].
In terms of lifestyle behavior, all included studies addressed smoking cessation, as might be expected given the long-established importance of tobacco use as an independent risk factor for stroke [6,50,51]. However, data from only five studies [33,34,38,39,42] were included in the meta-analysis, which demonstrated no significant positive effect of intervention on smoking status. All five interventions provided education and/or advice about smoking as a lifestyle risk factor for stroke, and some made use of motivational interviewing or counselling approaches; however, it was not clear, from what was reported, whether patients had been advised to use pharmacotherapy (e.g. nicotine replacement therapy) to support a cessation attempt. This is important as clinical guidelines suggest that smoking cessation interventions should include both behavioral support and pharmacotherapy [52]. Again, while advice and “support” were mentioned, there was little detail of what this actually meant. Brief smoking cessation interventions are an important first step in the chain of support known to be effective in assisting cessation; however, more intensive support provided by cessation specialists is known to be the most effective strategy in supporting an actual quit attempt [52]. In the UK it is recommended that patients wishing to stop smoking be referred to a network of specially trained advisors [52]. As discussed, little was written about the smoking cessation element of the various interventions and, similar to Lennon et al., (2013), we are concerned that the importance of the smoking cessation message, and the need for pharmacotherapy and more intensive support to assist a cessation attempt, may become lost in a multi-modal secondary prevention intervention [13]. Finally, all but one of the studies relied on self-report of smoking status. The Russell Standards recommend that all trials reporting on the effectiveness of smoking cessation interventions use objective measures of smoking status such as serum or salivary cotinine and/or expired carbon monoxide levels.
In terms of outcomes associated with lifestyle, meta-analysis for medication compliance demonstrated significant positive effect of intervention. As indicated above, these meta-analyses included large participant numbers, rendering these findings of greater interest to clinicians and researchers. Optimal medication compliance is vital in the prevention of recurrent strokes and other cardiovascular events [49]. However, the review found evidence of selective medication compliance i.e. participants were compliant with antithrombotics and statins but not with antihypertensives. Recent work by O’Carroll et al., (2013) found that predictors of poor adherence (unintentional and intentional) to medication regimes included reduced cognitive function [53], a common consequence of stroke known to be associated with poor medication adherence, and treatment beliefs i.e. perceived benefit versus perceived risk (side effects). Allen et al., (2009) attempted to address unintentional non-compliance by providing pill organisers and pre-packaged medication systems, as appropriate, and both Allen et al., (2009) and Hornnes et al., (2011) in intensive, nurse-led interventions provided education regarding medication and the importance of compliance, with mixed effect [39,35]. However, O’Carroll et al., (2013) found that a brief intervention addressing erroneous beliefs about medication and stroke improved medication adherence by 10% in a population of older adults following stroke [53].
Data pooled from two small (n = 143 participants) studies [30,36] indicated that intervention helped reduce anxiety, as measured by HADS. Although this is a positive outcome, the small number of participants means it should be treated with caution. The lack of reporting of psychosocial outcomes highlights need for further work in this area. In spite of the prevalence of psychological consequences of stroke, there are few trials of effectiveness of behavioral interventions designed to address psychosocial issues after stroke. For example, despite widespread recognition of mindfulness as a therapeutic intervention, a recent review of mindfulness-based interventions following TIA/stroke identified only four studies, and these were of poor methodological quality [54].
No meta-analyses were possible for any learning outcomes. Although, interventionists acknowledged the important role of education and knowledge acquisition in relation to behavior change, only four reported knowledge outcomes, and these used heterogeneous measures of acquired knowledge. Knowledge, together with skills acquisition, is understood to have a role as a precursor to behavior change, and education has been identified as a ‘source of behaviour’ [55]. Our qualitative review of participants’ perceptions of secondary prevention interventions described acquisition of stroke-specific knowledge as a factor contributing to the development of confidence [56], which is in turn a necessary precursor to engaging in and sustaining positive lifestyle behavior change [57]. Joubert et al., (2009) noted that cholesterol levels were reduced in participants who recalled receiving advice, and that this was statistically significant (P = 0.005) [32]. Based on this evidence, they suggest that ‘advice translated into risk-factor modification’ (p.282), although why this effect was demonstrated for cholesterol only, is unclear [32].
In terms of recurrence, there was a significant reduction in the recurrence cardiac events, but not in reduction of the odds of TIA/stroke recurrence. The large numbers include in the meta-analysis give weight to this significant finding. Given the commonalities in underlying risk, this is perhaps an unexpected finding; however, it may reflect higher precision in measuring and reporting cardiac events. In two studies the process for recording recurrent events is unclear [22,28] and one study relied on self-report, acknowledging this as a limitation [20]. Only Kono et al., (2013) made efforts to verify recurrent events clinically [27]. Alternatively, it might be argued that reduction in cardiac outcomes, rather than TIA/stroke outcomes is not too surprising, as cardiac outcomes may be physiologically more amenable to secondary prevention than stroke. Also, improved compliance with statins and antithrombotic medication (rather than antihypertensives) is likely to favour cardiac prevention. However, this hypothesis is tentative and should be regarded with caution.
Meta-analysis demonstrated no significant effect of intervention on mortality, perhaps an unsurprising finding given the short follow up period reported in most papers. Evidence regarding effectiveness in terms of recurrence of stroke and other vascular events, and stroke mortality, will only be generated by long-term follow-up of large cohorts; this review highlights the need for such studies.
The limited effectiveness of the few studies that have been conducted may reflect essential flaws in intervention design. In particular, a lack of theoretical underpinning and the failure to draw on powerful family dynamics [58,59]. The lack of appropriate theory underpinning behavior change is surprising. Intervening to effect behavior change in the general population is complex and challenging. Following stroke, residual impairments may vary in intensity and complexity, and may present considerable barriers to engaging with lifestyle behavior change, including formal, multimodal interventions. Evidence suggests that behavioral interventions are more likely to be effective, across a broader range of outcomes, if they are grounded in behavior change theory and are delivered by healthcare professionals with appropriate training [60]. In terms of family theory, a growing body of literature supports the active involvement of family members in nursing interventions [61] and in post-stroke rehabilitation in particular [62,63]. However, none of the studies in this review were overtly family-centred, only involving a family member if required to support the participant in some aspect of the intervention. In the cardiac field, where multimodal secondary prevention programmes are well established, Euroaction, is an example of an overtly family-centred intervention that reduced the risk of cardiovascular disease in families, who together made healthier food choices and became more physically active [64].
Conclusions
In summary, there is growing evidence of the effectiveness of multimodal interventions following TIA and stroke particularly in relation to achieving blood pressure reduction, medication compliance and anxiety reduction. The findings from this review are complex and should be interpreted with caution. They relate only to intervention outcomes and not to processes and mechanisms of action. Future, large-scale trials RCTs should measure and report a wider range of relevant outcomes, across the domains described here i.e. physiological, behavioral, psychosocial, learning, and recurrence/mortality, using standardised measures validated with stroke populations. Interventionists should provide greater detail regarding intervention design, delivery and fidelity, so that the essential work to understand the processes and mechanisms of action can be undertaken.
Supporting Information
S1 Box. Participants, Interventions, Comparator and Outcomes (PICO).
https://doi.org/10.1371/journal.pone.0120902.s002
(DOCX)
S2 Text. Search strategy finalised for use in MEDLINE.
https://doi.org/10.1371/journal.pone.0120902.s004
(DOCX)
Acknowledgments
Dr Maggie Lawrence would like to acknowledge the support received from her fellowship supervisors: Professor Martin Dennis, University of Edinburgh, Professor Francine Cheater, University of East Anglia, Professor Marian Brady, Glasgow Caledonian University and Dr David Gillespie, University of Edinburgh.
Author Contributions
Conceived and designed the experiments: ML SK. Performed the experiments: ML JP. Analyzed the data: ML JP LG. Wrote the paper: ML LG JP NR SK JB. ICMJE criteria for authorship read and met: ML JP LG NR SK JB. Agree with manuscript results and conclusions: ML JP LG SK JB. Secured funding: ML SK JB. Systematic literature review: ML JP SK JB. Quality assessment: ML JP. Data-extraction: ML JP SK JB.
References
- 1.
World Health Organisation (2011) Global Atlas on Cardiovascular Disease Prevention and Control. Available: http://whqlibdoc.who.int/publications/2011/9789241564373_eng.pdf. Accessed 05 December 2014.
- 2. Strong K, Mathers C, Bonita R (2007) Preventing stroke: saving lives around the world. Lancet Neurol 6(2): 182–187. pmid:17239805
- 3. Johnston S, Mendis S, Mathers C (2009) Global variation in stroke burden and mortality: estimates from monitoring, surveillance, and modelling. Lancet Neurol 8(4): 345–354. pmid:19233730
- 4. Mohan KM, Wolfe CDA, Rudd AG, Heuschmann PU, Kolominsky-Rabas PL (2011) Risk and cumulative risk of stroke recurrence: a systematic review and meta-analysis. Stroke 45(5): 1489–1494.
- 5. O’Donnell D, Xavier D, Lui L, Zhang H, Chin S, Rao-Melacini P, et al. (2010) Risk factors for ischaemic and intracerebral haemorrhagic stroke in 22 countries (the INTERSTROKE study): a case control study. Lancet 376: 112–123. pmid:20561675
- 6. Kernan WN, Ovbiagele B, Black HR, Bravata DM, Chimowoitz MI, Ezekowitz MD, et al. (2014) Guidelines for prevention of stroke in patients with ischaemic stroke and transient ischaemic attack: a guideline for healthcare professionals from the American Heart Association/American Stroke Association. Stroke 45(7): 2160–2136. pmid:24788967
- 7.
Scottish Intercollegiate Guidelines Network (SIGN). SIGN 97: Risk estimation and the prevention of cardiovascular disease. Available: http://www.sign.ac.uk/pdf/sign97. Accessed 06 December 2014.
- 8. Van Nes M, Sawatzky J (2010) Improving cardiovascular health with motivational interviewing: A nurse practitioner perspective. J Am Acad Nurse Pract 22: 654–60. pmid:21129073
- 9. Lawrence M, Kerr S, McVey C, Godwin J (2011) A systematic review of the effectiveness of secondary prevention lifestyle interventions designed to change lifestyle behaviour following stroke. JBI Library of Systematic Reviews 9: 1782–1827.
- 10. Redfern J, McKevitt C, Wolfe CD (2006) Development of complex interventions in stroke care: as systematic review. Stroke 37: 2410–2419. pmid:16902171
- 11. Lawrence M, Kerr S, McVey C, Godwin J. (2012) The effectiveness of secondary prevention lifestyle interventions designed to change lifestyle behaviour following stroke: summary of a systematic review. Int J Stroke 7: 243–247. pmid:22405279
- 12.
MacKay-Lyons M, Thornton M, Ruggles T, Che M (2103) Non-pharmacological interventions for preventing secondary vascular events after stroke or transient ischemic attack. Cochrane Database of Systematic Reviews 2013, Issue 3, Art. No.: CD008656. https://doi.org/10.10002/14651858.CD008656.pub.2
- 13. Lennon O, Galvin R, Smith K, Doody C, Blake C (2013) Lifestyle interventions for secondary disease prevention in stroke and transient ischaemic attack: a systematic review. Eur J Prev Cardiol 0(00): 1–14.
- 14.
Higgins JPT, Green S, editors (2009) Cochrane Handbook for Systematic Reviews of Interventions Version 5.0.2 [updated September 2009]. Available http://www.cochrane.org.uk/handbook. Accessed 06 August 2014
- 15. Moher D, Liberati A, Tetzlaff J, Altman DG, for the PRISMA Group (2009) Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. BMJ 339: b2535. pmid:19622551
- 16. Richardson WS, Wilson MC, Nishikawa J, Hayward RS (1995) The well-built clinical question: a key to evidence-based decisions. ACP J Club 123(3): A12–3. pmid:7582737
- 17. Hatano S (1976) Experience from a multicentre stroke register: a preliminary report. Bull World Health Organ 54: 541–553. pmid:1088404
- 18.
Review Manager (RevMan) [Computer program]. Version 5.0. Copenhagen: The Nordic Cochrane Centre, The Cochrane Collaboration, 2008.
- 19. Ellis G, Rodger J, McAlpine C, Langhorne P (2005) The impact of stroke nurse specialist input on risk factor modification: a randomised controlled trial [research letter]. Age Ageing 34(4): 389–92. pmid:15955759
- 20. McManus JA, Craig A, McAlpine C, Langhorne P, Ellis G (2009) Does behaviour modification affect post-stroke risk factor control? Clin Rehab 23: 99–105.
- 21. Faulkner J, Lambrick D, Woolley B, Stoner L, Wong L, McGonigal G (2013a) Health-enhancing physical activity programme (HEPAP) for transient ischaemic attack and non-disabling stroke: recruitment and compliance. The N Z Med J 125(1364): 68–76.
- 22. Faulkner J, Lambrick D, Woolley B, McGonigal G, Stoner L, Wong L (2013b) Effects of Early Exercise Engagement on Vascular Risk in Patients with Transient Ischemic Attack and Nondisabling Stroke. J Stroke Cerebrovasc Dis 22(8): e388–e396. pmid:23680679
- 23. Goldfinger JZ, Kronish IM, Fei K, Graciani A, Rosenfeld P, Lorig K, et al. (2012) Peer education for secondary stroke prevention in inner-city minorities: Design and methods of the prevent recurrence of all inner-city strokes through education randomized controlled trial. Contemp Clin Trials 33: 1065–1073. pmid:22710563
- 24. Horowitz C, Fei K, Tuhrim S, Negron R, Kronish I (2013) A Peer-led Intervention Improves Stroke Survivors’ Blood Pressure Control. [conference abstract] Stroke 44: AWP421.
- 25.
Negron R. (2014) Personal communication.
- 26. Chanruengvanich W, Kasemkitwattana S, Charoenyooth C, Towanabut S, Pongurgsorn C (2006) RCT: Self-regulated exercise program in Transient Ischaemic Attack and minor stroke patients. Thai J Nurs Research 10(3): 165–179.
- 27. Kono Y, Yamada S, Yamaguchi J, Hagiwara Y, Iritani N, Ishida S, et al. (2013) Secondary Prevention of New Vascular Events with Lifestyle Intervention in Patients with Noncardioembolic Mild Ischemic Stroke: A Single-Center Randomized Controlled Trial. Cerebrovasc Dis 36: 88–97. pmid:24029303
- 28. Peng B, Ni J, Anderson CS, Zhu Y, Wang Y, Pu C, et al. (2014) on behalf of the SMART Investigators. (2014) Implementation of a Structured Guideline–Based Program for the Secondary Prevention of Ischemic Stroke in China. Stroke 45: 515–519. pmid:24385269
- 29. Sit J, Yip V, Ko S, Gun AP, Lee JS (2007) A quasi-experimental study on a community-based stroke prevention programme for clients with minor stroke. J Clin Nurs 16(2): 272–81. pmid:17239062
- 30. Eames S, Hoffmann T, Worrall L, Read S, Wong A (2013) Randomised controlled trial of an education and support package for stroke patients and their carers. BMJ Open 3: e002538. pmid:23657469
- 31. Joubert J, Reid C, Joubert L, Barton D, Ruth D, et al. (2006) Risk factor management and depression post-stroke: The value of an integrated model of care. J Clin Neurosci 13: 84–90. pmid:16410202
- 32. Joubert J, Reid C, Barton D, Ruth D, Jackson D, Sullivan JO, et al. (2009) Integrated care improves risk factor modification after stroke: initial results of the Integrated Care for the Reduction of Secondary Stroke Model. Jnl Neurol Neurosurg Psychiatry 80: 279–84. pmid:19010943
- 33. Adie K, James M (2010) Does telephone follow-up improve blood pressure after minor stroke or TIA? Age Ageing 39: 598–563. pmid:20667838
- 34. Gillham S, Endacott R (2010) Impact of enhanced secondary prevention on health behaviour in patients following minor stroke and transient ischaemic attack: a randomized controlled trial. Clin Rehabil 24: 822–830. pmid:20685723
- 35. Hornnes N, Larsen K, Boysen G (2011) Blood Pressure 1 Year after Stroke: The Need to Optimize Secondary Prevention. J Stroke Cerebrovasc Dis 20(1): 16–23. pmid:21187254
- 36.
Kirk H, Kersten P, Crawford P, Keens A, Ashburn A, Conway J (2013) The cardiac model of rehabilitation for reducing cardiovascular risk factors post transient ischaemic attack and stroke: a randomized controlled trial. Clin Rehabil https://doi.org/10.1177/0269215513502211
- 37. Maasland L, Koudstaal PJ, Habbema JD, Dippel DW (2007) Knowledge and understanding of disease process, risk factors and treatment modalities in patients with a recent TIA or minor ischemic stroke. Cerebrovasc Dis 23: 435–40. pmid:17406114
- 38. Wolfe CDA, Redfern J, Rudd AG, Grieve AP, Heuschmann PU, McKevitt C (2010) Cluster Randomized Controlled Trial of a Patient and General Practitioner Intervention to Improve the Management of Multiple Risk Factors After Stroke Stop Stroke. Stroke 41: 2470–2476. pmid:20864664
- 39. Allen K, Hazelett S, Jarjoura D, Hua K, Wright K, Weinhardt J, et al. (2009) A randomized trial testing the superiority of a postdischarge care management model for stroke survivors. J Stroke Cerebrovasc Dis 18(6): 443–452. pmid:19900646
- 40. Banet GA, Felchlia MA (1997) The potential utility of a shared medical record in a ‘first-time’ stroke population. J Vasc Nurs XV(1): 29–33.
- 41. Damush TM, Ofner PS, Yu Z, Plue L, Nicholas G, Williams LS (2011) Abstract TP415: Implementation of a secondary stroke prevention program Transl Behav Med 1(4): 561–572. pmid:24073080
- 42. Flemming KD, Allison TG, Covalt JL, Herzig DE, Brown RD (2013) Utility of a post-hospitalization stroke prevention program managed by nurses. Hosp Pract 41(3): 70–9. pmid:23948623
- 43. Bandura A (2004) Health promotion by social cognitive means. Health Educ Behav 31: 143–64. pmid:15090118
- 44.
Sharma M, Romas JA (2008) Theoretical foundations of health education and health promotion. Sudbury, Jones and Bartlett Publishers. 306p.
- 45. Prochaska J, DiClemente C (1983) Stages and processes of self change in smoking: toward and integrative model change. J Consult Clin Psychol 21: 390–5.
- 46. Zigmond A, Smith R (1983) The Hospital Anxiety and Depression Scale. Acta Psychiatry Scand 67: 361–370. pmid:6880820
- 47. Hoffman TC, Erueti C, Glasziou PP (2013) Poor description of non-pharmacological interventions: analysis of consecutive sample randomised controlled trials. BMJ 347: f3755. pmid:24021722
- 48. PROGRESS collaborative group (2001) Randomised trial of a perindopril-based blood-pressure-lowering regimen among 6,105 individuals with previous stroke or transient ischaemic attack. Lancet 358(9287): 1033–41. pmid:11589932
- 49.
Scottish Intercollegiate Guidelines Network (2008) Management of Patients with Stroke or TIA: Assessment, Investigation, Immediate management and Secondary Prevention. Clinical Guideline 108. Available: http://www.sign.ac.uk/pdf/sign108/pdf. Accessed 06 December 2014.
- 50. Goldstein LB, Adams R, Alberts MJ, Appel LJ, Brass LM, Bushnell CD (2006) Primary Prevention of Ischaemic Stroke. A Guideline from the American Heart Association/American Stroke Association Council. Stroke 37: 1583–633. pmid:16675728
- 51. Campbell S, Moffatt R, Stamford B (2008) Smoking and smoking cessation: the relationship between cardiovascular disease and lipoprotein metabolism—A review. Atherosclerosis 20(2): 225–35.
- 52.
National Institute for Health and Clinical Excellence (2006) Brief Interventions and referral for smoking cessation in primary care and other settings. Available: http://www.nice.org.uk/guidance/ph1. Accessed 06 December 2014.
- 53. O'Carroll R, Whittaker J, Hamilton B, Johnston M, Sudlow C, Dennis M (2011) Predictors of adherence to secondary preventive medication in stroke patients. Ann Behav Med 41(3): 383–90. pmid:21193977
- 54. Lawrence M, Booth J, Mercer S, Crawford E (2013) A systematic review of the benefits of Mindfulness-Based Interventions following transient ischaemic attack and stroke. Int J Stroke 8: 465–474 pmid:23879751
- 55. Michie S, Van Stralen MM, West R (2011) The behaviour change wheel: a new method for characterising and designing behaviour change interventions. Implement Sci 16:42.
- 56.
Lawrence M, Pringle J, Kerr S, Booth J (2014) Stroke survivors’ & family members’ perspectives of participation in multimodal stroke secondary prevention interventions: qualitative review & meta-aggregation. [Oral poster abstract, European Stroke Conference, Nice, France] Cerebrovasc Dis 37(suppl 1): Abstract e-Book 1–2. https://doi.org/10.1159/000362854
- 57.
Dixon A (2008) Motivation and Confidence: what does it take to change behaviour? London, The Kings Fund. Available: http://www.kingsfund.org.uk/. Accessed 06 December 2014.
- 58.
National Cancer Institute, US Department of Health and Human Services (2005) Theory At A Glance: A Guide for Health Promotion Practice. Available: http://www.cancer.gov/cancertopics/cancerlibrary/theory.pdf. Accessed 06 August 2014.
- 59.
Wright LM, Leahey M (2005) Nurses and Families. Philadelphia, PA: FA Davis Company. 345 p.
- 60.
National Institute for Health and Clinical Excellence (2007) Behaviour change: the principles for effective interventions. Available: http://www.nice.org.uk/guidance/ph6/resources/guidance-beahviour-change-the-principles-for-effective-interventions-pdf. Accessed 06 December 2014.
- 61. Ostlund U, Persson C (2014) Examining Family Responses to Family Systems Nursing Interventions: An Integrative Review. J Fam Nurs 20(3): 259–286. pmid:25026964
- 62. Lawrence M, Kinn S (2013) Needs, priorities, and desired rehabilitation outcomes of family members of young adults who have had a stroke: findings from a phenomenological study Disabil Rehabil 35(7): 586–595. pmid:22931404
- 63. Visser-Meily A, Post M, Gorter JW, Berlekom SB, Van Den Bos T, Lindeman E (2006) Rehabilitation of stroke patients needs a family-centred approach. Disabil Rehabil 28(24): 1557–1561. pmid:17178619
- 64. Wood DA, Kotseva K, Connolly S, Jennings C, Mead A, Jones J, et al. on behalf of EUROACTION Study Group and Thompson D (2008) Nurse-coordinated multidisciplinary, family-based cardiovascular disease prevention programme (EUROACTION) for patients with coronary heart disease and asymptomatic individuals at high risk of cardiovascular disease: a paired, cluster-randomised controlled trial. Lancet 371(9629): 1999–2012. pmid:18555911