Auditory training involves active listening to auditory stimuli and aims to improve performance in auditory tasks. As such, auditory training is a potential intervention for the management of people with hearing loss.
This systematic review (PROSPERO 2011: CRD42011001406) evaluated the published evidence-base for the efficacy of individual computer-based auditory training to improve speech intelligibility, cognition and communication abilities in adults with hearing loss, with or without hearing aids or cochlear implants.
A systematic search of eight databases and key journals identified 229 articles published since 1996, 13 of which met the inclusion criteria. Data were independently extracted and reviewed by the two authors. Study quality was assessed using ten pre-defined scientific and intervention-specific measures.
Auditory training resulted in improved performance for trained tasks in 9/10 articles that reported on-task outcomes. Although significant generalisation of learning was shown to untrained measures of speech intelligibility (11/13 articles), cognition (1/1 articles) and self-reported hearing abilities (1/2 articles), improvements were small and not robust. Where reported, compliance with computer-based auditory training was high, and retention of learning was shown at post-training follow-ups. Published evidence was of very-low to moderate study quality.
Our findings demonstrate that published evidence for the efficacy of individual computer-based auditory training for adults with hearing loss is not robust and therefore cannot be reliably used to guide intervention at this time. We identify a need for high-quality evidence to further examine the efficacy of computer-based auditory training for people with hearing loss.
Citation: Henshaw H, Ferguson MA (2013) Efficacy of Individual Computer-Based Auditory Training for People with Hearing Loss: A Systematic Review of the Evidence. PLoS ONE 8(5): e62836. doi:10.1371/journal.pone.0062836
Editor: Joel Snyder, UNLV, United States of America
Received: December 15, 2012; Accepted: March 26, 2013; Published: May 10, 2013
Copyright: © 2013 Henshaw, Ferguson. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This research was funded by the National Institute for Health Research (NIHR). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
The World Health Organization  reported in 2004 that over 275 million people worldwide had a significant hearing impairment. Adult-onset hearing loss is highly prevalent, whereby 27% of males and 24% of females aged 45 years and over experience mild hearing loss (defined as a pure-tone hearing threshold of 26 decibels (dB) average across 0.5, 1, 2, 4 k Hz) or greater in the better hearing ear. Hearing loss is currently estimated to be the 13th most common disease burden worldwide, and it has been predicted that by 2030 adult-onset hearing loss will be the seventh leading disease burden, above diabetes and HIV . Hearing loss can lead to additional difficulties with employment, depression, social isolation, and reduced quality of life . Untreated hearing loss has a substantial social impact on the person with hearing loss and for those with whom they communicate , .
For adults who gradually acquire a hearing loss, their first complaint is unlikely to be ‘I cannot hear’. More often they report ‘I can hear but I cannot understand what is being said’, particularly in noisy listening environments . Hearing aids are the most common management option for people with hearing loss, yet uptake is low, with just 20% of people with hearing loss in the UK , , and just under 30% in the US  owning them. Furthermore, of those who do own hearing aids, between 15% and 30% do not wear them regularly , . It has become apparent over the last decade that the challenges faced by people with hearing loss cannot be explained by the audiogram alone , . Difficulties in hearing may be exacerbated by, or masquerade as, reductions in cognitive ability such as problems in remembering or comprehending speech , . Although hearing aids may help people with hearing loss hear speech, their ability to listen to and make sense of speech may still be sub-optimal. Cognitive function plays a significant role in listening, whereby greater working memory capacity is associated with improved language comprehension , and selective attention has been shown to be central to following multi-speaker conversations (see  for a review).
The 2012 British Society of Audiology guidance for adult hearing rehabilitation  states that successful rehabilitation should be based upon, ‘identifying individual needs, setting specific goals, making shared informed decisions and supporting self-management – steps that are important for helping the client to overcome his/her difficulties in everyday life’ . To enable this, clinicians may need to consider interventions that are complementary or alternative to the provision of hearing aids (or cochlear implants where hearing loss is severe to profound). Auditory training is one such clinical intervention, which promotes self-management of hearing difficulties, and is aimed at improving speech intelligibility through the development of auditory perceptual skills. Typically, listeners learn to make perceptual distinctions between sounds presented systematically . Studies of auditory perceptual learning demonstrate the potential for training to improve auditory perceptual skills over the course of an adult’s lifespan (see  for a review).
Auditory Training as an Intervention for People with Hearing Loss
Historically, a distinction has been made between bottom-up sensory refinement (analytic training) and top-down improvement of spoken language comprehension (synthetic training) . In 2005, Sweetow and Palmer published a systematic review of studies that assessed the efficacy of individual auditory training for adults with hearing loss . These studies assessed clinician-delivered training, an intervention which is time-, resource-, and cost-intensive. Six articles, published between 1970 and 1996 –, met the criteria for inclusion, which were; Participants: adults with hearing loss with or without hearing aids, who were not cochlear implant users; Intervention: analytic or synthetic auditory training, or combination of the two; Controls: with or without a control group comparison; Outcomes; one or more measure relating to communication skills (e.g. understanding speech, self-perception of ability); Study designs: randomized controlled trials, nonrandomized controlled trials, cohort and repeated measures designs with or without a control group. The authors concluded that speech recognition skills, particularly in noise, may be improved by synthetic training, whereas the contribution of analytic training remains uncertain. Yet, more recently, bottom-up (analytic) auditory training using phoneme discrimination has also shown improvements in top-down cognitive processing, which may offer additional benefit to people with hearing loss, particularly in adverse listening situations . Finally, a meta-analysis of six studies assessing the benefits of (primarily clinician-delivered) auditory training for people with hearing loss published between 1970 and 2009, (including those reviewed by Sweetow & Palmer ), suggested a reliable but small post-training improvements in speech recognition performance (Cohen’s d = .352) .
Over the last two decades, the emergence of individual (non-clinician delivered), computer-based auditory training (CBAT) packages has resulted in a resurgence of interest in auditory training as an intervention for people with hearing loss. The key benefits of CBAT include home-delivery, the potential to tailor training packages to individual needs, and the ability to remotely monitor and capture trainee data over the internet. Thus, CBAT is an intervention that is time-, resource- and cost-effective, and can be conveniently accessed by the user . There are several key considerations in using individual CBAT as an intervention to improve speech intelligibility for people with hearing loss. First and foremost, the intervention should be demonstrated to be effective, whereby any on-task learning should generalise to functional benefits in real-world listening ability. Improvements in behavioural measures of speech intelligibility in noise are typically considered by researchers and clinicians to be the ultimate aim of CBAT, as this is the most common complaint of people with hearing loss. However, as speech intelligibility has been shown to be mediated by cognition, particularly where the speech signal is degraded, training-related improvements in cognition (e.g. attention and working memory) are also likely to reflect functional real-world benefits to listening. Second, for auditory training to be accepted by an individual and therefore undertaken, the individual must be able to identify tangible benefits from the training. Thus, improvements in self-reported communication abilities are also important to the success of CBAT. Nevertheless, evidence from studies of alternative interventions suggest that improvements in self-reported outcomes alone may simply reflect expectations created as a result of receiving an intervention , . Ideally, any improvements in self-reported outcomes should therefore be accompanied by functional benefits, as indexed by behavioural tasks of speech intelligibility or cognitive performance. Third, for auditory training to be a successful intervention for people with hearing loss, any CBAT related improvements should persist over time. Finally, individuals must comply with CBAT, as an intervention can only be effective when individuals conform. This final point is of particular importance where CBAT is used as an unsupervised, home-based intervention.
A systematic review aims to identify, appraise and synthesize all the empirical evidence that meets pre-specified eligibility criteria in order to answer a given research question . The primary aim of the present review was to examine the evidence for individual CBAT as an effective intervention for people with hearing loss. The evidence-base in the published literature was evaluated for both on-task learning for trained stimuli, and generalisation of learning to improvements in untrained measures of speech intelligibility, cognition and communication. Secondary aims sought to examine the feasibility of individual CBAT as an intervention for people with hearing loss by examining (i) the long-term retention of training-related improvements, and (ii) levels of compliance with CBAT programmes.
Specific Research Questions
- Does evidence exist to support improvements in trained and untrained measures of speech intelligibility, cognition or communication (either behavioural or self-reported outcomes) as a result of individual computer-based auditory training (CBAT) in people with hearing loss?
- Do any improvement(s) in communication, speech intelligibility or cognitive abilities remain for people with hearing loss after CBAT has ceased (retention of learning)?
- What are the levels of compliance with individual CBAT?
To address these questions, data from 13 published articles that met the criteria for inclusion were reviewed and quality assessed. Evidence for the efficacy of CBAT for people with hearing loss was extracted from included articles and the quality of evidence examined. Findings are presented together with recommendations for future research.
The Centre for Reviews and Dissemination, University of York , part of the National Institute for Health Research (NIHR), and the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) statement , which offer guidance for undertaking and reporting of systematic reviews in health care, were used to inform the methodology, the systematic search procedure, and the reporting of this systematic review (Checklist S1).
Systematic Search Strategy and Study Selection
Methods of data extraction, data analysis, and inclusion and exclusion criteria were pre-specified and documented within the systematic review protocol. This is important in providing transparency in the review process by ensuring that the objectives of the systematic review and methods of data identification and extraction are clearly defined prior to any data being collected. Details of the systematic review protocol have been registered with PROSPERO, the International prospective register of systematic reviews. The protocol is available online at: http://www.crd.york.ac.uk/prospero/display_record.asp?ID=CRD42011001406. Inclusion criteria were formed using the Participants, Intervention, Control, Outcomes, and Study designs (PICOS) strategy . PICOS inclusion criteria are presented in Table 1. Exclusion criteria included articles that were published prior to 1996 (i.e. those included in the previous review of auditory training for people with hearing loss by Sweetow and Palmer, ), studies presenting pilot data, studies that were not peer reviewed and those not available in English.
Table 1. PICOS criteria for inclusion.doi:10.1371/journal.pone.0062836.t001
Eight electronic databases (Embase, Medline, Pubmed, Web of Science, Applied Social Sciences Index and Abstracts (ASSIA), Science Direct,/Cumulative Index to Nursing and Allied Health (CINAHL) and PsychINFO) were initially searched in August 2011 using the terms hearing loss OR hearing aid* OR hearing impair* OR cochlear implant* AND auditory training OR auditory learning OR perceptual training OR perceptual learning. Search terms were always combined in an attempt to limit identified papers to those reporting adult subjects with hearing loss. An example search string is provided (Example Search Terms S1). Additional articles were identified through the systematic snowballing of all 349 articles reference lists, and a related article search for each author of an article which met the PICOS criteria for inclusion. Three further articles were identified through ongoing hand-searches of audiology journals, up to the date of first submission of this article (December 2012), to ensure an up-to-date review.
The database searches returned a total of 349 articles. A further 27 articles were identified through the additional journal searches. A total of 229 articles of potential relevance remained after the removal of duplicate articles (n = 147). Abstracts of the 229 identified articles were independently assessed by the two authors relative to the PICOS criteria for inclusion (Figure 1), of which, 201 failed to meet the inclusion criteria. In cases where insufficient detail was available in the abstract to make a decision, the full-text of the article was retrieved and assessed against the PICOS criteria. A total of 28 abstracts either met the PICOS criteria for inclusion, or contained insufficient information from which to make a judgement, and progressed to a second stage of screening where the full-text articles were obtained.
Figure 1. Flow diagram of the study identification, eligibility, and inclusion process.doi:10.1371/journal.pone.0062836.g001
A second stage of assessment, a full-text review of the 28 potentially relevant articles, revealed 15 articles that failed to meet the PICOS criteria for inclusion. For cases where multiple publications arose from the same participant data, only the first publication was included in line with the Centre for Reviews and Dissemination guidelines . A total of 13 articles were eligible for inclusion in the systematic review.
Data Extraction and Data Synthesis
Data to be extracted were pre-specified within a data extraction and quality assessment form, piloted by the two authors and amended as necessary. Final study data extraction was conducted independently by the same two authors and included details of study design, participants (number, age, sex and hearing loss), training stimuli, amount of training and training duration, outcome measures, main findings (both trained and untrained), compliance and follow-up. Where any instances of non-agreement on the extracted data occurred, the article was jointly revisited until a consensus was reached.
Study Quality and Potential Sources of Study Bias
Scientific study quality and potential sources of study bias were assessed using five independent measures; randomisation, controls, sample size and power calculation, blinding, and outcome measure reporting. Low scores on these measures indicate less information, thus a higher potential for bias in results. Five additional measures, which were all highly specific to training intervention studies, aimed to capture the quality of the intervention study designs. Measures included; generalisation of learning to functional benefits in real-world listening (outcome selection), training feedback, which has been previously shown to maximise auditory learning in auditory training , , ecological validity, compliance with training protocols, and long-term follow-up of improvements. Scores for each of the study quality measures ranged from 0–2. A score of 0 indicated flawed or no information from which to make a judgement, a score of 1 indicated weak information or lack of detail and a score of 2 indicated appropriate use and reporting.
Individual measure scores were summed to form an overall study quality score that was then used to inform the level of evidence attributed to each study. Levels of evidence were adapted from the 2004 Grading of Recommendations Assessment, Development and Evaluation (GRADE) Working Group guidelines  and provide an indication of confidence in the estimation of effect (Table 2). Studies that represent a low-level of evidence offer results that are likely to vary should the experiment be repeated, whereas a study offering a high-level of evidence provides greater confidence that the data are representative of valid results.
Table 2. Level of evidence by study quality score (Adapted from the GRADE Working Group, 2004 ).doi:10.1371/journal.pone.0062836.t002
A meta-analysis of results from comparable studies was not possible due to the heterogeneity between studies in terms of differences in participant samples (people with hearing loss, hearing aid users, and cochlear implant users), training stimuli, training protocols, and outcome measures adopted. As such, study findings and study quality were incorporated within a narrative synthesis to aid interpretation of findings and to examine any differences in outcomes across the 13 articles included in the systematic review.
Table 3 summarises the data extracted from each of the 13 articles. Where publications reported more than one study or training protocol these are presented separately in the table.
Table 3. Descriptive summary of extracted data from the 13 included articles.doi:10.1371/journal.pone.0062836.t003
Data extracted from the 13 articles are presented in terms of the PICOS criteria (Participants, Intervention, Controls, Outcome measures, Study designs).
Participant samples included people with hearing loss without hearing aids or cochlear implants , , , new  and existing hearing aid users , , , experienced cochlear implant users [36, 41 43–45, 47], and bimodal (cochlear implant plus hearing aid) users . However, samples were not always consistent. Participants in the study by Burk et al.  were not all regular hearing aid users, and the participant sample in Sweetow and Henderson-Sabes  included nine participants who reported difficulty understanding speech in adverse listening environments, but did not use hearing aids. Participant sample sizes ranged from n = 3  (Experiment 1) to n = 69 , with a median sample of 9.5 (mean = 17.75, SD = 20.33).
Training stimuli, training frequency, and training duration varied substantially between studies. Several studies trained participants on small parts of speech, such as phonemes , monosyllabic words, vowels or consonants , , , , , spondee words , and nonsense syllables , . Other studies trained participants using digits , words or sentences , . The remaining studies trained their participants using hybrid communication training packages such as the Listening and Communication Enhancement (LACE) program , which included a variety of listening and cognitive tasks alongside interactive communication strategies, and ‘I hear what you mean’ , that comprised several listening comprehension tasks. Training sessions ranged from 30 minutes  to 2 hours per session , and occurred daily to twice-weekly. Training duration ranged from four days  to three months .
Ideally a systematic review would assess only high-level evidence arising from randomised controlled trials as randomisation, rather than between-group differences, substantially increases our confidence that any observed effects are attributable to the intervention. Nevertheless, inclusion of only randomised controlled trials in this review would have served to eliminate the majority of published evidence assessing the efficacy of auditory training for people with hearing loss. As such, other study designs were considered. However, only studies that reported direct comparisons between control and trained groups, or between control and trained periods within a subject group, were included in the review. Repeated measures design (where participants act as their own controls) was the most commonly identified study type.
There were no outcome measures that were common to all training studies. The majority of studies assessed measures of speech intelligibility using validated speech tests such as the Hearing in Noise Test (HINT) , the Revised Speech in Noise test (R-SPIN) , IEEE sentences , and the Nonsense Syllables Test (NST) . The study by Sweetow and Henderson-Sabes  also included behavioural measures of cognition (working memory: Listening Span , and attention: Stroop Task ) and self-report of hearing (either the Hearing Handicap Inventory for the Elderly (HHIE)  or the Hearing Handicap Inventory for Adults (HHIA) , and the Communication Scale for Older Adults (CSOA] ). The study by Ingvalson et al.  was the only other study to include a self-report measure of hearing (Speech and Spatial Qualities of Hearing Scale (SSQ) ), whereas Stacey et al.  assessed self-report of health status using the Glasgow Benefit Inventory (GBI) .
Some articles reported more than one study. There were 11 repeated measures designs –, , –, two non-randomised controlled trials ,  and three randomised controlled trials , , .
On-task learning was defined as any improvement in performance on a task or stimulus that had been directly trained. This was almost always reported in studies assessing the efficacy of auditory training for people with hearing loss (10/13). Nine articles reported significant on-task learning for trained stimuli. Despite trends towards improvement, Stacey et al.  did not show significant on-task learning for trained words in a group of 10 cochlear implant users. Barcroft et al. , Ingvalson et al.  and Zhang et al.  did not report any on-task learning results.
Burk and colleagues were the only authors to report multiple outcomes from variations in training protocols using the same word training stimuli. Humes et al.  reported significant and considerably smaller improvements (20%) in open-set word recognition for trained words presented in larger sets (600 words) than Burk and Humes, (40–55%) who presented words in smaller (150 words) sets .
Generalisation of On-task Learning
Generalisation of learning was defined as an improvement in performance on a task or stimulus not directly trained. Outcomes that measured the generalisation of learning were divided into three sub-groups; improvements in speech intelligibility, cognition and self-report of communication.
All studies reported at least one measure of speech intelligibility. Table 4 provides a summary of these outcomes and any significant post-training improvement. Results are presented for untrained speech stimuli only, thus generalisation to improvements in performance for trained stimuli produced by different talkers is not considered here (refer to Table 3).
Table 4. Improvements in untrained measures of speech intelligibility by participant type.doi:10.1371/journal.pone.0062836.t004
A number of studies reporting untrained speech intelligibility measures identified measures that had a degree of overlap between the lexical content of the trained and outcome stimuli. For example, Burk et al.  reported a 6–9% overlap and tested trained word recognition embedded in untrained sentences. Humes et al.  reported substantially greater overlap between the lexical content of trained and outcome stimuli of 50–80%. For some studies the degree of overlap was unclear, for example, the ‘Four Choice Discrimination Task’ reported by Barcroft et al.  appears to be very similar in nature to a trained exercise, although no details about any lexical overlap are provided.
Results revealed mixed findings for all participant groups, training stimuli, and study designs, whereby generalisation of learning to untrained measures of speech intelligibility did not always occur. For example, Burk et al.  reported that training on words generalised to improvements in untrained words and to trained words by untrained speakers, but did not generalise to trained words embedded in TIMIT  sentences. Similarly Zhang et al.  showed post-training improvements in the intelligibility of untrained vowels, consonants and words, but no improvements in performance for untrained sentences. Typically, where improvements were reported, the magnitude of improvement for people with hearing loss was small. For example, older hearing impaired listeners in Burk et al.  improved on untrained word recognition by an average of 6.9% compared to 45.3% in younger normally hearing listeners. Average improvement in untrained measures of speech intelligibility in people with hearing loss, ranged from 3.3% for sentences , to 14.9% average for words . Sweetow and Henderson-Sabes,  were the only authors to report effect sizes for improvements in speech outcomes for people with hearing loss following training using LACE. Despite small reported effect sizes (ES) for an untrained measure of speech intelligibility, (QuickSIN: improvement of −1.5 dB signal to noise ratio (SNR) when presented at 70 dB, ES = 0.23, improvement of −2.2 dB SNR when presented at 45 dB, ES = 0.31) , the authors suggested that 46% of participants achieved clinically significant post-training improvements (defined as an improvement of −1.6 dB or greater in the SNR). No significant improvements were shown for HINT sentences, which the authors attributed to improvements also being shown in the control group, suggesting likely test-retest improvement effects.
The study by Sweetow and Henderson-Sabes  was the only study to include cognitive outcome measures. Significant post-training improvements were shown for measures of attention (Stroop, 7.5 points) and working memory (Listening Span, 0.5 sentences). However, unlike the results for speech intelligibility measures in the same study, effect sizes were not presented for these cognitive outcomes. Furthermore, due to the hybrid (auditory-cognitive) nature of the training stimuli, it is not clear which element(s) of LACE contributed to the improvements in cognition.
Sweetow and Henderson-Sabes  demonstrated significant post-training improvements in self-reported hearing handicap using the HHIE and HHIA  and the CSOA , with effect sizes of around.4. However, Ingvalson et al.  did not report statistically significant post-training improvements for the SSQ .
Retention of Learning
Retention of learning was defined as (i) the maintenance of a significant improvement from pre-training baseline performance, or (ii) a non-significant decrease in post-training performance, at a delayed post-training follow-up assessment. Follow-up assessments were reported in 8/13 articles, ranging from 4 days to 7 months post-training.
Retention of on-task learning.
Burk et al.  reported that trained word-recognition performance at baseline (37.6%) was significantly improved six months post-training (62.9%, p<.05), but significantly worse than immediate post-training performance (83.5%, p<.05). The authors reported that participants were returned to peak post-training performance levels with as little as one hour of top-up training, although no additional follow-up was conducted to identify for how long peak performance was maintained. Stecker et al.  reported that Nonsense Syllable Test (NST) scores for new hearing aid users, showed no significant decrement from immediate post-training performance (9.8%) at an eight week follow-up (8.7%). For existing hearing aid users, the same was true, despite a smaller post-training improvement. Burk and Humes  tested participants on the same outcomes once a week for seven weeks after completion of two training protocols (easy and hard words), with no significant reduction in performance over the seven week period (Table 3). Tyler et al.  reported retention of trained sound localization and spondee-in-noise performance at two and seven months post-training, although no statistical tests are reported due to the small sample size. Finally, Oba et al.  reported retention of trained digit recognition performance at a one-month post-training that was significantly better than pre-training baseline, with no significant reduction from post-training performance levels.
Retention of generalised improvements in untrained outcomes.
Sweetow and Henderson-Sabes  reported that at the time of publication, 65% (42/65) of trained participants had completed both QuickSIN and HINT sentences, and 48% (31/65) of participants had completed the HHIE, HHIA and the CSOA questionnaires, at a four-week follow-up. Post-training improvements were reported to be maintained for all measures, although no statistical analyses were presented. Tyler et al.  reported retention of improvements for HINT sentences seven months post-training for subject 1 (of 3) only. However, the authors also reported a gradual improvement in performance over time at pre-training assessments for subject 1, suggesting that some degree of post-training improvement in this measure may be attributable to test-retest improvement effects. Oba et al.  reported retention at one month post-training was significantly greater than pre-training baseline performance for both HINT and IEEE sentences (in steady noise and in babble) with no significant change between immediate post-training and follow-up performance. Ingvalson et al.  reported no significant performance differences four days post-training for HINT and QuickSIN sentences. Zhang et al.  reported maintenance of a significant increase from pre-training baseline at a one month post-training assessment, for measures of vowel, consonant and CNC word recognition. However, no information was provided as to whether performance on these measures was significantly reduced from immediate post-training levels.
Compliance with training
Compliance was defined as the percentage of participants completing the requested training duration in each study. Compliance was reported in less than half of the articles (6/13) and the method of identifying those participants who did not achieve 100% compliance differed between studies. Stecker et al.  reported that on average, participants achieved 37 of the requested 44 days of training (92.5%). Sweetow and Henderson-Sabes  reported overall compliance of 73% (65/89 participants completed the training) although no details of training duration were provided for those who had completed. Humes et al.  reported that 13/16 participants (81%) completed the requested training duration. The remaining three participants completed 92%, 75% and 50% of the requested training. As these participants did not significantly differ in performance on the post-training outcomes compared with fully-compliant participants (CID Everyday Sentences , frequent words and phrases , and VAST sentences ), data from these low-compliant participants were included in the main analysis. In the article by Stacey et al. , compliance was 73% and three participants who completed only five of the requested 15 hours of training were excluded from the main analysis. Oba et al.  reported that 100% of participants achieved the required training duration of 600 minutes, despite reported training durations ranging from 583–767 minutes. Similarly, Zhang et al.  stated that 100% of participants completed the 20 hours requested training, but reported a mean training duration of 18 hours (range 15.4–21.2 hours).
Study quality was assessed using five measures of scientific study validity, and five training-specific study quality criteria (each scoring 0–2), resulting in a possible maximum study quality score of 20. Table 5 shows individual study validity ratings and overall study quality scores for each of the 13 articles. Overall study quality ranged from very low (lowest score for Barcroft et al. , scoring 1/20) to moderate study quality (highest score for Sweetow and Henderson-Sabes, , scoring 13/20).
Table 5. Study validity criteria, study quality scores and levels of evidence for included articles.doi:10.1371/journal.pone.0062836.t005
Scientific study quality.
Out of a maximum 10 points for the scientific study quality, the highest scoring article achieved a total of five points . None of the included articles reported participant or tester blinding, or a power calculation to determine the required participant sample size. Where participant randomisation was used, there was often a lack of detail on how randomisation was conducted , , . However, more than half the articles (8/13) scored 2 points for the adequate reporting of all included outcome measures in their studies.
Training intervention-specific study quality.
The majority of articles (10/13) reported the use of performance feedback in their training protocols. Reporting of participant compliance with training regimens occurred in almost half of the included articles (6/13). However, definitions of non-compliance varied. For example, some studies reported this as the number of participants remaining in the study irrespective of whether they had completed the requested amount of training, e.g. . Others considered this to mean to completion of the requested training duration, e.g. . Follow-up assessments were reported in 8/13 articles, and ranged from repeated testing of participants at weekly intervals  to single follow-up assessments –, , , , . Training in the participant’s home environment occurred in approximately half of the studies , , , –, , while the remaining studies delivered training in the laboratory , –, , . Although the majority of studies (11/13) assessed and reported the generalisation of learning to untrained measures of speech intelligibility, some to cognition or communication, outcome measures were not always reported in adequate detail , , . Furthermore, there were frequent reports of test administration inconsistencies whereby not all participants were administered all outcome measures , , , training stimuli varied between participants , and findings from some outcome measures were omitted from the results , .
Risk of funding bias.
Sweetow and Henderson-Sabes  acknowledged a potential conflict of interest in funding. They reported a financial interest in Neurotone, Inc., the company licenced by the University of California, San Franscisco to produce LACE training software.
The primary aim of this systematic review was to examine the evidence for individual computer-based auditory training (CBAT) as an effective intervention for people with hearing loss. Secondary aims sought to examine the feasibility of individual CBAT as an intervention for people with hearing loss by examining (i) the long-term retention of auditory training-related improvements at post-training follow-ups, and (ii) levels of participant compliance with individual CBAT protocols.
Efficacy of Individual Computer-based Auditory Training as an Intervention for People with Hearing Loss
Following a program of individual CBAT, significant improvements on the trained task (on-task learning) were shown for all but one of the articles that reported on-task outcomes [9/10]. However, evidence for the generalisation of learning to functional benefits (i.e. speech intelligibility) for people with hearing loss was mixed. A narrative synthesis and quality assessment of included articles suggested that evidence was not robust, and a number of confounding factors contributed to the inconsistency in reported effects. First and foremost, a lack of homogeneity in training protocols (training stimuli, duration or frequency), outcome measures, participant samples (sample size, hearing loss) and study designs may have resulted in variations in reported outcomes. Second, where generalisation of learning was shown to untrained measures, improvements were often highly variable between trained individuals , , ,  and not everyone was shown to benefit from auditory training –, , , . Previous research into the neurophysiological changes resulting from auditory perceptual learning for normally hearing adults suggests that although the auditory system is responsive to training, there is a substantial degree of variability across individuals in their ability to make use of physiological cues .
In a previous review of the efficacy of auditory training for adults with hearing loss , the authors concluded there was little evidence for real-world effectiveness, but some evidence for within-study efficacy, of individual auditory training for people with hearing loss. A more recent meta-analysis of six (predominantly clinician-delivered) auditory training studies published between 1970 and 2009  suggested reliable but small improvements in speech recognition (Cohen’s d = .352). Findings from the present review are similar in that on-task learning nearly always occurred for people with hearing loss following individual CBAT. Furthermore, there was some evidence for the generalisation of that on-task learning to untrained measures of speech intelligibility, cognition and self-reports of communication. However, the magnitude of improvement for untrained outcomes is small, and reported improvements are shown to be inconsistent across different studies, and within studies across individual trainees.
Feasibility of Individual Computer-based Auditory Training as an Intervention for People with Hearing Loss
Feasibility was considered in terms of the retention of training-related improvements and compliance with individual CBAT. Although retention of post-training improvements was shown for a range of on-task and untrained measures at follow-up assessments up to 7 months post-training, the definition of retention varied across studies. The majority focused on the retention of improvements for trained tasks, not the retention of generalised improvements in untrained measures of speech intelligibility, cognition and communication. It is the latter that holds the most promise for individual CBAT to improve the everyday listening abilities of people with hearing loss.
Details of participant compliance with training were often underreported, appearing in less than half of the articles included in the review (6/13). Where reported, participant compliance rates were high. However, these reports of high compliance with training were not consistent with a large-scale study of more than 3000 clinical LACE trainees , where compliance (defined as completion of 10 or more training sessions) was around 30% . This may suggest that rates of compliance with individual CBAT may be greater in smaller, controlled research-settings than may be typically expected in clinical environments.
Study Quality and Evidence of Bias
Study quality scores suggest that the articles included in this review offer very-low to moderate levels of evidence. None of the studies reported participant or tester blinding. Thus, where between-groups designs are employed and the control group received no intervention , , , , we cannot be confident that any training improvements were not biased by placebo effects. The study by Sweetow and Henderson-Sabes  that obtained the highest quality score was the only study to report cognitive outcomes. Results showed significant generalisation of learning from trained stimuli (LACE) to untrained measures of speech intelligibility (QuickSIN), cognition (attention: Stroop Task, and working memory: listening span), and self-report of communication (HHIE, HHIA and CSOA).
The majority of studies failed to account for test-retest improvements in reported outcomes. When administering the outcomes across multiple test sessions, there is a possibility that improvement will occur as a result of procedural rather than perceptual learning , . It has been recommended for the HINT and QuickSIN sentences that practice with at least two sentence lists is needed to eliminate procedural learning effects at baseline sessions . Only two of the articles repeated outcome measure assessments at baseline sessions. Studies by Fu and colleagues  administered outcomes for a minimum of two weeks prior to training, and Stacey and colleagues  repeated baseline measures for approximately three hours per participant, both until a performance asymptote was reached. The total number of occasions outcomes that administered was not reported in either study. Finally, two articles omitted findings from some outcome measures included in the studies , . Selective outcome reporting is likely to lead to inaccurate and misleading conclusions being reached .
Lack of High-quality Evidence as a Barrier to implementation
Results from this systematic review demonstrate robust on-task learning following individual CBAT. Generalisation of on-task learning to functional benefits for people with hearing loss is less robust. Evidence for the generalisation of on-task learning to improvements in speech intelligibility, cognition and self-report of hearing suggests that improvements are both small and inconsistent across studies and individual trainees. Inconsistencies in reported effects may in part be associated with inconsistencies in study designs, training protocols, participant samples, and outcome measures adopted. However, analysis of study quality has demonstrated some fundamental issues with scientific control, which may result in a range of biases in reported effects. Nevertheless, retention of learning from both trained and untrained stimuli was shown to persist where reported, up to seven months post-training. Furthermore, where participant compliance was reported, rates were high. This suggests that individual CBAT has the potential to be a feasible intervention, which may offer benefit to the auditory-perceptual abilities of people with hearing loss.
Nevertheless, some of the questions posed by Boothroyd  in a discussion of the potential role of formal training in adapting to changed hearing, remain unanswered in the current evidence-base. First, where benefits occur, what are the mechanisms of benefit of auditory training for people with hearing loss (i.e. where generalisation of learning is shown, what elements of on-task learning are these attributable to)? How do individual characteristics interact with training outcomes? And, do training-induced changes influence participation and quality of life for people with hearing loss? Although many of these questions are currently being explored in normally hearing listeners – there is a need for further research designed to specifically address these issues in people with hearing loss.
Recommendations for further research
Based on the reviewed evidence we propose key recommendations for future research:
1. High-level evidence.
High quality studies that are randomised, blinded, with a sample size dictated by a power calculation, are crucial to adequately assess the efficacy of individual computer-based auditory training for people with hearing loss. Furthermore, the possible inclusion of an ‘active’ control group (that is a task comparable to the training group task, but for which no improvement in performance is expected), may help enable participant blinding to help ensure any training-related improvements are not influenced by placebo effects. Future research would ideally be reported in accordance with the CONSORT statement , which offers guidelines for the reporting of randomised controlled trials. This would result in sufficiently detailed reporting to allow for an adequate appraisal of the quality and applicability of published results. It is also important that future studies consider key factors pertinent to training intervention studies, including ecologically valid training environments, performance related feedback, and follow-up assessments to ascertain the long-term benefits of auditory training and adequate reporting of participant (non-) compliance as interventions can only ever be beneficial if individuals comply with them.
2. Outcome selection.
Measures that are appropriate for and sensitive to CBAT effects should be adopted to allow accurate assessment of training efficacy. This includes a consideration of the magnitude of effect required for those outcomes to represent clinically significant improvements in listening abilities for people with hearing loss, for example, combining behavioural outcomes with questionnaires to assess self-reported benefits in everyday listening. In addition, the inclusion of cognitive outcomes in future studies assessing the efficacy of individual CBAT for people with hearing loss may be informative given that the only study to include such measures in this review reported significant post-training improvements in attention and auditory working memory . Evidence from a study of LACE training with normally hearing adults suggested that training improves the neural representation of cues important for speech perception . However, Tremblay and colleagues argue that at least that some of the physiological changes as a result of auditory training may not reflect sensory-specific fine-tuning, but other top-down modulatory influences that are activated during focused listening tasks, such as stimulus exposure, attention, memory, decision-making and task execution . Thus, measurement of both auditory and cognitive outcomes may help to characterise the mechanisms of benefit for people with hearing loss following auditory training.
3. Standardisation of outcome measures.
Standardisation of outcomes across auditory training studies would enable comparisons to be made between different training protocols. Furthermore, common outcome measures would enable meta-analyses of data from future training intervention studies.
Published evidence suggests that post-training improvements in untrained outcomes are highly variable, and not everyone benefits from auditory training –, , . Thus, identification of those individuals most likely to benefit from auditory training would be of substantial clinical importance, enabling clinicians to individually target those for whom CBAT would be most effective, and consider alternative interventions for those who are least likely to benefit from training.
Summary and Conclusions
Individual computer-based auditory training (CBAT) is a time and cost efficient, flexible self-management intervention that has the potential to be delivered to people with hearing loss in their home environment. It is easily accessible to the target population via PCs and the internet , and can be tailored to individual needs. The present review identifies scientific, methodological and study quality issues in each of the 13 articles included in this systematic review. Our findings demonstrate that although individual CBAT is a feasible intervention for people with hearing loss, published evidence for the efficacy of individual CBAT to improve speech intelligibility, cognition and hearing abilities for adults with hearing loss is neither consistent nor robust. As such, the evidence cannot be used reliably to guide intervention at this time. Future high level evidence and the standardisation of outcome measures across different training studies will provide an evidence-base from which to adequately assess the efficacy of auditory training as an intervention for people with hearing loss.
Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) Checklist.
Example terms used to search the PubMed database.
We would like to thank Holly Thomas for her assistance with the systematic database search. We would also like to thank Dr Derek Hoare and Mark Edmondson-Jones and for their comments on earlier versions of this article. This paper presents independent research funded by the National Institute for Health Research (NIHR). The views expressed are those of the authors and not necessarily those of the NHS, the NIHR, or the Department of Health.
Conceived and designed the experiments: HH MAF. Performed the experiments: HH MAF. Analyzed the data: HH MAF. Contributed reagents/materials/analysis tools: HH MAF. Wrote the paper: HH MAF.
- 1. World Health Organization (2004) The global burden of disease: 2004 update. Switzerland: WHO press.
- 2. Davis A, Smith P, Ferguson M, Stephens D, Gianopoulos I (2007) Acceptability, benefit and costs of early screening for hearing disability: a study of potential screening tests and models. Health Technology Assessment 11.
- 3. Scarinci N, Worrall L, Hickson L (2008) The effect of hearing impairment in older people on the spouse. International Journal of Audiology 47: 141–151. doi: 10.1080/14992020701689696
- 4. Hétu R, Jones L, Getty L (1993) The impact of acquired hearing impairment on intimate relationships: Implications for rehabilitation. Audiology 32: 363–381. doi: 10.1111/j.1651-2227.2006.tb02378.x
- 5. Banh J, Singh G, Pichora-Fuller MK (2012) Age affects responses on the speech, spatial and qualities of hearing scale (SSQ) by adults with minimal audometric loss. Journal of the American Academy of Audiology 23: 81–91. doi: 10.3766/jaaa.23.2.2
- 6. Action on Hearing Loss (2011) Statistics on deafness and hearing loss.
- 7. Davis A (1995) Hearing in Adults. London: Whurr Publishers Ltd.
- 8. Kochkin S (2008) MarkeTrak VIII: 25-year trends in the hearing health market. Hearing Review 16: 12–31.
- 9. Smeeth L, Fletcher AE, Ng ES, Stirling S, Nunes MB, et al. (2002) Reduced hearing, ownership and use of hearing aids in elderly people in the UK – the MRC trial of the assessment and management of older people in the community: a cross-sectional survey. Lancet 359: 1466–1070. doi: 10.1016/S0140-6736(02)08433-7
- 10. Kiessling J, Pichora-Fuller MK, Gatehouse S, Stephens D, Arlinger S, et al. (2003) Candidature for and delivery of audiological services: special needs of older people. International Journal of Audiology 42: S92–S101.
- 11. Pichora-Fuller MK, Schneider BA, Daneman M (1995) How young and old adults listen to and remember speech in noise. Journal of the Acoustical Society of America 97: 593–608. doi: 10.1121/1.412282
- 12. Schneider BA, Daneman M, Murphy DR, Kwong-See S (2000) Listening to discourse in distracting settings: The effects of gaining. Psychology and Aging 15: 110–125. doi: 10.1037/0882-79184.108.40.206
- 13. Rönnberg J, Rudner M, Foo C, Lunner T (2008) Cognition counts: A working memory system for ease of language understanding (ELU). International Journal of Audiology 47: S99–S105. doi: 10.1080/14992020802301167
- 14. Shinn-Cunningham BG, Best V (2008) Selective Attention in Normal and Impaired Hearing. Trends in Amplification 12: 283–299. doi: 10.1177/1084713808325306
- 15. BSA (2012) Practice Guidance: common principles of rehabilitation for adults with hearing- and/or balance-related problems in routine audiologist services. Reading: British Society of Audiology.
- 16. Schow R, Nerbonne M (2007) Introduction to audiologic rehabilitation. Boston, MA: Pearson Education.
- 17. Wright BA, Zhang Y (2009) A review of the generalization of auditory learning. Philosophical Transactions of the Royal Society B: Biological Sciences 364: 301–311. doi: 10.1098/rstb.2008.0262
- 18. Sweetow RW, Palmer CV (2005) Efficacy of Individual Auditory Training in Adults: A Systematic Review of the Evidence. Journal of the American Academy of Audiology 16: 494–504. doi: 10.3766/jaaa.16.7.9
- 19. Bode DL, Oyer JJ (1970) Auditory training and speech discrimination. Journal of Speech and Hearing Research 13: 839–255. doi: 10.1098/rstb.2008.0262
- 20. Kricos PB, Holmes AE (1996) Efficacy of audiologic rehabilitation for older adults. Journal of the American Academy of Audiology 7: 219–229.
- 21. Rubinstein A, Boothroyd A (1987) Effect of two approaches to auditory training on speech recognition by hearing-impaired adults. Journal of Speech, Language, and Hearing Research 30: 153–160.
- 22. Montgomery A, Walden B, Schwartz D, Prosek R (1984) Training auditory-visual speech recogntiion in adults with moderate sensorineural hearing loss. Ear & Hearing 5: 30–36. doi: 10.1097/00003446-198401000-00007
- 23. Walden B, Erdman S, Montgomery A, Schwartz D, Prosek R (1981) Some effects of training on speech recognition by hearing-impaired adults. Journal of Speech and Hearing Research 24: 207–216.
- 24. Kricos P, Holmes A, Doyle D (1992) Efficacy of a communication training program for hearing impaired adults. Journal of the Academy of Rehabilitative Audiology 25: 69–80.
- 25. Ferguson MA, Henshaw H, Clark DA, Moore DR (2012) Auditory training improves listening and cognition in complex conditions. International Journal of Audiology 51: 220–227.
- 26. Chisolm T, Arnold M (2012) Evidence about the Effectiveness of Aural Rehabilitation Programs for Adults. In: L Wong, L Hickson (Eds.) Evidence-Based Practice in Audiology: Evaluating Interventions for Children and Adults with Hearing Impairment. Plural Publishing, San Diego. 237–266.
- 27. Henshaw H, Clark D, Kang S, Ferguson M (2012) Computer Skill and Internet Use in Adults Aged 50–74 years: Influence of Hearing Difficulties. Journal of Internet Medicine Research 14: e113.
- 28. Shipstead Z, Redick TS, Engle RW (2012) Is working memory training effective? Psychol Bull 138: 628–654. doi: 10.1037/a0027473
- 29. Greenwald AG, Spangenberg ER, Pratkanis AR, Eskenazi J (1991) Double-blind tests of subliminal self-help audiotapes. Psychological Science 2: 119–122.
- 30. Cochrane (2012) The Cochrane Library. John Wiley & Sons Ltd.
- 31. Centre for Reviews and Dissemination (2008) Systematic Reviews: CRD’s guidance for undertaking systematic reviews in health care. Centre for Research and Dissemination, University of York.
- 32. Moher D, Liberati A, Tetzlaff J, Altman DG (2009) Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement. PloS Medicine 6: e1000097. doi: 10.1371/journal.pmed.1000097
- 33. Amitay S, Halliday L, Taylor J, Sohoglu E, Moore DR (2010) Motivation and Intelligence Drive Auditory Perceptual Learning. PloS One 5: e9816. doi: 10.1371/journal.pone.0009816
- 34. Song JH, Skoe E, Banai K, Kraus N (2012) Training to improve hearing speech in noise: biological mechanisms. Cerebral Cortex 22: 1180–1190. doi: 10.1093/cercor/bhr196
- 35. Group GW (2004) Grading quality of evidence and strength of recommendations. BMJ 328: 1490. doi: 10.1136/bmj.328.7454.1490
- 36. Fu QJ, Galvin J, Wang X, Nogaki G (2004) Effects of auditory training on adult cochlear implant patients: a preliminary report. Cochlear Implants International 5: 84–90. doi: 10.1002/cii.181
- 37. Burk MH, Humes LE, Amos NE, Strauser LE (2006) Effect of Training on Word-Recognition Performance in Noise for Young Normal-Hearing and Older Hearing-Impaired Listeners. Ear & Hearing 27: 263–278. doi: 10.1097/01.aud.0000215980.21158.a2
- 38. Stecker GC, Bowman GA, Yund EW, Herron TJ, Roup CM, et al. (2006) Perceptual training improves syllable identification in new and experienced hearing aid users. Journal of Rehabilitation Research & Development 43: 537–551. doi: 10.1682/JRRD.2005.11.0171
- 39. Sweetow RW, Henderson-Sabes J (2006) The Need for and Development of an Adaptive Listening and Communication Enhancement (LACETM) Program. Journal of the American Academy of Audiology 17: 538–558. doi: 10.3766/jaaa.17.8.2
- 40. Burk MH, Humes LE (2008) Effects of Long-Term Training on Aided Speech-Recognition Performance in Noise in Older Adults. Journal of Speech, Language, and Hearing Research 51: 759–771. doi: 10.1044/1092-4388(2008/054)
- 41. Miller JD, Watson CS, Kistler DJ, Wightman FL, Preminger JE (2008) Preliminary evaluation of the speech perception assessment and training system (SPATS) with hearing-aid and cochlear-implant users. Proc Meet Acoust 2: 1–15. doi: 10.1121/1.2988004
- 42. Humes LE, Burk MH, Strauser LE, Kinney DL (2009) Development and efficacy of a frequent-word auditory training protocol for older adults with impaired hearing. Ear & Hearing 30: 613–627. doi: 10.1097/AUD.0b013e3181b00d90
- 43. Stacey PC, Raine CH, O’Donoghue GM, Tapper L, Twomey T, et al. (2010) Effectiveness of computer-based auditory training for adult users of cochlear implants. International Journal of Audiology 49: 347–356. doi: 10.3109/14992020903397838
- 44. Tyler RS, Witt SA, Dunn CC, Wang W (2010) Initial Development of a Spatially Separated Speech-in-Noise and Localization Training Program. Journal of the American Academy of Audiology 21: 390–403. doi: 10.3766/jaaa.21.6.4
- 45. Oba SI, Fu Q, Galvin JJ (2011) Digit training in noise can improve cochlear implant users’ speech understanding in noise. Ear & Hearing 32: 573–581. doi: 10.1097/AUD.0b013e31820fc821
- 46. Barcroft J, Sommers MS, Tye-Murray N, Mauze E, Schroy C, et al. (2011) Tailoring auditory training to patient needs with single and multiple talkers: Transfer-appropriate gains on a four-choice discrimination test. International Journal of Audiology 50: 802–808. doi: 10.3109/14992027.2011.599868
- 47. Ingvalson EM, Lee B, Fiebig P, Wong PC (2012) The Effects of Short-Term Computerized Speech-in-Noise Training on Post-Lingually Deafened Adult Cochlear Implant Recipients. Journal of Speech, Language and Hearing Research.
- 48. Zhang T, Dorman MF, Fu QJ, Spahr AJ (2012) Auditory training in patients with unilateral cochlear implant and contralateral acoustic stimulation. Ear and Hearing 33: e70–e79. doi: 10.1097/AUD.0b013e318259e5dd
- 49. Studebaker GA (1985) A “Rationalized” Arcsine Transform. Journal of Speech and Hearing Research 28: 455–462.
- 50. Turner CW, Gantz BJ, Vidal C, Behrens A, Henry BA (2004) Speech recognition in noise for cochlear implant listeners: benefits of residual acoustic hearing. Journal of the Acoustical Society of America 115: 1729–1735. doi: 10.1121/1.1687425
- 51. Tyler RS, Noble W, Dunn C, Witt S (2006) Some benefits and limitations of binaural cochlear implants and our ability to measure them. International Journal of Audiology 45: S113–S119. doi: 10.1080/14992020600783095
- 52. Spahr AJ, Dorman MF, Litvak LM, Van Wie S, Gifford RH, et al. (2012) Development and Validation of the AzBio Sentence Lists. Ear and Hearing 33: 112–117. doi: 10.1097/AUD.0b013e31822c2549
- 53. Bench J, Kowal A, Bamford J (1979) The BKB (Bamford-Kowal-Bench) sentence lists for partially-hearing children. British Journal of Audiology 13: 108–112. doi: 10.3109/03005367909078884
- 54. Tye-Murray N, Sommers M, Spehar B, Myerson J, Hale S, et al. (2008) Auditory-visual discourse comprehension by older and young adults in favorable and unfavorable conditions. International Journal of Audiology 47 Supplement 2S31–37. doi: 10.1080/14992020802301662
- 55. Davis H, Silverman SR (1978) Hearing and Deafness. New York: Holt, Rinehart and Winston.
- 56. Hirsh IJ, Davis H, Silverman SR, Reynolds EG, Eldert E, et al. (1952) Development of Materials for Speech Audiometry. Journal of Speech and Hearing Disorders 17: 321–337.
- 57. Tillman TW, Carhart R (1966) An Expanded Test for Speech Discrimination Utilizing CNC Monosyllabic Words, Northwestern University Auditory Test No. 6. Texas: USAF School of Aerospace Medicine, Brooks Air Force Base. 1–12 p.
- 58. Peterson GE, Lehiste I (1962) Revised CNC lists for auditory tests. Journal of Speech and Hearing Disorders 27: 62–70.
- 59. Shannon RV, Jensvold A, Padilla M, Robert ME, Wang X (1999) Consonant recordings for speech testing. Journal of the Acoustical Society of America 106.
- 60. Kaplan H, Bally S, Brandt F, Busacco D, Pray J (1997) Communication Scale for Older Adults (CSOA). Journal of the American Academy of Audiology 8: 203–217.
- 61. Cox RM, Alexander GC, Gilmore C (1987) Development of the Connected Speech Test (CST). Ear & Hearing 8: 119S–126S. doi: 10.1097/00003446-198710001-00010
- 62. Boothroyd A, Hanin L, Hnath T (1985) A sentence test of speech perception: Reliability, set equivalence, and short term learning. New York: City University of New York.
- 63. Dunn CC, Tyler RS, Witt SA (2005) Benefit of wearing a hearing aid on the unimplanted ear in adult users of a cochlear implant. Journal of Speech, Language, and Hearing Research 48: 668–680.
- 64. IEEE (1969) IEEE Recommended Practice for Speech Quality Measurements. IEEE Transactions on Audio and Electroacoustics 17: 225–246.
- 65. Robinson K, Gatehouse S, Browning GC (1996) Measuring patient benefit from otorhinolaryngological surgery and therapy. Annals of Otology, Rhinology and Laryngology 105: 415–422.
- 66. Newman CW, Weinstein BE, Jacobson GP, Hug GA (1990) The Hearing Handicap Inventory for Adults: psychometric adequacy and audiometric correlates. Ear & Hearing 11: 430–433. doi: 10.1097/00003446-199012000-00004
- 67. Ventry IM, Weinstein BE (1982) The Hearing Handicap Inventory for the Elderly: A New Tool. Ear & Hearing 3: 128–134. doi: 10.1097/00003446-198205000-00006
- 68. Nilsson M, Soli SD, Sullivan JA (1994) Development of the Hearing in Noise Test for the measurement of speech reception thresholds in quiet and in noise. The Journal of the Acoustical Society of America 95: 1085–1099. doi: 10.1121/1.408469
- 69. Dubno JR, Levitt H (1981) Predicting consonant confusions from acoustic analysis. The Journal of the Acoustical Society of America 69: 249–261. doi: 10.1121/1.385345
- 70. Killion MC, Niquette PA, Gudmundsen GI, Revit LJ, Banerjee S (2004) Development of a quick speech-in-noise test for measuring signal-to-noise ratio loss in normal-hearing and hearing-impaired listeners. Journal of the Acoustical Society of America 116: 2395–2405. doi: 10.1121/1.1784440
- 71. Wilson RH, McArdle R, Watts KL, Smith SL (2012) The Revised Speech Perception in Noise Test (R-SPIN) in a multiple signal-to-noise ratio paradigm. Journal of the American Academy of Audiology 23: 590–605. doi: 10.3766/jaaa.23.7.9
- 72. Miller JD, Watson CS, Kewley-Port D, Sillings R, Mills W, et al. (2007) SPATS: Speech Perception Assessment and Training System. Journal of the Acoustical Society of America 122: 3063. doi: 10.1121/1.2942927
- 73. Kalikow DN, Stevens KN, Elliott LL (1977) Development of a test of speech intelligibility in noise using sentence materials with controlled word predictability. Journal of the Acoustical Society of America 61: 1337–1351. doi: 10.1121/1.381436
- 74. Gatehouse S, Noble W (2004) The Speech, Spatial and Qualities of Hearing Scale (SSQ). International Journal of Audiology 43: 85–99. doi: 10.1080/14992020400050014
- 75. Uttl B, Graf P (1997) Color-Word Stroop test performance across the adult life span. Journal of Clinical and Experimental Neuropsychology 19: 405–420. doi: 10.1080/01688639708403869
- 76. Garofolo JS, Lamel LF, Fisher WM, Fiscus JG, Pallett DS, et al.. (1993) DARPA TIMIT Acoustic-phonetic Continuous Speech Corpus. Philadelphia: Linguistic Data Consortium.
- 77. Bastiaanse R, Edwards S, Rispens J (2002) The verb and sentence test. Bury St Edmonds: Thames Valley Test Company.
- 78. Hillenbrand J, Getty LA, Clark MJ, Wheeler K (1995) Acoustic characteristics of American English vowels. Journal of the Acoustical Society of America 97: 3099–3111. doi: 10.1121/1.411872
- 79. Tremblay K, Kraus N, McGee T (1998) The time course of auditory perceptual learning: neurophysiological changes during speech-sound training. Neuroreport 9: 3557–3560. doi: 10.1097/00001756-199811160-00003
- 80. Sweetow R (2009) Integrating LACE into a busy clinical practice. American Academy of Audiology. Dallas, TX.
- 81. Sweetow RW, Sabes JH (2010) Auditory training and challenges associated with participation and compliance. Journal of the American Academy of Audiology 21: 586–593. doi: 10.3766/jaaa.21.9.4
- 82. McArthur GM (2007) Test–Retest Effects in Treatment Studies of Reading Disability: The Devil is in the Detail. Dyslexia 13: 240–252. doi: 10.1002/dys.355
- 83. Yund EW, Woods DL (2010) Content and Procedural Learning in Repeated Sentence Tests of Speech Perception. Ear & Hearing 31: 769–778. doi: 10.1097/AUD.0b013e3181e68e4a
- 84. Kirkham JJ, Dwan KM, Altman DG, Gamble C, Dodd S, et al. (2010) The impact of outcome reporting bias in randomised controlled trials on a cohort of systematic reviews. BMJ (Clinical research ed) 340: c365. doi: 10.1136/bmj.c365
- 85. Boothroyd A (2010) Adapting to Changed Hearing: The Potential Role of Formal Training. Journal of the American Academy of Audiology 21: 601–611. doi: 10.3766/jaaa.21.9.6
- 86. Song J, Skoe E, Banai K, Kraus N (2012) Training to improve speech in noise: Biological mechanisms. Cerebral Cortex 22: 1180–1190. doi: 10.1093/cercor/bhr196
- 87. Wright BA, Wilson RM, Sabin AT (2010) Generalization lags behind learning on an auditory perceptual task. Journal of Speech, Language and Hearing Research 56: 31–43.
- 88. Tremblay K (2007) Training-related changes in the brain: Evidence from human auditory-evoked potentials. Seminars in Hearing 28: 120–132.
- 89. Schulz KF, Altman DG, Moher D (2010) CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials. British Medical Journal 340: c869. doi: 10.1136/bmj.c869