Journal of Rehabilitation Research & Development (JRRD)

Quick Links

  • Health Programs
  • Protect your health
  • Learn more: A-Z Health
Veterans Crisis Line Badge

Volume 51 Number 4, 2014
   Pages 579 — 590

Abstract — Reliability of brain-computer interface language sample transcription procedures

Katya Hill, PhD, CCC-SLP;* Thomas Kovacs, MA; Sangeun Shin

Research Services, Highland Drive Department of Veterans Affairs Healthcare System, Pittsburgh, PA; and School of Health and Rehabilitation Sciences, University of Pittsburgh, Pittsburgh, PA

Abstract — We tested the reliability of transcribing language samples of daily brain-computer interface (BCI) communication recorded as language activity monitoring (LAM) logfiles. This study determined interrater reliability and interjudge agreement for transcription of communication of veterans with amyotrophic lateral sclerosis using a P300-based BCI as an augmentative and alternative communication (AAC) system. KeyLAM software recorded logfiles in a universal logfile format during use of BCI-controlled email and word processing applications. These logfiles were encrypted and sent to our laboratory for decryption, transcription, and analysis. The study reports reliability results on transcription of 345 daily logfile samples. The procedure was found to be accurate across transcribers/raters. Frequency of agreement ratios of 97.6% for total number of words and 93.5% for total utterances were found as measures of interrater reliability. Interjudge agreement was 100% for both measures. The results indicated that transcribing language samples using LAM data is highly reliable and the fidelity of the process can be maintained. LAM data supported the transcription of a large number of samples that could not have been completed using audio and video recordings of AAC speakers. This demonstrated efficiency of LAM tools to measure language performance benefits to BCI research and clinical communities.

Key words: amyotrophic lateral sclerosis, augmentative and alternative communication, BCI, brain-computer interface, encryption, language activity monitor, logfile, performance report tool, reliability, transcription.

View HTML ¦ View PDF ¦ Contents Vol. 51, No.4
This article and any supplementary material should be cited as follows:
Hill K, Kovacs T, Shin S. Reliability of brain-computer interface language sample transcription procedures. J Rehabil Res Dev. 2014;51(4):579–90.

Go to TOP

Last Reviewed or Updated  Thursday, July 24, 2014 11:47 AM

Valid HTML 4.01 Transitional