The Unified Batten Disease Rating Scale (UBDRS): Validation and reliability in an independent CLN3 disease sample

BACKGROUND: The neuronal ceroid lipofuscinoses (NCLs) are a group of disorders characterized by neurodegeneration and intracellular accumulation of an auto-fluorescent lipopigment. Together, NCLs represent the most common cause of cerebral neurodegenerative disease in children. CLN3 disease, the classic juvenile-onset form (JNCL) due to mutations in CLN3, is characterized by progressive vision loss, epilepsy, dementia, behavioral difficulties, and motor impairment. The Unified Batten Disease Rating Scale (UBDRS) is a disease-specific rating scale that was developed to assess disease severity in 4 domains: physical, behavior, seizures, and functional capability. Validity and reliability of the UBDRS has been established in a large North American cohort of over 130 individuals. The purpose of this study was to determine whether the UBDRS is valid and reliable when tested in an independent sample.

METHODS: Over the course of one week, 13 individuals with genetically confirmed CLN3 disease were evaluated with the UBDRS by 5 examiners at the University Medical Center Hamburg Eppendorf (UKE). One rater (JWM), one of the developers of the UBDRS, served as the reference standard. The other 4 raters were physicians with expertise in various forms of Batten Disease. After a formal training session, 13 individuals (age 16.5 ± 5.6 yrs) were evaluated simultaneous in parallel by the 5 raters. Inter-rater reliability of the Physical subscale was assessed with Intra-class Correlation (ICC) analysis. The relationship between age and severity was assessed and compared to previously published data from the North American cohort.

FINDINGS: The ICC among the 5 independent raters was 0.92, demonstrating excellent inter-rater reliability. The individual correlations of each UKE rater compared to the reference standard rater were all >0.95. The average UBDRS Physical Subscale score in this sample was 28 ± 21 (mean ± SD) with a range from 1 to 61. When evaluated as a function of participant age, the slope was 3.06 points/year (R2 = 0.66).

INTERPRETATION: We have shown excellent interrater reliability for the UBDRS as a clinical rating scale for CLN3 disease in a sample independent from previous work. The results of this study are comparable to those published by Kwon et al., 2011 in a North American cohort showing a slope of 2.86 points per year with a 95% CI of 2.27-3.45 (N = 82). Our results demonstrate excellence inter-rater reliability after training a new group of raters and provide additional evidence for construct validity of the UBDRS. The UBDRS is a valid and reliable rating scale that can used by trained raters to assess the severity and rate of progression of CLN3 disease.