Increased risk of type I errors for detecting heterogeneity of treatment effects in cluster-randomized trials using mixed-effect models

Abstract

Background/Aims Evaluating heterogeneity of treatment effects (HTE) across subgroups is common in both randomized trials and observational studies. Although several statistical challenges of HTE analyses including low statistical power and multiple comparisons are widely acknowledged, issues specific to clustered data, including cluster randomized trials (CRTs), have received less attention. For testing interactions in linear mixed-effects models (LMM), Barr et al. (2013) suggested that: random slopes for interaction terms should be studied. In this paper, we explore the impact of model misspecification, including generalized LMM (GLMM) with or without random slopes, and provide recommendations for conducting inference for HTE across subgroups in CRTs. Methods We conducted a simulation study to evaluate the performance of common analytic approaches for testing the presence of HTE for continuous, binary, and count outcomes: generalized linear mixed models (GLMM) and generalized estimating equations (GEE) including interaction terms between treatment and subgroup. Several simulation scenarios covered broad range of scenarios in CRTs, for example, small to a large number of clusters, small to moderate cluster-specific random slopes for subgroup. The performance metric was the empirical type I error rate compared to a nominal level. We applied the analytical methods to a real-world CRT using the count outcome utilization of healthcare from the motivating Primary Care Opioid Use Disorder treatment (PROUD) trial. Results We found that standard GLMM analyses that assume a common correlation of participants within clusters can lead to severely elevated type 1 error rates of up to 47.2% compared to the 5% nominal level if the within-cluster correlation varies across subgroups. A maximal GLMM, which allows subgroup-specific within-cluster correlations, achieved the nominal type 1 error rate, as did GEE (though rates were slightly elevated even with as many as 50 clusters). Applying the methods to the real-world CRT, we found a large impact of the model specification on inference.