Bottom-up, data-driven response filtering methods that exclude unrealistically fast responses from calculating test scores have been successfully applied to improve test validity. We introduce a top-down, theory-driven method to detect cognitively disengaged behavior, compare it with a data-driven method using data from a nationally representative reading assessment, and discuss its potential and limitations.
Arslan, Burcu; Lehman, Blair; Sparks, Jesse R.; and Steinberg, Jonathan, "Application of a Theory-Driven Approach to Detect Cognitively Disengaged Test-Taker Behavior" (2021). NERA Conference Proceedings 2021. 3.