Computer-Based Testing versus Paper-Based Testing in Large- Scale Assessments: A Comparative Evaluation of Mode Effects, Psychometric Equivalence, and Testing Kinetics

Abstract

The migration of large-scale academic examinations from traditional paper-based testing (PBT) to computer-based testing (CBT) environments represents a profound shift in modern educational measurement. While digital systems promise rapid administration, lower operational overhead, and opportunities for computerized adaptive testing (CAT), they also introduce potential 'mode effects' that can alter the psychometric properties of standardized test items. This paper presents a multi-site, randomized cross-over experimental design evaluating the comparability of CBT and PBT frameworks across a cohort of 480 secondary school students. Utilizing Classical Test Theory (CTT) and Item Response Theory (IRT) parameter matching, this study analyzes score equivalence, structural item differential function (DIF), test-taking velocity, and cognitive navigation fatigue across identical assessment items. Quantitative findings indicate that overall psychometric equivalence holds across standard verbal and scientific domains; however, a statistically significant mode effect was observed in complex data interpretation and spatial math subsets, with CBT cohorts achieving up to 6.7% higher efficiency (p < 0.001) due to active visualization interfaces. Conversely, time-series velocity tracking demonstrated that paper-based cohorts suffered from a 26% higher average navigation latency as testing progressed into later quartiles, indicating notable cognitive fatigue from manual booklet handling. Qualitative telemetry reveals that interface familiarity, screen layout, and digital interactive elements serve as primary drivers of student engagement,whereas systemic device variance and scrolling limits act as primary confounding factors. This research provides a mathematically validated optimization framework for educational administrators and testingpsychometrists seeking to deploy equitable, large-scale computer-basedassessment models. KEYWORDS: Computer-Based Testing (CBT); Paper-Based Testing (PBT);Mode Effects; Item Response Theory (IRT); Differential Item Functioning(DIF); Psychometric Equivalence.