Psychometric Validation And Structural Analysis Of A Gamified Mobile Cognitive Assessment For Adolescents: The Skilme Craft-The-Block Task

Abstract

The digitisation of cognitive assessment has catalysed the development of gamified tools designed to improve engagement, scalability, and ecological validity. However, concerns persist regarding psychometric robustness and theoretical grounding, particularly in non-Western, mobile-first contexts. The present study evaluated the psychometric properties of the skilme Craft-the-Block Task, a gamified mobile assessment designed to measure Fluid Reasoning (Gf) and Psychomotor Speed (Gps) within the Cattell–Horn–Carroll (CHC) framework. A stratified random sample of 260 adolescents (aged 13–19 years; 50% male, 50% female; 56.1% rural, 43.9% urban) from educational institutions in Kerala, India completed the assessment under standardised conditions. Data analyses were conducted using R (Version 4.5.0; R Core Team, 2025) within the RStudio integrated development environment. Reliability analysis yielded strong internal consistency (Cronbach’s α = .812, 95% CI [.78, .85]). Exploratory Factor Analysis (EFA) with Varimax rotation revealed a theoretically coherent two-factor structure accounting for 62.24% of total variance, differentiating Nonverbal Concept Formation (Gf/Gv; Levels 3–10) from foundational Manual Dexterity (Gps; Levels 1–2). Corrected item-total correlations ranged from .443 to .763. No statistically significant bias was observed across gender (p = .197) or locality (p = .788). Academic grade level demonstrated a significant effect on performance (Kruskal–Wallis H = 22.14, p = .001), evidencing developmental sensitivity. These findings provide preliminary evidence supporting the reliability and structural validity of the skilme Craft-the-Block Task as a scalable, equitable digital cognitive assessment instrument.