Effectiveness of An EHR- and KPI Dashboard-Based Technology Utilization Training Intervention on Nursing Leaders’ Digital Competency and KPI

Abstract

Background: Saudi Arabia’s ongoing digital health transformation has expanded the availability of electronic health records (EHRs), computerized provider order entry systems, clinical dashboards, and digital performance data. Effective digital transformation requires nursing leaders to possess the knowledge, competency, confidence, and practical skills necessary to translate digital information into leadership and performance-management activities.

Objective: To evaluate the effectiveness of an EHR- and key performance indicator (KPI) dashboard-based technology utilization training intervention in improving nursing leaders’ knowledge, attitude, practice, digital competency, digital self-efficacy, perceived usefulness, perceived ease of use, technology utilization behavior, and perceived KPI management ability within the Second Medical Health Cluster, Saudi Arabia.

Methods: A quantitative quasi-experimental nonequivalent control-group pretest–posttest design was employed. The study included 148 nursing leaders, with 74 participants in the intervention group and 74 in the control group. The intervention consisted of six blended-learning sessions delivered over four weeks and focused on EHR use, KPI dashboard interpretation, digital reporting, documentation monitoring, medication and patient-safety information, and data-informed leadership decision-making. Outcomes were assessed using a structured questionnaire.

Results: At baseline, the overall mean knowledge score was 47.25%, while mean attitude and practice scores were 3.11 and 3.00, respectively. Compared with the control group, the intervention group demonstrated significantly greater improvement in knowledge (Cohen’s d=1.43, p<.001), attitude (ηp²=.269, p<.001), practice (ηp²=.174, p<.001), digital competency (ηp²=.547, p<.001), digital self-efficacy (ηp²=.357, p<.001), perceived usefulness (d=.86, p<.001), perceived ease of use (ηp²=.382, p<.001), technology utilization behavior (ηp²=.355, p<.001), and perceived KPI management ability (ηp²=.570, p<.001). Age, nursing experience, and leadership experience were associated with technology utilization at the bivariate level; however, no individual demographic or professional factor remained independently significant after multivariable adjustment.

Conclusion: Structured, leadership-specific EHR- and KPI dashboard-based training was associated with substantial short-term improvements in nursing leaders measured digital capabilities, technology utilization, and perceived KPI management ability. The strongest adjusted effects were observed for perceived KPI management ability and digital competency. The findings relate primarily to self-reported outcomes and should not be interpreted as evidence of direct improvement in institutional or clinical KPI performance.