Data from: Comparison of the Validity of the Checklist Assessment in the Cardiac Arrest Simulations with the App in an Academic Hospital in Taiwan: A Retrospective Observational Study

Creators

• Ming-Yuan Huang
• Lu-Chih Kung
• Sheng-Wen Hou
• Yi-Kung Lee
• Yung-Cheng Su

Description

Background

Robust assessment is a crucial component in Advanced Cardiac Life Support (ACLS) training to determine whether participants meet learning objectives with consistency. This study aimed to evaluate resuscitation performance using real-time logs, comparing traditional instructor checklists to time-sensitive performance metrics recorded via video and mobile app.

The study hypothesized that instructors may be unable to reliably assess time-sensitive parameters like:
- Chest Compression Fraction (CCF)
- Time to Initiating Chest Compression
- Time to Initiating Defibrillation

Methods

• Data Source: Video records and checklist-based evaluations of Megacode scenarios from ACLS certification exams across hospitals in Taipei.
• Analysis: Time-sensitive metrics were extracted using video reviews assisted by a mobile phone app.
• The study compared checklist pass/fail results with these quantitative parameters.

Results

• Total Scenarios Analyzed: 185
• Key Finding: High chest compression fraction was significantly associated with passing (OR = 3.65; 95% CI: 1.36–9.91; P = 0.01).
• Among 112 participants who failed one time-sensitive parameter:
• Only 25 were marked as fail by checklist.
• This resulted in a specificity of 22.3% (95% CI: 15.0–31.2%).

Conclusions

• Visual evaluation of CPR performance is inaccurate for time-sensitive parameters.
• Objective, app-based evaluations should be integrated into ACLS assessments for both accurate certification and effective feedback to trainees.