# Data from: Comparison of the Validity of the Checklist Assessment in the Cardiac Arrest Simulations with the App in an Academic Hospital in Taiwan: A Retrospective Observational Study

## Creators

- **Ming-Yuan Huang**  

- **Lu-Chih Kung**  

- **Sheng-Wen Hou**  

- **Yi-Kung Lee**  

- **Yung-Cheng Su**  

## Description

### **Background**

Robust assessment is a crucial component in **Advanced Cardiac Life Support (ACLS)** training to determine whether participants meet learning objectives with consistency. This study aimed to evaluate **resuscitation performance using real-time logs**, comparing traditional instructor checklists to time-sensitive performance metrics recorded via video and mobile app.

The study hypothesized that instructors may be unable to reliably assess **time-sensitive parameters** like:

- **Chest Compression Fraction (CCF)**

- **Time to Initiating Chest Compression**

- **Time to Initiating Defibrillation**

### **Methods**

- **Data Source:** Video records and checklist-based evaluations of Megacode scenarios from ACLS certification exams across hospitals in **Taipei**.

- **Analysis:** Time-sensitive metrics were extracted using **video reviews assisted by a mobile phone app**.

- The study compared **checklist pass/fail results** with these quantitative parameters.

### **Results**

- **Total Scenarios Analyzed:** 185

- **Key Finding:** High chest compression fraction was significantly associated with passing (OR = 3.65; 95% CI: 1.36–9.91; **P = 0.01**).

- Among **112 participants** who failed one time-sensitive parameter:

  - Only **25 were marked as fail** by checklist.

  - This resulted in a **specificity of 22.3%** (95% CI: 15.0–31.2%).

### **Conclusions**

- Visual evaluation of CPR performance is **inaccurate** for time-sensitive parameters.

- **Objective, app-based evaluations** should be integrated into ACLS assessments for both accurate certification and effective feedback to trainees.