Validation of “time to task” performance assessment method in simulation
View File(s)
- Author(s)
- Details
-
Mary Ann Shinnick, PhD, ACNP, CCNS, CHSE; Mary A. Woo, PhD
- Sigma Affiliation
- Non-member
- Contributor Affiliation(s)
- International Nursing Association for Clinical Simulation and Learning (INACSL)
Background. Current methods to assess clinical performance are known to be often invalid and unreliable1. Therefore, we pilot tested an objective assessment of clinical competence, “Time to Task” (ability to perform specific activities within 5 minutes) and compared it to two other assessments, the Lasater Clinical Judgement Rubric (Lasater) and the common “pass/fail” assessment (subjective measure of whether the subject would “pass” or “fail”).
Methods. Using a prospective, “Known Groups” (expert vs. novice nurses) design, Expert nurses (ICU nurses) and Novice nurses (senior prelicensure nursing students) participated individually in a simulation. Academic and clinical experts reviewed each video and scored each performance on two assessments while the third assessment, “Time to Task”, (key task elements to be completed in 5 minutes) was calculated from each video by the researcher. Statistical analysis consisted of T-Tests and Chi-square.
Results. Fourteen evaluators reviewed the videos. For “Time to Task”. There was strong statistical significance between the novice and expert groups (p < 0.01) and sensitivity (0.80) and specificity (0.85) were good. The Lasater (p < 0.01) only had sensitivity (0.72) and specificity (0.40) while “pass/fail”, sensitivity was high (0.90) but specificity was low (0.47) indicating an ability to identify “Expert” nurses but not “Novice” nurses.
Conclusion. “Time to Task” performed best as a measure of competency in simulation. While there have been similar objective measures in healthcare, they have not been adopted for assessment of clinical performance 2,3. One instrument is not appropriate for all assessment but “Time to Task” warrants further study.
INACSL Conference 2017: Nursing Simulation, Marriott Wardman Hotel, Washington, DC, USA
Items submitted to a conference/event were evaluated/peer-reviewed at the time of abstract submission to the event. No other peer-review was provided prior to submission to the Henderson Repository, unless otherwise noted.
| Type | Presentation |
| Acquisition | Proxy-submission |
| Review Type | Abstract Review Only: Reviewed by Event Host |
| Format | Text-based Document |
| Evidence Level | N/A |
| Research Approach | N/A |
| Keywords | Simulation; Nurse Competency Assessment; Time Based Assessments |
| Name | INACSL Conference 2017 |
| Host | International Nursing Association for Clinical Simulation and Learning |
| Location | Washington, DC, USA |
| Date | 2017 |
All rights reserved by the author(s) and/or publisher(s) listed in this item record unless relinquished in whole or part by a rights notation or a Creative Commons License present in this item record.
All permission requests should be directed accordingly and not to the Sigma Repository.
All submitting authors or publishers have affirmed that when using material in their work where they do not own copyright, they have obtained permission of the copyright holder prior to submission and the rights holder has been acknowledged as necessary.
Related items
Showing items related by title, author, creator and subjects.
-
Validating targeted behavioral markers for baccalaureate nursing student teamwork performance outcomes in simulation
(2017-07-05)Background: Patient safety is a global priority for nurses and healthcare providers alike, yet medical errors are not decreasing. The Agency for Healthcare Research and Quality (AHRQ, 2014f) indicates that one out of seven ... -
Design and evaluation of a simulation-based assessment instrument to identify performance gaps in graduate nurses
(2018-03-15)This presentation will describe the current status of a mixed-methods, multiphase educational needs assessment of up to 250 participants intended to identify actual and perceived performance gaps graduate nurses have ... -
Expanding Guyanese nurse tutor competencies in assessment and evaluation methods: A nurse education certificate program
Assessment and evaluation are critical competencies for a nurse educator/tutor. However,inconsistencies and inaccuracies exist with various assessment measures. The use of a hybrid nursing education certificate program ... -
Literature review: Using time-on-task to enhance teaching effectiveness and student outcomes
Nurse educators strive to teach students information and skills necessary to practice safely. With advances in science and technology, nursing curricula content has reached saturation. Cognitive and physical overload affects ... -
English version of the Evidence-Based Practice Competence Questionnaire: Validity assessment among nursing students
The purpose of this study was to evaluate the psychometric properties (validities) and the ease of use of instruments among nursing students. In this study, the EBP-COQ tool was translated and validated into North American ...
