Rates of agreement with statements in post-test survey: comparison of residents and experts
| Statement | No. (%) of participants;* group | p value | |
|---|---|---|---|
| Residents n = 36 | Experts n = 23 | ||
| The instructions at the beginning of the test were clear. | 23 (65.7) | 20 (87.0) | 0.014 |
| The SCT examples (with answers) presented before the test were helpful. | 22 (62.9) | 20 (87.0) | 0.007 |
| The test questions were clear. | 16 (44.4) | 21 (91.3) | < 0.001 |
| It was easy to adapt to this kind of test. | 11 (30.5) | 17 (73.9) | 0.001 |
| The questions reflected authentic clinical situations. | 25 (69.4) | 23 (100) | 0.003 |
| The questions reflected situations that I have encountered or I am likely to encounter during my training/practice. | 26 (72.2) | 23 (100) | 0.005 |
| This evaluation was useful for testing the ability to reason through cases in otolaryngology. | 18 (50.0) | 21 (91.3) | 0.002 |
SCT = script concordance testing.
↵* Participants who answered “agree” or “strongly agree.”