Byrd, Nick and Joseph, Brianna and Gongora, Gabriela and Sirota, Miroslav (2023) Tell Us What You Really Think: A Think Aloud Protocol Analysis of the Verbal Cognitive Reflection Test. Journal of Intelligence, 11 (4). p. 76. DOI https://doi.org/10.3390/jintelligence11040076
Byrd, Nick and Joseph, Brianna and Gongora, Gabriela and Sirota, Miroslav (2023) Tell Us What You Really Think: A Think Aloud Protocol Analysis of the Verbal Cognitive Reflection Test. Journal of Intelligence, 11 (4). p. 76. DOI https://doi.org/10.3390/jintelligence11040076
Byrd, Nick and Joseph, Brianna and Gongora, Gabriela and Sirota, Miroslav (2023) Tell Us What You Really Think: A Think Aloud Protocol Analysis of the Verbal Cognitive Reflection Test. Journal of Intelligence, 11 (4). p. 76. DOI https://doi.org/10.3390/jintelligence11040076
Abstract
The standard interpretation of cognitive reflection tests assumes that correct responses are reflective and lured responses are unreflective. However, prior process-tracing of mathematical reflection tests has cast doubt on this interpretation. In two studies (N = 201), we deployed a validated think-aloud protocol in-person and online to test how this assumption is satisfied by the new, validated, less familiar, and non-mathematical verbal Cognitive Reflection Test (vCRT). Verbalized thoughts in both studies revealed that most (but not all) correct responses involved reflection and that most (but not all) lured responses lacked reflection. The think-aloud protocols seemed to reflect business-as-usual performance: thinking aloud did not disrupt test performance compared to a control group. These data suggest that the vCRT usually satisfies the standard interpretation of the reflection tests (albeit not without exceptions) and that the vCRT can be a good measure of the construct theorized by the two-factor explication of ‘reflection’ (as deliberate and conscious).
Item Type: | Article |
---|---|
Uncontrolled Keywords: | cognitive reflection test; think-aloud protocol analysis; psychometrics; judgment- and decision-making; heuristics and biases |
Divisions: | Faculty of Science and Health Faculty of Science and Health > Psychology, Department of |
SWORD Depositor: | Unnamed user with email elements@essex.ac.uk |
Depositing User: | Unnamed user with email elements@essex.ac.uk |
Date Deposited: | 28 Apr 2023 12:25 |
Last Modified: | 07 Aug 2024 20:21 |
URI: | http://repository.essex.ac.uk/id/eprint/35471 |
Available files
Filename: jintelligence-11-00076-v3.pdf
Licence: Creative Commons: Attribution 4.0