Research Repository

Measuring Cognitive Reflection without Maths: Development and Validation fo the Verbal Cognitive Reflection Test

Sirota, Miroslav and Dewberry, Chris and Juanchich, Marie and Valuš, Lenka and Marshall, Amanda (2021) 'Measuring Cognitive Reflection without Maths: Development and Validation fo the Verbal Cognitive Reflection Test.' Journal of Behavioral Decision Making, 34 (3). pp. 322-343. ISSN 0894-3257

bdm.2213.pdf - Published Version
Available under License Creative Commons Attribution.

Download (2MB) | Preview


The Cognitive Reflection Test (CRT) became popular for its impressive power to predict how well people reason and make decisions. Despite the popularity of the CRT, a major issue complicates its interpretation: the numerical nature of the CRT confounds reflection ability with mathematical ability. We have addressed this issue by developing the Verbal CRT (CRT-V), a novel 10-item measure of cognitive reflection (, using non-mathematical problems with good statistical and psychometric properties and with low familiarity. First, we selected suitable items with relatively low familiarity and optimal difficulty as identified in two different populations (Studies 1 and 2) and with high content validity as judged by an expert panel (Study 3). Second, we demonstrated good criterion and construct validity for the test in different populations with a wide range of variables (Studies 4-6, 8) and a good internal consistency and test-retest reliability (Study 7). The Verbal CRT was less associated with math anxiety, objective and subjective numeracy than the original CRT and it was test equivalent across gender, age groups and administration setting. In contrast with the original CRT (Hedge’s g = 0.29, 95% CI[0.17, 0.40]), the Verbal CRT showed no gender differences (Hedge’s g = -0.06, 95% CI[-0.18, 0.06]). The Verbal CRT can complement existing, numerical, tests of cognitive reflection.

Item Type: Article
Uncontrolled Keywords: cognitive reflection, cognitive reflection test, reasoning, verbal cognitive reflection test
Divisions: Faculty of Science and Health
Faculty of Science and Health > Psychology, Department of
SWORD Depositor: Elements
Depositing User: Elements
Date Deposited: 03 Nov 2020 13:22
Last Modified: 18 Aug 2022 12:16

Actions (login required)

View Item View Item