Flashcard library · Psychology · PaperFren
Does the Cognitive Reflection Test measure math or intuition?
The Cognitive Reflection Test predicts better decisions because it measures math skills, not because it measures the ability to override intuitive errors.
Keep what you just learned
Save these 35 cards to your NoteFren library. Your first review starts right away, and each card links back to the study it came from.
What is the Cognitive Reflection Test (CRT) historically thought to measure?
The CRT is historically thought to measure the monitoring of System 1 intuitions, determining whether a person can detect and correct intuitive errors.
Source: Cognitive reflection vs. calculation in decision making · DOI · quote verified
What two competing abilities do the authors investigate to explain why the CRT predicts superior decision-making?
The authors investigate whether the CRT predicts superior decision-making because it measures the ability to check intuitions (cognitive reflection) or the ability to solve numeric calculations (calculation/numeracy).
Source: Cognitive reflection vs. calculation in decision making · DOI · quote verified
How is Cognitive Reflection defined under the Cognitive Reflection Hypothesis?
It is defined as the tendency to check and detect intuitive errors.
Source: Cognitive reflection vs. calculation in decision making · DOI · quote verified
What anecdotal evidence suggests that correct CRT solvers still experience the intuitive but incorrect response?
Correct solvers sometimes write down the intuitive answer in the margins of the test or report thinking about the intuitive option during verbal protocols.
Source: Cognitive reflection vs. calculation in decision making · DOI · quote verified
How did incorrect responders in the bat and ball problem rate its difficulty compared to correct responders?
Incorrect responders judged the problem to be easier and believed a higher proportion of other people would answer it correctly.
Source: Cognitive reflection vs. calculation in decision making · DOI · quote verified
What did Diemand-Yauman et al. find regarding the effect of disfluent fonts on cognitive tasks?
They showed that disfluent fonts improved performance across a wide range of tasks, implying the improvement is due to a general increase in deliberation rather than specific intuition checking.
Source: Cognitive reflection vs. calculation in decision making · DOI · quote verified
How does the temporal activation of System 1 and System 2 differ in the dual-systems model described by Frederick?
System 1 processes are quick and effortless, generating intuitive answers first, while System 2 processes are slow, controlled, and only activate after System 1 has finished.
Source: Cognitive reflection vs. calculation in decision making · DOI · quote verified
What does 'temporal rigidness' mean in Frederick's dual-systems explanation?
It refers to the idea that System 2 is only activated after System 1 processing is completely finished, rather than the two systems interacting dynamically.
Source: Cognitive reflection vs. calculation in decision making · DOI · quote verified
What is the core assertion of the Numeracy Hypothesis?
It asserts that the CRT is primarily a measure of numeric ability, and that numeric ability is what actually drives the CRT's capacity to predict better decisions.
Source: Cognitive reflection vs. calculation in decision making · DOI · quote verified
What do factor analyses typically show about the relationship between CRT and numeracy items?
Most factor analyses show that CRT and other numeracy items load on the exact same factor, suggesting they measure the same underlying mathematical construct.
Source: Cognitive reflection vs. calculation in decision making · DOI · quote verified
In the two-step CRT model, what occurs when a person has high cognitive reflection but low numeric ability?
The person successfully detects that the intuitive response is incorrect, but they subsequently fail the calculations, resulting in a non-intuitive error.
Source: Cognitive reflection vs. calculation in decision making · DOI · quote verified
How are CRT responses categorized to split cognitive reflection from calculation in cognitive models?
Responses are coded into three categories: intuitive errors, non-intuitive errors, and non-intuitive correct responses.
Source: Cognitive reflection vs. calculation in decision making · DOI · quote verified
How is Cognitive Reflection mathematically defined in the two-step CRT model?
It is defined as the likelihood that a participant gives any non-intuitive answer, whether correct or incorrect.
Source: Cognitive reflection vs. calculation in decision making · DOI · quote verified
How is numeric ability (Calculation) mathematically defined in the two-step CRT model?
It is the conditional likelihood of giving the correct answer, given that the participant did not give the intuitive response.
Source: Cognitive reflection vs. calculation in decision making · DOI · quote verified
What was the main objective of Study 1?
To test whether CRT performance predicts decision biases due to Cognitive Reflection or due to Calculation (numeric ability).
Source: Cognitive reflection vs. calculation in decision making · DOI · quote verified
What subscale of the Adult Decision Making Competence (ADMC) scale was evaluated in Study 1?
The consistency in risk perception subscale was used as the primary outcome measure.
Source: Cognitive reflection vs. calculation in decision making · DOI · quote verified
How is the framing inconsistency score calculated in Study 1?
It is the number of complementary pairs of items where the sum of the participant's estimated likelihoods deviates from 100% by 10 points or more.
Source: Cognitive reflection vs. calculation in decision making · DOI · quote verified
Describe the subset/superset conjunction fallacy tested in Study 1.
It occurs when a participant rates a narrower, specific subset event as more likely than the broader, overarching superset event.
Source: Cognitive reflection vs. calculation in decision making · DOI · quote verified
What is the time-based conjunction fallacy evaluated in Study 1?
It occurs when an event happening in the shorter time frame of next year is judged as more likely than the same event happening in the longer 5-year frame.
Source: Cognitive reflection vs. calculation in decision making · DOI · quote verified
Which model fit the Study 1 CRT data significantly better: Model 1 (single-factor) or Model 2 (two-factor)?
Model 2, which separated individual differences into separate Cognitive Reflection and Calculation factors, fit the data significantly better.
Source: Cognitive reflection vs. calculation in decision making · DOI · quote verified
Did Calculation or Cognitive Reflection show more individual variation in Study 1?
Calculation showed greater variation, indicating that the CRT captures individual differences in Calculation to a larger extent than Cognitive Reflection.
Source: Cognitive reflection vs. calculation in decision making · DOI · quote verified
What was the estimated correlation between Cognitive Reflection and Calculation in Study 1's latent model?
They were substantially correlated at 0.40.
Source: Cognitive reflection vs. calculation in decision making · DOI · quote verified
Why is Cognitive Reflection positively correlated with standard numeracy?
Setting up and checking a numeric formula is necessary to realize that an intuitive mathematical response is incorrect.
Source: Cognitive reflection vs. calculation in decision making · DOI · quote verified
Did Cognitive Reflection independently predict framing inconsistency in Study 1?
No, after accounting for demographic variables, higher Calculation but not Cognitive Reflection independently predicted less framing inconsistency.
Source: Cognitive reflection vs. calculation in decision making · DOI · quote verified
What was the primary finding regarding conjunction fallacies in Study 1?
Calculation (or numeracy), and not Cognitive Reflection, predicted a lower rate of conjunction fallacies.
Source: Cognitive reflection vs. calculation in decision making · DOI · quote verified
What new outcome and cognitive measures were introduced in Study 2?
Study 2 added under/overconfidence, incentivized intertemporal and risky choices, self-reported financial outcomes, and non-numeric intelligence tests.
Source: Cognitive reflection vs. calculation in decision making · DOI · quote verified
How was under/overconfidence operationalized in Study 2?
It was measured as the absolute difference between a participant's percentage of correct answers on general knowledge statements and their average confidence ratings.
Source: Cognitive reflection vs. calculation in decision making · DOI · quote verified
What real-world, incentivized intertemporal choice was offered in Study 2?
Participants chose between having their payment mailed immediately or receiving 110% of that payment mailed 10 days later.
Source: Cognitive reflection vs. calculation in decision making · DOI · quote verified
What classic paradigm was used to measure risky choices in Study 2?
The Holt-Laury Procedure, which presents 10 sequential choices between safe and risky gambles at varying probabilities.
Source: Cognitive reflection vs. calculation in decision making · DOI · quote verified
What does the 'consistency score' measure in the risky choice task of Study 2?
It measures the minimum number of choices that must be changed to ensure the participant's risk preferences are logically consistent across probabilities.
Source: Cognitive reflection vs. calculation in decision making · DOI · quote verified
What did the stepwise regression reveal about the predictors of the decision-bias composite in Study 2?
Both Calculation and numeracy predicted fewer biases, whereas Cognitive Reflection did not retain independent predictive power.
Source: Cognitive reflection vs. calculation in decision making · DOI · quote verified
Which cognitive predictor significantly predicted the financial-outcomes composite in Study 2?
Only numeracy significantly predicted better financial outcomes, while Cognitive Reflection and Calculation were non-significant.
Source: Cognitive reflection vs. calculation in decision making · DOI · quote verified
Why might Cognitive Reflection fail to predict incentivized choices compared to non-incentivized ones?
Incentives may naturally motivate everyone to reflect and check their intuition, leaving basic numeric skill as the main bottleneck for solving the task.
Source: Cognitive reflection vs. calculation in decision making · DOI · quote verified
What methodological problem is caused by the widespread public exposure of the original CRT items?
Prior exposure increases later performance, making the test a measure of prior memory rather than active cognitive reflection.
Source: Cognitive reflection vs. calculation in decision making · DOI · quote verified
What is the authors' main conclusion regarding the primary driver of CRT's predictive validity?
The CRT's ability to predict decision-making performance and financial outcomes is driven by numeric ability rather than cognitive reflection.
Source: Cognitive reflection vs. calculation in decision making · DOI · quote verified