Can a shorter eyes test better measure theory of mind?

What clinical population is the Reading the Mind in the Eyes Test primarily used to assess?

It is primarily used as a measure of individual differences in Theory of Mind (ToM) in individuals on the autism spectrum.

Source: A psychometric analysis of the reading the mind in the eyes test: toward a brief form for research and applied settings · DOI · quote verified

What did the exploratory factor analysis (EFA) show to be the statistically best-fitting factor structure for the full Eyes Test?

According to all fit indices, a five-factor solution was the best statistical fit to the data.

Source: A psychometric analysis of the reading the mind in the eyes test: toward a brief form for research and applied settings · DOI · quote verified

Why did the authors reject the exploratory 5-factor structure for the full Eyes Test despite its statistical fit?

Only 27 of 36 items loaded moderately, the factors were weakly correlated, and a five-factor structure had never been theoretically postulated.

Source: A psychometric analysis of the reading the mind in the eyes test: toward a brief form for research and applied settings · DOI · quote verified

What psychometric prerequisite prevented the authors from using item parceling in their CFA of the full scale?

Item parceling requires knowing the underlying factor structure supporting each individual item, which was not established.

Source: A psychometric analysis of the reading the mind in the eyes test: toward a brief form for research and applied settings · DOI · quote verified

How did the single-factor CFA of the full 36-item Eyes Test perform overall?

The model fit was poor across most relative fit indices, indicating that a single-factor solution does not sufficiently represent the full 36 items.

Source: A psychometric analysis of the reading the mind in the eyes test: toward a brief form for research and applied settings · DOI · quote verified

Why can the absolute fit index RMSEA result in artificially low misfit estimates in models like the full Eyes Test?

RMSEA can result in artificially lower (better-looking) estimates when there are weak factor loadings present in the model.

Source: A psychometric analysis of the reading the mind in the eyes test: toward a brief form for research and applied settings · DOI · quote verified

What percentage of the full 36-item scale displayed weak factor loadings, and what was their average loading?

Twenty items (56% of the scale) had weak loadings, with an average loading of 0.278.

Source: A psychometric analysis of the reading the mind in the eyes test: toward a brief form for research and applied settings · DOI · quote verified

What was the average residual variance for the items on the full 36-item Eyes Test?

The average residual variance was 0.910, meaning the single factor explained very little variance for any item.

Source: A psychometric analysis of the reading the mind in the eyes test: toward a brief form for research and applied settings · DOI · quote verified

Why is the seemingly acceptable ordinal omega reliability (0.75) of the full 36-item Eyes Test likely misleading?

The estimate is likely inflated because of the test's length, despite many items being unrelated or negatively correlated.

Source: A psychometric analysis of the reading the mind in the eyes test: toward a brief form for research and applied settings · DOI · quote verified

Why could convergent validity estimates not be meaningfully interpreted for the full Eyes Test in Study 1?

Because the single-factor measurement model of the full test fit the data so poorly in the CFA.

Source: A psychometric analysis of the reading the mind in the eyes test: toward a brief form for research and applied settings · DOI · quote verified

What internal consistency (alpha) did Konrath et al. report for their 17-item short-form of the Eyes Test?

They reported an exceptionally poor internal consistency of alpha = 0.23.

Source: A psychometric analysis of the reading the mind in the eyes test: toward a brief form for research and applied settings · DOI · quote verified

Why is having duplicated target words problematic for the CFA of the Konrath reduced scale?

The items sharing the same target word correlate weakly, proving that they are not interchangeable.

Source: A psychometric analysis of the reading the mind in the eyes test: toward a brief form for research and applied settings · DOI · quote verified

What occurred when trying to model the Konrath Affect Model subscales in a single CFA?

The model yielded an improper solution because the predicted covariance matrix was not positive definite.

Source: A psychometric analysis of the reading the mind in the eyes test: toward a brief form for research and applied settings · DOI · quote verified

What three affect-based subscales were identified by Harkness et al.?

They identified Positive Affect, Negative Affect, and Neutral Affect subscales.

Source: A psychometric analysis of the reading the mind in the eyes test: toward a brief form for research and applied settings · DOI · quote verified

What did the strong correlation between Negative and Neutral subscales in the Harkness model suggest?

The strong correlation (r = 0.876) suggested that the Negative Affect and Neutral Affect subscales essentially measure the same construct.

Source: A psychometric analysis of the reading the mind in the eyes test: toward a brief form for research and applied settings · DOI · quote verified

How does the Maximizing Main Loadings (MML) iterative approach select items?

It repeatedly removes the item with the weakest factor loading in a CFA and re-estimates the model until adequate fit is achieved.

Source: A psychometric analysis of the reading the mind in the eyes test: toward a brief form for research and applied settings · DOI · quote verified

How many items were retained by the MML approach, and what was its critical limitation?

It retained only 7 items, and its critical limitation was a poor omega estimate indicating poor internal consistency and factor saturation.

Source: A psychometric analysis of the reading the mind in the eyes test: toward a brief form for research and applied settings · DOI · quote verified

What is Ant Colony Optimization (ACO) in scale development?

ACO is a heuristic search algorithm that converges to an optimal or near-optimal subset of items based on user-defined statistical criteria.

Source: A psychometric analysis of the reading the mind in the eyes test: toward a brief form for research and applied settings · DOI · quote verified

What specific psychometric criteria did the authors program the ACO algorithm to optimize?

ACO was tasked to find the shortest scale maintaining an omega reliability of at least 0.70 and CFA fit criteria of CFI = 0.95 and RMSEA = 0.02.

Source: A psychometric analysis of the reading the mind in the eyes test: toward a brief form for research and applied settings · DOI · quote verified

How many items were selected in the optimal ACO model developed by the authors?

A 10-item solution was identified as the shortest scale meeting all criteria.

Source: A psychometric analysis of the reading the mind in the eyes test: toward a brief form for research and applied settings · DOI · quote verified

What was the average inter-item correlation of the 10-item ACO model in Study 1?

The average inter-item correlation was 0.18, which is psychometrically acceptable.

Source: A psychometric analysis of the reading the mind in the eyes test: toward a brief form for research and applied settings · DOI · quote verified

What was the final sample size analyzed in Study 2?

The final validated sample consisted of 210 participants.

Source: A psychometric analysis of the reading the mind in the eyes test: toward a brief form for research and applied settings · DOI · quote verified

What was the internal consistency (omega) of the ACO Model in Study 2?

The internal consistency was omega = 0.73, indicating acceptable reliability and factor saturation.

Source: A psychometric analysis of the reading the mind in the eyes test: toward a brief form for research and applied settings · DOI · quote verified

What statistical technique was used to assess measurement invariance of the ACO model across the two samples?

The authors used multiple-group analysis with a two-step approach tailored for categorical data.

Source: A psychometric analysis of the reading the mind in the eyes test: toward a brief form for research and applied settings · DOI · quote verified

What did the measurement invariance testing reveal about the ACO Model?

It proved that the ACO Model has equivalent structure (factorial invariance) across both samples.

Source: A psychometric analysis of the reading the mind in the eyes test: toward a brief form for research and applied settings · DOI · quote verified

Why did the authors use 'Phantom Variables' in their multiple-group analysis?

They used them to control for differences in latent variances between Sample 1 and Sample 2 when comparing correlations.

Source: A psychometric analysis of the reading the mind in the eyes test: toward a brief form for research and applied settings · DOI · quote verified

What is the authors' primary recommendation regarding the use of the 10-item ACO Model?

They recommend using the 10-item ACO Model short-form instead of the full 36-item Eyes Test when evaluating healthy, unimpaired adults.

Source: A psychometric analysis of the reading the mind in the eyes test: toward a brief form for research and applied settings · DOI · quote verified

How does the gender distribution in the ACO Model compare to the original version?

It retains an almost equal distribution of male and female identities, similar to the original scale.

Source: A psychometric analysis of the reading the mind in the eyes test: toward a brief form for research and applied settings · DOI · quote verified

Why do the authors argue that the ACO Model is not biased toward negative emotional states?

Because structural testing revealed that the affect of the target words does not predict test performance in any meaningful way.

Source: A psychometric analysis of the reading the mind in the eyes test: toward a brief form for research and applied settings · DOI · quote verified

Why were Theory of Mind (via the Eyes Test) and Cognitive Empathy not more strongly correlated?

The moderate correlation can be attributed to differences in their measurement methodologies.

Source: A psychometric analysis of the reading the mind in the eyes test: toward a brief form for research and applied settings · DOI · quote verified

What construct was most strongly related to the ACO Model at the latent level in both studies?

Vocabulary was the most strongly related construct in both Study 1 and Study 2.

Source: A psychometric analysis of the reading the mind in the eyes test: toward a brief form for research and applied settings · DOI · quote verified

How does word frequency impact selection performance on the Eyes Test?

Target words that occur more frequently in the English language are significantly more likely to be selected correctly by participants.

Source: A psychometric analysis of the reading the mind in the eyes test: toward a brief form for research and applied settings · DOI · quote verified

What clinical diagnostic concern is raised by the test's strong reliance on Vocabulary and Emotion Perception?

It raises the possibility that the Eyes Test discriminates clinical groups based on vocabulary or emotion-perception deficits rather than purely on Theory of Mind.

Source: A psychometric analysis of the reading the mind in the eyes test: toward a brief form for research and applied settings · DOI · quote verified