Psychometric Properties and Measurement Invariance of the Turkish Version of the Multidimensional Cognitive Attentional Syndrome Scale

A significant advancement in the understanding and treatment of psychological disorders has been the development of Metacognitive Therapy (MCT). At its core, MCT targets dysfunctional metacognitive beliefs and self-regulatory processes, acknowledging their crucial role in the persistence of emotional challenges. A key component of this therapeutic model is the Cognitive Attentional Syndrome (CAS), which encompasses repetitive thinking patterns like worry and rumination, threat monitoring, and maladaptive behavioral strategies. These elements, rather than being mere symptoms, are viewed as metacognitive strategies that actively maintain problematic thought processes and emotional distress. The Multidimensional Cognitive Attentional Syndrome Scale (MCASS) was developed to comprehensively measure these multifaceted CAS components. This article details a study that rigorously tested the validity and reliability of the Turkish translation of the MCASS, assessing its applicability in both clinical and healthy populations.

Background: Understanding the Cognitive Attentional Syndrome

Metacognitive therapy, pioneered by researchers like Adrian Wells, posits that individuals with emotional disorders often engage in maladaptive metacognitive processes. These processes include holding beliefs about the nature of thinking itself – for instance, believing that worry is uncontrollable or beneficial – and employing attentional and behavioral strategies that inadvertently sustain distress. The Cognitive Attentional Syndrome (CAS) is a central construct within MCT, described by Wells as a set of interconnected processes that maintain psychological distress. These include:

• Repetitive Thinking: Characterized by persistent worry and rumination, where individuals engage in endless cycles of negative thought.
• Threat Monitoring: A heightened and sustained focus on potential dangers or threats in the environment or within oneself.
• Maladaptive Behavioral Strategies: Actions taken to cope with distress that, in the long run, prove counterproductive, such as avoidance, reassurance-seeking, or thought suppression.

The interplay between metacognitive beliefs (MCB) and the CAS is considered fundamental to the maintenance of various psychological disorders, from anxiety and depression to obsessive-compulsive disorder. Conventional cognitive therapies often focus on the content of thoughts, whereas MCT shifts the focus to the control and nature of thinking processes themselves. This paradigm shift necessitates robust measurement tools to accurately assess the components of the CAS and metacognitive beliefs.

The Need for a Comprehensive Measure: The MCASS

Previous attempts to measure CAS components, such as the CAS-1 scale, have been criticized for their lack of comprehensiveness. The CAS-1, while influential, has been described as a single-factor tool and has been noted to include vague phrasing in its items, potentially conflating metacognitive beliefs with attentional and behavioral strategies. Recognizing these limitations, Conboy et al. developed the Multidimensional Cognitive Attentional Syndrome Scale (MCASS). This scale offers a more detailed assessment by measuring seven distinct CAS components: worry, rumination, internal threat monitoring, external threat monitoring, thought suppression, physical avoidance behavior, and substance use. The development of the MCASS aimed to provide a more nuanced understanding of how these different facets of the CAS contribute to psychological distress.

The Turkish Adaptation Study: Methodology and Findings

The study undertaken aimed to validate the Turkish version of the MCASS, ensuring its psychometric soundness and suitability for use within the Turkish cultural context. The research team meticulously followed a rigorous process to translate and adapt the scale, employing standard psychometric evaluation techniques.

Participants and Design

A total of 229 participants were enrolled in the study, comprising 115 patients diagnosed with various mental health conditions and 114 age- and sex-matched healthy controls. The patient group included individuals with primary diagnoses of panic disorder, generalized anxiety disorder, major depressive disorder, social anxiety disorder, and obsessive-compulsive disorder, all assessed by experienced clinicians according to DSM-5 criteria. The control group consisted of individuals reporting no current psychiatric disorders. Exclusion criteria were implemented to ensure the sample’s suitability, excluding individuals with substance use disorder, intellectual disability, less than 11 years of formal education, psychotic disorders, or bipolar disorder.

Measurement Tools

In addition to the Turkish MCASS, several other established psychological instruments were utilized to assess convergent validity. These included:

• Sociodemographic Data Form: A researcher-developed form to gather essential demographic and clinical information.
• Multidimensional Experiential Avoidance Questionnaire (MEAQ-30): A measure assessing experiential avoidance, a concept closely related to maladaptive coping strategies.
• Depression Anxiety Stress Scales (DASS-21): A widely used instrument to measure symptoms of depression, anxiety, and stress.
• Ruminative Response Scale (RRS-10): A scale designed to assess ruminative thinking styles.
• Metacognitive Questionnaire (MCQ-30): A measure of metacognitive beliefs, complementing the MCASS’s focus on the CAS.
• Cognitive Attentional Syndrome Scale (CAS-1): An earlier measure of CAS components, used for comparative purposes.

Translation and Cultural Adaptation

The translation process involved multiple steps to ensure accuracy and cultural appropriateness. Three independent forward translations were conducted by fluent bilingual therapists specializing in MCT. These translations were then synthesized by a domain expert into a single Turkish version. This version was subsequently back-translated into English by an independent expert, blinded to the original instrument, to verify semantic and conceptual equivalence. Finally, a panel of three MCT experts reviewed both the original and translated versions for clarity and theoretical consistency, leading to the finalized Turkish MCASS. A pilot evaluation further confirmed item clarity and comprehensibility.

Data Analysis: Rigorous Psychometric Evaluation

The study employed a comprehensive suite of statistical analyses to evaluate the psychometric properties of the Turkish MCASS. These included:

• Confirmatory Factor Analysis (CFA): Used to test the hypothesized seven-factor structure of the MCASS in both the patient and control groups. This analysis helps determine if the items load onto the intended underlying factors.
• Internal Consistency Analysis: Assessed using Cronbach’s alpha and McDonald’s omega coefficients to measure the reliability of each subscale and the overall scale. High internal consistency indicates that the items within a scale measure the same underlying construct.
• Convergent Validity Analysis: Examined by calculating correlations between the MCASS subscales and scores on theoretically related measures (e.g., DASS-21, RRS-10, MCQ-30, CAS-1). Moderate to strong positive correlations would support convergent validity.
• Test-Retest Reliability Analysis: Conducted on a subsample of healthy controls over a 2-week interval to assess the temporal stability of the scale.
• Measurement Invariance Analysis: A crucial step to determine if the MCASS functions similarly across different groups (clinical vs. control). This involved testing configural, metric, and scalar invariance.

Key Findings: Validity and Reliability

The study’s results provided strong evidence for the validity and reliability of the Turkish MCASS, with some important modifications.

Factor Structure and Item Performance

Confirmatory factor analyses supported the seven-factor structure of the MCASS in both patient and control groups. However, item 7, originally translated as "Her zaman uyanık ve dikkatli olurum" (I am always alert and attentive), showed a weak and non-significant factor loading in both groups. This was attributed to potential semantic ambiguity in the Turkish translation, where the intended focus on external stimuli might have been lost, leading to a more general interpretation of alertness. Consequently, item 7 was removed, resulting in a validated 20-item Turkish MCASS. The remaining 20 items demonstrated acceptable to excellent factor loadings and error variances, indicating their suitability for measuring the intended latent constructs.

Reliability Estimates

The internal consistency of the Turkish MCASS was found to be acceptable to excellent across both groups. Cronbach’s alpha values ranged from 0.694 to 0.952 in the patient group and 0.695 to 0.954 in the control group. McDonald’s omega coefficients yielded similar strong results. These findings suggest that the Turkish MCASS reliably measures the intended constructs within each subscale.

Measurement Invariance: Cross-Group Equivalence

A significant aspect of the study was the assessment of measurement invariance across clinical and control groups. The analyses revealed that the Turkish MCASS achieved configural, metric, and scalar invariance. Configural invariance indicates that the factor structure is the same across groups. Metric invariance suggests that the factor loadings are equivalent, meaning the items function similarly in measuring the underlying constructs. Scalar invariance, the highest level achieved, implies that the item intercepts are also equivalent, allowing for meaningful comparisons of latent mean scores between groups. While strict invariance (equality of error variances) was not fully supported, the established levels of invariance indicate that the Turkish MCASS is a robust tool for comparing CAS components between clinical and healthy populations.

Convergent Validity: Connections to Other Constructs

Correlations between the MCASS subscales and other theoretically related measures largely supported convergent validity. For instance, rumination and worry subscales of the MCASS showed expected correlations with measures of depression, anxiety, and stress (DASS-21), as well as with the Ruminative Response Scale (RRS-10) and Metacognitions Questionnaire (MCQ-30). These findings align with the established understanding of the transdiagnostic nature of CAS components, demonstrating their association with emotional distress and metacognitive processes across different psychological conditions.

Test-Retest Reliability: Temporal Stability

Test-retest reliability, assessed over a 2-week interval in a subsample of controls, indicated moderate to good temporal stability for both the total score and individual subscales, with Intraclass Correlation Coefficients (ICCs) ranging from 0.620 to 0.741. While these results are encouraging, the authors noted that they should be interpreted with caution due to the small sample size used for this specific analysis.

Discussion and Implications

The successful adaptation and validation of the Turkish MCASS represent a significant contribution to the field of clinical psychology in Turkey. The scale’s ability to measure the seven components of the CAS with good reliability and validity in both clinical and non-clinical populations makes it a valuable tool for research and clinical practice.

The exclusion of item 7, while improving the psychometric properties, highlights the importance of cultural adaptation in cross-lingual translation of psychological instruments. The semantic nuances of language can profoundly impact how individuals interpret and respond to questionnaire items. This modification means the Turkish MCASS is a 20-item scale, which, while effective, may have slightly different content coverage than the original 21-item version, particularly concerning external fixation. Future research could explore ways to refine or replace this item to fully capture the original scale’s intent within the Turkish context.

The finding of measurement invariance across clinical and control groups is particularly important. It suggests that the Turkish MCASS can be reliably used to compare the levels of CAS components between individuals with mental health issues and healthy individuals. This is crucial for understanding the role of the CAS in the development and maintenance of psychological disorders and for evaluating the effectiveness of interventions.

The Transdiagnostic Nature of CAS and the Need for Specificity

The study’s findings reinforce the transdiagnostic nature of the Cognitive Attentional Syndrome, indicating that its components are present across a range of mental health conditions. This aligns with the broader MCT framework, which posits that metacognitive processes play a role in numerous psychological disorders. However, the authors also pointed out a crucial limitation: current scales like the CAS-1 and MCASS, while valuable, do not appear to measure diagnosis-specific CAS components. For instance, specific safety-seeking behaviors in social anxiety disorder or compulsions in OCD are prominent CAS elements not adequately captured by general measures. The study advocates for the development of diagnosis-specific metacognitive assessment tools to enhance personalized treatment planning and monitoring, drawing parallels to existing diagnosis-specific instruments in the field of OCD research. While the MCASS serves as a powerful transdiagnostic tool, its utility could be further enhanced by complementary, disorder-specific measures.

Future Directions and Clinical Relevance

The validated Turkish MCASS offers a robust instrument for researchers and clinicians to explore the prevalence and impact of CAS components in Turkish-speaking populations. Its use can facilitate a deeper understanding of the mechanisms underlying various psychological disorders and inform the development and application of Metacognitive Therapy. The study’s conclusion underscores the ongoing need for tailored assessment tools, especially in specialized clinical areas, to provide a more granular and effective approach to mental health assessment and intervention. The implications of this research extend to improving diagnostic accuracy, tailoring therapeutic interventions, and advancing the theoretical understanding of metacognition in mental health.