Arabic Validation and Adaptation of the Screen for Cognitive Impairment in Psychiatry (SCIP-A) in University Students: A Pilot Study

Cognitive impairments represent a significant and persistent challenge in numerous psychiatric disorders, impacting patient outcomes and functional recovery. While the Screen for Cognitive Impairment in Psychiatry (SCIP) has emerged as a valuable, brief tool for assessing these deficits internationally, an Arabic version has been notably absent. Addressing this critical gap, a recent study has successfully translated, culturally adapted, and validated the Arabic version of the SCIP, now known as SCIP-A, in a sample of healthy university students. This pioneering work promises to enhance cognitive screening capabilities within Arabic-speaking contexts, paving the way for improved mental health diagnostics and care.

The SCIP, developed by Purdon in 2005, is a performance-based, paper-and-pencil instrument designed to be administered in under 20 minutes. It meticulously assesses five key cognitive domains commonly affected in psychiatric conditions: immediate verbal learning, working memory, verbal fluency, delayed recall, and processing speed. The tool’s utility is further amplified by its provision of three alternate forms, specifically engineered to mitigate practice effects during repeated assessments, a crucial feature for longitudinal studies and clinical monitoring. Prior research has underscored the SCIP’s superiority over tools like the Mini-Mental State Examination (MMSE) and the Montreal Cognitive Assessment (MoCA) in accurately identifying cognitive impairments in psychiatric populations, particularly in psychosis. Its validation across various languages and countries, including Spain, Italy, Denmark, and Colombia, attests to its robust psychometric properties and cross-cultural applicability.

The impetus for developing an Arabic version of the SCIP stems from the substantial prevalence of severe mental disorders in Arabic-speaking countries, coupled with limited access to specialized neuropsychological services. While other validated cognitive instruments exist for Arabic-speaking populations, such as the Arabic version of the Brief Assessment of Cognition in Schizophrenia (BACS), the SCIP’s ultra-brief nature (10-15 minutes) and its three alternate forms offer distinct advantages for scalable cognitive screening and serial assessments.

Methodology: A Rigorous Translation and Validation Process

The translation and cross-cultural adaptation of the SCIP-A followed a meticulous, multi-stage process guided by established international standards. This involved:

• Forward and Backward Translation: Two independent professional translators, one informed about the test’s concepts and another uninformed, translated the original English SCIP into Arabic. Subsequently, two native English speakers, unaware of the original test, back-translated the synthesized Arabic version into English.
• Expert Committee Review: An expert committee, comprising the study authors, bilingual clinical psychologists, and a linguist, meticulously reviewed all translations. They identified and resolved any semantic, idiomatic, or conceptual discrepancies to ensure linguistic accuracy and cultural appropriateness.
• Pre-testing and Cognitive Interviews: The pre-final Arabic version underwent pilot testing with a sample of 10 university students. "Think-aloud" cognitive interviews were conducted to gauge comprehension and ensure that the interpretation of instructions and items aligned with the original intent.

Crucial linguistic and cultural adaptations were made based on this process. For instance, English letters without direct Arabic phonetic equivalents, such as ‘C’, ‘P’, and ‘X’, were replaced with unambiguous Arabic consonants like ‘Th’ (ث), ‘Ayn’ (ع), and ‘S’ (س) respectively, particularly in the Verbal Fluency Test (VFT) and Working Memory Test (WMT). In the Verbal Learning Test (VLT), specific words were substituted for cultural or frequency equivalence, such as replacing "Doll" with "Statue" (تمثال) in Form 2. Furthermore, instructions for the Processing Speed Test (PST) were adapted from "left-to-right" to "right-to-left" to align with Arabic reading conventions.

Participant Demographics and Study Design

A total of 120 healthy university students, comprising an equal number of males and females (60 each), voluntarily participated in the study. Participants were native Arabic speakers, aged between 20 and 25 years, and were recruited through university email announcements. To ensure adequate verbal cognitive functioning, all participants completed the Vocabulary subtest of the Wechsler Adult Intelligence Scale—Revised (WAIS-R) as a screening measure. Exclusion criteria included any self-reported history of neurological, psychiatric, or cognitive disorders. The study received ethical approval from the Institutional Review Board of Assiut University.

The study employed a rigorous design to assess the psychometric properties of the SCIP-A. Participants completed two testing sessions, separated by a 48-hour interval. During the initial session, participants were administered one of the three alternate forms of the SCIP-A. The second session involved administering a different alternate form to evaluate test-retest reliability and parallel form equivalence. To ensure counterbalancing and minimize order effects, participants were divided into six subgroups, each assigned a specific sequence of form administrations.

Key Findings: Robust Psychometric Properties

The SCIP-A demonstrated strong psychometric performance in the tested sample:

• Internal Consistency: The SCIP-A exhibited acceptable internal consistency for its total score (Cronbach’s α = 0.78). The two identified factors also showed acceptable consistency: 0.74 for the "working memory and verbal fluency" factor and 0.63 for the "learning and processing speed" factor. The lower alpha for the second factor is attributed to its composition of only two subtests.
• Test-Retest Reliability: The SCIP-A showed excellent test-retest reliability, with an Intraclass Correlation Coefficient (ICC) of 0.92 for the total score. Individual subtest ICCs ranged from 0.77 (VFT) to 0.89 (VLT-I), indicating good to excellent stability over the 48-hour interval.
• Parallel Form Equivalence: Analysis of alternate forms revealed strong reliability, particularly for the total SCIP score across subgroups (ICCs ranging from 0.89 to 0.96). While some subtests showed minor variability, overall, the alternate forms were found to be largely equivalent, supporting their interchangeable use.
• Construct Validity: Confirmatory Factor Analysis (CFA) supported the proposed two-factor model, which differentiated between "working memory and verbal fluency" and "learning and processing speed." The model fit indices, including a non-significant chi-square test (χ² = 10.722, p = 0.071), a CFI of 0.975, and an SRMR of 0.038, indicated an acceptable fit to the data. This suggests that the SCIP-A effectively captures distinct cognitive constructs in healthy individuals.
• Practice Effects and Gender Differences: While the use of alternate forms helped mitigate practice effects, performance generally improved from Time 1 to Time 2, particularly for the total score, WMT, and PST. This suggests that repeated exposure, even to different forms, can lead to small learning gains, a factor to consider in longitudinal assessments. Minor gender differences were observed, with males performing better on the WMT and females on the VLT-I at baseline. However, no significant gender effects were noted for the total score or in the interaction with time, indicating that cognitive changes over time were consistent across genders.

Implications for Arabic-Speaking Mental Healthcare

The successful validation of the SCIP-A carries significant implications for mental healthcare delivery in Arabic-speaking regions. The tool’s brevity, ease of administration, and minimal resource requirements make it an ideal candidate for integration into routine clinical practice. This is particularly crucial in busy psychiatric settings where comprehensive neuropsychological assessments are often not feasible due to time and cost constraints.

The SCIP-A can serve as a valuable initial screening tool to identify individuals who may be experiencing cognitive impairments, thereby guiding referral for more in-depth evaluations. This early detection is critical for developing personalized treatment plans and improving patient outcomes, especially in conditions where cognitive deficits are closely linked to functional impairment and recovery. For researchers, the availability of a validated Arabic version opens new avenues for cross-cultural studies and facilitates the inclusion of Arabic-speaking populations in international research initiatives investigating cognitive remediation strategies.

The study’s findings regarding practice effects also offer practical guidance. Clinicians using the SCIP-A for longitudinal monitoring should be aware that small improvements over short retest intervals may reflect learning rather than genuine cognitive change. This underscores the importance of using longer intervals between assessments or incorporating control groups in research to accurately attribute changes to interventions.

Future Directions and Limitations

While this study provides a strong foundation for the SCIP-A, several limitations warrant consideration. The validation was conducted solely in a sample of healthy, educated university students, which restricts the generalizability of the findings to clinical populations and individuals with lower educational attainment or different age groups. Future research must focus on validating the SCIP-A in diverse clinical samples (e.g., individuals with schizophrenia, bipolar disorder, depression) to establish clinical cut-off scores for identifying cognitive impairment and to assess its performance across a wider spectrum of cognitive functioning.

The relatively short retest interval of 48 hours, while useful for estimating temporal stability, may have amplified practice effects. Future studies should explore longer retest intervals to better reflect real-world clinical practice and to more accurately assess the long-term reliability of the SCIP-A.

Furthermore, the Arabic language exhibits significant dialectal variations across regions. While the study aimed for a standard form of Arabic, the influence of regional dialects on test performance was not systematically investigated. Future research should explore the SCIP-A’s applicability across different Arabic dialects and in populations with varying literacy levels to ensure its broad utility.

Conclusion

The Arabic validation of the Screen for Cognitive Impairment in Psychiatry (SCIP-A) represents a significant advancement in the field of neuropsychological assessment for Arabic-speaking populations. The study demonstrates that the SCIP-A possesses sound psychometric properties, including acceptable internal consistency, excellent test-retest reliability, and evidence of construct validity and parallel form equivalence. Its brevity, ease of administration, and availability of alternate forms make it a practical and valuable tool for cognitive screening in both research and clinical settings. By addressing a critical gap in the availability of culturally adapted cognitive assessment instruments, the SCIP-A holds immense promise for enhancing the identification, understanding, and management of cognitive impairments in individuals with psychiatric disorders across the Arab world. Further validation in clinical populations and diverse demographic groups will be essential to fully realize its potential.