Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Reliability and Validity of the Beijing Version of the Montreal Cognitive Assessment in the Evaluation of Cognitive Function of Adult Patients with OSAHS

  • Xiong Chen ,

    Contributed equally to this work with: Xiong Chen, Rui Zhang, Ying Xiao

    Affiliation Department of Otolaryngology, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China

  • Rui Zhang ,

    Contributed equally to this work with: Xiong Chen, Rui Zhang, Ying Xiao

    Affiliation Department of Otolaryngology, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China

  • Ying Xiao ,

    Contributed equally to this work with: Xiong Chen, Rui Zhang, Ying Xiao

    Affiliation Department of Otolaryngology, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China

  • Jiaqi Dong,

    Affiliation Department of Otolaryngology, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China

  • Xun Niu,

    Affiliation Department of Otolaryngology, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China

  • Weijia Kong

    entwjkong@hust.edu.cn

    Affiliation Department of Otolaryngology, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China

Abstract

Background

The patients with obstructive sleep apnea hypopnea syndrome (OSAHS) tend to develop cognitive deficits, which usually go unrecognized, and can affect their daily life. The Beijing version of the Montreal cognitive assessment (MoCA-BJ), a Chinese version of MoCA, has been used for the assessment of cognitive functions of OSAHS patients in clinical practice. So far, its reliability and validity have not been tested. This study examined the reliability and validity of MoCA-BJ in a cohort of adult OSAHS patients.

Methods

152 OSAHS patients, ranging from mild, moderate to severe, 49 primary snoring subjects and 40 normal controls were evaluated for cognitive functions by employing both MoCA-BJ and the Mini Mental State Examination (MMSE). Forty of them were re-tested by MoCA-BJ 14 days after the first test. Internal consistency, test-retest reliability, discriminate and concurrent validity of MoCA-BJ were analyzed.

Results

Internal consistency reliability by Cronbach’s alpha was adequate (0.73). Intra-class correlation coefficient (ICC), an measure of test-retest reliability, was 0.87 (P<0.001). The total MoCA-BJ scores were significant higher in normal controls than in OSAHS groups (p<0.05). The performances of visuospatial ability in severe OSAHS group were significantly weaker than in normal controls and primary snoring group. The performances of executive ability in severe OSAHS patients were weaker than in normal controls. An optimal cut-off between normal controls and non-normal subjects was at 26 points (total MoCA score). Moreover, cut-off between non-severe and severe OSAHS was at 2 points on visuospatial subscale. Analysis of the correlation between MoCA total scores and MMSE total scores revealed a statistically significant, though relatively weak, correlation (r=0.41, P<0.05).

Conclusion

In conclusion, our study showed that the Beijing version of the MoCA was reliable and stable. The MoCA-BJ was capable of detecting cognitive dysfunction by visuospatial and total MoCA-BJ score.

Introduction

Obstructive sleep apnea hypopnea syndrome (OSAHS) represents a common disorder that is associated with partial or complete collapse of the upper airway during sleep [1,2] and characterized by intermittent hypoxia and repeated arousals. OSAHS may increase the risk for hypertension and cardiovascular events and cause cognitive impairment [3,4].

A great many studies examined cognitive impairments by employing both objective and subjective techniques in OSAHS. Simple MRI and functional MRI have revealed a number of specific cerebral damages in hippocampus, anterior prefrontal gyri and other regions [5,6]. Moreover, a wide array of subjective tests, including the trail making test, digit span test and the verbal fluency test, have been used for the assessment of the cognitive performance of subjects with sleep apnea [79]. Many people can't afford objective methods due to the cost involved. On the other hand, the subjective neuropsychological assessments involve completing a large battery questionnaires and are hard-to-use, time-consuming and intimidating to patients. In view of these problems, an easy and effective method is needed for the early detection of cognitive deficits in OSHAS patients.

The Montreal Cognitive Assessment (MoCA) developed by Nasreddine is a brief and useful screening tool with high sensitivity and specificity for detecting mild cognitive impairment [10]. It has been effectively applied for the evaluation of the cognitive impairments in many diseases such as cardiovascular disease and Parkinson’s disease [11, 12]. The MoCA was introduced into China in 2006. Translated into Chinese and tailored to local context, it was employed nation-wide for the screening of cognitive function in a large population of Chinese subjects [13,14]. So far, five Chinese versions of MoCA are available in China and the Beijing version (MoCA-BJ) has been most widely used in mainland China. Though the MoCA has been used for the cognitive assessment of OSAHS patients, its reliability and validity, to our knowledge, have not been reported [15, 16].

In this study, we used MoCA-BJ to evaluate the cognitive functions of OSAHS patients and compared them with age- and educational-background-matched non-OSAHS subjects (including normal controls and primary snoring subjects). Additionally, the concurrent validity of MoCA-BJ was evaluated against the Mini Mental State Examination (MMSE), the most commonly used cognitive screening test in the world [17]. The aim of this study was to test the reliability and validity of the MoCA-BJ and to explore the possibility of using it for the cognitive assessment of Chinese adult patients with OSAHS.

Materials and Methods

Ethics statement

The study was approved by the Ethics Committee of the Union Hospital of Tongji Medical College, Huazhong University of Science and Technology and written informed consent was obtained from each participant.

Participants

A total of 201 patients and 40 age- and educational-background-matched normal controls were included in the study. The former were outpatients visiting our sleep clinics at Union Hospital of Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China. Forty normal controls, who neither reported snoring nor suffered from daytime sleepiness, were selected from hospital employees and their relatives or friends.

All of them received overnight polysomnography (PSG). Before PSG, the subjects had been evaluated for cognitive function by using MoCA-BJ and MMSE. 14 days after the first evaluation, 40 of the subjects were randomly selected for re-assessment with MoCA-BJ. The Epworth sleepiness scale was employed to assess the daytime sleepiness.

Exclusion criteria for all participants: (i) history of having received treatment for sleep-related breathing disorders; (ii) presence of other sleep disorders (International Classification of Sleep Disorders (ICSD-II) diagnosis) [18], such as central sleep apnea, insomnia, restless legs syndrome, REM sleep behavior disorder; (iii) other diseases such as CNS disease, cancer, severe obstructive pulmonary disease, severe physical disabilities and mental disorders; (iv) history of having undergone major surgery within the past three months; (v) recent history of having alcoholism and being on psychotropic drugs.

In addition, before MoCA-BJ and MMSE tests, demographic data, medical history, current medications, recent mental status, lifestyle and family history were also obtained from all the subjects.

Montreal Cognitive Assessment

The MoCA is a one-page 30-point test, which contains the following cognitive domains: visuospatial, executive, sustained attention, concentration, working memory, short-term memory recall, language and orientation. To correct for effects of education, one additional point (1 point) was awarded to MoCA total score of subject who had received only ≤12 years of education [10].

Mini-Mental State Examination

The Chinese version of the MMSE questionnaire consists of several subscales: orientation, immediate and short-term memory recall, attention/calculation, language and visuospatial skills. Cognitive deficit on the MMSE is defined as a score less than 27 [19].

Epworth sleepiness scale (ESS)

The ESS is a self-administered questionnaire that is widely used for subjective assessment of daytime sleepiness. It contains eight items involving eight daily-life scenarios, with each item being assessed on a 0-to-3 scale. The total scores of ESS range from 0 to 24. The cutoff point for excessive daytime sleepiness is set at >10 [20].

Polysomnographic recordings

All patients received overnight PSG (Alice 5, Respironics, Herrsching, Germany), including electroencephalography (C3/A2, C4/A1, O1/A2, O2/A1), electrooculography, submental electromyography, bilateral anterior tibialis electromyography, electrocardiography, nasal airflow measurement, monitoring of thoracoabdominal movements, oxygen saturation, snoring and body position. Sleep stages and respiratory events were analyzed against the Sleep Medicine Criteria (American Academy, 2007) [21]. An apnea was defined as complete stoppage of airflow for at least 10 s. A hypopnea was defined as reduction in airflow by over 50% from baseline for at least 10 s with accompanying drop in arterial oxygen saturation of at least 4% and/or an electroencephalographic arousal. Finally, scoring was carried out independently by two experienced technicians who were blind to the study. The 201 non-normal subjects in our series were divided into four groups: primary snoring group was made up of subjects with AHI<5 /hr, mild OSAHS group contained subjects with 5≤AHI<15 /hr; moderate OSAHS group was comprised of those with AHI ranging between 15 and 30/hr; and severe OSAHS group was consisted of subjects with AHI≥30/hr. In normal controls, the AHI was <5 /hr[21].

Statistical analyses

All analyses were performed by means of SPSS software package (version 19.0) (SPSS Inc, Chicago, IL, USA) and Medcalc version 15.2.2 (Medcalc Software, Ostend Belgium). The distribution of the data was analyzed by employing the Kolomogorov-Smirnov test. Data were presented as mean±standard deviations for continuous variables with normal distribution. Medians and interquartile ranges were used for continuous variables without normal distribution and categorical variables.

To test the differences in the demographic, clinical, primary polysomnographic parameters and cognition scores among five groups, one-way analysis of variance (ANOVA) and Kruskal-Wallis were performed. Internal consistency reliability was tested in terms of Cronbach's alpha coefficient and subscale-total correlation coefficient. Test-retest reliability was evaluated in terms of intraclass correlation coefficients (ICC). Spearman correlation coefficient was used to test concurrent validity between the MoCA-BJ total scores and MMSE total scores. The Spearman correlation analysis and multiple regression analysis were performed to assess correlations between the parameters (age, education, BMI, AHI, the minimum oxygen saturation (L-SaO2), mean oxygen saturation (A-SaO2) and the time spent at SaO2<90% (CT90)) and total scores of MoCA-BJ and its subscales scores.

To further determine the discriminate validity of the MoCA-BJ in OSAHS, receiver operating characteristic (ROC) curves of MoCA-BJ and all the cognitive domains were generated among the five groups. The area under the curve (AUC) was calculated for each ROC curve. The cutoff score, optimal sensitivity and specificity were determined on the basis of Youden index.

Statistical significance for all analysis was set at a P value < 0.05.

Results

Demographic data and clinical findings

The age of the participants ranged from 18 to 55 years, with their median time of education being 14 and 16 years (range: 6 to 16 years). The details of sex distribution, BMI, ESS scores, AHI, L-SaO2, A-SaO2 and CT90 were listed in Table 1. The rates of hypertension ranged from 0% to 11.76% and 17.65% among groups. Smoking rates ranged from 21.3% to 24.5% and 43.14% among groups.

thumbnail
Table 1. Demographics and Clinical data for studied participants.

https://doi.org/10.1371/journal.pone.0132361.t001

Internal consistency and test-retest reliability

The Cronbach’s alpha of the MoCA-BJ was 0.73(p<0.05). The correlations between visuospatial, executive, attention, language, short-term memory, and orientation and MoCA-BJ were 0.65, 0.68, 0.42, 0.56, 0.67 and 0.16, respectively. Forty subjects were retested 14 days after the first interview, and the test-retest reliability was 0.87 (95% confidence interval [CI] = 0.77–0.93, P < 0.001).

Validity, sensitivity and specificity of the MoCA-BJ and related factors

The total MoCA-BJ scores were significant higher in normal controls than in OSAHS groups (p<0.05). The total MoCA-BJ scores were comparable between normal controls and primary snoring group. The performances of visuospatial ability in severe OSAHS group were significantly weaker than in normal controls and primary snoring group. The visuospatial score in severe OSAHS subjects was also lower than in mild OSAHS group, but the difference was not significant (p = 0.051). No significant differences were revealed in visuospatial ability among normal controls, the primary snoring, mild and moderate OSAHS groups. The performances of executive ability in severe OSAHS patients were weaker than in normal controls. No significant differences were observed in attention, short-term memory recall, language, and orientation domains among the five groups. The results are detailed in Table 2.

thumbnail
Table 2. The results of MoCA-BJ cognitive domains and responding cognitive tasks.

https://doi.org/10.1371/journal.pone.0132361.t002

The ROC analysis identified an optimal cut-off between normal controls and non-normal subjects at 26 points (total MoCA score), with a sensitivity of 54.23%, specificity of 70.0% and AUC of 0.66 (95% CI 0.59–0.72). The optimal cut-off for the visuospatial subscale was at 3 points, with an sensitivity of 50.75%, specificity of 70.0% and AUC of 0.63 (95% CI 0.56–0.69). Moreover, optimal cut-off between severe OSAHS and non-severe OSAHS was found to be at 2 on visuospatial subscale, with the sensitivity was 41.18% and specificity was 85.26%, AUC was 0.68 (95%CI 0.62–0.74). Details are given in Table 3, Figs 1 and 2.

thumbnail
Table 3. Discrimination validity of the MoCA-BJ (with 95% confidence interval, CI) among groups.

https://doi.org/10.1371/journal.pone.0132361.t003

thumbnail
Fig 1. The Receiver characteristic (ROC) curves of global MoCA-BJ and visuospatial ability between normal controls and non-normal subjects.

The area under the curve of MoCA-BJ was 0.66 (95% CI 0.59–0.72), an sensitivity of 54.23% and specificity 70.0%. The AUC of visuospatial subscale was 0.63 (95% CI 0.56–0.69), the sensitivity was 50.75% and specificity was 70.0%. MoCA-BJ, Beijing version of the Montreal Cognitive Assessment. Visuo: Visuospitial.

https://doi.org/10.1371/journal.pone.0132361.g001

thumbnail
Fig 2. The Receiver characteristic (ROC) curve of visuospatial between non-severe subjects and severe OSAHS.

The area under the curve of visuospatial ability was 0.68 (95%CI 0.62–0.74), the sensitivity was 41.18% and specificity was 85.26%.

https://doi.org/10.1371/journal.pone.0132361.g002

Correlation analysis between MoCA total scores and MMSE total scores revealed a statistically significant, though relatively weak correlation (r = 0.41, P<0.05). There were no significant differences in MMSE total scores and sub-domain scores among the five groups. The results are listed in Table 4.

The associations between four polysomnographic measures of OSAHS severity (AHI, L-SaO2, A-SaO2 and CT90) and MoCA-BJ total scores and subscale scores were analyzed. It was found that the MoCA total score was significantly correlated with L-SaO2 (r = 0.16,β = 0.18), and the visuospatial skill was significantly correlated with AHI (r = 0.29,β = 0.21). There existed no significant correlations between other subscales scores and AHI, L-SaO2, A-SaO2 and CT90. As to anthropometric variables, the age educational level were found to be significantly correlated with many subscales of MoCA-BJ, the details were listed in Table 5. However, the gender distribution and BMI were not significantly correlated with the total scores and subscales scores of MoCA-BJ.

thumbnail
Table 5. The correlations between age, education and MoCA-BJ cognitive domains and the correlation between cognitive domains and MoCA-BJ total score.

https://doi.org/10.1371/journal.pone.0132361.t005

Discussion

In this study, we found that the Beijing version of the Montreal Cognitive Assessment possessed adequate internal consistency and good test-retest reliability. OSAHS patients performed poorly on global MoCA-BJ than normal controls. The severe OSAHS also had poor performance on tests of visuospatial and executive ability. According to the results from ROC curve, the MoCA-BJ demonstrated adequate ability to discriminate normal controls from non-normal subjects and severe OSAHS from non-severe OSAHS.

Internal consistency of the MoCA-BJ (Cronbach’s alpha = 0.73) satisfied the recommended value for internal consistency and was similar to those of previous studies conducted in some non-English speaking populations [22, 23]. Among the subscales in the MoCA-BJ, almost all correlations were above the minimum recommended criterion for adequate fit, except that of the orientation (r = 0.16<0.3), suggesting that the subscale orientation can be excluded when MoCA-BJ is employed for the assessment of cognitive function in adult OSAHS. The high test-retest reliability demonstrated that the MoCA-BJ is stable over time.

On global MoCA-BJ test, OSAHS patients preformed more poorly than normal controls. The total MoCA-BJ scores did not differ among primary snoring, mild, moderate and severe OSAHS groups. Our findings were consistent with the result of one previous study in which comparison was made between only two groups (OSAHS and healthy controls)[16]. Moreover, the total MoCA-BJ scores were found to be associated with L-SaO2. Our findings were consistent with the findings of a recent study, which revealed that total MoCA-BJ scores was correlated with L-SaO2 in OSAHS [15].

In this study, cube copy and clock drawing tests showed that visuospatial ability was reduced in severe OSAHS group. Our findings were similar to the results reported by Greenberg and Bédard who compared normal controls and subjects with sleep apnea in terms of visuospatial/construction ability by using Copy test. They found that sleep apnea patients performed less well than controls [1, 24]. Pietrini et al also found, by employing Drawing test, the visuospatial/construction ability was reduced in sleep apnea [25]. Furthermore, we found that the AHI was one contributor to the visuospatial ability impairment. As to whether disease severity and visuospatial capacity are related, different studies reached different conclusions. Some studies reported the visuospatial/construction ability was associated with sleep apnea severity, while some studies did not found associations [24,26,27]. The discrepancies might be ascribed to differences in methods used, subjects included and severity of the diseases.

In this study, we found that the severe OSAHS patients had significantly poorer performance on abstract test, which measures executive functions, than normal controls and no significant differences were found in trail making B and verbal fluency between severe OSAHS patients and normal controls. This findings were similar to some previous studies [28,29]. However, some studies found the people with sleep apnea had executive dysfunction on tests of trail making B and verbal fluency when compared with controls [1,30]. Since psychometric methods and study designs varied, even the same tests were used, differences among groups might or might not be revealed.

The global MoCA-BJ demonstrated adequate ability to discriminate normal controls from non-normal subjects. The point of 26 (global MoCA-BJ) might be a cutoff to differentiate normal controls from non-normal subjects. Moreover, visuospatial scale was demonstrated to be adequately able to distinguish the non-severe OSAHS from severe OSAHS. The point of 2 on visuospatial subscale might be the cutoff to discriminate non-severe OSAHS from severe OSAHS.

Many studies reported that patients with sleep apnea tended to suffer from impaired attention/vigilance. Nonetheless, in this study, no differences were found in attention among the five groups. Attention involves a number of sub-domains and a great many tests for attention are available. In previous studies, the four-choice reaction time (FCRRT) and the psycho-motor vigilance (PVT) tests showed that the sustained attention was impaired in patients with sleep apnea [3133] and the Stroop test exhibited that subjects with sleep apnea had poorer selective attention ability [34,35]. In our study, the tasks of finger tapping, digit span and calculation in MoCA-BJ were not sensitive enough for the detection of the attention impairment. Despite low sensitivity of above tasks, the cube copy, drawing, abstract, and global MoCA-BJ scores, when used in combination, can effectively measure cognitive ability.

The short-term verbal memory recall process was tested in MoCA-BJ, no differences were found among groups. Memory processes are involved and previous studies, using WMS: figural memory and Rey-Osterrieth figure tasks, found that the long-term memory recall was impaired in sleep apnea subjects [25,32]. The Benton Visual Retention Test (BVRT) and WMS: logical memory tests showed that the immediate recall memory ability did not differ between patients and controls [1,4]. Beebe and colleges, in their meta-review study, reported that the impact of OSA on short-term verbal memory was marginal and not statistically significant [36]. It remains elusive which aspects of memory are most vulnerable to or affected by OSA. In addition, our study did not exhibit any differences in language ability among the five groups. Meta-review by Bucks and Beebe showed that language ability was not affected by OSA [36, 37].

Our study showed that the correlation between MoCA-BJ total scores and MMSE scores was weak and this might be attributed to the fact that the two instruments don’t cover exactly the same domains of cognitive function. The MMSE couldn’t differentiate adult normal subjects from primary snoring and OSAHS subjects.

Among the demographic variables, age and educational level were found to be correlated with many MoCA-BJ subdomains. Our findings were consistent with the previous studies which suggested that the MoCA scores were significantly associated with age and educational level [14, 38].

This study had some limitations. First, age of our subjects were ranged from 18–55 and the results may not be extrapolated to older or younger populations. Second, this study was not a population-based and more normal subjects from communities should be included to better meet the statistical requirements.

In conclusion, our study showed that the Beijing version of the MoCA was reliable and stable in adult OSAHS patients. The MoCA-BJ was capable of detecting cognitive dysfunction by visuospatial and total MoCA-BJ score, though it was not sensitive to attention and memory deficits. In future, research efforts should be directed at examining the relationship between MoCA-BJ and other sensitive measures and other objective tests.

Supporting Information

Acknowledgments

We are indebted to all the subjects who took part in this study, and the staff of the Sleep Center of Union Hospital of Tongji Medical College, Huazhong University of Science and Technology.

Author Contributions

Conceived and designed the experiments: WK XC RZ. Performed the experiments: XC RZ YX. Analyzed the data: XC RZ JD XN. Wrote the paper: XC RZ YX WK.

References

  1. 1. Bédard MA, Montplaisir J, Richer F, Rouleau I, Malo J. Obstructive sleep apnea syndrome: pathogenesis of neuropsychological deficits. J Clin Exp. 1991;13: 950–964.
  2. 2. Xiao Y, Chen Xiong, Shi HS, Yang Y, He LC, Kong WJ, et al. Evaluation of Airway Obstruction at Soft Palate Level in Male Patients with Obstructive Sleep Apnea/Hypopnea Syndrome: Dynamic 3-Dimensional CT Imaging of Upper Airway. J Huazhong Univ Sci Techno. 2011; 31: 413–418.
  3. 3. Nieto FJ, Young TB, Lind BK, Shahar E, Samet JM, Reline S, et al. Association of sleep-disordered breathing, sleep apnea, and hypertension in a large community-based study. Journal of the American Medical Association. 2000; 283:1829–1836. pmid:10770144
  4. 4. Findley LJ, Barth JT, Powers DC, Wilhoit SC, Boyd DG, Suratt PM. Cognitive impairment in patients with obstructive sleep apnea and associated hypoxemia. Chest. 1986; 90: 686–690. pmid:3769569
  5. 5. Canessa N, Castronovo V, Cappa SF, Aloia MS, Marelli S, Falini A, et al. Obstructive sleep apnea: brain structural changes and neurocognitive function before and after treatment. AM J Resp Crit Care. 2011;183:1419–1426.
  6. 6. Zhang X, Ma L, Li S, Wang Y, Wang L. A functional MRI evaluation of frontal dysfunction in patients with severe obstructive sleep apnea. Sleep Med. 2011;12:335–340. pmid:21398177
  7. 7. Shpirer Isaac, Elizur Arnon, Shorer Ran, Bernst Ruth. Hypoxemia correlates with attentional dysfunction in patients with obstructive sleep apnea. Sleep Breath. 2012; 16:821–827. pmid:21898098
  8. 8. Mathieu A, Mazza S, Décary A, Massicotte-Marquez J, Petit D, Gosselin N, et al. Effects of obstructive sleep apnea on cognitive function: A comparison between younger and older OSAS patients. Sleep Med. 2008; 9: 112–120. pmid:17513171
  9. 9. Naëgelé B, Launois SH, Mazza S, Feuerstein C. Which Memory Processes are affected in Patients With Obstructive Sleep Apnea? An Evaluation of 3 Types of Memory. Sleep. 2006; 29: 533–544. pmid:16676787
  10. 10. Nasreddine ZS, Phillips NA, Bédirian V, Charbonneau S, Whitehead V, Collin I, et al. The Montreal Cognitive Assessment, MoCA: a brief screening tool for mild Cognitive impairment. Am Geriatr Soc. 2005; 53: 695–699.
  11. 11. McLennan SN, Mathias JL, Brennan LC, Stewart S. Validity of the montreal cognitive assessment (MoCA) as a screening test for mild cognitive impairment (MCI) in a cardiovascular population. J Geriatr Psychiatry Neurol. 2011; 24: 33–38. pmid:21156989
  12. 12. Nazem S, Siderowf AD, Duda JE, et al. Montreal cognitive assessment performance in patients with Parkinson's disease with "normal" global cognition according to mini-mental state examination score. J Am Geriatr Soc. 2009; 57: 304–308. pmid:19170786
  13. 13. Lu J, Li D, Li F, Zhou A, Wang F, Zuo X, et al. Montreal cognitive assessment in detecting cognitive impairment in Chinese elderly individuals: a population-based study. J Geriatr Psychiatry Neurol. 2011; 24:184–190. pmid:22228824
  14. 14. Yu J, Li J, Huang X. The Beijing version of the Montreal cognitive assessment as a brief screening tool for mild cognitive impairment: a community-based study. BMC Psychiatry. 2012; 25: 156
  15. 15. Chen R, Xiong KP, Huang JY, Lian YX, Jin F, Li ZH, et al. Neurocognitive impairment in Chinese patients with obstructive sleep apnoea hypopnoea syndrome. Respirology. 2011; 16: 842–848. pmid:21507144
  16. 16. Wang WH, He GP, Xiao XP, Gu C, Chen HY. Relationship between brain-derived neurotrophic factor and cognitive function of obstructive sleep apnea/hypopnea syndrome patients. Asian Pac J Trop Med. 2012; 5: 906–910. pmid:23146807
  17. 17. Folstein MF, Folstein SE, McHugh PR “Mini-mental state”. A practical method for grading the cognitive state of patients for the clinician. J Psychiatr Res. 1975; 12: 189–198. pmid:1202204
  18. 18. American Academy of Sleep Medicine. International Classification of Sleep Disorders, 2nd Edition Diagnostic and Coding Manual. American Academy of Sleep Medicine, Westchester, IL (2005).
  19. 19. Yu ES, Liu WT, Levy P, Zhang MY, Katzman R, Lung CT, et al. Cognitive impairment among elderly adults in Shanghai, China. J Gerontol. 1989; 44: S97–106.
  20. 20. Johns MW. Sensitivity and specificity of the multiple sleep latency test (MSLT), the maintenance of wakefulness test and the Epworth Sleepiness Scale: failure of the MSLT as a gold standard. J Sleep Res. 2000; 9: 5–11. pmid:10733683
  21. 21. Iber C, Ancoli-Israel S, Chesson AL, et al. The AASM Manual for the Scoring of Sleep and Associated Events: Rules, Terminology and Technical Specifications American Academy of Sleep Medicine, Westchester, IL(2007).
  22. 22. Fujiwara Y, Suzuki H, Yasunaga M, Sugiyama M, Ijuin M, Sakuma N, et al. Brief screening tool for mild cognitive impairment in older Japanese: validation of the Japanese version of the Montreal Cognitive Assessment. Geriatr Gerontol Int. 2010;10: 225–232. pmid:20141536
  23. 23. Ozdilek B, Kenangil G. Validation of the Turkish Version of the Montreal Cognitive Assessment Scale (MoCA-TR) in patients with Parkinson's disease. Clin Neuropsychol. 2014; 28: 333–343. pmid:24528299
  24. 24. Greenberg GD, Watson R. Neuropsychological dysfunction in sleep apnea. Sleep. 1987; 10:254–262. pmid:3629088
  25. 25. Pietrini P, Dani A, Raphaelson M, Furey ML, Alexander G, Levine B, et al. Cerebral glucose metabolic and neuropsychological dysfunction in patients with untreated sleep apnea syndrome(SAS). Sleep. 1998, (supple 3):82.
  26. 26. Cheshire K, Engleman H, Deary I, Shapiro C, Douglas NJ. Factors impairing daytime performance in patients with sleep apnea hypopnea syndrome. Arch Intern Med. 1992; 152: 538–541. pmid:1546916
  27. 27. Kingshott RN, Vennelle M, Hoy CJ, Engleman HM, Deary IJ, Douglas NJ. Predictors of improvements in daytime function outcomes with CPAP therapy. Am J Respir Crit Care Med. 2000; 161:866–871 pmid:10712335
  28. 28. Redline S, Strauss ME, Adams N, Winters M, Roebuck T, Spry K, et al. Neuropsychological function in mild sleep-disordered breathing. Sleep. 1997; 20:160–167. pmid:9143077
  29. 29. Lee MM, Strauss ME, Adams N, Redline S. Executive functions in persons with sleep apnea. Sleep Breath. 1999; 3: 13–16. pmid:11898098
  30. 30. Saunamäki T, Himanen SL, Polo O, Jehkonen M. Executive dysfunction in patients with obstructive sleep apnea syndrome. Eur Neurol. 2009; 62: 237–242. pmid:19672077
  31. 31. Morisson F, Decary A, Poirier G, Godbout R, Bédard MA, Lavigne G, et al. Vigilance impairment in obstructive sleep apnea syndrome, idiopathic hypersomnia and narcolepsy. Sleep Res. 1997; 26: 438.
  32. 32. Zozula R, Caccappolo E, Rapoport D, Walsleben J. Assessment of cognitive function in moderate-severe OSAS. Sleep. 1998; 21(Suppl. 3): 71.
  33. 33. Muñoz A, Mayoralas LR, Barbé A, Mayoralas LR, Barbé F, Péricás J, et al. Long-term effects of CPAP on daytime functioning in patients with sleep apnea syndrome. Eur Respir J. 2000; 15:676–681. pmid:10780758
  34. 34. Kuo TF, Bootzin RR, Quan SF, Hiley A, Caccappolo E, Walsleben JA, et al. Sleep disordered breathing and neuropsychological functioning: a study in non-patient adults age 45–75. Sleep. 2000; 23(Suppl. 2): 58.
  35. 35. Lauer CJ, Fischer J, Lund R, Zihl J. Patients with obstructive sleep apnea syndrome(OSAS) show deficits in attentional demands and problem solving capacities. J Sleep Res. 1998; 7(Suppl.2):148.
  36. 36. Beebe DW, Groesz L, Wells C, Nichols A, McGee K. The neuropsychological effects of OSA: A meta-analysis of norm-referenced and case-control data. Sleep. 2003; 26: 298–307. pmid:12749549
  37. 37. Bucks RS, Olaithe M, Eastwood P. Neurocognitive function in obstructive sleep apnoea: A meta-review. Respirology. 2013; 18: 61–70. pmid:22913604
  38. 38. Rossetti HC, Lacritz LH, Cullum CM, Weiner MF. Normative data for the Montreal Cognitive Assessment (MoCA) in a population-based sample. Neurology. 2011; 77: 1272–1275. pmid:21917776