Bracher-Smith, Matthew, Rees, Elliott ORCID: https://orcid.org/0000-0002-6168-9222, Menzies, Georgina ORCID: https://orcid.org/0000-0002-6600-6507, Walters, James ORCID: https://orcid.org/0000-0002-6980-4053, O'Donovan, Michael ORCID: https://orcid.org/0000-0001-7073-2379, Owen, Michael J. ORCID: https://orcid.org/0000-0003-4798-0862, Kirov, George ORCID: https://orcid.org/0000-0002-3427-3950 and Escott-Price, Valentina ORCID: https://orcid.org/0000-0003-1784-5483 2022. Machine learning for prediction of schizophrenia using genetic and demographic factors in the UK Biobank. Schizophrenia Research 246 , pp. 156-164. 10.1016/j.schres.2022.06.006 |
PDF
- Published Version
Available under License Creative Commons Attribution. Download (3MB) |
Abstract
Machine learning (ML) holds promise for precision psychiatry, but its predictive performance is unclear. We assessed whether ML provided added value over logistic regression for prediction of schizophrenia, and compared models built using polygenic risk scores (PRS) or clinical/demographic factors. LASSO and ridge-penalised logistic regression, support vector machines (SVM), random forests, boosting, neural networks and stacked models were trained to predict schizophrenia, using PRS for schizophrenia (PRSSZ), sex, parental depression, educational attainment, winter birth, handedness and number of siblings as predictors. Models were evaluated for discrimination using area under the receiver operator characteristic curve (AUROC) and relative importance of predictors using permutation feature importance (PFI). In a secondary analysis, fitted models were tested for association with schizophrenia-related traits which had not been used in model development. Following learning curve analysis, 738 cases and 3690 randomly sampled controls were selected from the UK Biobank. ML models combining all predictors showed the highest discrimination (linear SVM, AUROC = 0.71), but did not significantly outperform logistic regression. AUROC was robust over 100 random resamples of controls. PFI identified PRSSZ as the most important predictor. Highest variance in fitted models was explained by schizophrenia-related traits including fluid intelligence (most associated: linear SVM), digit symbol substitution (RBF SVM), BMI (XGBoost), smoking status (XGBoost) and deprivation (linear SVM). In conclusion, ML approaches did not provide substantial added value for prediction of schizophrenia over logistic regression, as indexed by AUROC; however, risk scores derived with different ML approaches differ with respect to association with schizophrenia-related traits.
Item Type: | Article |
---|---|
Date Type: | Publication |
Status: | Published |
Schools: | Advanced Research Computing @ Cardiff (ARCCA) Biosciences MRC Centre for Neuropsychiatric Genetics and Genomics (CNGG) Medicine |
Additional Information: | This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/) |
Publisher: | Elsevier |
ISSN: | 0920-9964 |
Funders: | MRC |
Date of First Compliant Deposit: | 29 June 2022 |
Date of Acceptance: | 11 June 2022 |
Last Modified: | 05 Aug 2024 16:21 |
URI: | https://orca.cardiff.ac.uk/id/eprint/150878 |
Citation Data
Cited 3 times in Scopus. View in Scopus. Powered By Scopus® Data
Actions (repository staff only)
Edit Item |