Skip to main content
Open access
ARTICLES
Published Online: 13 May 2023

Exploring the Use of Natural Language Processing for Objective Assessment of Disorganized Speech in Schizophrenia

Publication: Psychiatric Research and Clinical Practice

Abstract

Objective

Measurement‐based care tools in psychiatry are useful for symptom monitoring and detecting response to treatment, but methods for quick and objective measurement are lacking especially for acute psychosis. The aim of this study was to explore potential language markers, detected by natural language processing (NLP) methods, as a means to objectively measure the severity of psychotic symptoms of schizophrenia in an acute clinical setting.

Methods

Twenty‐two speech samples were collected from seven participants who were hospitalized for schizophrenia, and their symptoms were evaluated over time with SAPS/SANS and TLC scales. Linguistic features were extracted from the speech data using machine learning techniques. Spearman's correlation was performed to examine the relationship between linguistic features and symptoms. Various machine learning models were evaluated by cross‐validation methods for their ability to predict symptom severity using the linguistic markers.

Results

Reduced lexical richness and syntactic complexity were characteristic of negative symptoms, while lower content density and more repetitions in speech were predictors of positive symptoms. Machine learning models predicted severity of alogia, illogicality, poverty of speech, social inattentiveness, and TLC scores with up to 82% accuracy. Additionally, speech incoherence was quantifiable through language markers derived from NLP methods.

Conclusions

These preliminary findings suggest that NLP may be useful in identifying clinically relevant language markers of schizophrenia, which can enhance objectivity in symptom monitoring during hospitalization. Further work is needed to replicate these findings in a larger data set and explore methods for feasible implementation in practice.

Formats available

You can view the full content in the following formats:

Supplementary Material

File (rcp21064-sup-0001-suppl-data.docx)
Supplementry Material 1

Information & Authors

Information

Published In

Go to Psychiatric Research and Clinical Practice
Psychiatric Research and Clinical Practice
Pages: 84 - 92

History

Received: 13 January 2023
Accepted: 16 April 2023
Published online: 13 May 2023
Published in print: Autumn (Fall) 2023

Authors

Affiliations

Faculty of Information, University of Toronto, Toronto, Ontario, Canada (L. Jeong); Department of Psychiatry, University of Toronto, Toronto, Ontario, Canada (M. Lee, C. Gabilondo); Department of Computer Science, University of Toronto, Toronto, Ontario, Canada (B. Eyre, F. Rudzicz); Vector Institute for Artificial Intelligence, Toronto, Ontario, Canada (B. Eyre, F. Rudzicz); Massachusetts Institute of Technology, Cambridge, Massachusetts, USA (A. Balagopalan); Faculty of Computer Science, Dalhousie University, Halifax, Nova Scotia, Canada (F. Rudzicz)
Melissa Lee, MD
Faculty of Information, University of Toronto, Toronto, Ontario, Canada (L. Jeong); Department of Psychiatry, University of Toronto, Toronto, Ontario, Canada (M. Lee, C. Gabilondo); Department of Computer Science, University of Toronto, Toronto, Ontario, Canada (B. Eyre, F. Rudzicz); Vector Institute for Artificial Intelligence, Toronto, Ontario, Canada (B. Eyre, F. Rudzicz); Massachusetts Institute of Technology, Cambridge, Massachusetts, USA (A. Balagopalan); Faculty of Computer Science, Dalhousie University, Halifax, Nova Scotia, Canada (F. Rudzicz)
Ben Eyre, BSc
Faculty of Information, University of Toronto, Toronto, Ontario, Canada (L. Jeong); Department of Psychiatry, University of Toronto, Toronto, Ontario, Canada (M. Lee, C. Gabilondo); Department of Computer Science, University of Toronto, Toronto, Ontario, Canada (B. Eyre, F. Rudzicz); Vector Institute for Artificial Intelligence, Toronto, Ontario, Canada (B. Eyre, F. Rudzicz); Massachusetts Institute of Technology, Cambridge, Massachusetts, USA (A. Balagopalan); Faculty of Computer Science, Dalhousie University, Halifax, Nova Scotia, Canada (F. Rudzicz)
Aparna Balagopalan, MSc
Faculty of Information, University of Toronto, Toronto, Ontario, Canada (L. Jeong); Department of Psychiatry, University of Toronto, Toronto, Ontario, Canada (M. Lee, C. Gabilondo); Department of Computer Science, University of Toronto, Toronto, Ontario, Canada (B. Eyre, F. Rudzicz); Vector Institute for Artificial Intelligence, Toronto, Ontario, Canada (B. Eyre, F. Rudzicz); Massachusetts Institute of Technology, Cambridge, Massachusetts, USA (A. Balagopalan); Faculty of Computer Science, Dalhousie University, Halifax, Nova Scotia, Canada (F. Rudzicz)
Frank Rudzicz, PhD
Faculty of Information, University of Toronto, Toronto, Ontario, Canada (L. Jeong); Department of Psychiatry, University of Toronto, Toronto, Ontario, Canada (M. Lee, C. Gabilondo); Department of Computer Science, University of Toronto, Toronto, Ontario, Canada (B. Eyre, F. Rudzicz); Vector Institute for Artificial Intelligence, Toronto, Ontario, Canada (B. Eyre, F. Rudzicz); Massachusetts Institute of Technology, Cambridge, Massachusetts, USA (A. Balagopalan); Faculty of Computer Science, Dalhousie University, Halifax, Nova Scotia, Canada (F. Rudzicz)
Cedric Gabilondo, MD
Faculty of Information, University of Toronto, Toronto, Ontario, Canada (L. Jeong); Department of Psychiatry, University of Toronto, Toronto, Ontario, Canada (M. Lee, C. Gabilondo); Department of Computer Science, University of Toronto, Toronto, Ontario, Canada (B. Eyre, F. Rudzicz); Vector Institute for Artificial Intelligence, Toronto, Ontario, Canada (B. Eyre, F. Rudzicz); Massachusetts Institute of Technology, Cambridge, Massachusetts, USA (A. Balagopalan); Faculty of Computer Science, Dalhousie University, Halifax, Nova Scotia, Canada (F. Rudzicz)

Notes

Send correspondence to
Dr. Lee
([email protected])

Funding Information

Michael Garron Hospital
Michael Garron Hospital Educational Scholarship and Research Grant

Metrics & Citations

Metrics

Citations

Export Citations

If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.

For more information or tips please see 'Downloading to a citation manager' in the Help menu.

Format
Citation style
Style
Copy to clipboard

There are no citations for this item

View Options

View options

PDF/ePub

View PDF/ePub

Full Text

View Full Text

Get Access

Login options

Already a subscriber? Access your subscription through your login credentials or your institution for full access to this article.

Personal login Institutional Login Open Athens login

Not a subscriber?

Subscribe Now / Learn More

PsychiatryOnline subscription options offer access to the DSM-5-TR® library, books, journals, CME, and patient resources. This all-in-one virtual library provides psychiatrists and mental health professionals with key resources for diagnosis, treatment, research, and professional development.

Need more help? PsychiatryOnline Customer Service may be reached by emailing [email protected] or by calling 800-368-5777 (in the U.S.) or 703-907-7322 (outside the U.S.).

Media

Figures

Other

Tables

Share

Share

Share article link

Share