• Home
  • Search
  • Deep Multimodal Representations and Classification of First-Episode Psychosis via Live Face Processing
  • Cite Icon1
  • https://doi.org/10.1101/2024.11.07.622469Copy DOI Icon

Deep Multimodal Representations and Classification of First-Episode Psychosis via Live Face Processing

  • Nov 8, 2024
  • bioRxiv
  • Rahul Singh +8 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Schizophrenia is a severe psychiatric disorder associated with a wide range of cognitive and neurophysiological dysfunctions and long-term social difficulties. In this paper, we test the hypothesis that integration of multiple simultaneous acquisitions of neuroimaging, behavioral, and clinical information will be better for prediction of early psychosis than unimodal recordings. We propose a novel framework to investigate the neural underpinnings of the early psychosis symptoms (that can develop into Schizophrenia with age) using multimodal acquisitions of neural and behavioral recordings including functional near-infrared spectroscopy (fNIRS) and electroencephalography (EEG), and facial features. Our data acquisition paradigm is based on live face-to-face interaction in order to study the neural correlates of social cognition in first-episode psychosis (FEP). We propose a novel deep representation learning framework, Neural-PRISM, for learning joint multimodal compressed representations combining neural as well as behavioral recordings. These learned representations are subsequently used to describe, classify, and predict the severity of early psychosis in patients, as measured by the Positive and Negative Syndrome Scale (PANSS) and Global Assessment of Functioning (GAF) scores. We found that incorporating joint multimodal representations from fNIRS and EEG along with behavioral recordings enhances classification between typical controls and FEP individuals. Additionally, our results suggest that geometric and topological features such as curvatures and path signatures of the embedded trajectories of brain activity enable detection of discriminatory neural characteristics in early psychosis.

Similar Papers
  • Research Article
  • Citations2

Deep multimodal representations and classification of first-episode psychosis via live face processing.

  • Feb 26, 2025
  • Frontiers in psychiatry
  • Rahul Singh +8
  • Research Article
  • Citations1

Compulsory treatment across a 2-year follow-up within an "Early Intervention in Psychosis" program in Italy: Incidence rates and baseline predictors.

  • May 01, 2025
  • Schizophrenia research
  • Lorenzo Pelizza +8
  • Research Article
  • Citations5

Hippocampal Volumes in First-Episode Psychosis

  • Feb 01, 2009
  • Journal of Neuropsychiatry
  • S Verma +7
  • Discussion

White matter volume not associated with hallucinations in clinical high risk and first-episode psychosis: A voxel-based morphometry study.

  • Aug 04, 2021
  • Psychiatry and Clinical Neurosciences
  • Yutaro Sato +9
  • Research Article
  • Citations9

Impaired Performance on the Reading the Mind in the Eyes Test in First-Episode Psychosis and Clinical High Risk for Psychosis

  • Dec 01, 2020
  • Psychiatry Investigation
  • Seo Woo Kim +7
  • Research Article
  • Citations1

Associations Between Childhood Trauma and Social Cognition in Early Psychosis.

  • May 01, 2025
  • Early intervention in psychiatry
  • D Cavero +12
  • PDF
  • Research Article
  • Citations27

Effect of Vitamin D Supplementation on Outcomes in People With Early Psychosis

  • Dec 28, 2021
  • JAMA Network Open
  • Fiona Gaughran +22
  • Research Article
  • Citations4

Borderline personality disorder vs. mood disorders: clinical comparisons in young people treated within an “Early Intervention” service for first episode psychosis

  • Oct 01, 2023
  • The European Journal of Psychiatry
  • Lorenzo Pelizza +9
  • Abstract
  • Citations1

Anxious-depressive symptoms after a first episode of schizophrenia: Response to treatment and psychopathological considerations from a 2-year follow-up study in Italy

  • Apr 01, 2024
  • European Psychiatry
  • L Pelizza +3
  • Research Article
  • Citations1

Effects of Fish-Oil Consumption on Psychological Function Outcomes in Psychosis: A Systematic Review and Dose-Response Meta-Analysis of Randomized Controlled Trials.

  • Sep 27, 2022
  • Advances in Nutrition
  • Mohsen Montazer +3
  • Research Article
  • Citations1

Autism-spectrum traits in First Episode Psychosis: Psychopathological and prognostic considerations from a 2-year follow-up study.

  • Sep 01, 2025
  • Schizophrenia research
  • Lorenzo Pelizza +8
  • PDF
  • Research Article
  • Citations29

Duration of Untreated Disorder and Cannabis Use: An Observational Study on a Cohort of Young Italian Patients Experiencing Psychotic Experiences and Dissociative Symptoms

  • Nov 30, 2021
  • International Journal of Environmental Research and Public Health
  • Valerio Ricci +12
  • PDF
  • Research Article
  • Citations1

Longitudinal evaluation of the early auditory gamma-band response and its modulation by attention in first-episode psychosis

  • Nov 01, 2024
  • Psychological Medicine
  • Alfredo L Sklar +9
  • Abstract

T15. MISMATCH NEGATIVITY INDICES AS A PROGNOSTIC FACTOR FOR REMISSION IN SCHIZOPHRENIA

  • May 01, 2020
  • Schizophrenia Bulletin
  • Se-Hoon Shim +6
  • Research Article
  • Citations40

Increase in serum HDL level is associated with less negative symptoms after one year of antipsychotic treatment in first-episode psychosis

  • Nov 10, 2017
  • Schizophrenia Research
  • Priyanthi B Gjerde +11
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.