For information about COVID-19, including symptoms and prevention, please read our COVID-19 patient guide. Please also consider supporting Weill Cornell Medicine’s efforts against the pandemic.

Multimodal mental health analysis in social media.

TitleMultimodal mental health analysis in social media.
Publication TypeJournal Article
Year of Publication2020
AuthorsYazdavar AHossein, Mahdavinejad MSaeid, Bajaj G, Romine W, Sheth A, Monadjemi AHassan, Thirunarayan K, Meddar JM, Myers A, Pathak J, Hitzler P
JournalPLoS One
Volume15
Issue4
Paginatione0226248
Date Published2020
ISSN1932-6203
Abstract

Depression is a major public health concern in the U.S. and globally. While successful early identification and treatment can lead to many positive health and behavioral outcomes, depression, remains undiagnosed, untreated or undertreated due to several reasons, including denial of the illness as well as cultural and social stigma. With the ubiquity of social media platforms, millions of people are now sharing their online persona by expressing their thoughts, moods, emotions, and even their daily struggles with mental health on social media. Unlike traditional observational cohort studies conducted through questionnaires and self-reported surveys, we explore the reliable detection of depressive symptoms from tweets obtained, unobtrusively. Particularly, we examine and exploit multimodal big (social) data to discern depressive behaviors using a wide variety of features including individual-level demographics. By developing a multimodal framework and employing statistical techniques to fuse heterogeneous sets of features obtained through the processing of visual, textual, and user interaction data, we significantly enhance the current state-of-the-art approaches for identifying depressed individuals on Twitter (improving the average F1-Score by 5 percent) as well as facilitate demographic inferences from social media. Besides providing insights into the relationship between demographics and mental health, our research assists in the design of a new breed of demographic-aware health interventions.

DOI10.1371/journal.pone.0226248
Alternate JournalPLoS ONE
PubMed ID32275658
PubMed Central IDPMC7147779
Division: 
Health Informatics
Category: 
Faculty Publication