NORMA eResearch @NCI Library

A Multimodal system for detecting life threatening emotions in social media using AI

Ponugupati, Siva Naga Malleswara Rao (2024) A Multimodal system for detecting life threatening emotions in social media using AI. Masters thesis, Dublin, National College of Ireland.

[thumbnail of Master of Science]
Preview
PDF (Master of Science)
Download (1MB) | Preview
[thumbnail of Configuration Manual]
Preview
PDF (Configuration Manual)
Download (544kB) | Preview

Abstract

Catastrophic emotions like anxiety, fear, anger, and suicidal phrases are more shortly experienced as a result of social and psychological issues occurring after COVID-19. With the tremendous amount of content in various formats on social media, we present a multimodal AI system that detects indicators of early stages of the emotional distress based on speech, vision and text analysis. It uses the latest deep learning models, spectrogram-based LSTMs for speech, facial recognition for vision and sentiment analysis for text to improve detection and timely report generation. As a result of filling the gaps left by other single-modal approaches, our framework can provide timely interventions for these patients, help mental health professionals, and raise the quality of patients’ treatment. Its scale and its ethical structure provides a strong framework for delivering intelligent analytics into healthcare, thereby gaining lives of those in danger and allowing for mental health crisis intervention. The findings of this study also show how AI can be used to revolutionize other mental health issues across the world.

Item Type: Thesis (Masters)
Supervisors:
Name
Email
-, -
UNSPECIFIED
Subjects: Q Science > QA Mathematics > Electronic computers. Computer science
T Technology > T Technology (General) > Information Technology > Electronic computers. Computer science
Q Science > QH Natural history > QH301 Biology > Methods of research. Technique. Experimental biology > Data processing. Bioinformatics > Artificial intelligence
Q Science > Q Science (General) > Self-organizing systems. Conscious automata > Artificial intelligence
Q Science > QA Mathematics > Computer software > Computer Security
T Technology > T Technology (General) > Information Technology > Computer software > Computer Security
R Medicine > RA Public aspects of medicine > RA790 Mental Health
Z Bibliography. Library Science. Information Resources > ZA Information resources > ZA4150 Computer Network Resources > The Internet > World Wide Web > Websites > Online social networks
T Technology > TK Electrical engineering. Electronics. Nuclear engineering > Telecommunications > The Internet > World Wide Web > Websites > Online social networks
Divisions: School of Computing > Master of Science in Cyber Security
Depositing User: Ciara O'Brien
Date Deposited: 28 Jul 2025 09:09
Last Modified: 28 Jul 2025 09:09
URI: https://norma.ncirl.ie/id/eprint/8242

Actions (login required)

View Item View Item