NORMA eResearch @NCI Library

Object Detection for Visually Impaired Individuals in Different Weather Conditions

-, Ankit Kumar (2024) Object Detection for Visually Impaired Individuals in Different Weather Conditions. Masters thesis, Dublin, National College of Ireland.

[thumbnail of Master of Science]
Preview
PDF (Master of Science)
Download (706kB) | Preview
[thumbnail of Configuration Manual]
Preview
PDF (Configuration Manual)
Download (1MB) | Preview

Abstract

Visually impaired people use white cane to navigate through their surroundings. This research presents an object detection system designed to assist visually impaired individuals in different weather conditions. Current models do not account for real-time weather conditions. The objective of this research is to utilize the state-of-the-art YOLOv8 model and integrate weather data with it to enhance object detection accuracy and reliability under various weather conditions. The system was trained on the Pascal VOC 2012 dataset, pre-processed to simulate five major weather types: rainy, snowy, foggy, sunny, and cloudy. By incorporating real-time weather data, the model dynamically adjusts its detection parameters, providing context-aware feedback through audio using Google Text-to-Speech. The results indicate that the model performs optimally under sunny conditions, with a mean average precision (mAP@0.5) of 0.74 and an F1 score of 0.69. Performance under challenging conditions like rain and snow was lower, demonstrating the need for further optimization. The system enhances the navigational safety and independence of visually impaired users by providing real-time, intelligible audio feedback about their surroundings. This research contributes to the field of assistive technology by highlighting the importance of personalized and adaptive systems. Future work includes expanding the dataset, improving preprocessing techniques, integrating with other assistive technologies, and incorporating user feedback for continuous system improvement.

Item Type: Thesis (Masters)
Supervisors:
Name
Email
Raza Abidi, Syed Muhammad
UNSPECIFIED
Uncontrolled Keywords: Visually Impaired; YOLOv8; Object Detection; Weather conditions; Audio feedback
Subjects: Q Science > QA Mathematics > Electronic computers. Computer science
T Technology > T Technology (General) > Information Technology > Electronic computers. Computer science
Q Science > QH Natural history > QH301 Biology > Methods of research. Technique. Experimental biology > Data processing. Bioinformatics > Artificial intelligence > Computer vision
Q Science > Q Science (General) > Self-organizing systems. Conscious automata > Artificial intelligence > Computer vision
R Medicine > Diseases > Disabilities
Q Science > Q Science (General) > Self-organizing systems. Conscious automata > Machine learning
Divisions: School of Computing > Master of Science in Data Analytics
Depositing User: Ciara O'Brien
Date Deposited: 06 Aug 2025 14:05
Last Modified: 06 Aug 2025 14:05
URI: https://norma.ncirl.ie/id/eprint/8442

Actions (login required)

View Item View Item