DESIGN AND IMPLEMENTATION OF AN INTELLIGENT OBJECT DETECTION AND INTERACTION SYSTEM LEVERAGING OPENAI

Student: Solomon Oluwaseun Adeniran
Supervisor: Mrs Olawunmi Adebanjo
HOD: Dr Olusola Maitami
Department of Software Engineering
Science and Technology
Babcock University, Ilishan-Remo, Ogun State

Abstract

The constant evolution of artificial intelligence has led to a significant improvement in object detection and human-computer interaction. This project presents an AI-powered Object Detection and Interaction System that integrates OpenAI's GPT-4o model to recognize and describe objects through natural language understanding. The study aims to develop a system that improves accessibility and user interaction by enabling users to query detected objects and receive meaningful responses in plain text. The problem addressed in this research is that most object detection systems only identify objects without providing useful information about them. This can make them less interactive and not very helpful for everyday users. To fix this, the proposed system combines computer vision which helps computers see and recognize images and natural language processing which helps computers understand and respond in human language to create a more user-friendly experience. The system works by analyzing images, identifying objects, and allowing users to interact with it through text-based questions. User feedback is used to evaluate how well the system works, focusing on accuracy, ease of use, and the quality of responses. The results show that this approach makes object recognition more interactive and practical, with potential applications in education, assistive technology, and smart search tools. In summary, this project shows how combining AI-powered image recognition and language understanding can improve the way people interact with technology. Future improvements could include adding real-time detection and allowing the system to answer more complex questions.

Full-Text Access Notice

In accordance with the NERD Policy on promoting peer-reviewed publication, public access to the full text of a project, thesis or dissertation is restricted for three years, allowing the author and supervisors sufficient time to pursue peer-reviewed publication. During this period, researchers with legitimate academic or research purposes may request authorisation directly from the author to enable NERD to release the indexed full texts of the work using the form below.

Request authorisation from the author