DESIGN AND IMPLEMENTATION OF AN INTELLIGENT OBJECT DETECTION AND INTERACTION SYSTEM LEVERAGING OPENAI
Abstract
The constant evolution of artificial intelligence has led to a significant
improvement in object detection and human-computer interaction. This project
presents an AI-powered Object Detection and Interaction System that integrates
OpenAI's GPT-4o model to recognize and describe objects through natural
language understanding. The study aims to develop a system that improves
accessibility and user interaction by enabling users to query detected objects
and receive meaningful responses in plain text.
The problem addressed in this research is that most object detection systems
only identify objects without providing useful information about them. This can
make them less interactive and not very helpful for everyday users. To fix this,
the proposed system combines computer vision which helps computers see and
recognize images and natural language processing which helps computers
understand and respond in human language to create a more user-friendly
experience.
The system works by analyzing images, identifying objects, and allowing users
to interact with it through text-based questions. User feedback is used to
evaluate how well the system works, focusing on accuracy, ease of use, and the
quality of responses. The results show that this approach makes object
recognition more interactive and practical, with potential applications in
education, assistive technology, and smart search tools.
In summary, this project shows how combining AI-powered image recognition
and language understanding can improve the way people interact with
technology. Future improvements could include adding real-time detection and
allowing the system to answer more complex questions.
Full-Text Access Notice
In accordance with the NERD Policy on promoting peer-reviewed publication, public access to the full text of a project, thesis or dissertation is restricted for three years, allowing the author and supervisors sufficient time to pursue peer-reviewed publication.
During this period, researchers with legitimate academic or research purposes may request authorisation directly from the author to enable NERD to release the indexed full texts of the work using the form below.