Advanced search
Start date

Robotic inspection system using RGB-D camera

Grant number: 23/06578-6
Support Opportunities:Scholarships in Brazil - Scientific Initiation
Effective date (Start): October 01, 2023
Effective date (End): June 30, 2024
Field of knowledge:Engineering - Electrical Engineering - Industrial Electronics, Electronic Systems and Controls
Principal Investigator:Roberto Santos Inoue
Grantee:Joao Carlos Tonon Campi
Host Institution: Centro de Ciências Exatas e de Tecnologia (CCET). Universidade Federal de São Carlos (UFSCAR). São Carlos , SP, Brazil


Inspection indoor environments is increasingly important, given its usefulness in finding simple faults or even those that pose an imminent danger to the people involved. Still aiming at safety and optimization, robotic platforms are used in this task, enabling inspection in unhealthy and toxic environments to the quality of human life. This requires simultaneous location and mapping (SLAM) and object detection techniques. Thus, this project proposes developing a robotic inspection system using RGB-D cameras, generating maps of the inspected environments and signaling the objects of interest in the study. Mapping will be carried out using open-access ROS packages, both in two and three dimensions, depending on feasibility, using the Point Cloud data from the camera. As for object detection, the camera images will be processed by a convolutional neural network called YOLO, providing the detection reliability and the image coordinates, in which, together with the depth information, the spatial position of the object detection is found, and the marking on the map is performed. The project results will be evaluated through metrics related to object detection accuracy, using the average AP accuracy and the average mAP average accuracy and metrics related to filling and marking objects on the map. The inspections will be carried out in the department's internal environments, detecting common everyday objects at first, such as doors, emergency exits, and fire extinguishers.

News published in Agência FAPESP Newsletter about the scholarship:
Articles published in other media outlets (0 total):
More itemsLess items

Please report errors in scientific publications list using this form.