Advanced search
Start date

Assist - telepresence application with augmented reality for remote support

Grant number: 18/21817-9
Support Opportunities:Research Grants - Innovative Research in Small Business - PIPE
Duration: August 01, 2019 - March 31, 2020
Field of knowledge:Physical Sciences and Mathematics - Computer Science
Principal Investigator:Marcelo Aparecido Pelegrini
Grantee:Marcelo Aparecido Pelegrini
Host Company:Sense Plus Consultoria e Desenvolvimento Ltda
CNAE: Desenvolvimento e licenciamento de programas de computador customizáveis
Desenvolvimento e licenciamento de programas de computador não-customizáveis
Pesquisa e desenvolvimento experimental em ciências físicas e naturais
City: São Paulo
Associated scholarship(s):19/18011-5 - Developing an experimental telepresence system with augmented reality interactions, BP.TT


The main challenge face by field workers is the lack of information and/or experience to develop the activities. In critical moments, an efficient communication with supervisors and specialists is essential. However, the communication is not always effective because the supervisor has difficulty on understanding the situation the field worker is facing. This proposal objective is demonstrating the technological viability of a product that applies Augmented (AR) and real time video calls by adapting de Visual Simultaneous Localization and Mapping (SLAM) technologies to solve the problem. Another project objective is prove that is feasible to deploy the solution in lower costs devices that do not have a depth sensor, replacing hardware capabilities by software functionalities. The proposed methodology comprehend adjusting a Visual SLAM algorithm form a third party software development kit (SDK) to map real environments captured by the camera and transmitted through video calls. We will compare the performance of the mapping with applications in hardware that use depth sensors. The developed prototype must allow movement without losing AR information. As a result, we expect to achieve a prototype with same mapping technologies maturity level as international product, but allowing the use of lower cost Smart Glasses. From functional perspective, we will have a tool that allows video calls with supervisor visualizing the environment seen by the field worker and AR interactions. Our approach finds application in any company that has fieldwork and presents need for communication with remote sites. The application allows flexibility for information access and restrict knowledge. That includes industries such as manufacturing, civil construction, utilities, oil& gas, telecommunications, transportation, and others. Duo to the diversity of applications, it is possible to assume that the market for the product is extremely attractive. Developing this product represents a unique opportunity for Brazilian market to have access to a product with advanced AR capabilities, with Portuguese language and local support. As international companies with similar products did not demonstrate interest in bringing solutions to Brazil in short-term. Brazilian companies have the opportunity to stablish themselves as specialists and suppliers and to achieve a considerable market share for this type of solutions. (AU)

Articles published in Agência FAPESP Newsletter about the research grant:
Articles published in other media outlets (0 total):
More itemsLess items

Please report errors in scientific publications list using this form.