Advanced search
Start date

Semantic Segmentation Using Hourglass Learning Model

Grant number: 19/18678-0
Support Opportunities:Scholarships abroad - Research Internship - Doctorate
Effective date (Start): November 01, 2019
Effective date (End): October 31, 2020
Field of knowledge:Physical Sciences and Mathematics - Computer Science - Computer Systems
Principal Investigator:Gerberth Adín Ramírez Rivera
Grantee:Darwin Danilo Saire Pilco
Supervisor: Tabbone Salvatore Antoine
Host Institution: Instituto de Computação (IC). Universidade Estadual de Campinas (UNICAMP). Campinas , SP, Brazil
Research place: Université de Lorraine (UL), France  
Associated to the scholarship:17/16597-7 - Semantic Segmentation on Videos, BP.DR


Semantic segmentation task aims to create a dense classification by labeling pixel-wise each object present in images or videos. Convolutional neural network (CNN) approaches have been proved useful by exhibiting the best results in this task. Some challenges remain, however, such as the low-resolution of feature maps and the loss of spatial precision, both produced in the CNNs by limited local neighborhoods, i.e., filters with small size and regular shape. How to solve these problems and obtain consistent results is still an open problem: Thus, making semantic segmentation a rather difficult problem even using deep learning models. On the other hand, Graph Neural Networks (GNNs) approach prove the ability to reflect local and global properties on unstructured data, as well as taking into account the irregular connections. In this research project, to solve these problems, we propose to create a deep learning architecture which combines local features extraction of CNNs with the global features extraction of GNNs and their irregular connections between pixels to address the semantic segmentation task on images. Our proposed architecture is end-to-end trainable and extracts local and global information to discriminate between several object classes present in images. In this way, the final result of our proposed architecture is the generation of densely labeled images.

News published in Agência FAPESP Newsletter about the scholarship:
Articles published in other media outlets (0 total):
More itemsLess items

Scientific publications
(References retrieved automatically from Web of Science and SciELO through information on FAPESP grants and their corresponding numbers as mentioned in the publications by the authors)
SAIRE, DARWIN; RIVERA, ADIN RAMIREZ. Global and Local Features Through Gaussian Mixture Models on Image Semantic Segmentation. IEEE ACCESS, v. 10, p. 14-pg., . (19/07257-3, 17/16597-7, 19/18678-0)
SAIRE, DARWIN; RIVERA, ADIN RAMIREZ. Empirical Study of Multi-Task Hourglass Model for Semantic Segmentation Task. IEEE ACCESS, v. 9, p. 80654-80670, . (19/18678-0, 19/07257-3, 17/16597-7)
SAIRE, DARWIN; TABBONE, SALVATORE; IEEE COMP SOC. Documents Counterfeit Detection Through a Deep Learning Approach. 2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), v. N/A, p. 8-pg., . (19/18678-0)

Please report errors in scientific publications list using this form.