Advanced search
Start date

Adversarial learning in natural language processing

Grant number: 19/02205-5
Support Opportunities:Scholarships in Brazil - Doctorate
Effective date (Start): May 01, 2019
Effective date (End): July 31, 2021
Field of knowledge:Physical Sciences and Mathematics - Computer Science - Computing Methodologies and Techniques
Principal Investigator:João Paulo Papa
Grantee:Gustavo Henrique de Rosa
Host Institution: Faculdade de Ciências (FC). Universidade Estadual Paulista (UNESP). Campus de Bauru. Bauru , SP, Brazil
Associated research grant:14/12236-1 - AnImaLS: Annotation of Images in Large Scale: what can machines and specialists learn from interaction?, AP.TEM


Machine learning techniques have been paramount in the latest years, mainly due to their high effectiveness in computer vision and Natural Language Processing (NLP) problems. Despite their significant discriminatory power, their generative capacities are far from having an ideal performance in specific applications, often related to text-data mining ones. The most significant setback occurs when those techniques are employed with discrete representations such as characters and words sequences. Although some novel works presented feasible solutions to the natural language generation problem, most could not generate a completely `natural´ language, lacking from either morphological, syntactical or semantical knowledge. Furthermore, another recurring issue in the NLP area concerns the scarcity of data to feed deep learning architectures. Popularly used in the image processing field for generating synthetical data, adversarial learning has not yet been developed to a satisfactory point in the text-data area, producing lots of repeated words and even some without semantical significance. Therefore, this present proposal endeavors on fostering forefront research in developing adversarial models in the context of natural language processing. Generative Adversarial Networks (GANs) and Recurrent Neural Networks (RNNs), with particular attention to Gated Recurrent Units (GRUs) and Long Short-Term Memory (LSTMs) architectures, will be studied. This proposal also comprises an internship at Stanford University, United States. (AU)

News published in Agência FAPESP Newsletter about the scholarship:
Articles published in other media outlets (0 total):
More itemsLess items

Scientific publications (5)
(References retrieved automatically from Web of Science and SciELO through information on FAPESP grants and their corresponding numbers as mentioned in the publications by the authors)
DE ROSA, GUSTAVO H.; BREGA, JOSE R. F.; PAPA, JOAO P.. How optimizing perplexity can affect the dimensionality reduction on word embeddings visualization?. SN APPLIED SCIENCES, v. 1, n. 12, . (19/02205-5)
RODER, MATEUS; PASSOS, LEANDRO APARECIDO; DE ROSA, GUSTAVO H.; DE ALBUQUERQUE, VICTOR HUGO C.; PAPA, JOAO PAULO. Reinforcing learning in Deep Belief Networks through nature-inspired optimization. APPLIED SOFT COMPUTING, v. 108, . (19/07825-1, 18/21934-5, 17/25908-6, 19/07665-4, 19/02205-5, 13/07375-0, 14/12236-1)
DE ROSA, GUSTAVO H.; PAPA, JOAO P.. A survey on text generation using generative adversarial networks. PATTERN RECOGNITION, v. 119, . (19/02205-5, 20/12101-0, 14/12236-1, 19/07665-4, 13/07375-0)
DE ROSA, GUSTAVO H.; PAPA, JOAO P.; YANG, XIN-SHE. A nature-inspired feature selection approach based on hypercomplex information. APPLIED SOFT COMPUTING, v. 94, . (13/07375-0, 16/19403-6, 14/12236-1, 17/25908-6, 17/02286-0, 19/02205-5)
Academic Publications
(References retrieved automatically from State of São Paulo Research Institutions)
ROSA, Gustavo Henrique de. Text generation analysis using similarity-based adversarial learning. 2022. Doctoral Thesis - Universidade Estadual Paulista (Unesp). Faculdade de Ciências. Bauru Bauru.

Please report errors in scientific publications list by writing to: