データ駆動型サイエンス創造センター

Talk

Events

2023.01.23
Talk

DSC talk in January

Assoc. Prof. Hidetaka Kamigaito gave a lecture in January.

The details are as follows.

 

====================

Assoc. Prof. Hidetaka Kamigaito (Natural Language Processing Laboratory)

TITLE: Recent Advances of Negative Sampling in Natural Language Processing

Abstract:

In natural language processing (NLP), models often learn a large number of labels, such as words and phrases. Therefore, loss based on negative sampling (NS) loss, which can approximately reduce the number of labels during training, plays an important role in reducing computational costs. In this presentation, I’ll introduce NS loss, used in various NLP tasks with other loss functions that play similar roles, and their recent applications.