2021
DOI: 10.48550/arxiv.2108.06614
|View full text |Cite
Preprint
|
Sign up to set email alerts
|

The SelectGen Challenge: Finding the Best Training Samples for Few-Shot Neural Text Generation

Ernie Chang,
Xiaoyu Shen,
Alex Marin
et al.

Abstract: We propose a shared task on training instance selection for few-shot neural text generation. Large-scale pretrained language models have led to dramatic improvements in few-shot text generation. Nonetheless, almost all previous work simply applies random sampling to select the few-shot training instances. Little to no attention has been paid to the selection strategies and how they would affect model performance.The study of the selection strategy can help us to (1) make the most use of our annotation budget i… Show more

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...
1

Citation Types

0
1
0

Publication Types

Select...
1

Relationship

0
1

Authors

Journals

citations
Cited by 1 publication
(1 citation statement)
references
References 19 publications
0
1
0
Order By: Relevance
“…Repeating this process for all languages is infeasible, as most low-resource languages do not have enough conversational data to support this type of training (Zhao et al, 2020;. Even for high-resource languages, collecting sufficient amount of high-quality data to cover various domains is still costly (Xu et al, 2020;Chang et al, 2021). Therefore, we believe crosslingual transfer is crucial for efficiently developing chatbots in multiple languages, through which the same resource can be reused across languages.…”
Section: Introductionmentioning
confidence: 99%
“…Repeating this process for all languages is infeasible, as most low-resource languages do not have enough conversational data to support this type of training (Zhao et al, 2020;. Even for high-resource languages, collecting sufficient amount of high-quality data to cover various domains is still costly (Xu et al, 2020;Chang et al, 2021). Therefore, we believe crosslingual transfer is crucial for efficiently developing chatbots in multiple languages, through which the same resource can be reused across languages.…”
Section: Introductionmentioning
confidence: 99%