2021
DOI: 10.1155/2021/5375334
|View full text |Cite|
|
Sign up to set email alerts
|

[Retracted] Analyzing the Effect of Masking Length Distribution of MLM: An Evaluation Framework and Case Study on Chinese MRC Datasets

Abstract: Machine reading comprehension (MRC) is a challenging natural language processing (NLP) task. It has a wide application potential in the fields of question answering robots, human-computer interactions in mobile virtual reality systems, etc. Recently, the emergence of pretrained models (PTMs) has brought this research field into a new era, in which the training objective plays a key role. The masked language model (MLM) is a self-supervised training objective widely used in various PTMs. With the development of… Show more

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...
1
1
1

Citation Types

0
4
0

Year Published

2022
2022
2024
2024

Publication Types

Select...
6
1
1

Relationship

0
8

Authors

Journals

citations
Cited by 12 publications
(4 citation statements)
references
References 20 publications
0
4
0
Order By: Relevance
“…Masking strategy indicates the means by which we decide which tokens to mask and which to keep unmasked [53][54][55]. Motivated by the skewed distribution of amino acid tokens in protein sequences in addition to the redundancy in the database, we have tested different means of masking strategies to ensure protein-specific adoption.…”
Section: A Masking Strategymentioning
confidence: 99%
“…Masking strategy indicates the means by which we decide which tokens to mask and which to keep unmasked [53][54][55]. Motivated by the skewed distribution of amino acid tokens in protein sequences in addition to the redundancy in the database, we have tested different means of masking strategies to ensure protein-specific adoption.…”
Section: A Masking Strategymentioning
confidence: 99%
“…Elena and Prokopenko proposed storing audio and video file directories in the file system by using a data table to store the physical paths of the files [21]. To lay a foundation for the later burgeoning of the system and data retrieval and sharing, Zeng and Li proposed standardising the definition and description of teaching resources based on the existing architecture and application, combined with the problems encountered by current teaching resources [22].…”
Section: Related Workmentioning
confidence: 99%
“…At the same time, in this stage, the teaching resources are more targeted, which not only carry out the teaching design from the perspective of teachers but also fully take into account the different learning styles of students. Teaching products are gradually improved, and theory and practice are effectively combined to jointly promote the development of teaching quality [9]. For example, students can carry out self-study activities with the help of multimedia CDs.…”
Section: Introductionmentioning
confidence: 99%