Enhanced Web Page Cleaning for Constructing Social Media Text Corpora

Neunerdt, Melanie; Reimer, Eva; Reyer, Michael; Mathar, Rudolf

doi:10.1007/978-3-662-46578-3_78

Search citation statements

Order By: Relevance

Paper Sections

Select...

Related Work1

Citation Types

Supporting

Mentioning

Contrasting

Year Published

2016

2022

Publication Types

Select...

Other2

Article1

Relationship

Self Cite0

Independent3

Authors

Journals

Cited by 3 publications

(1 citation statement)

References 2 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Sequence-labeling methods, such as Conditional Random Field (CRF) [15], [16], use relations between neighboring text blocks to jointly decode the best chain of labels for text blocks. To enrich conventional features, a CNN model may be added to sequence labeling.…”

Section: Related Workmentioning

confidence: 99%

Boilerplate Detection via Semantic Classification of TextBlocks

Zhang

Wang

2021

2021 International Joint Conference on Neural Networks (IJCNN)

View full text Add to dashboard Cite

We present a hierarchical neural network model called SemText to detect HTML boilerplate based on a novel semantic representation of text blocks. We train SemText on three published datasets of news webpages and fine-tune it using a small number of development data in CleanEval and GoogleTrends-2017. We show that SemText achieves the stateof-the-art accuracy on these datasets. We then demonstrate the robustness of SemText by showing that it also detects boilerplate effectively on out-of-domain community-based Q&A webpages.

show abstract

Section: Related Workmentioning

confidence: 99%