Improving BERT-Based Text Classification With Auxiliary Sentence and Domain Knowledge

General language model BERT pre-trained on cross-domain text corpus, BookCorpus and Wikipedia, achieves excellent performance on a couple of natural language processing tasks through the way of fine-tuning in the downstream tasks. But it still lacks of task-specific knowledge and domain-related know...

Full description

Saved in:

Bibliographic Details
Published in:	IEEE access Vol. 7; pp. 176600 - 176612
Main Authors:	Yu, Shanshan, Su, Jindian, Luo, Da
Format:	Journal Article
Language:	English
Published:	Piscataway IEEE 2019 The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subjects:	bidirectional encoder representations from transformer Bit error rate Classification Context modeling Datasets Domains language model Natural language processing neural networks Sentences State vectors Task analysis Text categorization text classification Training Training data
Online Access:	Get full text
Tags:	Add Tag No Tags, Be the first to tag this record!

Be the first to leave a comment!