papers-kmrc.md

Papers on Knowledge-based Machine Reading Comprehension.

A list of recent papers about Knowledge-based Machine Reading Comprehension (KMRC).

Contributed by Luxi Xing, Yuqiang Xie and Wei Peng.

Institute of Information Engineering, Chinese Academy of Sciences, Beijing, China.

Update on Nov. 7, 2021.

---

Content

1. Cloze Style Tasks
2. Span Extraction Tasks
3. Multiple Choice Tasks
4. Generation Tasks

Cloze Style Tasks

Title	Publish	Tasks	Links
Reasoning with Heterogeneous Knowledge for Commonsense Machine Comprehension	ACL 2017	SCT	paper
World Knowledge for Reading Comprehension: Rare Entity Prediction with Hierarchical LSTMs Using External Descriptions	EMNLP 2017	Rare Entity Prediction	paper
Knowledgeable Reader: Enhancing Cloze-Style Reading Comprehension with External Commonsense Knowledge	ACL 2018	Common Nouns	paper note
A Multi-Attention based Neural Network with External Knowledge for Story Ending Predicting Task	COLING 2018	SCT	paper
Incorporating Structured Commonsense Knowledge in Story Completion	AAAI 2018	SCT	paper
Story Ending Prediction by Transferable BERT	IJCAI 2019	SCT	paper
Toward Better Storylines with Sentence-Level Language Models	ACL 2020	SCT	paper

Span Extraction Tasks

Title	Publish	Tasks	Links
Dynamic Integration of Background Knowledge in Neural NLU Systems	2018	SQuAD/ TriviaQA	paper note
Explicit Utilization of General Knowledge in Machine Reading Comprehension	ACL 2019	SQuAD	paper note
Enhancing Pre-Trained Language Representations with Rich Knowledge for Machine Reading Comprehension	ACL 2019	SQuAD/ ReCoRD	paper note
Machine Reading Comprehension Using Structural Knowledge Graph-aware Network	EMNLP 2019 short	ReCoRD	paper
+ SG-Net: Syntax-Guided Machine Reading Comprehension	AAAI 2020	SQuAD2.0 RACE	paper
+ Semantics-aware BERT for Language Understanding	AAAI 2020	SQuAD2.0	paper
+ Entities as Experts: Sparse Memory Access with Entity Supervision	2020	TriviaQA	paper
+ Semantics-Aware Inferential Network for Natural Language Understanding	2020	*	paper

• + indicates works regarding injecting knowledge to improve performance on the datasets not included in this summary.

Multiple Choice Tasks

Title	Publish	Tasks	Links
Yuanfudao at SemEval-2018 Task 11: Three-way Attention and Relational Knowledge for Commonsense Machine Comprehension	SemEval 2018	SemEval-2018 Task 11	paper code
Improving Question Answering by Commonsense-Based Pre-Training	AAAI 2019	ARC/ OpenBookQA/ SemEval-2018 Task 11	paper
Improving Machine Reading Comprehension with General Reading Strategies	NAACL 2019	ARC/ OpenBookQA/ MCTest/ SemEval-2018 Task 11/ SCT/ MultiRC	paper code
Ranking and Selecting Multi-Hop Knowledge Paths to Better Predict Human Needs	NAACL 2019	story commonsense	paper code
Incorporating Relation Knowledge into Commonsense Reading Comprehension with Multi-task Learning	CIKM 2019	SemEval-2018 Task 11 / SCT	paper
Explain Yourself! Leveraging Language Models for Commonsense Reasoning	ACL 2019	CSQA	paper code note
Careful Selection of Knowledge to solve Open Book Question Answering	ACL 2019	OpenBookQA	paper
Improving Question Answering with External Knowledge	EMNLP MRQA 2019	ARC/ OpenBookQA	paper note
KagNet: Knowledge-Aware Graph Networks for Commonsense Reasoning	EMNLP 2019	CSQA	paper code note
What’s Missing: A Knowledge Gap Guided Approach for Multi-hop Question Answering	EMNLP 2019	OpenBookQA	paper note
BIG MOOD: Relating Transformers to Explicit Commonsense Knowledge	EMNLP COIN 2019	MCScripts v2	paper
Align, Mask and Select: A Simple Method for Incorporating Commonsense Knowledge into Language Representation Models	2019	CSQA WSC	paper
Abductive Reasoning as Self-Supervision for Common Sense Question Answering	2019	Swag HellaSwag	paper
Exploring ways to incorporate additional knowledge to improve Natural Language Commonsense Question Answering	2019	ANLI/ SocialIQA	paper note
Graph-Based Reasoning over Heterogeneous External Knowledge for Commonsense Question Answering	AAAI 2020	CSQA	paper note
K-ADAPTER: Infusing Knowledge into Pre-Trained Models with Adapters	2020	CosmosQA	paper note
Unsupervised Commonsense Question Answering with Self-Talk	2020	CSQA SIQA	paper note
L2R2: Leveraging Ranking for Abductive Reasoning	SIGIR 2020	ANLI	paper
Unsupervised Alignment-based Iterative Evidence Retrieval for Multi-hop Question Answering	ACL 2020	MultiRC QASC	paper
Logic-Guided Data Augmentation and Regularization for Consistent Question Answering	ACL 2020	WIQA QuaREL	paper
A Frame-based Sentence Representation for Machine Reading Comprehension	ACL 2020	MCTest	paper
Incorporating Syntax and Frame Semantics in Neural Network for Machine Reading Comprehension	COLING 2020	MCTest	paper
Connecting the Dots: A Knowledgeable Path Generator for Commonsense Question Answering	2020	CSQA OBQA	paper
Fusing Context Into Knowledge Graph for Commonsense Reasoning	2020	CSQA	paper
QA-GNN: Reasoning with Language Models and Knowledge Graphs for Question Answering	NAACL 2021	CSQA OBQA	[paper]
Generated Knowledge Prompting for Commonsense Reasoning	2021	CSQA QASC CSQA2	paper
GNN is a Counter? Revisiting GNN for Question Answering	2021	CSQA OBQA	paper

Generation Tasks

Also known as Free-form Answer Tasks

Title	Publish	Tasks	Links
Commonsense for Generative Multi-Hop Question Answering Tasks	EMNLP 2018	NarrativeQA/ WikiHop	paper code note
COMET: Commonsense Transformers for Automatic Knowledge Graph Construction	ACL 2019	Atomic	paper code note
Incorporating External Knowledge into Machine Reading for Generative Question Answering	EMNLP 2019	MS MARCO	paper note
Modeling Event Background for If-Then Commonsense Reasoning Using Context-aware Variational Autoencoder	EMNLP 2019	Event2Mind	paper
Dynamic Knowledge Graph Construction for Zero-shot Commonsense Question Answering	2019	SocialIQA StoryCommonsense	paper
Injecting Numerical Reasoning Skills into Language Models	ACL 2020	DROP	paper

Other Paper List About MRC

thunlp/RCPapers