Position-Aware Neural Attentive Graph Networks for Question Answering (2021)

Authors: Ege Ersü, Yifu Qiu, Anda Zhou


GitHub Repository


Recently there has been considerable interest in applying Graph Neural Networks (GNN) to Multi-hop Question Answering (QA) tasks, as graph representations can explicitly express rich dependencies in language. However, graph representations suffer from the loss of sequential information and the difficulty of representing global semantic information. In this work, we propose the query-attention mechanism to enhance the GNN-QA system by utilizing both global and local contextual information. We also explore injecting the positional information into the graph to complement the sequential information. Our experiments are conducted on the WikiHop dataset to allow direction comparison with Entity Relational-Graph Convolutional Networks. Our contributions identify the existence of position bias in the dataset, and we further conduct ablation studies to confirm that our proposed modules improve the generalization accuracy by 1.43%.



Required Pretrained Models

How to run