Samothrakis, S and Vodopivec, T and Fairbank, M and Fasli, M (2017) Convolutional-Match Networks for Question Answering. In: International Joint Conference on Artificial Intelligence (IJCAI), 2017-08-19 - 2017-08-25, Melbourne.
Samothrakis, S and Vodopivec, T and Fairbank, M and Fasli, M (2017) Convolutional-Match Networks for Question Answering. In: International Joint Conference on Artificial Intelligence (IJCAI), 2017-08-19 - 2017-08-25, Melbourne.
Samothrakis, S and Vodopivec, T and Fairbank, M and Fasli, M (2017) Convolutional-Match Networks for Question Answering. In: International Joint Conference on Artificial Intelligence (IJCAI), 2017-08-19 - 2017-08-25, Melbourne.
Abstract
In this paper, we present a simple, yet effective, attention and memory mechanism that is reminis- cent of Memory Networks and we demonstrate it in question-answering scenarios. Our mechanism is based on four simple premises: a) memories can be formed from word sequences by using convo- lutional networks; b) distance measurements can be taken at a neuronal level; c) a recursive soft- max function can be used for attention; d) extensive weight sharing can help profoundly. We achieve state-of-the-art results in the bAbI tasks, outper- forming Memory Networks and the Differentiable Neural Computer, both in terms of accuracy and stability (i.e. variance) of results.
Item Type: | Conference or Workshop Item (Paper) |
---|---|
Additional Information: | Published proceedings: Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence |
Uncontrolled Keywords: | Machine Learning: Neural Networks; Machine Learning: Deep Learning |
Subjects: | Q Science > QA Mathematics > QA75 Electronic computers. Computer science |
Divisions: | Faculty of Science and Health Faculty of Science and Health > Computer Science and Electronic Engineering, School of |
SWORD Depositor: | Unnamed user with email elements@essex.ac.uk |
Depositing User: | Unnamed user with email elements@essex.ac.uk |
Date Deposited: | 29 Sep 2017 13:03 |
Last Modified: | 03 Jun 2024 15:02 |
URI: | http://repository.essex.ac.uk/id/eprint/20402 |
Available files
Filename: 0374.pdf