MRNN: A Multi-Resolution Neural Network with Duplex Attention for Deep Ad-Hoc Retrieval

Tolgahan Cakaloglu, Tolgahan Cakaloglu, Xiaowei Xu, Roshith Raghavan

2023

Abstract

The primary goal of ad-hoc retrieval is to find relevant documents satisfying the information need posted by a natural language query. It requires a good understanding of the query and all the documents in a corpus, which is difficult because the meaning of natural language texts depends on the context, syntax, and semantics. Recently deep neural networks have been used to rank search results in response to a query. In this paper, we devise a multi-resolution neural network (MRNN) to leverage the whole hierarchy of representations for ad-hoc retrieval. The proposed MRNN model is capable of deriving a representation that integrates representations of different levels of abstraction from all the layers of the learned hierarchical representation. Moreover, a duplex attention component is designed to refine the multi-resolution representation so that an optimal context for matching the query and document can be determined. More specifically the first attention mechanism determines optimal context from the learned multi-resolution representation for the query and document. The latter attention mechanism aims to fine-tune the representation so that the query and the relevant document are closer in proximity. The empirical study shows that MRNN with the duplex attention is significantly superior to existing models used for ad-hoc retrieval on benchmark datasets including SQuAD, WikiQA, QUASAR, and TrecQA.

Paper Citation

in Harvard Style

Cakaloglu T., Xu X. and Raghavan R. (2023). MRNN: A Multi-Resolution Neural Network with Duplex Attention for Deep Ad-Hoc Retrieval. In Proceedings of the 15th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART, ISBN 978-989-758-623-1, pages 466-477. DOI: 10.5220/0011896300003393

in Bibtex Style

@conference{icaart23,
author={Tolgahan Cakaloglu and Xiaowei Xu and Roshith Raghavan},
title={MRNN: A Multi-Resolution Neural Network with Duplex Attention for Deep Ad-Hoc Retrieval},
booktitle={Proceedings of the 15th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART,},
year={2023},
pages={466-477},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0011896300003393},
isbn={978-989-758-623-1},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 15th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART,
TI - MRNN: A Multi-Resolution Neural Network with Duplex Attention for Deep Ad-Hoc Retrieval
SN - 978-989-758-623-1
AU - Cakaloglu T.
AU - Xu X.
AU - Raghavan R.
PY - 2023
SP - 466
EP - 477
DO - 10.5220/0011896300003393