loading
Papers Papers/2022 Papers Papers/2022

Research.Publish.Connect.

Paper

Paper Unlock

Authors: Abhinay Pandya and Mourad Oussalah

Affiliation: University of Oulu, Finland

Keyword(s): Sentiment Analysis, Deep Learning, Information Retrieval, Text Mining.

Related Ontology Subjects/Areas/Topics: Artificial Intelligence ; Computational Intelligence ; Evolutionary Computing ; Knowledge Discovery and Information Retrieval ; Knowledge-Based Systems ; Machine Learning ; Mining Text and Semi-Structured Data ; Soft Computing ; Symbolic Systems ; Web Mining

Abstract: Unsupervised learning of distributed representations (word embeddings) obviates the need for task-specific feature engineering for various NLP applications. However, such representations learned from massive text datasets do not faithfully represent finer semantic information in the feature space required by specific applications. This is owing to the fact that (a) models learning such representations ignore the linguistic structure of the sentences, (b) they fail to capture \textit{polysemous} usages of the words, and (c) they ignore pre-existing semantic information from manually-created ontologies. In this paper, we propose three semantics-based distributed representations of words and phrases as features for message polarity classification: Sentiment-Specific Multi-Word Expressions Embeddings(SSMWE) are sentiment encoded distributed representations of \textit{multi-word expressions (MWEs)}; Sense-Disambiguated Word Embeddings(SDWE) are sense-specific distributed representations of words; and WordNet embeddings(WNE) are distributed representations of hypernym and hyponym of the correct sense of a given word. We examine the effects of these features incorporated in a convolutional neural network(CNN) model for evaluation on the SemEval benchmarked dataset. Our approach of using these novel features yields 14.24\% improvement in the macro-averaged F1 score on SemEval datasets over existing methods. While we have shown promising results in twitter sentiment classification, we believe that the method is general enough to be applied to many NLP applications where finer semantic analysis is required. (More)

CC BY-NC-ND 4.0

Sign In Guest: Register as new SciTePress user now for free.

Sign In SciTePress user: please login.

PDF ImageMy Papers

You are not signed in, therefore limits apply to your IP address 44.204.164.147

In the current month:
Recent papers: 100 available of 100 total
2+ years older papers: 200 available of 200 total

Paper citation in several formats:
Pandya, A. and Oussalah, M. (2017). Novel Semantics-based Distributed Representations for Message Polarity Classification using Deep Convolutional Neural Networks. In Proceedings of the 9th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management (IC3K 2017) - KDIR; ISBN 978-989-758-271-4; ISSN 2184-3228, SciTePress, pages 71-82. DOI: 10.5220/0006500800710082

@conference{kdir17,
author={Abhinay Pandya. and Mourad Oussalah.},
title={Novel Semantics-based Distributed Representations for Message Polarity Classification using Deep Convolutional Neural Networks},
booktitle={Proceedings of the 9th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management (IC3K 2017) - KDIR},
year={2017},
pages={71-82},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006500800710082},
isbn={978-989-758-271-4},
issn={2184-3228},
}

TY - CONF

JO - Proceedings of the 9th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management (IC3K 2017) - KDIR
TI - Novel Semantics-based Distributed Representations for Message Polarity Classification using Deep Convolutional Neural Networks
SN - 978-989-758-271-4
IS - 2184-3228
AU - Pandya, A.
AU - Oussalah, M.
PY - 2017
SP - 71
EP - 82
DO - 10.5220/0006500800710082
PB - SciTePress