loading
Documents

Research.Publish.Connect.

Paper

Paper Unlock

Authors: Kunal Mukerjee ; Todd Porter and Sorin Gherman

Affiliation: Microsoft, United States

ISBN: 978-989-8425-79-9

Keyword(s): Semantic mining, Documents, Full text search, SQL Server.

Related Ontology Subjects/Areas/Topics: Artificial Intelligence ; Concept Mining ; Context Discovery ; Foundations of Knowledge Discovery in Databases ; Information Extraction ; Knowledge Discovery and Information Retrieval ; Knowledge-Based Systems ; Mining Text and Semi-Structured Data ; Symbolic Systems

Abstract: Automatically mining entities, relationships, and semantics from unstructured documents and storing these in relational tables, greatly simplifies and unifies the work flows and user experiences of database products at the Enterprise. This paper describes three linear scale, incremental, and fully automatic semantic mining algorithms that are at the foundation of the new Semantic Platform being released in the next version of SQL Server. The target workload is large (10 – 100 million) enterprise document corpuses. At these scales, anything short of linear scale and incremental is costly to deploy. These three algorithms give rise to three weighted physical indexes: Tag Index (top keywords in each document); Document Similarity Index (top closely related documents given any document); and Phrase Similarity Index (top semantically related phrases, given any phrase), which are then query-able through the SQL interface. The need for specifically creating these three indexes was motivated by observing typical stages of document research, and gap analysis, given current tools and technology at the Enterprise. We describe the mining algorithms and architecture, and outline some compelling user experiences that are enabled by these indexes. (More)

PDF ImageFull Text

Download
Sign In Guest: Register as new SciTePress user now for free.

Sign In SciTePress user: please login.

PDF ImageMy Papers

You are not signed in, therefore limits apply to your IP address 54.161.118.57

In the current month:
Recent papers: 100 available of 100 total
2+ years older papers: 200 available of 200 total

Paper citation in several formats:
Mukerjee, K.; Porter, T. and Gherman, S. (2011). SEMANTIC MINING OF DOCUMENTS IN A RELATIONAL DATABASE.In Proceedings of the International Conference on Knowledge Discovery and Information Retrieval - Volume 1: KDIR, (IC3K 2011) ISBN 978-989-8425-79-9, pages 138-150. DOI: 10.5220/0003631401460158

@conference{kdir11,
author={Kunal Mukerjee. and Todd Porter. and Sorin Gherman.},
title={SEMANTIC MINING OF DOCUMENTS IN A RELATIONAL DATABASE},
booktitle={Proceedings of the International Conference on Knowledge Discovery and Information Retrieval - Volume 1: KDIR, (IC3K 2011)},
year={2011},
pages={138-150},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003631401460158},
isbn={978-989-8425-79-9},
}

TY - CONF

JO - Proceedings of the International Conference on Knowledge Discovery and Information Retrieval - Volume 1: KDIR, (IC3K 2011)
TI - SEMANTIC MINING OF DOCUMENTS IN A RELATIONAL DATABASE
SN - 978-989-8425-79-9
AU - Mukerjee, K.
AU - Porter, T.
AU - Gherman, S.
PY - 2011
SP - 138
EP - 150
DO - 10.5220/0003631401460158

Login or register to post comments.

Comments on this Paper: Be the first to review this paper.