loading
Documents

Research.Publish.Connect.

Paper

Paper Unlock
Distributed File System Based on Erasure Coding for I/O-Intensive Applications

Topics: Cloud Application Scalability and Availability; Cloud Applications Performance and Monitoring; Cloud Ilities (Scalability, Availability, Reliability); Monitoring of Services, Quality of Service, Service Level Agreements; Programming Models, Systems, and Fault-Tolerant Computing; Services Security and Reliability

Authors: Dimitri Pertin 1 ; Sylvain David 2 ; Pierre Evenou 2 ; Benoît Parrein 3 and Nicolas Normand 3

Affiliations: 1 LUNAM Université, Université de Nantes and Fizians SAS, France ; 2 Fizians SAS, France ; 3 LUNAM Université and Université de Nantes, France

ISBN: 978-989-758-019-2

Keyword(s): Distributed File System, RozoFS, Erasure Coding, Mojette Transform, IOzone, Video Editing.

Related Ontology Subjects/Areas/Topics: Cloud Application Scalability and Availability ; Cloud Applications Performance and Monitoring ; Cloud Computing ; Cloud Computing Enabling Technology ; Cloud Ilities (Scalability, Availability, Reliability) ; Monitoring of Services, Quality of Service, Service Level Agreements ; Platforms and Applications ; Programming Models, Systems, and Fault-Tolerant Computing ; Services Science ; Services Security and Reliability

Abstract: Distributed storage systems take advantage of the network, storage and computational resources to provide a scalable infrastructure. But in such large system, failures are frequent and expected. Data replication is the common technique to provide fault-tolerance but suffers from its important storage consumption. Erasure coding is an alternative that offers the same data protection but reduces significantly the storage consumption. As it entails additional workload, current storage providers limit its use for longterm storage. We present the Mojette Transform (MT), an erasure code whose computations rely on fast XOR operations. The MT is part of RozoFS, a distributed file system that provides a global namespace relying on a cluster of storage nodes. This work is part of our ongoing effort to prove that erasure coding is not necessarily a bottleneck for intense I/O applications. In order to validate our approach, we consider a case study involving a storage cluster of RozoFS that suppo rts video editing as an I/O intensive application. (More)

PDF ImageFull Text

Download
Sign In Guest: Register as new SciTePress user now for free.

Sign In SciTePress user: please login.

PDF ImageMy Papers

You are not signed in, therefore limits apply to your IP address 54.226.102.115

In the current month:
Recent papers: 100 available of 100 total
2+ years older papers: 200 available of 200 total

Paper citation in several formats:
Pertin, D.; David, S.; Evenou, P.; Parrein, B. and Normand, N. (2014). Distributed File System Based on Erasure Coding for I/O-Intensive Applications.In Proceedings of the 4th International Conference on Cloud Computing and Services Science - Volume 1: CLOSER, ISBN 978-989-758-019-2, pages 451-456. DOI: 10.5220/0004960604510456

@conference{closer14,
author={Dimitri Pertin. and Sylvain David. and Pierre Evenou. and Benoît Parrein. and Nicolas Normand.},
title={Distributed File System Based on Erasure Coding for I/O-Intensive Applications},
booktitle={Proceedings of the 4th International Conference on Cloud Computing and Services Science - Volume 1: CLOSER,},
year={2014},
pages={451-456},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004960604510456},
isbn={978-989-758-019-2},
}

TY - CONF

JO - Proceedings of the 4th International Conference on Cloud Computing and Services Science - Volume 1: CLOSER,
TI - Distributed File System Based on Erasure Coding for I/O-Intensive Applications
SN - 978-989-758-019-2
AU - Pertin, D.
AU - David, S.
AU - Evenou, P.
AU - Parrein, B.
AU - Normand, N.
PY - 2014
SP - 451
EP - 456
DO - 10.5220/0004960604510456

Login or register to post comments.

Comments on this Paper: Be the first to review this paper.