• Home
  • Search
  • Performance-Aware Data Placement in Hybrid Parallel File Systems
  • Cite Icon16
  • https://doi.org/10.1007/978-3-319-11197-1_43Copy DOI Icon

Performance-Aware Data Placement in Hybrid Parallel File Systems

  • Jan 1, 2014
  • Shuibing He +3 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Hybrid parallel file systems (PFS), which consist of both HDD and SSD servers, provide a promising solution for data-intensive applications. In this study, we propose a performance-aware data placement (PADP) strategy to enable efficient data layout in hybrid PFSs. The basic idea of PADP is to dispatch data on different file servers with adaptive varied-size file stripes based on the server storage performance. By using an effective data access cost model and a linear programming optimization method, the appropriate stripe sizes for each file server are determined effectively. We have implemented PADP within OrangeFS, a widely used parallel file system in HPC domain. Experimental results of representative benchmark show that PADP can significantly improve the I/O performance of hybrid PFSs.KeywordsParallel I/O SystemParallel File systemSolid State Drive

Similar Papers
  • Book Chapter
  • Citations6

Power Consumption Constrained Task Scheduling Using Enhanced Genetic Algorithms

  • Jan 01, 2013
  • Gang Shen +1
  • Research Article

PENGEMBANGAN MODEL MATEMATIKA JARINGAN SUPPLY CHAIN DENGAN MEMPERTIMBANGKAN EMISI PADA INDUSTRI DAUR ULANG KERTAS

  • Aug 30, 2017
  • Jurnal Teknosains
  • Asgar Ali +1
  • Conference Article
  • Citations59

Efficient structured data access in parallel file systems

  • Jan 01, 2003
  • Ching +4
  • Conference Article
  • Citations6

Genetic algorithm based scheduling method for lifespan extension of a wireless sensors network

  • Sep 01, 2015
  • Yousif Elhadi Elsideeg Ahmed +3
  • Conference Article
  • Citations11

Improving Real-Time Feasibility Analysis for Use in Linear Optimization Methods

  • Jul 01, 2010
  • Haibo Zeng +1
  • Conference Article
  • Citations4

Virtualization-based bandwidth management for parallel storage systems

  • Nov 01, 2010
  • Yiqi Xu +5
  • Conference Article
  • Citations5

On the performance of the POSIX I/O interface to PVFS

  • Jan 01, 2004
  • Murali Vilayannur +5
  • Book Chapter
  • Citations1

Characterizing I/O Optimization Effect Through Holistic Log Data Analysis of Parallel File Systems and Interconnects

  • Jan 01, 2020
  • Yuichi Tsujita +4
  • Conference Article

MulConn: User-Transparent I/O Subsystem for High-Performance Parallel File Systems

  • Dec 01, 2021
  • Hwajung Kim +5
  • Conference Article
  • Citations12

Fingerprinting the Checker Policies of Parallel File Systems

  • Nov 01, 2020
  • Runzhou Han +2
  • Conference Article
  • Citations2

A Technique for Lock-Less Mirroring in Parallel File Systems

  • May 01, 2008
  • Bradley W Settlemyer +1
  • Research Article
  • Citations4

Fine-grained management of I/O optimizations based on workload characteristics

  • Dec 31, 2020
  • Frontiers of Computer Science
  • Bing Wei +5
  • Conference Article
  • Citations3

StageFS: A Parallel File System Optimizing Metadata Performance for SSD Based Clusters

  • Aug 01, 2016
  • Huijun Wu +4
  • Conference Article
  • Citations540

Design, Modeling, and Evaluation of a Scalable Multi-level Checkpointing System

  • Nov 01, 2010
  • Adam Moody +3
  • Research Article
  • Citations32

Detailed Modeling and Evaluation of a Scalable Multilevel Checkpointing System

  • Sep 01, 2014
  • IEEE Transactions on Parallel and Distributed Systems
  • Kathryn Mohror +3
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.