• Home
  • Search
  • Distributed file systems for storage and analysis of Next-Generation Sequencing data
  • https://doi.org/10.7490/f1000research.1112971.1Copy DOI Icon

Distributed file systems for storage and analysis of Next-Generation Sequencing data

Show More
  • Abstract
  • Literature Map
  • Similar Papers
Abstract

Analysis of NGS (Next Generation Sequencing) data is a computationally demanding task requiring large amounts of CPU, memory, and disk space. There is also a requirement for high performance data storage systems, resilient to hardware failure, to be connected directly to the computing infrastructure (typically a multi-node cluster) to store large quantities of NGS data reliably. Traditional shared file systems such as NFS (Network File System) do not offer the performance, scalability or cache coherence required by modern NGS data analysis, so alternatives including GlusterFS, Ceph, and Lustre have been developed. However, there is a trade-off between data safety on replicated local storage and degradation of performance across distributed storage. Resilience to hardware failure is typically provided by RAID (Redundant Array of Independent Disks) and redundant storage nodes. Here we describe the evaluation of an alternative file system, RozoFS ( https://github.com/rozofs/rozofs ) for use with demanding NGS data analysis workloads. We used a synthetic data set (DREAM-TCGA data set 3) to run a complete tumor-normal analysis pipeline (“bcbio”, https://github.com/chapmanb/bcbio-nextgen ), including base quality recalibration, local indel realignment, somatic variant calling, and structural variants as a benchmark to compare RozoFS with a traditional shared file system (NFS) on two different HPC (High Performance Computing; Cloud4CaRE project) clusters. Our results show high reliability and good performance of RozoFS compared to NFS, in particular, during heavy I/O workloads. These findings indicate that the reliability and robustness of RozoFS's make it a good candidate for demanding NGS analysis workloads.

Similar Papers
  • Abstract

P842: Unified comprehensive analysis of NGS and optical genome mapping data for constitutional applications using Bionano VIA software

  • Jan 01, 2024
  • Genetics in Medicine Open
  • Zachary Norgaard +4
  • Research Article
  • Citations52

Computational analysis of next generation sequencing data and its applications in clinical oncology

  • Jan 01, 2018
  • Informatics in Medicine Unlocked
  • Rucha M Wadapurkar +1
  • PDF
  • Research Article
  • Citations5

PVT: An Efficient Computational Procedure to Speed up Next-generation Sequence Analysis

  • Jun 04, 2014
  • BMC Bioinformatics
  • Ranjan Kumar Maji +4
  • PDF
  • Research Article
  • Citations3

Evaluation of EPISEQ SARS-CoV-2 and a Fully Integrated Application to Identify SARS-CoV-2 Variants from Several Next-Generation Sequencing Approaches.

  • Jul 29, 2022
  • Viruses
  • Nathalie Mugnier +15
  • PDF
  • Research Article
  • Citations5

Engineering of Src Homology 2 Domain Leading to Sulfotyrosine Recognition With a High Affinity by Integrating a Distinctive Selection Theme and Next-Generation Sequencing

  • Jun 03, 2022
  • Frontiers in Microbiology
  • Dongping Zhao +7
  • Book Chapter
  • Citations4

Bioinformatics in Next-Generation Genome Sequencing

  • Jan 01, 2018
  • Satendra Singh +6
  • Dissertation

Deciphering the mechanisms of genetic disorders by high throughput genomic data

  • Jan 01, 2013
  • Suying Bao
  • Research Article
  • Citations8

Online resources for genomic analysis using high-throughput sequencing.

  • Feb 05, 2015
  • Cold Spring Harbor protocols
  • Daniel Blankenberg +2
  • Research Article

P–582 High level of concordance between invasive and non-invasive preimplantation genetic testing for aneuploidies (niPGT-A) at day5 and day6–7

  • Aug 06, 2021
  • Human Reproduction
  • A Biricik +8
  • Research Article
  • Citations18

Seq2pathway: an R/Bioconductor package for pathway analysis of next-generation sequencing data

  • May 15, 2015
  • Bioinformatics
  • Bin Wang +2
  • Research Article

Taxonomic Diversity and Clinical Correlations in Periapical Lesions by Next-Generation Sequencing Analysis.

  • Jun 30, 2025
  • Genes
  • Juliana D Bronzato +2
  • Conference Article
  • Citations1

Exploring Declustered Software RAID for Enhanced Reliability and Recovery Performance in HPC Storage Systems

  • Oct 01, 2019
  • Zhi Qiao +4
  • Research Article

Abstract 3186: Improved sensitive detection method of FLT3 (FMS-like tyrosine kinase) internal tandem duplication (ITD) mutation using next-generation sequencing technology and nested PCR

  • Jul 15, 2016
  • Cancer Research
  • Daeyoon Kim +8
  • PDF
  • Research Article
  • Citations40

MultiSNV: a probabilistic approach for improving detection of somatic point mutations from multiple related tumour samples.

  • Feb 26, 2015
  • Nucleic Acids Research
  • Malvina Josephidou +2
  • Research Article

Screening of the key genes and signaling pathways for schizophrenia using bioinformatics and next generation sequencing data analysis

  • Dec 18, 2024
  • Italian Journal of Medicine
  • Iranna Kotturshetti +4
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.