• Home
  • Search
  • Constructing collaborative desktop storage caches for large scientific datasets
  • Open Access IconOpen Access
  • Cite Icon72
  • https://doi.org/10.1145/1168910.1168911Copy DOI Icon

Constructing collaborative desktop storage caches for large scientific datasets

Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

High-end computing is suffering a data deluge from experiments, simulations, and apparatus that creates overwhelming application dataset sizes. This has led to the proliferation of high-end mass storage systems, storage area clusters, and data centers. These storage facilities offer a large range of choices in terms of capacity and access rate, as well as strong data availability and consistency support. However, for most end-users, the “last mile” in their analysis pipeline often requires data processing and visualization at local computers, typically local desktop workstations. End-user workstations---despite having more processing power than ever before---are ill-equipped to cope with such data demands due to insufficient secondary storage space and I/O rates. Meanwhile, a large portion of desktop storage is unused.We propose the FreeLoader framework, which aggregates unused desktop storage space and I/O bandwidth into a shared cache/scratch space, for hosting large, immutable datasets and exploiting data access locality. This article presents the FreeLoader architecture, component design, and performance results based on our proof-of-concept prototype. Its architecture comprises contributing benefactor nodes, steered by a management layer, providing services such as data integrity, high performance, load balancing, and impact control. Our experiments show that FreeLoader is an appealing low-cost solution to storing massive datasets by delivering higher data access rates than traditional storage facilities, namely, local or remote shared file systems, storage systems, and Internet data repositories. In particular, we present novel data striping techniques that allow FreeLoader to efficiently aggregate a workstation's network communication bandwidth and local I/O bandwidth. In addition, the performance impact on the native workload of donor machines is small and can be effectively controlled. Further, we show that security features such as data encryptions and integrity checks can be easily added as filters for interested clients. Finally, we demonstrate how legacy applications can use the FreeLoader API to store and retrieve datasets.

Similar Papers
  • Research Article
  • Citations29

Data integrity issues in pharmaceutical industry: Common observations, challenges and mitigations strategies

  • Dec 16, 2022
  • International Journal of Pharmaceutics
  • Naseem A Charoo +2
  • Research Article
  • Citations208

Certificateless public integrity checking of group shared data on cloud storage

  • Jan 01, 2018
  • IEEE Transactions on Services Computing
  • Jiguo Li +2
  • Conference Article
  • Citations1

Incorporating data integrity in gossip based overlay networks

  • Oct 01, 2008
  • S Durr-E-Zehra Naqvi +1
  • Research Article
  • Citations2

A Conceptual Framework for Enhancing Healthcare Data Security Using Blockchain and AI

  • Dec 31, 2024
  • International Journal of Advanced Multidisciplinary Research and Studies
  • Nura Ikhalea +3
  • Conference Article
  • Citations7

EncryScation: A novel framework for cloud IaaS, DaaS security using encryption and Obfuscation techniques

  • Nov 01, 2015
  • Krunal Suthar +1
  • Conference Article

<title>High performance computing with optical interconnects</title>

  • Nov 17, 2000
  • Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE
  • Ted H Szymanski
  • Conference Article

The attack on DDIMT: Dynamic data and indirect mutual trust for cloud computing

  • Dec 01, 2013
  • Xiaowei Gao +1
  • Research Article
  • Citations12

Data integrity verification: a novel approach for cloud computing

  • Mar 01, 2019
  • Sādhanā
  • Rajat Saxena +1
  • Research Article

A Secured Communication between Web Servers in a Network

  • Jun 24, 2010
  • International Journal of Web Technology
  • P.T Kasthuribai +1
  • PDF
  • Book Chapter
  • Citations10

Practical Cryptographic Data Integrity Protection with Full Disk Encryption

  • Jan 01, 2018
  • Milan Brož +2
  • Research Article
  • Citations12

Cryptanalysis of an integrity checking scheme for cloud data sharing

  • Jun 12, 2015
  • Journal of Information Security and Applications
  • Yuan Zhang +4
  • Conference Article
  • Citations8

A Survey on Data Integrity Checking and Enhancing Security for Cloud to Fog Computing

  • Mar 01, 2020
  • K.Uma Maheswari +2
  • PDF
  • Research Article
  • Citations25

DTrace: fine-grained and efficient data integrity checking with hardware instruction tracing

  • Jan 14, 2019
  • Cybersecurity
  • Xiayang Wang +2
  • Book Chapter
  • Citations1

Simulation and Synthesis of SHA-256 Using Verilog HDL for Blockchain Applications

  • Jan 01, 2023
  • Jitendra Goyal +3
  • Conference Article
  • Citations16

A parallelized way to provide data encryption and integrity checking on a processor-memory bus

  • Jan 01, 2006
  • Proceedings - ACM IEEE Design Automation Conference
  • R Elbaz +5
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.