Integrating Collective I/O and Cooperative Caching into the Clusterfile Parallel File System

  • Name:

    Konferenzartikel 

  • Author:

    Walter F. Tichy, Guido Malpohl, Vlad Olaru, Florin Isailă 

  • Zusammenfassung

    This paper presents the integration of two collective I/O techniques into the Clusterfile parallel file system: disk-directed I/O and two-phase I/O. We show that global cooperative cache management improves the collective I/O performance. The solution focuses on integrating disk parallelism with other types of parallelism: memory (by buffering and caching on several nodes), network (by parallel I/O scheduling strategies) and processors (by redistributing the I/O related computation over several nodes). The performance results show considerable throughput increases over ROMIO&#8217s extended two-phase I/O.
  • Year:

    2004 

  • Links:
Beteiligte Mitarbeiter (zufällige Reihenfolge)
Titel Vorname Nachname
Prof. em. Dr. Walter F. Tichy
Dr. Vlad Olaru
Dr. Guido Malpohl
Dr. Florin Isailă

Bibtex

@inproceedings{,
author={Walter F. Tichy, Guido Malpohl, Vlad Olaru, Florin Isail{\ua}},
title={Integrating Collective I/O and Cooperative Caching into the Clusterfile Parallel File System},
year=2004,
month=Nov,
booktitle={Proc. Of ACM International Conference on Supercomputing (ICS)},
url={https://ps.ipd.kit.edu/downloads/ka_2004_integrating_collective_io_cooperative_caching.pdf},
abstract={This paper presents the integration of two collective I/O techniques into the Clusterfile parallel file system: disk-directed I/O and two-phase I/O. We show that global cooperative cache management improves the collective I/O performance. The solution focuses on integrating disk parallelism with other types of parallelism: memory (by buffering and caching on several nodes), network (by parallel I/O scheduling strategies) and processors (by redistributing the I/O related computation over several nodes). The performance results show considerable throughput increases over ROMIO&#8217s extended two-phase I/O.},
}