Find results with:

Add another field

Search by date

to

Searching collections:

Dartmouth Dissertations

Add or remove collections

Home Dartmouth Dissertations nieuwejaar1996 1

Reference URL

To link to the entire object, paste this link in email, IM or document

To embed the entire object, paste this HTML in website

To link to this page, paste this link in email, IM or document

To embed this page, paste this HTML in website

Galley: a new parallel file system for scientific applications.

you wish to report:

Your comment:

Your Name:

Submit

Cancel

...

Back to top

Powered by CONTENTdm®

Call No.	QA76.58 .N54 1996
Author	Nieuwejaar, Nils
Title	Galley: a new parallel file system for scientific applications.
Date	1996
Abstract	Most current multiprocessor file systems are designed to use multiple disks in parallel, using the high aggregate bandwidth to meet the growing I/O requirements of parallel scientific applications. Most multiprocessor file systems provide applications with a conventional Unix-like interface, allowing the application to access those multiple disks transparently. This interface conceals the parallelism within the file system, increasing the ease of programmability, but making it difficult or impossible for sophisticated application and library programmers to use knowledge about their I/O to exploit that parallelism. In addition to providing an insufficient interface, most current multiprocessor file systems are optimized for a different workload than they are being asked to support. In this work we examine current multiprocessor file systems, as well as how those file systems are used by scientific applications. Contrary to the expectations of the designers of current parallel file systems; the workloads on those systems are dominated by requests to read and write small pieces of data. Furthermore, rather than being accessed sequentially and contiguously, as in uniprocessor and supercomputer workloads, files in multiprocessor file systems are accessed in regular, structured, but non-contiguous patterns. Based on our observations of multiprocessor workloads, we have designed Galley; a new parallel file system that is intended to efficiently support realistic scientific multiprocessor workloads. In this work, we introduce Galley and discuss its design and implementation. We describe Galley''s new three-dimensional file structure and discuss how that structure can be used by parallel applications to achieve higher performance. We introduce several new data-access interfaces, which alloy applications to explicitly describe the regular access patterns we found to be common in parallel file system workloads. We show how these new interfaces allow parallel applications to achieve tremendous increases in I/O performance. Finally, we discuss how Galley''s new file structure and data-access interfaces can be useful in practice.
Description	1 online resource (x, 160 leaves) : illustrations
Format	application/pdf
Advisor	Kotz, David
Subject	Parallel processing (Electronic computers). ; File organization (Computer science). ; Multiprogramming (Electronic computers). ; Multiprocessors.
College	Dartmouth College -- Department of Computer Science.
Issuing Body	Dartmouth Dissertations are made available through the Dartmouth Digital Library.
Degree	Thesis (Ph.D)--Dartmouth College.
Copyright	In Copyright. This material is protected by copyright and/or related rights. You are free to use this material in any way that is permitted by copyright law that applies to your use. For other uses, you need to obtain permission from the rights-holder(s). http://rightsstatements.org/page/InC/1.0/
DOI	https://doi.org/10.1349/ddlp.2848

Title	nieuwejaar1996 1
Full Text	Galley: A New Parallel File System for Scientific Applications A Thesis Submitted to the Faculty in partial fulfillment of the requirements for the degree of Doctor of Philosophy in Computer Science by Nils A. Nieuwejaar Dartmouth College Hanover, New Hampshire November 4, 1996

Find results with:

Searching collections:

Home Dartmouth Dissertations nieuwejaar1996 1

Galley: a new parallel file system for scientific applications.

Object Description

Description

Galley: a new parallel file system for scientific...

Galley: a new parallel file system for scientific...

	All
	Pages Enter page numbers or page ranges separated by commas. For example: 1,3,5-12