Results 1 - 10
of
18
Frangipani: A Scalable Distributed File System
"... The ideal distributed file system would provide all its users with coherent, shared access to the same set of files,yet would be arbitrarily scalable to provide more storage space and higher performance to a growing user community. It would be highly available in spite of component failures. It woul ..."
Abstract
-
Cited by 320 (1 self)
- Add to MetaCart
(Show Context)
The ideal distributed file system would provide all its users with coherent, shared access to the same set of files,yet would be arbitrarily scalable to provide more storage space and higher performance to a growing user community. It would be highly available in spite of component failures. It would require minimal human administration, and administration would not become more complex as more components were added. Frangipani is a new file system that approximates this ideal, yet was relatively easy to build because of its two-layer structure. The lower layer is Petal (described in an earlier paper), a distributed storage service that provides incrementally scalable, highly available, automatically managed virtual disks. In the upper layer, multiple machines run the same Frangipani file system code on top of a shared Petal virtual disk, using a distributed lock service to ensure coherence. Frangipaniis meant to run in a cluster of machines that are under a common administration and can communicate securely. Thus the machines trust one another and the shared virtual disk approach is practical. Of course, a Frangipani file system can be exported to untrusted machines using ordinary network file access protocols. We have implemented Frangipani on a collection of Alphas running DIGITAL Unix 4.0. Initial measurements indicate that Frangipani has excellent single-server performance and scales well as servers are added.
A Coherent Distributed File Cache With Directory Write-behind
, 1993
"... Extensive caching is a key feature of the Echo distributed file system. Echo client machines maintain coherent caches of file and directory data and properties, with write-behind (delayed write-back) of all cached information. Echo specifies ordering constraints on this write-behind, enabling applic ..."
Abstract
-
Cited by 63 (7 self)
- Add to MetaCart
Extensive caching is a key feature of the Echo distributed file system. Echo client machines maintain coherent caches of file and directory data and properties, with write-behind (delayed write-back) of all cached information. Echo specifies ordering constraints on this write-behind, enabling applications to store and maintain consistent data structures in the file system even when crashes or network faults prevent some writes from being completed. In this paper we describe the Echo cache's coherence and ordering semantics, show how they can improve the performance and consistency of applications, and explain how they are implemented. We also discuss the general problem of reliably notifying applications and users when write-behind is lost; we addressed this problem as part of the Echo design but did not find a fully satisfactory solution.
New-Value Logging in the Echo Replicated File System
- Research report, Systems Research Center, Digital Equipment Corporation
, 1993
"... The Echo replicated file system uses new-value logging. Echo's use of new-value logging provides a clean separation of the internals of the system into one module that is concerned with logging and recovery, and another module that is concerned with accessing and updating the file system's ..."
Abstract
-
Cited by 16 (4 self)
- Add to MetaCart
(Show Context)
The Echo replicated file system uses new-value logging. Echo's use of new-value logging provides a clean separation of the internals of the system into one module that is concerned with logging and recovery, and another module that is concerned with accessing and updating the file system's on-disk structures. The logging module provides a restricted form of transaction. The restrictions simplify its implementation but impose constraints on the file system module. The file system module easily satisfies these constraints, resulting in a good match overall. Contents 1 Introduction 1 2 Simplified EchoDisk 4 2.1 The interface : : : : : : : : : : : : : : : : : : : : : : : : : : : : 4 2.2 The implementation : : : : : : : : : : : : : : : : : : : : : : : : 7 3 Real EchoDisk 9 3.1 Reserving bounded resources : : : : : : : : : : : : : : : : : : : 9 3.2 Optimizing large writes : : : : : : : : : : : : : : : : : : : : : : 11 3.3 Replication : : : : : : : : : : : : : : : : : : : : : : : : : : : : ...
Communication and Consistency in Mobile File Systems
- IEEE Personal Communications
, 1995
"... To overcome availability, latency, bandwidth, and cost barriers of mobile networks, mobile clients of distributed file systems switch between connected and disconnected modes of operation. Lying between these are modes of operation that refine the consistency semantics of cached files, allowing a mo ..."
Abstract
-
Cited by 13 (0 self)
- Add to MetaCart
(Show Context)
To overcome availability, latency, bandwidth, and cost barriers of mobile networks, mobile clients of distributed file systems switch between connected and disconnected modes of operation. Lying between these are modes of operation that refine the consistency semantics of cached files, allowing a mobile client to select a mode appropriate for the the prevailing network conditions. Clients can take advantage of network opportunities unsuitable for connected operation, obtaining improved performance, more effective sharing, and more stringent consistency guarantees as a result.
PacificA: Replication in log-based distributed storage systems
, 2008
"... Large-scale distributed storage systems have gained popularity for storing and processing ever increasing amount of data. Replication mechanisms are often key to achieving high availability and high throughput in such systems. Research on fundamental problems such as consensus has laid out a solid f ..."
Abstract
-
Cited by 10 (2 self)
- Add to MetaCart
(Show Context)
Large-scale distributed storage systems have gained popularity for storing and processing ever increasing amount of data. Replication mechanisms are often key to achieving high availability and high throughput in such systems. Research on fundamental problems such as consensus has laid out a solid foundation for replication protocols. Yet, both the architectural design and engineering issues of practical replication mechanisms remain an art. This paper describes our experience in designing and implementing replication for commonly used log-based storage systems. We advocate a general replication framework that is simple, practical, and strongly consistent. We show that the framework is flexible enough to accommodate a variety of different design choices that we explore. Using a prototype system called PacificA, we implemented three different replication strategies, all using the same replication framework. The paper reports detailed performance evaluation results, especially on system behavior during failure, reconciliation, and recovery. 1.
Distributed File Systems Past, Present and Future A Distributed File System for 2006
, 1996
"... A survey on distributed file systems ..."
(Show Context)
HAMFS File System
- In proceedings of 18th IEEE Symposium on Reliable Distributed Systems
, 1999
"... ..."
(Show Context)
104 New-Value Logging in the Echo Replicated File System
, 1993
"... The charter of SRC is to advance both the state of knowledge and the state of the art in computer systems. From our establishment in 1984, we have performed basic and applied research to support Digital’s business objectives. Our current work includes exploring distributed personal computing on mult ..."
Abstract
- Add to MetaCart
(Show Context)
The charter of SRC is to advance both the state of knowledge and the state of the art in computer systems. From our establishment in 1984, we have performed basic and applied research to support Digital’s business objectives. Our current work includes exploring distributed personal computing on multiple platforms, networking, programming technology, system modelling and management techniques, and selected applications. Our strategy is to test the technical and practical value of our ideas by building hardware and software prototypes and using them as daily tools. Interesting systems are too complex to be evaluated solely in the abstract; extended use allows us to investigate their properties in depth. This experience is useful in the short term in refining our designs, and invaluable in the long term in advancing our knowledge. Most of the major advances in information systems have come through this strategy, including personal computing, distributed systems, and the Internet. We also perform complementary work of a more mathematical flavor. Some of it is in established fields of theoretical computer science, such as the analysis of algorithms, computational geometry, and logics of programming. Other work explores new ground motivated by problems that arise in our systems research. We have a strong commitment to communicating our results; exposing and testing our ideas in the research and development communities leads to improved understanding. Our research report series supplements publication in professional journals and conferences. We seek users for our prototype systems among those with whom we have common interests, and we encourage collaboration with university researchers.
