Google Research Publication: The Google File ...
来源:百度文库 编辑:神马文学网 时间:2024/04/26 17:43:06
The Google File System
Sanjay Ghemawat,Howard Gobioff, andShun-Tak Leung
Abstract
We have designed and implemented the Google File System, a scalable distributed file system for large distributed data-intensive applications. It provides fault tolerance while running on inexpensive commodity hardware, and it delivers high aggregate performance to a large number of clients.
While sharing many of the same goals as previous distributed file systems, our design has been driven by observations of our application workloads and technological environment, both current and anticipated, that reflect a marked departure from some earlier file system assumptions. This has led us to reexamine traditional choices and explore radically different design points.
The file system has successfully met our storage needs. It is widely deployed within Google as the storage platform for the generation and processing of data used by our service as well as research and development efforts that require large data sets. The largest cluster to date provides hundreds of terabytes of storage across thousands of disks on over a thousand machines, and it is concurrently accessed by hundreds of clients.
In this paper, we present file system interface extensions designed to support distributed applications, discuss many aspects of our design, and report measurements from both micro-benchmarks and real world use.
Appeared in:
19th ACM Symposium on Operating Systems Principles,
Lake George, NY, October, 2003.
Sanjay Ghemawat,Howard Gobioff, andShun-Tak Leung
Abstract
We have designed and implemented the Google File System, a scalable distributed file system for large distributed data-intensive applications. It provides fault tolerance while running on inexpensive commodity hardware, and it delivers high aggregate performance to a large number of clients.
While sharing many of the same goals as previous distributed file systems, our design has been driven by observations of our application workloads and technological environment, both current and anticipated, that reflect a marked departure from some earlier file system assumptions. This has led us to reexamine traditional choices and explore radically different design points.
The file system has successfully met our storage needs. It is widely deployed within Google as the storage platform for the generation and processing of data used by our service as well as research and development efforts that require large data sets. The largest cluster to date provides hundreds of terabytes of storage across thousands of disks on over a thousand machines, and it is concurrently accessed by hundreds of clients.
In this paper, we present file system interface extensions designed to support distributed applications, discuss many aspects of our design, and report measurements from both micro-benchmarks and real world use.
Appeared in:
19th ACM Symposium on Operating Systems Principles,
Lake George, NY, October, 2003.
Google Research Publication: The Google File ...
Google Research Publication: BigTable
The Google File System
The Google File System中文版
用Google做research
Google File System
Google File System(中文翻译)
Google File System文件系统详解
Research Beyond Google: 119 Authoritative, In...
Google File Systems v2, part 1
Google: The Meta Brain
The ‘Google generation‘ myth
Google: The Meta Brain
Will Google win the enterprise?
Research Beyond Google: 119 Authoritative, Invisible, and Comprehensive Resources | OEDb
学会用GOOGLE做research | Pure Pleasure - Reborn
Google Keyword Tool: Research and Application Tips | Get Elastic
google
Google
Google
google
Google
google
Google