Moose File System
 | |
| Developer(s) | Jakub Kruszona-Zawadzki[1] / Core Technology[2] |
|---|---|
| Stable release | 2.0.89-1 / 27 April 2016[3][4][5] |
| Preview release | 3.0.74-1 / 8 March 2016[6][7][8] |
| Operating system | Linux, FreeBSD, Solaris, OpenSolaris, Mac OS X |
| Type | Distributed file system |
| License | GPLv2 / proprietary |
| Website | moosefs.com |
Moose File System (MooseFS) is a distributed file system developed by Core Technology. The lead developer is Jakub Kruszona-Zawadzki.[9] MooseFS aims to be fault-tolerant, highly available, highly performing, scalable general-purpose network distributed file system for data centers. Initially proprietary code, it was released to the public as open source on May 5, 2008.
Currently two editions of MooseFS are available:
- MooseFS - released under GPLv2 license,
- MooseFS Professional Edition (MooseFS Pro) - release under proprietary license in binary packages form.
Design
The MooseFS follows similar design principles as Fossil (file system), Google File System, Lustre or Ceph. The file system comprises three components:
- Metadata server (MDS) — manages the location (layout) of files, file access and namespace hierarchy. The current version of MooseFS does support multiple metadata servers and automatic failover. Clients only talk to the MDS to retrieve/update a file's layout and attributes; the data itself is transferred directly between clients and chunk servers. The Metadata server is a user-space daemon; the metadata is kept in memory and lazily stored on local disk.
- Metalogger server — periodically pulls the metadata from the MDS to store it for backup. Since version 1.6.5, this is an optional feature.
- Chunk servers (CSS) — store the data and optionally replicate it among themselves. There can be many of them, though the scalability limit has not been published. The biggest cluster reported so far consists of 160 servers.[10] The Chunk server is also a user-space daemon that relies on the underlying local file system to manage the actual storage.
- Clients — talk to both the MDS and CSS. MooseFS clients mount the file system into user-space via FUSE.
Features
To achieve high reliability and performance MooseFS offers the following features:
- Fault-tolerance — MooseFS uses replication, data can be replicated across chunkservers, the replication ratio (N) is set per file/directory. If (N-1) replicas fail the data will still be available. At the moment MooseFS does not offer any other technique for fault-tolerance. Fault-tolerance for very big files thus requires vast amount of space - N*filesize instead of filesize+(N*stripesize) as would be the case for RAID 4, RAID 5 or RAID 6. Version 4.x PRO of MooseFS will have RAID6.
- Striping — large files are divided into chunks (up to 64 megabytes) that might be stored on different chunk servers in order to achieve higher aggregate bandwidth.
- Load balancing — MooseFS attempts to use storage resources equally, the current algorithm seems to take into account only the consumed space.
- Security — Apart from classical POSIX file permissions, since the 1.6 release MooseFS offers a simple, NFS-like, authentication/authorization.
- Snapshots - Quick, low-overhead snapshots.
Hardware, software and networking
Similarly to other cluster-based file systems MooseFS uses commodity hardware running a POSIX compliant operating system. TCP/IP is used as the interconnect.
See also
- Distributed file system
- List of file systems, the distributed fault-tolerant file system section
- Ceph
- Lustre
- GlusterFS
References
- ↑ https://github.com/moosefs/moosefs/graphs/contributors
- ↑ "About us - Core Technology - MooseFS fault tolerant network distributed file system". Core Technology.
- ↑ "Download MooseFS - fault tolerant network distributed file system".
- ↑ "Latest changes in MooseFS 2.0".
- ↑ https://github.com/moosefs/moosefs/releases
- ↑ "Download MooseFS - fault tolerant network distributed file system".
- ↑ "Latest changes in MooseFS 3.0".
- ↑ https://github.com/moosefs/moosefs/releases
- ↑ https://github.com/moosefs/moosefs/graphs/contributors
- ↑ Mariusz Gądarowski (2010-04-01). "MooseFS: Bezpieczny i rozproszony system plików" (PDF). Linux Magazine Poland.
External links
- Moose File System official website
- MooseFS on GitHub
- MooseFS project page on SourceForge
- LizardFS – a fork of old version (1.6.27) of MooseFS licensed under the terms of the GPL-3.
This article is issued from Wikipedia - version of the Thursday, May 05, 2016. The text is available under the Creative Commons Attribution/Share Alike but additional terms may apply for the media files.