Gluster_FS_Release_Notes_3.1.6
Document Sample


Gluster File System
Release Notes
Version: 3.1.6
Release: August 2011
ds
License
Gluster 3.1.6 is licensed under GNU General Public License v3 or later.
Preamble to the GNU General Public License
The GNU General Public License is a free, copyleft license for software and other kinds of works.
The licenses for most software and other practical works are designed to take away your freedom to
share and change the works. By contrast, the GNU General Public License is intended to guarantee
your freedom to share and change all versions of a program--to make sure it remains free software
for all its users. We, the Free Software Foundation, use the GNU General Public License for most of
our software; it applies also to any other work released this way by its authors. You can apply it to
your programs, too.
When we speak of free software, we are referring to freedom, not price. Our General Public Licenses
are designed to make sure that you have the freedom to distribute copies of free software (and
charge for them if you wish), that you receive source code or can get it if you want it, that you can
change the software or use pieces of it in new free programs, and that you know you can do these
things.
To protect your rights, we need to prevent others from denying you these rights or asking you to
surrender the rights. Therefore, you have certain responsibilities if you distribute copies of the
software, or if you modify it: responsibilities to respect the freedom of others.
For example, if you distribute copies of such a program, whether gratis or for a fee, you must pass on
to the recipients the same freedoms that you received. You must make sure that they, too, receive
or can get the source code. And you must show them these terms so they know their rights.
Developers that use the GNU GPL protect your rights with two steps: (1) assert copyright on the
software, and (2) offer you this License giving you legal permission to copy, distribute and/or modify
it.
For the developers' and authors' protection, the GPL clearly explains that there is no warranty for
this free software. For both users' and authors' sake, the GPL requires that modified versions be
marked as changed, so that their problems will not be attributed erroneously to authors of previous
versions.
Some devices are designed to deny users access to install or run modified versions of the software
inside them, although the manufacturer can do so. This is fundamentally incompatible with the aim
of protecting users' freedom to change the software. The systematic pattern of such abuse occurs in
the area of products for individuals to use, which is precisely where it is most unacceptable.
Therefore, we have designed this version of the GPL to prohibit the practice for those products. If
such problems arise substantially in other domains, we stand ready to extend this provision to those
domains in future versions of the GPL, as needed to protect the freedom of users.
Finally, every program is threatened constantly by software patents. States should not allow patents
to restrict development and use of software on general-purpose computers, but in those that do, we
wish to avoid the special danger that patents applied to a free program could make it effectively
proprietary. To prevent this, the GPL assures that patents cannot be used to render the program non-
free.
Gluster File System Release_Notes_3.1.6_01_A Pg No. 2
ds
The precise terms and conditions for copying, distribution and modification are available at
http://www.gnu.org/licenses/gpl-3.0.html .
Gluster File System Release_Notes_3.1.6_01_A Pg No. 3
ds
Table of Contents
1. Overview ........................................................................................................... 5
1.1. Product Background .................................................................................... 5
1.2. Product License.......................................................................................... 5
1.3. Copyright/Trademarks ................................................................................. 5
1.4. Providing Feedback ..................................................................................... 5
1.5. Disclaimer ................................................................................................ 6
2. What is New in this Release? .................................................................................... 7
3. Dropped Features ................................................................................................. 8
4. System Requirements ............................................................................................ 9
4.1. Storage Severs ........................................................................................... 9
4.2. Networking Requirements ............................................................................. 9
4.3. Operating System Requirements ..................................................................... 9
4.4. File System Requirements ............................................................................. 9
5. Downloading and Installing GlusterFS 3.1.6 ................................................................. 10
5.1. Downloading GlusterFS 3.1.6 ......................................................................... 10
5.2. New Installation ........................................................................................ 10
5.3. Compatibility ........................................................................................... 10
5.4. Upgrade .................................................................................................. 10
5.4.1. Upgrading from Gluster 3.1.x to Gluster v3.1.6 ........................................ 10
5.4.2. Upgrading from 3.0.x to 3.1.6 ............................................................. 11
6. Issues Resolved in GlusterFS 3.1.6 ............................................................................ 12
7. Known Issues ...................................................................................................... 13
8. Documentation ................................................................................................... 15
9. Appendix – Bugs Fixed ........................................................................................... 16
Gluster File System Release_Notes_3.1.6_01_A Pg No. 4
ds
1. Overview
This Release Notes includes the following sections for the 3.1.6 release of the GlusterFS:
What is New in this Release?
Dropped Features
System Requirements
Downloading and Installing GlusterFS 3.1.6
Issues Resolved in GlusterFS 3.1.6
Known Issues
Note: It is recommended that you must thoroughly review this release note prior to installing or
upgrading GlusterFS.
1.1. Product Background
GlusterFS is an open source, clustered file system capable of scaling to several petabytes and
handling thousands of clients. GlusterFS clusters together storage building blocks over Infiniband
RDMA or TCP/IP interconnect, aggregating disk and memory resources and managing data in a single
global namespace. GlusterFS is based on a stackable user space design and can deliver exceptional
performance for diverse workloads.
The GlusterFS modular architecture allows administrators to stack modules to match user
requirements, as needed. For example, administrators can use GlusterFS to quickly configure a
standalone server system and later expand the system as needs grow.
1.2. Product License
Gluster 3.1.6 is licensed under the GNU General Public License v3 or later. The license for GlusterFS
3.1.6 can be viewed in License section.
1.3. Copyright/Trademarks
Gluster, the Gluster logo and GlusterFS are all trademarks of Gluster, Inc. All other trademarks,
registered trademarks, and product names may be trademarks of their respective owners.
1.4. Providing Feedback
Gluster welcomes your comments and suggestions on the quality and usefulness of its documentation.
If you find any errors or have any other suggestions, write to us at docfeedback@gluster.com for
clarification by providing the chapter, section, and page number, if available.
Gluster offers a range of resources related to Gluster software:
Discuss technical problems and solutions on the Discussion Forum
(http://community.gluster.org)
Get hands-on step-by-step tutorials
(http://www.gluster.com/community/documentation/index.php/Main_Page)
Reach Support (http://www.gluster.com/services/)
Gluster File System Release_Notes_3.1.6_01_A Pg No. 5
ds
1.5. Disclaimer
Gluster v3.1.6 software is provided AS IS. There is NO WARRANTY to the extent permitted by law.
Gluster Inc. is in no way responsible for any loss of data or services.
Gluster File System Release_Notes_3.1.6_01_A Pg No. 6
ds
2. What is New in this Release?
This is primarily a stabilization release and there is no new feature in this release.
Gluster File System Release_Notes_3.1.6_01_A Pg No. 7
ds
3. Dropped Features
No feature is dropped from this release.
Gluster File System Release_Notes_3.1.6_01_A Pg No. 8
ds
4. System Requirements
4.1. Storage Severs
Gluster supports the following storage servers:
Processor: Intel/AMD x86 64-bit
Disk: 8 GB minimum using direct-attached-storage, RAID, Amazon EBS, and FC/Infiniband/iSCSI
SAN disk backend using SATA/SAS/FC disks
Memory: 1 GB minimum
4.2. Networking Requirements
Gluster supports the following networks:
Gigabit Ethernet
10 Gigabit Ethernet
InfiniBand – OFED 1.5 or later
4.3. Operating System Requirements
GlusterFS has been tested extensively on the following environments:
Operating System Architecture Modes
CentOS 5.1 or higher x86_64 Client & Server
Solaris 10 Update 8 or higher x86_64 Server
GlusterFS works with other common Linux distribution like RHEL 5.1 or higher, Ubuntu 8.04 or higher,
and Fedora 11 or higher, but has not been tested extensively.
Packages
Ensure that the following additional packages are installed:
Bison
Automake/ Autoconf
Flex
libtool
gcc
Portmapper (for NFS)
Fuse
Readline
4.4. File System Requirements
Gluster recommends Ext4 (for Linux kernel 2.6.31 or higher or for CentOS 5.4 or higher) and Ext3 (for
all earlier versions) when formatting the disk sub-system. Any other POSIX compliant disk file system,
such as ReiserFS may also work, but has not been tested widely.
Gluster File System Release_Notes_3.1.6_01_A Pg No. 9
ds
5. Downloading and Installing GlusterFS 3.1.6
You can download and install the GlusterFS 3.1.6 or upgrade to latest version.
5.1. Downloading GlusterFS 3.1.6
You can download the latest software to each server in your cluster from
http://download.gluster.com/pub/gluster/glusterfs/3.1/3.1.6/.
5.2. New Installation
The installation process for GlusterFS server is available at:
http://www.gluster.com/community/documentation/index.php/Gluster_3.1:_Installing_GlusterFS_S
erver.
5.3. Compatibility
Release 3.1.6 of GlusterFS is compatible with 3.1.5 or higher releases of GlusterFS.
Release 3.1.6 of GlusterFS is not compatible with 2.0.x, 3.0.x, 3.1.4 or lower, and 3.2.0 releases of
GlusterFS.
5.4. Upgrade
Gluster recommends that you back up your data before upgrading to GlusterFS 3.1.6.
NOTE: Configurations generated outside the scope of gluster CLI are neither recommended nor
supported by Gluster.
5.4.1. Upgrading from Gluster 3.1.x to Gluster v3.1.6
In an environment with replicated bricks, it is recommended that you upgrade a single storage
server, confirm stability, and then upgrade the replica.
Use the same installation method for the upgrade as the original gluster installation.
Using RPM's on CentOS, RHEL, Fedora
1. Download the 3.1.6 RPM's from
http://download.gluster.com/pub/gluster/glusterfs/3.1/3.1.6/CentOS/
or
http://download.gluster.com/pub/gluster/glusterfs/3.1/3.1.6/RHEL/
or
http://download.gluster.com/pub/gluster/glusterfs/3.1/3.1.6/Fedora/
Gluster File System Release_Notes_3.1.6_01_A Pg No. 10
ds
2. Run rpm using the following command:
# rpm -U glusterfs*
Using dpkg on Debian, Ubuntu
1. Download the 3.1.6 packages from
http://download.gluster.com/pub/gluster/glusterfs/3.1/3.1.6/Debian/
or
http://download.gluster.com/pub/gluster/glusterfs/3.1/3.1.6/Ubuntu
2. Run dpkg using the following command:
# dpkg -i glusterfs*
Building from source
1. Download the 3.1.6 source code from
http://download.gluster.com/pub/gluster/glusterfs/3.1/3.1.6/glusterfs-3.1.6.tar.gz
2. Unpack and install Gluster using the following commands:
# gunzip glusterfs-3.1.6.tar.gz
# tar xvf glusterfs-3.1.6.tar
# cd glusterfs-3.1.6
# ./configure
# make
# make install
3. Stop and start Gluster using the following commands, this step will disconnect Gluster Native
clients.
# killall glusterfsd
# killall glusterfs
# killall glusterd
4. Start Gluster using the following command:
# /etc/init.d/glusterd start
5.4.2. Upgrading from 3.0.x to 3.1.6
For detailed instructions on upgrading from 3.0.x to 3.1.6, see
http://www.gluster.com/community/documentation/index.php/Gluster_3.0_to_3.1_Upgrade_Guide.
Gluster File System Release_Notes_3.1.6_01_A Pg No. 11
ds
6. Issues Resolved in GlusterFS 3.1.6
The following are the major bugs resolved in this release:
Bug 2522: Fixed issues related to gfid mismatch during rename operation.
Bug 3138: Fixed the issue of duplicate entries displayed during listing of files in replicated setup.
Bug 3011: Fixed the issue of client-servers hanging occasionally during uninterruptable processes.
Gluster File System Release_Notes_3.1.6_01_A Pg No. 12
ds
7. Known Issues
The following are the known issues:
Issues related to Distributed Replicated Volumes
When process has done ‘cd’ into a directory, stat of deleted file recreates it (directory self-
heal not triggered).
In GlusterFS replicated setup, if you are inside a directory (for example, ‘Test’ directory) of
replicated volume. From another node, you will delete a file inside ‘Test’ directory. Then if you
perform 'stat' operation on the same file name, the file will be automatically created. (that is, a
proper directory self-heal is not triggered when process has done ‘cd' into a path).
Open fd self-heal blocks the I/O on fd.
While doing self-heal on open file descriptors in replicate, the I/O operations on that particular
file descriptor may get blocked.
Manual intervention required in split-brain scenario.
If a file is actually in a split-brain situation, then GlusterFS does not perform any operation on
that file. In such a case, administrator must manually check and decide which of the replicated
copy is genuine.
Issues related to Distributed Volumes
Rebalance does not happen if bricks are down.
Currently while running rebalance, make sure all the bricks are in operating/connected state.
Rebalance can happen to already filled sub-volume.
Current algorithm of rebalance is not considering the free-space in the target brick before
migrating data. This enhancement is under development and will be available shortly.
In Replicate configuration, if the servers are of 3.1.6 version and clients are of 3.1.4 or lower
version, parallel operations on directories may hang.
Workaround: Install 3.1.6 version on both servers and clients.
glusterfsd - Error return code is not proper after daemonizing the process.
Due to this, scripts that mount glusterfs or start glusterfs process must not depend on its return
value.
glusterd - Parallel rebalance
With the current rebalance mechanism, the machine issuing the rebalance is becoming a
bottleneck as all the data migrations are happening through that machine.
Parallel operations (add brick, remove brick, and so on) with CLI from different nodes can crash
glusterd.
After '# gluster volume replace-brick <VOLNAME> commit' command is issued, the file system
operations on that particular volume, which are in transit will fail.
Gluster File System Release_Notes_3.1.6_01_A Pg No. 13
ds
The following are few known missing (minor) features:
access-control – POSIX ACLs
The application operations which require POSIX ACLs to function properly will not work on
GlusterFS.
locks - 'mandatory' locking is not supported.
NFS - NLM (Network Lock Manager) is not supported.
Gluster File System Release_Notes_3.1.6_01_A Pg No. 14
ds
8. Documentation
Product documentation of GlusterFS 3.1.x is available at:
http://www.gluster.com/community/documentation/index.php/Gluster_3.1.x_Documentation.
Gluster File System Release_Notes_3.1.6_01_A Pg No. 15
ds
9. Appendix – Bugs Fixed
The following are the list of bugs fixed in this release:
Bug Number URL
1059 http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=1059
2041 http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=2041
2346 http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=2346
2464 http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=2464
2522 http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=2522
2522 http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=2522
2525 http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=2525
2923 http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=2923
2939 http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=2939
3011 http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=3011
3036 http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=3036
3039 http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=3039
3041 http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=3041
3050 http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=3050
3069 http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=3069
3072 http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=3072
3077 http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=3077
3091 http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=3091
3104 http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=3104
3120 http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=3120
3122 http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=3122
3138 http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=3138
3144 http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=3144
3168 http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=3168
3170 http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=3170
3171 http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=3171
3191 http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=3191
3193 http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=3193
3206 http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=3206
3252 http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=3252
3255 http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=3255
Gluster File System Release_Notes_3.1.6_01_A Pg No. 16
ds
Bug Number URL
3260 http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=3260
3280 http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=3280
3295 http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=3295
3309 http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=3309
3317 http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=3317
3326 http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=3326
3340 http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=3340
3343 http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=3343
3348 http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=3348
3366 http://bugs.gluster.com/cgi-bin/bugzilla3/show_bug.cgi?id=3366
Gluster File System Release_Notes_3.1.6_01_A Pg No. 17
Get documents about "