doc: Syntax cleanup for new IA. Added reference to repo.

Signed-off-by: John Wilkins <john.wilkins@inktank.com>

doc: Syntax cleanup for new IA.

Signed-off-by: John Wilkins <john.wilkins@inktank.com>

doc: Syntax cleanup for new IA. Removed steps for building docs.

Signed-off-by: John Wilkins <john.wilkins@inktank.com>

doc: Syntax cleanup for new IA. Removed info for building documentation.

Signed-off-by: John Wilkins <john.wilkins@inktank.com>

doc: Syntax cleanup for new IA.

Signed-off-by: John Wilkins <john.wilkins@inktank.com>

doc: update the rest of the table for debian wheezy

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>

Merge remote-tracking branch 'upstream/wip_recovery_reserve'

Reviewed-by: Samuel Just <sam.just@inktank.com>

doc/: document recovery reservation process

Signed-off-by: Mike Ryan <mike.ryan@inktank.com>

pg: recovery reservations

This extends the backfill reservation system to work with log-based
recovery. The Active and RepActive states of the PG state machine are
greatly expanded to deal with the increased complexity of handling both
recovery and backfill reservations.

Signed-off-by: Mike Ryan <mike.ryan@inktank.com>

doc: Wheezy is now using kernel 3.2.0; say so

doc: Fix per-daemon public/private settings: "network" -> "addr"

doc: Clarify "pool size", copies, and replicas more

doc: fix Hadoop config option typo

Signed-off-by: Noah Watkins <noahwatkins@gmail.com>

doc: Made changes to the CSS to make admonitions more prominent.

Signed-off-by: John Wilkins <john.wilkins@inktank.com>

doc: Added lines between title and body. Pre IA cleanup.

Signed-off-by: John Wilkins <john.wilkins@inktank.com>

doc: Updated syntax for consistent usage prior to IA updates.

Signed-off-by: John Wilkins <john.wilkins@inktank.com>

doc: Updated index for removal of legacy openstack install.

Signed-off-by: John Wilkins <john.wilkins@inktank.com>

doc: Minor edit to admonitions.

Signed-off-by: John Wilkins <john.wilkins@inktank.com>

doc: Updated syntax prior to IA updates.

Signed-off-by: John Wilkins <john.wilkins@inktank.com>

doc: Updated syntax usage prior to IA updates.

Signed-off-by: John Wilkins <john.wilkins@inktank.com>

doc: Added new info per Ross's request.

Signed-off-by: John Wilkins <john.wilkins@inktank.com>

doc: Fix and minor edit for admonitions.

Signed-off-by: John Wilkins <john.wilkins@inktank.com>

doc: Minor edits for admonitions.

Signed-off-by: John Wilkins <john.wilkins@inktank.com>

doc: Edits from Peter Reiher's feedback, and minor edits for admonitions.

Signed-off-by: John Wilkins <john.wilkins@inktank.com>

doc: Minor edits for admonitions.

Signed-off-by: John Wilkins <john.wilkins@inktank.com>

doc: Added topic for adding OSDs and adjusting CRUSH weights.

Signed-off-by: John Wilkins <john.wilkins@inktank.com>

Merge branch 'master' of https://github.com/ceph/ceph

doc: Removed legacy OpenStack installation.

Signed-off-by: John Wilkins <john.wilkins@inktank.com>

doc: Added topic for adding an OSD and adjusting CRUSH weights.

Signed-off-by: John Wilkins <john.wilkins@inktank.com>

ceph.spec.in:  Remove ceph version requirement from ceph-fuse package.

The ceph-fuse rpm package now only requires ceph as a pre-req, not a specific
version.

Update log file when rgw is not running

Signed-off-by: tamil <tamil.muthamizhan@inktank.com>

osd/: add pool min_size parameter for min acting set size

Otherwise, a pg might go active with a single osd in the
acting set.  If that osd subsequently dies, we potentially
loose client writes.  Note: it's still possible for the
acting set to exceed min_size but fail to obey the spirit
of the user's crush settings (e.g., min_size is 2, but both
osds happen to be no the sam node).

Signed-off-by: Samuel Just <sam.just@inktank.com>
Reviewed-by: Sage Weil: <sage@inktank.com>

Merge remote-tracking branch 'upstream/wip_lost_unfound_event'

Reviewed-by: Sage Weil <sage@inktank.com>

Merge remote-tracking branch 'upstream/wip-xattr'

Reviewed-by: Samuel Just <sam.just@inktank.com>

Makefile: add missing rgw_resolve.h to dist tarball

Signed-off-by: Sage Weil <sage@inktank.com>

qa: disable xfstest 45 until mount issue is resolved on precise

Meh

Signed-off-by: Sage Weil <sage@inktank.com>

Merge branch 'next'

cls_rbd: send proper format of key to "last_read" for dir_list

rbd ls of format-2 images was looping on the first 64 (when more than 64
were present).  The key name passed to the omap layer needs to always
contain the prefix, and the "inside-the-loop next-chunk" statement
was missing the "add the prefix" call.

Also, add a test for listing 100 images, format 1 and 2.

Signed-off-by: Dan Mick <dan.mick@inktank.com>
Reviewed-by: Josh Durgin <josh.durgin@inktank.com>

rgw: document cname configurable

Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>

Merge remote-tracking branch 'origin/master' into wip-3206

rgw: resolve hostname dns cname record

Implements #3206
This allows using vanity domains. A CNAME record can now
be set for the domain that would point at the rgw instance,
with or without a bucket set as a subdomain.

Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>

java: use accessors for mode flag tests

Add isDir(), isFile(), and isSymlink() for read-only tests corresponding
to the S_ISREG test and friends.

Signed-off-by: Noah Watkins <noahwatkins@gmail.com>
Reviewed-by: Joe Buck <jbbuck@gmail.com>

rgw: fix multipart overwrite

Fixes: #3400
Removed a few lines of code that prematurely created the head
part of the final object (before creating the manifest).

Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>

rgw: don't reset multipart parts when updating their metadata

Fixes: #3401
The problem was that put_obj_meta() was assuming object is going
to be reset, so it was resetting the object anyway. This is not
true when dealing with the immutable multipart upload parts.

Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>

rgw: break out of read loop if we got zero bytes

If the part that we're reading is corrupted and we end up
reading zero bytes, we need to exit, otherwise we'd just
loop forever.

Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>

Merge branch 'master' of https://github.com/ceph/ceph

doc: fixed some inccorrect syntax.

Signed-off-by: John Wilkins <john.wilkins@inktank.com>

rbd: allow removal of image even if rbd_children deletion fails

Users have been seeing failures where rbd rm is half-done; could be
because of outstanding watches on the rbd_header object.  The state
is that rbd_children no longer contains the child, but other pieces
remain; remove considers this a failure.

Fix: test for ENOENT from remove_child, and treat that as an ignorable
error and drive on.  Simulate this in copy.sh by removing the
rbd_children object altogether, which also results in ENOENT return
from remove_child.

Signed-off-by: Dan Mick <dan.mick@inktank.com>
Reviewed-by: Josh Durgin <josh.durgin@inktank.com>

rbd: allow removal of image even if rbd_children deletion fails

Users have been seeing failures where rbd rm is half-done; could be
because of outstanding watches on the rbd_header object.  The state
is that rbd_children no longer contains the child, but other pieces
remain; remove considers this a failure.

Fix: test for ENOENT from remove_child, and treat that as an ignorable
error and drive on.  Simulate this in copy.sh by removing the
rbd_children object altogether, which also results in ENOENT return
from remove_child.

Signed-off-by: Dan Mick <dan.mick@inktank.com>
Reviewed-by: Josh Durgin <josh.durgin@inktank.com>

doc: Minor edits and added reference to Cephx intro.

Signed-off-by: John Wilkins <john.wilkins@inktank.com>

osd/: encode LOST_REVERT reverting_to in prior_version pos

This will allow older osds to interpret the LOST_REVERT event
correctly.

Signed-off-by: Samuel Just <sam.just@inktank.com>

PG: use remove_object_with_snap_hardlinks for divergent objects

Otherwise, we end up leaving snap hardlinks in the snapshot
index directories.  This eventually results in an EEXIST error
when we attempt to re-link the clone into place during
recovery.

Signed-off-by: Samuel Just <sam.just@inktank.com>
Reviewed-by: Sage Weil <sage@inktank.com>

rbd: stripe count is not measured in bytes

Signed-off-by: Sage Weil <sage@inktank.com>

chain_xattr: use sys_* methods

The sys_* wrappers return -errno on error; use those!

Signed-off-by: Sage Weil <sage@inktank.com>

os/FileStore: chain_*() methods return error codes; don't check errno

Signed-off-by: Sage Weil <sage@inktank.com>

chain_xattr: comment about how xattrs are named

Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>

os/chain_xattr: whitespace, constify *end

Signed-off-by: Sage Weil <sage@inktank.com>

os/chain_xattr: do not double memory buffer (again)

This appears to be a typo; there is no need to double (again) the size of
the buffer we allocate.

Signed-off-by: Sage Weil <sage@inktank.com>

os/chain_xattr: fix listxattr buffer size

Intenrally allocate 2x the raw listxattr result; tell the user the same.

Signed-off-by: Sage Weil <sage@inktank.com>

os/FileStore: introduce lfn_close()

Match every lfn_open() with lfn_close() (instead of close(2)).

Signed-off-by: Sage Weil <sage@inktank.com>

os/FileStore: remove lfn_*xattr helpers

No longer used!

Signed-off-by: Sage Weil <sage@inktank.com>

os/FileStore: recast _rmattr on top of chain_f*

Signed-off-by: Sage Weil <sage@inktank.com>

os/FileStore: recast _setattrs() on top of chain_f* methods

This lets us open an fd once and use that.

Signed-off-by: Sage Weil <sage@inktank.com>

os/FileStore: drop _getattr() helpers

Signed-off-by: Sage Weil <sage@inktank.com>

os/FileStore: use new helpers from collection_{get,set,rm}attr[s]

Signed-off-by: Sage Weil <sage@inktank.com>

os/FileStore: use _fgetattr() from getattr()

Signed-off-by: Sage Weil <sage@inktank.com>

os/FileStore: remove unused _getattrs() methods

We are now using the _fgetattrs() variant everywhere instead.

Signed-off-by: Sage Weil <sage@inktank.com>

os/FileStore: use _fgetattrs() from collection_getattr()

Signed-off-by: Sage Weil <sage@inktank.com>

os/FileStore: use _fgetattrs() from _rmattrs()

Note that we subtly change failure handling to be more strict: if we
fail to open the file, we error out; before we ignored errors from
_getattr().

Signed-off-by: Sage Weil <sage@inktank.com>

os/FileStore: use _fgetattrs() for _setattrs()

If we're using omap for spillover, we need to load the xattrs so that
they can be removed if necessary.

Note that we subtly change the failure behavior here to be more
strict: if we can't open the file, we fail, whereas before we did not.

Signed-off-by: Sage Weil <sage@inktank.com>

os/FileStore: use _fgetattrs() for CLONE

We have the src fd.

Signed-off-by: Sage Weil <sage@inktank.com>

os/FileStore: use _fgetattrs() for GETATTRS op

Signed-off-by: Sage Weil <sage@inktank.com>

os/FileStore: add _fgetattr(), _fgetattrs() helpers

Introduce new fd-based getattr[s] helpers.

Signed-off-by: Sage Weil <sage@inktank.com>

os/FileStore: use f*xattr() methods to test xattr support

Signed-off-by: Sage Weil <sage@inktank.com>

os/chain_xattr: move chained xattr helpers into separate file/module

* Rename do_* -> chain_*.
* Move #defines to a header.
* Fix *Index users
* Implement both *xattr() and f*xattr() variants for get, set, list,
  remove.

Signed-off-by: Sage Weil <sage@inktank.com>

client: return EBADF for invalid file desc

Adds get_filehandle to Client which resolves a file descriptor or
returns NULL if the file descriptor is invalid. Libcephfs calls that
accept a file descriptor are changed to return -EBADF when
get_filehandle returns NULL.

Signed-off-by: Noah Watkins <noahwatkins@gmail.com>
Reviewed-by: Sage Weil <sage@inktank.com>

doc: describe Hadoop configuration options

Start a document describing Ceph integration with Hadoop, and adds a
description of configuration options that the CephFileSystem shim will
accept.

PG::merge_old_entry: fix case for divergent prior_version

Previously, we asserted that a log entry with a divergent
prior_version must be a clone.  Consider the following
case:

6'11(6'2)  m foo
7'12(6'3) m bar
7'13(7'12) m bar

If this is merged with:

6'11(6'2)  m foo
8'12(6'4) m baz

we will hit the assert.  The correct behavior is simply to remove
the object as in the clone case.

Signed-off-by: Samuel Just <sam.just@inktank.com>
Reviewed-by: Sage Weil <sage@inktank.com>

PG: use remove_object_with_snap_hardlinks for divergent objects

Otherwise, we end up leaving snap hardlinks in the snapshot
index directories.  This eventually results in an EEXIST error
when we attempt to re-link the clone into place during
recovery.

Signed-off-by: Samuel Just <sam.just@inktank.com>
Reviewed-by: Sage Weil <sage@inktank.com>

Merge branch 'wip-reorg'

Merge branch 'wip-msgr-ports'

Reviewed-by: Greg Farnum <greg@inktank.com>

msg/Accepter: use derr

Signed-off-by: Sage Weil <sage@inktank.com>

msgr: change port range from 6800-6900 -> 6800-7100

This allows more OSDs per host.

Signed-off-by: Sage Weil <sage@inktank.com>

msgr: make bind port range configurable

Signed-off-by: Sage Weil <sage@inktank.com>

librados: move misc tests into test/librados/ dir

Signed-off-by: Sage Weil <sage@inktank.com>

librados: test/rados-api/* -> test/librados/*

Signed-off-by: Sage Weil <sage@inktank.com>

client: Support for fchown

Implement fchown in libcephfs and client,
which is needed by the samba vfs module.

Signed-off-by: Sam Lang <sam.lang@inktank.com>

cls_lock: reorg test_cls_lock

Signed-off-by: Sage Weil <sage@inktank.com>

cls_rgw: reorg test_cls_rgw

Signed-off-by: Sage Weil <sage@inktank.com>

fix cls_rbd reorg

librbd: reorg rbd tests

Signed-off-by: Sage Weil <sage@inktank.com>

cls_rbd: move into new location

Be consistent!  Make an example of ourselves!

Signed-off-by: Sage Weil <sage@inktank.com>

msg/Pipe: fix leak of AuthSessionHandler

Init ptr in ctor, delete in dtor.

Reported-by: Yan, Zheng <yan.zheng@intel.com>
Signed-off-by: Sage Weil <sage@inktank.com>

Merge branch 'wip-mds'

Merge branch 'master' of https://github.com/ceph/ceph

doc: Added qemu caching section.

fixes: #3332

Signed-off-by: John Wilkins <john.wilkins@inktank.com>

doc: Added Commandline Usage and a few fixes.

Signed-off-by: John Wilkins <john.wilkins@inktank.com>

test script for s3 tests
Signed-off-by: tamil <tamil.muthamizhan@inktank.com>

doc: Changed term "kernel object" to "kernel module". Added hyperlink to cephx.

Signed-off-by: John Wilkins <john.wilkins@inktank.com>

doc: Improved the landing page for RBD.

Signed-off-by: John Wilkins <john.wilkins@inktank.com>