rgw-admin: remove subuser index when required

rgw: clone operation should only update index for main category

rgw: fix cache interface (was not overloading method)

rgw: fix bucket creation

rgw: write bucket info in one operation

Objecter: fix local reads one more time.

Document it a little since we've gotten it wrong so often.

Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>

filestore: fix config observer

Actually, I don't think this was fully implemented to begin with, so it's
not a 'fix' per se.  This will let you use injectargs to adjust the
filestore config options during runtime.

Signed-off-by: Sage Weil <sage@newdream.net>

MOSDPGRepScrub: Fix typo in MOSDPGRepScrub

Signed-off-by: Samuel Just <samuel.just@dreamhost.com>

Merge branch 'wip-signal'

MOSDRepScrub: use header.version for payload version

Signed-off-by: Samuel Just <samuel.just@dreamhost.com>

Merge branch 'stable'

monmap: iterate over addr_name when printing summary

The rank is now ordered by IP address. We should iterate over
addr_name.

Signed-off-by: Henry C Chang <henry.cy.chang@gmail.com>

monmap: clear addr_name map on calculating ranks

We should clear addr_name before filling it. Otherwise, the removed
mon will stay there and cause incorrect rank assignment.

Signed-off-by: Henry C Chang <henry.cy.chang@gmail.com>

interval_set: fix truncation of _size

_size is type of int64_t. Use int to store the value of _size
will cause value truncation.

Signed-off-by: Henry C Chang <henry.cy.chang@gmail.com>

osd: remove SIGTERM cruft

The default handler will exit(0).  The got_sigterm stuff was dead code.

Signed-off-by: Sage Weil <sage@newdream.net>

mon: drop special SIGTERM handler

Default does exit(0).

Signed-off-by: Sage Weil <sage@newdream.net>

mds: drop special SIGTERM handler

Default does exit(0).

Signed-off-by: Sage Weil <sage@newdream.net>

exit(0) on SIGTERM by default

Signed-off-by: Sage Weil <sage@newdream.net>

Merge pull request #7 from kylemarsh/wip-obsync-swift-metadata

obsync: pull object metadata from swift store

obsync: pull object metadata from swift store

Obsync wasn't pulling object metadata from swift stores and thus wasn't
syncing metadata when reading from a swift store.  This commit fixes that.

rgw: fix subuser key name when purging subuser keys

radosgw-admin: add --purge-keys option

rgw: add timeout to init path

MOSDRepScrub,ReplicatedPG: Add scrub_to to MOSDRepScrub

When scrub_from is set, also set scrub_to to the primary's
last_update_applied (which will also be the official last_update before
finalizing scrub began).  The replica instead of waiting for
last_update_applied to catch up to last_update will wait for
last_update_applied to catch up to active_rep_scrub->scrub_to.  This
avoids a race where the replica scrub is requeued before all of the
currently queued sub-ops have been processed.

Signed-off-by: Samuel Just <samuel.just@dreamhost.com>

mon: update man page to document --mkfs stuff

Signed-off-by: Sage Weil <sage@newdream.net>

mds: misc assertions about truncation

Signed-off-by: Sage Weil <sage@newdream.net>

osd: EINVAL on truncate to huge object size

Signed-off-by: Sage Weil <sage@newdream.net>

Merge pull request #6 from kylemarsh/wip-obsync-swift

Wip obsync swift

rgw: remove temp context in prepare_get_obj

rgw: fix xml parser internal structure leak

rgw: fix a leak of acl structure (in req_state)

rgw: remove temp context in prepare_get_obj

rgw: fix xml parser internal structure leak

rgw: fix a leak of acl structure (in req_state)

Merge branch 'wip-osd-maybe-created'

Merge branch 'wip-osd-fsid'

doc: fix typo

Signed-off-by: Sage Weil <sage@newdream.net>

osd: --get-journal-fsid

Signed-off-by: Sage Weil <sage@newdream.net>

filejournal: uuid for fsid

Decode old header struct, but encode new class using more normal encoding
style.  Embed in a bufferlist for later extensibility.  Use the first
64 bits of the uuid for the per-entry magic, as before.

When we load an old fsid, we mirror the 64-bits.

Signed-off-by: Sage Weil <sage@newdream.net>

filestore: make fsid uuid_d instead of uint64_t

Signed-off-by: Sage Weil <sage.weil@dreamhost.com>

osd: --get-osd-fsid and --get-cluster-fsid

Signed-off-by: Sage Weil <sage.weil@dreamhost.com>

osd: store osd_fsid as text in osd_data dir

along with ceph_fsid (the cluster fsid) and a few other things.

Signed-off-by: Sage Weil <sage.weil@dreamhost.com>

osd: include osd_fsid in OSDSuperblock

Generated during mkfs.

Signed-off-by: Sage Weil <sage.weil@dreamhost.com>

osd: rename OSDSuperblock::fsid -> cluster_fsid

Signed-off-by: Sage Weil <sage.weil@dreamhost.com>

doc: fix mon cluster expansion docs

Signed-off-by: Sage Weil <sage@newdream.net>

mon: pull addr from ceph.conf, mon_host as needed when joining mon cluster

Signed-off-by: Sage Weil <sage@newdream.net>

mon: fix setting of mon addr when joining a cluster

Signed-off-by: Sage Weil <sage@newdream.net>

rgw: fix updating of object metadata

being used in swift POST. We were updating wrong object
size and etag

rgw: bucket cannot be recreated if already exists

man: Update the configuration example for radosgw

Signed-off-by: Wido den Hollander <wido@widodh.nl>

man: It is capital -C instead of -c when for creating a new keyring

Signed-off-by: Wido den Hollander <wido@widodh.nl>

rgw: fix updating of object metadata

being used in swift POST. We were updating wrong object
size and etag

rgw: bucket cannot be recreated if already exists

obsync: add authurl to CLI

s3 connections require the hostname and swift connections require the
authurl.  obsync treats these as equivalent internally, but breaks them
apart on the command line interface for clarity for the users.

object.h: initialize max in hobject_t(sobject_t) constructor

Signed-off-by: Samuel Just <samuel.just@dreamhost.com>

ReplicatedPG: fix handle_watch_timeout ctx->at_version

ctx->at_version should match the head of the new log entries
during issue_repop.  This could cause the scrub hang bug as
last_update would be less than last_update_applied.

Signed-off-by: Samuel Just <samuel.just@dreamhost.com>

ReplicatedPG: add asserts to catch scrub error

If last_update_applied skipped over last_update, we would see
scrub hang.

Signed-off-by: Samuel Just <samuel.just@dreamhost.com>

doc: fix filename in mon addition process

Signed-off-by: Sage Weil <sage@newdream.net>

filejournal: preallocate journal bytes on create

This should reduce fragmentation for large journals that are written
slowly the first time around.

Signed-off-by: Sage Weil <sage@newdream.net>

Merge pull request #5 from homac/master

Minor fix for init files and cleaned up spec file. Please pull

man: clarify mount.ceph auth options

Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com>

man: update rule definition for ceph-rbdnamer

This is the rule we install since 891025e539a92b5d75011e2e75c475fc0c272042.

Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com>

authx -> cephx everywhere it's used

The term authx was in the mount.ceph man page, and got accidentally
copied into rbd help.

Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com>

ceph.spec: Clean up and fix spec file and build for a couple of distributions

Clean up and fix the spec file. This includes cleaning up of build and
installed system dependencies, LSB compliance fixes, splitting up into
several sub-packages (lib*) and so on. It now builds fine for the
following distributions in the Open Build Service and should be
considered as a starting point for further fixes:

 - CentOS 6
 - Fedora 15
 - RedHat Enterprise Linux 6
 - openSUSE 11.4
 - openSUSE 12.1
 - openSUSE Factory
 - SUSE Linux Enterprise 11 (SP1 and SP2)

Signed-off-by: Holger Macht <hmacht@suse.de>

init-ceph/init-radosgw: Don't use unspecified runlevel 4

Don't use runlevel 4 in init scripts. AFAIK, no distribution is using it
and at least the Open Build Service complains about it.

Signed-off-by: Holger Macht <hmacht@suse.de>

client: fix logger deregistration

Only unregister logger if it is non-NULL (and thus registered) to avoid
running afoul of the cct assertions.

Signed-off-by: Sage Weil <sage@newdream.net>

obsync: add vvprint back in

Commit ebe5fc60d20f92a0037c53c1e7bd7ae512be3da4 removed the definition of
vvprint without removint all the places that used it.

doc: Make overview.rst valid reStructuredText, so I can stop seeing warnings.

It's still wrong, but now it won't clutter the output.

Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com>

pybind: Add a description to docstring.

This avoids a Sphinx warning like this:

.../src/pybind/rbd.py:docstring of rbd.RBD.version:2: WARNING: Field list ends without a blank line; unexpected unindent.

Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com>

doc: reStructuredText syntax fix.

Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com>

Merge branch 'wip-messenger'

doc: "ceph -w" clarification.

Stop saying "watch cluster state" so many times.

Don't say stdout, that's the assumption.

Don't call showing things on terminal "printing".

Don't show -C option here.

Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com>

doc: Fix sentence that ended too abruptly.

Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com>

doc: Split intro to talk about the DFS separately. Mention petabytes.

Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com>

doc: Add more missing commands to control.

This is too unstructured, that will have to be fixed later.

Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com>

doc: Add misc explanations of Ceph internals from email.

Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com>

doc: Use todo directive, rescue list of missing commands from wiki.

Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com>

doc: Link to manpage when command is mentioned.

Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com>

doc: More consistency on formatting placeholder names.

Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com>

msgr: unset did_bind in stop().

We use did_bind as a flag on whether or not to stop the Accepter thread
and we should clear it when we do the stopping.
This fixes #1829.

Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>

objecter: fix use-after-free

messenger consumes the m reference.  Yay valgrind.

Signed-off-by: Sage Weil <sage@newdream.net>

client: move PerfCounter into Client

globals are evil.

Fixes: #1826
Signed-off-by: Sage Weil <sage@newdream.net>

swift: auth response returns X-Auth-Token instead of X-Storage-Token

osd: fix build_incremental_map_msg

We keep both the inc and the full for our oldest osdmap.

Signed-off-by: Sage Weil <sage.weil@dreamhost.com>

osd: clean up _delete_head

Might be fixing a subtle logic bug, but old flow was confusing, so not
sure.  :)

Signed-off-by: Sage Weil <sage@newdream.net>
Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>

osd: simplify creation logic in do_osd_ops

Drop the maybe_created variable, and track exists over the course of the
transaction.

Fixes: #1825
Signed-off-by: Sage Weil <sage@newdream.net>
Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>

qa: trivial_libceph test

This currently fails... see #1827

Signed-off-by: Sage Weil <sage@newdream.net>

libceph: add missing #includes

Signed-off-by: Sage Weil <sage@newdream.net>

libceph: catch errors from Client::init()

And clean up error paths.

Signed-off-by: Sage Weil <sage@newdream.net>

client: return errors from init

Signed-off-by: Sage Weil <sage@newdream.net>

filestore: dump transaction to log if we hit an error

This will let us see which operation in the transaction failed.

Signed-off-by: Sage Weil <sage@newdream.net>

objectstore: implement Transaction::dump()

Signed-off-by: Sage Weil <sage@newdream.net>

objectstore: create Transaction::iterator class

Remove iterator state from Transaction itself.

Signed-off-by: Sage Weil <sage@newdream.net>

qa: rados load-gen workunits

Signed-off-by: Sage Weil <sage@newdream.net>

pybind/rados: add asynchronous write,append,read,write_full operations

Signed-off-by: Samuel Just <samuel.just@dreamhost.com>

doc: Clarify documentation of reweight command.

This caused some discussions on the mailing list, so let's try to be clear
about the meaning of an OSD weight.

Signed-Off-By: Andre Noll <maan@systemlinux.org>

doc: Add missing documentation for osd pool get.

"osd pool set" was already documented, but the corresponding "get"
command was not. This patch adds the list of valid fields for this
command, together with short descriptions.

Thanks to Gregory Farnum for pointing out a flaw in the description
of lpl_num and lpgp_num in an earlier version of the patch.

Signed-Off-By: Andre Noll <maan@systemlinux.org>

doc: Update the list of fields for the pool set command.

This list was lacking a few fields: crash_replay_interval, pg_num,
pgp_num and crush_ruleset. Include these fields and add add short
descriptions.

Signed-Off-By: Andre Noll <maan@systemlinux.org>

doc: Document pause and unpause osd commands.

These two commands were undocumented so far. This patch adds a short
description.

Signed-Off-By: Andre Noll <maan@systemlinux.org>

doc: Add documentation of missing osd commands.

The set of OSD commands which added by the previous commit is
incomplete. This patch adds documentation for the following
OSD commands which were previously missing: dump, tree, crush,
cluster_snap, lost, create, rm.

Signed-Off-By: Andre Noll <maan@systemlinux.org>