doc: Fixed typos.

fixes: #4932

Signed-off-by: John Wilkins <john.wilkins@inktank.com>

doc: Fixed typo.

fixes: #4422

Signed-off-by: John Wilkins <john.wilkins@inktank.com>

doc: Removed "and" as suggested.

fixes: #3686

Signed-off-by: John Wilkins <john.wilkins@inktank.com>

doc: Fixed hyperlink.

Signed-off-by: John Wilkins <john.wilkins@inktank.com>

doc: Fixed path typo.

Signed-off-by: John Wilkins <john.wilkins@inktank.com>

doc: Updated OS support for Cuttlefish.

Signed-off-by: John Wilkins <john.wilkins@inktank.com>

doc: Minor tweak to the definition list style.

Signed-off-by: John Wilkins <john.wilkins@inktank.com>

doc: Added glossary to TOC.

Signed-off-by: John Wilkins <john.wilkins@inktank.com>

doc: Added glossary.

Signed-off-by: John Wilkins <john.wilkins@inktank.com>

doc: Fixed usage typo.

fixes: #4923

Signed-off-by: John Wilkins <john.wilkins@inktank.com>

Merge pull request #262 from gollub/typos

fixed common typo in error messages

fixed common typo in error messages

Signed-off-by: Daniel Gollub <d.gollub@telekom.de>

doc/install/{debian,rpm}: update for cuttlefish

Signed-off-by: Sage Weil <sage@inktank.com>

doc/start/get-involved: fix links

ERROR: /srv/autobuild-ceph/gitbuilder.git/build/doc/start/get-involved.rst:33: Unknown target name: "tracker".
ERROR: /srv/autobuild-ceph/gitbuilder.git/build/doc/start/get-involved.rst:43: Unknown target name: "support".

Signed-off-by: Sage Weil <sage@inktank.com>

doc/release-notes: I missed rgw rest api in the release notes

Mostly from here dd19d693e6528c70167958ebc57e075200a08803

Signed-off-by: Sage Weil <sage@inktank.com>

Merge branch 'next'

os/ObjectStore: add missing break in dump()

CID 751331 (#1 of 1): Missing break in switch (MISSING_BREAK)
unterminated_case: This case (value 35) is not terminated by a 'break' statement.

Signed-off-by: Sage Weil <sage@inktank.com>

doc: Deleted redundant "so that" phrase.

Signed-off-by: John Wilkins <john.wilkins@inktank.com>

doc: Corrected typo.

Signed-off-by: John Wilkins <john.wilkins@inktank.com>

doc: Corrected typo.

Removed comment out of header, and added "coming soon."

doc: Updated usage for push | pull.

Signed-off-by: John Wilkins <john.wilkins@inktank.com>

osd: make class load errors louder

Fixes: #4639
Signed-off-by: Sage Weil <sage@inktank.com>

v0.61

os/: default to dio for non-block journals

Workaround: #4910
Signed-off-by: Samuel Just <sam.just@inktank.com>
Reviewed-by: Sage Weil <sage@inktank.com>

ceph-disk: use separate lock files for prepare, activate

Use a separate lock file for prepare and activate to avoid deadlock.  This
didn't seem to trigger on all machines, but in many cases, the prepare
process would take the file lock and later trigger a udev event and the
activate would then block on the same lock, either when we explicitly call
'udevadm settle --timeout=10' or when partprobe does it on our behalf
(without a timeout!).   Avoid this by using separate locks for prepare
and activate.  We only care if multiple activates race; it is
okay for a prepare to be in progress and for an activate to be kicked
off.

Signed-off-by: Sage Weil <sage@inktank.com>

ceph-test.install: add ceph-monstore-tool and ceph-osdomap-tool

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>

ceph.spec.in: remove twice listed ceph-coverage

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>

ceph.spec: add some files to ceph

Add installed, but not packaged files to ceph-test (ceph-monstore-tool,
ceph-osdomap-tool) rpm file section.

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>

doc: Update the usage to reflect optional directory name.

Signed-off-by: John Wilkins <john.wilkins@inktank.com>

doc: Rearranged to show zapping multiple disks and creating multiple OSDs.

Signed-off-by: John Wilkins <john.wilkins@inktank.com>

doc: Moved install to the second step, from the first step.

Signed-off-by: John Wilkins <john.wilkins@inktank.com>

Merge pull request #256 from dalgaaf/wip-da-spec-update

Fix ceph.spec.in

Merge pull request #257 from dalgaaf/wip-da-fix-debian

ceph-test.install: add ceph-monstore-tool and ceph-osdomap-tool

doc: Autonumbering syntax correction.

Signed-off-by: John Wilkins <john.wilkins@inktank.com>

doc: Added troubleshooting PGs to the index.

Signed-off-by: John Wilkins <john.wilkins@inktank.com>

doc: Commented out osd list for now.

Signed-off-by: John Wilkins <john.wilkins@inktank.com>

doc: Commented out remove a mds for now.

Signed-off-by: John Wilkins <john.wilkins@inktank.com>

doc: Forwarding link. FAQ migrated to new Ceph wiki.

Signed-off-by: John Wilkins <john.wilkins@inktank.com>

ceph-test.install: add ceph-monstore-tool and ceph-osdomap-tool

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>

ceph.spec.in: remove twice listed ceph-coverage

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>

ceph.spec: add some files to ceph

Add installed, but not packaged files to ceph-test (ceph-monstore-tool,
ceph-osdomap-tool) rpm file section.

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>

mon: fix init sequence when not daemonizing

We made the common_init_finish and chdir conditional on daemonize in commit
2e0dd5ae6c8751e33d456b2b06c1204b63db959a, breaking init (asok at least)
when -f is specified (as with upstart).

Signed-off-by: Sage Weil <sage@inktank.com>
Reviewed-by: Greg Farnum <greg@inktank.com>

mon: avoid null deref in Monitor::_mon_status()

mikedawson reports:

*** Caught signal (Segmentation fault) **
 in thread 7f40ce270700

 ceph version 0.60-801-g7ec0151 (7ec01513970b5a977bdbdf60052b6f6e257d267e)
 1: /usr/bin/ceph-mon() [0x59d550]
 2: (()+0xfbd0) [0x7f40d3e38bd0]
 3: (operator<<(std::ostream&, entity_name_t const&)+0x16) [0x4d7c46]
 4: (operator<<(std::ostream&, entity_inst_t const&)+0x1b) [0x4d837b]
 5: (Monitor::_mon_status(std::ostream&)+0x2ce) [0x4d284e]
 6: (Monitor::do_admin_command(std::string, std::string, std::ostream&)+0x4f) [0x4d652f]
 7: (AdminHook::call(std::string, std::string, ceph::buffer::list&)+0x68) [0x4efa38]
 8: (AdminSocket::do_accept()+0x451) [0x64ab81]
 9: (AdminSocket::entry()+0x398) [0x64c528]
 10: (()+0x7f8e) [0x7f40d3e30f8e]
 11: (clone()+0x6d) [0x7f40d237ae1d]

Signed-off-by: Sage Weil <sage@inktank.com>
Reviewed-by: Greg Farnum <greg@inktank.com>

ceph.spec: require xfsprogs

This is needed when creating new OSDs (via ceph-disk).  At least for most
people.  Eventually we'll want to include btrfs here.

Signed-off-by: Sage Weil <sage@inktank.com>

Merge branch 'next'

doc/release-notes: warn about sysvinit crush map update

See c189d855e67baadf977d8ca14509dcacd579af7a.

Signed-off-by: Sage Weil <sage@inktank.com>

init-ceph: update osd crush map position on start

This is what the upstart ceph-osd.conf does; we need to do the same so that
new OSDs (e.g., that ceph-deploy creates) get added to the crush map.

Signed-off-by: Sage Weil <sage@inktank.com>

mon: fork early to avoid leveldb static env state

leveldb has static state that prevents it from recreating its worker thread
after our fork(), even when we close and reopen the database (tsk tsk!).
Avoid this by forking early, before we touch leveldb.

Hide the details in a Preforker class.  This is modeled after what
ceph-fuse already does; we should convert it later.

Signed-off-by: Sage Weil <sage@inktank.com>
Reviewed-by: Samuel Just <sam.just@inktank.com>
Reviewed-by: Greg Farnum <greg@inktank.com>

doc/release-notes: add/link complete changelogs

Signed-off-by: Sage Weil <sage@inktank.com>

doc/release-notes: v0.56.5

Signed-off-by: Sage Weil <sage@inktank.com>

doc: Fixed typos.

Signed-off-by: John Wilkins <john.wilkins@inktank.com>

Merge branch 'next'

Revert "mon: fix Monitor::pick_random_mon()"

This reverts commit 741f46852380c8e75669f6d7bf1202adad0358fb.

This is fixed in next; revert this to avoid a conflict.

Signed-off-by: Sage Weil <sage@inktank.com>

Merge remote-tracking branch 'gh/wip-mon-rank' into next

Reviewed-by: Greg Farnum <greg@inktank.com>
Reviewed-by: Sage Weil <sage@inktank.com>

doc/install/upgrading...: note that argonaut->bobtail->cuttlefish must be v0.56.5

Which will be released shortly.

Signed-off-by: Sage Weil <sage@inktank.com>

tools/: add paranoid option to ceph-osdomap-tool

Signed-off-by: Samuel Just <sam.just@inktank.com>
Reviewed-by: Greg Farnum <greg@inktank.com>

osd: default 'osd leveldb paranoid = false'

Signed-off-by: Sage Weil <sage@inktank.com>

librados,client: bump mount timeout to 5 min

30 seconds is pretty short.

Signed-off-by: Sage Weil <sage@inktank.com>
Reviewed-by: Josh Durgin <josh.durgin@inktank.com>

Merge pull request #251 from bkerensa/patch-1

Improve verbiage

Signed-off-by: Benjamin Kerensa <bkerensa@ubuntu.com>

OSD: also walk maps individually for start_split in consume_map()

We need to go map-by-map to get the parents right in consume_map()
just as we must in load_pgs().

Fixes: 4884
Signed-off-by: Samuel Just <sam.just@inktank.com>
Reviewed-by: Greg Farnum <greg@inktank.com>

rgw: increase startup timeout to 5 min

30s is too short.

Signed-off-by: Sage Weil <sage@inktank.com>

Merge branch 'wip-paranoid' into next

doc/install/upgrading...: note about transitioning to ceph-deploy

Signed-off-by: Sage Weil <sage@inktank.com>

doc/release-notes: note about ceph-deploy

Signed-off-by: Sage Weil <sage@inktank.com>

Update debian.rst

"complete list of distributions" should be complete list of releases since we already know what distributions are supported and the list specifies releases. (Wheezy, Precise etc.)

Merge branch 'next'

Merge remote-tracking branch 'gh/wip-doc-cuttlefish' into next

Merge remote-tracking branch 'upstream/wip_4884' into next

Fixes: #4884
Reviewed-by: Greg Farnum <greg@inktank.com>

Makefile,gitignore: ceph-monstore-tool, not ceph_monstore_tool

Signed-off-by: Samuel Just <sam.just@inktank.com>

Makefile: put ceph_monstore_tool in bin_DEBUGPROGRAMS

Signed-off-by: Samuel Just <sam.just@inktank.com>

tools: ceph-osdomap-tool.cc

Add tool for dumping info from osd omap.

Signed-off-by: Samuel Just <sam.just@inktank.com>

OSD: load_pgs() should fill in start_split honestly

In load_pgs(), we previously called assigned children starting
at the loaded pg created between its stored epoch and the current
osdmap to have that pg as their parent.  This is not correct, some
of the children may have been split in subsequent epochs from children
split in earlier epochs.  Instead, do each map individually.

Signed-off-by: Samuel Just <sam.just@inktank.com>

OSD: cancel_pending_splits needs to cancel all descendants

expand_pg_num() and load_pgs() may result in a pg with children
in pending_splits which also have children in pending_splits (etc).

Signed-off-by: Samuel Just <sam.just@inktank.com>

osd: add --osd-leveldb-paranoid flag

Signed-off-by: Sage Weil <sage@inktank.com>

mon: add --mon-leveldb-paranoid flag

This is sort of equivalent to an fsck.

Signed-off-by: Sage Weil <sage@inktank.com>

dumper: fix Objecter locking

Locking expectations changed at some point, and the Dumper wasn't
updated to comply:
1) We need to take the lock for Objecter, as it
doesn't do so on its own any more.
2) We need to drop the lock in several places so that Objecter
can take delivery of messages

Signed-off-by: Greg Farnum <greg@inktank.com>
Reviewed-by: Sage Weil <sage@inktank.com>

Merge remote-tracking branch 'gh/next'

doc/rados/deploy: note that osd delete does not work yet

Signed-off-by: Sage Weil <sage@inktank.com>

doc/rados/deploy: misc edits

Signed-off-by: Sage Weil <sage@inktank.com>

Revert "PaxosService: use get and put for version_t"

This reverts commit e725c3e210b244e090d70c77d937c94f4f63a2be.

These inadvertantely got rid of the prefix portion of the key, which
lead to overwriting the wrong keys.

Fixes: #4872
Signed-off-by: Sage Weil <sage@inktank.com>
Reviewed-by: Samuel Just <sam.just@inktank.com>

mon/Paxos: update first_committed when we trim

The Paxos::trim() -> ::trim_to() path trims old states but does not
update first_committed.  This misinforms later paxos rounds such that
peers think they can participate and end up with COMMIT messages
following the COLLECT/LAST exchange that are for future commits they
can't do anything with and then crash out when they get the BEGIN:

mon/Paxos.cc: 557: FAILED assert(begin->last_committed == last_committed)

Fixes: #4879
Signed-off-by: Sage Weil <sage@inktank.com>
Reviewed-by: Greg Farnum <greg@inktank.com>

mon/Paxos: don't ignore peer first_committed

We go to the effort of keeping a map of the peer's first/last committed
so that we can send the right commits during the first phase of paxos,
but we forgot to record the first value.  This appears to simply be an
oversight.  It is mostly harmless; it just means we send extra states
that the peer already has.

Signed-off-by: Sage Weil <sage@inktank.com>
Reviewed-by: Greg Farnum <greg@inktank.com>

mon: Monitor: fix bug on _pick_random_mon() that would choose an invalid rank

Signed-off-by: Joao Eduardo Luis <joao.luis@inktank.com>

mon: Monitor: use rank instead of name when randomly picking monitors

Signed-off-by: Joao Eduardo Luis <joao.luis@inktank.com>

OSD: clean up in progress split state on pg removal

There are two cases: 1) The parent pg has not yet initiated the split 2) The
parent pg has initiated the split.

Previously in case 1), _remove_pg left the entry for its children in the
in_progress_splits map blocking subsequent peering attempts.

In case 1), we need to unblock requests on the child pgs for the parent on
parent removal.  We don't need to bother waking requests since any requests
received prior to the remove_pg request are necessarily obsolete.

In case 2), we don't need to do anything: the child will complete the split on
its own anyway.

Thus, we now track pending_splits vs in_progress_splits.  Children in
pending_splits are in state 1), in_progress_splits in state 2).  split_pgs
bumps pgs from pending_splits to in_progress_splits atomically with respect to
_remove_pg since the parent pg lock is held in both places.

Fixes: #4813
Signed-off-by: Samuel Just <sam.just@inktank.com>
Reviewed-by: Greg Farnum <greg@inktank.com>

Merge pull request #250 from wido/docs

docs: Various updates for the documentation

docs: Update links to Github and the Tracker

docs: Update the ceph-users join and leave addresses

These were pointing to vger, where only -devel lives.

docs: Update CloudStack RBD documentation

mon: communicate the quorum_features properly when declaring victory.

Fixes #4747.

Signed-off-by: Greg Farnum <greg@inktank.com>
Reviewed-by: Sage Weil <sage@inktank.com>

doc: Incorporating Tamil's feedback.

Signed-off-by: John Wilkins <john.wilkins@inktank.com>

doc: Reordered header levels for visual clarity.

Signed-off-by: John Wilkins <john.wilkins@inktank.com>

doc: Fixed a few typos.

Signed-off-by: John Wilkins <john.wilkins@inktank.com>

doc: Updated the upgrade guide for Aronaut and Bobtail to Cuttlefish.

fixes: #4874

Signed-off-by: John Wilkins <john.wilkins@inktank.com>

doc/release-notes: update cuttlefish release notes to include bobtail

Collapse changes from bobtail -> cuttlefish.

Signed-off-by: Sage Weil <sage@inktank.com>

Merge branch 'wip-4837-election-syncing' into next

Reviewed-by: Sage Weil <sage@inktank.com>

ceph-disk: tolerate /sbin/service or /usr/sbin/service

CentOS/RH has it in /sbin, others in /usr/sbin.

Backport: bobtail
Signed-off-by: Sage Weil <sage@inktank.com>

mon: Monitor: disregard paxos_max_join_drift when deciding whether to sync

We should only rely on whether our paxos version is overlap with whatever
they have -- we'll catch up later with them.

Signed-off-by: Joao Eduardo Luis <joao.luis@inktank.com>

mon: if we get our own sync_start back, drop it on the floor.

We have timeouts that will clean everything up, and this can happen
in some cases that we've decided are legitimate. Hopefully we'll
be able to do something else later.

Signed-off-by: Greg Farnum <greg@inktank.com>