do_autogen.sh: add missing '--without-lttng' option to usage

Signed-off-by: Nathan Cutler <ncutler@suse.cz>

Merge pull request #4333 from dachary/wip-fedora

tests: add Dockerfile for fedora 21

Reviewed-by: Kefu Chai <kchai@redhat.com>

tests: add Dockerfile for fedora 21

Signed-off-by: Loic Dachary <ldachary@redhat.com>

Merge pull request #4306 from dachary/wip-ec-troubleshooting

doc: an erasure code crush ruleset can be dynamically modified

Reviewed-by: Greg Farnum <gfarnum@redhat.com>

Merge pull request #4320 from liewegas/wip-crush-straw2-div0

crush/mapper: fix divide-by-0 in straw2

Reviewed-by: Yann Dupont <yann@objoo.org>
Reviewed-by: Loic Dachary <ldachary@redhat.com>

crush/mapper: fix divide-by-0 in straw2

If the item weight is 0 we don't want to divide; instead draw a minimal
value.

Fixes: #11357
Reported-by: Yann Dupont <yd@objoo.org>
Tested-by: Yann Dupont <yd@objoo.org>
Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #4174 from trociny/wip-10976.master

osd: fix PG::all_unfound_are_queried_or_lost for non-existent osds

Reviewed-by: Kefu Chai <tchaikov@gmail.com
Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #4111 from wonzhq/hitsets-check

osd/ReplicatedPG: correct the checking if the promoting object is in other hit sets

Reviewed-by: Kefu Chai <tchaikov@gmail.com>

Merge pull request #4136 from XinzeChi/wip-pg-delete-sleep

osd: return fast if PG::deleting is true in snap_trimmer and PG::scrub

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #4178 from XinzeChi/wip-tracker-message

osd: more useful message to find out potential unhealth osd

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #4155 from wonzhq/prdop

osd/ReplicatedPG: don't check order in finish_proxy_read

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #4139 from Ved-vampir/oscnt

Perf counters descriptions

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #3928 from dmitryya/rados_bench_with_iops_metric

rados bench: Add IOPS metric to `rados bench'

Reviewed-by: Loic Dachary <ldachary@redhat.com>

Merge pull request #4253 from majianpeng/scrub-fix2

Scrub bug fix

Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #4224 from rzarzynski/wip-10682_bucketlisting

rgw: add support for end_marker parameter for GET on Swift container.

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>

Merge pull request #4305 from Ved-vampir/rgw

rgw: add perf counters descriptions

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>

Merge pull request #4240 from 9seconds/post_check_quotas

rgw: Quota not respected in POST object

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>

Merge pull request #4268 from guangyy/wip-11322

rgw : Issue AIO for next chunk first before flush the (cached) data.

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>

Merge pull request #4315 from dachary/wip-workflow

doc: development workflows

Reviewed-by: Alistair Israel <aisrael@gmail.com>

doc: when and why publish a point release

Explain who decides when to cut a point release and the tradeoffs
involved.

Signed-off-by: Loic Dachary <ldachary@redhat.com>

doc: add Hammer to the release timeline

Signed-off-by: Loic Dachary <ldachary@redhat.com>

Merge pull request #4233 from ceph/wip-librbd-aio-request

librbd: simplify AioRequest constructor parameters

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge remote-tracking branch 'origin/wip-2862'

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Conflicts:
src/common/ceph_argparse.cc
src/rbd.cc

Merge pull request #4307 from dzafman/wip-dz-cmd-fix

osd: Fix wrong usage for "ceph tell osd.* debug dump_missing"

Reviewed-by: Dan Mick <dmick@redhat.com>

osd: Fix wrong usage for "ceph tell osd.* debug dump_missing"

Signed-off-by: David Zafman <dzafman@redhat.com>

Merge pull request #4304 from Ved-vampir/mds

mds: add perf counters descriptions

Reviewed-by: John Spray <john.spray@redhat.com>

rgw: add perf counters descriptions

Sign-off-by: Alyona Kiseleva <akiselyova@mirantis.com>

doc: an erasure code crush ruleset can be dynamically modified

Signed-off-by: Loic Dachary <ldachary@redhat.com>

mds: add perf counters descriptions

Sign-off-by: Alyona Kiseleva <akiselyova@mirantis.com>

doc/release-notes: note about SHEC

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #4274 from liewegas/wip-osd-cleanup

osd: remove some dead(ish) code

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #4301 from nilamdyuti/wip-doc-ceph-object-gateway

doc: Corrects rgw.conf file path for Debian-based and RPM-based distros
in radosgw man page.

Reviewed-by: Ken Dreyer <kdreyer@redhat.com>

doc: Corrects rgw.conf file path for Debian-based and RPM-based distros
in radosgw man page.

Signed-off-by: Nilamdyuti Goswami <ngoswami@redhat.com>

Merge pull request #4294 from ktdreyer/wip-readme-rm-old-ubuntu

README: rm references to old Ubuntu distros

Reviewed-by: Loic Dachary <ldachary@redhat.com>

Merge pull request #4289 from dachary/wip-docker-user

tests: allow multiple users of docker-tests.sh

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #4210 from trociny/fix-11261

ceph_argparse: return false instead exiting when argument is missed

Reviewed-by: Kefu Chai <kchai@redhat.com>

TestCase: Change in testcase output

For the local sanity test to pass this change is needed as the output message changes.

Signed-off-by: Rajesh Nambiar <rajesh.n@msystechnologies.com>

 Fix to some of the command line parsing (including rbd)

Fix#: 2862

Changes to some of the common files for command line parsing

Change to ceph_argparse.cc
-------------------------

Added function ceph_arg_value_type()
  Given an input it will determine
   i) If that input is an option or not
   ii) If input is numeric in nature or not.

  It will set the flag bool_option and bool_numeric appropriately.
  This function is called by ceph_argparse_witharg() to figure out if
  the input parameter to those functions are numeric in nature and not
  an option.  If the input parameter to ceph_argparse_witharg()
  happens to be an option then it implies that user didn't supply
  value to the option.

Changes to strol.cc
-------------------
Changes to strict_strtoll() and strict_strtol()

  Both these functions reponsibility is to convert the string to long or to int.
  I felt it may be not be good for it to display error message within this function,
  rather caller of this function who has better understanding of the function's purpose
  can display the error message.

  Made change in this function to just create a generic error message,Its the
  caller of this function decides what to do with this message.

Signed-off-by: Rajesh Nambiar <rajesh.n@msystechnologies.com>

rbd: create command throws inappropriate error messages

Fixes: #2862
Changes related to rbd file

Changes to rbd.cc
-----------------

Change 1: line# 2744 to 2747

 If the option is --order then do the check of its value if its less
 than 12 or greaterthan 25 then throw error. Correct value of --order
 is 12 to 25.

Change 2: Removal of validation from line# 3205 to 3209

  Since the check for correct value of --order is done before hence the
  check here is not needed.

Signed-off-by: Rajesh Nambiar <rajesh.n@msystechnologies.com>

Merge pull request #4288 from fullerdj/wip-rbd-xfstests-201504

RBD: build xfsdump and xfsprogs from source; set new expunge set for xfstests

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

RBD: update expunge set for latest test, parameterize test script

Update expunge set for xfstests to known-good set for RHEL7 and Ubuntu 14.04.
Expunged tests without justifying comments are long-running and have not yet
been thoroughly investigated.

Add an environment variable (optionally passed from xfstests_url variable in
test YAML) to override the default xfstests repo.

Signed-off-by: Douglas Fuller <dfuller@redhat.com>

RBD: build prerequisites for latest xfstests and update test configuration

To standardize results from xfstests, install specific versions of xfstests,
xfsprogs, and xfsdump in /tmp. Move test mountpoints to /tmp/cephtest to allow
access for fsgqa user expected by xfstests.

XXX: xfsdump required significant hacks to build and install on Ubuntu 14.04.
A developer removed the definitions of the min and max macros; this commit is
reverted by this script. The installation paths are difficult to override and
the installer breaks (trying to ln one of the binaries to itself) when an
alternate installation location is specified. This script ignores this error
(make -k install || true).

Signed-off-by: Douglas Fuller <dfuller@redhat.com>

README: rm references to old Ubuntu distros

Support for Ubuntu 11.04 officially ended on 28 October 2012.

Support for Ubuntu Oneiric Ocelot was officially ended on 9 May 2013.

Remove the references to these EOL distro versions.

Signed-off-by: Ken Dreyer <kdreyer@redhat.com>

Merge pull request #4292 from ceph/wip-11342

librbd: moved snap_create header update notification to initiator

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #4281 from wonzhq/readahead

librbd: readahead fixes

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

doc/release-notes: spelling

Signed-off-by: Sage Weil <sage@redhat.com>

doc/release-notes: correction

There isn't an upgrade f-g-x suite

Signed-off-by: Sage Weil <sage@redhat.com>

librbd: moved snap_create header update notification to initiator

When handling a proxied snap_create operation, the client which
invoked the snap_create should send the header update notification
to avoid a possible race condition where snap_create completes but
the client doesn't see the new snapshot (since it didn't yet receive
the notification).

Fixes: #11342
Signed-off-by: Jason Dillaman <dillaman@redhat.com>

doc/release-notes: final hammer notes

Signed-off-by: Sage Weil <sage@redhat.com>

Merge remote-tracking branch 'gh/hammer'

Conflicts:
src/gmock

Merge pull request #4291 from ceph/wip-doc-fixes

Wip doc fixes

Reviewed-by: Loic Dachary <ldachary@redhat.com>

doc/release-notes: make a note about rgw deployment; tweak dedication

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #4283 from oritwas/multizone

rgw: remove meta file after deleting bucket

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>

0.94

librbd: simplify AioRequest constructor parameters

Moved all parent overlap computation to within AioRequest so that
callers don't need to independently compute the overlap.  Also
removed the need to pass the snap_id for write operations since
it can only be CEPH_NOSNAP.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

man: enable warning msgs for "all" target

* and remove `local-check` target. because we have killed all warnings,
  and `make check` depends on `am-all` actually. so previously, `make check`
  basically does nothing at all for validating the man pages' syntax.
  `make all` has rendered them already.
* do not run sphinx-build if $(top_srcdir)/doc/man does not exist. this
  is exactly the case of `make install` from a dist tarball.
* remove generated man pages in `make maintainer-clean` not in `make
  clean`, because we don't ship .rst files in the dist tarball.

Signed-off-by: Kefu Chai <kchai@redhat.com>

doc: ref 9/ceph-mon using relative path

sphinx complains when it failed to find the referenced file using the
absolute path whose root is the $(top_srcdir)/doc/man when rendering
man pages. but it is able to find it when rendering the html, because
build-doc specifies $(top_srcdir)/doc/ as the source directory.

Signed-off-by: Kefu Chai <kchai@redhat.com>

doc: add ":orphan:" field to avoid sphinx warnings

when building man pages from rst files, sphinx complains if any
rst file is not referenced by a doctree.

Signed-off-by: Kefu Chai <kchai@redhat.com>

man: ignore fieldlist when getting desc for manpages

this change will enable us to specify `:orphan:` in the fieldlist of
a manpage rst file, otherwise sphinx-build complains at seeing it if
it is not referenced by a toc doc.

Signed-off-by: Kefu Chai <kchai@redhat.com>

doc: fix sphinx warnings

* fix `Inline literal start-string without end-string` warnings.
* fix `Title underline too short` warning

Signed-off-by: Kefu Chai <kchai@redhat.com>

doc: fix sphinx warnings

fix `Inline literal start-string without end-string` warnings.

Signed-off-by: Kefu Chai <kchai@redhat.com>

man: appease sphinx by providing a toc doc

Fixes: #11324
Signed-off-by: Kefu Chai <kchai@redhat.com>

man: point man/conf.py and Makefile to doc/man

Fixes: #11320
Signed-off-by: Kefu Chai <kchai@redhat.com>

man: move man/8/*.rst back to doc/man/8

sphinx requires that a document tree to be in a single directory,
and the man pages are references by our document. so a simple solution
would be to put all the rst file under a single directory.

Fixes: #11320
Signed-off-by: Kefu Chai <kchai@redhat.com>

doc: fix a typo which use "::" for ":"

Signed-off-by: Kefu Chai <kchai@redhat.com>

doc: fix "Title underline too short" warning

Signed-off-by: Kefu Chai <kchai@redhat.com>

doc: fix sphinx warnings

* kill "Inline strong start-string without end-string" warning by
  removing superfluous '*'

Signed-off-by: Kefu Chai <kchai@redhat.com>

doc: remove duplicated option doc

sphinx complains:
SEVERE: Duplicated ID: "cmdoption-radosgw-admin--bucket"
at seeing duplicated `--bucket` option in radosgw-admin.rst. and
there is a global `--bucket` for all commands of radosgw, so remove
the one for the `quota` command.

Signed-off-by: Kefu Chai <kchai@redhat.com>

rgw: add support for end_marker for GET on Swift container.

Fixes: #10682
Backport: hammer
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

tests: remove dead code in docker-test-helper.sh

Signed-off-by: Loic Dachary <ldachary@redhat.com>

tests: allow multiple users of docker-tests.sh

The docker image created by docker-tests.sh for a given operating system
is parameterized with the user name. If two users on the same machine
try to use the same image, they will compete and fail with an error
like:

... user get supplementary groups Unable to find user ...

Add the $USER to the image name to reflect the fact that they contain an
account for this user.

Signed-off-by: Loic Dachary <ldachary@redhat.com>

Merge pull request #4273 from dachary/wip-docker-ccache

tests: docker-test must bind mount .ccache

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #4255 from Ved-vampir/osdccnt

Perf counters descriptions, new part

Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Joao Eduardo Luis <jluis@suse.com>

Merge pull request #4286 from tchaikov/readable-href-in-admonition

doc: show href anchor in white in important block

Reviewed-by: Loic Dachary <ldachary@redhat.com>

Merge pull request #4287 from dachary/wip-sphinx

spec.in: sphinx -b man needs sphinx > 1.0 (part 2)

Reviewed-by: Owen Synge <osynge@suse.com>

doc: show href anchor in white in important block

Fixes: #11310
Signed-off-by: Kefu Chai <kchai@redhat.com>

mon: add perf counters description

Sign-off-by: Alyona Kiseleva <akiselyova@mirantis.com>

Merge pull request #4265 from trociny/wip-11319

ceph daemonperf: add watch interval and count parameters

Reviewed-by: John Spray <john.spray@redhat.com>

spec.in: sphinx -b man needs sphinx > 1.0 (part 2)

Instead of listing the operating system versions that do not require the
python-sphinx10 package, switch to listing the operating system versions that
require the python-sphinx10 package. It's easier to maintain because
there only are a few.

Signed-off-by: Loic Dachary <ldachary@rehdat.com>

Merge pull request #4271 from nehaummareddy/master

doc: Replaced with apt word and fixed grammatical error

Reviewed-by: Loic Dachary <ldachary@redhat.com>

rgw: remove meta file after deleting bucket
The meta file is deleted only if the bucket meta data is not synced

Signed-off-by: Orit Wasserman <owasserm@redhat.com>
Fixes: #11149
Backport: hammer, firefly

doc: Replaced with apt word and fixed grammatical error

Signed-off-by: Neha Ummareddy <nehaummareddy@gmail.com>

rgw: quota not respected in POST object

Signed-off-by: Sergey Arkhipov <nineseconds@yandex.ru>
Backport: hammer, firefly
Fixes: #11323

librbd: don't do readahead when m_readahead_pos reaching limit

When m_readahead_pos reaches the limit, there's no need to call
_compute_readahead to calculate the readahead. Just return with no
readahead.

Signed-off-by: Zhiqiang Wang <zhiqiang.wang@intel.com>

librbd: start readahead from m_last_pos when the size of the continuing
triggering request is big enough

If the size of the read triggering the continuing readahead is such big
that exceeding m_readahead_pos, should do the readahead starting from
m_last_pos.

Signed-off-by: Zhiqiang Wang <zhiqiang.wang@intel.com>

Merge pull request #3867 from wonzhq/fiemap

FileStore: fiemap implementation using SEEK_HOLE/SEEK_DATA

Reviewed-by: Haomai Wang <haomaiwang@gmail.com>
Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #3170 from tchaikov/python-rados-refactor

python-rados: extract type-checking into a decorator

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Loic Dachary <ldachary@redhat.com>

Merge pull request #3560 from XinzeChi/wip-pmon-all

ceph.in: add ceph ping mon.* for ping all monitor

Reviewed-by: Loic Dachary <ldachary@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #3879 from liewegas/wip-cache-mode-none

mon: warn if cache_mode is none and pool is a read or writ eoverlay tier

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #3980 from ceph/wip-rbd-update-features

librbd: add support for updating image features

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge remote-tracking branch 'gh/hammer'

Conflicts:
src/gmock

Merge pull request #4133 from rzarzynski/wip-10645

rgw: improve metadata handling on object copy operation of Swift API.

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>

Merge pull request #4280 from jdurgin/wip-lttng-build

debian: remove lttng checking from rules

Reviewed-by: Sage Weil <sage@redhat.com>

debian: remove lttng checking from rules

This can be done better in a separate script, which puts these in
CEPH_EXTRA_CONFIGURE_ARGS. In particular, this lets us enable
lttng for gitbuilder builds, but not release builds.

Fixes: #11333
Signed-off-by: Josh Durgin <jdurgin@redhat.com>
(cherry picked from commit a294daff0bb69a7e0951f98c9497ccb22e91e705)

debian: remove lttng checking from rules

This can be done better in a separate script, which puts these in
CEPH_EXTRA_CONFIGURE_ARGS. In particular, this lets us enable
lttng for gitbuilder builds, but not release builds.

Fixes: #11333
Signed-off-by: Josh Durgin <jdurgin@redhat.com>

Update PendingReleaseNotes for firefly change, rgw socket path related

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

librbd: remove object maps when disabling

If the object map feature is disabled, remove any object maps
prior to disabling the feature.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

librbd: flag the snapshot object map as invalid when error occurs

Instead of flagging the HEAD image object map as invalid when an
error occurs with a snapshot object map, properly flag the snapshot
as invalid.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

rbd: add feature enable/disable support

Mutable image features can now be enabled/disabled via
the rbd CLI.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

tests: add update_features test to test_librbd

Signed-off-by: Jason Dillaman <dillaman@redhat.com>