objecter: avoid recursive lock of Objecter::rwlock

Objecter::RequestStateHook::call() already takes read lock of
Objecter::rwlock. Taking read lock again in Objecter::_dump_foo_ops()
can trigger lockdep assertion.

Signed-off-by: Yan, Zheng <zyan@redhat.com>

Merge pull request #6976 from dzafman/wip-13862

osd: fix temp object removal after upgrade

http://pulpito.ceph.com/sage-2016-01-20_17:01:32-upgrade:hammer-x-wip-sage-testing---basic-smithi/

Reviewed-by: Sage Weil <sage@redhat.com>

Merge remote-tracking branch 'gh/jewel'

Merge pull request #7300 from ceph/wip-cmake

cmake: test_build_libcephfs needs ${ALLOC_LIBS}

cmake: test_build_libcephfs needs ${ALLOC_LIBS}

Signed-off-by: Ali Maredia <amaredia@redhat.com>

Merge pull request #7231 from renhwsky/renhw-wip-14369

osd: remove unused OSDMap::set_weightf()

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #7164 from flaf/master

doc: fix "mon osd down out subtree limit" option name

Reviewed-by: Kefu Chai <kchai@redhat.com>

doc: fix "mon osd down out subtree limit" option name

The name of the parameter `mon osd down out subtree limit`
was incorrect (with `downout` instead of `down out`).
Furthermore, the description seemed to me a little bit
ambiguous.

Signed-off-by: François Lafont <francois.lafont@ac-versailles.fr>

Merge pull request #7246 from ukernel/jewel-14377

ceph_test_libcephfs: tolerate duplicated entries in readdir

Reviewed-by: Greg Farnum <gfarnum@redhat.com>

Merge pull request #6205 from jcsp/wip-volume-client

pybind: add ceph_volume_client interface for Manila and similar frameworks

Reviewed-by: Greg Farnum <gfarnum@redhat.com>

Merge pull request #7229 from david-z/wip-master-fix-failling-to-cache-pressure

ceph-fuse: fix double decreasing the count to trim caps

Reviewed-by: Yan, Zheng <zyan@redhat.com>

Merge pull request #7209 from ukernel/jewel-11517

client: check if Fh is readable when processing a read

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #7199 from ukernel/jewel-14254

mds: fix client cap/message replay order on restart

Reviewed-by: Greg Farnum <gfarnum@redhat.com>

Merge pull request #7279 from zaitcev/wip-5073-subuser

rgw: Parse --subuser better

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>

Merge remote-tracking branch 'origin/jewel'

Merge pull request #6496 from ceph/wip-fs-snaptests

qa/workunits/snaps: move snap tests into fs sub-directory

Reviewed-by: Greg Farnum <gfarnum@redhat.com>

Merge pull request #6868 from H3C/wip-11642-cephfuse-useage

ceph-fuse:print usage information when no parameter specified

Reviewed-by: Greg Farnum <gfarnum@redhat.com>

Merge pull request #7270 from cbodley/wip-cmake-execinfo

cmake: add missing check for HAVE_EXECINFO_H

Merge pull request #7280 from zaitcev/wip-5073-update2

rgw: Drop a debugging message

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: Parse --subuser better

This fixes a funny message "ERROR: 'tenant$user != tenant$user'"
in case --subuser='tenant$user' is supplied.

Signed-off-by: Pete Zaitcev <zaitcev@redhat.com>

rgw: Drop a debugging message

A P3-tagged message escaped upstream.

Signed-off-by: Pete Zaitcev <zaitcev@redhat.com>

Merge pull request #7274 from dillaman/wip-helgrind-race-jewel

helgrind: additional race conditionslibrbd: journal replay should honor inter-event dependencies

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

librbd: missing lock on state transition

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

helgrind: annotate false-positive race conditions

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #7272 from dillaman/wip-14385-jewel

qa: disable rbd/qemu-iotests test case 055 on RHEL/CentOSlibrbd: journal replay should honor inter-event dependencies

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #7019 from dillaman/wip-14006

librbd: journal replay should honor inter-event dependencies

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

qa: disable rbd/qemu-iotests test case 055 on RHEL/CentOS

Fixes: #14385
Signed-off-by: Jason Dillaman <dillaman@redhat.com>

cmake: add missing check for HAVE_EXECINFO_H

Signed-off-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #7265 from ceph/wip-14397-disable-xfs-extsize

osd: disable filestore_xfs_extsize by default

Reviewed-by: Sage Weil <sage@redhat.com>

osd: disable filestore_xfs_extsize by default

This option involves a tradeoff: When disabled, fragmentation is worse,
but large sequential writes are faster. When enabled, large sequential
writes are slower, but fragmentation is reduced.

Fixes: #14397

os/kstore: fix u64 decode checks

Signed-off-by: Sage Weil <sage@redhat.com>

Merge branch 'wip-bluestore'

os/bluestore: fix _key_decode_u64 error checks

The data that follows may be binary encoded and null.

Signed-off-by: Sage Weil <sage@redhat.com>

os/bluestore/FreelistManager: switch to std::mutex

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #7211 from cxwshawn/clean-fix

osd: ReplicatedPG: clean up unused function

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #7158 from yuyuyu101/wip-async-cleanup-deleted

msg/async: cleanup dead connection and misc things

Merge pull request #6809 from yuyuyu101/wip-13985

msgr:  fix large message data content length causing overflow

Reviewed-by: Greg Farnum <gfarnum@redhat.com>

Merge pull request #7047 from xiexingguo/xxg-wip-14176

osd: KeyValueStore: fix wrongly placed assert

Reviewed-by: David Zafman <dzafman@redhat.com>

Merge pull request #7142 from xiexingguo/xxg-wip-crush

crushtool: improve usage/tip messages

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #7203 from branch-predictor/bp-use-faster-is-zero

osd: use optimized is_zero in object_stat_sum_t.is_zero()

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #7169 from trociny/fix-bluestore-without-aio

osd: bluestore: don't include when building without libaio

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #5900 from ritz303/wip-doc-12899

doc: Updated the rados command man page to include the --run-name opt…

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #7249 from ceph/wip-fix-cmake-trusty

cmake: fix the build on trusty

librbd: handle additional journal replay states

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

librbd: avoid recursive callback when replaying journal

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

tests: correct googlemock warnings

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

tests: update tests to support replaying snap create / resize

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

librbd: initial hook points for snap create / resize journal replay

After snap create has blocked IO and after resize has ensured clipped
IO boundaries, they will resume the playback of journal events.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

librbd: journal events still possible during shutdown

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

tests: new unit test for snap rollback state machine

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

librbd: snapshot rollback should block writes

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

librbd: track simple maintenance ops to coordinate replay

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

librbd: asynchronously replay journal events

Properly track when AIO operations are safely committed to
disk before marking the journal events are committed.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

tests: unit test cases for all available journal events

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

librbd: initial integration of maintenance op journal replay

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

librbd: AioImageRequest base class is now templated

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

tests: updated librbd test cases for updated maint ops API

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

librbd: moved all maintenance ops to new Operations class

This will permit unit testing and will facilitate proper
serialization of requests (when necessary).

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

tests: journal event handling test updates

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

tests: unit test case for librbd::operation::ResizeRequest

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

librbd: properly order maintenance ops journal events

In general, the op shoud only start after the jouranl event is
safely committed.  Snapshot create and resize need special treatment
to record the event while no IO is in-progress.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

librbd: fixed "hidden" virtual methods

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

librbd: handle journal and IO commits in either sequence

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

librbd: allocate and associate op tids to maint op journal events

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

tests: unit tests for librbd Journal

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

librbd: journal replay flush should be async

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

librbd: convert journal classes to templates for unit testing

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

tests: compile RBD and RGW types into ceph-dencoder when enabled

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

librbd: move journal support classes to journal namespace

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

cmake: fix the build on trusty

Signed-off-by: Kefu Chai <kchai@redhat.com>

ceph_test_libcephfs: tolerate duplicated entries in readdir

If a dirfrag get fragmented in the middle of readdir, the readdir
result may contain duplicated entries. (but there shouldn't be
any missing entries)

Fixes: #14377
Signed-off-by: Yan, Zheng <zyan@redhat.com>

osd:osdmap some clean up

remove set_weightf

Fixes: #14369
Signed-off-by: huanwen ren <ren.huanwen@zte.com.cn>

mds: add config option to suspend logging

The option creates long-standing unsafe MDS requests. It help in
testing unsafe request related corner cases.

Signed-off-by: Yan, Zheng <zyan@redhat.com>

mds: fix completed cap flush handling

Client re-send cap flush when MDS restarts. The cap flush message
may release some caps even if the corresponding flush is already
completed.

Fixes: #13546
Signed-off-by: Yan, Zheng <zyan@redhat.com>

mds: delay handling client caps until corresponding inode is created

When handling client caps in clientreplay stage, it's possible that
corresponding inode does not exist because the client request which
creates inode hasn't been replayed. To handle this corner case, we
delay handling caps message until corresponding inode is created.

Fixes: #14254
Signed-off-by: Yan, Zheng <zyan@redhat.com>

Merge branch 'wip-compressor'

Reviewed-by: Sage Weil <sage@redhat.com>

Compressor: compressor plugins unit tests

Signed-off-by: Alyona Kiseleva <akiselyova@mirantis.com>

Compressor: compressor code extention: plugin system added

Signed-off-by: Alyona Kiseleva <akiselyova@mirantis.com>

Merge pull request #6425 from branch-predictor/bp-delayed-pglog-index-v2

osd: delay populating in-memory PG log hashmaps

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #6797 from mathslinux/fix-parse-return

rgw: fix wrong check for parse() return

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #7087 from H3C/wip-yrf-cephdf

mon: add RAW USED column to ceph df detail

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #7106 from tchaikov/wip-11101

ceph: improve the error message

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #7122 from xiexingguo/xxg-wip-bluefs

osd: bluestore: fix several bugs

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #7196 from liewegas/wip-bluestore

osd: bluestore: fix space rebalancing, collection split, buffered reads

Merge pull request #7200 from xiexingguo/xxg-wip-14343

osd: bluestore: bluefs: fix several small bugs

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #7213 from xiexingguo/xxg-wip-14351

osd: kstore: several small fixes

Reviewed-by: Sage Weil <sage@redhat.com>

Merge remote-tracking branch 'upstream/jewel'

Merge pull request #7222 from dack/master

ceph-disk: add -f flag for btrfs mkfs

Reviewed-by: Sage Weil <sage@redhat.com>

Merge branch 'greg-fs-testing'

fsx: checkout old version until it compiles properly on miras

I sent a patch to xfstests upstream at
http://article.gmane.org/gmane.comp.file-systems.fstests/1665, but
until that's fixed we need a version that works in our test lab.

Signed-off-by: Greg Farnum <gfarnum@redhat.com>

Merge branch 'wip-13569' of git://github.com/ukernel/ceph into greg-fs-testing

https://github.com/ceph/ceph/pull/6463

Reviewed-by: Greg Farnum <gfarnum@redhat.com>

Merge branch 'wip-13127-master' into greg-fs-testing

https://github.com/ceph/ceph/pull/5990

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge remote-tracking branch 'origin/wip-libcephfs-acl' into greg-fs-testing

https://github.com/ceph/ceph/pull/5658

Reviewed-by: John Spray <jspray@redhat.com>
Conflicts:
src/common/config_opts.h

Signed-off-by: Greg Farnum <gfarnum@redhat.com>

Merge branch 'wip-root-metadata' of git://github.com/jcsp/ceph into greg-fs-testing

https://github.com/ceph/ceph/pull/6179

Reviewed-by: Greg Farnum <gfarnum@redhat.com>

doc/release-notes: v10.0.2

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #7235 from theanalyst/fix/pybind-build-failure

pybind: fix build failure, remove extraneous semicolon in method

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

pybind/rbd.pyx: drop stray semicolon

Signed-off-by: Sage Weil <sage@redhat.com>

os/bluestore/FreelistManager: fix _dump locking

Signed-off-by: Sage Weil <sage@redhat.com>

pybind: remove extraneous semicolon in method

A semicolon on `rbd_build_object_map` method was causing build failures
in current master

Fixes: #14371
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>

osd: less chatter about tick

Signed-off-by: Sage Weil <sage@redhat.com>