adding contributor credits script

Signed-off-by: Patrick McGarry <pmcgarry@redhat.com>

Merge pull request #13223 from wjwithagen/wip-wjw-freebsd-sphynx

build/install-deps.sh: Add sphinx package for building docs on FreeBSD

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #11448 from ledgr/change/mount_fuse_ceph_options_in_fs_mntops_and_python

Rewrite mount.fuse.ceph (to python) and move ceph-fuse options to fs_mntops

Reviewed-by: John Spray <john.spray@redhat.com>

Merge pull request #13194 from smithfarm/wip-16263

tests: ignore bogus ceph-objectstore-tool error in ceph_manager

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: David Zafman <dzafman@redhat.com>

Merge pull request #13234 from ifed01/wip-bluestore-performance-sandbox2017

os/bluestore: fix potential assert in cache _trim method.

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #12965 from linuxbox2/wip-librgw-expand-argv

rgw_file:  split last argv on ws, if provided

rgw_file:  split last argv on ws, if provided

This is intended to allow an "extra" unparsed argument string
containing various cmdline options to be passed as the last argument
in the argv array of librgw_create(), which nfs-ganesha is
expecting to happen.

While at it, hook env_args() too.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>

Merge pull request #12335 from theanalyst/mailmap/v11.1.0

mailmap updates for v11.1.0

Reviewed-by: Loic Dachary <ldachary@redhat.com>

ceph_test_objectstore: match clone_range src and dst offset

This is what the OSD does, and BlueStore doesn't necessarily handle
all combinations of different offsets.

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #13211 from liewegas/wip-clone-offsets

ceph_test_objectstore: match clone_range src and dst offset

Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>

Merge pull request #12904 from ifed01/wip-bluestore-onode-refmap3

os/bluestore: replace Blob ref_map with reference counting

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #13192 from liewegas/wip-bluestore-min-alloc-size

os/bluestore: fix min_alloc_size at mkfs time

Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>

os/bluestore: fix potential assert in cache _trim method.

Signed-off-by: Igor Fedotov <ifedotov@mirantis.com>

Merge pull request #13158 from dillaman/wip-18594

qa: integrate OpenStack 'gate-tempest-dsvm-full-devstack-plugin-ceph'

Reviewed-by: Mykola Golub <mgolub@mirantis.com>

Merge pull request #13225 from tmuthamizhan/wip-ansible-m

qa: do not mention ceph branch explicitly

do not mention ceph branch explicitly

no need to mention ceph_dev_branch explicitly. it will be taken from the
ceph branch value mentioned in the teuthology-suite command

Signed-off-by: Tamil Muthamizhan <tmuthami@redhat.com>

build/install-deps.sh: Add sphinx package for DOCS

Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>

Merge pull request #13009 from liewegas/wip-mempool-bloom-filter

mempool: put bloom_filter in mempool

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #13136 from liewegas/wip-scrub-waitlist

osd: use separate waitlist for scrub

Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #12104 from pritha-srivastava/wip_sts_role_rest

rgw: Added code for REST APIs for AWS Roles.

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #13189 from gaurav36/bug-18326-image-rename-non-rbd-pool

rbd: destination pool should be source pool if it is not specified

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #12948 from trociny/wip-17020

rbd-mirror: add support for active/passive daemon instances

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #13013 from wangzhengyong/master

os/bluestore: remove no use parameter in bluestore_blob_t::map_bl

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #12782 from atheism/rgw-orphan-fix-error-messages

rgw: orphan: fix error messages

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #13199 from chipitsine/master

mds,mon: Clean issues detected by cppcheck

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #13203 from ifed01/wip-bluestore-more-dump

os: extend ObjectStore interface to dump store's performance counters

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #12974 from ukernel/wip-multimds-misc

mds: miscellaneous fixes

Reviewed-by: John Spray <john.spray@redhat.com>

qa/suites/rbd: add rbd-mirror-ha test

Signed-off-by: Mykola Golub <mgolub@mirantis.com>

qa/workunits/rbd: tweaks to use RBD_MIRROR_USE_EXISTING_CLUSTER locally

This var is mostly used when running rbd_mirror test scripts on
teuthology.  It can be used locally though to speedup re-running the
tests:

Set a test temp directory:

  export RBD_MIRROR_TEMDIR=/tmp/tmp.rbd_mirror

Run the tests the first time with NOCLEANUP flag (the cluster and
daemons are not stopped on finish):

  RBD_MIRROR_NOCLEANUP=1 ../qa/workunits/rbd/rbd_mirror.sh

Now, to re-run the test without restarting the cluster, run cleanup
with USE_EXISTING_CLUSTER flag:

  RBD_MIRROR_USE_EXISTING_CLUSTER=1 \
    ../qa/workunits/rbd/rbd_mirror_ha.sh cleanup

and then run the tests:

  RBD_MIRROR_USE_EXISTING_CLUSTER=1
    ../qa/workunits/rbd/rbd_mirror_ha.sh

Signed-off-by: Mykola Golub <mgolub@mirantis.com>

qa/workunits/rbd: tests for rbd mirror HA

Signed-off-by: Mykola Golub <mgolub@mirantis.com>

qa/workunits/rbd: allow to start several daemons for the same cluster

by optionally specifyning daemon instance after cluster name and
colon, like:

  start_mirror ${cluster}:${instance}

Signed-off-by: Mykola Golub <mgolub@mirantis.com>

rbd-mirror HA: pool replayer should be started/stopped when lock acquired/released

Fixes: http://tracker.ceph.com/issues/17020
Signed-off-by: Mykola Golub <mgolub@mirantis.com>

rbd-mirror HA: create pool locker / leader class

Fixes: http://tracker.ceph.com/issues/17019
Signed-off-by: Mykola Golub <mgolub@mirantis.com>

rbd-mirror HA: add new lock released/acquired and heartbeat messages

Fixes: http://tracker.ceph.com/issues/17018
Signed-off-by: Mykola Golub <mgolub@mirantis.com>

rbd-mirror: add class for mirror status watcher

Signed-off-by: Mykola Golub <mgolub@mirantis.com>

librbd: equality operator for managed_lock::Locker

Signed-off-by: Mykola Golub <mgolub@mirantis.com>

librbd: add create_async_context_callback helper

Signed-off-by: Mykola Golub <mgolub@mirantis.com>

librbd: missing const qualifiers

Signed-off-by: Mykola Golub <mgolub@mirantis.com>

librbd: track in-fly break_lock and get_locker requests in managed lock

Signed-off-by: Mykola Golub <mgolub@mirantis.com>

librbd: pass notifier_id to Watcher handle_notify

Signed-off-by: Mykola Golub <mgolub@mirantis.com>

librbd: allow watcher derived classes access ioctx, oid and work queue

Signed-off-by: Mykola Golub <mgolub@mirantis.com>

rbd: destination pool should be source pool if it is not specified

Currently if user perform image rename operation and user give pool
name as a optional parameter (--pool=<pool_name>) then currently
its taking this optional pool name for source pool and making
destination pool name default pool name.
With this fix if user provide pool name as a optional pool name
parameter then it  will consider both soruce and destination pool
name as optional parameter pool name.

Fixes: http://tracker.ceph.com/issues/18326
Reported-by: МАРК КОРЕНБЕРГ <socketpair@gmail.com>
Signed-off-by: Gaurav Kumar Garg <garg.gaurav52@gmail.com>

ceph_test_objectstore: match clone_range src and dst offset

This is what the OSD does, and BlueStore doesn't necessarily handle
all combinations of different offsets.

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #13077 from guzhongyan/fix_wrongly_init

librbd: initialize diff parent overlap to zero

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #12537 from liewegas/wip-optracker

common/TrackedOp: various cleanups and optimizations

Reviewed-by: Greg Farnum <gfarnum@redhat.com>

Merge pull request #13205 from dachary/wip-crush-documentation

crush: API documentation

Reviewed-by: Sage Weil <sage@redhat.com>

os/bluestore: decode min_alloc_size into temp var

Defend against future changes to min_alloc_size.

Signed-off-by: Sage Weil <sage@redhat.com>

crush: API documentation

Signed-off-by: Loic Dachary <loic@dachary.org>

os/bluestore: fix min_alloc_size at mkfs time

It is an ongoing challenge to allow min_alloc_size to be varied on
an existing bluestore instance, and the code paths are not well
tested.  Avoid the complexity entirely by fixing min_alloc_size at
mkfs time.

Signed-off-by: Sage Weil <sage@redhat.com>

os/bluestore: add ondisk format version info to super section

Note the version of the ondisk format and the oldest version that is
allowed to read us.

Signed-off-by: Sage Weil <sage@redhat.com>

os/bluestore: EIO if we can't read some existing super keys

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #13164 from dzafman/wip-18718

osd: Fix useless MAX(0, unsigned) to prevent out of wack misplaced

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>

os/bluestore: add submit latency perf counter.

Signed-off-by: Igor Fedotov <ifedotov@mirantis.com>

test/fio: add performance counters dump on FIO job completion.

Signed-off-by: Igor Fedotov <ifedotov@mirantis.com>

os: add dump_perf_counters method to ObjectStore implementations.

Signed-off-by: Igor Fedotov <ifedotov@mirantis.com>

os/bluestore: fix typos in perf counter public names.

Signed-off-by: Igor Fedotov <ifedotov@mirantis.com>

test/fio: fix misordered parameter for queue_transaction.

Signed-off-by: Igor Fedotov <ifedotov@mirantis.com>

Merge pull request #13193 from dillaman/wip-18738

journal: stop processing removal after error

Reviewed-by: Mykola Golub <mgolub@mirantis.com>

Merge pull request #13069 from SUSE/wip-hammer-retirement

doc: add 0.94.10 and hammer EOL to releases.rst

Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>

Clean issues detected by cppcheck

[src/mds/MDLog.cc:1172] -> [src/mds/MDLog.cc:1173]: (warning) Either the condition 'sle!=NULL' is redundant or there is possible null pointer dereference: sle.
[src/mon/MDSMonitor.cc:2622] -> [src/mon/MDSMonitor.cc:2625]: (warning) Either the condition 'mds_map!=nullptr' is redundant or there is possible null pointer dereference: mds_map.

Signed-off-by: Ilya Shipitsin <chipitsine@gmail.com>

Merge pull request #13151 from smithfarm/wip-ceph-release-notes

tools: ceph-release-notes: ignore low-numbered PRs

Merge pull request #13190 from Adirl/reduce_num_buffers

msg/async/rdma: reduce number of rdma rx/tx buffers

Reviewed-by: Haomai Wang <haomai@xsky.com>

Merge pull request #13066 from liewegas/wip-aio-read

os/bluestore: use aio for reads

Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>

Merge pull request #13071 from liewegas/wip-omap-getkeys-rados-test

qa/suites/rados/basic: set low omap limit for rgw workload

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #13150 from tchaikov/wip-mon-cleanup

mon: post-jewel cleanups

Reviewed-by: Sage Weil <sage@redhat.com>

osd: use distinct wait list for scrub

We've traditionally (ab)used waiting_for_active for ops blocked
by scrub.  In order to preserve the op requeue ordering for
backoffs relating to unreadable and degraded, however, we need
to order the scrub waits different.  The first step is to have it
on its own list.

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #12966 from dillaman/wip-18436

osdc: cache should ignore error bhs during trim

Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Gregory Farnum <gfarnum@redhat.com>

Merge pull request #12800 from jcsp/wip-vstart-qasuite

Improve vstart_runner to (optionally) create its own cluster

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

tests: ignore bogus ceph-objectstore-tool error in ceph_manager

Fixes: http://tracker.ceph.com/issues/16263
Signed-off-by: Nathan Cutler <ncutler@suse.com>

Merge pull request #12817 from liupan1111/wip-list-snapshot-time

librbd: support to list snapshot timestamp

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

doc: update actual firefly and estimated hammer retirement

According to the "Understanding the release cycle" section, firefly was
actually retired when jewel was released (April 2016), and hammer will be
retired when luminous is released (estimated in May 2017).

Signed-off-by: Nathan Cutler <ncutler@suse.com>

doc: add 0.94.10 to releases.rst

Signed-off-by: Nathan Cutler <ncutler@suse.com>

Merge pull request #13098 from wido/doc-osd-greace

doc: Document that osd_heartbeat_grace applies to MON and OSD

Reviewed-by: Joao Eduardo Luis <joao@suse.de>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>

journal: stop processing removal after error

Fixed: http://tracker.ceph.com/issues/18738
Signed-off-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #13141 from dillaman/wip-18653

librbd: introduce new constants for tracking max block name prefix

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>

librbd: introduce new constants for tracking max block name prefix

Fixes: http://tracker.ceph.com/issues/18653
Signed-off-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #13188 from liewegas/wip-rest-fs-name

qa/workunits/rest: use unique pool names for cephfs test

Reviewed-by: Kefu Chai <kchai@redhat.com>

test: regolden formatted-output.t for timestamp metadata of rbd snapshot

Signed-off-by: Pan Liu <pan.liu@istuary.com>

test: Add unit test for getting rbd snapshot timestamp info

Signed-off-by: Pan Liu <pan.liu@istuary.com>

librbd: support to list snapshot time stamp

Fixes: http://tracker.ceph.com/issues/808
Signed-off-by: Pan Liu <pan.liu@istuary.com>

librbd: Add timestamp metadata when creating rbd snapshot

Signed-off-by: Pan Liu <pan.liu@istuary.com>

Merge pull request #12646 from SirishaGuduru/swift-api-auth-doc-change

doc: Fixes radosgw-admin ex: in swift auth section

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>

qa/workunits/rest: use unique pool names for cephfs test

Using cephfs_[meta]data collides with the pools that teuthology
already creates if an mds is defined.

This became a (noticeable) problem with 052c3d3f681017d56b5b0ee5cf6f65bffc952a4c

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #13054 from oritwas/wip-rgw-period-update-crash

rgw: fix period update crash

Reviewed-by: Casey Bodley <cbodley@redhat.com>

msg/async/rdma: reduce number of rdma rx/tx buffers

issue: none

Change-Id: Ied523fec3210af152508b102c48aff5633343ab4
Signed-off-by: Adir Lev <adirl@mellanox.com>

Merge pull request #13186 from Adirl/fix_rdma_compile

cmake: fix broken RDMA compilation after merge PR #12878

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #13003 from Jing-Scott/dev/swift-container-acl-info

rgw: swift: the http referer acl in swift API should be shown

Reviewed-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

Merge pull request #13005 from Jing-Scott/dev/swift-http-url-parse

rgw: swift: The http referer should be parsed to compare in swift API

Reviewed-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

Merge pull request #12874 from Jing-Scott/dev/swift-ref

rgw: the swift container acl should support field .ref

Reviewed-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

cmake: fix broken RDMA compilation after merge PR #12878

issue: 965984

Change-Id: I2e401acf204069d3907001d276c58d9fb4cd0d58
Signed-off-by: Oren Duer <oren@mellanox.com>

doc: Document that osd_heartbeat_grace applies to MON and OSD

This value has to be set in both the [mon] and [osd] section since
both daemons read this value.

Signed-off-by: Wido den Hollander <wido@42on.com>

Rewrite mount.fuse.ceph (to python) and move ceph-fuse options to fs_mntops

Rewrote mount.fuse.ceph to move ceph-fuse options to `fs_mntops`, where it should be.
Bash version with options in `fs_spec` is counterintuitive and cause issues in some
situations (systemd, for example)

Signed-off-by: Edgaras Lukosevicius <edgaras.lukosevicius@gmail.com>

Merge pull request #13142 from Adirl/remove_compilation_warning

msg/async/rdma: Remove compilation warning

Reviewed-by: Haomai Wang <haomai@xsky.com>

osd: Fix useless MAX(0, unsigned) to prevent out of wack misplaced

Still want to prevent strange results if for some reason num_objects
is less than osd_missing.

Fixes: http://tracker.ceph.com/issues/18718
Signed-off-by: David Zafman <dzafman@redhat.com>

Merge pull request #13057 from wido/issue-18635

systemd: Restart Mon after 10s in case of failure

Reviewd-by: Loic Dachary <ldachary@redhat.com>

Merge pull request #13140 from liewegas/wip-bluestore-statfs

os/bluestore: fix statfs to not include DB partition in free space

Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>

Merge pull request #13135 from liewegas/wip-kerneldevice-debug

os/bluestore/KernelDevice: fix debug message

Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>

qa/suites/rbd: OpenStack devstack tempest full suite

This mimics the OpenStack tempest gate tests that OpenStack
Zuul executes as a gate test.

Fixes: http://tracker.ceph.com/issues/18594
Signed-off-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #13124 from ukernel/wip-18675

client: remove request from session->requests when handling forward

Reviewed-by: John Spray <john.spray@redhat.com>

Merge pull request #13095 from ukernel/wip-18660

mds: skip fragment space check for replayed request

Reviewed-by: John Spray <john.spray@redhat.com>