doc: 12.2.4 release notes

And updating the release table

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>

Merge pull request #20234 from smithfarm/wip-run-make-check

build/ops: run-make-check.sh: fix SUSE support

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #20436 from smithfarm/wip-22999

install-deps.sh: set python2 %bcond by environment

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Jan Fajerski <jfajerski@suse.com>

Merge pull request #20611 from Leeshine/wip-rgw-22080-1

rgw: create sync-module instance when radosgw-admin sync run

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #20397 from tdb/fix/perms-ocf-rbd

rbd: resource agent needs to be executable

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>

Merge pull request #20577 from Songweibin/wip-group-rename

rbd: add group rename methods

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

install-deps.sh: set python2 %bcond by environment

If there is no /usr/bin/python2 we need to set %bcond_with python2.

Fixes: http://tracker.ceph.com/issues/22999
Signed-off-by: Nathan Cutler <ncutler@suse.com>

Merge pull request #20434 from smithfarm/wip-22998

build/ops: install-deps.sh: pass --no-recommends to zypper

Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Jan Fajerski <jfajerski@suse.com>

Merge pull request #20404 from smithfarm/wip-cmake-with-systemd

build/ops: change WITH_SYSTEMD default to ON

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Ken Dreyer <kdreyer@redhat.com>
Reviewed-by: Boris Ranto <branto@redhat.com>

build/ops: run-make-check.sh: fix SUSE support

Get /usr/bin/which from the right RPM.

Fixes: http://tracker.ceph.com/issues/22875
Signed-off-by: Nathan Cutler <ncutler@suse.com>

Merge pull request #20245 from smithfarm/wip-p2p-ripout

tests: cleanup: drop upgrade/jewel-x/point-to-point-x

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #20138 from smithfarm/wip-recommend-chrony

build/ops: rpm: recommend chrony instead of ntp-daemon

Reviewed-by: Ken Dreyer <kdreyer@redhat.com>

Merge pull request #20551 from shun-s/wip-add-notify-name-print

rbd: output notifyOp request name when watching

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

Merge PR #19471 into master

* refs/pull/19471/head:
cephfs-journal-tool: support purge queue

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge PR #20412 into master

* refs/pull/20412/head:
mds/CDir: cleanup in the lookup_exact_snap()
mds/cdir: add CDir missing state

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge PR #20468 into master

* refs/pull/20468/head:
mds: fix check of underwater dentries

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge PR #20489 into master

* refs/pull/20489/head:
common: omit short option for id in help for clients

Reviewed-by: Jos Collin <jcollin@redhat.com>

Merge PR #20547 into master

* refs/pull/20547/head:
mds: add uptime to MDS status

Reviewed-by: Douglas Fuller <dfuller@redhat.com>

Merge PR #20553 into master

* refs/pull/20553/head:
mds: always handle SESSION_REQUEST_RENEWCAPS messages
mds: don't cleanup request that has pending remote authpin/wrlock/xlock

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

rgw: create sync-module instance when radosgw-admin sync run

Signed-off-by: lvshanchun <lvshanchun@gmail.com>

Merge pull request #20532 from Songweibin/wip-du-user

rbd: filter out UserSnapshotNamespace in do_disk_usage

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #20529 from Songweibin/wip-fix-nbd-map

 rbd: set a default value for options in `nbd map`

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #20507 from trociny/wip-remote-rename

 librbd: make rename request complete with filtered code

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #20600 from liewegas/wip-msgr-level

msg/async/AsyncConnection: less noisy debug

Reviewed-by: Haomai Wang <haomai@xsky.com>

Merge pull request #20572 from batrick/erasure-code-cephfs-doc

doc: cleanup erasure coded pool doc on cephfs use

msg/async/AsyncConnection: less noisy debug

This spams logs of healthy OSDs.

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #20571 from dzafman/wip-21833-2

Fix asserts caused by DNE pgs left behind after lots of OSD restarts

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #20594 from ceph/wip-rm23004

ceph-volume: log the current running command for easier debugging

Reviewed-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #20560 from dillaman/wip-22960-1

librbd: minor cleanup of the IO pathway

Reviewed-by: Mykola Golub <mgolub@suse.com>

librbd: moved write same buffer assembler to common location

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

librbd: decoupled object read requests from result assembler

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

librbd: use move-semantics for object IO data payloads

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

librbd: track the originating source of a flush request

This will be used in a later cleanup to remove the IO flush handling
from ImageCtx.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

librbd: separated queued image IO requests from state machine

This breaks the tight coupling between the IO work queue and
the actual dispatch of IO requests.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

ceph-volume: log the current running command for easier debugging

Fixes: http://tracker.ceph.com/issues/23004
Signed-off-by: Andrew Schoen <aschoen@redhat.com>

osd: Remove partially created pg known as DNE

Fixes: http://tracker.ceph.com/issues/21833
Signed-off-by: David Zafman <dzafman@redhat.com>

Merge pull request #20567 from liewegas/wip-kill-pg-preferred

osd/osd_types: kill preferred field in pg_t

Reviewed-by: Greg Farnum <gfarnum@redhat.com>

osd/osd_types: pg_t: remove preferred

We killed this many many years ago; remove it!

Keep the hash<pg_t> value the same just in case this leaked into some
on-disk or on-wire structure.

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #20592 from ceph/ceph-volume-ssh

ceph-volume: add ANSIBLE_SSH_RETRIES=5 to functional tests

Reviewed-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #20591 from idryomov/wip-krbd-latest-osdmap-on-map-test

qa: krbd latest-osdmap-on-map test

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

ceph-volume: add ANSIBLE_SSH_RETRIES=5 to functional tests

Occasionally we get tests that fail because a test node becomes
'unreachable'. This should avoid those ssh connection issues we see sometimes
by increasing the amount of times ansible will try to reconnect to a node
after an ssh failure.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #20152 from Rubab-Syed/add_units_to_performance_counters

mgr: add units to performance counters

Reviewed-by: John Spray <john.spray@redhat.com>

Merge pull request #20576 from wjwithagen/wjw-fix-store_test

test: put new BlueStore tests un ifdef WITH_BLUESTORE

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

rbd: add 'group rename' action to CLI and Python API

Signed-off-by: songweibin <song.weibin@zte.com.cn>

librbd: add group rename methods

Signed-off-by: songweibin <song.weibin@zte.com.cn>

cls_rbd: add group rename operations to cls_rbd

Signed-off-by: songweibin <song.weibin@zte.com.cn>

Merge pull request #20552 from xiexingguo/wip-scrub-preempt-fixes

osd/PG: decay scrub_chunk_max too if scrub is preempted

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #20555 from jdurgin/wip-min-size-default

mon/OSDMonitor: fix min_size default for replicated pools

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #20549 from Songweibin/wip-cleanup

common: fix typo in options.cc

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>

qa: krbd latest-osdmap-on-map test

Make sure we get the latest osdmap when using an existing client.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>

Merge PR #20562 into master

* refs/pull/20562/head:
doc:Update ceph-fuse doc

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #20574 from tchaikov/wip-no-more-hash-pthread-t

common/lockdep: drop hash<pthread_t> specialization

Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>

test: put net BlueStore tests un ifdef WITH_BLUESTORE

Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>

Merge pull request #20497 from tchaikov/wip-ceph-disk-cmd-failure

ceph-disk: include output of failed command in exception

Reviewed-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #20534 from tchaikov/wip-22413

librados: make OPERATION_FULL_FORCE the default for rados_remove()

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #20456 from b-ranto/wip-mgr-prom

mgr/prometheus: Skip bogus entries

Reviewed-by: Jan Fajerski <jfajerski@suse.com>

Merge pull request #19843 from ifed01/wip-ifed-bluestore-repair

os/bluestore: implement BlueStore repair

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

Merge pull request #14727 from voidbag/wip-voidbag-bdev-discard

os/bluestore: add discard method for ssd's performance

Reviewed-by: Wido den Hollander <wido@42on.com>
Reviewed-By: Sage Weil <sage@redhat.com>

common/lockdep: drop hash<pthread_t> specialization

quote from http://en.cppreference.com/w/cpp/utility/hash:

> Each standard library header that declares the template std::hash
> provides enabled specializations of std::hash for std::nullptr
> and all cv-unqualified arithmetic types (including any extended
> integer types), all enumeration types, and all pointer types.

since we've switched to C++17. this full specialization is not necessary
anymore.

Signed-off-by: Kefu Chai <kchai@redhat.com>

rbd: output notifyOp request name when watching

  output notifyOp request name when watching,
  which is more easier to dentify what happend.

Signed-off-by: shun-s <song.shun3@zte.com.cn>

doc: cleanup erasure coded pool doc on cephfs use

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #20488 from theanalyst/rgw/frontend-init

rgw:  make init env methods return an error

Reviewed-by: Casey Bodley <cbodley@redhat.com>

osd/osd_types: pg_t: remove set_preferred()

Signed-off-by: Sage Weil <sage@redhat.com>

doc:Update ceph-fuse doc

Fixes: http://tracker.ceph.com/issues/23084
Signed-off-by: Jos Collin <jcollin@redhat.com>

Merge pull request #20504 from dzafman/wip-pg-states-doc

doc: Add missing pg states from doc

Reviewed-by: Sage Weil <sage@redhat.com>

osd/PG: kill extra scrubber state transition

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>

mon/OSDMonitor: fix min_size default for replicated pools

This was accidentally changed to 0 by using the config value
directly in 582e567c93f7656a1f3e16f473c583e6cb3d5926

Signed-off-by: Josh Durgin <jdurgin@redhat.com>

mds: always handle SESSION_REQUEST_RENEWCAPS messages

Fixes: http://tracker.ceph.com/issues/23059
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>

osd/PG: decay scrub_chunk_max too if scrub is preempted

In normal case we'll at least scrub as many objects as
osd_scrub_chunk_max specified at a time, so the current
backoff mechanism should have very limit effect.
Decay both osd_scrub_chunk_min and osd_scrub_chunk_max
should instead be a better resolution.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>

mds: don't cleanup request that has pending remote authpin/wrlock/xlock

Fixes: http://tracker.ceph.com/issues/23059
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>

Merge pull request #20543 from ceph/wip-rm23080

ceph-volume correctly normalize mount flags

Reviewed-by: Andrew Schoen <aschoen@redhat.com>

mds: add uptime to MDS status

Fixes: https://tracker.ceph.com/issues/23094
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>

ceph-volume tests.util update tests for mount flags

Include parametrized flags for ensuring a combination of values will
still be normalized regardless on how they are on ceph.conf

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ceph-volume util.prepare normalize mount flags for CLI

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #20510 from ceph/wip-cdp-docs-update

docs update ceph-deploy reference to reflect ceph-volume API

Reviewed-by: Vasu Kulkarni <vakulkar@redhat.com>

Merge pull request #20537 from ceph/wip-rm22878

ceph-volume: adds support to zap encrypted devices

Reviewed-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #20425 from yehudasa/wip-22982

rgw: parse old rgw_obj with namespace correctly

Reviewed-by: Orit Wasserman <owasserm@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #13644 from yehudasa/wip-rgw-ragweed

rgw: changes to support ragweed

Reviewed-by: Casey Bodley <cbodley@redhat.com>

ceph-volume: use lv.encrypted property with lvm zap

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

ceph-volume: adds an encrypted property to api.lvm.Volume

This property will return a boolean indicating if the lv
is encrypted or not.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

ceph-volume: add zapping to lvm dmcrypt tests

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

ceph-volume: test zapping for both lvm create and lvm dmcrypt

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

ceph-volume: adds support to zap encrypted devices, lvs, and partitions

Fixes: http://tracker.ceph.com/issues/22878
Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #20533 from wido/issue-23083

systemd: Wait 10 seconds before restarting ceph-mgr

Reviewed-by: Sage Weil <sage@redhat.com>

doc/rados/troubleshooting update ceph-deploy references with new ceph-voume API

Signed-off-by: Alfredo Deza <adeza@redhat.com>

doc/rados/deployment update ceph-deploy references with new ceph-volume API

Signed-off-by: Alfredo Deza <adeza@redhat.com>

doc/man update ceph-deploy for the new ceph-volume API

Signed-off-by: Alfredo Deza <adeza@redhat.com>

librados: make OPERATION_FULL_FORCE the default for rados_remove()

Fixes: http://tracker.ceph.com/issues/22413
Signed-off-by: Kefu Chai <kchai@redhat.com>

systemd: Wait 10 seconds before restarting ceph-mgr

We do this for the MON and OSD as well, wait for a few
seconds before we try to attempt a restart.

On boot in IPv6 networks it might take a few seconds longer
before a IP-address is usable and this does not allow the mgr
to start right away.

Fixes: http://tracker.ceph.com/issues/23083
Signed-off-by: Wido den Hollander <wido@42on.com>

Merge pull request #20400 from tchaikov/wip-22354

ceph-disk: erase 110MB for nuking existing bluestore

Reviewed-by: Alfredo Deza <adeza@redhat.com>
Reviewed-by: Wido den Hollander <wido@42on.com>

Merge pull request #20514 from ifed01/wip-ifed-fio-build-fix

test/fio: fix fio objectstore plugin building broken by

rbd: filter out UserSnapshotNamespace in do_disk_usage

Signed-off-by: songweibin <song.weibin@zte.com.cn>

common: fix typo in options.cc

Signed-off-by: songweibin <song.weibin@zte.com.cn>

rbd: fix get image or snap spec in `nbd map`

root@s222:/ceph-dev/build# rbd nbd map img1
rbd: 'nbd map' command is deprecated, use 'device map -t nbd' instead
rbd: image name was not specified
root@s222:/ceph-dev/build# rbd nbd map -p rbd --image img1
rbd: 'nbd map' command is deprecated, use 'device map -t nbd' instead
rbd: image name was not specified

Signed-off-by: songweibin <song.weibin@zte.com.cn>

rbd: set a default value for options in `nbd map`

Since `vm` does not contain an `options` item and
`vm.at("options").value()` will throw an exception.

root@s222:/ceph-dev/build# rbd nbd map img1
rbd: 'nbd map' command is deprecated, use 'device map -t nbd' instead
terminate called after throwing an instance of 'std::out_of_range'
  what():  map::at
*** Caught signal (Aborted) **
 in thread 7f0e5e046400 thread_name:rbd
 ceph version 12.0.3-11022-ga09b319 (a09b319a5e984185bd56064e52f2e8ec3da49b73) mimic (dev)
 1: (()+0x1afb00) [0x55a07d677b00]
 2: (()+0x10340) [0x7f0e545a0340]
 3: (gsignal()+0x39) [0x7f0e531b0cc9]
 4: (abort()+0x148) [0x7f0e531b40d8]
 5: (__gnu_cxx::__verbose_terminate_handler()+0x125) [0x7f0e53ac8415]
 6: (()+0x6a206) [0x7f0e53ac6206]
 7: (()+0x6a251) [0x7f0e53ac6251]
 8: (()+0x6a493) [0x7f0e53ac6493]
 9: (std::__throw_out_of_range(char const*)+0x3f) [0x7f0e53aeac3f]
 10: (rbd::action::nbd::execute_map_deprecated(boost::program_options::variables_map const&,
     std::vector<std::string, std::allocator<std::string> > const&)+0xa35) [0x55a07d5f6a15]
 11: (rbd::Shell::execute(int, char const**)+0xb5b) [0x55a07d581adb]
 12: (main()+0x15) [0x55a07d546615]
 13: (__libc_start_main()+0xf5) [0x7f0e5319bec5]
 14: (()+0xa141f) [0x55a07d56941f]
2018-02-22 13:43:59.212 7f0e5e046400 -1 *** Caught signal (Aborted) **
 in thread 7f0e5e046400 thread_name:rbd

Signed-off-by: songweibin <song.weibin@zte.com.cn>

ceph-disk: erase 110MB for nuking existing bluestore

10M is not enough for erasing the data partition *and* db partition,
let's make it 110M.

Fixes: http://tracker.ceph.com/issues/22354
Signed-off-by: Kefu Chai <kchai@redhat.com>

Merge pull request #20513 from ceph/wip-rm23003

ceph-volume warn on mix of filestore and bluestore flags

Reviewed-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #20500 from theanalyst/doc/releases/12.2.3

doc: release notes for 12.2.3

Reviewed-By: Sage Weil <sage@redhat.com>

test/fio: fix fio objectstore plugin building broken by
ObjectStore::queue_transaction interface changes.

Signed-off-by: Igor Fedotov "ifedotov@suse.com"

common: omit short option for id in help for clients

Commit 8e3abf3ce337 removed the short option for clients to conflicts.

Fixes: http://tracker.ceph.com/issues/23041
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>