msg/async:change EventCenter::process_events(int timeout_microseconds) to EventCenter::process_events(unsigned timeout_microseconds)

Signed-off-by: shangfufei <shangfufei@inspur.com>

Merge pull request #20600 from liewegas/wip-msgr-level

msg/async/AsyncConnection: less noisy debug

Reviewed-by: Haomai Wang <haomai@xsky.com>

Merge pull request #20572 from batrick/erasure-code-cephfs-doc

doc: cleanup erasure coded pool doc on cephfs use

msg/async/AsyncConnection: less noisy debug

This spams logs of healthy OSDs.

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #20571 from dzafman/wip-21833-2

Fix asserts caused by DNE pgs left behind after lots of OSD restarts

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #20594 from ceph/wip-rm23004

ceph-volume: log the current running command for easier debugging

Reviewed-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #20560 from dillaman/wip-22960-1

librbd: minor cleanup of the IO pathway

Reviewed-by: Mykola Golub <mgolub@suse.com>

librbd: moved write same buffer assembler to common location

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

librbd: decoupled object read requests from result assembler

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

librbd: use move-semantics for object IO data payloads

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

librbd: track the originating source of a flush request

This will be used in a later cleanup to remove the IO flush handling
from ImageCtx.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

librbd: separated queued image IO requests from state machine

This breaks the tight coupling between the IO work queue and
the actual dispatch of IO requests.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

ceph-volume: log the current running command for easier debugging

Fixes: http://tracker.ceph.com/issues/23004
Signed-off-by: Andrew Schoen <aschoen@redhat.com>

osd: Remove partially created pg known as DNE

Fixes: http://tracker.ceph.com/issues/21833
Signed-off-by: David Zafman <dzafman@redhat.com>

Merge pull request #20567 from liewegas/wip-kill-pg-preferred

osd/osd_types: kill preferred field in pg_t

Reviewed-by: Greg Farnum <gfarnum@redhat.com>

osd/osd_types: pg_t: remove preferred

We killed this many many years ago; remove it!

Keep the hash<pg_t> value the same just in case this leaked into some
on-disk or on-wire structure.

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #20592 from ceph/ceph-volume-ssh

ceph-volume: add ANSIBLE_SSH_RETRIES=5 to functional tests

Reviewed-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #20591 from idryomov/wip-krbd-latest-osdmap-on-map-test

qa: krbd latest-osdmap-on-map test

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

ceph-volume: add ANSIBLE_SSH_RETRIES=5 to functional tests

Occasionally we get tests that fail because a test node becomes
'unreachable'. This should avoid those ssh connection issues we see sometimes
by increasing the amount of times ansible will try to reconnect to a node
after an ssh failure.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #20152 from Rubab-Syed/add_units_to_performance_counters

mgr: add units to performance counters

Reviewed-by: John Spray <john.spray@redhat.com>

Merge pull request #20576 from wjwithagen/wjw-fix-store_test

test: put new BlueStore tests un ifdef WITH_BLUESTORE

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #20552 from xiexingguo/wip-scrub-preempt-fixes

osd/PG: decay scrub_chunk_max too if scrub is preempted

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #20555 from jdurgin/wip-min-size-default

mon/OSDMonitor: fix min_size default for replicated pools

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #20549 from Songweibin/wip-cleanup

common: fix typo in options.cc

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>

qa: krbd latest-osdmap-on-map test

Make sure we get the latest osdmap when using an existing client.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>

Merge PR #20562 into master

* refs/pull/20562/head:
doc:Update ceph-fuse doc

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #20574 from tchaikov/wip-no-more-hash-pthread-t

common/lockdep: drop hash<pthread_t> specialization

Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>

test: put net BlueStore tests un ifdef WITH_BLUESTORE

Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>

Merge pull request #20497 from tchaikov/wip-ceph-disk-cmd-failure

ceph-disk: include output of failed command in exception

Reviewed-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #20534 from tchaikov/wip-22413

librados: make OPERATION_FULL_FORCE the default for rados_remove()

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #20456 from b-ranto/wip-mgr-prom

mgr/prometheus: Skip bogus entries

Reviewed-by: Jan Fajerski <jfajerski@suse.com>

Merge pull request #19843 from ifed01/wip-ifed-bluestore-repair

os/bluestore: implement BlueStore repair

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

Merge pull request #14727 from voidbag/wip-voidbag-bdev-discard

os/bluestore: add discard method for ssd's performance

Reviewed-by: Wido den Hollander <wido@42on.com>
Reviewed-By: Sage Weil <sage@redhat.com>

common/lockdep: drop hash<pthread_t> specialization

quote from http://en.cppreference.com/w/cpp/utility/hash:

> Each standard library header that declares the template std::hash
> provides enabled specializations of std::hash for std::nullptr
> and all cv-unqualified arithmetic types (including any extended
> integer types), all enumeration types, and all pointer types.

since we've switched to C++17. this full specialization is not necessary
anymore.

Signed-off-by: Kefu Chai <kchai@redhat.com>

doc: cleanup erasure coded pool doc on cephfs use

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #20488 from theanalyst/rgw/frontend-init

rgw:  make init env methods return an error

Reviewed-by: Casey Bodley <cbodley@redhat.com>

osd/osd_types: pg_t: remove set_preferred()

Signed-off-by: Sage Weil <sage@redhat.com>

doc:Update ceph-fuse doc

Fixes: http://tracker.ceph.com/issues/23084
Signed-off-by: Jos Collin <jcollin@redhat.com>

Merge pull request #20504 from dzafman/wip-pg-states-doc

doc: Add missing pg states from doc

Reviewed-by: Sage Weil <sage@redhat.com>

osd/PG: kill extra scrubber state transition

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>

mon/OSDMonitor: fix min_size default for replicated pools

This was accidentally changed to 0 by using the config value
directly in 582e567c93f7656a1f3e16f473c583e6cb3d5926

Signed-off-by: Josh Durgin <jdurgin@redhat.com>

osd/PG: decay scrub_chunk_max too if scrub is preempted

In normal case we'll at least scrub as many objects as
osd_scrub_chunk_max specified at a time, so the current
backoff mechanism should have very limit effect.
Decay both osd_scrub_chunk_min and osd_scrub_chunk_max
should instead be a better resolution.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>

Merge pull request #20543 from ceph/wip-rm23080

ceph-volume correctly normalize mount flags

Reviewed-by: Andrew Schoen <aschoen@redhat.com>

ceph-volume tests.util update tests for mount flags

Include parametrized flags for ensuring a combination of values will
still be normalized regardless on how they are on ceph.conf

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ceph-volume util.prepare normalize mount flags for CLI

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #20510 from ceph/wip-cdp-docs-update

docs update ceph-deploy reference to reflect ceph-volume API

Reviewed-by: Vasu Kulkarni <vakulkar@redhat.com>

Merge pull request #20537 from ceph/wip-rm22878

ceph-volume: adds support to zap encrypted devices

Reviewed-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #20425 from yehudasa/wip-22982

rgw: parse old rgw_obj with namespace correctly

Reviewed-by: Orit Wasserman <owasserm@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #13644 from yehudasa/wip-rgw-ragweed

rgw: changes to support ragweed

Reviewed-by: Casey Bodley <cbodley@redhat.com>

ceph-volume: use lv.encrypted property with lvm zap

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

ceph-volume: adds an encrypted property to api.lvm.Volume

This property will return a boolean indicating if the lv
is encrypted or not.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

ceph-volume: add zapping to lvm dmcrypt tests

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

ceph-volume: test zapping for both lvm create and lvm dmcrypt

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

ceph-volume: adds support to zap encrypted devices, lvs, and partitions

Fixes: http://tracker.ceph.com/issues/22878
Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #20533 from wido/issue-23083

systemd: Wait 10 seconds before restarting ceph-mgr

Reviewed-by: Sage Weil <sage@redhat.com>

doc/rados/troubleshooting update ceph-deploy references with new ceph-voume API

Signed-off-by: Alfredo Deza <adeza@redhat.com>

doc/rados/deployment update ceph-deploy references with new ceph-volume API

Signed-off-by: Alfredo Deza <adeza@redhat.com>

doc/man update ceph-deploy for the new ceph-volume API

Signed-off-by: Alfredo Deza <adeza@redhat.com>

librados: make OPERATION_FULL_FORCE the default for rados_remove()

Fixes: http://tracker.ceph.com/issues/22413
Signed-off-by: Kefu Chai <kchai@redhat.com>

systemd: Wait 10 seconds before restarting ceph-mgr

We do this for the MON and OSD as well, wait for a few
seconds before we try to attempt a restart.

On boot in IPv6 networks it might take a few seconds longer
before a IP-address is usable and this does not allow the mgr
to start right away.

Fixes: http://tracker.ceph.com/issues/23083
Signed-off-by: Wido den Hollander <wido@42on.com>

Merge pull request #20400 from tchaikov/wip-22354

ceph-disk: erase 110MB for nuking existing bluestore

Reviewed-by: Alfredo Deza <adeza@redhat.com>
Reviewed-by: Wido den Hollander <wido@42on.com>

Merge pull request #20514 from ifed01/wip-ifed-fio-build-fix

test/fio: fix fio objectstore plugin building broken by

common: fix typo in options.cc

Signed-off-by: songweibin <song.weibin@zte.com.cn>

ceph-disk: erase 110MB for nuking existing bluestore

10M is not enough for erasing the data partition *and* db partition,
let's make it 110M.

Fixes: http://tracker.ceph.com/issues/22354
Signed-off-by: Kefu Chai <kchai@redhat.com>

Merge pull request #20513 from ceph/wip-rm23003

ceph-volume warn on mix of filestore and bluestore flags

Reviewed-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #20500 from theanalyst/doc/releases/12.2.3

doc: release notes for 12.2.3

Reviewed-By: Sage Weil <sage@redhat.com>

test/fio: fix fio objectstore plugin building broken by
ObjectStore::queue_transaction interface changes.

Signed-off-by: Igor Fedotov "ifedotov@suse.com"

doc quick-ceph-deploy update for newer ceph-volume API

Signed-off-by: Alfredo Deza <adeza@redhat.com>

doc: release notes for 12.2.3

Also dropping the relevant changes from PendingReleaseNotes

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>

Merge pull request #20503 from theanalyst/doc/changelog/v12.2.3

doc: changelog for v12.2.3

ceph-volume tests verify exclude_group_options works with groups of flags

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ceph-volume tests add exclusion checks in prepare

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ceph-volume tests add exclusion checks in create

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ceph-volume util.arg_validators create an arg group exclusion check

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ceph-volume lvm.create use the new group option exclution

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ceph-volume lvm.prepare use the new group option exclution

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ceph-volume lvm.common remove --journal-size as it is not used/supported

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ceph-volume lvm.common define arg groups for objectstores

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge PR #19342 into master

* refs/pull/19342/head:
osd: add 'ceph [tell|daemon] osd.id smart'

Reviewed-by: Sage Weil <sage@redhat.com>

Merge PR #20465 into master

* refs/pull/20465/head:
os/bluestore: avoid frequent allocator dump on bluefs rebalance failure

Reviewed-by: Sage Weil <sage@redhat.com>

Merge PR #20467 into master

* refs/pull/20467/head:
mon: mark manager beacons as no_reply

Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: João Eduardo Luís <joao@suse.de>

Merge PR #20484 into master

* refs/pull/20484/head:
osd/PrimaryLogPG: cancel all objecter ops atomically
osdc/Objecter: allow multiple ops to be canceled atomically

Reviewed-by: David Zafman <dzafman@redhat.com>

Merge PR #20487 into master

* refs/pull/20487/head:
os/bluestore: do not account DB volume space in total one reported by statfs method
os/bluestore: prevent statfs available from going negative

Reviewed-by: Igor Fedotov <ifedotov@suse.com>

Merge pull request #20374 from liewegas/wip-18351

msg/DispatchQueue: clear queue after wait()

Reviewed-by: Greg Farnum <gfarnum@redhat.com>

os/bluestore: add an ability to reproduce issue #21040 and verify if
fsck repair fixes it.

Signed-off-by: Igor Fedotov <ifedotov@suse.com>

Merge pull request #20475 from tchaikov/wip-std-string-view

common/str_list: s/boost::string_view/std::string_view

Reviewed-by: Casey Bodley <cbodley@redhat.com>

os/bluestore: implement BlueStore repair

Signed-off-by: Igor Fedotov <ifedotov@suse.com>

os/bluestore: simplify SharedBlob::put_ref interface

Signed-off-by: Igor Fedotov <ifedotov@suse.com>

Merge pull request #20443 from rzarzynski/wip-common-inlineable-ceph_clock_now

common: make ceph_clock_now() inlineable.

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #20439 from jcsp/wip-percent_used

mon: dump percent_used PGMap field as float

Reviewed-by: Kefu Chai <kchai@redhat.com>

doc: Add missing pg states from doc

Signed-off-by: David Zafman <dzafman@redhat.com>

doc: changelog for v12.2.3

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>

Merge pull request #20177 from liewegas/wip-kill-onreadable

os,osd: initial work to drop onreadable/onapplied callbacks

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #20499 from idryomov/wip-krbd-discard-tests

qa: additional krbd discard test cases

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #20490 from dillaman/wip-rbd-journal-workunit

qa/workunits/rbd: remove sanity check in journal.sh test

Reviewed-by: Mykola Golub <mgolub@suse.com>

Merge pull request #20093 from supriti/wip_rgw_ganesha_df

RGW-NFS: Use rados cluster_stat to report filesystem usage

Merge pull request #20395 from Songweibin/wip-misc-cleanup

librbd: validate if dst group snap name is the same with src

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #20420 from trociny/wip-unwatch-race

librbd: potential race in RewatchRequest when resetting watch_handle

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #20478 from trociny/wip-api-mirror

librbd: fix structure size check in rbd_mirror_image_get_info/status

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

rgw:  make init env methods return an error

Since web frontends may signal an error when requests are malformed or so, let
us double check this and raise errors early. The current user of this is
civetweb frontend; which can potentially return null from `parse_http_headers`
when a HTTP header without a ":" is supplied at which point headers.value is
null which can lead to undefined behaviour later in RGW.

Fixes: http://tracker.ceph.com/issues/23039
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>