install-deps.sh: Actually set gpgcheck to false

The current command appears to do nothing.

Fixes: https://tracker.ceph.com/issues/44344
Signed-off-by: Brad Hubbard <bhubbard@redhat.com>

Merge pull request #33389 from trociny/wip-43619

rbd: schedule for running trash purge operations

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #32554 from dzafman/wip-dump-perf

Improve internal python to c++ interface

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #33493 from zhengchengyao/read

librbd: improved support for balanced and localized reads

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #33563 from dillaman/wip-rbd-op-threads

librbd: fix potential race conditions

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

test: Disable self-test of diskprediction_cloud since it isn't loaded

See qa/packages/packages.yaml

Signed-off-by: David Zafman <dzafman@redhat.com>

mon mgr osd: Add dump_osd_times interface for python

The dump_osd_times interface is here for future use of a manager module.
The osd_stats and pg_dump python interfaces don't return network ping
information.

User facing ping time information is formatted 3 decimal places
Use dump_float() (low overhead) for network ping times
   used by python dump_osd_times and dump commands like
   "ceph --formet=json pg dump osds" which for now yields output like
   >>>> "1min": 0.61599999999999999,

Signed-off-by: David Zafman <dzafman@redhat.com>

mgr/progress: Add pg_ready interface for python to get pgmap_ready state

Fixes: https://tracker.ceph.com/issues/43557
Signed-off-by: David Zafman <dzafman@redhat.com>

Merge pull request #33559 from liewegas/fix-42328-more

msg/async/ProtocolV2: fix typo in register_lossy_clients fix

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>

Merge PR #33460 into master

* refs/pull/33460/head:
doc/cephadm: Add Troubleshooting

Reviewed-by: Sage Weil <sage@redhat.com>

doc/cephadm: Add Troubleshooting

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>

Merge PR #33518 into master

* refs/pull/33518/head:
doc/foundation: add Samsung

Reviewed-by: Myougnwon Oh <myoungwon.oh@samsung.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Myoungwon Oh <omwmw@sk.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #33044 from jschmid1/drive_group_docs

doc/drivegroups: add docs for DriveGroups with excessive examples

Reviewed-by: Kiefer Chang <kiefer.chang@suse.com>

Merge pull request #33218 from yuvalif/add_cls_queue_ut

cls/queue: add unit tests

Reviewed-by: Pritha Srivastava <prsivas@redhat.com>

mgr/rbd_support: wait for latest osdmap on init

The main goal is to initialize the librados instance before
starting any thread that may use it.

Signed-off-by: Mykola Golub <mgolub@suse.com>

Merge pull request #33561 from dillaman/wip-44249

doc/rbd: document the new snapshot-based mirroring feature

Reviewed-by: Mykola Golub <mgolub@suse.com>

Merge pull request #33490 from dillaman/wip-43934

rbd-mirror: add support for snapshot-based mirroring resyncs

Reviewed-by: Mykola Golub <mgolub@suse.com>

Merge PR #33574 into master

* refs/pull/33574/head:
doc/mgr/orchestrator: Add CephFS
doc/mgr/orchestrator: Add documentation for plcement specs
doc/mgr: Reordering

Reviewed-by: Alexandra Settle <asettle@suse.com>
Reviewed-by: Sage Weil <sage@redhat.com>

Merge PR #33577 into master

* refs/pull/33577/head:
doc: Add sphinx_autodoc_typehints extension

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #33555 from LenzGr/master-documentation

doc: Add Dashboard Octopus release notes

Reviewed-by: Tatjana Dehler <tdehler@suse.com>

rbd-mirror: no need to perform extra image-meta filtering for image-state

The image-state now only stores non RBD-internal image-meta keys and only
non RBD-internal image-meta keys are returned from the image-meta helper
state machine.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

librbd: snapshot image-state should use get image-meta state machine

This commit was accidentally dropped from commit bcbdd6cf698 when all
existing logic was updated to use the new helper state machine.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

librbd: optionally filter internal image-meta when copying/cloning

Any ".rbd"-prefixed image-meta keys will be considered RBD-internal and
will not be added to the new image when copied/cloned.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

librbd: remove snapshot mirror image-meta when disabling

Remove the snapshot-based mirroring image-meta key/value pair
(if any) when disabling mirroring.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

rbd-mirror: support resync request for snapshot-based mirroring

When a local image has the resync requested image-meta property, the
snapshot replayer will stop and initiate the resync request.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

rbd-mirror: register for local image updates in snapshot replayer

The snapshot replayer will need to watch for local forced-promotion
events and also resync requests.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #32937 from rzarzynski/wip-bl-carry-_carriage

common/bl: carry the bufferlist::_carriage over std::moves

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #32515 from majianpeng/osd-remove-unused-func3

osd: remove unused functions

Reviewed-by: Kefu Chai <kchai@redhat.com>

doc: Add sphinx_autodoc_typehints extension

`mgr/orchestrator_modules.rst` makes heavy use type hints.

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>

doc/mgr/orchestrator: Add CephFS

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>

doc/mgr/orchestrator: Add documentation for plcement specs

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>

doc/mgr: Reordering

* Moved *Configuring the Orchestrator CLI*
* Updated the definitions

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>

Merge pull request #33573 from votdev/fix_mypy_issue

mgr/dashboard: make check mypy failure

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Patrick Seidensal <pseidensal@suse.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>

mgr/dashboard: make check mypy failure

Fixes: https://tracker.ceph.com/issues/44319
Signed-off-by: Volker Theile <vtheile@suse.com>

Merge pull request #33079 from jan--f/c-v-scan-dmcrypt-osds

ceph-volume: strip _dmcrypt suffix in simple scan json output

Merge pull request #33562 from dillaman/wip-fix-doc-builds

Revert "doc: do not add suffix for search result links"

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #32953 from votdev/issue_43665_smart_data

mgr/dashboard: smart: smart data read out on down osd causes error popup

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Patrick Seidensal <pnawracay@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>

Merge PR #33547 into master

* refs/pull/33547/head:
mgr/volumes: unregister job upon async threads exception

Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

mgr/volumes: unregister job upon async threads exception

If the async threads hit a temporary exception the job is
never unregistered and therefore gets skipped by the async
threads on subsequent scans.

Patrick hit this in nautilus when one of the purge threads
hit an exception when trying to log a message. The trash
entry was never picked up again by the purge threads.

Fixes: http://tracker.ceph.com/issues/44293
Signed-off-by: Venky Shankar <vshankar@redhat.com>

msg/async/AsyncMessenger: make accept_conn respect register_lossy_clients

Back in 507d213cc453ed86ab38619590f710f33245c652 we missed this condition,
which was originally introduced by c48a29b9edde3c6d3cd34252d202885e2e064fe0.

Signed-off-by: Sage Weil <sage@redhat.com>

Merge PR #33552 into master

* refs/pull/33552/head:
mgr/dashboard: Enhance user create CLI command to force password change

Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>

Merge PR #33550 into master

* refs/pull/33550/head:
rpm,deb: poke Python OpenSSL dependencies
mgr: outsource creation of self-signed certificates

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>

Merge PR #33517 into master

* refs/pull/33517/head:
cephadm: bootstrap: nag about telemetry

Reviewed-by: Sebastian Wagner <swagner@suse.com>

Merge PR #33519 into master

* refs/pull/33519/head:
cephadm: shell: make a root home dir (/root) in /var/log/ceph/$fsid/home

Reviewed-by: Sebastian Wagner <swagner@suse.com>

Merge PR #33544 into master

* refs/pull/33544/head:
qa/workunits/cephadm/test_cephadm.sh: remove image param non-ceph tests
qa/workunits/cephadm/test_cephadm.sh: consolidate wait loop logic

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>

doc/drivegroups: add initial write-up

Signed-off-by: Joshua Schmid <jschmid@suse.de>

doc/rbd: document the new snapshot-based mirroring feature

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

librbd: fix IO execution order

Signed-off-by: Mahati Chamarthy <mahati.chamarthy@intel.com>

test/rbd-mirror: fix test failure due to multi-threading

... also change the lock type in rbd mirror.

Signed-off-by: Mahati Chamarthy <mahati.chamarthy@intel.com>

Revert "doc: do not add suffix for search result links"

This reverts commit 88d6d499e0ff8341f8dc4c73b7a7c3cdc41b63d5.

All doc builds are currently broken due to this change since
the HTML files are written without the necessary ".html"
extension.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

mgr/rbd_support: catch rados errors when loading schedules

It may be a temporary error and the scheduler will succeed on the
next run.

Signed-off-by: Mykola Golub <mgolub@suse.com>

mgr: Add pg_stats and pool_stats direct access

More efficient to get just what you need out of the PGMap

mgr/progress: Use pg_stats instead of pg_dump
mgr/diskprediction_cloud: Use pg_stats instead of pg_dump
mgr/balancer: Use pg_stats and pool_stats instead of pg_dump

Fixes: https://tracker.ceph.com/issues/43556
Signed-off-by: David Zafman <dzafman@redhat.com>

mgr mon: Expose network ping information except for python pg_dump

Caused by: ffb8a2a904426c8a3d6fc2fd70266418a98623c5

Signed-off-by: David Zafman <dzafman@redhat.com>

msg/async/ProtocolV2: fix typo in register_lossy_clients fix

In 507d213cc453ed86ab38619590f710f33245c652 this was typoed, reversing
the condition.

Fixes: https://tracker.ceph.com/issues/42328
Signed-off-by: Sage Weil <sage@redhat.com>

cephadm: shell: make a root home dir (/root) in /var/log/ceph/$fsid/home

This makes the shell much more friendly to humans.

Signed-off-by: Sage Weil <sage@redhat.com>

Merge PR #33551 into master

* refs/pull/33551/head:
doc/cephadm: Rephrased introduction sentence
doc/cephadm: Rename section titles and fix introductions
doc/cephadm: Add CLI and OS recommendations to TOC
doc: move cephadm mgr doc to /doc/cephadm
doc: move bootstrap.rst to cephadm

Reviewed-by: Alexandra Settle <asettle@suse.com>
Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #33321 from rhcs-dashboard/43801-purge-button

mgr/dashboard: Fixes rbd image 'purge trash' button & modal text

mgr/dashboard: Enhance user create CLI command to force password change

Fixes: https://tracker.ceph.com/issues/44301
Signed-off-by: Volker Theile <vtheile@suse.com>

rpm,deb: poke Python OpenSSL dependencies

to ceph-mgr-modules-core package.

Fixes: https://tracker.ceph.com/issues/44306
Signed-off-by: Patrick Seidensal <pseidensal@suse.com>

mgr: outsource creation of self-signed certificates

Remove duplicated code from mgr/cephadm and mgr/dashboard and move it to
`mgr_util.py`.

Fixes: https://tracker.ceph.com/issues/44306
Signed-off-by: Patrick Seidensal <pseidensal@suse.com>

Merge pull request #33537 from cbodley/wip-test-rgw-common-commit

test/rgw: fixes for test-rgw-multisite.sh

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>

cls/queue: add multithreaded unit tests

Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>

doc/cephadm: Rephrased introduction sentence

Signed-off-by: Alexandra Settle <asettle@suse.com>

Merge pull request #33463 from sebastian-philipp/cephadm-workerpool-10

mgr/cephadm: set thread pool size to 10

Reviewed-by: Sage Weil <sage@redhat.com>

Merge PR #31200 into master

* refs/pull/31200/head:
qa/cephfs: test case for auto reconnect after blacklisted

Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

doc: Add Dashboard Octopus release notes

Signed-off-by: Lenz Grimmer <lgrimmer@suse.com>

mgr/dashboard: Fixes rbd image 'purge trash' button & modal text

Fixes: https://tracker.ceph.com/issues/43801
Signed-off-by: anurag <abandhu@redhat.com>

test: add read balance mode test case

Signed-off-by: Zheng Yin <zhengyin@cmss.chinamobile.com>

Merge pull request #33478 from yehudasa/wip-44246

ceph-volume: lvm: get_device_vgs() filter by provided prefix

cls/queue: add unit tests

Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>

rbd-mirror: check for resync request during snapshot prepare state machine

Before attempting to start the image replayer for snapshot-based mirroring,
check to ensure that a resync hasn't already been requested.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

doc/cephadm: Rename section titles and fix introductions

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>

doc/cephadm: Add CLI and OS recommendations to TOC

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>

doc: move cephadm mgr doc to /doc/cephadm

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>

doc: move bootstrap.rst to cephadm

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>

Merge pull request #33171 from rhcs-dashboard/wip-42914-fix-ui-issues

mgr/dashboard: UI fixes

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>

Merge pull request #33405 from rhcs-dashboard/wip-44198-fix-style-issues

mgr/dashboard: 'destroyed' view in CRUSH map viewer

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>

Merge pull request #33459 from liewegas/doc-adopt

doc/mgr/cephadm: document adoption process

Reviewed-by: Zac Dover <zac.dover@gmail.com>

Merge pull request #33454 from votdev/fix_mypy_issues

mgr/dashboard: Fix mypy issues and enable it by default

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Patrick Seidensal <pnawracay@suse.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>

Merge pull request #33372 from pritha-srivastava/rgw-omap-offload-gc-fixes

Fixes related to omap offload and gc.

Merge pull request #33528 from cyx1231st/wip_crimson_osd_misc_fixes

crimson/osd: misc fixes and cleanup

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #33543 from badone/wip-doc-min_size-applicable-to-ec-pools

doc/rados/operations: min_size is applicable to EC

Reviewed-by: Kefu Chai <kchai@redhat.com>

qa/workunits/cephadm/test_cephadm.sh: remove image param non-ceph tests

non-ceph components have a default image
as of 97def7cb60de8c52db1cfca198bd2cd64585883f

Signed-off-by: Michael Fritch <mfritch@suse.com>

qa/workunits/cephadm/test_cephadm.sh: consolidate wait loop logic

into an `is_available` function

Signed-off-by: Michael Fritch <mfritch@suse.com>

doc/rados/operations: Detail for min_size on EC pools

Signed-off-by: Brad Hubbard <bhubbard@redhat.com>

librbd: Improved support for balanced and localized reads

Fixes: https://tracker.ceph.com/issues/43793
Signed-off-by: Zheng Yin <zhengyin@cmss.chinamobile.com>

Merge pull request #32342 from dzafman/wip-43126

mon: Improvements to slow heartbeat health messages

Reviewed-by: Sage Weil <sage@redhat.com>

doc/rados/operations: min_size is applicable to EC

min_size is *not* replicated pool specific.

Signed-off-by: Brad Hubbard <bhubbard@redhat.com>

Merge pull request #33379 from badone/wip-upgrade-ansible-version-for-ca

qa/ceph-ansible: Upgrade ansible version

Merge PR #33516 into master

* refs/pull/33516/head:
ceph.in: Fix name retval is not defined error

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Gabriel Brascher <gabriel@apache.org>

Merge PR #33525 into master

* refs/pull/33525/head:
osd/PeeringState.h: ignore RemoteBackfillReserved in WaitLocalBackfillReserved

Reviewed-by: David Zafman <dzafman@redhat.com>

Merge PR #33263 into master

* refs/pull/33263/head:
qa/vstart_runner.py: make run()'s interface same as teuthology's run

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge PR #33499 into master

* refs/pull/33499/head:
mount: fix the debug log when keyring getting secret failed

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>

Merge PR #33515 into master

* refs/pull/33515/head:
mgr/cephadm: replace static SSL cert
mgr/cephadm: dynamically add Grafana data sources
mgr/cephadm: provide static default configs for grafana deployment
mgr/cephadm: provision grafana
mgr/orch: add grafana hooks

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #29816 from coder-hugo/feature/fix-ldap-auth-doc

rgw: Fix documentation for rgw_ldap_secret

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>

Merge PR #33480 into master

* refs/pull/33480/head:
test: add new ceph_lseek test
client: fix error handling in lseek SEEK_HOLE/SEEK_DATA cases

Reviewed-by: David Disseldorp <ddiss@suse.de>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Xiubo Li <xiubli@redhat.com>

Merge PR #33427 into master

* refs/pull/33427/head:
qa/cephfs: rewrite a bit of code xfstests_dev.py
qa/cephfs: update xfstests-dev deps for RHEL 8

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge PR #32657 into master

* refs/pull/32657/head:
test: query using mds id, not rank
mgr: re-enable mds `scrub status` info in ceph status
mon: filter out ceph normal ceph entity types when dumping service metadata
mgr: filter out normal ceph services when processing service map
mgr: helper function to check if a service is a normal ceph service

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge PR #33449 into master

* refs/pull/33449/head:
mds: handle bad purge queue item encoding

Reviewed-by: Zheng Yan <zyan@redhat.com>

Merge PR #33471 into master

* refs/pull/33471/head:
mds: relevel debug message levels for balancer/migrator
mds: inline mds_role_t stream operator

Reviewed-by: Mark Nelson <mnelson@redhat.com>