doc/rados: add prompts to erasure-code-jerasure.rst

Add unselectable prompts to
doc/rados/operations/erasure-code-jerasure.rst.

https://tracker.ceph.com/issues/57108

Signed-off-by: Zac Dover <zac.dover@gmail.com>

Merge pull request #48549 from pkalever/snap-list

cls/rbd: update last_read in group::snap_list

Reviewed-by: Mykola Golub <mgolub@suse.com>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>

Merge pull request #49177 from yuvalif/remove-pubsub-release-notes

rgw: update release notes on the removal of pubsub

Merge pull request #49052 from tchaikov/wip-fmt-v9

*: include fmt/ostream.h if FMT_VERSION >= 9

Reviewed-by: Tim Serong <tserong@suse.com>

Merge pull request #49185 from zdover23/wip-doc-2022-12-01-rados-ops-devices-prompts

doc/rados: add prompts to devices.rst

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>

doc/rados: add prompts to devices.rst

Add unselectable prompts to doc/rados/operations/devices.rst.

https://tracker.ceph.com/issues/57108

Signed-off-by: Zac Dover <zac.dover@gmail.com>

Merge pull request #49182 from zdover23/wip-doc-2022-12-01-rados-ops-crush-map-prompts

doc/rados: add prompts to crush-map.rst

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>

doc/rados: add prompts to crush-map.rst

Add unselectable prompts to doc/rados/operations/crush-map.rst.

https://tracker.ceph.com/issues/57108

Signed-off-by: Zac Dover <zac.dover@gmail.com>

Merge pull request #48838 from badone/wip-ceph-ansible-suite-nightlies-disable

qa/tests: Remove octopus ceph-ansible tests

Reviewed-by: Neha Ojha <nojha@redhat.com>

rgw: update release notes on the removal of pubsub

Signed-off-by: yuval Lifshitz <ylifshit@redhat.com>

Merge pull request #48609 from cbodley/wip-rgw-encrypt-compress-release-note

PendingReleaseNotes: add note for rgw compression+encryption

Reviewed-by: Yuval Lifshitz <ylifshit@redhat.com>

PendingReleaseNotes: add note for rgw compression+encryption

adds release notes for the feature added in
https://github.com/ceph/ceph/pull/46188

Signed-off-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #48996 from yuvalif/wip-yuval-remove-pubsub

remove pubsub from the RGW

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
Reviewed-by: Ronen Friedman <rfriedma@redhat.com>

Merge pull request #49167 from zdover23/wip-doc-2022-12-01-cephadm-upgrade-warning-removal

doc/cephadm - remove "danger" admonition

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

doc/cephadm - remove "danger" admonition

Remove the "Danger!" admonition that warned against upgrading to Pacific
from an older version of Ceph. That admonition was meant to protect
against the issue discussed here: https://tracker.ceph.com/issues/53062.
That issue was fixed in this PR:
https://github.com/ceph/ceph/pull/43793.

Signed-off-by: Zac Dover <zac.dover@gmail.com>

Merge pull request #49161 from zdover23/wip-doc-2022-12-01-cephadm-host-management-grammar

doc/cephadm: improve grammar in "listing hosts"

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #48930 from joscollin/wip-replace-isinstance-current-screen

cephfs-top: replace isinstance call with current_screen variable

Reviewed-by: Neeraj Pratap Singh <neesingh@redhat.com>

Merge pull request #49041 from joscollin/wip-reset-filters-nofs

cephfs-top: reset filters when no fs

Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Neeraj Pratap Singh <neesingh@redhat.com>

Merge pull request #49160 from Gaoweinan/main-doc-docerror-radosgw-gaoweinan

doc/radosgw:Fix index error

doc/cephadm: improve grammar in "listing hosts"

Improve the grammar in host-management.rst.

Signed-off-by: Zac Dover <zac.dover@gmail.com>

doc/radosgw:Fix index error

Fix index error.There is a sentence in the note of chapter "Pool Placement and storage classes": "If you have not done any previous Multisite Configuration", so it seems that chapter "Multisite Configuration" precedes chapter "Pool Placement and storage classes", but actually chapter "Multisite Configuration" follows chapter "Pool Placement and storage classes" in the index.

Fix:https://tracker.ceph.com/issues/58134

Signed-off-by: gaoweinan <gaoweinan@inspur.com>

Merge pull request #49153 from Gaoweinan/master-doc-docerror-WordRepetition-gaoweinan

doc/radosgw/swift: Fix repeated word

doc/radosgw/swift: Fix repeated word

Fix repeated word in swift API

fix:https://tracker.ceph.com/issues/58124

Signed-off-by: gaoweinan <gaoweinan@inspur.com>

Merge pull request #49156 from zdover23/wip-doc-2022-12-01-cephadm-install-airgap-grammar

doc/cephadm: improve airgapping procedure grammar

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc/cephadm: improve airgapping procedure grammar

Improve the grammar of the airgapping procedure.

Signed-off-by: Zac Dover <zac.dover@gmail.com>

rgw/pubsub: remove unnecessary REST abstraction layer

this was used for an already deprecated non s3 API for pubsub
also, some texts changes in docs and error messages

Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>

rgw/pubsub: remove deprecated pubsub event types

Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>

rgw/pubsub: remove pusub subscription functionality

Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>

rgw/pubsub: remove pusub sync module functionality

also update the documentation

Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>

Merge pull request #48908 from kalebskeithley/ceph-zipper-utils

rgw: refactor selected files for better above- vs below-the-line

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>

Merge pull request #49147 from zdover23/wip-doc-2022-11-30-cephadm-install-airgap-formatting

doc/cephadm: format airgap install procedure

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>

doc/cephadm: format airgap install procedure

Format the procedure that explains how to install an airgapped cluster.

Signed-off-by: Zac Dover <zac.dover@gmail.com>

Merge pull request #49060 from rhcs-dashboard/accept-cors-dashboard

mgr/dashboard: allow cross origin when the url is set

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>

Merge pull request #49143 from zdover23/wip-doc-2022-11-30-44346-update

doc/cephadm: add airgapped install procedure

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>

doc/cephadm: add airgapped install procedure

Add a procedure describing an installation with an airgapped registry.

This commit ingests work done in https://github.com/ceph/ceph/pull/44346
that was abandoned for lo these past eleven months. The PR connected
with this commit supersedes that PR.

Signed-off-by: Zac Dover <zac.dover@gmail.com>

Merge pull request #47969 from myoungwon/wip-rbm-integration-step1

crimson/os/seastore: add RBM OOL path

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #49131 from cbodley/wip-rgw-log-identity-type

rgw: initialize rgw_log_entry::identity_type

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>

rgw: refactor selected files for better above- vs below-the-line

Based on https://github.com/ceph/ceph/pull/48272, separate selected methods
into new files for above-the-line vs below-the-line linkage. This is more of
the work to prepare for eventual merging of the loadable module implementation.

"Utility" functions that don't reference the Store are moved, e.g. from
rgw_zone.cc, into the new rgw_zone_utils.cc. Methods in the new *_utils.cc
files are above-the-line.

Signed-off-by: Kaleb S. KEITHLEY <kkeithle@redhat.com>

rgw: default-initialize delete_multi_obj_op_meta

Signed-off-by: Casey Bodley <cbodley@redhat.com>

rgw: initialize rgw_log_entry::identity_type

uninitialized identity_type field was causing unit test failures from
check-generated.sh:

**** rgw_log_entry test 2 dump_json check failed ****
   ceph-dencoder type rgw_log_entry select_test 2 dump_json > /tmp/typ-AW7AEODB3
   ceph-dencoder type rgw_log_entry select_test 2 encode decode dump_json > /tmp/typ-0NX4cmLHR
21c21
<     "identity_type": 3599295712
---
>     "identity_type": 2072560864

Fixes: https://tracker.ceph.com/issues/58115
Signed-off-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #49136 from zdover23/wip-doc-2022-11-30-glossary-dashboard-module

doc/glossary: add "Dashboard Module"

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc/glossary: add "Dashboard Module"

Define "Dashboard Module" in doc/glossary.rst.

Signed-off-by: Zac Dover <zac.dover@gmail.com>

Merge pull request #49133 from zdover23/wip-doc-2022-11-30-glossary-rados-cluster

doc/glossary: add "RADOS Cluster"

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc/glossary: add "RADOS Cluster"

Define "RADOS Cluster" in the glossary.

Signed-off-by: Zac Dover <zac.dover@gmail.com>

Merge pull request #48682 from Matan-B/wip-matanb-obc-loader

crimson/osd: Introduce ObjectContextLoader

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: chunmei-liu <chunmei.liu@intel.com>

Merge pull request #48831 from rzarzynski/wip-crimson-list_snaps-fix-errmsg

crimson/osd: fix error msg in OpsExecuter::do_list_snaps()

Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #48527 from rzarzynski/wip-crimson-simpler-cloning

crimson/osd: simplify cloning

Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #49119 from zdover23/wip-doc-2022-11-29-rados-ops-change-mon-elections-prompts

doc/rados: add prompts to change-mon-elections.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #49120 from zdover23/wip-doc-2022-11-29-rados-ops-control-prompts

doc/rados: add prompts to control.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #49118 from zdover23/wip-doc-2022-11-29-rados-cache-tiering-prompts

doc/rados: add prompts to cache-tiering.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #49114 from zdover23/wip-doc-2022-11-29-rados-bluestore-migration-prompts

doc/rados: add prompts to bluestore-migration.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc/rados: add prompts to control.rst

Add unselectable prompts to doc/rados/operations/control.rst.

https://tracker.ceph.com/issues/57108

Signed-off-by: Zac Dover <zac.dover@gmail.com>

doc/rados: add prompts to change-mon-elections.rst

Add unselectable prompts to
doc/rados/operations/change-mon-elections.rst.

https://tracker.ceph.com/issues/57108

Signed-off-by: Zac Dover <zac.dover@gmail.com>

Merge pull request #48525 from rhcs-dashboard/fix-PgImbalance-alert

mgr/dashboard: fix CephPGImbalance alert

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>

Merge pull request #48526 from rhcs-dashboard/fix-cephPoolGrowth-alert

mgr/dashboard: Fix CephPoolGrowthWarning alert

Reviewed-by: Pegonzal <NOT@FOUND>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>

doc/rados: add prompts to cache-tiering.rst

Add unselectable prompts to doc/rados/operations/cache-tiering.rst.

https://tracker.ceph.com/issues/57108

Signed-off-by: Zac Dover <zac.dover@gmail.com>

doc/rados: add prompts to bluestore-migration.rst

Add unselectable prompts to
doc/rados/operations/bluestore-migration.rst.

https://tracker.ceph.com/issues/57108

Signed-off-by: Zac Dover <zac.dover@gmail.com>

cephfs-top: reset filters when no fs

Signed-off-by: Jos Collin <jcollin@redhat.com>

Merge pull request #49107 from zdover23/wip-doc-2022-11-29-rados-balancer-prompts

doc/rados: add prompts to balancer.rst

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc/rados: add prompts to balancer.rst

Add unselectable prompts to doc/rados/operations/balancer.rst.

https://tracker.ceph.com/issues/57108

Signed-off-by: Zac Dover <zac.dover@gmail.com>

Merge pull request #49015 from batrick/meta-doc

doc/cephfs: correct names for fs/meta

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Kotresh HR <khiremat@redhat.com>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #48490 from aclamk/wip-aclamk-fix-deferred

[bluestore] Improve deferred write decision

Reviewed-by: Mark Nelson <mnelson@redhat.com>
Reviewed-by: Igor Fedotov <ifedotov@suse.com>

mgr/dashboard: allow cross origin when the url is set

Allow CORS when the cross_origin_url is set in the config opt.

you have to update the cross_origin_url setting with the url of the
requesting entity.

The request needs to have the header `Access-Control-Allow-Origin`
with the origin URL

The url can be set using this command
`ceph config set mgr mgr/dashboard/cross_origin_url
http://localhost:4200`

multiple urls can be set as
`ceph config set mgr mgr/dashboard/cross_origin_url
http://localhost:4200,http://localhost:4201`

If multiple url is provided in the configuration option, then whatever
url is there in the Access-Control-Allow-Origin request header will be
allowed for CORS

Once the URL is set you have to restart the dashboard module to restart
the cherrypy server with the new CORS policies

Fixes: https://tracker.ceph.com/issues/58086
Signed-off-by: Nizamudeen A <nia@redhat.com>

Merge pull request #49053 from tchaikov/wip-crimson-fmt-v9

crimson: various fmt related changes and fixes

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>

Merge pull request #47221 from markhpc/wip-faster-rocksdb

[WIP] kv/RocksDBStore: Improved RocksDB Settings and Tombstone behavior

Merge pull request #48875 from yuvalif/wip-yuval-fix-58014

rgw/notifications: sending metadata in COPY and CompleteMultipartUpload

Merge pull request #49082 from zdover23/wip-doc-2022-11-28-rbd-isci-monitoring-prompts

doc/rbd: add prompts to iscsi-monitoring.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>

Merge pull request #48598 from yuvalif/wip-yuval-fix-57899

rgw/admin/notifications: support admin operations on topics with tenants

Merge pull request #49079 from zdover23/wip-doc-2022-11-28-glossary-ceph-system-remove

doc/glossary: s/Ceph System/Ceph Cluster/

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc/rbd: add prompts to iscsi-monitoring.rst

Add unselectable prompts to doc/rbd/iscsi-monitoring.rst.

Signed-off-by: Zac Dover <zac.dover@gmail.com>

doc/glossary: s/Ceph System/Ceph Cluster/

Remove "Ceph System" and replace it with "Ceph Cluster".

Signed-off-by: Zac Dover <zac.dover@gmail.com>

Merge pull request #49074 from zdover23/wip-doc-2022-11-27-dev-guide-basic-workflow-local-working-copy

doc/dev: improve Basic Workflow wording

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc/dev: improve Basic Workflow wording

Make several semantic and syntactic improvements to basic-workflow.rst.

Signed-off-by: Zac Dover <zac.dover@gmail.com>

Merge pull request #48680 from pkalever/snap-id

rbd: add --snap-id option to "rbd device map" to allow mapping arbitrary snapshots

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>

Merge pull request #49066 from zdover23/wip-doc-2022-11-26-glossary-ceph-system-remove

doc/glossary: remove "Ceph System"

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #49065 from zdover23/wip-doc-2022-11-26-rados-ops-add-or-rm-osds-prompts

doc/rados: add prompts to add-or-remove-osds

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #49045 from zdover23/wip-doc-2022-11-25-rbd-iscsi-initiator

doc/rbd: update iSCSI gateway info

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: Ilya Dryomov <idryomov@redhat.com>

doc/rbd: update iSCSI gateway info

Update iSCSI gateway info in the RBD documentation.

https://tracker.ceph.com/issues/58080

Signed-off-by: Zac Dover <zac.dover@gmail.com>

doc/glossary: remove "Ceph System"

"Ceph System" appears only in definitions where "Ceph Cluster" should
be, so I'm removing the headword. A future commit will scrub the
glossary of the phrase "Ceph System".

Signed-off-by: Zac Dover <zac.dover@gmail.com>

qa/workunits/rbd-nbd: clear DEV after detach tests

Otherwise we attempt to unmap it in cleanup(), needlessly.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>

doc/rados: add prompts to add-or-remove-osds

Add unselectable prompts to add-or-rm-osds.rst.

Signed-off-by: Zac Dover <zac.dover@gmail.com>

Merge pull request #49062 from zdover23/wip-doc-2022-11-26-glossary-ceph-manager

doc/glossary: link to "Ceph Manager"

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>

doc/glossary: link to "Ceph Manager"

Add link to "Ceph Manager" material.

Signed-off-by: Zac Dover <zac.dover@gmail.com>

Merge pull request #48761 from soumyakoduri/wip-skoduri-cloudtier-fixes

rgw/cloud-transition: Fix issues with MCG endpoint

Reviewed-by: Casey Bodley <cbodley@redhat.com>

crimson/osd: correct the fmt::formatter<WatchTimeoutRequest>

it was introduced by c9569f8eb027b9e08c8eeb59ecb37378ef66e5c0

Signed-off-by: Kefu Chai <tchaikov@gmail.com>

crimson: print exceptions using e.what()

see also e6223872c58e492d3570335fd7f05bb52641837c

Signed-off-by: Kefu Chai <tchaikov@gmail.com>

crimson/os: specialize fmt::formatter<> for StagedIterator

StagedIterator is a nested class of stage_t, which is in turn a template
class. it would be impossible to partial specialize fmt::formatter<> for
a nested class of a template class. to workaround this, we specialize
fmt::formatter<> for a type which has `do_format_to()` method, and
define this method for StagedIterator.

since seastar::logger is the only user of the operator<<() operator,
the original operator<<() operator is replaced with this new helper
method.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>

Merge pull request #49036 from idryomov/wip-52932

mgr/rbd_support: avoid wedging the task queue if pool is removed

Reviewed-by: Mykola Golub <mgolub@suse.com>

Merge pull request #49042 from idryomov/wip-rbd-support-flake8

mgr/rbd_support: clean up and enable flake8

Reviewed-by: Mykola Golub <mgolub@suse.com>

crimson/os: include fmt/os.h for printing std::error_code

this is required by {fmt} v9 and up.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>

crimson: specialize fmt::formatter<> for formatting using {fmt}

so the specialized types can be formatted using {fmt} v9.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>

*: include fmt/ostream.h if FMT_VERSION >= 9

before this change, we assume that `fmt/ostream.h` is included, and
reference `fmt::ostream_formatter`. this breaks the build if the tree
is compiled on {fmt} v9 and up.

after this change, `fmt/ostream.h` is conditionally included. as the
compiling unit is supposed to include fmt headers before including
headers in this project, we can tell if fmt/ostream.h is needed or not
by checking the FMT_VERSION macro.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>

Merge pull request #49046 from zdover23/wip-doc-2022-11-25-rados-ops-erasure-code-profiles

doc/rados: cleanup "erasure code profiles"

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc/rados: cleanup "erasure code profiles"

Improve the grammar of "Erasure Code Profiles".

Signed-off-by: Zac Dover <zac.dover@gmail.com>

Merge pull request #48927 from neesingh-rh/fix_58028

cephfs-top: Fix unresposive sorting in some cases

Reviewed-by: Jos Collin <jcollin@redhat.com>

Merge pull request #48542 from CongMinYin/fix-inconsistent-pwl-status

librbd/cache/pwl: fix clean vs bytes_dirty cache state inconsistency

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>

cephfs-top: Fix unresposive sorting in some cases

Sorting is not working properly in case of change
in the number of clients or after removing and
creating the same filesystem again.

Fixes: https://tracker.ceph.com/issues/58028
Signed-off-by: Neeraj Pratap Singh <neesingh@redhat.com>

Merge pull request #49026 from neesingh-rh/fix_58031

cephfs-top: sorting excepts when the filesystems are removed and created

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>

mgr/rbd_support: clean up and enable flake8

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>

Merge pull request #49029 from Matan-B/wip-matanb-EIO-flag

crimson/osd: Support Pool EIO flag

Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>
Reviewed-by: Kefu Chai <tchaikov@gmail.com>