doc/rgw: refine "Multi-site Config Ref" (1 of x)

Refine the syntax (and in some cases, the semantics) of the English in
"Multi-site Configuration Reference" in doc/radosgw/multisite.rst. This
is a long section, so more PRs are likely.

https://tracker.ceph.com/issues/58632

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Co-authored-by: Casey Bodley <cbodley@redhat.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>

Merge pull request #50051 from rhcs-dashboard/rbd-mirroring-status-fix

mgr/dashboard: fix rbd mirroring daemon health status

Reviewed-by: Pegonzal <NOT@FOUND>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>

Merge pull request #49729 from rzarzynski/wip-crimson-obcregistry-per-pg

crimson/osd: make the ObjectContextRegistry per-PG

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>
Reviewed-by: Matan Breizman <mbreizma@redhat.com>

Merge pull request #49020 from xxhdx1985126/wip-pg-remove

crimson/osd: implement pg removal

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #50058 from rishabh-d-dave/vstart-client-debug

vstart.sh: set logging for client and MDS when -d is passed

Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #50076 from idryomov/wip-codeowners-doc-writers-fix

CODEOWNERS: don't override doc-writers by core and rbd for some files

Reviewed-by: Neha Ojha <nojha@redhat.com>

Merge pull request #50070 from xxhdx1985126/wip-sync-peering-backfill

crimson/osd/pg: synchronize processing of peering events and backfill

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Matan Breizman <mbreizma@redhat.com>

Merge pull request #49344 from xxhdx1985126/wip-obc-watchers-checkonload

crimson/osd/object_context_loader: check on old watchers when loading obcs

Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #49955 from xxhdx1985126/wip-pg-stats-read

crimson/osd/ops_executor: apply delta stats for pure read ops

Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #50018 from Matan-B/wip-matanb-c-pg-pipeline

crimson/osd/osd_operations: Remove replicated_request_pg_pipeline

Reviewed-by: Samuel Just <sjust@redhat.com>

CODEOWNERS: don't override doc-writers by core and rbd for some files

This happens because core and rbd ownership is defined after
doc-writers: a later match takes precedence.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>

Merge pull request #50073 from cbodley/wip-codeowners-rgw

github: add rgw team to CODEOWNERS

Reviewed-by: Yuval Lifshitz <ylifshit@redhat.com>

Merge pull request #49555 from fmount/drive_group_crush

Add per OSD crush_device_class definition

Reviewed-by: Adam King <adking@redhat.com>

Merge pull request #50086 from zdover23/wip-doc-2023-02-13-multisite-migrating-single-site-to-multi-site

doc/rgw: "Migrating Single Site to Multi-Site"

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc/rgw: "Migrating Single Site to Multi-Site"

Refine "Migrating Single-site System to Multi-site" in
doc/radosgw/multisite.rst.

https://tracker.ceph.com/issues/58632

Co-authored-by: Cole Mitchell <cole.mitchell@gmail.com>
Co-authored-by: Anthonh D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>

Merge pull request #50071 from idryomov/wip-58688

qa/suites/rbd: fix sporadic "rx-only direction" test failures

Reviewed-by: Ramana Raja <rraja@redhat.com>

github: add /examples to CODEOWNERS

Signed-off-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #50077 from zdover23/wip-doc-2023-02-12-multisite-failover

doc/rgw: refine "Failover and Disaster Recovery"

doc/rgw: refine "Failover and Disaster Recovery"

English grammar and syntax pass for "Failover and Disaster Recovery" in
doc/radosgw/multisite.rst.

https://tracker.ceph.com/issues/58632

Co-authored-by: Cole Mitchell <cole.mitchell@gmail.com>
Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>

Merge pull request #50066 from zdover23/wip-doc-2023-02-10-multisite-configuring-secondary-zones

doc/rgw: refine "Configuring Secondary Zones"

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

github: add rgw team to CODEOWNERS

Signed-off-by: Casey Bodley <cbodley@redhat.com>

qa/suites/rbd: fix sporadic "rx-only direction" test failures

The existing

    xmlstarlet sel -t -v  '//mirror/peers/peer[1]/uuid')" = ""

test is bogus since a tx-only peer gets added after the remote
rbd-mirror daemon pings the local cluster.  It happened to pass most
of the time because xmlstarlet filter just failed on an empty peers
array, producing the wrongly expected empty string by accident.

Fixes: https://tracker.ceph.com/issues/58688
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>

Merge pull request #49763 from Svelar/vstart4

vstart: check mgr status after starting mgr

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>

crimson/osd/pg: synchronize processing of peering events and backfill
events

All peering events and backfill events for the same pg has to be
processed sequentially, so use a single pipeline phase to synchronize
them.

Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>

Merge pull request #50063 from zdover23/wip-doc-2023-02-10-cephfs-quota-extended-cephfs-attributes-and-getfattr

doc/cephfs: add note about CephFS extended attributes and getfattr

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc/rgw: refine "Configuring Secondary Zones"

English grammar and syntax pass (and some pragmatics, too, where I had
enough understanding to be helpful that way) for "Configuring Secondary
Zones" in doc/radosgw/multisite.rst.

https://tracker.ceph.com/issues/58632

Co-authored-by: Cole Mitchell <cole.mitchell@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>

vstart: check mgr status after starting mgr.

Signed-off-by: Rongqi Sun <sunrongqi@huawei.com>

doc/cephfs: add note about CephFS extended attributes and getfattr

Supersedes https://github.com/ceph/ceph/pull/50060

Add a note on the fact that CephFS extended attributes are not printed
by "getfattr /some/cephfs/dir/ -d -m -" even when the CephFS directory
has some extended attributes set on it.

https://lists.ceph.io/hyperkitty/list/ceph-users@ceph.io/thread/6ENI42ZMHTTP2OONBRD7FDP7LQBC4P2E/

Primary Author: Rishabh Dave <ridave@redhat.com>
Co-author: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>

crimson/osd: make the ObjectContextRegistry per-PG

This patch moves the OBC registry from ShardServices (which
is basicaly a gateway to a bunch of PGs) into PG itself.
Dividing OBCs by PG (they truly belong to) minimizes the space
to search when e.g. checking whether a client is blocked or
not. Therefore, this commit is enabler of more performant
PR #47637.

The changeset draws the assumption that OBC registry and all
its users live on the same CPU core. It looks valid to me.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

vstart.sh: set logging for client and MDS when -d is passed

Set debug log messages for client and MDS to 20 when option "--debug" is
passed to vstart.sh

Signed-off-by: Rishabh Dave <ridave@redhat.com>

Merge pull request #49132 from aclamk/wip-aclamk-bs-excl-lock

blk/kernel: Add O_EXCL for block devices

Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
Reviewed-by: Mark Nelson <mnelson@redhat.com>

mgr/dashboard: fix rbd mirroring daemon health status

Fixes: https://tracker.ceph.com/issues/58679
Signed-off-by: Nizamudeen A <nia@redhat.com>

Merge pull request #50023 from rosinL/fix-vstart

vstart: correct condition for checking crimson

Reviewed-by: Matan Breizman <mbreizma@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

Merge pull request #49744 from xxhdx1985126/wip-fix-seastar-mem-leak

seastar: fix mem leak caused by no maximum memory limit for cpu core

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>

Merge pull request #48703 from sseshasa/wip-fix-mclk-builtin-profile-mods

osd: Restore defaults of mClock built-in profiles upon modification

Reviewed-by: Neha Ojha <nojha@redhat.com>

Merge pull request #48591 from rzarzynski/wip-osd-snaptrimmer-waitscrub-fix-name

osd: fix name of WaitScrub state of SnapTrimmer

Merge pull request #47702 from ifed01/wip-ifed-more-pin-fix

os/bluestore: fix onode ref counting.

Merge pull request #49888 from phlogistonjohn/jjm-more-utils-coverage

cephadm: more test coverage for various utils functions

Reviewed-by: Adam King <adking@redhat.com>

Merge pull request #50030 from zdover23/wip-doc-2023-02-09-multisite-to-config-2ndary-zones

doc/rgw: refine multisite to "config 2ndary zones"

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc/rgw: refine multisite to "config 2ndary zones"

Refine the English in doc/radosgw/multisite.rst up to (but not
including) "Configure Secondary Zones".

https://tracker.ceph.com/issues/58632

Signed-off-by: Zac Dover <zac.dover@proton.me>

Merge pull request #50027 from joscollin/wip-drop-aitalic

cephfs-top: drop curses.A_ITALIC

Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #50021 from rhcs-dashboard/rename-endpoints

mgr/rgw: rename endpoints to zone_endpoints to match rgw spec

Reviewed-by: rkachach <NOT@FOUND>

Merge pull request #48783 from rhcs-dashboard/fix-grafana-stat-panel

mgr/dashboard: Replace vonage-status-panel with native grafana stat panel

Reviewed-by: Nizamudeen A <nia@redhat.com>

cephfs-top: drop curses.A_ITALIC

Fixes: https://tracker.ceph.com/issues/58663
Signed-off-by: Jos Collin <jcollin@redhat.com>

Merge pull request #49627 from rhcs-dashboard/box-podman-osd

cephadm/box: create osds with podman.

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Juan Miguel Olmo <jolmomar@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>

vstart: correct condition for checking crimson

Signed-off-by: luo rixin <luorixin@huawei.com>

Merge pull request #50022 from zdover23/wip-doc-2023-02-08-multisite-maintenance

doc/radosgw: refine "Maintenance" in multisite.rst

Merge pull request #50011 from zmc/deps-broken-repos

install-deps.sh: Fail when downloading apt repos

doc/radosgw: refine "Maintenance" in multisite.rst

Refine the text in the "Maintenance" section of
doc/radosgw/multisite.rst.

https://tracker.ceph.com/issues/58632

Co-authored-by: Cole Mitchell <cole.mitchell@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>

mgr/rgw: rename endpoints to zone_endpoints to match rgw spec

As per the docs (and the codes), the rgw_spec.endpoint should actually
be rgw_spec.zone_endpoint.

```
rgw_realm: myrealm
rgw_zonegroup: myzonegroup
rgw_zone: myzone
zone_endpoints: http://<rgw_host1>:<rgw_port1>, http://<rgw_host2>:<rgw_port2>
```
Refer: https://docs.ceph.com/en/latest/mgr/rgw/#rgw-realm-operations

Signed-off-by: Nizamudeen A <nia@redhat.com>

crimson/osd/osd_operations: Rename client_request_pg_pipeline

Rename client_request_pg_pipeline to request_pg_pipeline

Signed-off-by: Matan Breizman <mbreizma@redhat.com>

crimson/osd/osd_operations: Remove replicated_request_pg_pipeline

Use client_request_pg_pipeline instead.

Signed-off-by: Matan Breizman <mbreizma@redhat.com>

Merge pull request #49723 from anthonyeleven/anthonyeleven/58123

ceph: Clarify usage message for admin-socket commands

install-deps.sh: Fail when downloading apt repos

More specifically, if we get e.g. a 504 while attempting to download a
.list file, fail the build and log the status code.

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #49994 from zdover23/wip-doc-2023-02-05-rgw-multisite-refine-2

doc/rgw: refine ~50-~140 of multisite.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc/rgw: refine ~50-~140 of multisite.rst

Remove pleonasm from approximately line 50 to line 140 of
doc/rgw/multisite.rst.

Follows https://github.com/ceph/ceph/pull/49993.

https://tracker.ceph.com/issues/58632

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@gmail.com>

Merge pull request #49993 from zdover23/wip-doc-2023-02-04-rgw-multisite-top-matter-refine

doc/rgw: refine 1-50 of multisite.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc/rgw: refine 1-50 of multisite.rst

Refine the English in the first fifty lines of multisite.rst. This is
part of a project whose goal is the creation of a document that will
impart a good aerial view of RGW to a first-time reader in the minimum
number of words.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>

Merge pull request #49981 from zdover23/wip-doc-2023-02-03-rgw-multisite-zones-refinement

doc/rgw: refine "Zones" in multisite.rst

doc/rgw: refine "Zones" in multisite.rst

Clean up the English under the section called "Zones". Part of a larger
project aimed at giving the reader more understanding earlier in the
documentation of how buckets and zones and zone groups and endpoints
work.

https://tracker.ceph.com/issues/58632

Signed-off-by: Zac Dover <zac.dover@gmail.com>

Merge pull request #49968 from zdover23/wip-doc-2023-02-02-jaegertracing-refinement

doc/jaegertracing: refine index.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #49848 from ljflores/wip-tracker-58545

qa/workunits: give telemetry opt-in check more time

doc/jaegertracing: refine index.rst

Make English in jaegertracing/index.rst more elegant.

Signed-off-by: Zac Dover <zac.dover@gmail.com>

Merge pull request #49935 from athanatos/sjust/wip-58486

crimson: fix incorrect interval check in PG::submit_transaction

Reviewed-by: Xuehan Xu <xxhdx1985126@gmail.com>

crimson/net/ProtocalV2: no need to define fmt::ptr() since seastar has done it

Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>

seastar: bump up seastar submodule to fix mem leaks

fix mem leak caused by no maximum memory limit for cpu core

Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>

crimson/osd/ops_executor: apply delta stats for pure read ops

Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>

Merge pull request #49812 from petrutlucian94/poll_hup

msg: fix poll event driver, handling POLLHUP and POLLERR

ceph: Clarify usage message for admin-socket commands

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>

Merge pull request #48295 from NitzanMordhai/wip-nitzan-osd-start-osdmap-hang-adding-debug-msg

OSD: during test start, not all osds started due to consum map hang

Merge pull request #45247 from andriytk/update-ceph-mgw

rgw: update motr sal

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>

Merge PR #49842 into main

* refs/pull/49842/head:
Revert "cmake: do not link ceph-dencoder against global"

Reviewed-by: Tim Serong <tserong@suse.com>

Merge pull request #49946 from cityofships/pkg-docs

doc/cephadm: grammar / syntax in install.rst

Signed-off-by: Piotr Parczewski <piotr@stackhpc.com>

crimson/osd/pg: remove incorrect map epoch check in PG::submit_transasction

It's entirely fine for the map_epoch to change while the op is processed
as long as none of the intervening epochs caused an interval change.  In
general, the correct way to check for an interval change is with
has_reset_since.

We don't need to do this check here at all because IOInterruptCondition
will already have performed it against the captured epoch when the
continuation resumed.

Introduced: 31418020fd58
Fixes: https://tracker.ceph.com/issues/58486
Signed-off-by: Samuel Just <sjust@redhat.com>

Revert "cmake: do not link ceph-dencoder against global"

Reverting since this is causing the following ceph-dencoder exception:

        [src/tcmalloc.cc:332] Attempt to free invalid pointer 0x558f14e3a000

NOTE: I didn't debug this any more further since there is sizable backlog
of PRs that need testing/merging, but reverting the change makes it work.

Fixes: http://tracker.ceph.com/issues/58219
Signed-off-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #49913 from neesingh-rh/wip-51459

doc: add the damage types that scrub can repair

Reviewed-by: Zac Dover <zac.dover@proton.me>

Merge PR #49048 into main

* refs/pull/49048/head:
mds: fix and skip submitting invalid osd request

Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Milind Changire <mchangir@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>

doc: add the damage types that scrub can repair

Fixes: https://tracker.ceph.com/issues/51459
Signed-off-by: Neeraj Pratap Singh <neesingh@redhat.com>

Rollback submodules changes made by accident

Signed-off-by: Andriy Tkachuk <andriy.tkachuk@seagate.com>

Merge pull request #48541 from lxbsz/wip-qa-upgrade-fix

qa/cephfs: fix confusing config when upgrading mds nodes

Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Kotresh HR <khiremat@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>

Merge pull request #48049 from dparmar18/wip-dparmar-qa-mixed-clients-57280

qa/fs/mixed-clients: specify distros for tests

Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Kotresh HR <khiremat@redhat.com>

Merge pull request #48251 from dparmar18/wip-dparmar-MDS-57359

mds/Server: do not allow -ve reclaim flags to cause client eviction

Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Xiubo Li <xiubli@redhat.com>
Reviewed-by: Milind Changire <mchangir@redhat.com>
Reviewed-by: Kotresh HR <khiremat@redhat.com>

Merge pull request #47753 from mchangir/mon-disable-snap-id-allocation-for-fsmap-pools

mon: disable snap id allocation for fsmap pools

Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
Reviewed-by: Kotresh HR <khiremat@redhat.com>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>

Merge pull request #47114 from lxbsz/wip-56532

ceph_fuse: retry the test_dentry_handling if fails

Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Milind Changire <mchangir@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>

client: switch to old method to invalidate dcache if euid != 0

Force to use the old and slow method to invalidate the dcache
if the euid is non-root, or the remount may fail with return
code 1 or 32.

https://tracker.ceph.com/issues/56532
Signed-off-by: Xiubo Li <xiubli@redhat.com>

ceph_fuse: make it to force invalidating dentries when kernel >=3.18

The remount will fail randomly for unknown reasons. And in certain
circumstance we can reprodce this very easy, which will block our
testing. Make it posible to force to old method to invalidate the
dcache when the "client_try_dentry_invalidate" option is enabled
even kernel version >= 3.18.0

Fixes: https://tracker.ceph.com/issues/56532
Signed-off-by: Xiubo Li <xiubli@redhat.com>

ceph_fuse: retry the test_dentry_handling if fails

For some unknown reason the remount will fail, we need to retry it
for the test_dentry_handling.

Fixes: https://tracker.ceph.com/issues/56532
Signed-off-by: Xiubo Li <xiubli@redhat.com>

client: move a client's option to mds-client.yaml

mds_max_retries_on_remount_failure option is used by Client.cc only.

Fixes: https://tracker.ceph.com/issues/56532
Signed-off-by: Xiubo Li <xiubli@redhat.com>

crimson/osd/osd_operations/client_request: clarify get_obc stage message

Signed-off-by: Samuel Just <sjust@redhat.com>

Merge pull request #49906 from evershalik/main

Update README.md

Merge pull request #49905 from zdover23/wip-doc-2023-01-29-rados-config-osd-config-ref-osd-op-thread-suicide-timeout

doc/rados: document osd_op_thread_suicide_timeout

Merge pull request #49908 from Matan-B/wip-matanb-upgrade-doc

doc/dev/developer_guide: Add Upgrade Testing Documentation

Reviewed-by: Zac Dover <zac.dover@proton.me>

doc/dev/developer_guide/testing_integration_tests: Add Upgrade Testing Documentation

Signed-off-by: Matan Breizman <mbreizma@redhat.com>

doc/rados: document osd_op_thread_suicide_timeout

Add default value for osd_op_thread_suicide_timeout configuration value
to the OSD Configuraton Reference.

https://tracker.ceph.com/issues/58590

Signed-off-by: Zac Dover <zac.dover@gmail.com>

Update README.md

Signed-off-by: SHANKAR <98207888+evershalik@users.noreply.github.com>

Merge branch 'master' into update-ceph-mgw

crimson/osd/object_context_loader: add logging for notify_on_change

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/osd/object_context_loader: convert to log macros

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/osd/object_context_loader: take backend by reference

It's required and we don't check for null.

Signed-off-by: Samuel Just <sjust@redhat.com>