doc: note architecture availability for PMEM mode of PWL cache

Fixes: https://tracker.ceph.com/issues/49947
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>

Merge pull request #40363 from orozery/rbd-clone-encryption

librbd: add encryption format support for clones (part 1/2)

Reviewed-by: Mykola Golub <mgolub@suse.com>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>

Merge pull request #48547 from SUSE/wip-fix-57893

make-dist: don't set Release tag in ceph.spec for SUSE distros

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>

Merge pull request #48610 from zdover23/wip-doc-2022-10-25-cephadm-ssh-capitalization

doc/cephadm: s/ssh/SSH/ in doc/cephadm (complete)

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc/cephadm: s/ssh/SSH/ in doc/cephadm (complete)

This PR alters "ssh" to "SSH" in the text (that is, not in
commands) every location in the doc/cephadm/ directory where
"ssh" should be "SSH".

Signed-off-by: Zac Dover <zac.dover@gmail.com>

make-dist: don't set Release tag in ceph.spec for SUSE distros

SUSE's Open Build Service overwrites the Release tag with checkin
and build counters, so we can't use it to record the number of
commits since the last tag, and the last commit hash.  This commit
appends that extra information to the Version tag instead for
SUSE builds.

Fixes: https://tracker.ceph.com/issues/57893
Signed-off-by: Tim Serong <tserong@suse.com>
Signed-off-by: Nathan Cutler <ncutler@suse.com>

Merge pull request #46188 from Zhiwei-Dai/wip-rgw-crypto-stack-on-compress

rgw: support full object encryption stack on compression

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #48588 from tchaikov/wip-57834

qa/tasks/vstart_runner: do not fail if stop.sh fails

Reviewed-by: Tim Serong <tserong@suse.com>

Merge pull request #48345 from Matan-B/wip-matanb-c-load-obc

crimson/osd: Generalize loading obc for head/clone

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Xuehan Xu <xxhdx1985126@gmail.com>

Merge pull request #48605 from zdover23/wip-doc-2022-10-24-cephadm-front-matter-improvement

doc/cephadm: improve front matter

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc/cephadm: improve front matter

- I fixed a sentence that was missing a verb.
- I linked to the Ceph-specific Rook instructions.
- I removed the word "GitHub", because after adding the
  Rook instructions it made the sentence false.

Signed-off-by: Zac Dover <zac.dover@gmail.com>

Merge pull request #48576 from cyx1231st/wip-crimson-msgr-cleanup-2

crimson/net: fixes and cleanups

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
Reviewed-by: Matan Breizman <mbreizma@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #48600 from zdover23/wip-doc-2022-10-24-cephadm-host-management-colon-cleaning

doc/cephadm: clean colons in host-management.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #48599 from zdover23/wip-doc-2022-10-24-cephadm-troubleshooting-ssh-capitalization

doc/cephadm: s/ssh/SSH/ in troubleshooting.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc/cephadm: clean colons in host-management.rst

Two lines in host-management.rst ended with both colons and
full stops (periods), causing a kind of punctuational turf
war. This commit removes the full stops.

Signed-off-by: Zac Dover <zac.dover@gmail.com>

doc/cephadm: s/ssh/SSH/ in troubleshooting.rst

Two places in the troubleshooting.rst file had "ssh" in
the text when it should have been "SSH".

Signed-off-by: Zac Dover <zac.dover@gmail.com>

Merge pull request #48593 from zdover23/wip-doc-2022-10-23-cephadm-front-matter

doc/cephadm: update install.rst

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>

doc/cephadm: update install.rst

This commit addresses https://github.com/ceph/ceph/pull/43250,
which has remained unmerged for thirteen months. The issues
raised in that PR are addressed here.

This commit contributes to the simplification of the procedure
that explains how to install cephadm. More remains to be done
on this page, but the old PR had to be dealt with first.

Signed-off-by: Zac Dover <zac.dover@gmail.com>

Merge pull request #48584 from tchaikov/crimson-net-formatter

crimson/net: define fmt::formatter for write_state_t

Reviewed-by: Ronen Friedman <rfriedma@redhat.com>

Merge pull request #48587 from zdover23/wip-doc-2022-10-22-cephadm-host-management-prompts

doc/cephadm: add prompts to host-management.rst

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>

qa/tasks/vstart_runner: do not fail if stop.sh fails

stop.sh might fail, but let's keep moving on.

See-also: https://tracker.ceph.com/issues/57834
Signed-off-by: Kefu Chai <tchaikov@gmail.com>

stop.sh: call cephadm rm-cluster only if FSID is not empty

there are chances that there is no cluster running at that moment,
so we could have failure messages like

[errno 2] RADOS object not found (error connecting to the cluster)
usage: cephadm rm-cluster [-h] --fsid FSID [--force] [--keep-logs]
                          [--zap-osds]
cephadm rm-cluster: error: argument --fsid: expected one argument

in that case, better off not failing this bash function, as this
is not a fatal failure.

See-also: https://tracker.ceph.com/issues/57834
Signed-off-by: Kefu Chai <tchaikov@gmail.com>

Merge pull request #48555 from phlogistonjohn/jjm-unify-test-alertmanager-config

mgr/cephadm: consolidate test_alertmanager_config_* tests into one

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Redouane Kachach <rkachach@redhat.com>

doc/cephadm: add prompts to host-management.rst

This PR adds unselectable prompts to host-management.rst.

Signed-off-by: Zac Dover <zac.dover@gmail.com>

crimson/net: define fmt::formatter for write_state_t

for better readability

Signed-off-by: Kefu Chai <tchaikov@gmail.com>

Merge pull request #48478 from myoungwon/wip-rbm-move-mkfs-cleanup

crimson/os/seastore/rbm: move mkfs to RBMDevice and use device_config_t

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>

crimson/net: convert Connection to an interface class

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>

crimson/net: convert Messenger to an interface class

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>

crimson/net: no futurized SocketMessenger::get_global_seq()

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>

crimson/net: no futurized Messenger::set_myaddrs()

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>

crimson/net: add warn log if server got mismatched lossy policy from client

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>

crimson/net: set global_seq when get from Messenger

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>

crimson/net: move features from Connection to SocketConnection

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>

crimson/net: drop the unnecessary connection_features member

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>

crimson/net: fix peer_supported_features usages

Also see commit "msg/async/ProtocolV2: store supported features instead
of required"

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>

Merge pull request #48445 from rzarzynski/wip-crimson-fix-obcload-errs

crimson/osd: send proper reply on obc load failure

Reviewed-by: Matan Breizman <mbreizma@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #48577 from zdover23/wip-doc-2022-10-21-radosgw-notifications-and-event

doc/radosgw: refine "notifications" and "events"

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>

doc/radosgw: refine "notifications" and "events"

This commit refines the English in the "Notifications"
and "Events" sections of the notifications.rst page
(the "Bucket Notifications" page).

Signed-off-by: Zac Dover <zac.dover@gmail.com>

crimson/os/seastore/cbj: handle remaing space (from written_to to the end of the journal) is less than the requested size

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

crimson/os/seastore/rbm: move test interfaces to the end of the class

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

crimson/os/seastore/cbj: rename size-related interfaces with grouping

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

Merge pull request #48477 from rzarzynski/wip-crimson-rollback-delete-head

crimson/osd: add the delete-head special case of CEPH_OSD_OP_ROLLBACK

Reviewed-by: Matan Breizman <mbreizma@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #48572 from zdover23/wip-doc-2022-10-21-cephadm-host-management-os-tuning-grammar

doc/cephadm: refine "os tuning" in h. management

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc/cephadm: refine "os tuning" in h. management

This commit refines the English in the "OS Tuning Profiles" section of
the "Host Management" page of the cephadm documentation. This commit is
made separately from but in anticipation of a forthcoming commit that
corrects technical (non-grammatical) errors.

Signed-off-by: Zac Dover <zac.dover@gmail.com>

Merge pull request #46089 from myoungwon/wip-dedup-doc

doc/dev: add explanation of how to use deduplication

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: Samuel Just <sjust@redhat.com>

crimson/osd: add the delete-head special case of CEPH_OSD_OP_ROLLBACK

This allows to pass `TestLibRBD.TestIOToSnapshot`:

```
[rzarzynski@o06 build]$ CRIMSON_COMPAT=true RBD_FEATURES=1 bin/ceph_test_librbd --gtest_filter=TestLibRBD.TestIOToSnapshot
seed 3954016
Note: Google Test filter = TestLibRBD.TestIOToSnapshot
[==========] Running 1 test from 1 test suite.
[----------] Global test environment set-up.
[----------] 1 test from TestLibRBD
[ RUN      ] TestLibRBD.TestIOToSnapshot
using new format!
...
opening testimg@orig
read: 80
write to snapshot returned -30
Read-only file system
num snaps is: 2
expected: 2
snap: orig
snap: written
found orig with size 2097152
found written with size 2097152
num snaps is: 1
expected: 1
snap: orig
found orig with size 2097152
num snaps is: 0
expected: 0
[       OK ] TestLibRBD.TestIOToSnapshot (7510 ms)
[----------] 1 test from TestLibRBD (7510 ms total)

[----------] Global test environment tear-down
[==========] 1 test from 1 test suite ran. (8504 ms total)
[  PASSED  ] 1 test.
```

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

Merge pull request #48246 from liangmingyuanneo/fix-throttle-test

test/rgw: improve integrity of rgw throttle test

Reviewed-by: Casey Bodley <cbodley@redhat.com>

crimson/osd: ClientRequest sends error to client when loading obc fails

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

Merge pull request #48456 from rhcs-dashboard/cypress-video-enable

mgr/dashboard: enable cypress video on test fails

Reviewed-by: Aashish Sharma <aasharma@redhat.com>

Merge pull request #48546 from rhcs-dashboard/update-node

cmake: bump node version to 14

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>

Merge pull request #48505 from zhscn/fix-uaf

crimson/osd: fix use after free error in FuturizedStoreLogReader::read

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>
Reviewed-by: Kefu Chai <tchaikov@gmail.com>

crimson/net: drop Protocol::proto_type

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>

crimson/net: check SERVER_WAIT state won't send

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>

crimson/net: check CONNECTING/WAIT/STANDBY states are not reentrant

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>

Merge pull request #48556 from zdover23/wip-doc-2022-10-20-radosgw-notifications-bucket-notifications-rest-api

doc/radosgw: refine "bucket notifications"

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>

doc/radosgw: refine "bucket notifications"

This commit refines the English in the "Bucket Notifications REST API"
section of the notifications.rst page (the "Bucket Notifications" page).

Co-author: Cole Mitchell <cole.mitchell@gmail.com>

Signed-off-by: Zac Dover <zac.dover@gmail.com>

Merge pull request #47848 from galsalomon66/s3select_next_version

moving to next version of s3select.

Reviewed-by: Casey Bodley <cbodley@redhat.com>

mgr/cephadm: consolidate test_alertmanager_config_* tests into one

Consolidate all the test_alertmanager_config_* tests into one pytest
parameterized test function. While doing this make all test instances
use a mock socket.getfqdn so that all hostname resolution is controlled
by the test and shouldn't fail on systems set up differently from the
test runners.

Signed-off-by: John Mulligan <jmulligan@redhat.com>

Merge pull request #48532 from ceph/wip-yuriw-release-17.2.5-main

doc: 17.2.5 Release Notes

doc: 17.2.5 Release Notes

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
Signed-off-by: Laura Flores <lflores@redhat.com>

crimson/os/seastore/rbm: rename TestMemory to EphemeralRBMDevice and adjust default paramter location

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

crimson/os/seastore/cbj: add get_journal_start() and adjust it to default block size

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

crimson/os/seastore/cbj: merge mkfs() in cbj into open_for_mkfs()

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

cmake: bump node version to 14

to update the angular to 13, we need a node version of either 12.20.x or
14.15.x or 16.10.x. But inorder to not break the angular 12 run for now
   we  need to choose the node which works for both 12 and 13. which is
14.15.x. So I went with that node version here.

Signed-off-by: Nizamudeen A <nia@redhat.com>

Merge pull request #48347 from ronen-fr/wip-rf-acting

osd/scrub: use the actual active set when requesting replicas to scrub

Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #48510 from ceph/update-mailmap

mailmap: add Pedro Gonzalez Gomez

Reviewed-by: Nizamudeen A <nia@redhat.com>

Merge pull request #48528 from ceph/fix-gh_pr_triage_node_version-main

.github/pr-triage: update node.js to v16

Reviewed-by: Nizamudeen A <nia@redhat.com>

Merge pull request #48515 from athanatos/sjust/wip-crimson-suites

qa/suites/crimson-rados: move seastore to crimson-rados-experimental, remove cache/dedup workloads

Reviewed-by: Matan Breizman <mbreizma@redhat.com>

moving to next version of s3select
s3select submodule

Signed-off-by: galsalomon66 <gal.salomon@gmail.com>

Merge pull request #48533 from zdover23/wip-doc-2022-10-19-radosgw-notification-topic-management-and-notification-performance

doc/radosgw: refine top. man. and not. perf. stats

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc/radosgw: refine top. man. and not. perf. stats

This commit refines the English in the "Topic Management via CLI" and
"Notification Performance Statistics" sections of the notifications.rst
file.

Signed-off-by: Zac Dover <zac.dover@gmail.com>

Merge pull request #48444 from yuvalif/wip-yuval-fix-57850

rgw/amqp: store CA location string in connection object

qa/suites/crimson-rados: remove cache and dedup related tests

It's an accident that some of these pass -- the tests provide some
coverage for inconsistencies that can arise, but don't really validate
that the objects actually get moved between tiers.

It's going to be some time before we implement cache or dedup in
crimson, and we'll probably want to disable the related commands for
pools that can map to crimson osds to prevent accidents.

Signed-off-by: Samuel Just <sjust@redhat.com>

qa/suites: move seastore to crimson-rados-experimental suite

Let's use crimson-rados-experimental for tests that don't yet
pass reliably.  We can move these to crimson-rados as they
become reliable.

Signed-off-by: Samuel Just <sjust@redhat.com>

Merge pull request #48511 from zdover23/wip-doc-2022-10-18-radosgw-notification-reliability

doc/radosgw: refine "notification reliability"

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc/radosgw: refine "notification reliability"

This commit refines the English in the "Notification Reliability"
section of the notifications.rst page (the "Bucket Notifications"
page). I have also added signposting structure.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Co-authored-by: Yuval Lifshitz <ylifshit@redhat.com>
Signed-off-by: Zac Dover <zac.dover@gmail.com>

crimson/osd: introduce get_or_load_obc()

Both with_head/clone_obc make use of this logic.

Signed-off-by: Matan Breizman <mbreizma@redhat.com>

.github/pr-triage: update node.js to v16

[Warning](https://github.com/ceph/ceph/actions/runs/3273201887):
```
Node.js 12 actions are deprecated. For more information see: https://github.blog/changelog/2022-09-22-github-actions-all-actions-will-begin-running-on-node16-instead-of-node12/.
Please update the following actions to use Node.js 16: actions/labeler, iyu/actions-milestone
```

Signed-off-by: Ernesto Puerta <37327689+epuertat@users.noreply.github.com>

Merge pull request #48484 from cyx1231st/wip-crimson-msgr-cleanup

crimson/net: simplify msgr interfaces with AuthClient/Server

Reviewed-by: Kefu Chai <tchaikov@gmail.com>

Merge pull request #48514 from ceph/wip-dashboard_gh_project-main

Reviewed-by: Nizamudeen A <nia@redhat.com>

Merge pull request #48485 from vshankar/wip-upgrade-x-o-q

qa: fs:upgrade featureful_client test upgrades to quincy

Reviewed-by: Milind Changire <mchangir@redhat.com>
Reviewed-by: Xiubo Li <xiubli@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>

Merge pull request #48398 from rhcs-dashboard/fix-get-rbd-stats

mgr/prometheus: avoid duplicates and deleted entries for rbd_stats_pools

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

Merge pull request #48471 from SUSE/wip-fix-57860

ceph.spec.in: disable system_pmdk on s390x for SUSE distros

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>

doc/dev: add explanation of how to use deduplication

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

crimson/os/seastore/cbj: remove duplicate configs in cbj_header_t

Also, this commits remove cbj::mkfs_config_t and use device's
information.

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

crimson/os/seastore/rbm: add stat to get device info. at mkfs time

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

crimson/os/seastore/rbm: remove start and start_data_area

remove start and start_data_area in rbm header and
use RBM_START_ADDRESS and journal_size instead.

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

crimson/os/seastore/rbm: remove block_size and size in RBMDevice

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

crimson/os/seastore/rbm: use device_config_t in rbm_metadata_header_t

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

crimson/os/seastore/rbm: move mkfs to RBMDevice

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

.github/pr-triage: switch from old to new project

The old (classic) Dashboard project (https://github.com/ceph/ceph/projects/6) has been migrated to a new-style one (https://github.com/orgs/ceph/projects/2/views/1).

This also requires updating the GH Action that automatically assigned `dashboard`-labeled PRs to the Dashboard project.

Signed-off-by: Ernesto Puerta <37327689+epuertat@users.noreply.github.com>

Merge pull request #48512 from zdover23/wip-doc-2022-10-18-radosgw-notifications-prompts

doc/radowsgw: add prompts to notifications.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

mailmap: add Pedro Gonzalez Gomez

Signed-off-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>

doc/radowsgw: add prompts to notifications.rst

This PR adds unselectable prompts to doc/radosgw/notifications.rst.

Signed-off-by: Zac Dover <zac.dover@gmail.com>

Merge pull request #48241 from ajarr/fix-57210

 src/mds: increment directory inode's change attr by one

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Kotresh HR <khiremat@redhat.com>

crimson/osd: fix use after free error in FuturizedStoreLogReader::read

Signed-off-by: Zhang Song <zhangsong325@gmail.com>

Merge pull request #48425 from phlogistonjohn/jjm-shell-fixups

build: minor build script cleanups

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Kefu Chai <tchaikov@gmail.com>

Merge pull request #48501 from zdover23/wip-doc-2022-10-17-radosgw-notifications

doc/radosgw: refine notifications.rst - top part

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>

doc/radosgw: refine notifications.rst - top part

This commit refines the English in the first part of the
notifications.rst page (the "Bucket Notifications" page).

Signed-off-by: Zac Dover <zac.dover@gmail.com>

install-deps: switch to C.UTF-8 locale

The en_US.UTF-8 locale is not always going to present on all systems.
Specifically, setting en_US.UTF-8 causes numerous warnings when running
this script on a CentOS Stream 8 container. Rather than install
additional packages to suppress the warning, use the C.UTF-8 locale.

Additionally, try to update the comment explaining the line to something
based on the commit history rather than the confusing term "vulnerable".

Signed-off-by: John Mulligan <jmulligan@redhat.com>