rbd/rwl: correct m_perfcounter access scope

There's no m_perfcounter in SyncPoint. Its scope is in
ReplicatedWriteLog.

Signed-off-by: Changcheng Liu <changcheng.liu@intel.com>

Merge pull request #35129 from smithfarm/wip-fix-PendingReleaseNotes-headings

doc/releases/octopus.rst: move still-pending release notes to official v15.2.0 release notes

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>

doc/releases/octopus: use fixed-width font for "ceph fs dump"

We are using fixed-width font to render commands elsewhere, so
let's do so in this release note, too - just for the sake of uniformity.

Signed-off-by: Nathan Cutler <ncutler@suse.com>

Merge pull request #35142 from mgfritch/cephadm-validate-mds-fsname

mgr/orch: allow MDS with explicit naming

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>

Merge pull request #34174 from theanalyst/doc/active-releases-oct

doc: move luminous to archived releases & octopus to active

Reviewed-by: Nathan Cutler <ncutler@suse.com>

Merge pull request #35219 from tchaikov/wip-crimson-cleanups

crimson/osd,test/crimson: avoid using variadic future and s/apply/invoke/

Reviewed-by: Ronen Friedman <rfriedma@redhat.com>

crimson/osd: avoid using variadic future

see also 3cee25ba41069e9e9b4855f99be20910759440ca

Signed-off-by: Kefu Chai <kchai@redhat.com>

test/crimson: use invoke instead of apply

it's an oversight in 33af821baafbb2e9c4ebea2e377db665e210701f

Signed-off-by: Kefu Chai <kchai@redhat.com>

Merge pull request #35204 from tchaikov/wip-tools-cephfs

tools/cephfs/MetaTool: print buffer::error::what()

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>

Merge pull request #35207 from tchaikov/wip-crimson-remove-vardiadict-future

crimson/osd: avoid using variadic future and cleanup

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

crimson/osd: remove redundant std::move()

this should address following warning:

../src/crimson/osd/ops_executer.cc:821:6:   required from here
../src/crimson/osd/ops_executer.cc:818:37: warning: redundant move in return statement [-Wredundant-move]
  818 |             return std::move(entries);
      |                                     ^
../src/crimson/osd/ops_executer.cc:818:37: note: remove ‘std::move’ call

Signed-off-by: Kefu Chai <kchai@redhat.com>

crimson/osd: avoid using variadic future

Signed-off-by: Kefu Chai <kchai@redhat.com>

Merge pull request #35205 from Huber-ming/zsm_doc

doc: replace https://ceph.com/ with http://download.ceph.com/

Reviewed-by: Kefu Chai <kchai@redhat.com>

doc:replacing https://ceph.com/ by http://download.ceph.com/

Signed-off-by: Shengming Zhang <zhangsm01@inspur.com>

Merge pull request #35179 from myoungwon/wip-affiliation-mw

mailmap: update affiliation for Myoungwon Oh

Reviewed-by: Kefu Chai <kchai@redhat.com>

tools/cephfs/MetaTool: print buffer::error::what()

* buffer::error does not offer operator<<(ostream&, const
  buffer::error&). so in this change, err.what() is used instead.
* also add spaces to follow our coding style convention.

Signed-off-by: Kefu Chai <kchai@redhat.com>

Merge PR #34755 into master

* refs/pull/34755/head:
tool: add function of show/amend fnode

Reviewed-by: Zheng Yan <zyan@redhat.com>

Merge PR #35090 into master

* refs/pull/35090/head:
mgr/volumes: Fix subvolume create idempotency

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>

Merge PR #35063 into master

* refs/pull/35063/head:
cephfs: allow pool names with '-' and '.'

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge PR #34975 into master

* refs/pull/34975/head:
systemd: lock down more privileges

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge PR #34757 into master

* refs/pull/34757/head:
mds: take xlock in the order requests start locking

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge PR #35143 into master

* refs/pull/35143/head:
mgr/status: 'ceph fs status' output add dirs and caps

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #35026 from changchengx/rwl

librbd: track per syncpoint's logentry number with perf counter

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

Merge PR #35109 into master

* refs/pull/35109/head:
qa: use py3 compat list from range

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #32601 from adamemerson/wip-objection-triumphant

Asynchronous work on objecter and asynchronous RADOS library.

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #35020 from yuvalif/cls_2pc_q_async_api

cls/2pc_queue: add async API to read operations

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #34505 from ktdreyer/doc-forwarded-https

doc/rgw: warn about "trust forwarded https" security

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #35158 from dillaman/wip-45137

librbd: initial implementation of plugin support

Reviewed-by: Mykola Golub <mgolub@suse.com>

mgr/volumes: Fix subvolume create idempotency

After subvolume is created, it can be resized
using subvolume create command. But it was
broken and the same is fixed.

Fixes: https://tracker.ceph.com/issues/45398
Signed-off-by: Kotresh HR <khiremat@redhat.com>

Merge pull request #33964 from rosinL/openss_engine

common, rgw: add openssl engine support

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

Merge pull request #33237 from aclamk/wip-bluefs-list-files

os/bluestore/bluefs: add inspection of bluefs files

Reviewed-by: Igor Fedotov <ifedotov@suse.com>

Merge pull request #35104 from varshar16/wip-fix-roleless-mon-issue

qa/cephadm: Add roleless mon names to ctx.cluster.remotes role dict

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
Reviewed-by: Georgios Kyratsas <gkyratsas@suse.com>

Merge pull request #35055 from mgfritch/py3-log-warning

mgr: logger.warn() -> logger.warning()

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #34897 from neha-ojha/wip-45298

test/cli-integration/balancer/misplaced.t: start with balancer off

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Brad Hubbard <bhubbard@redhat.com>

Merge pull request #34852 from wpf1253/master

compressor/zlib:make zlib windowBits configurable for compression

Reviewed-by: Igor Fedotov <ifedotov@suse.com>

Merge pull request #35082 from badone/wip-xenial-cmake-install-test_envlibrados_for_rocksdb

qa/workunits: Remove redundant Xenial cmake3 requirements

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #34593 from hfutljx/master

qa/workunits:fix the error of getting encoding technique in ec test

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #34936 from ddiss/timer_thread_name

common/ceph_timer: set thread name

Reviewed-by: Adam Emersen <aemerson@redhat.com>

Merge pull request #35107 from yuvalif/fix_issue_45586

cls/2pc_queue: fix access to invalidated iterator

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #34836 from ifed01/wip-ifed-fix-45337

os/bluestore: fix large (>2GB) writes when bluefs_buffered_io = true

Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #35140 from batrick/i45612

qa: run install task only once

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #34864 from aclamk/fix-45335

kv/RocksDBStore: Reduced verification on sharding

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

doc/rgw: warn about "trust forwarded https" security

Warn users about the implications of enabling this option when there is
no trusted proxy in front of radosgw.

Signed-off-by: Ken Dreyer <kdreyer@redhat.com>

rpm,deb: package librbd parent cache plugin with librbd

The librbd parent cache is an initial testbed for librbd plugin
support. The shared library will be packaged with librbd for the
time being.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

librbd: moved parent image cache to its own plugin

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

librbd: parent image cache should work for all parents in hierarchy

A parent image might have its own parent image and so forth. Use the
ImageCtx::child member instead to determine if it's a R/W image.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #35139 from smithfarm/wip-proxy-is-removed

qa/cephtool: remove/deprecate proxy cache-tier mode

Reviewed-by: Neha Ojha <nojha@redhat.com>

mailmap: update affiliation for Myoungwon Oh

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

Merge pull request #35177 from wjwithagen/wjw-fix-ceph-backport.sh

script: fix bash invocation on systems where bash live elsewhere

Reviewed-by: Nathan Cutler <ncutler@suse.com>

script: fix bash invocation on systems where bash live elsewhere

Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>

PendingReleaseNotes: drop mention of CVE fix

CVEs fixed before the first stable Pacific release need not be mentioned
explicitly in the release notes.

Signed-off-by: Nathan Cutler <ncutler@suse.com>

qa/cephtool: clean up after removal of cache-tier modes

The "proxy" and "forward" cache-tier modes have been completely removed,
so it's sufficient to test once that they cannot be set.

Fixes: a0a3ed324a130a9934735927600f01d1fa65bc0d
Signed-off-by: Nathan Cutler <ncutler@suse.com>

Merge pull request #35160 from rzarzynski/wip-crimson-objclass-subop_num

crimson/osd: implement cls_current_subop_num of the objclass API.

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #35154 from tchaikov/wip-crimson-admin-cleanup

crimson/admin: remove the unix domain socket for asock when stopping

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

tools/immutable_object_cache: fixed memory leak upon destruction

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

librbd: initial plugin registry implementation

The plugin registry will attempt to dynamically load the specified
librbd plugins at image open time.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

crimson/osd: implement cls_current_subop_num of the objclass API.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

Merge pull request #35114 from mgfritch/cephadm-reconfig-port-in-use

cephadm: skip port in use check during reconfig/redeploy

Reviewed-by: Varsha Rao <varao@redhat.com>

Merge pull request #35087 from sebastian-philipp/cephadm-fix-osd-service-create

mgr/cephadm: Fix OSDs not being created

Reviewed-by: Michael Fritch <mfritch@suse.com>

Merge pull request #35112 from athanatos/sjust/wip-manifest-doc

doc: update manifest.rst with plans for manifest work

Reviewed-by: Myoungwon Oh <omwmw@sk.com>

crimson/admin: remove the unix domain socket file for asock when stopping

should remove the leftovers when stopping

Signed-off-by: Kefu Chai <kchai@redhat.com>

Merge PR #33286 into master

* refs/pull/33286/head:
cephfs-shell: support cephfs-shell.conf

Reviewed-by: Varsha Rao <varao@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

cephfs-shell: support cephfs-shell.conf

cephfs-shell options should reside in cephfs-shell.conf and not in
ceph.conf. Please note, unlike before, -c option of cephfs-shell must
take path to cephfs-shell.conf instead of path to ceph.conf.

This commit also updates the docs and the tests for cephfs-shell accordingly
and renames the variable config_path in cephfs-shell to shell_conf_path so
that it's easy to distinguish.

Fixes: https://tracker.ceph.com/issues/44127
Signed-off-by: Rishabh Dave <ridave@redhat.com>

Merge PR #33264 into master

* refs/pull/33264/head:
test_cephfs_shell: refactor test_put_and_get_without_target_directory

Reviewed-by: Varsha Rao <varao@redhat.com>

mgr/orch: add explicit naming tests (MDS / RGW)

Signed-off-by: Michael Fritch <mfritch@suse.com>

librbd/rwl: track syncpoint's logentry number and write bytes

The SyncPoint's logentry number and write bytes affect the
peformance of rwl cache a lot. It needs to be tracked by
perf couter for analysis.

Signed-off-by: Changcheng Liu <changcheng.liu@aliyun.com>

mon/OSDMonitor: do not tell user 'proxy' cache-mode allowed

The 'proxy' cache-mode is deprecated and can no longer be used.

Signed-off-by: Nathan Cutler <ncutler@suse.com>

Merge pull request #35088 from sebastian-philipp/cephadm-admin-socket

doc/cephadm: accessing the admin socket

Reviewed-by: Michael Fritch <mfritch@suse.com>

Merge pull request #35125 from tchaikov/wip-cephadm-test

qa/tasks/cephadm: ignore tarfile.ReadError

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>

doc/dev/osd_internals:manifest.rst: clarification for manifest design and future steps

I've added a few significant changes:
* TIER_PROMOTE purely ensures that data is resident in the base pool
* Add EVICT_CHUNK to permit a tiering agent to selectively cold space
  from HEAD/snapshots independently of SET_CHUNK.
* Avoid using DIRTY entirely for dedup targets.
* Instead of modifying clone_range when updating clone manifests, simply
  update ReplicatedBackend::calc_*_subsets to also consider the clone
  obc manifest.

I've also added sections on how tiering agents are rbd/rgw are meant
to interact as well as on testing.

Signed-off-by: Samuel Just <sjust@redhat.com>

doc: more information on future work for manifest tiering

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

doc: more information on status and future work for manifest tiering

Signed-off-by: Samuel Just <sjust@redhat.com>
Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

doc: add more information for manifest tiering

Signed-off-by: Samuel Just <sjust@redhat.com>
Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

Merge pull request #35119 from ShraddhaAg/update-docs

doc: add machine type in teuthology commands

Reviewed-by: Neha Ojha <nojha@redhat.com>

mgr/status: 'ceph fs status' output add dirs and caps

Signed-off-by: Yanhu Cao <gmayyyha@gmail.com>

mgr/orch: fixup chars before hostname without '.' test

Signed-off-by: Michael Fritch <mfritch@suse.com>

mgr/orch: allow MDS with explicit naming

Fixes: https://tracker.ceph.com/issues/45617
Signed-off-by: Michael Fritch <mfritch@suse.com>

mgr/orch: allow RGWs with explicit naming

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>

qa: run install task only once

Fixes: https://tracker.ceph.com/issues/45612
Fixes: 8d77d134c73d3471515f113320e9db1f0e59eb1f
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #35110 from neha-ojha/wip-revert-34894

Revert "qa/tests: replaced ubuntu_latest.yaml with ubuntu 20.04"

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
Reviewed-by: Yuri Weinstein <yuriw@redhat.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #35113 from athanatos/sjust/wip-crimson-clang-cleanup

crimson clang cleanups

Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

crimson/osd: remove unnecessary captures

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/os: remove some unnecessary lambda captures

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/os/seastore/journal: avoid capturing destructured labels

clang at least doesn't allow those labels to be captured.

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson: remove a few unnecessary lambda captures

Signed-off-by: Samuel Just <sjust@redhat.com>

errorator: don't rely on non-evaluation of static_assert in constexpr branch

At least in clang, we appear to fail that static assert even with another
branch taken.  Instead, assert that one of the other conditions is true.

Signed-off-by: Samuel Just <sjust@redhat.com>

Merge pull request #35127 from ronen-fr/scrub4

test/librbd, Crimson: remove some unused captures

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>

PendingReleaseNotes: add missing ">= 16.0.0" heading

Signed-off-by: Nathan Cutler <ncutler@suse.com>

doc: add machine type in teuthology commands

This commit adds mandatory --machine-type flag in teuthology
command examples in docs.

Signed-off-by: Shraddha Agrawal <shraddha.agrawal000@gmail.com>

Merge pull request #32927 from linuxbox2/wip-rgw-lc-threads

rgwlc: enable thread-parallelism in RGWLC

doc/releases/octopus: add "default bucket index shards" release note

The RGW "default number of bucket index shards for new buckets was raised from
1 to 11" release note was added to PendingReleaseNotes by
1ec77ec7ba13da68d7919176b3675513ed7d7c21 but it did not find its way into the
official v15.2.0 release notes until now.

Signed-off-by: Nathan Cutler <ncutler@suse.com>

doc/releases/octopus: add "BlockPublicAccess" release note

The RGW BlockPublicAccess release note was added to PendingReleaseNotes
by df384ea95f88196a9723877a5aa9041ef25b5f29 but it did not find its way
into the official v15.2.0 release notes until now.

Signed-off-by: Nathan Cutler <ncutler@suse.com>

doc/releases/octopus: add "rgw bucket granularity" release note

The RGW bucket granularity release note was added to PendingReleaseNotes
by 50f13fd54b709bd0b8ad25e818fc61e2c55828fd but it never found its way
into the official v15.2.0 release notes.

Signed-off-by: Nathan Cutler <ncutler@suse.com>

Crimson: cleanup Clang issues in Crimson code

Mostly: remove redundant captures

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>

doc/releases/octopus: enforce mds_join_fs cluster affinity

The "enforce mds_join_fs cluster affinity" release note was
added to PendingReleaseNotes by 3fac3b1236c4918e9640e38fe7f5f59efc0a23b9
but it never made its way into the official v15.2.0 release notes.

Signed-off-by: Nathan Cutler <ncutler@suse.com>

doc/releases/octopus: osd_calc_pg_upmaps_max_stddev removal

The release note about osd_calc_pg_upmaps_max_stddev removal
was added to PendingReleaseNotes by
65d03bae8b4f50cc3cbaa50640eaeab4cabd711f but never found its
way into the official v15.2.0 release notes.

Signed-off-by: Nathan Cutler <ncutler@suse.com>

doc/releases/octopus: add bucket notification JSON array

The release note about bucket notifications being encapsulated in a JSON
array was added to PendingReleaseNotes by
19832a0daeb7b23006d1c38059ad14f0c239d32a but it never found its way into
the actual v15.2.0 release notes.

Signed-off-by: Nathan Cutler <ncutler@suse.com>

doc/cephadm: accessing the admin socket

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>

doc/releases/octopus.rst: add nvme self-classify release note

The release note about OSDs self-classifying themselves as "nvme" in
certain rare cases was added to PendingReleaseNotes by
1d0fd5603e9fd74d54d41b7c4895f9e41c510c29 but it never found its way into
the official v15.2.0 release notes.

Signed-off-by: Nathan Cutler <ncutler@suse.com>

doc/releases/octopus.rst: add "-o" behavior release note

The release note about restoring the original behavior of the rados
tool's "-o" option was added to PendingReleaseNotes by
d2b806070de5f56474283035a7ffc91fe96afbab but it never found its way into
the official v15.2.0 release notes.

Signed-off-by: Nathan Cutler <ncutler@suse.com>