Merge pull request #24031 from rzarzynski/wip-common-bl-drop-0c

common: drop the unused zero-copy facilities in ceph::bufferlist

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>

Merge PR #24120 into master

* refs/pull/24120/head:
doc: Fix Typos of Developer Guide

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #24105 from dillaman/wip-24516

librbd: object map improperly flagged as invalidated

Reviewed-by: Mykola Golub <mgolub@suse.com>

Merge pull request #23981 from cbodley/wip-35830

rgw: raise debug level on redundant data sync error messages

Merge pull request #24088 from dzafman/wip-35982

qa/standalone: Standalone test corrections

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

common: get_data() of buffer_raw isn't virtual anymore.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

common: make the get_data() of buffer_raw interface final.

This is just to ensure the just dropped buffer::raw_pipe
was the solely user of this facility. After successful
validation, we can drop `virtual` on the method entirely.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

common: drop can_zero_copy() from ceph::buffer interfaces.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

common: drop zero_copy_to_fd() from ceph::buffer interfaces.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

common: drop write_fd_zero_copy() from bufferlist.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

common: drop buffer::raw_pipe altogether with its factory method.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

common: drop buffer::list::read_fd_zero_copy.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

common, test: drop unit tests for 0c in ceph::bufferlist.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

Merge pull request #24087 from rzarzynski/wip-common-buffer_raw-drop-page-align-getters

common: drop/mark-as-final getters of buffer::raw for palign.

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #24061 from liewegas/wip-35923

osd/PG: write pg epoch when resurrecting pg after delete vs merge race

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>

Merge pull request #23306 from penglaiyxy/msg_branch

msg: ceph_abort() when there are enough accepter errors in msg server

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #23955 from wjwithagen/wjw-fix-ceph-helpers.sh

test: Start using GNU awk and fix archiving directory

Reviewed-by: Kefu Chai <kchai@redhat.com>

doc: Fix Typos of Developer Guide

Signed-off-by: Li Bingyang <li.bingyang1@zte.com.cn>

Merge PR #24023 into master

* refs/pull/24023/head:
mds: prevent rctime from going back

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge PR #24022 into master

* refs/pull/24022/head:
client: update ctime when modifying file content

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge PR #24048 into master

* refs/pull/24048/head:
mds: use common send message mechanisms
mds: remove dead code

Reviewed-by: Zheng Yan <zyan@redhat.com>

Merge PR #24053 into master

* refs/pull/24053/head:
mds: translate CEPH_MDS_STATE_NULL state name as null

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge PR #21992 into master

* refs/pull/21992/head:
qa: extend timeout for SessionMap flush

Reviewed-by: John Spray <john.spray@redhat.com>

librbd: do not invalidate object map when attempting to delete non-existent snapshot

If duplicate snapshot remove requests are received by the lock owner from a peer
client, the first request will remove the object map. If the second request
arrives while the first is in-progress, it will again attempt to remove the
object map but fail to load it since it's already been deleted. This incorrectly
results in the next object map being flagged as invalid.

Fixes: http://tracker.ceph.com/issues/24516
Signed-off-by: Jason Dillaman <dillaman@redhat.com>

librbd: converted object map snapshot remove state machine to new style

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #24029 from smithfarm/wip-35922

cmake: no libradosstriper headers if WITH_LIBRADOSSTRIPER=OFF

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Jesse Williamson <jwilliamson@suse.de>

Merge pull request #24036 from dillaman/wip-24688

rbd-mirror: optionally extract peer secrets from config-key

Reviewed-by: Mykola Golub <mgolub@suse.com>

Merge pull request #24063 from dillaman/wip-24140

rbd-mirror: prevent creation of clones when parents are syncing

Reviewed-by: Mykola Golub <mgolub@suse.com>

Merge pull request #24108 from clebergnu/rm_qa_btrfs_binary

qa/btrfs/test_rmdir_async_snap: remove binary file

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #23989 from dzafman/wip-35846

tools: ceph-objectstore-tool: Allow target level as first positional argument

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

qa/btrfs/test_rmdir_async_snap: remove binary file

On a quick look at the source code, I noticed this binary file, which
looks like was committed by mistake.

Signed-off-by: Cleber Rosa <crosa@redhat.com>

Merge pull request #23650 from tchaikov/wip-dpdk-cmake

cmake: fix the build WITH_DPDK=ON

Reviewed-by: Casey Bodley <cbodley@redhat.com>

librbd: test_flags helper should require snap id parameter

The HEAD and snapshots have potentially different flag states
since object maps get invalidated per revision.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #24097 from cyx1231st/fix-seastar-msgr-read-racing

crimson/net: Fix racing for promise on_message

Reviewed-by: Kefu Chai <kchai@redhat.com>

crimson/net: Fix racing for promise on_message

read_tags_until_next_message() will forward the ready future and create
a new promise for on_message, which assumes there is already a
read_message() holding the previous promise, but it is not true.

Signed-off-by: Yingxin <yingxin.cheng@intel.com>

Merge pull request #23972 from badone/wip-documentation-add-12.2.8-release

doc/releases/schedule: Add Luminous 12.2.8

Reviewed-by: Nathan Cutler <ncutler@suse.com>

Merge pull request #24099 from badone/wip-mimic-13-2-0-date-correction

doc/releases: Mark Mimic first release as June

Reviewed-by: Nathan Cutler <ncutler@suse.com>

doc/releases: Mark Mimic first release as June

Signed-off-by: Brad Hubbard <bhubbard@redhat.com>

Merge pull request #24094 from libingyang-zte/master

doc: Fix Typos of Developer Guide

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>

doc: Fix Typos of Developer Guide

Signed-off-by: Li Bingyang <li.bingyang1@zte.com.cn>

common: drop is_page_aligned() of buffer::raw entirely.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

test: osd-backfill-stats.sh: Fix subtests to get primary which can change

Fixes: http://tracker.ceph.com/issues/35982
Signed-off-by: David Zafman <dzafman@redhat.com>

test: Fix for error message changed in ceph-objectstore-tool

Fixes: http://tracker.ceph.com/issues/35982
Caused by: 6bd682f53dfe0b2f7c31b5c1ba081afb72f1dd6c

Signed-off-by: David Zafman <dzafman@redhat.com>

common: drop/mark-as-final getters of buffer::raw for palign.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

Merge pull request #23896 from Songweibin/wip-group-snap-rollback

rbd: add group snap rollback method

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Mykola Golub <mgolub@suse.com>

Merge pull request #24077 from alfredodeza/wip-rm35970

ceph-volume  fix zap not working with LVs

Reviewed-by: Andrew Schoen <aschoen@redhat.com>

ceph-volume tests.functional comment why not use --destroy when zapping lvs in filestore

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ceph-volume tests.functional use --destroy when zapping lvs in bluestore

Signed-off-by: Alfredo Deza <adeza@redhat.com>

qa/workunits/rbd: new test for rbd-mirror peer config-key secrets

Fixes: http://tracker.ceph.com/issues/24688
Signed-off-by: Jason Dillaman <dillaman@redhat.com>

doc/rbd: update mirroring to include new peer secret config-key actions

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

mon: added bootstrap-rbd-mirror/rbd-mirror mon profiles

The rbd-mirror daemon will require permission to read config-keys
from the "rbd/mirror/" prefix. These new profiles (and the new
associated bootstrap-rbd-mirror user) provide the required
permissions.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

rbd: mirror pool peer commands now support mon_host/key overrides

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #24024 from p-na/fix-flaky-qa-tests

mgr/dashboard: Fix flaky QA tests

Reviewed-by: Ricardo Dias <rdias@suse.com>

ceph-volume lvm.zap use remove_pv only for physical devices

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #23660 from falcon78921/wip-multisite-docs

doc: updated multisite documentation

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #23995 from tchaikov/wip-add-ceph-libboost-repo

install-deps,run-make-check: use ceph-libboost repo

Reviewed-by: Alfredo Deza <adeza@redhat.com>
Reviewed-by: Erwan Velu <erwan@redhat.com>

Merge pull request #24067 from libingyang-zte/master

doc: Fix typos in Developer Guide

Reviewed-by: Kefu Chai <kchai@redhat.com>

doc: Fix Spelling Error in Developer Guide

Signed-off-by: Li Bingyang <li.bingyang1@zte.com.cn>

Merge pull request #23919 from adamemerson/wip-end-to-warnings

Clean up warnings

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #24018 from dzafman/wip-35912

qa/standalone: Minor test improvements

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #24060 from alfredodeza/wip-rm35913

ceph-volume batch: allow --osds-per-device, default it to 1

Reviewed-by: Andrew Schoen <aschoen@redhat.com>

qa: extend timeout for SessionMap flush

Fixes: https://tracker.ceph.com/issues/24129
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>

ceph-volume tests.lvm.strategies initial filestore validation

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ceph-volume lvm.tests conftest fixtures for custom vgs

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ceph-volume tests.devices.lvm add bluestore strategy cases

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ceph-volume tests verify strategy validators for minimum size

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ceph-volume lvm.batch.filestore allow osds-per-device

Signed-off-by: Alfredo Deza <adeza@redhat.com>

rbd-mirror: connect to remote cluster using optional mon_host/key values

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

rbd-mirror: prevent creation of clones when parents are syncing

This will prevent a possible race condition where a thrashing rbd-mirror
daemon in mid-sync with a parent image would result in the deletion of
all snapshots when it restarts the sync.

Fixes: http://tracker.ceph.com/issues/24140
Signed-off-by: Jason Dillaman <dillaman@redhat.com>

cls_cas: Fix format string warning

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

Merge PR #24025 into master

* refs/pull/24025/head:
mon/OSDMonitor: reject pg_num -> 0

Reviewed-by: huangjun <huangjun@xsky.com>
Reviewed-by: Sage Weil <sage@redhat.com>

Merge PR #21611 into master

* refs/pull/21611/head:
osd/ECBackend: don't get result code of subchunk-read overwritten

Reviewed-by: David Zafman <dzafman@redhat.com>

Merge PR #23273 into master

* refs/pull/23273/head:
os/bluestore: handle spurious read errors

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Igor Fedotov <ifedotov@suse.com>

Merge PR #23694 into master

* refs/pull/23694/head:
mon: remove pre-luminous health output compatibility

Reviewed-by: Sage Weil <sage@redhat.com>

test: Remove unused variable

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

mds: Remove pessimizing move

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

test: Silence unused capture warnings

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

test: Fix sprintf overflow warning

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

test: Quell unused variable warnings

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

test: Fix sign comparison warnings

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

Merge PR #24035 into master

* refs/pull/24035/head:
osd/PG: avoid choose_acting picking want with > pool size items

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Neha Ojha <nojha@redhat.com>

Merge PR #24052 into master

* refs/pull/24052/head:
doc: update mds stat output

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Zheng Yan <zyan@redhat.com>

Merge pull request #24032 from liewegas/wip-pg-ls

mon/PGMap: include unknown PGs in 'pg ls'

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: David Zafman <dzafman@redhat.com>

Merge pull request #24040 from rzarzynski/wip-common-bl-drop-raw_mmap_pages

common: drop the unused buffer::raw_mmap_pages.

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

rbd: sort to display group image by name

Signed-off-by: songweibin <song.weibin@zte.com.cn>

pybind/rbd: new group snap rollback Python API

Signed-off-by: songweibin <song.weibin@zte.com.cn>

tools/rbd: support group snap rollback CLI

Signed-off-by: songweibin <song.weibin@zte.com.cn>

librbd: minor cleanup in api/Group.cc

Signed-off-by: songweibin <song.weibin@zte.com.cn>

librbd: add group snap rollback method

Fixes: http://tracker.ceph.com/issues/23550
Signed-off-by: songweibin <song.weibin@zte.com.cn>

cephfs: Do not catch polymorphic exception by value

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

crush: Quell unused variable warnings

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

ceph-volume lvm.batch.validators account for osds per device, include collocation

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ceph-volume lvm.batch.bluestore allow osds-per-device with MixedType

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #24042 from liewegas/wip-merge-derr

osd: remove stray derr

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #23996 from mogeb/fmt-cmake

cmake: fix version matching for Findfmt

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #24013 from dzafman/wip-35845

test: Use a grep pattern that works across releases

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #24045 from dillaman/wip-35702

librbd: fixed assert when flattening clone with zero overlap

Reviewed-by: Mykola Golub <mgolub@suse.com>

Merge pull request #24030 from LenzGr/mgr-dashboard-documentation

doc: Updated Mgr Dashboard documentation

Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>

osd/PG: write pg epoch when resurrecting pg after delete vs merge race

Fixes: http://tracker.ceph.com/issues/35923
Signed-off-by: Sage Weil <sage@redhat.com>

mds: use common send message mechanisms

Fixes: http://tracker.ceph.com/issues/26961
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>