crimson/net/ProtocalV2: no need to define fmt::ptr() since seastar has done it

Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>

seastar: bump up seastar submodule to fix mem leaks

fix mem leak caused by no maximum memory limit for cpu core

Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>

Merge pull request #49736 from zdover23/wip-doc-2023-01-14-dev-basic-workflow-git-commands

doc/dev: add git branch management commands

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>

doc/dev: add git branch management commands

Add git branch deleting and search commands to the "Basic Workflow" page
of the Developer Guide.

Signed-off-by: Zac Dover <zac.dover@gmail.com>

Merge pull request #48496 from adk3798/apply-spec-parsing

cephadm: only pull host info from applied spec, don't try to parse yaml

Reviewed-by: John Mulligan <jmulligan@redhat.com>
Reviewed-by: Redouane Kachach <rkachach@redhat.com>

Merge pull request #49024 from rkachach/fix_issue_58067

mgr/cephadm: fixing mgr port shown in ceph orch ps

Reviewed-by: Adam King <adking@redhat.com>

Merge PR #49731 into main

* refs/pull/49731/head:
tools/cephfs: fix traceback from missing envvar

Reviewed-by: Milind Changire <mchangir@redhat.com>

Merge pull request #48617 from adk3798/upgrade-status-help

mgr/orchestrator: fix upgrade status help message

Reviewed-by: Redouane Kachach <rkachach@redhat.com>

Merge pull request #48384 from jmolmo/Rook_PDFetcher

mgr/rook: Device inventory

Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Travis Nielsen <tnielsen@redhat.com>

Merge pull request #48592 from adk3798/offline-upgrade

mgr/cephadm: improve offline host handling, mostly around upgrade

Reviewed-by: Redouane Kachach <rkachach@redhat.com>

Merge pull request #48574 from adk3798/debug-log-spam

mgr/cephadm: make logging refresh metadata to debug logs configurable

Reviewed-by: Redouane Kachach <rkachach@redhat.com>

Merge pull request #47383 from rhcs-dashboard/ceph-exporter-cephadm-changes

exporter: cephadm changes

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
Reviewed-by: Redouane Kachach <rkachach@redhat.com>

Merge pull request #49389 from adk3798/git-archive-fix

qa/tasks/cephadm.py: fix pulling cephadm from git.ceph.com

Reviewed-by: Redouane Kachach <rkachach@redhat.com>

Merge pull request #49726 from rhcs-dashboard/cephadm-e2e-fixes

mgr/dashboard: cephadm dashboard e2e fixes

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>

Merge pull request #49635 from rkachach/fix_issue_58378

mgr/mgr_util: fixing some tox issues

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: John Mulligan <jmulligan@redhat.com>

mgr/dashboard: cephadm dashboard e2e fixes

Fixes: https://tracker.ceph.com/issues/58406
Signed-off-by: Nizamudeen A <nia@redhat.com>

Merge pull request #49417 from athanatos/sjust/backburner/wip-smp-option

crimson/osd/main: get full config before starting reactor

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

tools/cephfs: fix traceback from missing envvar

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #49713 from rhcs-dashboard/fix-sse-daemon-name

mgr/dashboard: rgw server side encryption daemon name fix

Reviewed-by: Nizamudeen A <nia@redhat.com>

Merge pull request #49540 from xxhdx1985126/wip-rebuild-missing-set

crimson/osd/pg: rebuild missing set when a new interval is created

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>

Merge pull request #48575 from liu-chunmei/multicore-cyanstore

crimson/os: cyanstore support multicore

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #49712 from tchaikov/wip-packaging-in-setuptools

mgr/prometheus: use vendored "packaging" instead

Merge pull request #49719 from zdover23/wip-doc-2023-01-12-dev-developer-guide-basic-workflow-miscellaneous-reorganization

doc/dev: add push.autoSetupRemote instructions

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>

doc/dev: add push.autoSetupRemote instructions

Explain how to set up push.autoSetupRemote so that the origin branch is
properly set up when running "get push" without the need for the
"--set-upstream" option.

Signed-off-by: Zac Dover <zac.dover@gmail.com>

Merge pull request #48756 from Matan-B/wip-matanb-rollback-snap

crimson/osd: Support snapshot rollbacks

Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #49568 from Matan-B/wip-matanb-crimson-modified-ranges

crimson/osd/*recovery_backend: Rename Push/Pull Info/Op

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: chunmei-liu <chunmei.liu@intel.com>

Merge pull request #49715 from zdover23/wip-doc-2023-01-12-cephadm-host-management-osd-capitalization

doc/cephadm: s/osd/OSD/ where appropriate

Merge PR #49711 into main

* refs/pull/49711/head:
ceph.spec.in: remove the bcond_without cephfs_java option

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Matan Breizman <mbreizma@redhat.com>

doc/cephadm: s/osd/OSD/ where appropriate

Capitalize the initialization "OSD" where it occurs in natural language
in cephadm/host-management.rst. This PR answers a request made by
Anthony D'Atri and seconded by Cole Mitchell in https://github.com/ceph/ceph/pull/49699#discussion_r1066171002.

Signed-off-by: Zac Dover <zac.dover@gmail.com>

mgr/prometheus: use vendored "packaging" instead

instead of using the top-level "packaging" module, use the one
vendored by setuptools.

packaging python module provides versioning defined by PEP-440.
but python3-packaging is provided by CentOS8 powertools repo,
which is not enabled by default. and in CentOS9, this package
is provided by AppStream instead of BaseOS.

as prometheus mgr module is included by ceph-mgr-module-core,
it would be desirable if our user can install ceph-mgr-module-core
without enabling powertools or AppStream repo on a CentOS or
its derivative distros.

fortunately, setuptools vendors packaging module. and both
CentOS8 and CentOS9 provide python3-setuptools in their BaseOS
repos.

in this change, instead of using "packging" module, we use the
venderored one, which is in turn embedded in pkg_resources.
this python module is provided by python3-setuptools on CentOS
distros, and python3-pkg-resources on Debian and its derivatives.

the packaging recipes are updated accordingly to reflect the
new runtime dependency.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>

mgr/dashboard: rgw server side encryption daemon name fix

The config values for the server side encryption currently are wrongly set to the mon daemon by default. This PR intends to fix this issue

Fixes: https://tracker.ceph.com/issues/58419
Signed-off-by: Aashish Sharma <aasharma@redhat.com>

Merge pull request #49686 from xxhdx1985126/wip-crimson-dump-metrics

crimson/admin: correct metrics dumping methods

Reviewed-by: Samuel Just <sjust@redhat.com>

crimson/os: make cyanstore not use proxy

Signed-off-by: chunmei-liu <chunmei.liu@intel.com>

crimson/os: make load_pgs() load pg on proper core

Signed-off-by: chunmei-liu <chunmei.liu@intel.com>

crimson/os: support multicores for cyanstore

Signed-off-by: chunmei-liu <chunmei.liu@intel.com>
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>

ceph.spec.in: remove the bcond_without cephfs_java option

This effectively disable cephfs_java for rpm builds for now.
The only user appears to be cephfs jni bindings.

Fixes: https://tracker.ceph.com/issues/58382
Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/admin: correct metrics dumping methods

First level object has no key, so we have to inclose metric objects with
an outer one

Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>

Merge pull request #49699 from zdover23/wip-doc-2023-01-11-cephadm-host-management-removing-hosts

doc/cephadm: refine "Removing Hosts"

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #49703 from zdover23/wip-doc-2023-01-11-rados-operations-move-colon

doc/rados: move colon

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>

Merge pull request #49700 from zdover23/wip-doc-2023-01-11-css-h3-padding

doc/css: add top-bar padding for h3 html element

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>

doc/rados: move colon

Move colon in add-or-rm-osds.rst so that the sentence reads properly.

Signed-off-by: Zac Dover <zac.dover@gmail.com>

doc/css: add top-bar padding for h3 html element

Add "scroll-margin-top: 4em;" property to h3 html element.

Signed-off-by: Zac Dover <zac.dover@gmail.com>

doc/cephadm: refine "Removing Hosts"

An intended edit to remove a redundant indefinite article became a
longer (but still brief) full editorial pass.

Signed-off-by: Zac Dover <zac.dover@gmail.com>

Merge pull request #49692 from zdover23/wip-doc-2023-01-11-header-fix

doc/css: add "span" padding to custom.css

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #49690 from idryomov/wip-58398

doc/man/ceph-rbdnamer: remove obsolete udev rule

Reviewed-by: Christopher Hoffman <choffman@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>

doc/css: add "span" padding to custom.css

Add "scroll-top-bar: 2em;" for the "span" html element in custom.css so
that the top bar doesn't get in the way of headings bounded by the "span
element".

See also https://github.com/ceph/ceph/pull/49644.

Signed-off-by: Zac Dover <zac.dover@gmail.com>

doc/man/ceph-rbdnamer: remove obsolete udev rule

Fixes: https://tracker.ceph.com/issues/58398
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>

Merge PR #49630 into main

* refs/pull/49630/head:
doc: document the relevance of mds_namespace mount option

Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>

doc: document the relevance of mds_namespace mount option

Fixes: https://tracker.ceph.com/issues/57673
Signed-off-by: Jos Collin <jcollin@redhat.com>

Merge pull request #49664 from batrick/first-damage-repair-nosnap

tools/cephfs/first-damage: repair specific first=CEPH_NOSNAP damage

Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #49677 from zdover23/wip-doc-2023-01-10-rados-replacing-an-osd

doc/rados: link to cephadm replacing osd section

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc/rados: link to cephadm replacing osd section

Direct readers to the "Replacing an OSD" section in the cephadm
documentation, for cases in which the instructions in "Replacing an OSD"
in the RADOS documentation don't work.

https://tracker.ceph.com/issues/58401

Signed-off-by: Zac Dover <zac.dover@gmail.com>

Merge pull request #48696 from adk3798/agent-testing-binary

cephadm: unit tests for CephadmAgent, MgrListener, AgentGatherer

Reviewed-by: John Mulligan <jmulligan@redhat.com>

Merge pull request #49495 from BryceCao/wip-fix-result-when-users-topics-is-null

rgw: fix result when user's topics is null

Reviewed-by: Yuval Lifshitz <ylifshit@redhat.com>

Merge pull request #49629 from guits/cv-fix-tox-allowlist_externals

ceph-volume/tests: add allowlist_externals to tox.ini

Merge pull request #49665 from zdover23/wip-doc-2023-01-08-glossary-ceph-object-storage

doc/glossary: Clean up "Ceph Object Storage"

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc/glossary: Clean up "Ceph Object Storage"

Remove redundant material under the "Ceph Object Storage" headword and
add a "See 'Ceph Object Store'" link. A future PR will provide a couple
of sentences that explain how object storage is what's really supporting
both CephFS and RBD.

Signed-off-by: Zac Dover <zac.dover@gmail.com>

tools/cephfs/first-damage: repair specific first=CEPH_NOSNAP damage

first==CEPH_NOSNAP is never valid. Apparently somehow the MDS may set
this in some code path yet to be discovered, even without snapshots.

Note, we probably should not necessarily automate this fix via the MDS
because we do not know if this dentry (visible in HEAD) should also be
visible before NEXT_SNAP.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>

tools/cephfs/first-damage.py: load CEPH_CONF

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #49663 from bradfitz/patch-1

doc: fix a typo

doc: fix a typo

Signed-off-by: Brad Fitzpatrick <brad@danga.com>

Merge pull request #49658 from zdover23/wip-doc-2023-01-15-h2-scroll-margin-top

doc/css: Add scroll-margin-top to h2 html element

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #49653 from zdover23/wip-doc-2023-01-06-crushtool-options

doc/man: define --num-rep, --min-rep and --max-rep

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: Laura Flores <lflores@redhat.com>

Merge pull request #49657 from dang/wip-dang-motr-build

Fix MOTRStore build

Reviewed-by: Casey Bodley <cbodley@redhat.com>

doc/css: Add scroll-margin-top to h2 html element

Add "scroll-margin-top: 4em;" to the h2 html element's definition in
custom.css. This moves the text under all h2 html elements out of the
way of the sticky-header-style top bar, which previously obscured the
text.

Signed-off-by: Zac Dover <zac.dover@gmail.com>

Merge pull request #49643 from zdover23/wip-doc-2023-01-05-add-padding-to-sections

doc/_static: add scroll-margin-top to custom.css

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc/man: define --num-rep, --min-rep and --max-rep

Explain the "--num-rep", "--min-rep", and "--max-rep" options, which are
required when running "crushtool" commands with the "--show-mappings"
flag. Originally reported by Brad Fitzpatrick.

https://tracker.ceph.com/issues/58374

Signed-off-by: Zac Dover <zac.dover@gmail.com>

Merge pull request #49373 from inspur-wyq/wip-doc-rgwtar

src/rgw/rgw_tar.h: fix typos

Reviewed-by: Kefu Chai <tchaikov@gmail.com>

Merge pull request #49631 from petrutlucian94/rbd_py_test2

qa: test_rbd_wnbd.py - disable PS progress bar

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>

crimson/osd/pg: rebuild missing set when a new interval is created

Fixes: https://tracker.ceph.com/issues/58339
Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>

crimson/osd/osd_operations: run peering_state related operations in a seastar::thread

Some peering events handling may involve seastar::future::wait(), so we need to run
the peering state machine in a dedicated seastar::thread

Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>

Merge pull request #49651 from Thingee/update-foundation-20230105

doc: Updating Foundation members for January 2023

doc: Updating Foundation members for January 2023

Signed-off-by: Mike Perez <thingee@gmail.com>

crimson/osd/main: get full config before starting reactor

Deployment tooling these days relies on fetching configs from the
mons.  We'd like to be able to set seastar reactor params like --smp
via mon config, so we need to start up a reactor and contact the mons
before starting up the reactor for real.

Seastar doesn't seem to like invoking app.run more than once -- a bunch
of thread-locals and statics get left around and result in invalid
memory accesses.  To avoid all of this, we simply fork a child process
to talk to the mons and send the information back over a fifo.

Signed-off-by: Samuel Just <sjust@redhat.com>

Fix MOTRStore build

Signed-off-by: Daniel Gryniewicz <dang@redhat.com>

doc/_static: add scroll-margin-top to custom.css

Add 4em of padding to the class "section", so that linked-to
destinations are not obscured by the top bar.

Signed-off-by: Zac Dover <zac.dover@gmail.com>

Merge pull request #49500 from BryceCao/wip-fix-result-when-users-mfas-is-null

rgw: fix result when users mfas is null

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #49637 from zdover23/wip-doc-2023-01-05-top-bar-scroll-margin-top-repair

doc/css: add scroll-margin-top to dt elements

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc/css: add scroll-margin-top to dt elements

add "scroll-margin-top: em3;" to custom.css so that the header bar
doesn't obscure the text of headwords in glossary.rst. Note that this
applies only to elements in the documentation that are rendered into
HTML with the dt (which stands for "description term" or "description
list") tag. Other modifications will be necessary in order to ensure
that the anchor points of non-dt elements are not obscured by the header
bar.

Signed-off-by: Zac Dover <zac.dover@gmail.com>

mgr/mgr_util: fixing some tox issues
Fixes: https://tracker.ceph.com/issues/58378
Signed-off-by: Redouane Kachach <rkachach@redhat.com>

qa: test_rbd_wnbd.py - disable PS progress bar

This test uses certain PS commands that attempt to display
a progress bar. However, this can cause issues when invoked
remotely (e.g. by the jenkins job).

For this reason, we're defining a helper (ps_execute) that runs
PS commands, disabling the progress bars and enabling the non
interactive mode.

Signed-off-by: Lucian Petrut <lpetrut@cloudbasesolutions.com>

Merge pull request #48730 from dang/wip-dang-zipper-chown

Fix chown to unlink

Reviewed-by: Casey Bodley <cbodley@redhat.com>

ceph-volume/tests: add allowlist_externals to tox.ini

typical failure seen in the CI:

```
py3-flake8: install_deps> ./tox_install_command.sh flake8
py3-flake8: failed with ./tox_install_command.sh (resolves to ./tox_install_command.sh) is not allowed, use allowlist_externals to allow it
```

Fixes: https://tracker.ceph.com/issues/58377
Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>

Merge pull request #49618 from petrutlucian94/rbd_py_test2

qa: retry test_rbd_wnbd.py fs operations

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>

qa: retry test_rbd_wnbd.py fs operations

Certain FS related operations can fail, especially under load
(e.g. initializing partitions, volume formatting, etc).

For this reason, we're going to introduce some retries.

Signed-off-by: Lucian Petrut <lpetrut@cloudbasesolutions.com>

Merge pull request #49620 from bradfitz/bradfitz/doc

doc: fix a couple grammatical things

Reviewed-by: Zac Dover <zac.dover@gmail.com>

doc: fix a couple grammatical things

Signed-off-by: Brad Fitzpatrick <brad@danga.com>

crimson/osd/pg_backend: missing modified_ranges implementataion tracker

Signed-off-by: Matan Breizman <mbreizma@redhat.com>

qa/suites/crimson-rados: rados_python - enable rollback test

Signed-off-by: Matan Breizman <mbreizma@redhat.com>

test/pybind/test_rados.py: add another rollback test

Added another rollback test case:
Do not remove the original object to be rollbacked to.

Signed-off-by: Matan Breizman <mbreizma@redhat.com>

crimson/osd: support snapshot rollbacks

Signed-off-by: Matan Breizman <mbreizma@redhat.com>

Merge pull request #49613 from zdover23/wip-doc-2023-01-02-start-documenting-ceph-49609-followup

doc/start: add Anthony D'Atri's suggestions

doc/start: add Anthony D'Atri's suggestions

Add the suggestions made by Anthony D'Atri in
https://github.com/ceph/ceph/pull/49609.

Signed-off-by: Zac Dover <zac.dover@gmail.com>

Merge pull request #49609 from zdover23/wip-doc-2023-01-02-start-documenting-ceph-cleanup

doc/start: refine "Quirks of RST"

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc/start: refine "Quirks of RST"

Refine the language that was added yesterday, language that explains how
certain aspects of RST work.

Signed-off-by: Zac Dover <zac.dover@gmail.com>

Merge pull request #49606 from zdover23/wip-doc-2023-01-01-start-documenting-ceph-quirks-of-rst

doc/start: add link-related metadocumentation

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc/start: add link-related metadocumentation

Add two kinds of link-related metadocumentation (documentation about how
to write documentation) to the "Documenting Ceph" section of the "Intro
to Ceph" document: 1. metadocumentation about external links, and 2.
metadocumentation about internal links.

Signed-off-by: Zac Dover <zac.dover@gmail.com>

Merge pull request #49602 from zdover23/wip-doc-2022-12-31-glossary-DAS-capitalization

doc/glossary: capitalize "DAS" correctly

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc/glossary: capitalize "DAS" correctly

Correctly capitalize "Direct-Attached Storage" in the glossary. (And
test the "Quincy" branch, which seems lately not to have picked up any
docs backports.)

Signed-off-by: Zac Dover <zac.dover@gmail.com>

Merge pull request #49599 from zdover23/wip-doc-2022-12-30-glossary-releases

doc/glossary: collate "releases" entries

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>