osd: drop includes of messages that are not longer used in OSD.cc

Signed-off-by: Radosław Zarzyński <rzarzyns@redhat.com>

Merge pull request #47849 from torchiaf/fix/37327

mgr/dashboard: Add details to the modal which displays the `safe-to-d…

Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Volker Theile <vtheile@suse.com>

Merge pull request #47958 from rhcs-dashboard/edit-host-labels-fix

mgr/dashboard: fix Expected to find element: `cd-modal .badge but never found it

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>

Merge pull request #45148 from guits/revert-ceph-crash-changes

Revert "src/ceph-crash.in: remove unused frame in handler()"

Reviewed-by: Teoman ONAY <tonay@redhat.com>

Merge pull request #47965 from cbodley/wip-rgw-drain-cb-capture-error

Revert "rgw: add coroutine drain callback capture_error()"

Reviewed-by: Soumya Koduri <skoduri@redhat.com>
Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>

mgr/dashboard: Add details to the modal which displays the `safe-to-destroy` result

- Add warnings type information in the case of the OSDs are not safe to destroy
- Add info type information in the case of the OSDs are safe to destroy

Fixes: https://tracker.ceph.com/issues/37327
Signed-off-by: Francesco Torchia <francesco.torchia@suse.com>

Merge pull request #47878 from xxhdx1985126/wip-pin_set-cpu

crimson/os/seastore/btree: reduce the avg number of queries of pin sets' parent/child lookup

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>

Merge pull request #47090 from lxbsz/wip-56553

client: do not uninline data for read

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Milind Changire <mchangir@redhat.com>
Reviewed-by: Kotresh HR <khiremat@redhat.com>

Merge pull request #48037 from guits/fix_57085

ceph-volume: fix inventory with device arg

Merge pull request #48117 from guits/fix-cv-func-test-filestore-create

ceph-volume/tests: fix lvm centos8-filestore-create job

Merge pull request #48054 from yuvalif/wip-yuval-fix-56572

tests: remove pubsub tests from multisite

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Kalpesh Pandya <kapandya@redhat.com>

Merge pull request #47516 from nmshelke/fix-56632

qa: ignore disk quota exceeded failure in test

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Xiubo Li <xiubli@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>

ceph-volume/tests: fix lvm centos8-filestore-create job

/dev/vdc1 can't be zapped if it still holds an lv mapper.
let's use --destroy in the lvm zap command in order to remove
the held lv mapper before zapping the partition and recreate the partition after.

Fixes: https://tracker.ceph.com/issues/57553
Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>

crimson/os/seastore/btree: reduce the avg number of queries of pin sets' parent/child lookup

Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>

Merge pull request #47966 from cyx1231st/wip-seastore-move-gcprocess

crimson/os/seastore: move AsyncCleaner::GCProcess to EPM::BackgroundProcess

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Myoungwon Oh <myoungwon.oh@samsung.com>
Reviewed-by: Xuehan Xu <xxhdx1985126@gmail.com>

Merge pull request #48105 from athanatos/sjust/wip-57530

crimson/.../node.cc: fix Node initialization argument passing

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>

crimson/.../node.cc: fix Node initialization argument passing

Argument evaluation order is unspecified, clang seems to be choosing
to execute the std::unique_ptr move constructor before the call to
get(), causing the first argument to be passed as null.

https://tracker.ceph.com/issues/57530
Signed-off-by: Samuel Just <sjust@redhat.com>

Merge pull request #48002 from nSedrickm/accessibility-documentation

doc/dashboard: update documentation with accessibility development pr…

Merge pull request #46723 from nSedrickm/dashboard-health-accessibility-update

mgr/dashboard: Improve accessibility for dashboard health page

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>

Merge pull request #47668 from NitzanMordhai/wip-nitzan-test-rados-watch-notify-callbacks

pybind/rados: notify callback reconnect

Reviewed-by: Laura Flores <lflores@redhat.com>

Merge pull request #47937 from adk3798/tp-add-rm-settings-docs

doc/cephadm: fix tuned-profile add/rm-setting syntax example

Reviewed-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>

Merge pull request #47709 from zalsader/add-daos

rgw: add DAOS SAL implementation

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #48066 from yuvalif/wip-yuval-fix-57518

rgw/lua: create lua background manager before the frontends

Reviwed-by: dang, cbodley, mattbenjamin

Revert "rgw: add coroutine drain callback capture_error()"

This reverts commit d75ea8757d96a82df692a9476ed40b3206cba47e.

Fixes: https://tracker.ceph.com/issues/57400
Signed-off-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #43655 from liewegas/auth-rotate

mon,auth,cephadm: support auth key rotation

Merge pull request #47967 from yangxiaolaing/cephadm_doc

doc/cephadm: Add creation method of OSD

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>

Merge pull request #47521 from adk3798/iscsi-ip-list

mgr/cephadm: reconfig iscsi daemons if trusted_ip_list changes

Reviewed-by: John Mulligan <jmulligan@redhat.com>
Reviewed-by: Redouane Kachach <rkachach@redhat.com>

Merge pull request #47640 from adk3798/no-cgroups

mgr/cephadm: make setting --cgroups=split configurable

Reviewed-by: Redouane Kachach <rkachach@redhat.com>

Merge pull request #47936 from adk3798/tuned-profile-dashes

mgr/cephadm: fix tuned profiles getting removed if name has dashes

Reviewed-by: Redouane Kachach <rkachach@redhat.com>

Merge pull request #47786 from rkachach/fix_issue_57192

mgr/cephadm: validating tuned profile specification

Reviewed-by: Adam King <adking@redhat.com>

Merge pull request #48008 from adk3798/docs-extra-container-mounts

doc/cephadm: document recommended syntax for mounting files with ECA

Reviewed-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>

mgr/cephadm: validating tuned profile specification
fixes: https://tracker.ceph.com/issues/57192
fixes: https://tracker.ceph.com/issues/57191

Signed-off-by: Redouane Kachach <rkachach@redhat.com>

mgr/cephadm: reconfig iscsi daemons if trusted_ip_list changes

This is necessary as iscsi daemons expect the iscsi-gateway.cfg
which includes this list to match across the iscsi daemons

Fixes: https://tracker.ceph.com/issues/57078
Signed-off-by: Adam King <adking@redhat.com>

Merge pull request #47898 from adk3798/no-sudo-true

mgr/cephadm: don't use "sudo" in commands if user is root

Reviewed-by: John Mulligan <jmulligan@redhat.com>
Reviewed-by: Redouane Kachach <rkachach@redhat.com>

mgr/cephadm: fix tuned profiles getting removed if name has dashes

Previously, due to the way it was just splitting the file name on
dashes to try and get the profile name, any profile name with dashes
was not getting properly matched and would therefore get marked
stray and removed. This new strategy instead tries to match the actual
expected file name.

Fixes: https://tracker.ceph.com/issues/57405
Signed-off-by: Adam King <adking@redhat.com>

Merge pull request #47469 from lxbsz/cleanup_C_MDC_EmptyImport

mds: remove the stale class C_MDC_EmptyImport code

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Milind Changire <mchangir@redhat.com>
Reviewed-by: Nikhilkumar Shelke <nshelke@redhat.com>

Merge pull request #48033 from joscollin/wip-kill-cephfs-top

stop.sh: kill cephfs-top

Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #48006 from rkachach/fix_issue_57422

mgr/cephadm: Adding --storage.tsdb.retention.size prometheus option

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>

rgw/lua: create lua background manager before the frontends

Fixes: https://tracker.ceph.com/issues/57518
issue was introduced in: d0424e842d283fb8309fcceb0a84effb16752e36

Signed-off-by: yuval Lifshitz <ylifshit@redhat.com>

Merge pull request #47574 from rhcs-dashboard/osd-form-hostname-filter

mgr/dashboard: osd form preselect db/wal device filters

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: sunilangadi2 <NOT@FOUND>

Merge pull request #48001 from aisakaki/wip-omap-inclusive-fix

crimson/seastore: fixs on omap list open/closed range

Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>

Merge pull request #47968 from rhcs-dashboard/add-alert-silence-button

mgr/dashboard: Add a Silence button shortcut to alert notifications

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>

Merge pull request #47305 from zdover23/wip-doc-2022-07-25-pr4600-cleanup

doc/monitoring: add min vers of apps in mon stack

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>

Merge pull request #47575 from zdover23/wip-doc-2022-08-13-rados-operations-pools-prompt-update

doc/rados: add prompts to pools.rst

Reviewed-by: Neha Ojha <nojha@redhat.com>

Merge pull request #48042 from SUSE/wip-fix-57497

ceph.spec.in: Use gcc11-c++ on openSUSE Leap 15.x

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #47771 from linuxbox2/wip-librgw-frontends

librgw: add ability to conditionally export HTTP frontends/apis

rgw/main: if !nfs, register service map as "rgw"

This was accidentally changed to "nfs"--which breaks various
ceph orchestration assumptions.

Found by Ernesto Puerta <epuertat@redhat.com>

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>

Merge pull request #47854 from phlogistonjohn/jjm-fix-57268

qa/tasks/kubeadm: set up tigera resources via kubectl create

Reviewed-by: Adam King <adking@redhat.com>

doc/cephadm: document recommended syntax for mounting files with ECA

Mounting files with extra container args seems to not
work with some of the more intuitive syntaxes.
See https://tracker.ceph.com/issues/57338

Signed-off-by: Adam King <adking@redhat.com>

Merge pull request #48007 from adk3798/fix-staggered-pacific-version

doc/cephadm: correct version staggered upgrade got in pacific

Reviewed-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>

Merge pull request #46344 from mjenglish/ceph-volume-multiple-actuator

ceph-volume/ceph_volume/util: ceph-volume multi-actuator drive attribute

Merge pull request #47970 from soumyakoduri/wip-skoduri-coverity

rgw/dbstore: Fix coverity issues #1510412, #1511420

Reviewed-by: Yuval Lifshitz <ylifshit@redhat.com>

mgr/cephadm: fix custom config unit test

this test needs to be updated to account for the
new keyring information being introduced

Signed-off-by: Adam King <adking@redhat.com>

mgr/cephadm: execute conf update when rotating secret

This is a fixup for: mgr/cephadm: add daemon 'rotate-key' action

The way we rotate mgr's secret require:

1) writing the new pending-key to mgr's file,
2) restarting the mgr via the `mgr fail` mon command.

Unfortunately, we might be doing the first step wrongly.
`_create_daemoan()` is a coroutine (Python's `async def`)
while we don't `wait` for it. IIUC the underlying doc
correctly, this has no effect, and thus the mgr is restarted
with old key.

  "Note that simply calling a coroutine will not schedule
  it to be executed"

See: https://docs.python.org/3/library/asyncio-task.html#id1

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

mon/AuthMonitor: don't forget about caps on "auth get".

The issue came in 98b89120321059397798170f7ae2bf7c64e4f4b2.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

mgr/cephadm: add crash keyring to unit test

Signed-off-by: Adam King <adking@redhat.com>

auth: refactor KeyServer::get_used_pending_keys().

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

ceph-crash: ping cluster with key on startup

This is mostly pointless, *except* that after a key rotation it ensures
that the new key is used immediately (and the pending_key is committed by
the mon).

Signed-off-by: Sage Weil <sage@newdream.net>

doc/cephadm/operations: document 'ceph orch daemon rotate-key'

Signed-off-by: Sage Weil <sage@newdream.net>

doc/cephadm/operations: document daemon commands

Signed-off-by: Sage Weil <sage@newdream.net>

qa/suites/orch/cephadm/with-work: add key rotation test

Signed-off-by: Sage Weil <sage@newdream.net>

mgr/cephadm: add rotate support for rgw, crash, nfs, rbd-mirror, iscsi

Signed-off-by: Sage Weil <sage@newdream.net>

mgr/cephadm: add daemon 'rotate-key' action

Caveats:
- only works with osd, mds, mgr so far
- sometimes we have to restart the daemon

Signed-off-by: Sage Weil <sage@newdream.net>

mgr/cephadm/service: factor out get_auth_entity()

Signed-off-by: Sage Weil <sage@newdream.net>

mgr/cephadm: log exceptions in daemon actions

Signed-off-by: Sage Weil <sage@newdream.net>

mon/AuthMonitor: no stderr output on success

These messages are distracting.

Signed-off-by: Sage Weil <sage@newdream.net>
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

osd: add 'rotate-stored-key' asok command

This writes the key to the osd_key in the block device label.

Signed-off-by: Sage Weil <sage@newdream.net>

mgr/cephadm: deploy pending_key when possible

Also, leave out the caps.

Signed-off-by: Sage Weil <sage@newdream.net>
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

mgr/cephadm: fix keyring when updating caps

Signed-off-by: Sage Weil <sage@newdream.net>

mon/AuthMonitor: include pending_key in 'auth get-or-create' result

Signed-off-by: Sage Weil <sage@newdream.net>

mon/MonClient: add 'rotate-key' asok command

Rotate the live auth key for a running daemon without restarting.

Signed-off-by: Sage Weil <sage@newdream.net>

common/admin_socket: pass inbl to sync call() method

Only the async_call got this before.

Signed-off-by: Sage Weil <sage@newdream.net>
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

qa/workunits/mon/auth_key_rotation.sh: exercise pending key / rotation

Signed-off-by: Sage Weil <sage@newdream.net>

mon: automatically commit used pending_keys

Signed-off-by: Sage Weil <sage@newdream.net>

auth: keep track of used pending_keys

Signed-off-by: Sage Weil <sage@newdream.net>

mon/AuthMonitor: 'auth {get-or-create,clear,commit}-pending'

Add commands to create, clear, or commit pending_key.

Signed-off-by: Sage Weil <sage@newdream.net>

auth/cephx: authenticate with either key or pending_key

Signed-off-by: Sage Weil <sage@newdream.net>

auth: add PendingKey to EntityAuth

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

doc/dashboard: update documentation with accessibility development practices

Update documentation to include  tools and practice used when developing dashboard features

Fixes: https://tracker.ceph.com/issues/56453
Signed-off-by: nsedrickm <nsedrick101@gmail.com>

tests: remove pubsub tests from multisite

Fixes: https://tracker.ceph.com/issues/56572
Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>

mgr/dashboard: Add a Silence button shortcut to alert notifications

Fixes: https://tracker.ceph.com/issues/57457
Signed-off-by: Aashish Sharma <aasharma@redhat.com>

Merge pull request #47976 from rhcs-dashboard/fix-duplicate-snapshot

mgr/dashboard: fix snapshot creation with duplicate name

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>

rgw/dbstore: Fix coverity issues #1510412, #1511420

Fixes: https://tracker.ceph.com/issues/57322
Fixes: https://tracker.ceph.com/issues/57325
Signed-off-by: Soumya Koduri <skoduri@redhat.com>

ceph.spec.in: Use gcc11-c++ on openSUSE Leap 15.x

Fixes: 80949babab4aac86647ce9973f6b44adb92fae95
Fixes: https://tracker.ceph.com/issues/57497
Signed-off-by: Tim Serong <tserong@suse.com>

Merge pull request #48032 from rhcs-dashboard/openapi-check-fix

mgr/dashboard: fix openapi-check

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>

mgr/dashboard: docs gen tags sort

When generating tags the order of endpoints wasn't taken into account.
Two endpoints with the same url prefix, for example `/api/cluster/` and
`/api/cluster/user`, have different docs and the tags is generated from
a doc of one of these two, and since the order of these endpoints might
vary it is imperative to sort them to have a deterministic output.

Signed-off-by: Pere Diaz Bou <pdiazbou@redhat.com>

Merge pull request #47770 from rzarzynski/wip-doc-dups-trimming-relnotes

PendingReleaseNotes: document online and offline trimming of PG Log's…

Reviewed-By: Neha Ojha <nojha@redhat.com>

rgwlib: ensure AppMain is destructed before CephContext

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>

rgw/main: cause ratelimiter to destruct in AppMain::shutdown()

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>

librgw: fix mismatched register/unregister sigterm handler

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>

rgw/main:  fix init order of rgw_main's init_storage()

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>

rgw/main: move service_map_meta into AppMain

The RGWRealmReloader holds a reference on it.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>

rgw/main: move signal handler actions out of shutdown()

AppMain::shutdown() had borrowed the unregister_async_signal_handler()
text from librgw, but of course, that's wrong.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>

rgwlib: robustify non-default initialization

Don't rely on the conf-default value of rgw_nfs_frontends to
provide "rgw-nfs," as that's not optional when running under
librgw.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>

rgw_main: remove unused tracepoint decls

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>

rgwlib: rework linkage

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>

rgw_a: build reorganization

Reorganize some dependencies shared by the librgw.so and radosgw
main units.  The librgw.so build no longer builds a main(...)
unit.

Build time should be slightly reduced, as several shared dependencies
have been moved into rgw_a.

There are some other cleanups, e.g., rgw_signal.{h,cc}.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>

rgw/main: remove friends, see_also

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>

rgw/main: various doc and comment corrections by doc writers

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>

rgw/main: use AppMain in c++ main function

Consolidate standalone and library initialization into one
unit.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>