mon/LogMonitor: add mon_cluster_log_to_file bool option

Allow cluster logging to a file to be disabled via a boolean.  Default
to true to avoid any change in behavior.

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #27280 from xiexingguo/wip-39039

mgr: more GIL fixes

Reviewed-by: Yan Jun <yan.jun8@zte.com.cn>
Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #27245 from tspmelo/wip-nfs-typo

mgr/dashboard: Fix typo in NFS form

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>

Merge pull request #27333 from tchaikov/wip-rpm-devtoolsset-8-on-aarch64

rpm: enable devtoolset-8 on aarch64 also

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>

install-deps,rpm: enable devtoolset-8 on aarch64 also

in 5ae3b06e, we left aarch64 with devtoolset-7, but aarch64 builders are
also suffering from http://tracker.ceph.com/issues/38892. so i installed
devtoolset-8 on all aarch64 builders manually from the rpm packages
downloaded from koji builder:

- https://cbs.centos.org/koji/buildinfo?buildID=24923
- https://cbs.centos.org/koji/buildinfo?buildID=24931

libasan5, libubsan1 are not installed.

Signed-off-by: Kefu Chai <kchai@redhat.com>

Merge PR #27328 into master

* refs/pull/27328/head:
qa/tests: reduce number of jobs for `kcephfs`

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #27310 from tchaikov/wip-crimson-cache-ss-oi

crimson/osd: cache object_info and snapset in PGBackend

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

Merge pull request #27307 from tchaikov/wip-crimson-osd-hb

crimson/osd: do not add whoami as hb peer and cleanups

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

qa/tests: reduce number of jobs for `kcephfs`

we need it on `master` as well
see https://github.com/ceph/ceph/pull/27165

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>

Merge PR #27316 into master

* refs/pull/27316/head:
doc/rados/operations: document BLUEFS_SPILLOVER

Reviewed-by: Igor Fedotov <ifedotov@suse.com>

Merge pull request #27223 from ivancich/wip-fix-resharding-issue

rgw: race condition between resharding and ops waiting on resharding

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>

doc/rados/operations: document BLUEFS_SPILLOVER

Signed-off-by: Sage Weil <sage@redhat.com>

mgr/dashboard: Fix typo in NFS form

Fixes: http://tracker.ceph.com/issues/39067
Signed-off-by: Tiago Melo <tmelo@suse.com>

Merge PR #27265 into master

* refs/pull/27265/head:
valgrind.supp: add clauses for uninitialised gcm.Xi in OpenSSL.
src/valgrind.supp: replace with the teuthology's whitelist.

Reviewed-by: Sage Weil <sage@redhat.com>

Merge PR #27313 into master

* refs/pull/27313/head:
mon: quiet devname log noise

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #26966 from SUSE/wip-orchestrator-deepsea-fix-device-ls

mgr/deepsea: use ceph_volume output in get_inventory()

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>

mon: quiet devname log noise

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #27308 from tchaikov/wip-init-ceph-patience-is-a-virtue

init-ceph: wait longer before resending $signal

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #27255 from adamemerson/wip-names-common-through-objecter

Remove dependence on `using namespace`: Build of 'common' through osdc/Objecter.cc

Reviewed-by: Kefu Chai <kchai@redhat.com>

crimson/osd: cache object_info and snapset in PGBackend

for better performance

Signed-off-by: Kefu Chai <kchai@redhat.com>

init-ceph: wait longer before resending $signal

if ceph-osd takes longer than 1 seconds to unmount the objectstore, it
won't get a chance to fully persist all of its stuff to disk before
init-ceph kills it again.

in my case, `MemStore::_save()` fails to write $path/collections before
it gets killed, if it has more than 512 PGs.

Signed-off-by: Kefu Chai <kchai@redhat.com>

crimson/osd: do not add whoami as hb peer

it does not make sense to say hello to myself.

Signed-off-by: Kefu Chai <kchai@redhat.com>

crimson/osd: do not store whoami or nonce in Heartbeat

we don't create messengers in the class which consumes them anymore, so
no need to have these member variable.

Signed-off-by: Kefu Chai <kchai@redhat.com>

crimson/os: lower debug level of i/o to "debug"

for better performance.

Signed-off-by: Kefu Chai <kchai@redhat.com>

mgr/deepsea: use ceph_volume output in get_inventory()

DeepSea is being updated to use ceph_volume internally (see
https://github.com/SUSE/DeepSea/pull/1517).  Once this is done,
the mgr_orch.get_inventory runner will just be returning the
raw ceph_volume output, so this commit updates the DeepSea mgr
module to match.

Signed-off-by: Tim Serong <tserong@suse.com>

mgr/deepsea: log salt job failures

If a request to salt succeeds, but the event comes back with some internal
failure (e.g.: an exception was thrown inside the salt runner), we need to
log this so the admin can find out what on earth went wrong.

Signed-off-by: Tim Serong <tserong@suse.com>

mgr/deepsea: use empty strings rather than None for option defaults

This makes the _config_valid() function work properly; the option
defaults are being strinified somewhere, so we need to use empty
strings rather than None (which becomes "None"), in order to check
if they're set or not.

Signed-off-by: Tim Serong <tserong@suse.com>

Merge PR #27301 into master

* refs/pull/27301/head:
qa: remove requirement on simple msgr

Reviewed-by: Sage Weil <sage@redhat.com>

qa: remove requirement on simple msgr

Fixes: http://tracker.ceph.com/issues/39079
Introduced-by: 28b4392a7191c5ed59c03cdd113050107a8109fc
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>

Merge PR #26970 into master

* refs/pull/26970/head:
mds: initialize cap_revoke_eviction_timeout with conf

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge PR #26992 into master

* refs/pull/26992/head:
mount.ceph.c: do not pass nofail to the kernel

Reviewed-by: Jeff Layton <jlayton@redhat.com>

Merge PR #27087 into master

* refs/pull/27087/head:
mds: remove duplicated check on balance amount

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge PR #27063 into master

* refs/pull/27063/head:
mds: there is an assertion when calling Beacon::shutdown()

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #27294 from tspmelo/wip-nfs-squash

mgr/dashboard: Fix NFS squash default value

Reviewed-by: Ricardo Marques <rimarques@suse.com>

Merge pull request #25353 from cbodley/wip-rgw-sysobj-yield

rgw: add optional_yield to SysObj service interfaces

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>

Merge pull request #25355 from cbodley/wip-rgw-http-yield

rgw: add optional_yield to http client interface

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>

Merge pull request #27276 from cbodley/wip-39033

rgw multisite: data sync checks empty next_marker for datalog

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>

Merge pull request #27244 from tspmelo/wip-nfsv3-prop

mgr/dashboard: Fix deletion of NFS protocol properties

Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>

Merge pull request #27130 from cbodley/wip-38700

rgw: decrypt filter does not cross multipart boundaries

Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>

mgr/dashboard: Fix NFS squash default value

Fixes: http://tracker.ceph.com/issues/39064
Signed-off-by: Tiago Melo <tmelo@suse.com>

Merge PR #27206 into master

* refs/pull/27206/head:
osd: shutdown recovery_request_timer earlier

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #27074 from LenzGr/master-documentation

doc: Updated dashboard iSCSI configuration, added labels

Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #27164 from Devp00l/issue-38937

mgr/dashboard: Back button component

Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>

Merge pull request #27269 from rhcs-dashboard/wip-39030-master

mgr/dashboard: update vstart to use new ssl port

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>

Merge pull request #27203 from falcon78921/wip-doc-38721

doc: removed OpenStack Kilo references in Keystone docs

Reviewed-by: Sebastian Wagner <swagner@suse.com>

Merge pull request #27264 from rouming/fio-ceph-messenger--dummy-auth-for-v2

fio_ceph_messenger: catch up v2 proto changes by using dummy auth

Reviewed-by: Ricardo Dias <rdias@suse.com>

mgr/BaseMgrModule: drop GIL in ceph_store_set

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>

mgr/BaseMgrModule: drop GIL in set_config

Holding GIL and run mon_command turns out to be easily deadlock-prone.
https://tracker.ceph.com/issues/35985 is a typical report, and here is
another.

Fix by using PyModuleConfig's own lock for protection of concurrent
accesses, which should be sufficient enough.

Fixes: http://tracker.ceph.com/issues/39040
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>

doc: Updated dashboard iSCSI configuration, added labels

Added note about the requirement for the latest ceph-iscsi version
3 to the dashboard documentation. Added some doc references
and replaced some URLs in the iSCSI docs with reST labels instead.

Signed-off-by: Lenz Grimmer <lgrimmer@suse.com>

Merge pull request #27205 from xiexingguo/wip-38784

osd/PG: introduce all_missing_unfound helper

Reviewed-by: Neha Ojha <nojha@redhat.com>

Merge pull request #27182 from xiexingguo/wip-38931

osd/PG: move down peers out from peer_purged

Reviewed-by: Sage Weil <sage@redhat.com>

osd/PG: move down peers out from peer_purged

In purge_strays(), we'll aggressively clear stray_set and
add all related peers into peer_purged.

However, if the corrsponding peer is down and becomes
up again, (unconditionally) adding it to peer_purged
will prevent primary from re-purging it.
(See Active::react(const MNotifyRec& notevt))

On consuming a new osdmap, let's move any down peers out from
peer_purged simutaneously. This way we can lower the risk
of leaving any leftover PGs behind.

Related-to: http://tracker.ceph.com/issues/38931
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>

Merge PR #27249 into master

* refs/pull/27249/head:
qa/suites/rados/thrash-old-clients: fix up v1/v2 options

Reviewed-by: Neha Ojha <nojha@redhat.com>

Merge PR #27133 into master

* refs/pull/27133/head:
log,global: do not start flusher thread until after we have our mon config
log: buffer log entries until flusher thread starts
log: open log file from flusher thread
common/ceph_context: fix log_to_file observer

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge PR #26976 into master

* refs/pull/26976/head:
doc: add doc for cephfs lazyio

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge PR #27199 into master

* refs/pull/27199/head:
mds: fix dump routine for session_info_t.used_inos
mds: fix some misleading log messages
client: comment fix in _lookup
mds: fix comment over MDRequestImpl
mds: use stdbool.h instead of hand-rolling our own bool type

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Zheng Yan <zyan@redhat.com>

mgr/dashboard: udpate vstart to use new ssl port

Fixes: https://tracker.ceph.com/issues/39030
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>

Merge pull request #27242 from theanalyst/beast-fe-ports

rgw: beast port parsing

Reviewed-by: Casey Bodley <cbodley@redhat.com>

rgw: beast: set a default port for endpoints

if no port is specified we don't set one(or set to 0), and don't exactly error
out, so rgw keeps running without being bound to a port. Set the port to default
in these cases

Fixes: http://tracker.ceph.com/issues/39000
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>

rgw: callers pass null_yield to RGWSI_SysObj

Signed-off-by: Casey Bodley <cbodley@redhat.com>

rgw: add optional_yield to RGWSI_Notify

Signed-off-by: Casey Bodley <cbodley@redhat.com>

rgw: add optional_yield to RGWSI_SysObj

Signed-off-by: Casey Bodley <cbodley@redhat.com>

rgw: add optional_yield to RGWSI_SysObj_Cache

Signed-off-by: Casey Bodley <cbodley@redhat.com>

rgw: add optional_yield to RGWSI_SysObj_Core interface

Signed-off-by: Casey Bodley <cbodley@redhat.com>

rgw: RGWSI_RADOS::Obj::notify() takes optional_yield

Signed-off-by: Casey Bodley <cbodley@redhat.com>

rgw: add rgw_rados_notify() with optional_yield

Signed-off-by: Casey Bodley <cbodley@redhat.com>

librados/asio: add async_notify() to wrap aio_notify()

Signed-off-by: Casey Bodley <cbodley@redhat.com>

mgr/dashboard: Fix deletion of NFS protocol properties

Fixes: http://tracker.ceph.com/issues/38997
Signed-off-by: Tiago Melo <tmelo@suse.com>

Merge pull request #27213 from ajarr/fix-38946

pybind: fix use of WriteOpCtx and ReadOpCtx

Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

auth: Update AuthServiceHandler.h to work without using namespace

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

auth: Update AuthServer.h to work without using namespace

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

auth: Update Crypto.h to work without using namespace

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

auth: Update AuthRegistry.h to work without using namespace

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

auth: Update AuthClientHandler.h to work without using namespace

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

auth: Update AuthAuthorizedHandler.h to work without using namespace

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

auth: Update AuthClient.h to work without using namespace

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

auth: Update Auth.h to work without using namespace

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

auth: Update KeyRing.h to work without using namespace

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

hello: Update cls_hello.cc to work without using namespace

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

journal: Update cls_journal_types.h to work without using namespace

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

cls/lock: Update cls_lock_types.h to work without using namespace

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

cls/numops: Update cls_numops.cc to work without using namespace

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

cls/sdk: Update cls_sdk.cc to work without using namespace

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

common: Update CommandTable.h to work without using namespace

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

common: Update EventTrace.h to work without using namespace

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

common: Update Finisher.h to work without using namespace

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

common: Update LogClient.h to work without using namespace

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

common: Update LogEntry.h to work without using namespace

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

common: Update Throttle.h to work without using namespace

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

common: Update TrackedOp.h to work without using namespace

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

common: Update WorkQueue.h to work without using namespace

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

common: Update ceph_json.h to work without using namespace

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

common: Update config.h to work without using namespace

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

common: Update config_obs_mgr.h to work without using namespace

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

common: Update config_proxy.h to work without using namespace

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

common: Update config_values.h to work without using namespace

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

common: Update entity_name.h to work without using namespace

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

common: Update fork_function.h to work without using namespace

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

common: Update histogram.h to work without using namespace

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

common: Update hobject.h to work without using namespace

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>