rpm: pass %{python3_version} to cmake

to force cmake to use the python3 and python3 modules for building
python3 bindings

on the debian side, it's okay to continue using "-DWITH_PYTHON3=ON", as

- cmake does normalize "ON" to 3
- debian's cmake extension lives on /usr/lib/python3/dist-packages/
  not in a specific /usr/lib/python3.x/dist-packages directory

Signed-off-by: Kefu Chai <kchai@redhat.com>

cmake: check for libpython of the same version of interpreter

actually cython or python3-cython's dependencies should take care of it.
but we should at least get it right on our side if we check it.

Signed-off-by: Kefu Chai <kchai@redhat.com>

cmake: use specified python3 version if any

use might have multiple python3 installed, some of them has/have all
dependencies installed and is good enough for building Ceph. we should
not always use the latest python installed in the system and complain that
there is missing dependencies, even if user has installed all the
python3 dependencies for the older python3.

put in other words, if user only installs cython module for python3.4, but
she has both python3.6 and python3.4 in her system. we should not force
her to uninstall python3.6 for installing Ceph.

this change also aligns with MGR_PYTHON_VERSION. i am not applying the
same change to WITH_PYTHON2, because python2 is already stablized. and distros
are not likely to release new python2 releases.

Signed-off-by: Kefu Chai <kchai@redhat.com>

Merge PR #27328 into master

* refs/pull/27328/head:
qa/tests: reduce number of jobs for `kcephfs`

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #27310 from tchaikov/wip-crimson-cache-ss-oi

crimson/osd: cache object_info and snapset in PGBackend

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

Merge pull request #27307 from tchaikov/wip-crimson-osd-hb

crimson/osd: do not add whoami as hb peer and cleanups

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

qa/tests: reduce number of jobs for `kcephfs`

we need it on `master` as well
see https://github.com/ceph/ceph/pull/27165

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>

Merge PR #27316 into master

* refs/pull/27316/head:
doc/rados/operations: document BLUEFS_SPILLOVER

Reviewed-by: Igor Fedotov <ifedotov@suse.com>

Merge pull request #27223 from ivancich/wip-fix-resharding-issue

rgw: race condition between resharding and ops waiting on resharding

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>

doc/rados/operations: document BLUEFS_SPILLOVER

Signed-off-by: Sage Weil <sage@redhat.com>

Merge PR #27265 into master

* refs/pull/27265/head:
valgrind.supp: add clauses for uninitialised gcm.Xi in OpenSSL.
src/valgrind.supp: replace with the teuthology's whitelist.

Reviewed-by: Sage Weil <sage@redhat.com>

Merge PR #27313 into master

* refs/pull/27313/head:
mon: quiet devname log noise

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #26966 from SUSE/wip-orchestrator-deepsea-fix-device-ls

mgr/deepsea: use ceph_volume output in get_inventory()

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>

mon: quiet devname log noise

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #27308 from tchaikov/wip-init-ceph-patience-is-a-virtue

init-ceph: wait longer before resending $signal

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #27255 from adamemerson/wip-names-common-through-objecter

Remove dependence on `using namespace`: Build of 'common' through osdc/Objecter.cc

Reviewed-by: Kefu Chai <kchai@redhat.com>

crimson/osd: cache object_info and snapset in PGBackend

for better performance

Signed-off-by: Kefu Chai <kchai@redhat.com>

init-ceph: wait longer before resending $signal

if ceph-osd takes longer than 1 seconds to unmount the objectstore, it
won't get a chance to fully persist all of its stuff to disk before
init-ceph kills it again.

in my case, `MemStore::_save()` fails to write $path/collections before
it gets killed, if it has more than 512 PGs.

Signed-off-by: Kefu Chai <kchai@redhat.com>

crimson/osd: do not add whoami as hb peer

it does not make sense to say hello to myself.

Signed-off-by: Kefu Chai <kchai@redhat.com>

crimson/osd: do not store whoami or nonce in Heartbeat

we don't create messengers in the class which consumes them anymore, so
no need to have these member variable.

Signed-off-by: Kefu Chai <kchai@redhat.com>

crimson/os: lower debug level of i/o to "debug"

for better performance.

Signed-off-by: Kefu Chai <kchai@redhat.com>

mgr/deepsea: use ceph_volume output in get_inventory()

DeepSea is being updated to use ceph_volume internally (see
https://github.com/SUSE/DeepSea/pull/1517).  Once this is done,
the mgr_orch.get_inventory runner will just be returning the
raw ceph_volume output, so this commit updates the DeepSea mgr
module to match.

Signed-off-by: Tim Serong <tserong@suse.com>

mgr/deepsea: log salt job failures

If a request to salt succeeds, but the event comes back with some internal
failure (e.g.: an exception was thrown inside the salt runner), we need to
log this so the admin can find out what on earth went wrong.

Signed-off-by: Tim Serong <tserong@suse.com>

mgr/deepsea: use empty strings rather than None for option defaults

This makes the _config_valid() function work properly; the option
defaults are being strinified somewhere, so we need to use empty
strings rather than None (which becomes "None"), in order to check
if they're set or not.

Signed-off-by: Tim Serong <tserong@suse.com>

Merge PR #27301 into master

* refs/pull/27301/head:
qa: remove requirement on simple msgr

Reviewed-by: Sage Weil <sage@redhat.com>

qa: remove requirement on simple msgr

Fixes: http://tracker.ceph.com/issues/39079
Introduced-by: 28b4392a7191c5ed59c03cdd113050107a8109fc
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>

Merge PR #26970 into master

* refs/pull/26970/head:
mds: initialize cap_revoke_eviction_timeout with conf

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge PR #26992 into master

* refs/pull/26992/head:
mount.ceph.c: do not pass nofail to the kernel

Reviewed-by: Jeff Layton <jlayton@redhat.com>

Merge PR #27087 into master

* refs/pull/27087/head:
mds: remove duplicated check on balance amount

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge PR #27063 into master

* refs/pull/27063/head:
mds: there is an assertion when calling Beacon::shutdown()

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #27294 from tspmelo/wip-nfs-squash

mgr/dashboard: Fix NFS squash default value

Reviewed-by: Ricardo Marques <rimarques@suse.com>

Merge pull request #25353 from cbodley/wip-rgw-sysobj-yield

rgw: add optional_yield to SysObj service interfaces

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>

Merge pull request #25355 from cbodley/wip-rgw-http-yield

rgw: add optional_yield to http client interface

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>

Merge pull request #27276 from cbodley/wip-39033

rgw multisite: data sync checks empty next_marker for datalog

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>

Merge pull request #27244 from tspmelo/wip-nfsv3-prop

mgr/dashboard: Fix deletion of NFS protocol properties

Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>

Merge pull request #27130 from cbodley/wip-38700

rgw: decrypt filter does not cross multipart boundaries

Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>

mgr/dashboard: Fix NFS squash default value

Fixes: http://tracker.ceph.com/issues/39064
Signed-off-by: Tiago Melo <tmelo@suse.com>

Merge PR #27206 into master

* refs/pull/27206/head:
osd: shutdown recovery_request_timer earlier

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #27074 from LenzGr/master-documentation

doc: Updated dashboard iSCSI configuration, added labels

Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #27164 from Devp00l/issue-38937

mgr/dashboard: Back button component

Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>

Merge pull request #27269 from rhcs-dashboard/wip-39030-master

mgr/dashboard: update vstart to use new ssl port

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>

Merge pull request #27203 from falcon78921/wip-doc-38721

doc: removed OpenStack Kilo references in Keystone docs

Reviewed-by: Sebastian Wagner <swagner@suse.com>

Merge pull request #27264 from rouming/fio-ceph-messenger--dummy-auth-for-v2

fio_ceph_messenger: catch up v2 proto changes by using dummy auth

Reviewed-by: Ricardo Dias <rdias@suse.com>

doc: Updated dashboard iSCSI configuration, added labels

Added note about the requirement for the latest ceph-iscsi version
3 to the dashboard documentation. Added some doc references
and replaced some URLs in the iSCSI docs with reST labels instead.

Signed-off-by: Lenz Grimmer <lgrimmer@suse.com>

Merge pull request #27205 from xiexingguo/wip-38784

osd/PG: introduce all_missing_unfound helper

Reviewed-by: Neha Ojha <nojha@redhat.com>

Merge pull request #27182 from xiexingguo/wip-38931

osd/PG: move down peers out from peer_purged

Reviewed-by: Sage Weil <sage@redhat.com>

osd/PG: move down peers out from peer_purged

In purge_strays(), we'll aggressively clear stray_set and
add all related peers into peer_purged.

However, if the corrsponding peer is down and becomes
up again, (unconditionally) adding it to peer_purged
will prevent primary from re-purging it.
(See Active::react(const MNotifyRec& notevt))

On consuming a new osdmap, let's move any down peers out from
peer_purged simutaneously. This way we can lower the risk
of leaving any leftover PGs behind.

Related-to: http://tracker.ceph.com/issues/38931
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>

Merge PR #27249 into master

* refs/pull/27249/head:
qa/suites/rados/thrash-old-clients: fix up v1/v2 options

Reviewed-by: Neha Ojha <nojha@redhat.com>

Merge PR #27133 into master

* refs/pull/27133/head:
log,global: do not start flusher thread until after we have our mon config
log: buffer log entries until flusher thread starts
log: open log file from flusher thread
common/ceph_context: fix log_to_file observer

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge PR #26976 into master

* refs/pull/26976/head:
doc: add doc for cephfs lazyio

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge PR #27199 into master

* refs/pull/27199/head:
mds: fix dump routine for session_info_t.used_inos
mds: fix some misleading log messages
client: comment fix in _lookup
mds: fix comment over MDRequestImpl
mds: use stdbool.h instead of hand-rolling our own bool type

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Zheng Yan <zyan@redhat.com>

mgr/dashboard: udpate vstart to use new ssl port

Fixes: https://tracker.ceph.com/issues/39030
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>

Merge pull request #27242 from theanalyst/beast-fe-ports

rgw: beast port parsing

Reviewed-by: Casey Bodley <cbodley@redhat.com>

rgw: beast: set a default port for endpoints

if no port is specified we don't set one(or set to 0), and don't exactly error
out, so rgw keeps running without being bound to a port. Set the port to default
in these cases

Fixes: http://tracker.ceph.com/issues/39000
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>

rgw: callers pass null_yield to RGWSI_SysObj

Signed-off-by: Casey Bodley <cbodley@redhat.com>

rgw: add optional_yield to RGWSI_Notify

Signed-off-by: Casey Bodley <cbodley@redhat.com>

rgw: add optional_yield to RGWSI_SysObj

Signed-off-by: Casey Bodley <cbodley@redhat.com>

rgw: add optional_yield to RGWSI_SysObj_Cache

Signed-off-by: Casey Bodley <cbodley@redhat.com>

rgw: add optional_yield to RGWSI_SysObj_Core interface

Signed-off-by: Casey Bodley <cbodley@redhat.com>

rgw: RGWSI_RADOS::Obj::notify() takes optional_yield

Signed-off-by: Casey Bodley <cbodley@redhat.com>

rgw: add rgw_rados_notify() with optional_yield

Signed-off-by: Casey Bodley <cbodley@redhat.com>

librados/asio: add async_notify() to wrap aio_notify()

Signed-off-by: Casey Bodley <cbodley@redhat.com>

mgr/dashboard: Fix deletion of NFS protocol properties

Fixes: http://tracker.ceph.com/issues/38997
Signed-off-by: Tiago Melo <tmelo@suse.com>

Merge pull request #27213 from ajarr/fix-38946

pybind: fix use of WriteOpCtx and ReadOpCtx

Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

auth: Update AuthServiceHandler.h to work without using namespace

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

auth: Update AuthServer.h to work without using namespace

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

auth: Update Crypto.h to work without using namespace

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

auth: Update AuthRegistry.h to work without using namespace

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

auth: Update AuthClientHandler.h to work without using namespace

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

auth: Update AuthAuthorizedHandler.h to work without using namespace

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

auth: Update AuthClient.h to work without using namespace

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

auth: Update Auth.h to work without using namespace

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

auth: Update KeyRing.h to work without using namespace

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

hello: Update cls_hello.cc to work without using namespace

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

journal: Update cls_journal_types.h to work without using namespace

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

cls/lock: Update cls_lock_types.h to work without using namespace

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

cls/numops: Update cls_numops.cc to work without using namespace

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

cls/sdk: Update cls_sdk.cc to work without using namespace

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

common: Update CommandTable.h to work without using namespace

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

common: Update EventTrace.h to work without using namespace

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

common: Update Finisher.h to work without using namespace

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

common: Update LogClient.h to work without using namespace

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

common: Update LogEntry.h to work without using namespace

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

common: Update Throttle.h to work without using namespace

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

common: Update TrackedOp.h to work without using namespace

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

common: Update WorkQueue.h to work without using namespace

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

common: Update ceph_json.h to work without using namespace

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

common: Update config.h to work without using namespace

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

common: Update config_obs_mgr.h to work without using namespace

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

common: Update config_proxy.h to work without using namespace

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

common: Update config_values.h to work without using namespace

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

common: Update entity_name.h to work without using namespace

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

common: Update fork_function.h to work without using namespace

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

common: Update histogram.h to work without using namespace

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

common: Update hobject.h to work without using namespace

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

common: Update options.h to work without using namespace

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

common: Update perf_counters.h to work without using namespace

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

common: Update scrub_types.h to work without using namespace

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

common: Update ceph_context.h to work without using namespace

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

common: Update bloom_filter.hpp to work without using namespace

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>