mgr/hello: typos

Signed-off-by: Sage Weil <sage@redhat.com>

mgr/hello: a better command example

Signed-off-by: Sage Weil <sage@redhat.com>

mgr/hello: boilerplate for handling config options

Signed-off-by: Sage Weil <sage@redhat.com>

mgr/hello: fully document our options

Signed-off-by: Sage Weil <sage@redhat.com>

Merge PR #29111 into master

* refs/pull/29111/head:
qa/mgr/progress: Update the test suite for progress module

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #29117 from tchaikov/wip-mgr-set_health_checks-unicode

mgr: check for unicode passed to "set_health_checks()"

Reviewed-by: Neha Ojha <nojha@redhat.com>

Merge PR #29320 into master

* refs/pull/29320/head:
os/bluestore: remove unused arg to _get_deferred_op()

Reviewed-by: Igor Fedotov <ifedotov@suse.com>

Merge pull request #29282 from yuriw/wip-yuriw-upgrade-rwg-splits-master

qa/tests: added rgw into upgrade sequence to improve coverage - splits

os/bluestore: remove unused arg to _get_deferred_op()

Fixes: http://tracker.ceph.com/issues/40918
Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #29296 from tchaikov/wip-remove-script/dep-report.sh

script: remove dep-report.sh

Reviewed-by: Neha Ojha <nojha@redhat.com>

mgr/PyFormatter.h: add necessary #include

this header uses `std::string`, `std::string_view` and
`std::stringstream`, so it should include the corresponding headers.

Signed-off-by: Kefu Chai <kchai@redhat.com>

mgr: check for unicode passed to "set_health_checks()"

in python2, in addition to `str`, a string could also be unicode
string. there is chance that user passes a unicode string to
`set_health_checks()`, so let's check for unicode string also.

in python3, all strings are `unicode` string, and `PyString_Check()` is
defined as an alias of `PyUnicode_Check()`, so we are fine with python3.

the wrapper method of `PyString_ToString()` returns a pair of converted
string and a bool. if it fails to detect a string, an empty string and
false are returned.

Signed-off-by: Kefu Chai <kchai@redhat.com>

script: remove dep-report.sh

dep-report.sh depends on .Po and .Plo files under .deps/, which is
created by automake. but we've switched to CMake. so we cannot use
these depfile or temporary depfiles anymore.

Signed-off-by: Kefu Chai <kchai@redhat.com>

Merge PR #29034 into master

* refs/pull/29034/head:
doc/mgr/crash: document missing commands, options
qa/suites/rados/singleton/all/test-crash: whitelist RECENT_CRASH
qa/suites/rados/mgr/tasks/insights: whitelist RECENT_CRASH
qa/tasks/mgr/test_insights: crash module now rejects bad crash reports
mgr/telemetry: fix remote into crash do_ls()
mgr/crash: don't make these methods static
mgr/BaseMgrModule: handle unicode health detail strings
mgr/crash: verify timestamp is valid
qa/suites/mgr: whitelist RECENT_CRASH
mgr/crash: remove unused var
mgr/crash: remove unused import 'six'
qa/workunits/rados/test_crash: health check
mgr/crash: improve validation on post
mgr/crash: automatically prune old crashes after a year
mgr/crash: raise RECENT_CRASH warning for recent (new) crashes
mgr/crash: add 'crash ls-new'
mgr/crash: add option and serve infra
mgr/crash: keep copy of crashes in memory
mgr/pg_autoscaler: adjust style to match built-in tables
mgr/crash: make 'crash ls' a nice table with a NEW column
mgr/crash: nicely format 'crash info' output
mgr/crash: add 'crash archive <id>', 'crash archive-all' commands

Reviewed-by: Neha Ojha <nojha@redhat.com>

Merge pull request #26160 from linuxbox2/wip-rgw-lc-header

rgw: project and return lc expiration from GET/HEAD and PUT ops

qa/tests: added rgw into upgrade sequence to improve coverage - splits

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>

doc/mgr/crash: document missing commands, options

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #29234 from yuriw/wip-yuriw-upgrade-rwg-master

qa/tests: added rgw into upgrade sequence to improve coverage

Merge pull request #29263 from trociny/wip-rbd-external_callback

librbd: don't use complete_external_callback if ImageCtx destroyed

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

Merge PR #29180 into master

* refs/pull/29180/head:
mon/FSCommand: set pg_num_min via 'fs new', not in mgr/volumes
mon/FSCommands: set pg_autoscale_factor on 'fs new', not via mgr/volumes
mon: set recovery_priority=5 on fs metadata pool

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge PR #27575 into master

* refs/pull/27575/head:
osd: avoid prep_object_replica_pushes() on clone object when head missing

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #29261 from jan--f/add-auth-to-ghub-api-calls

script/ceph-backport-sh: add access_token parameter to all ghub api c…

Reviewed-by: Nathan Cutler <ncutler@suse.com>

Merge PR #29124 into master

* refs/pull/29124/head:
test/old/test*buffers.cc: remove tests against bufferlist
test/old/test_*seek_read: remove this test
test/old/test{crush,bucket}: remove stale tests
test/old/testmpi.cc: remove this test
test/old/testxattr.cc: remove this test
test/old/testtree.cc: remove test for BinaryTree

Reviewed-by: Sage Weil <sage@redhat.com>

script/ceph-backport-sh: add access_token parameter to all ghub api calls

Otherwise one can get a "API rate limit exceeded for $YOUR_IP." message
when working from company offices and such.

Signed-off-by: Jan Fajerski <jfajerski@suse.com>

librbd: don't use complete_external_callback if ImageCtx destroyed

complete_external_callback (which requires ImageCtx) is used to
prevent concurrent callbacks, and not needed in this particular case.

Signed-off-by: Mykola Golub <mgolub@suse.com>

Merge pull request #29148 from tchaikov/wip-cmake-python2

cmake: use python2 by default

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #28448 from shyukri/wip-25030

ceph-volume: util: Use proper param substition

Merge pull request #29073 from dillaman/wip-40790

mon/mgr: add 'rbd_support' to list of always-on mgr modules

Reviewed-by: Mykola Golub <mgolub@suse.com>

Merge pull request #28765 from myoungwon/fix-chunk-scrub-dedup-tool

src/tools/ceph-dedup-tool: Fix chunk scrub

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #28832 from majianpeng/osd-only-empty-do-wakeup

osd/OSD: only wake up empty pqueue.

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #28778 from myoungwon/wip-chunk-flush-op

src/osd: add tier-flush op

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #28983 from myoungwon/wip-dedup-io-test

src/test, qa/suites/rados/thrash: add dedup test

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #29053 from dmick/master

ceph-crash: use open(..,'rb') to read bytes for Python3

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #28054 from iotcg/starlingx

pybind: add verbose error message

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #26724 from jecluis/dev/wip-mon-osd-info

mon: add `ceph osd info` to obtain info on osds rather than parsing `osd dump`

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #28772 from neha-ojha/wip-40528-2

osd: add hdd, ssd and hybrid variants for osd_snap_trim_sleep

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: David Zafman <dzafman@redhat.com>

qa/tests: added rgw into upgrade sequence to improve coverage

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>

Merge pull request #29026 from markhpc/wip-rocksdb-v6.1.2

rocksdb: Updated to v6.1.2

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #29083 from dillaman/wip-40802

doc/rbd: update krbd version support for RBD features

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>

do_cmake.sh: specify the supported py versions for different distros

there is chance that a distro offer a newer python3 version than the
supported one, so we need to avoid using the latest python3 version by
specifying the supported python3

Signed-off-by: Kefu Chai <kchai@redhat.com>

cmake: use exact version of python if minor version is specified

`find_package(Python ${version}...)` tries to find the greater python version
which is greater than `${version}`, on fc30, at the time of writing, both
python3.8 and python3.7 are offered. but `python3-Cython` is packaged only
for python3.7. so if user installs python3.8, this will prevent user from
building Ceph. as Ceph will not be able to find Cython python module, as it
will try to run `python3.8 -m cython --version`, where python3.8 is the
greatest python version available in the system. but since cython module is
not available to python3.8, cmake will fail to find cython even if is available
to python3.7.

in this change, if user specifies a python version with minor version, we
will use the exact specified version instead of trying to use a version
greater than the specified one.

Signed-off-by: Kefu Chai <kchai@redhat.com>

Merge pull request #29152 from tchaikov/wip-cmake-crimson-test

test/crimson/: use 256M mem and 1 cpu core for each test

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

mon/FSCommand: set pg_num_min via 'fs new', not in mgr/volumes

Signed-off-by: Sage Weil <sage@redhat.com>

mon/FSCommands: set pg_autoscale_factor on 'fs new', not via mgr/volumes

Signed-off-by: Sage Weil <sage@redhat.com>

mon: set recovery_priority=5 on fs metadata pool

Signed-off-by: Sage Weil <sage@redhat.com>

Merge PR #29114 into master

* refs/pull/29114/head:
mgr/dashboard: qa: whitelist client eviction warning

Reviewed-by: Laura Paduano <lpaduano@suse.com>

Merge PR #29164 into master

* refs/pull/29164/head:
mgr: cleanup idle debug log at level 4.

Reviewed-by: Sage Weil <sage@redhat.com>

Merge PR #29172 into master

* refs/pull/29172/head:
mgr/dashboard: Fix dashboard health test failure

Reviewed-by: Sage Weil <sage@redhat.com>

Merge PR #29169 into master

* refs/pull/29169/head:
qa/suites/rados/mgr/tasks/module_selftest: whitelist mgr client getting backlisted

Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #26690 from jecluis/dev/wip-vstart-fix-rgw

vstart.sh: run multiple rgws with different ids

Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #29195 from ricardoasmarques/fix-ceph-iscsi-required-version

doc: Update 'ceph-iscsi' min version

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

doc/rbd: update krbd version support for RBD features

Fixes: http://tracker.ceph.com/issues/40802
Signed-off-by: Jason Dillaman <dillaman@redhat.com>

vstart.sh: run multiple rgws with different ids

We should expect being able to run multiple rgws with different ids
using vstart, and yet that was not the case as they were sharing the
same name (and same key).

We now mimic each rgw running on a different host, with ids being their
ports; as such, we'll have 'client.rgw.X', 'client.rgw.X+1', and so
forth. These will match the ports the daemons are running on.

Signed-off-by: Joao Eduardo Luis <joao@suse.com>

Merge pull request #29132 from votdev/issue_40829

mgr/dashboard: RGW User quota validation is not working correctly

Reviewed-by: Ricardo Marques <rimarques@suse.com>

doc: Update 'ceph-iscsi' min version

Signed-off-by: Ricardo Marques <rimarques@suse.com>

Merge pull request #28986 from sebastian-philipp/orchestrator-verify-certificate

pybind/mgr: Remove code duplication

Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>

Merge pull request #29184 from neha-ojha/wip-1731894

mon/OSDMonitor.cc: better error message about min_size

Merge pull request #29070 from adk3798/reformat

mgr/dashboard: Update formatting of e2e test files

Reviewed-by: Tiago Melo <tmelo@suse.com>

Merge pull request #29042 from sebastian-philipp/orchestrator-doc-disable

mgr/orchestrator: Fix disabling the orchestrator

Reviewed-by: Tim Serong <tserong@suse.com>

Merge pull request #29058 from tchaikov/wip-ceph-conf

tool/ceph-conf: s/global_pre_init()/global_init()/

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #29151 from tchaikov/wip-rgw-kill-gcc-warnings

rgw/rgw_crypt.cc: silence -Wsign-compare GCC warning

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

Merge pull request #29155 from tchaikov/wip-msg-cleanup

msg/Message: remove unused local variables

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>

mon/OSDMonitor.cc: better error message about min_size

Signed-off-by: Neha Ojha <nojha@redhat.com>

Merge pull request #29183 from gabriellasroman/patch-2

doc/dev/developer_guide: remove web address

Reviewed-by: Neha Ojha <nojha@redhat.com>

Merge PR #29136 into master

* refs/pull/29136/head:
Client: bump ll_ref from int32 to uint64_t

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge PR #29119 into master

* refs/pull/29119/head:
common: add ref header

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge PR #28686 into master

* refs/pull/28686/head:
mds: cleanup truncating inodes when standby replay mds trim log segments

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge PR #28628 into master

* refs/pull/28628/head:
pybind: Fixes print of path as byte object in error message
pybind: Print standard error messages

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge PR #28557 into master

* refs/pull/28557/head:
ceph_volume_client: don't convert None to str object
ceph_volume_client: convert string to bytes object
ceph_volume_client: make UTF-8 encoding explicit

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>

Merge PR #28447 into master

* refs/pull/28447/head:
cephfs-shell: Fix print of error messages to stdout

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge PR #22645 into master

* refs/pull/22645/head:
qa/tests: test if unresponsive MDS client with no caps is evicted directly
qa/tests: add a method to signal a MDS client
qa/cephfs: memoize FUSE client pid

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

doc/dev/developer_guide: remove web address

Removed http://pulpito.ovh.sepia.ceph.com:8081/
in "The nightlies" because it was unreachable

Signed-off-by: gabriellasroman <gsroman@bu.edu>

Merge PR #29121 into master

* refs/pull/29121/head:
qa/suites/rados/multimon: whitelist SLOW_OPS while thrashing mons

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: João Eduardo Luís <joao@suse.de>

qa/suites/rados/singleton/all/test-crash: whitelist RECENT_CRASH

Signed-off-by: Sage Weil <sage@redhat.com>

qa/suites/rados/mgr/tasks/insights: whitelist RECENT_CRASH

Signed-off-by: Sage Weil <sage@redhat.com>

Merge PR #29052 into master

* refs/pull/29052/head:
common/ceph_time: make operator<< for timespan less useless
include/encoding: fix encode/decode for signed durations
osd/osd_types: make pg_history_t operator<< more concise
osd: do not rebind heartbeat messengers on wrongly marked down
ceph_test_osd_stale_read: add StaleRead test
osd/PeeringState: restructure init_primary_up_acting a bit
msg/async: add ms_blackhole_$type options

Reviewed-by: Samuel Just <sjust@redhat.com>

Merge PR #29089 into master

* refs/pull/29089/head:
mon/MgrMonitor: fix null deref when invalid formatter is specified

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: João Eduardo Luís <joao@suse.de>

Merge PR #29093 into master

* refs/pull/29093/head:
osd: set collection pool opts on collection create, pg load

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge PR #29096 into master

* refs/pull/29096/head:
pybind/rados: put lens array in outer scope
pybind/rados: fix set_omap() crash on py3

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge PR #29109 into master

* refs/pull/29109/head:
qa/tasks/ceph_manager: wait for clean before asserting clean on minsize test

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge PR #29144 into master

* refs/pull/29144/head:
qa/tasks/ceph_manager: fix thrash_pg_upmap_items when no pools

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #29171 from smithfarm/wip-release-notes-14.2.2-take-two

doc: nautilus 14.2.2 release notes, take three

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>

Merge pull request #29165 from dillaman/wip-40865

cls: reduce log level for non-fatal errors

Reviewed-by: Mykola Golub <mgolub@suse.com>

Merge pull request #28988 from zhangsw/rgw-fix-bug-listobjectv2

rgw: continuation token doesn't work in list object v2 request.

doc/releases/nautilus.rst: fix typo in name

Signed-off-by: Nathan Cutler <ncutler@suse.com>

doc/releases/nautilus: add missing PRs to 14.2.2

Signed-off-by: Nathan Cutler <ncutler@suse.com>

doc: release/nautilus.rst: drop stray "b'" strings

The ceph-release-notes script renders strings as bytes and these get exported
as b'<str>'. . . the script needs some more work to play nicely with Python 3.

Signed-off-by: Nathan Cutler <ncutler@suse.com>

mgr/dashboard: Fix dashboard health test failure

Fixes: https://tracker.ceph.com/issues/40869
Signed-off-by: Ricardo Marques <rimarques@suse.com>

Revert "doc/release/nautilus: 14.2.2 changes redone"

This reverts commit 7962a36849b91a3a11fa8a2fe90238b101868c7d.

Signed-off-by: Nathan Cutler <ncutler@suse.com>

qa/suites/rados/mgr/tasks/module_selftest: whitelist mgr client getting backlisted

The mgr's libcephfs client gets evicted after the mgr fails over.
Whitelist the message.

Fixes: http://tracker.ceph.com/issues/40867
Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #27420 from pooja-gautam/wip-dashboard-progress-bar

mgr/dashboard Displays progress bar in notification tray for background tasks

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>

qa/mgr/progress: Update the test suite for progress module

Update the test suite to reflect a feature
change that has been merged to master in
progress module where you create an event
when an osd is marked in.

Fixes: http://tracker.ceph.com/issues/40618
with success QA run in sepia:
http://pulpito.ceph.com/kchai-2019-07-16_10:10:01-rados-master-distro-basic-mira/

Signed-off-by: Kamoltat (Junior) Sirivadhna <ksirivad@redhat.com>

Merge pull request #29135 from dillaman/wip-40486

doc/rbd: re-organize top-level and add live-migration docs

Reviewed-by: Mykola Golub <mgolub@suse.com>

cls/journal: reduce verbosity of debug logs for non-errors

Fixes: http://tracker.ceph.com/issues/40865
Signed-off-by: Jason Dillaman <dillaman@redhat.com>

cls/rbd: reduce verbosity of debug logs for non-errors

Fixes: http://tracker.ceph.com/issues/40865
Signed-off-by: Jason Dillaman <dillaman@redhat.com>

mgr/dashboard: Update formatting for dashboard e2e test files

Fixes: https://tracker.ceph.com/issues/40789
Signed-off-by: Adam King <adking@redhat.com>
Signed-off-by: Rafael Quintero <rquinter@redhat.com>

mgr/dashboard Displays progress bar in notification tray

Signed-off-by: Pooja <pooja.gautam@ts.fujitsu.com>

mgr: cleanup idle debug log at level 4.

Changed all messages to 10 that are printed repeatedly in an idle cluster.

This makes debugging Python modules easier as the log
is no longer pullued by mgr core messages.

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>

doc/rbd: initial live-migration documentation

Fixes: http://tracker.ceph.com/issues/40486
Signed-off-by: Jason Dillaman <dillaman@redhat.com>

mgr/dashboard: RGW User quota validation is not working correctly

Fixes: https://tracker.ceph.com/issues/40829
Signed-off-by: Volker Theile <vtheile@suse.com>