More commits to the landing page project.

Signed-off-by: Zac Dover <zac.dover@gmail.com>

doc: Added the crisp getting started guide to index.rst

This commit adds the 3-node getting started procedure to the
doc/index.rst file and represents the first large action taken
toward making the Ceph documentation more user-friendly and more
comprehensible to readers who have never used Ceph before.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
Added jdurgin's notes.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
Removed "podman" per jdurgin's direction.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
changed a path from sdb1 to /by-id/[long string]w

Signed-off-by: Zac Dover <zac.dover@gmail.com>
changed the command for copying the keyring and the conf file, per jdurgin

Signed-off-by: Zac Dover <zac.dover@gmail.com>

Merge PR #32522 into master

* refs/pull/32522/head:
doc/cephfs: improve wording in mount-prerequisites.rst
doc: migrate best practices recommendations to relevant docs
doc/cephfs: rename doc/cephfs/kernel.rst & doc/cephfs/fuse.rst

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge PR #32763 into master

* refs/pull/32763/head:
qa: build v5.4 kernel

Reviewed-by: Jeff Layton <jlayton@redhat.com>

Merge PR #32762 into master

* refs/pull/32762/head:
doc/cephfs/client-auth: description and example are inconsistent

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge PR #32739 into master

* refs/pull/32739/head:
qa: log warning on scrub error

Reviewed-by: Neha Ojha <nojha@redhat.com>

qa: build v5.4 kernel

CentOS8 userspace cannot build v4.17 kernel anymore. See also [1].

[1] https://lkml.org/lkml/2019/4/23/517

Fixes: https://tracker.ceph.com/issues/43719
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #32761 from alimaredia/wip-rgw-verify-os-version-8.0

qa: pin rgw/verify to 8.0

doc/cephfs/client-auth: description and example are inconsistent

According to the path restriction example, the filesystem name
should be cephfs_a, not cephfs.  Converge on cephfs_a to avoid it
being confused with with the pool tag, which is always cephfs.

This was introduced in 160c4bfeb811 ("mon/AuthMonitor: Use new osd
auth caps for ceph fs authorize").

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>

qa: pin rgw/verify to 8.0

Signed-off-by: Ali Maredia <amaredia@redhat.com>

Merge PR #32748 into master

* refs/pull/32748/head:
doc: minor fix in mount.ceph

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #32751 from tchaikov/wip-readme-cmake

README.md: remove stale cmake prerequisite

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-By: Casey Bodley <cbodley@redhat.com>

README.md: remove stale cmake prerequisite

it's stale. as we now require 3.10 after dropping the support of xenial.

and it's incomplete, we have a ton of build dependencies apart from
cmake.

Signed-off-by: Kefu Chai <kchai@redhat.com>

Merge pull request #32655 from jan--f/c-v-mock-has_bluestore_label

ceph-volume: fix device unittest, mock has_bluestore_label

Merge PR #32738 into master

* refs/pull/32738/head:
qa/standalone/misc/ok-to-stop: improve test
qa/standalone/ceph-helpers: add wait_for_peered

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #32740 from cbodley/wip-rgw-doc-s3-extension-url

doc/rgw: fix broken link to boto s3 extensions document

Reviewed-by: Yuval Lifshitz <yuvalif@yahoo.com>

Merge pull request #32742 from tchaikov/wip-crimson-thread-pool

crimson/thread: generalize Task so it works w/ func returns void

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

ceph-volume: fix device unittest, mock has_bluestore_label, lint

This also adds a test case for has_bluestore_label.

Fixes: https://tracker.ceph.com/issues/43611
Signed-off-by: Jan Fajerski <jfajerski@suse.com>

doc: minor fix in mount.ceph

Also, fix the indentation since we are already here.

Fixes: https://tracker.ceph.com/issues/43743
Signed-off-by: Rishabh Dave <ridave@redhat.com>

crimson/thread: generalize Task so it works w/ func returns void

Signed-off-by: Kefu Chai <kchai@redhat.com>

mgr/dashboard: Fix modals for Identifying Device and Editing O… (#32589)

mgr/dashboard: Fix modals for Identifying Device and Editing OSD

Reviewed-by: Kiefer Chang <kiefer.chang@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>

mgr/dashboard: Introduce layout components (#32594)

mgr/dashboard: Introduce layout components

Reviewed-by: Sebastian Krah <skrah@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>

doc/cephfs: improve wording in mount-prerequisites.rst

Signed-off-by: Rishabh Dave <ridave@redhat.com>

doc: migrate best practices recommendations to relevant docs

Also, move the common part from "Mount using FUSE" doc and "Mount using
kernel" doc to "Mount CephFS" page to avoid repetitions.

Fixes: https://tracker.ceph.com/issues/43154
Signed-off-by: Rishabh Dave <ridave@redhat.com>

Merge PR #32725 into master

* refs/pull/32725/head:
qa/tasks/ceph_manager: fix revive_osd path
qa/tasks/ceph_manager: fix shell osd for ceph-objectstore-tool commands

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge PR #32737 into master

* refs/pull/32737/head:
qa/tasks/ceph_manager: fix post-osd-kill pg peered check

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge PR #32631 into master

* refs/pull/32631/head:
doc: add mds map to list of monitor assets

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge PR #32642 into master

* refs/pull/32642/head:
qa: save MDS epoch barrier
qa: prefer rank_asok

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge PR #32667 into master

* refs/pull/32667/head:
mds: track high water mark for purges
qa: use correct variable for exception debug
mds: mark purge queue protected members private

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

qa: save MDS epoch barrier

Rather than verify the latest OSDMap is the same as the rank's
osdmap_epoch_barrier, just use the rank's version. The OSDMap may change
out-of-band with the test startup and thus the epoch's would diverge.
The file system and rank is fresh for each test so there's no reason to
care if the MDS barrier is one epoch behind the latest.

Fixes: https://tracker.ceph.com/issues/43554
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>

qa: prefer rank_asok

This is a trivial refactor.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #32629 from tchaikov/wip-cephfs.pyx

libcephfs: add missing declaration of ceph_getaddrs()

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

mds: track high water mark for purges

This makes the corresponding test not racy.

Fixes: https://tracker.ceph.com/issues/16881
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>

qa: use correct variable for exception debug

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>

mds: mark purge queue protected members private

Nothing inherits from PQ.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>

doc/rgw: fix broken link to boto s3 extensions document

Signed-off-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #32652 from rhcs-dashboard/fix-43607-master

mgr/dashboard: fix improper URL checking

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Ricardo Dias <rdias@suse.com>

qa/standalone/misc/ok-to-stop: improve test

Make sure PGs peer (simply flushing state to mon isn't enough).

Fixes: https://tracker.ceph.com/issues/43721
Signed-off-by: Sage Weil <sage@redhat.com>

qa: log warning on scrub error

Instead of printing the (useless) traceback, just print a warning about
ignoring the failure. The traceback makes it harder to search for the
real problem in the teuthology log.

Fixes: https://tracker.ceph.com/issues/43718
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>

qa/standalone/ceph-helpers: add wait_for_peered

Signed-off-by: Sage Weil <sage@redhat.com>

Merge PR #32524 into master

* refs/pull/32524/head:
qa/xfstests_dev: change deps for xfstests-dev on ubuntu
qa/cephfs: change deps for xfstests-dev on centos8
vstart_runnner: add sh method to LocalRemote

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge PR #32637 into master

* refs/pull/32637/head:
client: Add is_dir check before changing directory

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>

Merge PR #32676 into master

* refs/pull/32676/head:
mds: don't respond getattr with -EROFS when mds is readonly

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge PR #32639 into master

* refs/pull/32639/head:
qa: rename kcephfs distro overrides

Reviewed-by: Rishabh Dave <ridave@redhat.com>

Merge PR #32696 into master

* refs/pull/32696/head:
mgr/volumes: fail removing subvolume with snapshots

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge PR #32645 into master

* refs/pull/32645/head:
mgr/volumes: remove stale subvolume module

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge PR #32659 into master

* refs/pull/32659/head:
mds: do not include metric_spec in MClientSession from MDS

Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Sidharth Anupkrishnan <sanupkri@redhat.com>

Merge PR #32709 into master

* refs/pull/32709/head:
mds/FSMap: fix adjust_standby_fscid

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #32727 from liewegas/fix-rgw-os

qa/suite/rgw/verify: valgrind on centos again!

qa/tasks/ceph_manager: fix revive_osd path

This was broken since it was introduced in b02e2f6cf2feb2711d4c867bf08c914b85715bb6
a year and a half ago...

Signed-off-by: Sage Weil <sage@redhat.com>

Merge PR #32668 into master

* refs/pull/32668/head:
qa: ignore slow ops for ffsb workunit

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #32723 from yuvalif/wip-yuval-notif-add-opaque-data

rgw/notification: add opaque data

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>

qa/tasks/ceph_manager: fix post-osd-kill pg peered check

This was asserting that all PGs are active or peered, but that assertion
could fail if the concurrent workload created a new pool.

Switch to a loop that checks several times for the condition to be true.

Fixes: https://tracker.ceph.com/issues/43656
Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #32565 from rhcs-dashboard/43534-decouple-backend-unit-tests

mgr/dashboard: decouple backend unit tests from build.

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>

Merge PR #32592 into master

* refs/pull/32592/head:
mgr/pg_autoscaler: calculate pool_pg_target using pool size

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

mgr/dashboard: Update npm package caniuse-lite (#32633)

mgr/dashboard: Update npm package caniuse-lite

Reviewed-by: Tiago Melo <tmelo@suse.com>

Merge pull request #32702 from rzarzynski/wip-bug-43646

common/bl: fix the dangling last_p issue.

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #32325 from Kriechi/fix-42982

monitoring: fix prometheus alert for full pools

mgr/dashboard: Cleanup router config

Now that a parent component takes care about the rendering of the workbench, then this componenta can also take care about the authentication check.

Signed-off-by: Volker Theile <vtheile@suse.com>

mgr/dashboard: Introduce layout components

This PR will simplify the code of the app component in that way that it introduces layout components. Depending on the route a specific layout is choosen. Currently there are two layouts:

- Workbench
- Blank

The blank layout, which does not show any navigation controls, is used for the error, login and logout pages. The workbench layout shows the navigation controls and is mainly used for all pages that are used to configure Ceph.

The 403 and 404 pages have a 'Back' button that will redirect to /login. The Angular router will redirect to /dashboard if logged in.

Fixes: https://tracker.ceph.com/issues/43565
Signed-off-by: Volker Theile <vtheile@suse.com>

doc/cephfs: rename doc/cephfs/kernel.rst & doc/cephfs/fuse.rst

Rename to mount-using-kernel.rst and mount-using-fuse.rst respectively
so that it's easier to find them in doc/cephfs directory.

Signed-off-by: Rishabh Dave <ridave@redhat.com>

Merge pull request #32692 from tchaikov/wip-remove-btree-dump

include/cpp-btree: drop btree::dump()

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>

qa/suite/rgw/verify: valgrind on centos again!

Signed-off-by: Sage Weil <sage@redhat.com>

Merge PR #32724 into master

* refs/pull/32724/head:
qa/workunits/rados/test_crash.sh: suppress core files

Reviewed-by: Kefu Chai <kchai@redhat.com>

qa/workunits/rados/test_crash.sh: suppress core files

The cores will make teuthology fail the job--and we don't want them for
this test, where we are deliberately causing crashes.

Fixes: https://tracker.ceph.com/issues/43653
Signed-off-by: Sage Weil <sage@redhat.com>

qa/tasks/ceph_manager: fix shell osd for ceph-objectstore-tool commands

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #32684 from dillaman/wip-rbd-el8

tests: corrected issues with RBD tests under EL8 distros

Reviewed-by: Mykola Golub <mgolub@suse.com>

Merge PR #32681 into master

* refs/pull/32681/head:
mgr/cephadm: fix section name for mon options in ceph.conf

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge PR #32006 into master

* refs/pull/32006/head:
mgr/cephadm: revert to OrchestratorClientMixin child
mgr/cephadm: initial upgrade logic
cephadm: return 'cephadm pull' result as JSON
mgr/cephadm: upgrade start/stop/pause/resume
mgr/cephadm: track ceph version as well as container in on 'upgrade check'
mgr/orchestrator_cli: upgrade {start,pause,resume,stop}
mgr/cephadm: fix upgrade check
mon/ConfigKeyService: remove config-key set warning

Reviewed-by: Sebastian Wagner <swagner@suse.com>

Merge PR #32685 into master

* refs/pull/32685/head:
cephadm: remove -crash container before starting it
cephadm: stop the crash container the nice way
cephadm: no need for podman rm when passing --rm to run
ceph-crash: exit code 0 on SIGINT, SIGTERM

Reviewed-by: Michael Fritch <mfritch@suse.com>

Merge pull request #32720 from tchaikov/wip-disable-crimson-socket-test

test/crimson: remove unittest_seastar_socket temporarily

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

rgw/notification: add opaque data

opaque data may be set in topic configuration and later on sent inside
nottifications triggered by that topic.

Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>

Merge pull request #32687 from dillaman/wip-42097

librbd: support compression allocation hints to the OSD

Reviewed-by: Mykola Golub <mgolub@suse.com>

Merge pull request #32671 from dillaman/wip-43537

rbd-mirror: periodically poll remote mirror configuration

Reviewed-by: Mykola Golub <mgolub@suse.com>

test/crimson: remove unittest_seastar_socket temporarily

see also #32632. before we have the complete fix, we should disable this
test to avoid more noise from this test.

Signed-off-by: Kefu Chai <kchai@redhat.com>

Merge pull request #32719 from liewegas/wip-o-upgrades

qa/suites/upgrade: fix mimic-x-singleton

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge PR #32673 into master

* refs/pull/32673/head:
crush/CrushWrapper: behave with empty weight vector
cmake: no need to link libglobal and libblkid for testing crush
test/crush: no need to use libglobal for testing crush

Reviewed-by: Sage Weil <sage@redhat.com>

Merge PR #32439 into master

* refs/pull/32439/head:
test/kv_store_bench: Fix double free error

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge PR #32640 into master

* refs/pull/32640/head:
cephadm: fix help message for bootstrap --mgr-id

Reviewed-by: Michael Fritch <mfritch@suse.com>

Merge PR #32627 into master

* refs/pull/32627/head:
test_cephadm: use container shell for ceph cmds
test_cephadm: `-d` debug no longer exists
test_cephadm: clean-up whitespace (tabs -> spaces)

Reviewed-by: Sage Weil <sage@redhat.com>

Merge PR #32628 into master

* refs/pull/32628/head:
test: Fix wait_for_state() to wait for a PG to get into a state

Reviewed-by: Neha Ojha <nojha@redhat.com>

Merge PR #32385 into master

* refs/pull/32385/head:
mgr/cephadm: check-host on 'host add'

Reviewed-by: Sebastian Wagner <swagner@suse.com>

Merge PR #32712 into master

* refs/pull/32712/head:
cephadm: SO_REUSEADDR when doing bind check

Reviewed-by: Michael Fritch <mfritch@suse.com>

Merge PR #32711 into master

* refs/pull/32711/head:
qa/standalone/mon/osd-create-pool: fix utf-8 grep LANG

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge PR #32641 into master

* refs/pull/32641/head:
cephadm: fix logging defaults

Reviewed-by: Michael Fritch <mfritch@suse.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge PR #32700 into master

* refs/pull/32700/head:
rpm: Relax the selinux policy version for centos builds

Reviewed-by: Sage Weil <sage@redhat.com>

Merge PR #32560 into master

* refs/pull/32560/head:
cephadm: show contextual message when port is in use

Reviewed-by: Sebastian Wagner <swagner@suse.com>

qa/xfstests_dev: change deps for xfstests-dev on ubuntu

Rename python to python2 if Ubuntu distro release is 19 or later.

Fixes: https://tracker.ceph.com/issues/43522
Signed-off-by: Rishabh Dave <ridave@redhat.com>

Merge PR #32713 into master

* refs/pull/32713/head:
qa/tasks/cephadm: start watching initial daemons before bootstrap
qa/tasks/cephadm: create /etc/ceph if it doesn't exist
qa/tasks/cephadm: fix log whitelist when there is no whitelist

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge PR #32701 into master

* refs/pull/32701/head:
qa/tasks/ceph_manager: fix ceph-objectstore-tool calls
qa/tasks/ceph_manager: fix admin_socket remote when using cephadm
qa/tasks/ceph_manager: --no-mon-config to ceph-objectstore-tool
qa/tasks/ceph_manager: fix filestore split command
qa/tasks/ceph_manager: fix import line

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

qa/releases/octopus: disable autoscale warnings

Existing pools might have too many/few PGs and produce a warning that
prevents us from getting to HEALTH_OK.

Signed-off-by: Sage Weil <sage@redhat.com>

cephadm: SO_REUSEADDR when doing bind check

This is what the ceph daemons use; our check should do it too.

Signed-off-by: Sage Weil <sage@redhat.com>

qa/tasks/ceph_manager: fix ceph-objectstore-tool calls

Pass the correct paths based on whether this is the importing or exporting
OSD.

Signed-off-by: Sage Weil <sage@redhat.com>

qa/tasks/ceph_manager: fix admin_socket remote when using cephadm

Signed-off-by: Sage Weil <sage@redhat.com>

qa/tasks/ceph_manager: --no-mon-config to ceph-objectstore-tool

The config is currently fetched at osd.admin, so the keyring is not
found.

Signed-off-by: Sage Weil <sage@redhat.com>

qa/tasks/ceph_manager: fix filestore split command

Signed-off-by: Sage Weil <sage@redhat.com>

qa/tasks/ceph_manager: fix import line

Signed-off-by: Sage Weil <sage@redhat.com>

qa/tasks/cephadm: start watching initial daemons before bootstrap

This lets us see output while bootstrap is happening.

(Depends on the teuthology change to use journalctl, see
teuthology commit 4fa83040b05b604280789459f095d6f2ad1b0d01.)

Signed-off-by: Sage Weil <sage@redhat.com>

qa/tasks/cephadm: create /etc/ceph if it doesn't exist

Signed-off-by: Sage Weil <sage@redhat.com>

qa/tasks/cephadm: fix log whitelist when there is no whitelist

Signed-off-by: Sage Weil <sage@redhat.com>