mgr/dashboard: add create functionality to the frontend

Add the missing functionality to create config options and related
tests to the frontend.

Fixes: http://tracker.ceph.com/issues/24455
Signed-off-by: Tatjana Dehler <tdehler@suse.com>

mgr/dashboard: add missing parameter type and related test

Added missing parameter type and a test for this service method.

Signed-off-by: Tatjana Dehler <tdehler@suse.com>

mgr/dashboard: add config options form

Fixes: http://tracker.ceph.com/issues/24455
Signed-off-by: Tatjana Dehler <tdehler@suse.com>

mgr/dashboard: add pattern validators

Add some pattern validators (ip, uuid, number, decimalNumber) that
are needed to validate the config option input values.

Fixes: http://tracker.ceph.com/issues/24455
Signed-off-by: Tatjana Dehler <tdehler@suse.com>

mgr/dashboard: add placeholder for filters to datatable

As (e.g.) the configuration option documentation has dropdown menus
with pre-defined filters we need a placeholder for them in the
datatable.

Signed-off-by: Tatjana Dehler <tdehler@suse.com>

mgr/dashboard: move config table details to their own component

Fixes: http://tracker.ceph.com/issues/24455
Signed-off-by: Tatjana Dehler <tdehler@suse.com>

mgr/dashboard: add backend method to create config options

Fixes: http://tracker.ceph.com/issues/24455
Signed-off-by: Tatjana Dehler <tdehler@suse.com>

mgr/dashboard: fix typo

Signed-off-by: Tatjana Dehler <tdehler@suse.com>

mgr/dashboard: fix missing import

Added the missing import otherwise the 'should create' test will fail
because the received component is undefined.

Signed-off-by: Tatjana Dehler <tdehler@suse.com>

mgr/dashboard: refactor '_get_mon_allow_pool_delete_config'

Refactor '_get_mon_allow_pool_delete_config' method to be a little bit
more general. The method can now be used to get the value of every
config option known to the cluster.

Signed-off-by: Tatjana Dehler <tdehler@suse.com>

Merge pull request #23666 from rhcs-dashboard/grafana-integration

mgr/dashboard: Grafana graphs integration with dashboard

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>

Merge pull request #24457 from trociny/wip-qa-cli-namespace

qa/workunits/rbd: fix cli generic namespace test

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #24460 from falcon78921/wip-doc-36336

doc: updated cluster map reference link

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #24369 from p-na/fix-osd-error

mgr/dashboard: Fix error when clicking on newly created OSD

Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>

mgr/dashboard: Adds dynamic documentation link

Fixes: https://tracker.ceph.com/issues/24999
Signed-off-by: Kanika Murarka <kmurarka@redhat.com>

Merge pull request #24326 from rhcs-dashboard/27050-landing-page-milestone-2

mgr/dashboard: New Landing Page: Milestone 2

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>

mgr/dashboard: Fix errors when clicking on new OSD

Fixes: http://tracker.ceph.com/issues/36245
Signed-off-by: Patrick Nawracay <pnawracay@suse.com>

mgr/dashboard: Add type hints to QA helper

Signed-off-by: Patrick Nawracay <pnawracay@suse.com>

Merge pull request #24462 from falcon78921/wip-doc-36339

doc: updated crush map tunables link

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #24416 from noahdesu/doc-req-no-clone

doc: install build-doc deps without git clone

Reviewed-by: Kefu Chai <kchai@redhat.com>

doc: updated crush map tunables link

Updated crush map tunables link in rados/configuration/mon-config-ref.rst
Fixes: https://tracker.ceph.com/issues/36339
Signed-off-by: James McClune <jmcclune@mcclunetechnologies.net>

doc: updated cluster map reference link

Updated cluster map reference link in rados/troubleshooting/troubleshooting-mon.rst
Fixes: https://tracker.ceph.com/issues/36336
Signed-off-by: James McClune <jmcclune@mcclunetechnologies.net>

qa/workunits/rbd: fix cli generic namespace test

expect_fail incorrectly unset '-e' option and if a consequent test
failed it did not abort the execution. And two typos in the namespace
tests were not detected due to this.

Signed-off-by: Mykola Golub <mgolub@suse.com>

Merge PR #24437 into master

* refs/pull/24437/head:
PendingReleaseNotes: add note for mds drop cache

Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #24444 from theanalyst/wip-reshard-stats

rgw: copy actual stats from the source shards during reshard

Merge pull request #23504 from pritha-srivastava/wip-sts-authentication

rgw: Code for STS Authentication.

rgw: copy actual stats from the source shards during reshard

Currently we don't copy the actual_stats field during reshard, which makes
resharded buckets show a size_utilized as 0, which further has the problem that
a subsequent object removal would subtract the object size from the 0 size
utilized showing up large uint64_t values. Copy the size_actual from the source
object in both cls and in reshard_process. This will fix the new buckets,
existing buckets will still have to go through a bucket check --fix for their
stats to be corrected.

Fixes: http://tracker.ceph.com/issues/36290
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>

Merge pull request #24433 from dillaman/wip-rbd-mirror-doc

doc/rbd: explicitly state that mirroring requires connectivity to clusters

Reviewed-by: Mykola Golub <mgolub@suse.com>

Merge pull request #24144 from tchaikov/wip-spdk

bluestore/NVMe: use PCIe selector as the path name

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #24168 from tchaikov/wip-17516

cmake: detect armv8 crc and crypto feature using CHECK_C_COMPILER_FLAG

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #24322 from votdev/improve_error_interceptor

mgr/dashboard: Improve error message handling

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>

PendingReleaseNotes: add note for mds drop cache

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>

doc/rbd: explicitly state that mirroring requires connectivity to cluster

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

mgr/dashboard: Reverse proxy changes

Fixes: https://tracker.ceph.com/issues/24999
Signed-off-by: Kanika Murarka <kmurarka@redhat.com>

mgr/dashboard: Updates documentation

Fixes: https://tracker.ceph.com/issues/24999
Signed-off-by: Kanika Murarka <kmurarka@redhat.com>

mgr/dashboard: Adding Grafana componenets to views

Fixes: https://tracker.ceph.com/issues/24999
Signed-off-by: Kanika Murarka <kmurarka@redhat.com>

mgr/dashboard: Adding grafana component and backend changes

Fixes: https://tracker.ceph.com/issues/24999
Signed-off-by: Kanika Murarka <kmurarka@redhat.com>

Merge pull request #24370 from tspmelo/fix-rbd-trash-purge

mgr/dashboard: Add permission validation to the  "Purge Trash" button

Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>

Merge pull request #24271 from croit/fix-36041

rgw/beast: drop privileges after binding ports

Reviewed-by: Casey Bodley <cbodley@redhat.com>

mgr/dashboard: Improve error message handling

The current implementation of the HTTP interceptor does not use the error description in all cases.

Fixes: https://tracker.ceph.com/issues/36190
Signed-off-by: Volker Theile <vtheile@suse.com>

mgr/dashboard: New Landing Page: Milestone 2

Reduced space between info group title and cards (PR review suggestion).

Fixes: https://tracker.ceph.com/issues/27050
Signed-off-by: Alfonso Martínez <almartin@redhat.com>

Merge pull request #24350 from ricardoasmarques/wip-json-decode

mgr/dashboard: Check content-type before decode json response

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Ricardo Dias <rdias@suse.com>

Merge pull request #24213 from familyuu/mgr

mgr/dashboard: Display logged in user

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>

Merge pull request #20645 from rishabh-d-dave/fix-doc-add-subcommand-application-manpages

ceph: describe application subcommand in ceph man page

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #24117 from trociny/wip-35915

mgr: create shell OSD performance query class

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: John Spray <john.spray@redhat.com>

doc: install build-doc deps without git clone

With `-e` the repository is cloned, leading to `git clean` skipping
the cloned dependencies due to the `.git` directory, and forcing manual
removal.

[nwatkins@daq ceph]$ git clean -dxf
Skipping repository build-doc/virtualenv/src/breathe
Skipping repository build-doc/virtualenv/src/sphinx-ditaa

Signed-off-by: Noah Watkins <nwatkins@redhat.com>

mgr: module to test osd_perf_query methods

Signed-off-by: Mykola Golub <mgolub@suse.com>

mgr: add osd_perf_query methods to ActivePyModules

Signed-off-by: Mykola Golub <mgolub@suse.com>

mgr: create shell OSD performance query class

Signed-off-by: Mykola Golub <mgolub@suse.com>

Merge pull request #24380 from smithfarm/wip-opensuse-15

qa/distros: add openSUSE Leap 42.3 and 15.0

Reviewed-by: Yuri Weinstein <yweins@redhat.com>

Merge pull request #24399 from alfredodeza/wip-rm36246

ceph-volume util.encryption don't push stderr to terminal

Reviewed-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #24394 from alfredodeza/wip-rm24795

ceph-volume lvm.prepare update help to indicate partitions are needed, not devices

Reviewed-by: Andrew Schoen <aschoen@redhat.com>

rgw/beast: drop privileges after binding ports

Fixes: http://tracker.ceph.com/issues/36041
Signed-off-by: Paul Emmerich <paul.emmerich@croit.io>

ceph: describe application subcommand in ceph man page

Add the summary and syntax for all the subcommands under the subcommand
"ceph osd pool application" to ceph the manual page.

Signed-off-by: Rishabh Dave <ridave@redhat.com>

ceph-volume util.encryption don't push stderr to terminal when cryptsetup fails to find device

Signed-off-by: Alfredo Deza <adeza@redhat.com>

mgr/dashboard: New Landing Page: Milestone 2

Added tests for Health component to ensure that

all groups and cards are rendered.

Fixes: https://tracker.ceph.com/issues/27050
Signed-off-by: Alfonso Martínez <almartin@redhat.com>

mgr/dashboard: New Landing Page: Milestone 2

Added tests for InfoCard & InfoGroup components.

Fixes: https://tracker.ceph.com/issues/27050
Signed-off-by: Alfonso Martínez <almartin@redhat.com>

mgr/dashboard: New Landing Page: Milestone 2

CSS refactor: move color to defaults.scss

Fixes: https://tracker.ceph.com/issues/27050
Signed-off-by: Alfonso Martínez <almartin@redhat.com>

mgr/dashboard: New Landing Page: Milestone 2

Set same font-size for all cards (updated OSD card font size).

Fixes: https://tracker.ceph.com/issues/27050
Signed-off-by: Alfonso Martínez <almartin@redhat.com>

mgr/dashboard: New Landing Page: Milestone 2

Fix: hide 'cluser status' popover when status change to OK.

Fixes: https://tracker.ceph.com/issues/27050
Signed-off-by: Alfonso Martínez <almartin@redhat.com>

mgr/dashboard: New Landing Page: Milestone 2

Info Card fluid font size: set max width to 2K.

Fixes: https://tracker.ceph.com/issues/27050
Signed-off-by: Alfonso Martínez <almartin@redhat.com>

mgr/dashboard: New Landing Page: Milestone 2

Cluster Status card: added style for clickable element

with mouse hover behaviour.

CSS refactor and cleanup.

Fixes: https://tracker.ceph.com/issues/27050
Signed-off-by: Alfonso Martínez <almartin@redhat.com>

mgr/dashboard: New Landing Page: Milestone 2

Fix: cluster status popover on top (it was under another card).

CSS adjustments.

Fixes: https://tracker.ceph.com/issues/27050
Signed-off-by: Alfonso Martínez <almartin@redhat.com>

mgr/dashboard: New Landing Page: Milestone 2

Improve medium size cards layout for 1366x768 (HD resolution).

Fixes: https://tracker.ceph.com/issues/27050
Signed-off-by: Alfonso Martínez <almartin@redhat.com>

mgr/dashboard: New Landing Page: Milestone 2

Changed navigation menu dropdown arrows' color to white.

All cards (except logs) viewable at-a-glance in Full HD presentation mode.

CSS adjustments, refactor and cleanup.

Fixes: https://tracker.ceph.com/issues/27050
Signed-off-by: Alfonso Martínez <almartin@redhat.com>

mgr/dashboard: New Landing Page: Milestone 2

Changed background color to gray.

Changed cards' background color to white.

Changed card font size to fluid: from 12px to 21px.

Info Group Title: fixed font size 21px, removed underline..

CSS Flexbox layout for  perf. and capacity cards.

CSS adjustments, refactor and cleanup.

Fixes: https://tracker.ceph.com/issues/27050
Signed-off-by: Alfonso Martínez <almartin@redhat.com>

mgr/dashboard: Landing Page Milestone 2

OSD card:

Break info in 2/3 lines for huge OSDs amount.

Fixes: https://tracker.ceph.com/issues/27050
Signed-off-by: Alfonso Martínez <almartin@redhat.com>

ceph-volume lvm.prepare update help to indicate partitions are needed, not devices

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #24348 from trociny/wip-config-pool-mirror

 rbd-mirror: use pool level config overrides

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

mgr/dashboard: Delete white space beform 'Sign'

Signed-off-by: guodan <guodan1@lenovo.com>

mgr/dashboard: Delete the old logout component

Signed-off-by: guodan1 <guodan1@lenovo.com>

mgr/dashboard: Display logged in user

Signed-off-by: guodan1 <guodan1@lenovo.com>

Merge PR #24367 into master

* refs/pull/24367/head:
doc: Fix typo error on cephfs/fuse/

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge PR #24362 into master

* refs/pull/24362/head:
doc: fix broken fstab url in cephfs/fuse

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #24276 from dillaman/wip-36183

osdc/Objecter: possible race condition with connection reset

Reviewed-by: Greg Farnum gfarnum@redhat.com

Merge pull request #24262 from cernceph/dvanders_creating

osd: add creating to pg_string_state

Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>

Merge pull request #24304 from tchaikov/wip-monclient-remove-unused-label

mon/MonClient: use scoped_guard instead of goto

Reviewed-by: Neha Ojha <nojha@redhat.com>

Merge pull request #24372 from alfredodeza/wip-rm36247

ceph-volume: skip processing devices that don't exist when scanning system disks

Reviewed-by: Andrew Schoen <aschoen@redhat.com>

qa/distros: add openSUSE Leap 42.3 and 15.0

References: https://tracker.ceph.com/issues/35927
Signed-off-by: Nathan Cutler <ncutler@suse.com>

Merge pull request #24180 from colletj/wip-35914-mmgrconfigure-osd-query

mgr: update MMgrConfigure message to include optional OSD perf queries

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

mgr: add optional OSD perf queries to MMgrConfigure message

Fixes: https://tracker.ceph.com/issues/35914
Signed-off-by: Julien Collet <julien.collet@cern.ch>

ceph-volume util.disk when there are no devices mapped, skip to the next one

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ceph-volume tests.util verify devices that don't exist don't break get_devices

Signed-off-by: Alfredo Deza <adeza@redhat.com>

mgr/dashboard: Add permission validation to the  "Purge Trash" button

Added missing permission validations in the RBD Trash endpoints.

Fixes: http://tracker.ceph.com/issues/36272
Signed-off-by: Tiago Melo <tmelo@suse.com>

Merge pull request #24349 from ricardoasmarques/wip-ex-message-py3

mgr/dashboard: Exception.message doesn't exist on Python 3

Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>

doc: Fix typo error on cephfs/fuse/

Fixes: http://tracker.ceph.com/issues/36180
Signed-off-by: Karun Josy <kjosy@redhat.com>

Merge pull request #24266 from theanalyst/doc/releases/13.2.2

doc: release notes for 13.2.2 mimic

Reviewed-By: Nathan Cutler <nculter@suse.com>

Merge pull request #24354 from idryomov/wip-krbd-kfsx-fancy-striping

qa/suites/krbd: more fsx tests

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

doc: fix broken fstab url in cephfs/fuse

Fixes: http://tracker.ceph.com/issues/36286
Signed-off-by: Jos Collin <jcollin@redhat.com>

Merge pull request #24291 from tchaikov/wip-23964

erasure-code: add clay codes

Reviewed-by: Myna Vajha <mynaramana@gmail.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>

Merge pull request #24256 from dzafman/wip-36170

osd: Remove old bft= which has been superceded by backfill=

Reviewed-by: Neha Ojha <nojha@redhat.com>

Merge pull request #24147 from sebastian-philipp/orchestrator-debuggability

mgr/orchestrator: Improve debuggability

Reviewed-by: John Spray <john.spray@redhat.com>

Merge PR #24346 into master

* refs/pull/24346/head:
doc: misc fixes cephfs-shell

Reviewed-by: Pavani Rajula <rpavani1998@gmail.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #24340 from tchaikov/wip-36260

qa/workunits/mon/test_mon_config_key.py: bump up the size limit

Merge PR #21566 into master

* refs/pull/21566/head:
test: add test for mds drop cache command
mds: command to trim mds cache and client caps
mds: implement journal flush as asynchronous context execution
mds: cleanup some asok commands

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #24355 from alfredodeza/wip-rm36249

ceph-volume:  activate option --auto-detect-objectstore respects --no-systemd

Reviewed-by: Andrew Schoen <aschoen@redhat.com>

Merge PR #24044 into master

* refs/pull/24044/head:
qa: tolerate failed rank while waiting for state

Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #23674 from wjwithagen/wjw-wip-ceph-volume-zfs

ceph-volume: zfs, the initial first submit.

Reviewed-by: Alfredo Deza <adeza@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge PR #24275 into master

* refs/pull/24275/head:
qa: add timeout to cleaning up workunit sandbox
qa: add timeout to kclient umount
qa: do not cleanup sandbox on error
qa: use default timeout in fs workunits

Reviewed-by: Nathan Cutler <ncutler@suse.com>

ceph-volume lvm.activate pass no_systemd args when detecting objectstore

Signed-off-by: Alfredo Deza <adeza@redhat.com>