mgr/dashboard: Unset any compression setting for pools in UI

The dashboard API now can delete all compression options if the
compression mode is set to 'unset' during edit. Other dismissed options
will be overwritten with the reset value on submit, which will cause
the deletion of the previously set settings.

Fixes: https://tracker.ceph.com/issues/36355
Signed-off-by: Stephan Müller <smueller@suse.com>

mgr/dashboard: Update PG update test

It is now commented out like it was before,
but I've added a comment what happened during this test with the QA
system. The problem was that even with only a increase of 1 PG the QA
cluster went into a cluster warning state and did not recover in time.
The QA coverage timeout is 2 minutes.

I could not reproduce this behavior with a local cluster, but I've
added a loop to wait until pgp and pg number are equal and the cluster
is in a healthy state again. This can take locally about 5 seconds.
The internal loop has a timeout of 3 minutes.

Fixes: https://tracker.ceph.com/issues/36362
Signed-off-by: Stephan Müller <smueller@suse.com>

mgr/dashboard: Unset compression arguments for pools

The dashboard backend can now unset all set compression arguments if the
compression mode is switched to 'unset'. In the case of 'unset' Ceph
itself will only delete the 'compression_mode' argument, not all other
set arguments. The other arguments that should be removed, too, are
added to the update arguments in order to delete all set arguments.

Fixes: https://tracker.ceph.com/issues/36355
Signed-off-by: Stephan Müller <smueller@suse.com>

mgr/dashboard: Readd pool notifications

As of the merge of cleaner notifications, the notification component was
refactored and move this caused a loss of previously added
notifications.

Fixes: https://tracker.ceph.com/issues/36355
Signed-off-by: Stephan Müller <smueller@suse.com>

mgr/dashboard: Use task list service in pool list

Now the pool list uses the task list service to monitor all tasks, in
order to extend each pool item with corresponding tasks if any. If there
is a running task for a pool you will see what action runs on it in the
listing.

Fixes: https://tracker.ceph.com/issues/36355
Signed-off-by: Stephan Müller <smueller@suse.com>

mgr/dashboard: Handle pool permissions

Handles pool action permissions in pool listing.

Fixes: https://tracker.ceph.com/issues/36355
Signed-off-by: Stephan Müller <smueller@suse.com>

mgr/dashboard: Pool delete

You can delete pools through the UI, this will generate a task that
deletes the pool in the background.

Fixes: https://tracker.ceph.com/issues/36355
Signed-off-by: Stephan Müller <smueller@suse.com>

mgr/dashboard: Pool create / edit

You can create/edit pools through the UI if you have the right
permissions.

You can specify the following:
* Name - can't be duplicated
* Type - replicated or erasure
* Crush rule set
  * Validates if you can use it
  * A popover tells which crush steps are used
* Replica size - depends on your selected rule and the amount of OSDs
* Erasure code profile
* PGs - will be recalculated on form changes (type, replica size,
    erasure profile, crush rule) only if not set before
* EC overwrites flag
* Compression - Algorithm / Min/max blob size / mode / ratio
* Application metadata - Predefined and custom applications as badges

Fixes: https://tracker.ceph.com/issues/36355
Signed-off-by: Stephan Müller <smueller@suse.com>

mgr/dashboard: Return errors to subscriber of task-wrapper

Fixes: https://tracker.ceph.com/issues/36360
Signed-off-by: Stephan Müller <smueller@suse.com>

mgr/dashboard: Fixes user roles

Due to changes in the badges component, user roles had to be amended.

Fixes: https://tracker.ceph.com/issues/36357
Signed-off-by: Stephan Müller <smueller@suse.com>

mgr/dashboard: Add badge filtering

It's now possible to filter badges and create badges via a create badges
label.

Fixes: https://tracker.ceph.com/issues/36357
Signed-off-by: Stephan Müller <smueller@suse.com>

mgr/dashboard: Enable custom badges

Enables custom badges within badges component.

It's possible to use custom validations and custom error messages.

Fixes: https://tracker.ceph.com/issues/36357
Signed-off-by: Stephan Müller <smueller@suse.com>

mgr/dashboard: Amend pool backend tasks

Amends pool tasks in order to get the right results back into the UI
and also to have tasks with the same attributes.

Fixes: https://tracker.ceph.com/issues/36355
Signed-off-by: Stephan Müller <smueller@suse.com>

mgr/dashboard: Add pool type definition

Adds pool type definition which is used in pool listing.

Fixes: https://tracker.ceph.com/issues/36355
Signed-off-by: Stephan Müller <smueller@suse.com>

mgr/dashboard: Add crush rule type definitions

There are two type definitions one for the crush rule itself and one
for the crush step definition which is used inside the crush rule
definition.

Fixes: https://tracker.ceph.com/issues/36355
Signed-off-by: Stephan Müller <smueller@suse.com>

mgr/dashboard: Erasure code profile interface

Fixes: https://tracker.ceph.com/issues/36355
Signed-off-by: Stephan Müller <smueller@suse.com>

mgr/dashboard: Erasure code service

Fixes: https://tracker.ceph.com/issues/36355
Signed-off-by: Stephan Müller <smueller@suse.com>

Merge pull request #23666 from rhcs-dashboard/grafana-integration

mgr/dashboard: Grafana graphs integration with dashboard

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>

Merge pull request #24457 from trociny/wip-qa-cli-namespace

qa/workunits/rbd: fix cli generic namespace test

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #24460 from falcon78921/wip-doc-36336

doc: updated cluster map reference link

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #24369 from p-na/fix-osd-error

mgr/dashboard: Fix error when clicking on newly created OSD

Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>

mgr/dashboard: Adds dynamic documentation link

Fixes: https://tracker.ceph.com/issues/24999
Signed-off-by: Kanika Murarka <kmurarka@redhat.com>

Merge pull request #24326 from rhcs-dashboard/27050-landing-page-milestone-2

mgr/dashboard: New Landing Page: Milestone 2

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>

mgr/dashboard: Fix errors when clicking on new OSD

Fixes: http://tracker.ceph.com/issues/36245
Signed-off-by: Patrick Nawracay <pnawracay@suse.com>

mgr/dashboard: Add type hints to QA helper

Signed-off-by: Patrick Nawracay <pnawracay@suse.com>

Merge pull request #24462 from falcon78921/wip-doc-36339

doc: updated crush map tunables link

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #24416 from noahdesu/doc-req-no-clone

doc: install build-doc deps without git clone

Reviewed-by: Kefu Chai <kchai@redhat.com>

doc: updated crush map tunables link

Updated crush map tunables link in rados/configuration/mon-config-ref.rst
Fixes: https://tracker.ceph.com/issues/36339
Signed-off-by: James McClune <jmcclune@mcclunetechnologies.net>

doc: updated cluster map reference link

Updated cluster map reference link in rados/troubleshooting/troubleshooting-mon.rst
Fixes: https://tracker.ceph.com/issues/36336
Signed-off-by: James McClune <jmcclune@mcclunetechnologies.net>

qa/workunits/rbd: fix cli generic namespace test

expect_fail incorrectly unset '-e' option and if a consequent test
failed it did not abort the execution. And two typos in the namespace
tests were not detected due to this.

Signed-off-by: Mykola Golub <mgolub@suse.com>

Merge PR #24437 into master

* refs/pull/24437/head:
PendingReleaseNotes: add note for mds drop cache

Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #24444 from theanalyst/wip-reshard-stats

rgw: copy actual stats from the source shards during reshard

Merge pull request #23504 from pritha-srivastava/wip-sts-authentication

rgw: Code for STS Authentication.

rgw: copy actual stats from the source shards during reshard

Currently we don't copy the actual_stats field during reshard, which makes
resharded buckets show a size_utilized as 0, which further has the problem that
a subsequent object removal would subtract the object size from the 0 size
utilized showing up large uint64_t values. Copy the size_actual from the source
object in both cls and in reshard_process. This will fix the new buckets,
existing buckets will still have to go through a bucket check --fix for their
stats to be corrected.

Fixes: http://tracker.ceph.com/issues/36290
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>

Merge pull request #24433 from dillaman/wip-rbd-mirror-doc

doc/rbd: explicitly state that mirroring requires connectivity to clusters

Reviewed-by: Mykola Golub <mgolub@suse.com>

Merge pull request #24144 from tchaikov/wip-spdk

bluestore/NVMe: use PCIe selector as the path name

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #24168 from tchaikov/wip-17516

cmake: detect armv8 crc and crypto feature using CHECK_C_COMPILER_FLAG

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #24322 from votdev/improve_error_interceptor

mgr/dashboard: Improve error message handling

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>

PendingReleaseNotes: add note for mds drop cache

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>

doc/rbd: explicitly state that mirroring requires connectivity to cluster

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

mgr/dashboard: Reverse proxy changes

Fixes: https://tracker.ceph.com/issues/24999
Signed-off-by: Kanika Murarka <kmurarka@redhat.com>

mgr/dashboard: Updates documentation

Fixes: https://tracker.ceph.com/issues/24999
Signed-off-by: Kanika Murarka <kmurarka@redhat.com>

mgr/dashboard: Adding Grafana componenets to views

Fixes: https://tracker.ceph.com/issues/24999
Signed-off-by: Kanika Murarka <kmurarka@redhat.com>

mgr/dashboard: Adding grafana component and backend changes

Fixes: https://tracker.ceph.com/issues/24999
Signed-off-by: Kanika Murarka <kmurarka@redhat.com>

Merge pull request #24370 from tspmelo/fix-rbd-trash-purge

mgr/dashboard: Add permission validation to the  "Purge Trash" button

Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>

Merge pull request #24271 from croit/fix-36041

rgw/beast: drop privileges after binding ports

Reviewed-by: Casey Bodley <cbodley@redhat.com>

mgr/dashboard: Improve error message handling

The current implementation of the HTTP interceptor does not use the error description in all cases.

Fixes: https://tracker.ceph.com/issues/36190
Signed-off-by: Volker Theile <vtheile@suse.com>

mgr/dashboard: New Landing Page: Milestone 2

Reduced space between info group title and cards (PR review suggestion).

Fixes: https://tracker.ceph.com/issues/27050
Signed-off-by: Alfonso Martínez <almartin@redhat.com>

Merge pull request #24350 from ricardoasmarques/wip-json-decode

mgr/dashboard: Check content-type before decode json response

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Ricardo Dias <rdias@suse.com>

Merge pull request #24213 from familyuu/mgr

mgr/dashboard: Display logged in user

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>

Merge pull request #20645 from rishabh-d-dave/fix-doc-add-subcommand-application-manpages

ceph: describe application subcommand in ceph man page

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #24117 from trociny/wip-35915

mgr: create shell OSD performance query class

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: John Spray <john.spray@redhat.com>

doc: install build-doc deps without git clone

With `-e` the repository is cloned, leading to `git clean` skipping
the cloned dependencies due to the `.git` directory, and forcing manual
removal.

[nwatkins@daq ceph]$ git clean -dxf
Skipping repository build-doc/virtualenv/src/breathe
Skipping repository build-doc/virtualenv/src/sphinx-ditaa

Signed-off-by: Noah Watkins <nwatkins@redhat.com>

mgr: module to test osd_perf_query methods

Signed-off-by: Mykola Golub <mgolub@suse.com>

mgr: add osd_perf_query methods to ActivePyModules

Signed-off-by: Mykola Golub <mgolub@suse.com>

mgr: create shell OSD performance query class

Signed-off-by: Mykola Golub <mgolub@suse.com>

Merge pull request #24380 from smithfarm/wip-opensuse-15

qa/distros: add openSUSE Leap 42.3 and 15.0

Reviewed-by: Yuri Weinstein <yweins@redhat.com>

Merge pull request #24399 from alfredodeza/wip-rm36246

ceph-volume util.encryption don't push stderr to terminal

Reviewed-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #24394 from alfredodeza/wip-rm24795

ceph-volume lvm.prepare update help to indicate partitions are needed, not devices

Reviewed-by: Andrew Schoen <aschoen@redhat.com>

rgw/beast: drop privileges after binding ports

Fixes: http://tracker.ceph.com/issues/36041
Signed-off-by: Paul Emmerich <paul.emmerich@croit.io>

ceph: describe application subcommand in ceph man page

Add the summary and syntax for all the subcommands under the subcommand
"ceph osd pool application" to ceph the manual page.

Signed-off-by: Rishabh Dave <ridave@redhat.com>

ceph-volume util.encryption don't push stderr to terminal when cryptsetup fails to find device

Signed-off-by: Alfredo Deza <adeza@redhat.com>

mgr/dashboard: New Landing Page: Milestone 2

Added tests for Health component to ensure that

all groups and cards are rendered.

Fixes: https://tracker.ceph.com/issues/27050
Signed-off-by: Alfonso Martínez <almartin@redhat.com>

mgr/dashboard: New Landing Page: Milestone 2

Added tests for InfoCard & InfoGroup components.

Fixes: https://tracker.ceph.com/issues/27050
Signed-off-by: Alfonso Martínez <almartin@redhat.com>

mgr/dashboard: New Landing Page: Milestone 2

CSS refactor: move color to defaults.scss

Fixes: https://tracker.ceph.com/issues/27050
Signed-off-by: Alfonso Martínez <almartin@redhat.com>

mgr/dashboard: New Landing Page: Milestone 2

Set same font-size for all cards (updated OSD card font size).

Fixes: https://tracker.ceph.com/issues/27050
Signed-off-by: Alfonso Martínez <almartin@redhat.com>

mgr/dashboard: New Landing Page: Milestone 2

Fix: hide 'cluser status' popover when status change to OK.

Fixes: https://tracker.ceph.com/issues/27050
Signed-off-by: Alfonso Martínez <almartin@redhat.com>

mgr/dashboard: New Landing Page: Milestone 2

Info Card fluid font size: set max width to 2K.

Fixes: https://tracker.ceph.com/issues/27050
Signed-off-by: Alfonso Martínez <almartin@redhat.com>

mgr/dashboard: New Landing Page: Milestone 2

Cluster Status card: added style for clickable element

with mouse hover behaviour.

CSS refactor and cleanup.

Fixes: https://tracker.ceph.com/issues/27050
Signed-off-by: Alfonso Martínez <almartin@redhat.com>

mgr/dashboard: New Landing Page: Milestone 2

Fix: cluster status popover on top (it was under another card).

CSS adjustments.

Fixes: https://tracker.ceph.com/issues/27050
Signed-off-by: Alfonso Martínez <almartin@redhat.com>

mgr/dashboard: New Landing Page: Milestone 2

Improve medium size cards layout for 1366x768 (HD resolution).

Fixes: https://tracker.ceph.com/issues/27050
Signed-off-by: Alfonso Martínez <almartin@redhat.com>

mgr/dashboard: New Landing Page: Milestone 2

Changed navigation menu dropdown arrows' color to white.

All cards (except logs) viewable at-a-glance in Full HD presentation mode.

CSS adjustments, refactor and cleanup.

Fixes: https://tracker.ceph.com/issues/27050
Signed-off-by: Alfonso Martínez <almartin@redhat.com>

mgr/dashboard: New Landing Page: Milestone 2

Changed background color to gray.

Changed cards' background color to white.

Changed card font size to fluid: from 12px to 21px.

Info Group Title: fixed font size 21px, removed underline..

CSS Flexbox layout for  perf. and capacity cards.

CSS adjustments, refactor and cleanup.

Fixes: https://tracker.ceph.com/issues/27050
Signed-off-by: Alfonso Martínez <almartin@redhat.com>

mgr/dashboard: Landing Page Milestone 2

OSD card:

Break info in 2/3 lines for huge OSDs amount.

Fixes: https://tracker.ceph.com/issues/27050
Signed-off-by: Alfonso Martínez <almartin@redhat.com>

ceph-volume lvm.prepare update help to indicate partitions are needed, not devices

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #24348 from trociny/wip-config-pool-mirror

 rbd-mirror: use pool level config overrides

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

mgr/dashboard: Delete white space beform 'Sign'

Signed-off-by: guodan <guodan1@lenovo.com>

mgr/dashboard: Delete the old logout component

Signed-off-by: guodan1 <guodan1@lenovo.com>

mgr/dashboard: Display logged in user

Signed-off-by: guodan1 <guodan1@lenovo.com>

Merge PR #24367 into master

* refs/pull/24367/head:
doc: Fix typo error on cephfs/fuse/

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge PR #24362 into master

* refs/pull/24362/head:
doc: fix broken fstab url in cephfs/fuse

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #24276 from dillaman/wip-36183

osdc/Objecter: possible race condition with connection reset

Reviewed-by: Greg Farnum gfarnum@redhat.com

Merge pull request #24262 from cernceph/dvanders_creating

osd: add creating to pg_string_state

Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>

Merge pull request #24304 from tchaikov/wip-monclient-remove-unused-label

mon/MonClient: use scoped_guard instead of goto

Reviewed-by: Neha Ojha <nojha@redhat.com>

Merge pull request #24372 from alfredodeza/wip-rm36247

ceph-volume: skip processing devices that don't exist when scanning system disks

Reviewed-by: Andrew Schoen <aschoen@redhat.com>

qa/distros: add openSUSE Leap 42.3 and 15.0

References: https://tracker.ceph.com/issues/35927
Signed-off-by: Nathan Cutler <ncutler@suse.com>

Merge pull request #24180 from colletj/wip-35914-mmgrconfigure-osd-query

mgr: update MMgrConfigure message to include optional OSD perf queries

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

mgr: add optional OSD perf queries to MMgrConfigure message

Fixes: https://tracker.ceph.com/issues/35914
Signed-off-by: Julien Collet <julien.collet@cern.ch>

ceph-volume util.disk when there are no devices mapped, skip to the next one

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ceph-volume tests.util verify devices that don't exist don't break get_devices

Signed-off-by: Alfredo Deza <adeza@redhat.com>

mgr/dashboard: Add permission validation to the  "Purge Trash" button

Added missing permission validations in the RBD Trash endpoints.

Fixes: http://tracker.ceph.com/issues/36272
Signed-off-by: Tiago Melo <tmelo@suse.com>

Merge pull request #24349 from ricardoasmarques/wip-ex-message-py3

mgr/dashboard: Exception.message doesn't exist on Python 3

Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>

doc: Fix typo error on cephfs/fuse/

Fixes: http://tracker.ceph.com/issues/36180
Signed-off-by: Karun Josy <kjosy@redhat.com>

Merge pull request #24266 from theanalyst/doc/releases/13.2.2

doc: release notes for 13.2.2 mimic

Reviewed-By: Nathan Cutler <nculter@suse.com>

Merge pull request #24354 from idryomov/wip-krbd-kfsx-fancy-striping

qa/suites/krbd: more fsx tests

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

doc: fix broken fstab url in cephfs/fuse

Fixes: http://tracker.ceph.com/issues/36286
Signed-off-by: Jos Collin <jcollin@redhat.com>

Merge pull request #24291 from tchaikov/wip-23964

erasure-code: add clay codes

Reviewed-by: Myna Vajha <mynaramana@gmail.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>

Merge pull request #24256 from dzafman/wip-36170

osd: Remove old bft= which has been superceded by backfill=

Reviewed-by: Neha Ojha <nojha@redhat.com>

Merge pull request #24147 from sebastian-philipp/orchestrator-debuggability

mgr/orchestrator: Improve debuggability

Reviewed-by: John Spray <john.spray@redhat.com>

Merge PR #24346 into master

* refs/pull/24346/head:
doc: misc fixes cephfs-shell

Reviewed-by: Pavani Rajula <rpavani1998@gmail.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>