]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
3 years agoRevert "Merge pull request #42099 from aclamk/wip-bluefs-fine-grain-locking-2" 43627/head
Sage Weil [Fri, 22 Oct 2021 02:18:12 +0000 (22:18 -0400)]
Revert "Merge pull request #42099 from aclamk/wip-bluefs-fine-grain-locking-2"

This reverts commit 44e89c613c6b882f3436714fdaa6c9c04b94b62d, reversing
changes made to 552ac6657753f00f039f267e20e5a4c399c2bb10.

This is causing failures in
ObjectStore/StoreTestSpecificAUSize.SyntheticMatrixCsumVsCompression/2
and ObjectStore/StoreTestSpecificAUSize.SpilloverFixedTest/2

Signed-off-by: Sage Weil <sage@newdream.net>
3 years agoMerge pull request #43503 from mkogan1/wip-fips-md5
Mark Kogan [Thu, 21 Oct 2021 14:35:53 +0000 (17:35 +0300)]
Merge pull request #43503 from mkogan1/wip-fips-md5

rgw: under fips, set flag to allow md5 in select rgw ops

3 years agoMerge PR #43566 into master
Patrick Donnelly [Thu, 21 Oct 2021 14:26:43 +0000 (10:26 -0400)]
Merge PR #43566 into master

* refs/pull/43566/head:
qa: reduce frag split confs for dir_split counter test

Reviewed-by: Venky Shankar <vshankar@redhat.com>
3 years agoMerge pull request #43600 from smithfarm/wip-52979
Daniel Gryniewicz [Thu, 21 Oct 2021 14:21:12 +0000 (10:21 -0400)]
Merge pull request #43600 from smithfarm/wip-52979

rgw/tracing: unify SO version numbers within librgw2 package

Reviewed-by: Casey Bodley <cbodley@redhat.com>
3 years agoMerge pull request #43586 from sebastian-philipp/docs-email-contact
zdover23 [Thu, 21 Oct 2021 11:14:01 +0000 (21:14 +1000)]
Merge pull request #43586 from sebastian-philipp/docs-email-contact

doc/start: documenting-ceph: Remove email to ceph-docs@redhat.com

Reviewed-by: Zac Dover <zac.dover@gmail.com>
3 years agoMerge pull request #43604 from zdover23/wip-doc-2021-10-21-cephadm-install-typo
Sebastian Wagner [Thu, 21 Oct 2021 11:08:38 +0000 (13:08 +0200)]
Merge pull request #43604 from zdover23/wip-doc-2021-10-21-cephadm-install-typo

doc/cephadm: update typo in install.rst

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
3 years agoMerge pull request #43616 from krafZLorG/fix-cephadm-chooseleaf
Sebastian Wagner [Thu, 21 Oct 2021 10:53:39 +0000 (12:53 +0200)]
Merge pull request #43616 from krafZLorG/fix-cephadm-chooseleaf

cephadm: Fix option name osd_crush_chooseleaf_type

Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
3 years agoFix option name osd_crush_chooseleaf_type 43616/head
krafZLorG [Thu, 21 Oct 2021 07:27:14 +0000 (10:27 +0300)]
Fix option name osd_crush_chooseleaf_type

Signed-off-by: Dmitry Kvashnin <dm.kvashnin@gmail.com>
3 years agoMerge PR #43508 into master
Patrick Donnelly [Thu, 21 Oct 2021 02:27:40 +0000 (22:27 -0400)]
Merge PR #43508 into master

* refs/pull/43508/head:
mds/FSMap: do not assert allow_standby_replay on old FSMaps

Reviewed-by: Ramana Raja <rraja@redhat.com>
3 years agoMerge PR #43506 into master
Patrick Donnelly [Thu, 21 Oct 2021 02:26:41 +0000 (22:26 -0400)]
Merge PR #43506 into master

* refs/pull/43506/head:
mon/MDSMonitor: avoid crash when decoding old FSMap epochs

Reviewed-by: Kotresh Hiremath Ravishankar <khiremat@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Xiubo Li <xiubli@redhat.com>
3 years agoMerge PR #40183 into master
Patrick Donnelly [Thu, 21 Oct 2021 02:25:58 +0000 (22:25 -0400)]
Merge PR #40183 into master

* refs/pull/40183/head:
client: remove useless mds member in Fh class
client: adjust the Fh class members order
client: switch to use shared_ptr for mds_sessions
client: minor cleanup to Fh related code
client: minor cleanup to MetaRequest class
client: minor cleanup to Client related code

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>
3 years agoMerge PR #38752 into master
Patrick Donnelly [Thu, 21 Oct 2021 02:24:32 +0000 (22:24 -0400)]
Merge PR #38752 into master

* refs/pull/38752/head:
qa: enable dynamic debug support to kclient

Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
3 years agoMerge PR #43138 into master
Sage Weil [Wed, 20 Oct 2021 21:50:21 +0000 (17:50 -0400)]
Merge PR #43138 into master

* refs/pull/43138/head:
mgr/rook: implement `orch device zap` in rook orchestrator

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Sébastien Han <seb@redhat.com>
3 years agoMerge pull request #43594 from ivancich/wip-bucket-fix-pool-actual
J. Eric Ivancich [Wed, 20 Oct 2021 18:38:26 +0000 (14:38 -0400)]
Merge pull request #43594 from ivancich/wip-bucket-fix-pool-actual

rgw: have "bucket check --fix" fix pool ids correctly

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
3 years agoMerge pull request #43429 from ivancich/wip-document-rgw_lc_debug_interval
J. Eric Ivancich [Wed, 20 Oct 2021 17:49:20 +0000 (13:49 -0400)]
Merge pull request #43429 from ivancich/wip-document-rgw_lc_debug_interval

rgw: document rgw_lc_debug_interval configuration option

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
3 years agorgw: clean up a little LC logging 43594/head
J. Eric Ivancich [Wed, 13 Oct 2021 13:43:59 +0000 (09:43 -0400)]
rgw: clean up a little LC logging

Some of the LC logging does not put whitespace between some values and
the thread identifier. This commit adds the whitespace.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
3 years agorgw: during "bucket check --fix" set index entry pool id correctly
J. Eric Ivancich [Mon, 11 Oct 2021 20:17:46 +0000 (16:17 -0400)]
rgw: during "bucket check --fix" set index entry pool id correctly

The current code sets the pool id of bucket index entries to the
bucket index pool rather than the data pool. This fixes that.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
3 years agoMerge pull request #43553 from ivancich/wip-bucket-fix-pool
J. Eric Ivancich [Wed, 20 Oct 2021 16:58:39 +0000 (12:58 -0400)]
Merge pull request #43553 from ivancich/wip-bucket-fix-pool

rgw: pass "force check filter" through SAL in bucket listing

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
3 years agoMerge pull request #43535 from Rethan/fix-image-spec
Mykola Golub [Wed, 20 Oct 2021 16:05:46 +0000 (19:05 +0300)]
Merge pull request #43535 from Rethan/fix-image-spec

rbd: correct image_spec() output when rbd-nbd Detach/Unmap error

Reviewed-by: Mykola Golub <mgolub@suse.com>
3 years agoMerge pull request #43596 from ronen-fr/wip-rf-test_info
Ronen Friedman [Wed, 20 Oct 2021 15:03:22 +0000 (18:03 +0300)]
Merge pull request #43596 from ronen-fr/wip-rf-test_info

tests: modify osd-scrub-repair to match PR #43239 changes

Reviewed-by: Mykola Golub <mgolub@suse.com>
3 years agodoc/cephadm: update typo in install.rst 43604/head
Zac Dover [Wed, 20 Oct 2021 14:42:02 +0000 (00:42 +1000)]
doc/cephadm: update typo in install.rst

This PR changes the string

   use "--log-to-file" option during bootstrap

to

   use the "--log-to-file" option during bootstrap

The way that it was written makes it sound like it was
written by a native Russian speaker. But it was written
by me, a native English speaker, so this is on me.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
3 years agoMerge pull request #43572 from trociny/wip-qa-backfill-toofull-compress
Neha Ojha [Wed, 20 Oct 2021 13:57:06 +0000 (06:57 -0700)]
Merge pull request #43572 from trociny/wip-qa-backfill-toofull-compress

qa/tasks/backfill_toofull: make test work when compression on

Reviewed-by: Neha Ojha <nojha@redhat.com>
3 years agorgw: document rgw_lc_debug_interval configuration option 43429/head
J. Eric Ivancich [Tue, 5 Oct 2021 23:27:27 +0000 (19:27 -0400)]
rgw: document rgw_lc_debug_interval configuration option

Updates the yaml describing this config option with a "desc" and a
"long_desc".

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
3 years agodoc/start: documenting-ceph: Remove email to ceph-docs@redhat.com 43586/head
Sebastian Wagner [Tue, 19 Oct 2021 09:08:35 +0000 (11:08 +0200)]
doc/start: documenting-ceph: Remove email to ceph-docs@redhat.com

Instead get in touch with the component lead.

Signed-off-by: Sebastian Wagner <sewagner@redhat.com>
3 years agodoc/start: documenting-ceph: Improve template of commits
Sebastian Wagner [Tue, 19 Oct 2021 09:07:13 +0000 (11:07 +0200)]
doc/start: documenting-ceph: Improve template of commits

by properly linking the corresponding tracker issue.

Signed-off-by: Sebastian Wagner <sewagner@redhat.com>
3 years agodoc/governanace: Fix my email address
Sebastian Wagner [Tue, 19 Oct 2021 09:00:26 +0000 (11:00 +0200)]
doc/governanace: Fix my email address

Signed-off-by: Sebastian Wagner <sewagner@redhat.com>
3 years agorgw/tracing: unify SO version numbers within librgw2 package 43600/head
Nathan Cutler [Wed, 20 Oct 2021 10:51:02 +0000 (12:51 +0200)]
rgw/tracing: unify SO version numbers within librgw2 package

The librgw2 package contains several SO files. Two of those - librgw_op_tp.so
and librgw_rados_tp.so - had a different version number than the main librgw.

This was a violation of the openSUSE Shared Library Packaging Policy [1] but it
also seems like a "violation" of common sense.

[1] https://en.opensuse.org/openSUSE:Shared_library_packaging_policy#Package_naming

Fixes: https://tracker.ceph.com/issues/52979
Signed-off-by: Nathan Cutler <ncutler@suse.com>
3 years agoMerge pull request #42772 from Daniel-Pivonka/cephadm-add-existing-host
Sebastian Wagner [Wed, 20 Oct 2021 09:49:33 +0000 (11:49 +0200)]
Merge pull request #42772 from Daniel-Pivonka/cephadm-add-existing-host

mgr/cephadm: update host when adding host that already exists

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
3 years agoMerge pull request #43354 from adk3798/daemon-failed-agent
Sebastian Wagner [Wed, 20 Oct 2021 09:48:42 +0000 (11:48 +0200)]
Merge pull request #43354 from adk3798/daemon-failed-agent

mgr/cephadm: update CEPHADM_FAILED_DAEMON after receiving agent metadata

Reviewed-by: Daniel Pivonka <dpivonka@redhat.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
3 years agoMerge pull request #43366 from adk3798/log-list-servers
Sebastian Wagner [Wed, 20 Oct 2021 09:48:09 +0000 (11:48 +0200)]
Merge pull request #43366 from adk3798/log-list-servers

mgr/cephadm: put list_servers output in debug logs

Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
3 years agoMerge pull request #43367 from adk3798/handle-use-agent
Sebastian Wagner [Wed, 20 Oct 2021 09:47:41 +0000 (11:47 +0200)]
Merge pull request #43367 from adk3798/handle-use-agent

mgr/cephadm: move handling of use_agent setting into agent.py

Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
3 years agoMerge pull request #43489 from adk3798/clear-agent-down
Sebastian Wagner [Wed, 20 Oct 2021 09:46:17 +0000 (11:46 +0200)]
Merge pull request #43489 from adk3798/clear-agent-down

mgr/cephadm: update CEPHADM_AGENT_DOWN when agent reports in

Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
3 years agoMerge pull request #43552 from adk3798/dont-log-credentials
Sebastian Wagner [Wed, 20 Oct 2021 09:45:29 +0000 (11:45 +0200)]
Merge pull request #43552 from adk3798/dont-log-credentials

cephadm: do not log commands sent to "call" function

Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
3 years agotests: modify osd-scrub-repair to match PR #43239 changes 43596/head
Ronen Friedman [Wed, 20 Oct 2021 06:42:51 +0000 (06:42 +0000)]
tests: modify osd-scrub-repair to match PR #43239 changes

PR #43239 has modified ECBackend::get_hash_info() behavior.
Modified the standalone scrub test to match.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
3 years agoMerge pull request #43592 from rzarzynski/wip-crimson-mount_ertr
Samuel Just [Wed, 20 Oct 2021 04:55:23 +0000 (21:55 -0700)]
Merge pull request #43592 from rzarzynski/wip-crimson-mount_ertr

crimson: errorate the FuturizedStore::mount() paths.

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>
3 years agoMerge pull request #42839 from giladmaya/wip-on-wire-compression-documentation
Neha Ojha [Tue, 19 Oct 2021 21:55:16 +0000 (14:55 -0700)]
Merge pull request #42839 from giladmaya/wip-on-wire-compression-documentation

doc: Added msgr on-wire-compression

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
3 years agoMerge pull request #43577 from ThomasLamprecht/docs-glossary-typo
Neha Ojha [Tue, 19 Oct 2021 21:54:10 +0000 (14:54 -0700)]
Merge pull request #43577 from ThomasLamprecht/docs-glossary-typo

docs: fix case and spelling of Proxmox VE

Reviewed-by: Laura Flores <lflores@redhat.com>
3 years agocrimson: errorate the FuturizedStore::mount() paths. 43592/head
Radoslaw Zarzynski [Tue, 19 Oct 2021 20:02:57 +0000 (20:02 +0000)]
crimson: errorate the FuturizedStore::mount() paths.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
3 years agoMerge PR #43556 into master
Sage Weil [Tue, 19 Oct 2021 20:04:36 +0000 (16:04 -0400)]
Merge PR #43556 into master

* refs/pull/43556/head:
qa/suites/orch/cephadm/osds: add osd rm/zap/add test

Reviewed-by: Cory Snyder <csnyder@iland.com>
3 years agocrimson/os: move singleton_ec up to let mount() reuse it.
Radoslaw Zarzynski [Tue, 19 Oct 2021 19:24:47 +0000 (19:24 +0000)]
crimson/os: move singleton_ec up to let mount() reuse it.

No other changes in this commit.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
3 years agoMerge PR #43569 into master
Sage Weil [Tue, 19 Oct 2021 14:58:31 +0000 (10:58 -0400)]
Merge PR #43569 into master

* refs/pull/43569/head:
mgr/orchestrator: clean up 'orch device ls' output

Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
3 years agoMerge pull request #43486 from cbodley/wip-rgw-maintainers
Casey Bodley [Tue, 19 Oct 2021 12:53:01 +0000 (08:53 -0400)]
Merge pull request #43486 from cbodley/wip-rgw-maintainers

rgw: start on MAINTAINERS.md

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
3 years agoMerge pull request #43514 from mgfritch/cephadm-agent-binary
Sebastian Wagner [Tue, 19 Oct 2021 11:33:43 +0000 (13:33 +0200)]
Merge pull request #43514 from mgfritch/cephadm-agent-binary

cephadm: use the current cephadm binary for the agent

Reviewed-by: Adam King <adking@redhat.com>
3 years agoMerge pull request #43465 from rhcs-dashboard/radosgw-grafana-dashboards
Ernesto Puerta [Tue, 19 Oct 2021 11:30:06 +0000 (13:30 +0200)]
Merge pull request #43465 from rhcs-dashboard/radosgw-grafana-dashboards

mgr/dashboard: monitoring: grafonnet refactoring for radosgw dashboards

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
3 years agoMerge pull request #43370 from liewegas/fix-rook-rgw-multisite
Sebastian Wagner [Tue, 19 Oct 2021 09:34:46 +0000 (11:34 +0200)]
Merge pull request #43370 from liewegas/fix-rook-rgw-multisite

mgr/rook: describe_services: name rgw svc appropriately

Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
3 years agoMerge pull request #43550 from liewegas/rook-nvme
Sebastian Wagner [Tue, 19 Oct 2021 09:30:40 +0000 (11:30 +0200)]
Merge pull request #43550 from liewegas/rook-nvme

qa/suites/orch/rook/smoke: use nvme-loop

Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
3 years agoMerge pull request #42526 from liewegas/dashboard-nfs
Ernesto Puerta [Tue, 19 Oct 2021 09:17:17 +0000 (11:17 +0200)]
Merge pull request #42526 from liewegas/dashboard-nfs

mgr/dashboard: consume mgr/nfs

Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Varsha Rao <rvarsha016@gmail.com>
3 years agomgr/dashboard: monitoring: grafonnet refactoring for cephfs dashboards 43465/head
Aashish Sharma [Fri, 8 Oct 2021 10:07:17 +0000 (15:37 +0530)]
mgr/dashboard: monitoring: grafonnet refactoring for cephfs dashboards

This PR intends to refactor cephfs dashboards using grafonnet

Fixes:https://tracker.ceph.com/issues/52777
Signed-off-by: Aashish Sharma <aasharma@redhat.com>
3 years agomgr/dashboard: monitoring: grafonnet refactoring for osds dashboards
Aashish Sharma [Fri, 8 Oct 2021 09:58:13 +0000 (15:28 +0530)]
mgr/dashboard: monitoring: grafonnet refactoring for osds dashboards

This PR intends to refactor osds dashboards using grafonnet

Fixes:https://tracker.ceph.com/issues/52777
Signed-off-by: Aashish Sharma <aasharma@redhat.com>
3 years agomgr/dashboard: monitoring: grafonnet refactoring for pools dashboards
Aashish Sharma [Fri, 8 Oct 2021 09:52:46 +0000 (15:22 +0530)]
mgr/dashboard: monitoring: grafonnet refactoring for pools dashboards

This PR intends to refactor pools dashboards using grafonnet

Fixes:https://tracker.ceph.com/issues/52777
Signed-off-by: Aashish Sharma <aasharma@redhat.com>
3 years agomgr/dashboard: monitoring: grafonnet refactoring for rbd dashboards
Aashish Sharma [Fri, 8 Oct 2021 09:42:41 +0000 (15:12 +0530)]
mgr/dashboard: monitoring: grafonnet refactoring for rbd dashboards

This PR intends to refactor rbd dashboards using grafonnet

Fixes:https://tracker.ceph.com/issues/52777
Signed-off-by: Aashish Sharma <aasharma@redhat.com>
3 years agomgr/dashboard: monitoring: grafonnet refactoring for radosgw dashboards
Aashish Sharma [Fri, 8 Oct 2021 09:30:09 +0000 (15:00 +0530)]
mgr/dashboard: monitoring: grafonnet refactoring for radosgw dashboards

This PR intends to refactor radosgw dashboards using grafonnet

Fixes:https://tracker.ceph.com/issues/52777
Signed-off-by: Aashish Sharma <aasharma@redhat.com>
3 years agomgr/rook: implement `orch device zap` in rook orchestrator 43138/head
Joseph Sawaya [Thu, 9 Sep 2021 19:14:29 +0000 (15:14 -0400)]
mgr/rook: implement `orch device zap` in rook orchestrator

This commit implements orch device zap by creating a pod on the target
host that mounts the /dev directory and runs either overwrites the first
few blocks of the device with zeros if it's a raw device or if it's not
a raw device it will use `ceph-volume lvm zap`.

Signed-off-by: Joseph Sawaya <jsawaya@redhat.com>
3 years agoqa/suites/orch/cephadm/osds: add osd rm/zap/add test 43556/head
Sage Weil [Thu, 14 Oct 2021 20:00:09 +0000 (15:00 -0500)]
qa/suites/orch/cephadm/osds: add osd rm/zap/add test

Signed-off-by: Sage Weil <sage@newdream.net>
3 years agoMerge PR #43504 into master
Sage Weil [Mon, 18 Oct 2021 19:03:33 +0000 (15:03 -0400)]
Merge PR #43504 into master

* refs/pull/43504/head:
mgr/nfs: add some test coverage for cluster info, cluster config
mgr/nfs: add 'nfs cluster config get'

Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
Reviewed-by: Varsha Rao <rvarsha016@gmail.com>
3 years agoMerge PR #43510 into master
Sage Weil [Mon, 18 Oct 2021 19:03:24 +0000 (15:03 -0400)]
Merge PR #43510 into master

* refs/pull/43510/head:
qa/suites/orch/cephadm/upgrade: smoke test for 'orch upgrade ls'
mgr/cephadm: make upgrade ls output structured
mgr/cephadm: add 'orch upgrade ls' to list available versions

Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
3 years agoMerge PR #43549 into master
Sage Weil [Mon, 18 Oct 2021 17:56:39 +0000 (13:56 -0400)]
Merge PR #43549 into master

* refs/pull/43549/head:
mgr/rook: fix mds service list

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
3 years agorgw: add src/rgw/MAINTAINERS.md 43486/head
Casey Bodley [Mon, 11 Oct 2021 14:42:34 +0000 (10:42 -0400)]
rgw: add src/rgw/MAINTAINERS.md

Signed-off-by: Casey Bodley <cbodley@redhat.com>
3 years agoMerge pull request #43469 from rhcs-dashboard/hosts-grafana-dashboards
Ernesto Puerta [Mon, 18 Oct 2021 15:14:03 +0000 (17:14 +0200)]
Merge pull request #43469 from rhcs-dashboard/hosts-grafana-dashboards

mgr/dashboard: monitoring: grafonnet refactoring for hosts dashboards

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
3 years agoqa/suites/orch/cephadm/upgrade: smoke test for 'orch upgrade ls' 43510/head
Sage Weil [Fri, 15 Oct 2021 15:58:41 +0000 (11:58 -0400)]
qa/suites/orch/cephadm/upgrade: smoke test for 'orch upgrade ls'

Signed-off-by: Sage Weil <sage@newdream.net>
3 years agoMerge pull request #42760 from ideepika/wip-iscsi-testing
Ilya Dryomov [Mon, 18 Oct 2021 12:25:36 +0000 (14:25 +0200)]
Merge pull request #42760 from ideepika/wip-iscsi-testing

qa/suites/rbd: switch iscsi tests to cephadm

Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
3 years agoMerge pull request #43564 from sebastian-philipp/doc-cephadm-host-location
Sebastian Wagner [Mon, 18 Oct 2021 11:58:55 +0000 (13:58 +0200)]
Merge pull request #43564 from sebastian-philipp/doc-cephadm-host-location

doc/cephadm: Hosts: Add "initial CRUSH location"

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Guillaume Abrioux <gabrioux@redhat.com>
3 years agomgr/dashboard: NFS exports: API + UI: integration with mgr/nfs; cleanups 42526/head
Alfonso Martínez [Thu, 26 Aug 2021 10:05:54 +0000 (12:05 +0200)]
mgr/dashboard: NFS exports: API + UI: integration with mgr/nfs; cleanups

mgr/dashboard: move NFS_GANESHA_SUPPORTED_FSALS to mgr_module.py

Importing from nfs module throws AttributeError because as a side effect the dashboard module is impersonating the nfs module.
https://gist.github.com/varshar16/61ac26426bbe5f5f562ebb14bcd0f548

mgr/dashboard: 'Create NFS export' form: list clusters from nfs module

mgr/dashboard: frontend+backend cleanups for NFS export

Removed all code and references related to daemons. UI cleanup and adopted unit-testing for
nfs-epxort create form for CEPHFS backend. Cleanup for export list/get/create/set/delete endpoints.

mgr/dashboard: rm set-ganesha ref + update docs

Remove existing set-ganesha-clusters-rados-pool-namespace references as
they are no longer required. Moreover, nfs doc in dashboard doc is
updated accordingly to the current nfs status.

mgr/dashboard: add nfs-export e2e test coverage

mgr/dashboard: 'Create NFS export' form: remove RGW user id field.

- Improve bucket typeahead behavior.
- Increase version for bucket list endpoint.
- Some refactoring.

mgr/dashboard: 'Create NFS export' form: allow RGW backend only when default realm is selected.

When RGW multisite is configured, the NFS module can only handle buckets in the default realm.

mgr/dashboard: 'Create service' form: fix NFS service creation.

After https://github.com/ceph/ceph/pull/42073, NFS pool and namespace are not customizable.

mgr/dashboard: 'Create NFS export' form: add bucket validation.

- Allow only existing buckets.
- Refactoring:
  - Moved bucket validator from bucket form to cd-validators.ts
  - Split bucket validator into 2: bucket name validator and bucket existence (that checks either existence or non-existence).

mgr/dashboard: 'Create NFS export' form: path validation refactor: allow only existing paths.

Fixes: https://tracker.ceph.com/issues/46493
Fixes: https://tracker.ceph.com/issues/51479
Signed-off-by: Alfonso Martínez <almartin@redhat.com>
Signed-off-by: Avan Thakkar <athakkar@redhat.com>
Signed-off-by: Pere Diaz Bou <pdiazbou@redhat.com>
3 years agodocs: fix case and spelling of Proxmox VE 43577/head
Thomas Lamprecht [Mon, 18 Oct 2021 10:10:24 +0000 (12:10 +0200)]
docs: fix case and spelling of Proxmox VE

There's no such thing as ProxMox, the hypervisor product with build
in ceph server management and RBD client access is named `Proxmox VE`
and the company behind it is named Proxmox Server Solutions GmbH

Signed-off-by: Thomas Lamprecht <t.lamprecht@proxmox.com>
3 years agomgr/dashboard: directly use ExportMgr and NFSCluster objects
Varsha Rao [Mon, 9 Aug 2021 19:00:16 +0000 (00:30 +0530)]
mgr/dashboard: directly use ExportMgr and NFSCluster objects

Using the objects directly provides access to other methods and helps in
avoiding repeatition.

mgr/dashboard/nfsganesha: remove tag

Since NFS v3 is no longer supported. We can remove tag.

mgr/nfs: define global constant to list supported FSALs

mgr/dashboard: directly list nfs clusters by directly importing available_cluster() method

The current dashboard api returns a list of following dictionary

{
   'pool': 'nfs-ganesha',
   'namespace': cluster_id,
   'type': 'orchestrator',
   'daemon_conf': None
}

None of these values are required for listing nfs cluster by mgr/nfs module.
Instead directly list available cluster names

mgr/dashboard: add comment to remove listing of daemons

As the configs are per cluster. There is no need to list daemons per cluster.

mgr/dashboard/controllers/nfsganesha: Add comments to update/remove status endpoint

This endpoint can be updated in suggested way or even removed. As it was
initially[1] introduced to check if dashboard pool and namespace configuration was
set.

[1] https://github.com/ceph/ceph/commit/824726393b185b8e5a8f17e66487dfde9f3c8b5c

mgr/nfs: remove fetch_cluster_obj()

There is no need to fetch NFSCluster class object. Directly
available_clusters() can be imported to list nfs clusters.

mgr/dashboard/controllers/nfsganesha: list exports based on cluster id

As mgr/nfs module lists based on cluster id.

mgr/dashboard/nfs: get and delete export by export id

Fixes: https://tracker.ceph.com/issues/46493
Signed-off-by: Varsha Rao <varao@redhat.com>
3 years agomgr/dashboard: consume mgr/nfs via mgr.remote()
Sage Weil [Wed, 28 Jul 2021 14:29:47 +0000 (10:29 -0400)]
mgr/dashboard: consume mgr/nfs via mgr.remote()

Stop using the dashboard version of the Ganesha config classes; consume
mgr/nfs instead via remote().

mgr/nfs/export: return Export from _apply_export

Future callers will want this.

mgr/nfs: new module methods for dashboard consumption

Add some new methods that are easy for the dashboard API to consume.  These
are very similar to the CLI methods but do now have the @CLICommand and
related decorators, and have slightly different interfaces (e.g., returning
the created/modified Export dict).

mgr/dashboard: remove old ganesha code (and tests)

Fixes: https://tracker.ceph.com/issues/46493
Signed-off-by: Sage Weil <sage@newdream.net>
3 years agosrc/test/cli-integration: correct hostname for iscsi gateway 42760/head
Deepika Upadhyay [Thu, 14 Oct 2021 07:10:14 +0000 (12:40 +0530)]
src/test/cli-integration: correct hostname for iscsi gateway

iscsi accepts first word of hostname as local hostname[0] instead of
smithi061.front.sepia.ceph.com we use: smithi061 otherwise gateway
creation will error out with:
```The first gateway defined must be the local machine```

[0] https://github.com/ceph/ceph-iscsi-cli/blob/ff3e430b70a62257a560b8988bd54bf845c01fb7/gwcli/utils.py#L36

Signed-off-by: Deepika Upadhyay <dupadhya@redhat.com>
3 years agosrc/test/cli-integration/rbd: update gwcli_* to use podman exec
Deepika Upadhyay [Wed, 13 Oct 2021 06:30:38 +0000 (12:00 +0530)]
src/test/cli-integration/rbd: update gwcli_* to use podman exec

* since iscsi now resides inside the container, for testing we use the
  hack:
  - find the iscsi container/
  - use found container and podman exec command to test gateway creation
    deletion from host itself

Signed-off-by: Deepika Upadhyay <dupadhya@redhat.com>
3 years agoqa/tasks: adapt ceph_iscsi.py task to ceph_iscsi_client
Deepika Upadhyay [Wed, 13 Oct 2021 06:19:02 +0000 (11:49 +0530)]
qa/tasks: adapt ceph_iscsi.py task to ceph_iscsi_client

* we use setup_iscsi_client.py to deploy iscsi client services,
  configuring intiator and mulitpath this is done by qa task
  ceph_iscsi_client
* qa/cephadm: adds remotes ip addresses to iscsi gateway,
* rename poolname: iscsi >> datapool, which we usually use for tests and
  expresses type of pool more clearly.

Signed-off-by: Deepika Upadhyay <dupadhya@redhat.com>
3 years agoqa/suites/rbd: remove baremetal based setup needed for iscsi testing
Deepika Upadhyay [Wed, 13 Oct 2021 06:17:11 +0000 (11:47 +0530)]
qa/suites/rbd: remove baremetal based setup needed for iscsi testing

* replace ceph baremetal deployment with cephadm based deployment

Signed-off-by: Deepika Upadhyay <dupadhya@redhat.com>
3 years agodoc: add iSCSI initiator client configuration section for cephadm
Deepika Upadhyay [Wed, 13 Oct 2021 06:03:39 +0000 (11:33 +0530)]
doc: add iSCSI initiator client configuration section for cephadm

Signed-off-by: Deepika Upadhyay <dupadhya@redhat.com>
3 years agodoc added msgr on-wire-compression 42839/head
Maya Gilad [Mon, 13 Sep 2021 17:11:39 +0000 (20:11 +0300)]
doc added msgr on-wire-compression

Signed-off-by: Maya Gilad <ms.maya.gilad@gmail.com>
3 years agoqa: reduce frag split confs for dir_split counter test 43566/head
Patrick Donnelly [Fri, 15 Oct 2021 15:08:28 +0000 (11:08 -0400)]
qa: reduce frag split confs for dir_split counter test

Fixes: https://tracker.ceph.com/issues/52949
Fixes: a5675535ba532cfe782238d995751f9bc91f5078
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
3 years agoqa/tasks/backfill_toofull: make test work when compression on 43572/head
Mykola Golub [Wed, 13 Oct 2021 15:22:09 +0000 (18:22 +0300)]
qa/tasks/backfill_toofull: make test work when compression on

The osd backfill reservation does not take compression into account so
we need to operate with "uncompressed" bytes when calculating nearfull
ratio.

Signed-off-by: Mykola Golub <mgolub@suse.com>
3 years agoMerge pull request #43571 from tchaikov/wip-bl-prepare-iovs
Kefu Chai [Sat, 16 Oct 2021 02:57:05 +0000 (10:57 +0800)]
Merge pull request #43571 from tchaikov/wip-bl-prepare-iovs

common/bl: bl::prepare_iovs() related cleanups

Reviewed-by: Xuehan Xu <xxhdx1985126@gmail.com>
3 years agocommon/bl: mark bl::prepare_iovs() const 43571/head
Kefu Chai [Sat, 16 Oct 2021 00:31:08 +0000 (08:31 +0800)]
common/bl: mark bl::prepare_iovs() const

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
3 years agocommon/bl: simplify bl::prepare_iovs()
Kefu Chai [Fri, 15 Oct 2021 23:58:50 +0000 (07:58 +0800)]
common/bl: simplify bl::prepare_iovs()

* consolidate the code to initialize a vector<iov>
* use an iterator to track the current vector<iovec>. less
  repeating this way.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
3 years agocommon/bl: define iov_vec_t using a dedicated struct
Kefu Chai [Fri, 15 Oct 2021 23:48:55 +0000 (07:48 +0800)]
common/bl: define iov_vec_t using a dedicated struct

more readable this way

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
3 years agocommon/bl: move bl::prepare_iovs() to .cc file
Kefu Chai [Fri, 15 Oct 2021 23:35:21 +0000 (07:35 +0800)]
common/bl: move bl::prepare_iovs() to .cc file

to reduce the compilation time by having a smaller header file.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
3 years agoMerge pull request #43478 from anthonyeleven/anthonyeleven/fix-52830
Anthony D'Atri [Fri, 15 Oct 2021 22:34:30 +0000 (15:34 -0700)]
Merge pull request #43478 from anthonyeleven/anthonyeleven/fix-52830

common/options: document rgw_lc_debug_interval configuration option

3 years agoMerge pull request #43537 from xxhdx1985126/wip-seastore-iov-max
Samuel Just [Fri, 15 Oct 2021 22:04:22 +0000 (15:04 -0700)]
Merge pull request #43537 from xxhdx1985126/wip-seastore-iov-max

crimson/os/seastore: deal with scenarios in which bufferlist of do_writev has more than IOV_MAX buffers

Reviewed-by: Samuel Just <sjust@redhat.com>
3 years agomgr/orchestrator: clean up 'orch device ls' output 43569/head
Sage Weil [Tue, 3 Aug 2021 17:25:26 +0000 (13:25 -0400)]
mgr/orchestrator: clean up 'orch device ls' output

- headings in CAPS
- DEVICE ID, not just serial or model/vendor
- drop the health, LED fields from non-wide view
- sort devices
- 'Yes' or '', for easier visual parsing

Signed-off-by: Sage Weil <sage@newdream.net>
3 years agoMerge pull request #43507 from cbodley/wip-rgw-log-spam
Casey Bodley [Fri, 15 Oct 2021 18:05:05 +0000 (14:05 -0400)]
Merge pull request #43507 from cbodley/wip-rgw-log-spam

rgw: hide some unnecessary log spam

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
3 years agoMerge pull request #43488 from cbodley/wip-52873
Casey Bodley [Fri, 15 Oct 2021 18:04:13 +0000 (14:04 -0400)]
Merge pull request #43488 from cbodley/wip-52873

radosgw-admin: 'reshard list' doesn't log ENOENT errors

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
3 years agoMerge pull request #43428 from cfsnyder/wip-52818-random-rgw-req-id
Casey Bodley [Fri, 15 Oct 2021 18:03:37 +0000 (14:03 -0400)]
Merge pull request #43428 from cfsnyder/wip-52818-random-rgw-req-id

rgw/rgw_rados: make RGW request IDs non-deterministic

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
3 years agoMerge pull request #42981 from mkogan1/rgw-d3n-fix-lru-exp
Casey Bodley [Fri, 15 Oct 2021 18:02:26 +0000 (14:02 -0400)]
Merge pull request #42981 from mkogan1/rgw-d3n-fix-lru-exp

rgw: d3n: fix d3n cached objects on disk lru eviction entering infini…

Reviewed-by: Casey Bodley <cbodley@redhat.com>
3 years agoMerge pull request #42208 from BryceCao/wip-add-return-when-access-key-exist-in-subus...
Casey Bodley [Fri, 15 Oct 2021 18:01:58 +0000 (14:01 -0400)]
Merge pull request #42208 from BryceCao/wip-add-return-when-access-key-exist-in-subuser-create

rgw : add return when access key exist in subuser create

Reviewed-by: Casey Bodley <cbodley@redhat.com>
3 years agoMerge pull request #40144 from hualongfeng/osd_compression_bypass
Casey Bodley [Fri, 15 Oct 2021 17:59:58 +0000 (13:59 -0400)]
Merge pull request #40144 from hualongfeng/osd_compression_bypass

rgw: osd compression bypass after rgw compression

Reviewed-by: Casey Bodley <cbodley@redhat.com>
3 years agocommon/options: document rgw_lc_debug_interval configuration option 43478/head
Anthony D'Atri [Sun, 10 Oct 2021 20:25:00 +0000 (13:25 -0700)]
common/options: document rgw_lc_debug_interval configuration option

Signed-off-by: Anthony D'Atri <anthony.datri@gmail.com>
3 years agoMerge pull request #43533 from tchaikov/wip-cmake-less-chatty
Kefu Chai [Fri, 15 Oct 2021 16:10:32 +0000 (00:10 +0800)]
Merge pull request #43533 from tchaikov/wip-cmake-less-chatty

cmake: only pass --verbose when VERBOSE env variable is set

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
3 years agorgw: silence error message for nonexistent realm 43507/head
Casey Bodley [Fri, 15 Oct 2021 15:57:13 +0000 (11:57 -0400)]
rgw: silence error message for nonexistent realm

in a normal vstart cluster without a realm or period, every command
prints this error message:

0 RGWPeriod::init failed to init realm  id  : (2) No such file or directory

Signed-off-by: Casey Bodley <cbodley@redhat.com>
3 years agoMerge PR #43558 into master
Sage Weil [Fri, 15 Oct 2021 15:48:29 +0000 (11:48 -0400)]
Merge PR #43558 into master

* refs/pull/43558/head:
doc/governance.rst: update clt membership

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
3 years agoMerge PR #43430 into master
Patrick Donnelly [Fri, 15 Oct 2021 15:16:25 +0000 (11:16 -0400)]
Merge PR #43430 into master

* refs/pull/43430/head:
qa: skip c-v install on pacific start

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
3 years agoMerge PR #43426 into master
Patrick Donnelly [Fri, 15 Oct 2021 15:15:41 +0000 (11:15 -0400)]
Merge PR #43426 into master

* refs/pull/43426/head:
qa/cephfs: update xfstests_dev for centos stream

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
3 years agoMerge PR #43425 into master
Patrick Donnelly [Fri, 15 Oct 2021 15:13:55 +0000 (11:13 -0400)]
Merge PR #43425 into master

* refs/pull/43425/head:
qa: import CommandFailedError from exceptions not run

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>
3 years agoMerge PR #43420 into master
Patrick Donnelly [Fri, 15 Oct 2021 15:13:05 +0000 (11:13 -0400)]
Merge PR #43420 into master

* refs/pull/43420/head:
qa: skip internal metadata directory when scanning ceph debugfs directory

Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
3 years agoMerge PR #43382 into master
Patrick Donnelly [Fri, 15 Oct 2021 15:11:48 +0000 (11:11 -0400)]
Merge PR #43382 into master

* refs/pull/43382/head:
mds: skip journaling blocklisted clients when in `replay` state

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
3 years agomgr/cephadm: make upgrade ls output structured
Sage Weil [Fri, 15 Oct 2021 15:09:07 +0000 (11:09 -0400)]
mgr/cephadm: make upgrade ls output structured

Signed-off-by: Sage Weil <sage@newdream.net>
3 years agoMerge pull request #43120 from dang/wip-dang-user-load-attrs
Daniel Gryniewicz [Fri, 15 Oct 2021 15:02:18 +0000 (11:02 -0400)]
Merge pull request #43120 from dang/wip-dang-user-load-attrs

RGW Zipper - load user attributes with user

Reviewed-by: Soumya Koduri <skoduri@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
3 years agodoc/cephadm: Hosts: Add "initial CRUSH location" 43564/head
Sebastian Wagner [Fri, 15 Oct 2021 11:13:02 +0000 (13:13 +0200)]
doc/cephadm: Hosts: Add "initial CRUSH location"

Followup on d2a9a35993

Signed-off-by: Sebastian Wagner <sewagner@redhat.com>