]> git-server-git.apps.pok.os.sepia.ceph.com Git - ceph.git/log
ceph.git
3 years agoqa/tasks/rbd_fio: bump default to fio 3.32 48372/head
Ilya Dryomov [Wed, 5 Oct 2022 08:09:28 +0000 (10:09 +0200)]
qa/tasks/rbd_fio: bump default to fio 3.32

fio 3.16 doesn't build against recent kernel headers due to removal of
linux/raw.h.

Fixes: https://tracker.ceph.com/issues/57766
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
3 years agoMerge pull request #48362 from zdover23/wip-doc-2022-10-05-rados-ops-crush-map-edits...
zdover23 [Wed, 5 Oct 2022 05:48:24 +0000 (15:48 +1000)]
Merge pull request #48362 from zdover23/wip-doc-2022-10-05-rados-ops-crush-map-edits-grammar

doc/rados: refine English in crush-map-edits.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>
3 years agodoc/rados: refine English in crush-map-edits.rst 48362/head
Zac Dover [Wed, 14 Sep 2022 05:19:44 +0000 (15:19 +1000)]
doc/rados: refine English in crush-map-edits.rst

This commit makes several refinements to the English in
rados/operations/crush-map-edits.rst, which refinements were suggested
by Cole Mitchell and Anthony D'Atri in the discussion of PR#48085.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
3 years agoMerge pull request #48085 from zdover23/wip-doc-2022-09-14-rados-ops-crush-map-prompt...
zdover23 [Wed, 5 Oct 2022 01:20:14 +0000 (11:20 +1000)]
Merge pull request #48085 from zdover23/wip-doc-2022-09-14-rados-ops-crush-map-prompt-update

doc/rados: update prompts in crush-map-edits.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>
3 years agoMerge pull request #47458 from rzarzynski/wip-all-kickoff-r
Radoslaw Zarzynski [Tue, 4 Oct 2022 20:39:19 +0000 (22:39 +0200)]
Merge pull request #47458 from rzarzynski/wip-all-kickoff-r

kickoff v18 reef

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Guillaume Abrioux <gabrioux@redhat.com>
Reviewed-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
3 years agoMerge pull request #46037 from mohmacht/ebdplugin
Laura Flores [Tue, 4 Oct 2022 14:48:24 +0000 (09:48 -0500)]
Merge pull request #46037 from mohmacht/ebdplugin

blk/kernel: add plugin system for devices with compression and move VDO support into plugin

3 years agoMerge pull request #48346 from zdover23/wip-doc-2022-10-03-glossary-remove-redundancies
zdover23 [Tue, 4 Oct 2022 14:29:19 +0000 (00:29 +1000)]
Merge pull request #48346 from zdover23/wip-doc-2022-10-03-glossary-remove-redundancies

doc/glossary.rst: remove duplicates

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
3 years agodoc/dev/release-checklists: mention LIBRBD_VER_MINOR and VERSION 47458/head
Ilya Dryomov [Tue, 4 Oct 2022 12:17:30 +0000 (14:17 +0200)]
doc/dev/release-checklists: mention LIBRBD_VER_MINOR and VERSION

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
3 years agolibrbd: bump minor version to match R release
Ilya Dryomov [Tue, 4 Oct 2022 12:15:04 +0000 (14:15 +0200)]
librbd: bump minor version to match R release

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
3 years agoMerge pull request #48218 from mchangir/qa-test_scrub_pause_and_resume_with_abort...
Venky Shankar [Tue, 4 Oct 2022 06:15:24 +0000 (11:45 +0530)]
Merge pull request #48218 from mchangir/qa-test_scrub_pause_and_resume_with_abort-wait-for-scrub-to-finish

qa: wait for scrub to finish

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Neeraj Pratap Singh <neesingh@redhat.com>
3 years agodoc, qa/standalone/mon/misc: verify that len(monmap.features.persistent) == 10
Radoslaw Zarzynski [Fri, 30 Sep 2022 09:54:12 +0000 (09:54 +0000)]
doc, qa/standalone/mon/misc: verify that len(monmap.features.persistent) == 10

Also updates the release checklist.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
3 years agodoc/dev/release-checklists.rst: document vX.0.0 tagging and mark it complete.
Radoslaw Zarzynski [Fri, 30 Sep 2022 09:48:07 +0000 (09:48 +0000)]
doc/dev/release-checklists.rst: document vX.0.0 tagging and mark it complete.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
3 years agoMerge pull request #48041 from cbodley/wip-rgw-notify-shutdown
Casey Bodley [Mon, 3 Oct 2022 21:06:10 +0000 (17:06 -0400)]
Merge pull request #48041 from cbodley/wip-rgw-notify-shutdown

rgw: rados service shuts down rados client on shutdown()

Reviewed-by: Soumya Koduri <skoduri@redhat.com>
Reviewed-by: Yuval Lifshitz <ylifshit@redhat.com>
3 years agoMerge pull request #48152 from Vfrost98/GHC22OSD_Ceph
Yuri Weinstein [Mon, 3 Oct 2022 20:21:49 +0000 (13:21 -0700)]
Merge pull request #48152 from Vfrost98/GHC22OSD_Ceph

mgr/telemetry: fixed log exceptions as "exception" instead of "error"

Reviewed-by: Laura Flores <lflores@redhat.com>
Reviewed-by: Yaarit Hatuka <yaarithatuka@gmail.com>
3 years agoMerge pull request #48150 from li3317/ghc-osd-li3317
Yuri Weinstein [Mon, 3 Oct 2022 20:21:00 +0000 (13:21 -0700)]
Merge pull request #48150 from li3317/ghc-osd-li3317

osd: break multi condition asserts into multiple asserts

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
3 years agoMerge pull request #47340 from kamoltat/wip-ksirivad-recreate-zilla-2104207
Yuri Weinstein [Mon, 3 Oct 2022 20:18:18 +0000 (13:18 -0700)]
Merge pull request #47340 from kamoltat/wip-ksirivad-recreate-zilla-2104207

mon/OSDMonitor: Added extra check before mon.go_recovery_stretch_mode()

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
3 years agoMerge pull request #46284 from votdev/issue_55673_cephadm_vagrantfile
Guillaume Abrioux [Mon, 3 Oct 2022 18:39:40 +0000 (20:39 +0200)]
Merge pull request #46284 from votdev/issue_55673_cephadm_vagrantfile

mgr/cephadm: Deploying a cluster with the Vagrantfile fails

3 years agoRGWServices_Def::shutdown() shuts down the rest of the services too 48041/head
Casey Bodley [Thu, 15 Sep 2022 17:37:51 +0000 (13:37 -0400)]
RGWServices_Def::shutdown() shuts down the rest of the services too

Signed-off-by: Casey Bodley <cbodley@redhat.com>
3 years agorgw: shut down RGWDataChangesLog before other services
Casey Bodley [Sun, 11 Sep 2022 22:25:38 +0000 (18:25 -0400)]
rgw: shut down RGWDataChangesLog before other services

Signed-off-by: Casey Bodley <cbodley@redhat.com>
3 years agorgw: rados service shuts down rados client on shutdown()
Casey Bodley [Sun, 11 Sep 2022 22:13:52 +0000 (18:13 -0400)]
rgw: rados service shuts down rados client on shutdown()

if we leave the rados client running, it will keep delivering
AioCompletions while we're shutting other things down

this resolves a valgrind use-after-free where rgw::notify::Manager
gets completions after its destruction

Signed-off-by: Casey Bodley <cbodley@redhat.com>
3 years agoMerge pull request #48155 from liangmingyuanneo/wip-rgw-aync-refcount
Casey Bodley [Mon, 3 Oct 2022 17:14:25 +0000 (13:14 -0400)]
Merge pull request #48155 from liangmingyuanneo/wip-rgw-aync-refcount

rgw: async refcount operate in copy_obj

Reviewed-by: Anthony D Atri <anthony.datri@gmail.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
3 years agoMerge pull request #47186 from cfsnyder/wip-cfsnyder-56645
Casey Bodley [Mon, 3 Oct 2022 16:01:18 +0000 (12:01 -0400)]
Merge pull request #47186 from cfsnyder/wip-cfsnyder-56645

rgw: log deletion status of individual objects in multi object delete request

Reviewed-by: Yuval Lifshitz <ylifshit@redhat.com>
Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
3 years agodoc/glossary.rst: remove duplicates 48346/head
Zac Dover [Mon, 3 Oct 2022 12:51:35 +0000 (22:51 +1000)]
doc/glossary.rst: remove duplicates

This commit removes similar but distinct entries for the following:
   * CephFS
   * Ceph Client

Removal of a glossary term that is referred to in the body of the
documentation suite requires the alteration of the text string
that refers to the glossary term. Alterations of this kind have
been made to doc/architecture.rst and doc/rados/api/index.rst.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
3 years agoMerge pull request #48292 from kotreshhr/doc-symlink-fix
Venky Shankar [Mon, 3 Oct 2022 05:44:33 +0000 (11:14 +0530)]
Merge pull request #48292 from kotreshhr/doc-symlink-fix

doc: Fix disaster recovery doc

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
3 years agoMerge pull request #46821 from batrick/i55470
Venky Shankar [Mon, 3 Oct 2022 04:38:05 +0000 (10:08 +0530)]
Merge pull request #46821 from batrick/i55470

qa: postgresql test suite workunit

Reviewed-by: Venky Shankar <vshankar@redhat.com>
3 years agoMerge pull request #48179 from batrick/i57598
Venky Shankar [Mon, 3 Oct 2022 04:37:13 +0000 (10:07 +0530)]
Merge pull request #48179 from batrick/i57598

qa: use correct recovery procedure for alternate meta pools

Reviewed-by: Venky Shankar <vshankar@redhat.com>
3 years agoMerge pull request #47795 from batrick/i57091
Venky Shankar [Mon, 3 Oct 2022 04:26:44 +0000 (09:56 +0530)]
Merge pull request #47795 from batrick/i57091

mds: check for some dentry damage in scrub

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
3 years agoMerge pull request #48333 from zdover23/wip-doc-2022-10-02-glossary-alphabetize
zdover23 [Mon, 3 Oct 2022 00:37:23 +0000 (10:37 +1000)]
Merge pull request #48333 from zdover23/wip-doc-2022-10-02-glossary-alphabetize

doc/glossary.rst: alphabetize glossary terms

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>
3 years agodoc/glossary.rst: alphabetize glossary terms 48333/head
Zac Dover [Sun, 2 Oct 2022 10:48:36 +0000 (20:48 +1000)]
doc/glossary.rst: alphabetize glossary terms

This commit (finally) alphabetizes the terms in the glossary.
This is not a grammar-correcting or usage-correcting commit.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
3 years agorgw: async refcount operate in copy_obj 48155/head
= [Sat, 17 Sep 2022 10:55:53 +0000 (18:55 +0800)]
rgw: async refcount operate in copy_obj

Signed-off-by: Mingyuan Liang <liangmingyuan@baidu.com>
3 years agoMerge pull request #48332 from zdover23/wip-doc-2022-10-01-rados-ops-ec-prompts
zdover23 [Sun, 2 Oct 2022 11:46:03 +0000 (21:46 +1000)]
Merge pull request #48332 from zdover23/wip-doc-2022-10-01-rados-ops-ec-prompts

doc/rados: fix prompts in erasure-code.rst

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>
3 years agoMerge pull request #48303 from PepperJo/cmp_write_test_bl_greater_fix
Ilya Dryomov [Sun, 2 Oct 2022 08:25:43 +0000 (10:25 +0200)]
Merge pull request #48303 from PepperJo/cmp_write_test_bl_greater_fix

librbd: remove unnecessary write in compare-and-write test

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
3 years agodoc/rados: fix prompts in erasure-code.rst 48332/head
Zac Dover [Sun, 2 Oct 2022 04:55:46 +0000 (14:55 +1000)]
doc/rados: fix prompts in erasure-code.rst

This commit adds unselectable prompts to doc/rados/
erasure-code.rst.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
3 years agoMerge pull request #48322 from zdover23/wip-doc-2022-10-01-rados-ops-ec-front-matter...
zdover23 [Sat, 1 Oct 2022 04:32:10 +0000 (14:32 +1000)]
Merge pull request #48322 from zdover23/wip-doc-2022-10-01-rados-ops-ec-front-matter-rewrite

doc/rados: rewrite EC intro

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>
3 years agodoc/rados: rewrite EC intro 48322/head
Zac Dover [Thu, 1 Sep 2022 19:08:00 +0000 (05:08 +1000)]
doc/rados: rewrite EC intro

This PR rewrites the front matter in the "Erasure Code"
section of the RADOS documentation. Previously, the information
in this section was syntactically confused. I have also fleshed
out the distinction between erasure coding and replication.

Co-Author: Cole Mitchell <cole.mitchell@gmail.com>
Signed-off-by: Zac Dover <zac.dover@gmail.com>
Signed-off-by: Zac Dover <zac.dover@gmail.com>
3 years agoMerge pull request #43567 from jdurgin/wip-gov
Josh Durgin [Sat, 1 Oct 2022 03:05:29 +0000 (20:05 -0700)]
Merge pull request #43567 from jdurgin/wip-gov

doc/governance: add proposed structure

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Zac Dover <zac.dover@gmail.com>
3 years agodoc: merge new and old governance description 43567/head
Josh Durgin [Fri, 30 Sep 2022 23:34:04 +0000 (19:34 -0400)]
doc: merge new and old governance description

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
3 years agodoc/governance: updates based on review comments
Josh Durgin [Fri, 18 Mar 2022 23:20:43 +0000 (19:20 -0400)]
doc/governance: updates based on review comments

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
3 years agoMerge pull request #48072 from ceph/wip-yuriw-release-17.2.4-main
Laura Flores [Fri, 30 Sep 2022 20:22:50 +0000 (15:22 -0500)]
Merge pull request #48072 from ceph/wip-yuriw-release-17.2.4-main

doc: 17.2.4 Release Notes

3 years agodoc: 17.2.4 Release Notes 48072/head
Yuri Weinstein [Tue, 13 Sep 2022 17:21:10 +0000 (10:21 -0700)]
doc: 17.2.4 Release Notes

Fixes: https://tracker.ceph.com/issues/57472
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
Signed-off-by: Laura Flores <lflores@redhat.com>
3 years agoMerge pull request #48259 from ktdreyer/build-win-fixes
Ken Dreyer [Fri, 30 Sep 2022 19:36:29 +0000 (15:36 -0400)]
Merge pull request #48259 from ktdreyer/build-win-fixes

win32: support building windows client on RHEL

Reviewed-by: Lucian Petrut <lpetrut@cloudbasesolutions.com>
Reviewed-by: Justin Caratzas <jcaratza@redhat.com>
3 years agodoc/governance: update based on review and CLT discussions
Josh Durgin [Fri, 11 Mar 2022 20:17:54 +0000 (15:17 -0500)]
doc/governance: update based on review and CLT discussions

Clarified some parts of council that were discussed previously,
specifying the number of members and a staggered term.

Added a bit more about the steering committee - thinking the meetings
could be split between tactical (3/4 weeks) and strategic (monthly),
and still open to anyone to join the discussion, but restricted to
only members voting.

Removed the meeting section since that belongs more in a separate
place, like the ceph.io website.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
3 years agodoc/governance: add proposed structure
Josh Durgin [Fri, 15 Oct 2021 15:36:07 +0000 (11:36 -0400)]
doc/governance: add proposed structure

This is Sage's summary of the Ceph leadership team discussions around
this topic. Still many details to be worked out, this is just one
concrete proposal as a basis for further discussion.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
3 years agodoc: Fix disaster recovery doc 48292/head
Kotresh HR [Thu, 29 Sep 2022 05:11:15 +0000 (10:41 +0530)]
doc: Fix disaster recovery doc

Fixes: https://tracker.ceph.com/issues/57734
Signed-off-by: Kotresh HR <khiremat@redhat.com>
3 years agoMerge pull request #47249 from nSedrickm/aria-labels-accessibility-update
Nizamudeen A [Fri, 30 Sep 2022 05:07:52 +0000 (10:37 +0530)]
Merge pull request #47249 from nSedrickm/aria-labels-accessibility-update

mgr/dashboard: Improve level A accessibility for missing aria labels in tabs and listitems

Reviewed-by: Pegonzal <NOT@FOUND>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
3 years agoMerge pull request #48299 from neha-ojha/wip-crimson-nightlies
Neha Ojha [Thu, 29 Sep 2022 23:44:22 +0000 (16:44 -0700)]
Merge pull request #48299 from neha-ojha/wip-crimson-nightlies

qa/crontab: run crimson-rados on the main branch

Reviewed-by: Sam Just <sjust@redhat.com>
Reviewed-by: Yuri Weinstein <yweinste@redhat.com>
3 years agoMerge pull request #48215 from zmc/osd-containers-tasks
Zack Cerza [Thu, 29 Sep 2022 22:57:30 +0000 (16:57 -0600)]
Merge pull request #48215 from zmc/osd-containers-tasks

qa/tasks: Updates to enable containerized loop-backed OSDs

3 years agoMerge pull request #48300 from zmc/db-e2e-url-fix
Zack Cerza [Thu, 29 Sep 2022 22:54:48 +0000 (16:54 -0600)]
Merge pull request #48300 from zmc/db-e2e-url-fix

mgr/dashboard: Fix broken Fedora image URL

3 years agolibrbd: remove unnecessary write in cmp&write test 48303/head
Jonas Pfefferle [Thu, 29 Sep 2022 20:02:56 +0000 (22:02 +0200)]
librbd: remove unnecessary write in cmp&write test

Remove write in compare and write test that tests
successful completion when bufferlist is greater then len.
The write was redundant and overwritten directly after.

Signed-off-by: Jonas Pfefferle <pepperjo@japf.ch>
3 years agomgr/dashboard: Fix broken Fedora image URL 48300/head
Zack Cerza [Thu, 29 Sep 2022 19:44:46 +0000 (13:44 -0600)]
mgr/dashboard: Fix broken Fedora image URL

This mirror apparently stopped working, breaking jobs that use this
script.

Signed-off-by: Zack Cerza <zack@redhat.com>
3 years agoMerge pull request #47679 from cbodley/wip-rgw-sal-bootstrap
Casey Bodley [Thu, 29 Sep 2022 17:45:00 +0000 (13:45 -0400)]
Merge pull request #47679 from cbodley/wip-rgw-sal-bootstrap

rgw: start on a rgw::sal::ConfigStore for boostrapping other stores

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
3 years agoqa/crontab: run crimson-rados on the main branch 48299/head
Neha Ojha [Thu, 29 Sep 2022 17:44:56 +0000 (17:44 +0000)]
qa/crontab: run crimson-rados on the main branch

It isn't useful to run the crimson suite on Quincy because we don't
backport crimson fixes.

Signed-off-by: Neha Ojha <nojha@redhat.com>
3 years agoMerge pull request #48287 from andriytk/fix-rpmbuild
Casey Bodley [Thu, 29 Sep 2022 17:43:14 +0000 (13:43 -0400)]
Merge pull request #48287 from andriytk/fix-rpmbuild

compressor: fix rpmbuild on RHEL-8

Reviewed-by: Casey Bodley <cbodley@redhat.com>
3 years agoMerge pull request #48194 from zmc/python36-prettytable
Zack Cerza [Thu, 29 Sep 2022 15:46:18 +0000 (09:46 -0600)]
Merge pull request #48194 from zmc/python36-prettytable

3 years agoMerge pull request #48260 from phlogistonjohn/jjm-cephadm-import
Adam King [Thu, 29 Sep 2022 15:00:50 +0000 (11:00 -0400)]
Merge pull request #48260 from phlogistonjohn/jjm-cephadm-import

cephadm: Clean up how test files import/use cephadm as a module

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
3 years agoMerge pull request #47814 from vshankar/wip-57072
Rishabh Dave [Thu, 29 Sep 2022 14:20:47 +0000 (19:50 +0530)]
Merge pull request #47814 from vshankar/wip-57072

pybind/mgr: check for empty metadata mgr_module:get_metadata()

Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>
Reviewed-by: Kotresh HR <khiremat@redhat.com>
Reviewed-by: Neeraj Pratap Singh <neesingh@redhat.com>
3 years agoMerge pull request #48174 from batrick/i57597
Venky Shankar [Thu, 29 Sep 2022 12:44:23 +0000 (18:14 +0530)]
Merge pull request #48174 from batrick/i57597

qa: output debugging for cephfs-journal-tool/cephfs-data-scan

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Kotresh HR <khiremat@redhat.com>
3 years agoMerge pull request #47991 from kotreshhr/qa-fix-57446
Rishabh Dave [Thu, 29 Sep 2022 12:26:35 +0000 (17:56 +0530)]
Merge pull request #47991 from kotreshhr/qa-fix-57446

qa: Fix test_subvolume_snapshot_info_if_orphan_clone

Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
3 years agoMerge pull request #47985 from kotreshhr/qa-fix-57205
Rishabh Dave [Thu, 29 Sep 2022 12:24:24 +0000 (17:54 +0530)]
Merge pull request #47985 from kotreshhr/qa-fix-57205

qa: Fix test_subvolume_group_ls_filter_internal_directories

Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
3 years agoMerge pull request #47879 from lxbsz/wip-57344
Rishabh Dave [Thu, 29 Sep 2022 12:21:31 +0000 (17:51 +0530)]
Merge pull request #47879 from lxbsz/wip-57344

client: fix incorrectly showing the .snap size for stat

Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
3 years agoMerge pull request #48257 from batrick/i57657
Venky Shankar [Thu, 29 Sep 2022 11:55:10 +0000 (17:25 +0530)]
Merge pull request #48257 from batrick/i57657

qa: ignore expected scrub error

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
3 years agoMerge pull request #48264 from batrick/i57677
Venky Shankar [Thu, 29 Sep 2022 11:52:33 +0000 (17:22 +0530)]
Merge pull request #48264 from batrick/i57677

qa: ignore MDS_TRIM warnings when osd thrashing

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
3 years agomds: check for some dentry damage in scrub 47795/head
Patrick Donnelly [Wed, 10 Aug 2022 17:21:26 +0000 (13:21 -0400)]
mds: check for some dentry damage in scrub

Fixes: https://tracker.ceph.com/issues/57091
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
3 years agomds: remove unused method
Patrick Donnelly [Wed, 31 Aug 2022 01:02:32 +0000 (21:02 -0400)]
mds: remove unused method

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
3 years agomds: note damaged dentry with first gt last
Patrick Donnelly [Wed, 24 Aug 2022 17:12:21 +0000 (13:12 -0400)]
mds: note damaged dentry with first gt last

Only when loaded in cache.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
3 years agomds: cluster log scrub failure for dirfrag
Patrick Donnelly [Wed, 24 Aug 2022 17:11:10 +0000 (13:11 -0400)]
mds: cluster log scrub failure for dirfrag

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
3 years agomds: mark dirfrag good if repaired
Patrick Donnelly [Tue, 20 Sep 2022 20:15:27 +0000 (16:15 -0400)]
mds: mark dirfrag good if repaired

Otherwise, we get wrong scrub errors after repair.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
3 years agomds: only dump past_parent_snap if non-empty
Patrick Donnelly [Wed, 24 Aug 2022 17:09:55 +0000 (13:09 -0400)]
mds: only dump past_parent_snap if non-empty

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
3 years agoMerge pull request #48282 from ljflores/wip-telemetry-perf-fix
Yuri Weinstein [Wed, 28 Sep 2022 22:37:11 +0000 (15:37 -0700)]
Merge pull request #48282 from ljflores/wip-telemetry-perf-fix

mgr/telemetry: handle daemons with complex ids

Reviewed-by: Yaarit Hatuka <yaarithatuka@gmail.com>
Reviewed-by: Ken Dreyer <kdreyer@redhat.com>
3 years agoradosgw-admin: use ConfigStore and related zone APIs 47679/head
Casey Bodley [Wed, 7 Sep 2022 18:19:34 +0000 (14:19 -0400)]
radosgw-admin: use ConfigStore and related zone APIs

replaces all of rgw_admin.cc's use of the RGWSystemMetaObj subclasses
with calls to the ConfigStore

Signed-off-by: Casey Bodley <cbodley@redhat.com>
3 years agorgw: add higher-level functions to rgw_zone.*
Casey Bodley [Wed, 7 Sep 2022 18:17:52 +0000 (14:17 -0400)]
rgw: add higher-level functions to rgw_zone.*

duplicates some of the logic from member functions of
RGWRealm/Period/ZoneGroup/ZoneParams, but as free functions in terms
of the sal::ConfigStore APIs

Signed-off-by: Casey Bodley <cbodley@redhat.com>
3 years agoradosgw-admin: fix --tier-config for 'zonegroup add'
Casey Bodley [Fri, 2 Sep 2022 17:52:22 +0000 (13:52 -0400)]
radosgw-admin: fix --tier-config for 'zonegroup add'

ZONEGROUP_ADD applies changes to RGWZoneParams based on the
--tier-config option, but doesn't write those changes to rados

Signed-off-by: Casey Bodley <cbodley@redhat.com>
3 years agoradosgw-admin: create a ConfigStore
Casey Bodley [Thu, 1 Sep 2022 19:54:03 +0000 (15:54 -0400)]
radosgw-admin: create a ConfigStore

Signed-off-by: Casey Bodley <cbodley@redhat.com>
3 years agorgw: add create_config_store() factory
Casey Bodley [Wed, 31 Aug 2022 02:57:39 +0000 (22:57 -0400)]
rgw: add create_config_store() factory

Signed-off-by: Casey Bodley <cbodley@redhat.com>
3 years agorgw: add rgw::sal::ImmutableConfigStore for json-based config
Casey Bodley [Tue, 13 Sep 2022 15:47:46 +0000 (11:47 -0400)]
rgw: add rgw::sal::ImmutableConfigStore for json-based config

Signed-off-by: Casey Bodley <cbodley@redhat.com>
3 years agorgw: add rgw::sal::SQLiteConfigStore
Casey Bodley [Tue, 30 Aug 2022 21:58:09 +0000 (17:58 -0400)]
rgw: add rgw::sal::SQLiteConfigStore

Signed-off-by: Casey Bodley <cbodley@redhat.com>
3 years agorgw: add rgw::sal::RadosConfigStore
Casey Bodley [Mon, 29 Aug 2022 20:08:10 +0000 (16:08 -0400)]
rgw: add rgw::sal::RadosConfigStore

Signed-off-by: Casey Bodley <cbodley@redhat.com>
3 years agorgw: add rgw::sal::ConfigStore
Casey Bodley [Mon, 29 Aug 2022 17:35:52 +0000 (13:35 -0400)]
rgw: add rgw::sal::ConfigStore

Signed-off-by: Casey Bodley <cbodley@redhat.com>
3 years agorgw: RGWRealm/Period/ZoneGroup/ZoneParams are fully public
Casey Bodley [Wed, 7 Sep 2022 18:15:02 +0000 (14:15 -0400)]
rgw: RGWRealm/Period/ZoneGroup/ZoneParams are fully public

Signed-off-by: Casey Bodley <cbodley@redhat.com>
3 years agocompressor: fix rpmbuild on RHEL-8 48287/head
Andriy Tkachuk [Wed, 28 Sep 2022 19:29:09 +0000 (20:29 +0100)]
compressor: fix rpmbuild on RHEL-8

When building rpms on latest RHEL-8.6:

    [  0%] Building CXX object src/compressor/CMakeFiles/compressor_objs.dir/Compressor.cc.o
    In file included from /d/ceph-build/ceph-17.2.3-0-dff484dfc9e/src/common/config_values.h:59,
                     from /d/ceph-build/ceph-17.2.3-0-dff484dfc9e/src/common/config.h:27,
                     from /d/ceph-build/ceph-17.2.3-0-dff484dfc9e/src/common/config_proxy.h:6,
                     from /d/ceph-build/ceph-17.2.3-0-dff484dfc9e/src/common/ceph_context.h:41,
                     from /d/ceph-build/ceph-17.2.3-0-dff484dfc9e/src/compressor/Compressor.cc:23:
    /d/ceph-build/ceph-17.2.3-0-dff484dfc9e/src/common/options/legacy_config_opts.h:1:10: fatal error: global_legacy_options.h: No such file or directory
        1 | #include "global_legacy_options.h"
          |          ^~~~~~~~~~~~~~~~~~~~~~~~~
    compilation terminated.
    make[2]: *** [src/compressor/CMakeFiles/compressor_objs.dir/build.make:76: src/compressor/CMakeFiles/compressor_objs.dir/Compressor.cc.o] Error 1
    make[1]: *** [CMakeFiles/Makefile2:7964: src/compressor/CMakeFiles/compressor_objs.dir/all] Error 2
    make: *** [Makefile:146: all] Error 2
    error: Bad exit status from /var/tmp/rpm-tmp.1CBUsC (%build)

    RPM build errors:
        Bad exit status from /var/tmp/rpm-tmp.1CBUsC (%build)

Solution: add legacy-option-headers dependency to compressor_objs.

Signed-off-by: Andriy Tkachuk <andriy.tkachuk@seagate.com>
3 years agoqa: wait for scrub to finish 48218/head
Milind Changire [Wed, 28 Sep 2022 18:46:12 +0000 (00:16 +0530)]
qa: wait for scrub to finish

Wait for scrub to finish during test_scrub_pause_and_resume_with_abort
which otherwise races and fails with an incorrect assertion.

Fixes: https://tracker.ceph.com/issues/48812
Signed-off-by: Milind Changire <mchangir@redhat.com>
3 years agoblk/kernel: add plugin system for devices with compression and move VDO support into... 46037/head
Martin Ohmacht [Wed, 28 Sep 2022 18:09:04 +0000 (14:09 -0400)]
blk/kernel: add plugin system for devices with compression and move VDO support into plugin

The current VDO support implementation is buried inside the common/blkdev.cc
with a simple interface used by KernelDevice. It is not easily extendable
and can not be easily used for other devices providing similar capabilities.
This patch adds a plugin system that is based in its structure on the
erasure code plugin system and moves the VDO support code into a VDO plugin.

Signed-off-by: Martin Ohmacht <mohmacht@us.ibm.com>
3 years agomgr/telemetry: handle daemons with complex ids 48282/head
Laura Flores [Wed, 28 Sep 2022 17:17:17 +0000 (17:17 +0000)]
mgr/telemetry: handle daemons with complex ids

Treating daemons as `<daemon_type>.x` caused a crash
in the Telemetry module since the current method does not cover a case
where a daemon id is more complex, i.e. `<daemon_type>.x.y`.

When we parse the daemon type and daemon id, we should
split it into a maximum of two pieces rather than splitting
it by every `.` character. Specifying `1` in the Python
.split() function will limit the split to a maximum of two items.

Fixes: https://tracker.ceph.com/issues/57700
Signed-off-by: Laura Flores <lflores@redhat.com>
3 years agoMerge pull request #45379 from tobias-urdin/bump-openstack-versions
Casey Bodley [Wed, 28 Sep 2022 14:51:38 +0000 (10:51 -0400)]
Merge pull request #45379 from tobias-urdin/bump-openstack-versions

qa/suites/rgw: fix and update tempest and barbican tests

Reviewed-by: Casey Bodley <cbodley@redhat.com>
3 years agorgw: fix json format of ops log op data fields for multi object delete 47186/head
Cory Snyder [Thu, 21 Jul 2022 21:51:11 +0000 (17:51 -0400)]
rgw: fix json format of ops log op data fields for multi object delete

The num_ok and num_err fields were being mistakenly dumped as bool values
vs. integers.

Signed-off-by: Cory Snyder <csnyder@iland.com>
3 years agorgw: log deletion status of individual objects in multi object delete request
Cory Snyder [Fri, 15 Jul 2022 02:51:48 +0000 (22:51 -0400)]
rgw: log deletion status of individual objects in multi object delete request

Provides ops log visibility for individual objects that are deleted as part
of a multi-object delete request.

Fixes: https://tracker.ceph.com/issues/56645
Signed-off-by: Cory Snyder <csnyder@iland.com>
3 years agorgw: add hook for RGWOp subclasses to write custom metadata to ops logs
Cory Snyder [Fri, 15 Jul 2022 01:40:22 +0000 (21:40 -0400)]
rgw: add hook for RGWOp subclasses to write custom metadata to ops logs

Adds a write_ops_log_entry method to the RGWOp class to allow it's
subclasses an opportunity to modify the request ops log entry.

Signed-off-by: Cory Snyder <csnyder@iland.com>
3 years agoMerge pull request #48267 from rhcs-dashboard/nfs-exports-fs-permission-error
Pedro Gonzalez Gomez [Wed, 28 Sep 2022 07:26:17 +0000 (09:26 +0200)]
Merge pull request #48267 from rhcs-dashboard/nfs-exports-fs-permission-error

mgr/dashboard: handle the cephfs permission issue in nfs exports

Reviewed-by: Pedro González Gómez <pegonzal@redhat.com>
Reviewed-by: Aashish Sharma <aasharma@redhat.com>
3 years agoMerge pull request #48114 from athanatos/sjust/wip-crimson-multicore-for-review
Samuel Just [Tue, 27 Sep 2022 23:03:23 +0000 (16:03 -0700)]
Merge pull request #48114 from athanatos/sjust/wip-crimson-multicore-for-review

crimson: multicore support for pgs in crimson-osd

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
3 years agocephadm: rename import from cephadm to _cephadm 48260/head
John Mulligan [Tue, 27 Sep 2022 18:51:00 +0000 (14:51 -0400)]
cephadm: rename import from cephadm to _cephadm

To be consistent with the other test_*.py files.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
3 years agocephadm: rename import from cd to _cephadm
John Mulligan [Tue, 27 Sep 2022 18:50:44 +0000 (14:50 -0400)]
cephadm: rename import from cd to _cephadm

The `cd` name is an abbreviation of an obsolete name for cephadm.
As this is not widely known it could be confusing or conflict with
other common terms like `cd` for "change dir" or "compact disc".
Therefore we rename it to something much clearer.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
3 years agocephadm: rename import from cd to _cephadm
John Mulligan [Tue, 27 Sep 2022 18:50:24 +0000 (14:50 -0400)]
cephadm: rename import from cd to _cephadm

The `cd` name is an abbreviation of an obsolete name for cephadm.
As this is not widely known it could be confusing or conflict with
other common terms like `cd` for "change dir" or "compact disc".
Therefore we rename it to something much clearer.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
3 years agocephadm: rename import from cd to _cephadm
John Mulligan [Tue, 27 Sep 2022 18:49:39 +0000 (14:49 -0400)]
cephadm: rename import from cd to _cephadm

The `cd` name is an abbreviation of an obsolete name for cephadm.
As this is not widely known it could be confusing or conflict with
other common terms like `cd` for "change dir" or "compact disc".
Therefore we rename it to something much clearer.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
3 years agocephadm: fix some nonstandard formatting in fixtures.py
John Mulligan [Mon, 26 Sep 2022 19:33:41 +0000 (15:33 -0400)]
cephadm: fix some nonstandard formatting in fixtures.py

Signed-off-by: John Mulligan <jmulligan@redhat.com>
3 years agocephadm: remove trailing whitespace
John Mulligan [Mon, 26 Sep 2022 19:30:47 +0000 (15:30 -0400)]
cephadm: remove trailing whitespace

Signed-off-by: John Mulligan <jmulligan@redhat.com>
3 years agocephadm: lazily import cephadm in fixtures.py
John Mulligan [Mon, 26 Sep 2022 19:30:25 +0000 (15:30 -0400)]
cephadm: lazily import cephadm in fixtures.py

We can avoid creating side-effects in the cephadm module by only importing
the module in the functions that are meant to generate side effects.
Simply importing fixtures and not calling any of the functions now can
not change cephadm by accident.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
3 years agocephadm: remove container_engine argument from test helper function
John Mulligan [Mon, 26 Sep 2022 19:20:25 +0000 (15:20 -0400)]
cephadm: remove container_engine argument from test helper function

The with_cephadm_ctx test helper function had an argument that *called*
mock_podman function, thus calling the function at import-time. This can
lead to confusing and unexpected side effects. Because the
container_engine argument is not used by any callers of with_cephadm_ctx
we remove the argument.
All other callers of with_cephadm_ctx that make use of container engine
are already setting `ctx.container_engine = <xyz>` so removing the
argument makes it harder to make the same mistake again in the future.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
3 years agocephadm: fix iscsi test_unit_run relying on how cephadm was being imported
John Mulligan [Mon, 26 Sep 2022 19:14:20 +0000 (15:14 -0400)]
cephadm: fix iscsi test_unit_run relying on how cephadm was being imported

The iscsi test_unit_run test case was relying upon a strange side-effect
of how the cephadm module was being imported in fixtures.py. In short,
it expected the podman container_engine not to be a subclass of Podman.

```
(Pdb) p ctx.container_engine
<Mock spec='Podman' id='140676342644256'>
(Pdb) p ctx.container_engine.__class__
<class 'cephadm.Podman'>
(Pdb) p isinstance(ctx.container_engine, Podman)
False
(Pdb) p id(ctx.container_engine.__class__)
94372514199712
(Pdb) p id(Podman)
94372516682112
```

In order to clean up fixtures.py and other imports of cephadm as a
module, we fix the test to expect a mock docker. We choose docker
because it only requires changes the path of the container engine. If we
changed it to a real podman subclass we'd have to change many arguments
in the expected CLI text.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
3 years agocephadm: use import_cephadm function in test_*.py files
John Mulligan [Mon, 26 Sep 2022 15:20:58 +0000 (11:20 -0400)]
cephadm: use import_cephadm function in test_*.py files

Any current or future chicanery needed to import cephadm is now isolated
in one place, and doesn't need to be repeated in every file.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
3 years agocephadm: use a function to encapsulate loading cephadm as a module
John Mulligan [Mon, 26 Sep 2022 15:19:48 +0000 (11:19 -0400)]
cephadm: use a function to encapsulate loading cephadm as a module

Instead of "open coding" all the cephadm imports let's do it in a
reusable function.

Signed-off-by: John Mulligan <jmulligan@redhat.com>