]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
3 years agorgw: bucket sync: fetch source bucket info 47120/head
Yehuda Sadeh [Fri, 15 Jul 2022 19:57:53 +0000 (15:57 -0400)]
rgw: bucket sync: fetch source bucket info

Fixes: https://tracker.ceph.com/issues/56576
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
3 years agoMerge pull request #46238 from Huber-ming/storage_class_in_checkdiskstate
Casey Bodley [Wed, 8 Jun 2022 15:16:02 +0000 (11:16 -0400)]
Merge pull request #46238 from Huber-ming/storage_class_in_checkdiskstate

rgw: check object storage_class when check_disk_state

Reviewed-by: Casey Bodley <cbodley@redhat.com>
3 years agoMerge pull request #44052 from cfsnyder/wip-53367-log-access-key-ops-logs
Casey Bodley [Wed, 8 Jun 2022 15:15:53 +0000 (11:15 -0400)]
Merge pull request #44052 from cfsnyder/wip-53367-log-access-key-ops-logs

rgw: log access key id in ops logs

Reviewed-by: Casey Bodley <cbodley@redhat.com>
3 years agoMerge pull request #46540 from yaarith/rook-telemetry-release-notes
Neha Ojha [Wed, 8 Jun 2022 14:33:41 +0000 (07:33 -0700)]
Merge pull request #46540 from yaarith/rook-telemetry-release-notes

PendingReleaseNotes: add a note about Rook telemetry

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
3 years agoMerge pull request #46482 from ceph/feature-54330-osd-creation-workflow
Ernesto Puerta [Wed, 8 Jun 2022 12:04:48 +0000 (14:04 +0200)]
Merge pull request #46482 from ceph/feature-54330-osd-creation-workflow

mgr/dashboard: Feature 54330 osd creation workflow

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
3 years agoMerge pull request #46458 from yuvalif/wip-yuval-objecter-latency
Yuval Lifshitz [Wed, 8 Jun 2022 07:59:35 +0000 (10:59 +0300)]
Merge pull request #46458 from yuvalif/wip-yuval-objecter-latency

objecter: add op latency stat and in-flight count
Reviwed-by: cbodley, adamemerson
3 years agoMerge pull request #42779 from Matan-B/lua-rgw-map
Yuval Lifshitz [Wed, 8 Jun 2022 05:32:35 +0000 (08:32 +0300)]
Merge pull request #42779 from Matan-B/lua-rgw-map

rgw: Lua scripting global map feature
Reviwed-by: dang, cbodley, yuvalif, anthonyeleven, tchaikov, mattbenjamin, batrick
3 years agoMerge pull request #46514 from adk3798/fqdn-autotune
Adam King [Wed, 8 Jun 2022 00:54:02 +0000 (20:54 -0400)]
Merge pull request #46514 from adk3798/fqdn-autotune

mgr/cephadm: use host shortname for osd memory autotuning

Reviewed-by: Guillaume Abrioux <gabrioux@redhat.com>
Reviewed-by: Redouane Kachach <rkachach@redhat.com>
3 years agoMerge pull request #46517 from guits/cephadm-upgrade-status-is_paused
Adam King [Wed, 8 Jun 2022 00:52:40 +0000 (20:52 -0400)]
Merge pull request #46517 from guits/cephadm-upgrade-status-is_paused

cephadm: add 'is_paused' field in orch status output

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
3 years agoMerge pull request #46539 from adk3798/master-main-cleanup2
Adam King [Wed, 8 Jun 2022 00:51:06 +0000 (20:51 -0400)]
Merge pull request #46539 from adk3798/master-main-cleanup2

mgr/cephadm: some master -> main cleanup

Reviewed-by: David Galloway <dgallowa@redhat.com>
Reviewed-by: Redouane Kachach <rkachach@redhat.com>
3 years agoMerge pull request #44234 from lxbsz/wip-53504
Venky Shankar [Tue, 7 Jun 2022 17:29:09 +0000 (22:59 +0530)]
Merge pull request #44234 from lxbsz/wip-53504

client: always return ESTALE directly in handle_reply

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Milind Changire <mchangir@redhat.com>
3 years agoMerge pull request #44247 from neesingh-rh/fix-52982
Venky Shankar [Tue, 7 Jun 2022 17:26:35 +0000 (22:56 +0530)]
Merge pull request #44247 from neesingh-rh/fix-52982

client: Inode::hold_caps_until is time from monotonic clock now.

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
3 years agoMerge pull request #46210 from vshankar/wip-54701
Venky Shankar [Tue, 7 Jun 2022 17:20:20 +0000 (22:50 +0530)]
Merge pull request #46210 from vshankar/wip-54701

mds: do not assert early on when issuing client leases

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Xiubo Li <xiubli@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
3 years agoMerge pull request #44335 from SMIL-Infra/export-unlinked-dir
Venky Shankar [Tue, 7 Jun 2022 17:17:36 +0000 (22:47 +0530)]
Merge pull request #44335 from SMIL-Infra/export-unlinked-dir

mds: fix crash when exporting unlinked dir

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Xiubo Li <xiubli@redhat.com>
3 years agoMerge pull request #46078 from kotreshhr/fuse-directory-dacs-issue
Venky Shankar [Tue, 7 Jun 2022 17:15:05 +0000 (22:45 +0530)]
Merge pull request #46078 from kotreshhr/fuse-directory-dacs-issue

client/fuse: Fix directory DACs overriding for root

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
3 years agoMerge pull request #46267 from tshacked/fix_24894
Venky Shankar [Tue, 7 Jun 2022 17:14:01 +0000 (22:44 +0530)]
Merge pull request #46267 from tshacked/fix_24894

client: allow overwrites to file with size greater than the max_file_size

Reviewed-by: Venky Shankar <vshankar@redhat.com>
3 years agoMerge pull request #46371 from aliakseimakarau/fs_multifs_fix
Venky Shankar [Tue, 7 Jun 2022 16:38:09 +0000 (22:08 +0530)]
Merge pull request #46371 from aliakseimakarau/fs_multifs_fix

mds/fsmap: proper update of filesystems

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
3 years agoMerge pull request #46398 from lxbsz/feature-cleanup
Venky Shankar [Tue, 7 Jun 2022 16:36:24 +0000 (22:06 +0530)]
Merge pull request #46398 from lxbsz/feature-cleanup

mds, client: remove useless feature required code

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
3 years agoMerge pull request #46405 from mgfritch/ceph-backport-fw-slash
Adam King [Tue, 7 Jun 2022 15:27:21 +0000 (11:27 -0400)]
Merge pull request #46405 from mgfritch/ceph-backport-fw-slash

script/ceph-backport.sh: consume excess forward slash chars

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Kefu Chai <tchaikov@gmail.com>
3 years agoMerge pull request #46263 from rhcs-dashboard/rbd-mirroring-snapshot
Ernesto Puerta [Tue, 7 Jun 2022 14:25:57 +0000 (16:25 +0200)]
Merge pull request #46263 from rhcs-dashboard/rbd-mirroring-snapshot

mgr/dashboard: rbd mirroring snapshot support

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
3 years agoobjecter: add op latency stat and in-flight count 46458/head
yuval Lifshitz [Tue, 31 May 2022 15:40:30 +0000 (18:40 +0300)]
objecter: add op latency stat and in-flight count

this is done in order to better estimate the origin of the end-to-end
operation latency. and see how much of it is due to the objecter and how
much of it is due to the client that uses it (e.g. the RGW)

Signed-off-by: yuval Lifshitz <ylifshit@redhat.com>
3 years agoMerge pull request #46261 from dang/wip-dang-zipper-req-id
Daniel Gryniewicz [Tue, 7 Jun 2022 12:44:33 +0000 (08:44 -0400)]
Merge pull request #46261 from dang/wip-dang-zipper-req-id

RGW - Zipper - Provide default get_new_req_id()

Reviewed-by: Casey Bodley <cbodley@redhat.com>
3 years agoMerge pull request #46403 from soumyakoduri/wip-skoduri-syncpolicy-crash
Casey Bodley [Tue, 7 Jun 2022 12:28:47 +0000 (08:28 -0400)]
Merge pull request #46403 from soumyakoduri/wip-skoduri-syncpolicy-crash

rgw: Avoid dereferencing nullptr while configuring bucket sync policy

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
3 years agoMerge pull request #46479 from rhcs-dashboard/rbd-mirroring-list-primary
Pere Diaz Bou [Tue, 7 Jun 2022 09:32:48 +0000 (11:32 +0200)]
Merge pull request #46479 from rhcs-dashboard/rbd-mirroring-list-primary

mgr/dashboard: add rbd primary info

Reviewed-by: Sarthak Gupta <sarthak.dev.0702@gmail.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
3 years agoMerge pull request #46473 from liu-chunmei/crimson-no-rollback
Liu-Chunmei [Tue, 7 Jun 2022 09:12:18 +0000 (02:12 -0700)]
Merge pull request #46473 from liu-chunmei/crimson-no-rollback

crimson/osd: don't do rollback when object not exists

3 years agoMerge pull request #46045 from idryomov/wip-qa-rwl-on-tmpfs
Ilya Dryomov [Tue, 7 Jun 2022 08:39:31 +0000 (10:39 +0200)]
Merge pull request #46045 from idryomov/wip-qa-rwl-on-tmpfs

qa/suites/rbd: place cache file on tmpfs for xfstests

Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com>
3 years agoMerge pull request #46440 from ronen-fr/wip-rf-scrub-trimisbad
Ronen Friedman [Tue, 7 Jun 2022 08:03:28 +0000 (11:03 +0300)]
Merge pull request #46440 from ronen-fr/wip-rf-scrub-trimisbad

osd/scrub: do not start scrubbing if the PG is snap-trimming

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
3 years agocephadm: add 'is_paused' field in orch status output 46517/head
Guillaume Abrioux [Fri, 3 Jun 2022 15:16:54 +0000 (17:16 +0200)]
cephadm: add 'is_paused' field in orch status output

it can be convenient for automation tool if `orch status` output reports
whether the upgrade is currently paused.

Fixes: https://tracker.ceph.com/issues/55843
Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>
3 years agoMerge pull request #46538 from adamemerson/wip-remove-unbuilt-rgw
Casey Bodley [Mon, 6 Jun 2022 22:22:19 +0000 (18:22 -0400)]
Merge pull request #46538 from adamemerson/wip-remove-unbuilt-rgw

rgw: Remove rgw_json_enc.cc which is not built

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
3 years agoMerge pull request #46396 from xxhdx1985126/wip-backref-buffer-optimization
Samuel Just [Mon, 6 Jun 2022 21:45:35 +0000 (14:45 -0700)]
Merge pull request #46396 from xxhdx1985126/wip-backref-buffer-optimization

crimson/os/seastore/backref: don't merge in-cache backrefs that has already been released

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
3 years agoPendingReleaseNotes: add a note about Rook telemetry 46540/head
Yaarit Hatuka [Mon, 6 Jun 2022 19:34:19 +0000 (19:34 +0000)]
PendingReleaseNotes: add a note about Rook telemetry

Signed-off-by: Yaarit Hatuka <yaarit@redhat.com>
3 years agomgr/cephadm: some master -> main cleanup 46539/head
Adam King [Mon, 6 Jun 2022 19:18:08 +0000 (15:18 -0400)]
mgr/cephadm: some master -> main cleanup

Signed-off-by: Adam King <adking@redhat.com>
3 years agoMerge pull request #46537 from cbodley/wip-55901
Casey Bodley [Mon, 6 Jun 2022 18:31:06 +0000 (14:31 -0400)]
Merge pull request #46537 from cbodley/wip-55901

rgw: fix un/signed comparison warnings in rgw_admin.cc

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
3 years agoMerge pull request #46536 from cbodley/wip-55898
Casey Bodley [Mon, 6 Jun 2022 18:07:24 +0000 (14:07 -0400)]
Merge pull request #46536 from cbodley/wip-55898

rgw: fix un/signed comparison warnings in rgw_sync.cc

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
3 years agorgw: Remove rgw_json_enc.cc which is not built 46538/head
Adam C. Emerson [Mon, 6 Jun 2022 17:10:51 +0000 (13:10 -0400)]
rgw: Remove rgw_json_enc.cc which is not built

This was removed from the build in a refactor but not removed from the tree.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
3 years agorgw: fix un/signed comparison warnings in rgw_admin.cc 46537/head
Casey Bodley [Mon, 6 Jun 2022 17:00:14 +0000 (13:00 -0400)]
rgw: fix un/signed comparison warnings in rgw_admin.cc

Fixes: https://tracker.ceph.com/issues/55901
Signed-off-by: Casey Bodley <cbodley@redhat.com>
3 years agomgr/cephadm: use hostname from crush map for osd memory autotuning 46514/head
Adam King [Fri, 3 Jun 2022 01:32:53 +0000 (21:32 -0400)]
mgr/cephadm: use hostname from crush map for osd memory autotuning

Fixes: https://tracker.ceph.com/issues/55841
Signed-off-by: Adam King <adking@redhat.com>
3 years agoMerge pull request #46376 from adk3798/cache-size
Adam King [Mon, 6 Jun 2022 16:50:09 +0000 (12:50 -0400)]
Merge pull request #46376 from adk3798/cache-size

mgr/cephadm: store device info separately from rest of host cache

Reviewed-by: Redouane Kachach <rkachach@redhat.com>
3 years agoMerge pull request #46502 from adk3798/default-image-master-main
Adam King [Mon, 6 Jun 2022 16:48:46 +0000 (12:48 -0400)]
Merge pull request #46502 from adk3798/default-image-master-main

cephadm: master -> main updates

Reviewed-by: Michael Fritch <mfritch@suse.com>
Reviewed-by: Redouane Kachach <rkachach@redhat.com>
3 years agoRGW - Zipper - Provide default get_new_req_id() 46261/head
Daniel Gryniewicz [Thu, 12 May 2022 17:48:44 +0000 (13:48 -0400)]
RGW - Zipper - Provide default get_new_req_id()

Now that RadorStore's get_new_req_id() just returns a random number, use
that as the default implementation for SAL.

Signed-off-by: Daniel Gryniewicz <dang@redhat.com>
3 years agorgw: fix un/signed comparison warnings in rgw_sync.cc 46536/head
Casey Bodley [Mon, 6 Jun 2022 16:06:19 +0000 (12:06 -0400)]
rgw: fix un/signed comparison warnings in rgw_sync.cc

Fixes: https://tracker.ceph.com/issues/55898
Signed-off-by: Casey Bodley <cbodley@redhat.com>
3 years agomgr/dashboard: snapshot mirroring from dashboard 46263/head
Pere Diaz Bou [Fri, 13 May 2022 15:15:33 +0000 (17:15 +0200)]
mgr/dashboard: snapshot mirroring from dashboard

Enable snapshot mirroring from the Pools -> Image

Also show the mirror-snapshot in the image where snapshot is enabled

When parsing images if an image has the snapshot mode enabled, it will
try to  run commands that don't work with that mode. The solution was
not running those for now and appending the mode in the get call.

Fixes: https://tracker.ceph.com/issues/55648
Signed-off-by: Pere Diaz Bou <pdiazbou@redhat.com>
Signed-off-by: Nizamudeen A <nia@redhat.com>
Signed-off-by: Aashish Sharma <aasharma@redhat.com>
Signed-off-by: Avan Thakkar <athakkar@redhat.com>
3 years agoMerge pull request #46452 from ceph/fix-codeowners_api-master
Ernesto Puerta [Mon, 6 Jun 2022 15:40:09 +0000 (17:40 +0200)]
Merge pull request #46452 from ceph/fix-codeowners_api-master

codeowners: remove api team

Reviewed-by: Sarthak Gupta <sarthak.dev.0702@gmail.com>
Reviewed-by: nSedrickm <NOT@FOUND>
Reviewed-by: Nizamudeen A <nia@redhat.com>
3 years agomds: do not assert early on when issuing client leases 46210/head
Venky Shankar [Thu, 5 May 2022 09:24:01 +0000 (05:24 -0400)]
mds: do not assert early on when issuing client leases

Move the relevant ceph_assert()'s when the MDS is issuing leases
to clients since clients may not be capable of reading projected
linkages.

Fixes: http://tracker.ceph.com/issues/54701
Signed-off-by: Venky Shankar <vshankar@redhat.com>
3 years agoMerge PR #46516 into main
Patrick Donnelly [Mon, 6 Jun 2022 12:48:39 +0000 (08:48 -0400)]
Merge PR #46516 into main

* refs/pull/46516/head:
doc/dev/developer_guide/testing_integration_tests: document how to test custom kernels

Reviewed-by: Xiubo Li <xiubli@redhat.com>
Reviewed-by: Anthony D Atri <anthony.datri@gmail.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
3 years agorgw: log identity applier metadata in ops logs 44052/head
Cory Snyder [Wed, 1 Jun 2022 09:04:24 +0000 (05:04 -0400)]
rgw: log identity applier metadata in ops logs

As relevant, logs the access key id, subuser, and whether a request was made
via a temp_url in the ops logs for auditing purposes.

Fixes: https://tracker.ceph.com/issues/53367
Signed-off-by: Cory Snyder <csnyder@iland.com>
3 years agomds, client: remove useless feature required code 46398/head
Xiubo Li [Thu, 26 May 2022 06:13:24 +0000 (14:13 +0800)]
mds, client: remove useless feature required code

This code was added but never ever used.

Signed-off-by: Xiubo Li <xiubli@redhat.com>
3 years agoMerge pull request #46165 from rishabh-d-dave/qa-omit-sudo
Venky Shankar [Mon, 6 Jun 2022 05:53:11 +0000 (11:23 +0530)]
Merge pull request #46165 from rishabh-d-dave/qa-omit-sudo

qa/cephfs: set omit_sudo False when sudo is set to True

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Nikhilkumar Shelke <nshelke@redhat.com>
3 years agoMerge pull request #46168 from rishabh-d-dave/fix-caps-helper
Venky Shankar [Mon, 6 Jun 2022 05:50:58 +0000 (11:20 +0530)]
Merge pull request #46168 from rishabh-d-dave/fix-caps-helper

qa/cephfs: fix minor bug in caps_helper.py's run_mon_cap_tests()

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
3 years agoMerge pull request #40434 from rishabh-d-dave/fs-refactor-method-in-mount
Venky Shankar [Mon, 6 Jun 2022 05:49:54 +0000 (11:19 +0530)]
Merge pull request #40434 from rishabh-d-dave/fs-refactor-method-in-mount

qa/cephfs: modify get_key_from_keyfile() in mount.py

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>
3 years agomgr/dashboard: add rbd primary info 46479/head
Pere Diaz Bou [Wed, 1 Jun 2022 10:44:35 +0000 (12:44 +0200)]
mgr/dashboard: add rbd primary info

Signed-off-by: Pere Diaz Bou <pdiazbou@redhat.com>
3 years agoMerge pull request #46522 from tchaikov/wip-crimson-logging
Kefu Chai [Mon, 6 Jun 2022 00:30:46 +0000 (08:30 +0800)]
Merge pull request #46522 from tchaikov/wip-crimson-logging

crimson/osd: reset logger before exit

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
3 years agoMerge pull request #46416 from tchaikov/wip-debian-dh-python3
Kefu Chai [Sun, 5 Jun 2022 13:44:41 +0000 (21:44 +0800)]
Merge pull request #46416 from tchaikov/wip-debian-dh-python3

debian: python3 related cleanups

Reviewed-by: Redouane Kachach <rkachach@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
3 years agocrimson/osd: reset logger before exit 46522/head
Kefu Chai [Sun, 5 Jun 2022 10:30:28 +0000 (18:30 +0800)]
crimson/osd: reset logger before exit

* extract the code to set logging fstream into a dedicated function
* do not reset logging until the end of the seastar application.

before this change, `reset_logger` is created in the
`if (auto log_file = local_conf()->log_file; !log_file.empty())` branch,
so its life cycle ends when the `if` block ends. in other words,
the cerr fstream is used for logging after the `if` block ends.
this is not the expected behavior.

after this changge, `reset_logger` is created out of the `if` block.
so we won't reset the logger back to `cerr` until the lambda passed to
`seastar::async()` exits.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
3 years agocrimson/os/seastore/backref: tolerate removing non-existing backrefs 46396/head
Xuehan Xu [Wed, 25 May 2022 10:45:02 +0000 (18:45 +0800)]
crimson/os/seastore/backref: tolerate removing non-existing backrefs

Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
3 years agocrimson/os/seastore/cache: don't index already removed backref entries in Cache:...
Xuehan Xu [Fri, 13 May 2022 08:29:23 +0000 (16:29 +0800)]
crimson/os/seastore/cache: don't index already removed backref entries in Cache::backref_buffer

This is needed by extent splitting, and can avoid inserting/removing
unnecessary backrefs

Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
3 years agoMerge pull request #46483 from yaarith/rook-telemetry
Neha Ojha [Fri, 3 Jun 2022 20:12:48 +0000 (13:12 -0700)]
Merge pull request #46483 from yaarith/rook-telemetry

mgr/telemetry: add Rook data

Reviewed-by: Laura Flores <lflores@redhat.com>
3 years agoMerge pull request #46417 from xxhdx1985126/wip-gc-parallel-live_extent_retrieval
Samuel Just [Fri, 3 Jun 2022 19:06:35 +0000 (12:06 -0700)]
Merge pull request #46417 from xxhdx1985126/wip-gc-parallel-live_extent_retrieval

crimson/os/seastore/segment_cleaner: parallel live extents retrieval

Reviewed-by: Samuel Just <sjust@redhat.com>
3 years agodoc/dev/developer_guide/testing_integration_tests: document how to test custom kernels 46516/head
Patrick Donnelly [Fri, 3 Jun 2022 14:11:31 +0000 (10:11 -0400)]
doc/dev/developer_guide/testing_integration_tests: document how to test custom kernels

Fixes: https://tracker.ceph.com/issues/55530
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
3 years agoqa/suites/rbd: place cache file on tmpfs for xfstests 46045/head
Ilya Dryomov [Sun, 24 Apr 2022 15:30:49 +0000 (17:30 +0200)]
qa/suites/rbd: place cache file on tmpfs for xfstests

The RWL mode needs DAX and is dog slow otherwise -- qemu_xfstests.yaml
job always hits the 6 hour max_job_time limit.

As our tmpfs instance is limited and qemu_xfstests.yaml opens three
images at the same time, reduce the "big cache" size to 5G.  This facet
was added to iron out 32-bit head/tail pointer issues and 5G still does
the job there.

Going through the loop device is needed because tmpfs doesn't support
O_DIRECT.

Fixes: https://tracker.ceph.com/issues/55400
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
3 years agoMerge pull request #46480 from cfsnyder/wip-cfsnyder-device-classes-in-service-spec
Adam King [Fri, 3 Jun 2022 15:46:54 +0000 (11:46 -0400)]
Merge pull request #46480 from cfsnyder/wip-cfsnyder-device-classes-in-service-spec

python-common: allow crush device class to be set from osd service spec

Reviewed-by: Adam King <adking@redhat.com>
3 years agotest/crimson/seastore: add test case for parallel extent retrieval 46417/head
Xuehan Xu [Thu, 2 Jun 2022 13:33:57 +0000 (21:33 +0800)]
test/crimson/seastore: add test case for parallel extent retrieval

Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
3 years agocrimson/os/seastore/cache: make access to Transaction::read_set atomic
Xuehan Xu [Wed, 1 Jun 2022 10:44:30 +0000 (18:44 +0800)]
crimson/os/seastore/cache: make access to Transaction::read_set atomic

Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
3 years agoMerge pull request #46505 from rhcs-dashboard/fix-backports_main-main
Ernesto Puerta [Fri, 3 Jun 2022 12:02:55 +0000 (14:02 +0200)]
Merge pull request #46505 from rhcs-dashboard/fix-backports_main-main

script/ceph-backport.sh: deal with main branch

Reviewed-by: Laura Flores <lflores@redhat.com>
Reviewed-by: nmshelke <NOT@FOUND>
Reviewed-by: Kefu Chai <kchai@redhat.com>
3 years agoMerge pull request #46186 from rhcs-dashboard/add-daemon-logs
Ernesto Puerta [Fri, 3 Jun 2022 10:09:56 +0000 (12:09 +0200)]
Merge pull request #46186 from rhcs-dashboard/add-daemon-logs

mgr/dashboard: Add daemon logs tab to Logs component

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: sunilangadi2 <NOT@FOUND>
3 years agoMerge pull request #46283 from MrFreezeex/mixin-config
Ernesto Puerta [Fri, 3 Jun 2022 10:05:58 +0000 (12:05 +0200)]
Merge pull request #46283 from MrFreezeex/mixin-config

ceph-mixin: fix linting issue and add cluster template support

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
3 years agoMerge pull request #46454 from idryomov/wip-rbd-unlink-newest-snap-at-capacity
Ilya Dryomov [Fri, 3 Jun 2022 09:51:41 +0000 (11:51 +0200)]
Merge pull request #46454 from idryomov/wip-rbd-unlink-newest-snap-at-capacity

librbd: unlink newest mirror snapshot when at capacity, bump capacity

Reviewed-by: Arthur Outhenin-Chalandre <arthur.outhenin-chalandre@cern.ch>
Reviewed-by: Mykola Golub <mgolub@suse.com>
3 years agoMerge pull request #46434 from idryomov/wip-rbd-preserve-non-primary-snap
Ilya Dryomov [Fri, 3 Jun 2022 09:50:41 +0000 (11:50 +0200)]
Merge pull request #46434 from idryomov/wip-rbd-preserve-non-primary-snap

rbd-mirror: don't prune non-primary snapshot when restarting delta sync

Reviewed-by: Arthur Outhenin-Chalandre <arthur.outhenin-chalandre@cern.ch>
Reviewed-by: Mykola Golub <mgolub@suse.com>
3 years agoqa/cephfs: modify get_key_from_keyfile() in mount.py 40434/head
Rishabh Dave [Fri, 26 Mar 2021 11:32:38 +0000 (17:02 +0530)]
qa/cephfs: modify get_key_from_keyfile() in mount.py

CephFSMount.get_key_from_keyfile() should raise an exception instead of
returning None if key is not found in keyring file.

Fixes: https://tracker.ceph.com/issues/50010
Signed-off-by: Rishabh Dave <ridave@redhat.com>
3 years agoMerge pull request #46411 from pcuzner/add-serial-numbers
Adam King [Thu, 2 Jun 2022 23:01:01 +0000 (19:01 -0400)]
Merge pull request #46411 from pcuzner/add-serial-numbers

cephadm: Add server serial info to gather-facts

Reviewed-by: Adam King <adking@redhat.com>
3 years agoMerge pull request #46444 from rkachach/fix_issue_55800
Adam King [Thu, 2 Jun 2022 23:00:17 +0000 (19:00 -0400)]
Merge pull request #46444 from rkachach/fix_issue_55800

mgr/cephadm: check if a service exists before trying to restart it

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
3 years agoMerge pull request #46445 from rkachach/fix_issue_55801
Adam King [Thu, 2 Jun 2022 22:59:02 +0000 (18:59 -0400)]
Merge pull request #46445 from rkachach/fix_issue_55801

mgr/cephadm: capture exception when not able to list upgrade tags

Reviewed-by: Adam King <adking@redhat.com>
3 years agoMerge pull request #46481 from guits/cephadm-custom-names-osd-adoption
Adam King [Thu, 2 Jun 2022 22:58:24 +0000 (18:58 -0400)]
Merge pull request #46481 from guits/cephadm-custom-names-osd-adoption

cephadm: fix osd adoption with custom cluster name

Reviewed-by: Adam King <adking@redhat.com>
3 years agoqa/suites/rbd: refactor persistent-writeback-cache suite
Ilya Dryomov [Sun, 24 Apr 2022 15:28:53 +0000 (17:28 +0200)]
qa/suites/rbd: refactor persistent-writeback-cache suite

Rename to pwl-cache, introduce home subdirectory and 4-cache-path.yaml.
No functional changes.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
3 years agoMerge pull request #39002 from ceph/wip-rgw-multisite-reshard
Casey Bodley [Thu, 2 Jun 2022 20:04:30 +0000 (16:04 -0400)]
Merge pull request #39002 from ceph/wip-rgw-multisite-reshard

rgw multisite: bucket reshard work in progress

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
3 years agoMerge pull request #45470 from ceph/wip-setx
Ernesto Puerta [Thu, 2 Jun 2022 17:22:59 +0000 (19:22 +0200)]
Merge pull request #45470 from ceph/wip-setx

run-backend-api-tests.sh: set -x for Jenkins job debugging

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
3 years agoMerge pull request #44684 from zenomri/wip-omri-tracing-compiled
Yuval Lifshitz [Thu, 2 Jun 2022 17:22:17 +0000 (20:22 +0300)]
Merge pull request #44684 from zenomri/wip-omri-tracing-compiled

tracer: set tracing compiled in by default

3 years agoscript/ceph-backport.sh: deal with main branch 46505/head
Ernesto Puerta [Thu, 2 Jun 2022 15:11:33 +0000 (17:11 +0200)]
script/ceph-backport.sh: deal with main branch

Signed-off-by: Ernesto Puerta <epuertat@redhat.com>
3 years agoMerge pull request #43216 from k0ste/fix_47537
Anthony D'Atri [Thu, 2 Jun 2022 15:41:25 +0000 (08:41 -0700)]
Merge pull request #43216 from k0ste/fix_47537

doc/mgr: Document wildcard to expose Prometheus metrics for all RBD pools and namespaces

3 years agopython-common: allow crush device class to be set from osd service spec 46480/head
Cory Snyder [Wed, 1 Jun 2022 09:39:11 +0000 (05:39 -0400)]
python-common: allow crush device class to be set from osd service spec

Adds crush_device_class parameter to DriveGroupSpec so that device class
can be set via service specs with cephadm.

Fixes: https://tracker.ceph.com/issues/55813
Signed-off-by: Cory Snyder <csnyder@iland.com>
3 years agocephadm: master -> main updates 46502/head
Adam King [Thu, 2 Jun 2022 14:57:29 +0000 (10:57 -0400)]
cephadm: master -> main updates

As part of the work to change the name of the
"master" branch to "main" in Ceph repos a few things
should change in the cephadm binary as well

Signed-off-by: Adam King <adking@redhat.com>
3 years agoMerge pull request #46019 from yushu20171007/fix_issue_55422
Casey Bodley [Thu, 2 Jun 2022 14:47:22 +0000 (10:47 -0400)]
Merge pull request #46019 from yushu20171007/fix_issue_55422

common: notify all when max backlog reached in OutputDataSocket

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
3 years agoMerge pull request #46501 from rhcs-dashboard/fix-55826-master
Ernesto Puerta [Thu, 2 Jun 2022 12:13:26 +0000 (14:13 +0200)]
Merge pull request #46501 from rhcs-dashboard/fix-55826-master

qa: fix teuthology master branch ref

Reviewed-by: amathuria <NOT@FOUND>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
3 years agoqa: fix teuthology master branch ref 46501/head
Ernesto Puerta [Thu, 2 Jun 2022 10:27:02 +0000 (12:27 +0200)]
qa: fix teuthology master branch ref

Fixes: https://tracker.ceph.com/issues/55826
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>
3 years agodoc/mgr: Document wildcard to expose Prometheus metrics for all RBD pools and namespaces 43216/head
Konstantin Shalygin [Sat, 18 Sep 2021 10:22:14 +0000 (17:22 +0700)]
doc/mgr: Document wildcard to expose Prometheus metrics for all RBD pools and namespaces

Fixes: https://tracker.ceph.com/issues/47537
Signed-off-by: Konstantin Shalygin <k0ste@k0ste.ru>
3 years agoMerge pull request #46272 from sshambar/bug-55664
Adam King [Wed, 1 Jun 2022 21:44:54 +0000 (17:44 -0400)]
Merge pull request #46272 from sshambar/bug-55664

cephadm: preserve cephadm user during RPM upgrade

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
3 years agocrimson/osd: don't do rollback when object not exists 46473/head
chunmei-liu [Wed, 1 Jun 2022 06:10:10 +0000 (23:10 -0700)]
crimson/osd: don't do rollback when object not exists

otherwise the follwoing operation's obc change will be discarded.

Signed-off-by: chunmei-liu <chunmei.liu@intel.com>
3 years agoscript/ceph-backport.sh: consume excess forward slash chars 46405/head
Michael Fritch [Thu, 26 May 2022 18:19:13 +0000 (12:19 -0600)]
script/ceph-backport.sh: consume excess forward slash chars

when attempting to determine the upstream remote
(e.g. `git@github.com:/ceph/ceph`)

Fixes: https://tracker.ceph.com/issues/55775
Signed-off-by: Michael Fritch <mfritch@suse.com>
3 years agoMerge pull request #46488 from jtlayton/teuth-branch-fix
David Galloway [Wed, 1 Jun 2022 19:17:03 +0000 (15:17 -0400)]
Merge pull request #46488 from jtlayton/teuth-branch-fix

qa: remove .teuthology_branch file

3 years agoqa: remove .teuthology_branch file 46488/head
Jeff Layton [Wed, 1 Jun 2022 18:26:33 +0000 (14:26 -0400)]
qa: remove .teuthology_branch file

This was originally added to help support the py2 -> py3 conversion.
That's long since complete so we should be able to just remove this file
now.

Signed-off-by: Jeff Layton <jlayton@redhat.com>
3 years agoMerge pull request #46487 from jtlayton/teuth-branch-fix
David Galloway [Wed, 1 Jun 2022 18:18:00 +0000 (14:18 -0400)]
Merge pull request #46487 from jtlayton/teuth-branch-fix

qa: fix .teuthology_branch file in qa/

3 years agotest/rgw/multisite: enable zonegroup resharding feature 39002/head
Casey Bodley [Wed, 1 Jun 2022 18:10:24 +0000 (14:10 -0400)]
test/rgw/multisite: enable zonegroup resharding feature

qa/tasks/rgw_multisite.py uses 'zonegroup set' to create zonegroups from
their json format. this doesn't enable any of the supported zonegroup
features by default, so this adds the 'enabled_features' field to the
json representations

Signed-off-by: Casey Bodley <cbodley@redhat.com>
3 years agoqa: fix .teuthology_branch file in qa/ 46487/head
Jeff Layton [Wed, 1 Jun 2022 17:57:29 +0000 (13:57 -0400)]
qa: fix .teuthology_branch file in qa/

According to teuthology-suite:

  -t <branch>, --teuthology-branch <branch>
                              The teuthology branch to run against.
                              Default value is determined in the next order.
                              There is TEUTH_BRANCH environment variable set.
                              There is `qa/.teuthology_branch` present in
                              the suite repo and contains non-empty string.
                              There is `teuthology_branch` present in one of
                              the user or system `teuthology.yaml` configuration
                              files respectively, otherwise use `main`.

The .teuthology_branch file in the qa/ dir currently points at "master".
Change it to point to "main".

Signed-off-by: Jeff Layton <jlayton@redhat.com>
3 years agocephadm: fix osd adoption with custom cluster name 46481/head
Guillaume Abrioux [Wed, 1 Jun 2022 11:24:50 +0000 (13:24 +0200)]
cephadm: fix osd adoption with custom cluster name

When adopting Ceph OSD containers from a Ceph cluster with a custom name, it fails
because the name isn't propagated in unit.run.
The idea here is to change the lvm metadata and enforce 'ceph.cluster_name=ceph'
given that cephadm doesn't support custom names anyway.

Fixes: https://tracker.ceph.com/issues/55654
Signed-off-by: Adam King <adking@redhat.com>
Co-authored-by: Guillaume Abrioux <gabrioux@redhat.com>
3 years agoMerge pull request #46474 from idryomov/wip-rbd-codeowners
Ilya Dryomov [Wed, 1 Jun 2022 16:29:38 +0000 (18:29 +0200)]
Merge pull request #46474 from idryomov/wip-rbd-codeowners

CODEOWNERS: add RBD team

Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com>
3 years agoCODEOWNERS: add RBD team 46474/head
Ilya Dryomov [Wed, 1 Jun 2022 07:22:15 +0000 (09:22 +0200)]
CODEOWNERS: add RBD team

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
3 years agocrimson/os/seastore/segment_cleaner: retrieve different live extents in parallel
Xuehan Xu [Sat, 28 May 2022 08:38:30 +0000 (16:38 +0800)]
crimson/os/seastore/segment_cleaner: retrieve different live extents in parallel

Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
3 years agomgr/cephadm: capture exception when not able to list upgrade tags 46445/head
Redouane Kachach [Tue, 31 May 2022 10:59:26 +0000 (12:59 +0200)]
mgr/cephadm: capture exception when not able to list upgrade tags
Fixes: https://tracker.ceph.com/issues/55801
Signed-off-by: Redouane Kachach <rkachach@redhat.com>
3 years agoosd/scrub: do not start scrubbing if the PG is snap-trimming 46440/head
Ronen Friedman [Tue, 31 May 2022 07:14:06 +0000 (07:14 +0000)]
osd/scrub: do not start scrubbing if the PG is snap-trimming

Both 'snap-trim' and 'snaptrim-wait' PG states now prevent
scrub from starting.

Background:
A PG should not be scrubbed and trimmed concurrently. Unlike
write operations, snap trimming does not verify that a targeted
object is not in the executing scrub's chunk.
The trimmer always checked for active scrubs before starting. The
scrubber - did not. This PR fixes that omission.

Fixes: https://tracker.ceph.com/issues/49525
Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
3 years agomgr/telemetry: add Rook data 46483/head
Yaarit Hatuka [Wed, 1 Jun 2022 04:46:17 +0000 (04:46 +0000)]
mgr/telemetry: add Rook data

Add the first Rook data collection to telemetry's basic channel.

We choose to nag with this collection since we wish to know the volume
of Rook deployments in the wild.

The next Rook collections should have consecutive numbers (basic_rook_v02,
basic_rook_v03, ...).

See tracker below for more details.

Fixes: https://tracker.ceph.com/issues/55740
Signed-off-by: Yaarit Hatuka <yaarit@redhat.com>