]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
3 years agoMerge pull request #43789 from sebastian-philipp/could-not-locate-podmanb
Sebastian Wagner [Wed, 10 Nov 2021 10:08:25 +0000 (11:08 +0100)]
Merge pull request #43789 from sebastian-philipp/could-not-locate-podmanb

cephadm: Avoid "Could not locate podman: podman not found"

Reviewed-by: Michael Fritch <mfritch@suse.com>
3 years agoMerge pull request #43825 from Daniel-Pivonka/cephadm_upgrade_name_already_inuse
Sebastian Wagner [Wed, 10 Nov 2021 10:08:11 +0000 (11:08 +0100)]
Merge pull request #43825 from Daniel-Pivonka/cephadm_upgrade_name_already_inuse

cephadm: fix upgrade name already in use

Reviewed-by: Adam King <adking@redhat.com>
3 years agoMerge pull request #43853 from cyx1231st/wip-seastore-fix-journal-write-boundary
Samuel Just [Wed, 10 Nov 2021 02:03:20 +0000 (18:03 -0800)]
Merge pull request #43853 from cyx1231st/wip-seastore-fix-journal-write-boundary

crimson/os/seastore: fix journal updates to the write boundaries

Reviewed-by: Samuel Just <sjust@redhat.com>
3 years agoMerge PR #43290 into master
Sage Weil [Wed, 10 Nov 2021 01:04:30 +0000 (20:04 -0500)]
Merge PR #43290 into master

* refs/pull/43290/head:
.github/pull_request_template: address review comments
.github/pull_request_template.md: update
.github/workflows/pr-checklist: add checklist action

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
3 years agoMerge PR #43821 into master
Sage Weil [Wed, 10 Nov 2021 01:00:23 +0000 (20:00 -0500)]
Merge PR #43821 into master

* refs/pull/43821/head:
mgr/cephadm: allow osd spec removal
mgr/orchestrator: pass 'force' flag down for remove_service

Reviewed-by: Adam King <adking@redhat.com>
3 years agoMerge pull request #43527 from sskaur/pybind-rados-omap-cmp
Yuri Weinstein [Tue, 9 Nov 2021 20:24:40 +0000 (12:24 -0800)]
Merge pull request #43527 from sskaur/pybind-rados-omap-cmp

pybind: add wrapper for rados_write_op_omap_cmp

Reviewed-by: Kefu Chai <kchai@redhat.com>
3 years agoMerge pull request #43403 from ronen-fr/wip-rf-scrub-deep-v2
Yuri Weinstein [Tue, 9 Nov 2021 20:24:03 +0000 (12:24 -0800)]
Merge pull request #43403 from ronen-fr/wip-rf-scrub-deep-v2

osd/scrub: expose PGs scrubbing schedule to the operator

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Matan Breizman <Matan.Brz@gmail.com>
3 years agoMerge pull request #43677 from majianpeng/remove-larger-debug-message
Deepika Upadhyay [Tue, 9 Nov 2021 20:02:10 +0000 (01:32 +0530)]
Merge pull request #43677 from majianpeng/remove-larger-debug-message

librbd/pwl: don't need print cache_bl contents.

Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com>
3 years agoMerge pull request #43585 from anthonyeleven/anthonyeleven/fix-with-legacy
Yuri Weinstein [Tue, 9 Nov 2021 19:30:13 +0000 (11:30 -0800)]
Merge pull request #43585 from anthonyeleven/anthonyeleven/fix-with-legacy

common/options: fix typo

Reviewed-by: Kefu Chai <kchai@redhat.com>
3 years agoMerge pull request #43844 from dang/wip-dang-zipper-doc
Daniel Gryniewicz [Tue, 9 Nov 2021 18:05:14 +0000 (13:05 -0500)]
Merge pull request #43844 from dang/wip-dang-zipper-doc

RGW Zipper - Cleanup and API doc pass

3 years agomgr/cephadm: allow osd spec removal 43821/head
Sage Weil [Fri, 5 Nov 2021 15:39:07 +0000 (11:39 -0400)]
mgr/cephadm: allow osd spec removal

OSD specs/drivegroups are essentially templates for OSD creation but do
not map to the full lifecycle of the OSDs that they create.  When a spec
is removed, remove it immediately.

If no --force is provided, the error lists which OSDs will be left behind.
If --force is passed, the service is removed.

This leaves behind a few oddities:

- When you list services, OSDs that were created by the drivegroup may
  still exist, causing the drivegroup to appear in the list as
  unmanaged services.
- If you create a new drivegroup with the same name, the prior OSDs will
  appear to belong to the new spec instance, regardless of whether the
  spec/drivegroup parameters are the same.

Signed-off-by: Sage Weil <sage@newdream.net>
3 years agomgr/orchestrator: pass 'force' flag down for remove_service
Sage Weil [Mon, 8 Nov 2021 17:04:27 +0000 (12:04 -0500)]
mgr/orchestrator: pass 'force' flag down for remove_service

Signed-off-by: Sage Weil <sage@newdream.net>
3 years agoMerge pull request #43836 from ronen-fr/wip-rf-atomic-enums
Ronen Friedman [Tue, 9 Nov 2021 15:13:01 +0000 (17:13 +0200)]
Merge pull request #43836 from ronen-fr/wip-rf-atomic-enums

crimson/common: disable arithmetic operators for atomic enums

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
3 years agoMerge pull request #43525 from ceph/wip-yuriw-release-15.2.15-master
David Galloway [Tue, 9 Nov 2021 14:01:34 +0000 (09:01 -0500)]
Merge pull request #43525 from ceph/wip-yuriw-release-15.2.15-master

doc: 15.2.15 Release Notes

3 years agoRGW Zipper - Initial round of API docs 43844/head
Daniel Gryniewicz [Thu, 21 Oct 2021 17:50:45 +0000 (13:50 -0400)]
RGW Zipper - Initial round of API docs

This is the initial round of API docs for Zipper, in the form of Doxygen
comments.  It's not detailed document, but it's a start.

Signed-off-by: Daniel Gryniewicz <dang@redhat.com>
3 years agoRGW Zipper - API Cleanups
Daniel Gryniewicz [Thu, 21 Oct 2021 14:54:00 +0000 (10:54 -0400)]
RGW Zipper - API Cleanups

During the documentation pass for the Zipper API, a number of cleanups
were found: APIs that should be slightly different, or that were unused
entirely.  This is a rollup commit of all those cleanups.

- move get_multipart_upload() to Bucket
- remove unused defer_gc
- move create_bucket() into User
- rename get_bucket_info() to load_bucket() to match load_user()
- Remove read_bucket_stats()
  The codepaths using read_bucket_stats() used CLS data types, and the
  function is confusingly named.  Load the ent in load_bucket(), and use
  an alternative data structure to get size stats for the bucket.
- rename get_bucket_stats to read_stats
- Remove remove_metadata() from API
- remove copy_obj_data() from API
- rename get_obj_layout to dump_obj_layout
- use SAL range_to_ofs

Signed-off-by: Daniel Gryniewicz <dang@redhat.com>
3 years agoMerge pull request #42479 from ronen-fr/wip-ronenf-scrub-prefix
Ronen Friedman [Tue, 9 Nov 2021 13:00:31 +0000 (15:00 +0200)]
Merge pull request #42479 from ronen-fr/wip-ronenf-scrub-prefix

osd/scrub: remove Scrubber sub-objects reliance on PG::gen_prefix()

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
3 years agoMerge pull request #43730 from nmshelke/newline-vstart-help
Venky Shankar [Tue, 9 Nov 2021 12:50:43 +0000 (18:20 +0530)]
Merge pull request #43730 from nmshelke/newline-vstart-help

vstart.sh: print newline character after vstart.sh help text

Reviewed-by: Venky Shankar <vshankar@redhat.com>
3 years agoMerge pull request #43414 from joscollin/wip-update-get-involved-cephfs
Jos Collin [Tue, 9 Nov 2021 11:35:27 +0000 (17:05 +0530)]
Merge pull request #43414 from joscollin/wip-update-get-involved-cephfs

doc: update get-involved for cephfs

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
3 years agovstart.sh: print newline character after vstart.sh help text 43730/head
Nikhilkumar Shelke [Fri, 29 Oct 2021 06:44:18 +0000 (12:14 +0530)]
vstart.sh: print newline character after vstart.sh help text

Without this newline character the help text messes up the
expected position of the prompt string.

Signed-off-by: Nikhilkumar Shelke <nshelke@redhat.com>
3 years agodoc: update dev list and kernel client 43414/head
Jos Collin [Tue, 22 Dec 2020 13:04:24 +0000 (18:34 +0530)]
doc: update dev list and kernel client

Signed-off-by: Jos Collin <jcollin@redhat.com>
3 years agodoc: update #cephfs channel
Jos Collin [Tue, 22 Dec 2020 12:31:30 +0000 (18:01 +0530)]
doc: update #cephfs channel

Signed-off-by: Jos Collin <jcollin@redhat.com>
3 years agocrimson/os/seastore/journal: fix updates to journal seq head and target 43853/head
Yingxin Cheng [Mon, 8 Nov 2021 03:52:50 +0000 (11:52 +0800)]
crimson/os/seastore/journal: fix updates to journal seq head and target

* update journal sequences at the write boundary;
* update journal head to the sequence of write end;

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
3 years agocrimson/os/seastore/journal: mark committed_to at the write boundary
Yingxin Cheng [Fri, 5 Nov 2021 08:00:16 +0000 (16:00 +0800)]
crimson/os/seastore/journal: mark committed_to at the write boundary

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
3 years agoMerge pull request #43835 from xxhdx1985126/wip-segment-avail-bytes
Samuel Just [Mon, 8 Nov 2021 23:22:05 +0000 (15:22 -0800)]
Merge pull request #43835 from xxhdx1985126/wip-segment-avail-bytes

crimson/os/seastore/segment_cleaner: initialize segments' avail_bytes…

Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>
Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
3 years agoMerge pull request #43754 from cyx1231st/wip-seastore-fix-journal-committed-to
Samuel Just [Mon, 8 Nov 2021 20:59:40 +0000 (12:59 -0800)]
Merge pull request #43754 from cyx1231st/wip-seastore-fix-journal-committed-to

crimson/os/seastore: fix ordered updates to JournalSegmentManager::committed_to

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Xuehan Xu <xxhdx1985126@gmail.com>
3 years agoMerge PR #43827 into master
Sage Weil [Mon, 8 Nov 2021 19:43:25 +0000 (14:43 -0500)]
Merge PR #43827 into master

* refs/pull/43827/head:
qa/suites/orch/cephadm: add repave-all test case
mgr/cephadm/services/osd: less noisy
mgr/cephadm/services/osd: do not log ok-to-stop/safe-to-destroy failures
mgr/orchestrator: clean up 'orch osd rm status'

Reviewed-by: Adam King <adking@redhat.com>
3 years agoMerge pull request #43699 from sebastian-philipp/qa-rados-mgr-random-objectstore
Yuri Weinstein [Mon, 8 Nov 2021 17:51:27 +0000 (09:51 -0800)]
Merge pull request #43699 from sebastian-philipp/qa-rados-mgr-random-objectstore

qa/suites/rados/mgr: use only one objectstore instead of all

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
3 years agoMerge pull request #43621 from ifed01/wip-ifed-fix-53011
Yuri Weinstein [Mon, 8 Nov 2021 17:50:33 +0000 (09:50 -0800)]
Merge pull request #43621 from ifed01/wip-ifed-fix-53011

os/bluestore: use proper prefix when removing undecodable Share Blob.

Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
3 years agoMerge pull request #43635 from adk3798/agent-responsiveness
Sebastian Wagner [Mon, 8 Nov 2021 16:15:55 +0000 (17:15 +0100)]
Merge pull request #43635 from adk3798/agent-responsiveness

mgr/cephadm: improve agent responsiveness

Reviewed-by: Daniel Pivonka <dpivonka@redhat.com>
Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
3 years agoMerge pull request #43574 from sabzco/ceph-volume-fix
Guillaume Abrioux [Mon, 8 Nov 2021 13:16:42 +0000 (14:16 +0100)]
Merge pull request #43574 from sabzco/ceph-volume-fix

ceph-volume: fix a typo causing AttributeError

3 years agoMerge pull request #43679 from guits/cv_quick_update_tests
Guillaume Abrioux [Mon, 8 Nov 2021 09:27:41 +0000 (10:27 +0100)]
Merge pull request #43679 from guits/cv_quick_update_tests

ceph-volume/tests: update setup_mixed_type playbook

3 years agocrimson/common: disable arithmetic operators for atomic enums 43836/head
Ronen Friedman [Sun, 7 Nov 2021 09:03:59 +0000 (11:03 +0200)]
crimson/common: disable arithmetic operators for atomic enums

While class enums are 'integral types', they do not support
all that an int does.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
3 years agocrimson/os/seastore/segment_cleaner: initialize segments' avail_bytes with segments... 43835/head
Xuehan Xu [Sun, 7 Nov 2021 07:47:02 +0000 (15:47 +0800)]
crimson/os/seastore/segment_cleaner: initialize segments' avail_bytes with segments' sizes

Currently, we initialize segments' avail_bytes with "segment_size * num_segments". Both segment_size
and num_segments are 32 bits long, multiplying them would lead to overflow.

Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
3 years agoMerge PR #43826 into master
Sage Weil [Sat, 6 Nov 2021 16:29:53 +0000 (12:29 -0400)]
Merge PR #43826 into master

* refs/pull/43826/head:
mgr/cephadm: allow zapping devices from other clusters

Reviewed-by: Adam King <adking@redhat.com>
3 years agoqa/suites/orch/cephadm: add repave-all test case 43827/head
Sage Weil [Fri, 5 Nov 2021 19:00:10 +0000 (15:00 -0400)]
qa/suites/orch/cephadm: add repave-all test case

Signed-off-by: Sage Weil <sage@newdream.net>
3 years agomgr/cephadm/services/osd: less noisy
Sage Weil [Fri, 5 Nov 2021 18:37:58 +0000 (14:37 -0400)]
mgr/cephadm/services/osd: less noisy

Signed-off-by: Sage Weil <sage@newdream.net>
3 years agomgr/cephadm/services/osd: do not log ok-to-stop/safe-to-destroy failures
Sage Weil [Fri, 5 Nov 2021 18:37:47 +0000 (14:37 -0400)]
mgr/cephadm/services/osd: do not log ok-to-stop/safe-to-destroy failures

These failures are normal and expected; they should not pollute the log.

Signed-off-by: Sage Weil <sage@newdream.net>
3 years ago.github/pull_request_template: address review comments 43290/head
Sage Weil [Thu, 21 Oct 2021 15:20:20 +0000 (10:20 -0500)]
.github/pull_request_template: address review comments

Signed-off-by: Sage Weil <sage@newdream.net>
3 years agomgr/cephadm: allow zapping devices from other clusters 43826/head
Sage Weil [Fri, 5 Nov 2021 18:36:54 +0000 (14:36 -0400)]
mgr/cephadm: allow zapping devices from other clusters

This is the 99% of the devices that ever get zapped.

Fixes: b7782084ac9657be9b2da6ebd56b5029cf859225
Signed-off-by: Sage Weil <sage@newdream.net>
3 years agoMerge pull request #43814 from neha-ojha/wip-more-cv
Neha Ojha [Fri, 5 Nov 2021 18:37:57 +0000 (11:37 -0700)]
Merge pull request #43814 from neha-ojha/wip-more-cv

qa/suites/upgrade/octopus-x/stress-split-no-cephadm: exclude ceph-volume

Reviewed-by: Yuri Weinstein <yweinste@redhat.com>
3 years agomgr/orchestrator: clean up 'orch osd rm status'
Sage Weil [Fri, 5 Nov 2021 18:24:47 +0000 (14:24 -0400)]
mgr/orchestrator: clean up 'orch osd rm status'

Signed-off-by: Sage Weil <sage@newdream.net>
3 years agocephadm: fix upgrade name already in use 43825/head
Daniel Pivonka [Fri, 5 Nov 2021 17:54:36 +0000 (13:54 -0400)]
cephadm: fix upgrade name already in use

Signed-off-by: Daniel Pivonka <dpivonka@redhat.com>
3 years agoMerge pull request #43808 from cbodley/wip-qa-rgw-java-master
Ali Maredia [Fri, 5 Nov 2021 16:34:53 +0000 (12:34 -0400)]
Merge pull request #43808 from cbodley/wip-qa-rgw-java-master

qa/rgw: master branch targets ceph-master branch of java_s3tests

3 years agodoc: document new scrub-related 'pg dump' columns 43403/head
Ronen Friedman [Thu, 4 Nov 2021 06:09:27 +0000 (08:09 +0200)]
doc: document new scrub-related 'pg dump' columns

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
3 years agoosd/scrub: update the stand-alone tests to check 'scrub scheduling' entries
Ronen Friedman [Mon, 25 Oct 2021 16:03:05 +0000 (16:03 +0000)]
osd/scrub: update the stand-alone tests to check 'scrub scheduling' entries

Analyzing and verifying the relevant entries in 'pg query' and
'pg dump' output.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
3 years agoosd/scrub: scrubbing schedule - minor related cleanups
Ronen Friedman [Mon, 1 Nov 2021 12:08:57 +0000 (12:08 +0000)]
osd/scrub: scrubbing schedule - minor related cleanups

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
3 years agoosd/scrub: expose scrubbing schedule to operator
Ronen Friedman [Tue, 21 Sep 2021 10:53:20 +0000 (10:53 +0000)]
osd/scrub: expose scrubbing schedule to operator

Add a 'scrub scheduling info' column to pgs dump.
Modify the name and behavior of 'last-scrub-duration'.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
Co-Authored-By: Aishwarya Mathuria <amathuri@redhat.com>
3 years agoMerge pull request #43807 from sebastian-philipp/osd_memory_target_autotune-true
Sebastian Wagner [Fri, 5 Nov 2021 14:09:20 +0000 (15:09 +0100)]
Merge pull request #43807 from sebastian-philipp/osd_memory_target_autotune-true

doc/cephadm: Recommend osd_memory_target_autotune

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Sage Weil <sage@newdream.net>
3 years agodoc/cephadm: Recommend osd_memory_target_autotune 43807/head
Sebastian Wagner [Thu, 4 Nov 2021 15:49:21 +0000 (16:49 +0100)]
doc/cephadm: Recommend osd_memory_target_autotune

In case the cluster runs on hardware that is used exclusively for
Ceph, let's recommend `osd_memory_target_autotune`

Signed-off-by: Sebastian Wagner <sewagner@redhat.com>
3 years agoqa/suites/upgrade/octopus-x/stress-split-no-cephadm: exclude ceph-volume 43814/head
Neha Ojha [Mon, 1 Nov 2021 23:55:22 +0000 (23:55 +0000)]
qa/suites/upgrade/octopus-x/stress-split-no-cephadm: exclude ceph-volume

To address failures like

```
Command failed on smithi096 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.2.15-11-g5f8f263c-1focal ceph-mds=15.2.15-11-g5f8f263c-1focal ceph-mgr=15.2.15-11-g5f8f263c-1focal ceph-common=15.2.15-11-g5f8f263c-1focal ceph-fuse=15.2.15-11-g5f8f263c-1focal ceph-test=15.2.15-11-g5f8f263c-1focal ceph-volume=15.2.15-11-g5f8f263c-1focal radosgw=15.2.15-11-g5f8f263c-1focal python3-rados=15.2.15-11-g5f8f263c-1focal python3-rgw=15.2.15-11-g5f8f263c-1focal python3-cephfs=15.2.15-11-g5f8f263c-1focal python3-rbd=15.2.15-11-g5f8f263c-1focal libcephfs2=15.2.15-11-g5f8f263c-1focal librados2=15.2.15-11-g5f8f263c-1focal librbd1=15.2.15-11-g5f8f263c-1focal rbd-fuse=15.2.15-11-g5f8f263c-1focal'
```

Signed-off-by: Neha Ojha <nojha@redhat.com>
3 years agoMerge pull request #43406 from ljflores/wip-telemetry-perf-improvements 43819/head
Neha Ojha [Thu, 4 Nov 2021 21:27:48 +0000 (14:27 -0700)]
Merge pull request #43406 from ljflores/wip-telemetry-perf-improvements

mgr/telemetry: add mempool stats to telemetry perf report

Reviewed-by: Yaarit Hatuka <yaarit@redhat.com>
3 years agoMerge PR #42727 into master
Sage Weil [Thu, 4 Nov 2021 21:14:19 +0000 (17:14 -0400)]
Merge PR #42727 into master

* refs/pull/42727/head:
mgr/orchestrator: improve usage string for 'orch daemon add osd'
ceph-volume: activate: try simple mode too
mgr/cephadm: identify and instantiate raw osds post-create
mgr/orchestrator: accept --method arg to 'orch daemon add osd'
python-common: drivegroup: add 'method' property
cephadm: use generic ceph-volume activate
ceph-volume: top-level 'activate' command
ceph-volume: lvm activate: add --no-tmpfs
ceph-volume: lvm activate: infer bluestore or filestore
ceph-volume: raw activate: accept --osd-id and/or --osd-uuid instead of device

Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
Reviewed-by: Guillaume Abrioux <gabrioux@redhat.com>
3 years agoMerge pull request #43705 from tchaikov/wip-no-more-python2
Yuri Weinstein [Thu, 4 Nov 2021 21:10:57 +0000 (14:10 -0700)]
Merge pull request #43705 from tchaikov/wip-no-more-python2

mgr: do not handle Python2

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
3 years agoMerge pull request #43700 from liewegas/fix-24990
Yuri Weinstein [Thu, 4 Nov 2021 21:08:07 +0000 (14:08 -0700)]
Merge pull request #43700 from liewegas/fix-24990

ceph_test_rados_api_watch_notify: extend Watch3Timeout test

Reviewed-by: Neha Ojha <nojha@redhat.com>
3 years agoMerge pull request #43664 from NUABO/tanchangzhi
Yuri Weinstein [Thu, 4 Nov 2021 21:07:35 +0000 (14:07 -0700)]
Merge pull request #43664 from NUABO/tanchangzhi

osd: fix 'ceph osd stop <osd.nnn>' doesn't take effect

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
3 years agoMerge PR #43752 into master
Patrick Donnelly [Thu, 4 Nov 2021 20:55:43 +0000 (16:55 -0400)]
Merge PR #43752 into master

* refs/pull/43752/head:
client: remove usless _openat()
client: remove optional for dirfd parameter

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>
3 years agoMerge PR #43666 into master
Patrick Donnelly [Thu, 4 Nov 2021 20:54:14 +0000 (16:54 -0400)]
Merge PR #43666 into master

* refs/pull/43666/head:
qa/vstart_runner: add "managers" to LocalContext instances

Reviewed-by: Jos Collin <jcollin@redhat.com>
Reviewed-by: Xiubo Li <xiubli@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
3 years agoMerge PR #43638 into master
Patrick Donnelly [Thu, 4 Nov 2021 20:53:20 +0000 (16:53 -0400)]
Merge PR #43638 into master

* refs/pull/43638/head:
qa: pass subdir arg when executing workunit

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
3 years agoMerge PR #43613 into master
Patrick Donnelly [Thu, 4 Nov 2021 20:52:23 +0000 (16:52 -0400)]
Merge PR #43613 into master

* refs/pull/43613/head:
qa: lengthen health warning wait

Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Xiubo Li <xiubli@redhat.com>
3 years agoMerge PR #41667 into master
Patrick Donnelly [Thu, 4 Nov 2021 20:51:11 +0000 (16:51 -0400)]
Merge PR #41667 into master

* refs/pull/41667/head:
mds: do not trim cache when creating system file
mds: fix the comment in add_inode

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
3 years agoMerge PR #43611 into master
Sage Weil [Thu, 4 Nov 2021 18:33:45 +0000 (14:33 -0400)]
Merge PR #43611 into master

* refs/pull/43611/head:
doc/mgr/nfs: document rgw user and bucket exports
PendingReleaseNotes: add note about nfs CLI change(s)
qa/suites/orch/cephadm/smoke-roleless: add rgw user nfs export case
mgr/nfs: take user-id and/or bucket for 'nfs export create rgw'
mgr/nfs: reorder 'nfs export creage rgw' arguments
mgr/nfs: reorder 'nfs export create cephfs' arguments
mgr/nfs: use keyword args for 'nfs export create rgw'
mgr/nfs: document and use keyword args for 'nfs export create cephfs'
qa/tasks/cephfs/test_nfs: use keyword args
pybind/ceph_argparse: handle misordered keyword arguments

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
3 years agoMerge pull request #43768 from Huber-ming/admin_mdlog_fetch
Daniel Gryniewicz [Thu, 4 Nov 2021 17:19:41 +0000 (13:19 -0400)]
Merge pull request #43768 from Huber-ming/admin_mdlog_fetch

radosgw-admin: supplement help documents with 'mdlog autotrim'

3 years agoMerge pull request #43778 from adamemerson/wip-53132
Casey Bodley [Thu, 4 Nov 2021 16:56:26 +0000 (12:56 -0400)]
Merge pull request #43778 from adamemerson/wip-53132

rgw: Ensure buckets too old to decode a layout have layout logs

Reviewed-by: Casey Bodley <cbodley@redhat.com>
3 years agoqa/rgw: master branch targets ceph-master branch of java_s3tests 43808/head
Casey Bodley [Thu, 4 Nov 2021 16:12:04 +0000 (12:12 -0400)]
qa/rgw: master branch targets ceph-master branch of java_s3tests

Signed-off-by: Casey Bodley <cbodley@redhat.com>
3 years agoMerge pull request #37184 from ybwang0211/KMSMSMSMS_return_error_message
Casey Bodley [Thu, 4 Nov 2021 16:07:05 +0000 (12:07 -0400)]
Merge pull request #37184 from ybwang0211/KMSMSMSMS_return_error_message

rgw:When KMS encryption is used and the key does not exist, we should…

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
3 years agoMerge pull request #43725 from rhcs-dashboard/nfs-export-form-fix
Ernesto Puerta [Thu, 4 Nov 2021 16:00:13 +0000 (17:00 +0100)]
Merge pull request #43725 from rhcs-dashboard/nfs-export-form-fix

mgr/dashboard: NFS 'create export' form: fixes

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
3 years agoosd/scrub: remove reliance of Scrubber objects' logging on the PG 42479/head
Ronen Friedman [Sun, 25 Jul 2021 11:58:51 +0000 (14:58 +0300)]
osd/scrub: remove reliance of Scrubber objects' logging on the PG

Modify the Scrubber's sub-objects to use their own gen_prefix()
functions, instead of using PG::gen_prefix().

Fixes: https://tracker.ceph.com/issues/51843
Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
3 years agodoc/mgr/nfs: document rgw user and bucket exports 43611/head
Sage Weil [Thu, 4 Nov 2021 14:41:44 +0000 (10:41 -0400)]
doc/mgr/nfs: document rgw user and bucket exports

Signed-off-by: Sage Weil <sage@newdream.net>
3 years agoPendingReleaseNotes: add note about nfs CLI change(s)
Sage Weil [Mon, 25 Oct 2021 19:52:28 +0000 (15:52 -0400)]
PendingReleaseNotes: add note about nfs CLI change(s)

Signed-off-by: Sage Weil <sage@newdream.net>
3 years agoqa/suites/orch/cephadm/smoke-roleless: add rgw user nfs export case
Sage Weil [Mon, 25 Oct 2021 14:53:56 +0000 (10:53 -0400)]
qa/suites/orch/cephadm/smoke-roleless: add rgw user nfs export case

Signed-off-by: Sage Weil <sage@newdream.net>
3 years agomgr/nfs: take user-id and/or bucket for 'nfs export create rgw'
Sage Weil [Wed, 20 Oct 2021 21:33:27 +0000 (17:33 -0400)]
mgr/nfs: take user-id and/or bucket for 'nfs export create rgw'

- move the bucket / user position after the cluster_id and pseudo_path
(since they are optional)
- require bucket or user or both
- if bucket, use the bucket owner
- if bucket+user, use that user
- if user only, then export at top-level (all users buckets)

Fixes: https://tracker.ceph.com/issues/53134
Signed-off-by: Sage Weil <sage@newdream.net>
3 years agomgr/orchestrator: improve usage string for 'orch daemon add osd' 42727/head
Sage Weil [Thu, 4 Nov 2021 14:07:14 +0000 (10:07 -0400)]
mgr/orchestrator: improve usage string for 'orch daemon add osd'

Signed-off-by: Sage Weil <sage@newdream.net>
3 years agomgr/dashboard: NFS 'create export' form: fixes 43725/head
Alfonso Martínez [Thu, 4 Nov 2021 13:56:37 +0000 (14:56 +0100)]
mgr/dashboard: NFS 'create export' form: fixes

* Do not allow a pseudo that is already in use by another export.
* Create mode form: prefill dropdown selectors if options > 0.
* Edit mode form: do not reset the field values that depend on other values that are being edited (unlike Create mode).
* Fix broken link: cluster service.
* Fix error message style for non-existent cephfs path.
* nfs-service.ts: lsDir: thow error if volume is not provided.
* File renaming: nfsganesha.py => nfs.py; test_ganesha.py => test_nfs.py

Fixes: https://tracker.ceph.com/issues/53083
Signed-off-by: Alfonso Martínez <almartin@redhat.com>
3 years agocephadm: Avoid "Could not locate podman: podman not found" 43789/head
Sebastian Wagner [Wed, 3 Nov 2021 11:12:15 +0000 (12:12 +0100)]
cephadm: Avoid "Could not locate podman: podman not found"

Right now, we're spamming the cephadm.log on docker deployments

Fixes: https://tracker.ceph.com/issues/52869
Signed-off-by: Sebastian Wagner <sewagner@redhat.com>
3 years agoMerge pull request #43737 from AndrewSharapov/master
Sebastian Wagner [Thu, 4 Nov 2021 09:45:56 +0000 (10:45 +0100)]
Merge pull request #43737 from AndrewSharapov/master

mgr/cephadm: Fixed spawning ip addresses list for public network interface

Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
3 years agoMerge pull request #43797 from rhcs-dashboard/fix-53144-master
Ernesto Puerta [Thu, 4 Nov 2021 09:17:57 +0000 (10:17 +0100)]
Merge pull request #43797 from rhcs-dashboard/fix-53144-master

mgr/dashboard: fix missing alert rule details

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
3 years agoMerge pull request #43461 from CongMinYin/fix-flush-advance
Deepika Upadhyay [Thu, 4 Nov 2021 07:45:42 +0000 (13:15 +0530)]
Merge pull request #43461 from CongMinYin/fix-flush-advance

librbd/cache/pwl: fix external flush dispatch in advance

Reviewed-by: Mykola Golub <mgolub@suse.com>
3 years agocrimson/os/seastore: fix ordered updates to JournalSegmentManager::committed_to 43754/head
Yingxin Cheng [Mon, 1 Nov 2021 08:28:59 +0000 (16:28 +0800)]
crimson/os/seastore: fix ordered updates to JournalSegmentManager::committed_to

Journal segment should not update committed_to during rolling as there
might be still pending writes from the previous segment.

A side-effect here is that committed_to now needs to include
segment_seq_t to point to a previous segment.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
3 years agoMerge pull request #43617 from cyx1231st/wip-seastore-batch-journal-records
Samuel Just [Thu, 4 Nov 2021 04:08:43 +0000 (21:08 -0700)]
Merge pull request #43617 from cyx1231st/wip-seastore-batch-journal-records

crimson/os/seastore/journal: support both batching and concurrent writes

Reviewed-by: Samuel Just <sjust@redhat.com>
3 years agoMerge pull request #43781 from liu-chunmei/osd_uuid_zero
Samuel Just [Thu, 4 Nov 2021 03:27:59 +0000 (20:27 -0700)]
Merge pull request #43781 from liu-chunmei/osd_uuid_zero

crimson/osd: randomize the osd_uuid if not specified

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
3 years agocrimson/osd: randomize the osd_uuid if not specified 43781/head
chunmei-liu [Wed, 3 Nov 2021 22:03:24 +0000 (15:03 -0700)]
crimson/osd: randomize the osd_uuid if not specified

address the failure spotted in teuthology based test:
sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 0

Signed-off-by: chunmei-liu <chunmei.liu@intel.com>
3 years agoradosgw-admin: supplement help documents with 'mdlog autotrim' 43768/head
Huber-ming [Thu, 4 Nov 2021 01:25:37 +0000 (09:25 +0800)]
radosgw-admin: supplement help documents with 'mdlog autotrim'

Signed-off-by: Huber-ming <zhangsm01@inspur.com>
3 years agoMerge pull request #43456 from ljflores/wip-separate-data
Neha Ojha [Wed, 3 Nov 2021 23:14:14 +0000 (16:14 -0700)]
Merge pull request #43456 from ljflores/wip-separate-data

mgr/telemetry: provide option for separated data in the telemetry perf channel

Reviewed-by: Yaarit Hatuka <yaarit@redhat.com>
3 years agoMerge pull request #43591 from cbodley/wip-52976
Casey Bodley [Wed, 3 Nov 2021 21:04:03 +0000 (17:04 -0400)]
Merge pull request #43591 from cbodley/wip-52976

radosgw-admin: allow 'bi purge' to delete index if entrypoint doesn't exist

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
3 years agoMerge pull request #43710 from cbodley/wip-53003
Casey Bodley [Wed, 3 Nov 2021 19:28:43 +0000 (15:28 -0400)]
Merge pull request #43710 from cbodley/wip-53003

rgw: fix self-comparison for RGWCopyObj optimization

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
3 years agoMerge pull request #43715 from cbodley/wip-52716
Casey Bodley [Wed, 3 Nov 2021 19:28:25 +0000 (15:28 -0400)]
Merge pull request #43715 from cbodley/wip-52716

rgw: ListMultipartUploads returns the real upload Owners

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
3 years agoMerge pull request #43779 from cbodley/wip-47527
Casey Bodley [Wed, 3 Nov 2021 19:27:56 +0000 (15:27 -0400)]
Merge pull request #43779 from cbodley/wip-47527

rgw: fix ListBucketMultiparts response with common prefixes

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
3 years agorgw: Ensure buckets too old to decode a layout have layout logs 43778/head
Adam C. Emerson [Tue, 2 Nov 2021 16:46:15 +0000 (12:46 -0400)]
rgw: Ensure buckets too old to decode a layout have layout logs

When decoding `RGWBucketInfo` data from before Pacific, we won't call
`rgw::BucketLayout::decode`, but will instead synthesize the layout
information. This leaves the `rgw::BucketLayout::logs` empty, as the
fallback to populate it only applies to old versions of
`rgw::BucketLayout`.

Add a check at the end of `RGWBUcketInfo::decode` to populate it if
empty.

Fixes: https://tracker.ceph.com/issues/53132
Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
3 years ago.github/pull_request_template.md: update
Sage Weil [Thu, 23 Sep 2021 20:59:18 +0000 (15:59 -0500)]
.github/pull_request_template.md: update

Signed-off-by: Sage Weil <sage@newdream.net>
3 years ago.github/workflows/pr-checklist: add checklist action
Sage Weil [Thu, 21 Oct 2021 15:12:50 +0000 (10:12 -0500)]
.github/workflows/pr-checklist: add checklist action

Signed-off-by: Sage Weil <sage@newdream.net>
3 years agoMerge pull request #42950 from CongMinYin/fix-dead-lock-during-shutdown
Deepika Upadhyay [Wed, 3 Nov 2021 18:25:31 +0000 (23:55 +0530)]
Merge pull request #42950 from CongMinYin/fix-dead-lock-during-shutdown

librbd/cache/pwl/ssd: fix dead lock and assert during shutdown

Reviewed-by: Mykola Golub <mykola.golub@clyso.com>
Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com>
3 years agomgr/dashboard: fix missing alert rule details 43797/head
Ernesto Puerta [Wed, 3 Nov 2021 17:57:53 +0000 (18:57 +0100)]
mgr/dashboard: fix missing alert rule details

Fixes: https://tracker.ceph.com/issues/53144
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>
3 years agoMerge pull request #43753 from soumyakoduri/wip-skoduri-dblock
Casey Bodley [Wed, 3 Nov 2021 16:05:22 +0000 (12:05 -0400)]
Merge pull request #43753 from soumyakoduri/wip-skoduri-dblock

rgw/dbstore: No need for explicit LOCK in DBStore

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
3 years agoMerge pull request #43790 from sebastian-philipp/doc-cephadm-purge
Sebastian Wagner [Wed, 3 Nov 2021 15:27:53 +0000 (16:27 +0100)]
Merge pull request #43790 from sebastian-philipp/doc-cephadm-purge

doc/cephadm: purge

Reviewed-by: Michael Fritch <mfritch@suse.com>
3 years agoMerge pull request #43659 from majianpeng/send-internal-flush-for-rbd-copy
Deepika Upadhyay [Wed, 3 Nov 2021 14:55:21 +0000 (20:25 +0530)]
Merge pull request #43659 from majianpeng/send-internal-flush-for-rbd-copy

librbd: send FLUSH_SOURCE_INTERNAL when do copy/deep_copy.

Reviewed-by: Mykola Golub <mykola.golub@clyso.com>
Reviewed-by: Sunny Kumar <sunkumar@redhat.com>
Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com>
3 years agodoc/cephadm: purge 43790/head
Sebastian Wagner [Wed, 3 Nov 2021 13:11:00 +0000 (14:11 +0100)]
doc/cephadm: purge

Fixes: https://tracker.ceph.com/issues/50534
Signed-off-by: Sebastian Wagner <sewagner@redhat.com>
3 years agoMerge PR #43786 into master
Patrick Donnelly [Wed, 3 Nov 2021 13:40:55 +0000 (09:40 -0400)]
Merge PR #43786 into master

* refs/pull/43786/head:
mds: fix typo in MDSRank.cc

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Xiubo Li <xiubli@redhat.com>
3 years agoMerge pull request #43690 from rhcs-dashboard/improve-error-handling-get-facts-backend
Ernesto Puerta [Wed, 3 Nov 2021 13:08:32 +0000 (14:08 +0100)]
Merge pull request #43690 from rhcs-dashboard/improve-error-handling-get-facts-backend

mgr/dashboard: improve error handling for gather_facts

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
3 years agomgr/dashboard: python unit tests refactoring
Alfonso Martínez [Wed, 3 Nov 2021 09:17:21 +0000 (10:17 +0100)]
mgr/dashboard: python unit tests refactoring

* Controller tests: cherrypy config: authentication disabled by default; ability to pass custom config (e.g. enable authentication).
* Auth controller: add tests; test that unauthorized request fails when authentication is enabled.
* DocsTest: clear ENDPOINT_MAP so the test_gen_tags test becomes deterministic.
* pylint: disable=no-name-in-module: fix imports in tests.

Fixes: https://tracker.ceph.com/issues/53083
Signed-off-by: Alfonso Martínez <almartin@redhat.com>