]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
3 years agocephadm: still set container_image when --no-assimilate-config is provided 45113/head
Adam King [Mon, 21 Feb 2022 21:34:47 +0000 (16:34 -0500)]
cephadm: still set container_image when --no-assimilate-config is provided

Fixes: https://tracker.ceph.com/issues/54141
Signed-off-by: Adam King <adking@redhat.com>
3 years agoMerge pull request #44985 from rhcs-dashboard/dashboard-turns-telemetry-off 45251/head
Yuri Weinstein [Mon, 21 Feb 2022 15:44:51 +0000 (07:44 -0800)]
Merge pull request #44985 from rhcs-dashboard/dashboard-turns-telemetry-off

mgr/dashboard: dashboard turns telemetry off when configuring report

Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Yaarit Hatuka <yaarit@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
3 years agoMerge pull request #45022 from kalebskeithley/54266
Casey Bodley [Mon, 21 Feb 2022 15:41:19 +0000 (10:41 -0500)]
Merge pull request #45022 from kalebskeithley/54266

rgw: cmake configure error on fedora-37/rawhide

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
Reviewed-by: Soumya Koduri <skoduri@redhat.com>
3 years agoMerge pull request #44905 from mgfritch/cephadm-prom-chown
Adam King [Mon, 21 Feb 2022 15:19:40 +0000 (10:19 -0500)]
Merge pull request #44905 from mgfritch/cephadm-prom-chown

cephadm: chown the prometheus data dir during redeploy

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Patrick Seidensal <pseidensal@suse.com>
3 years agoMerge pull request #45054 from rkachach/fix_issue_46655
Adam King [Mon, 21 Feb 2022 15:17:00 +0000 (10:17 -0500)]
Merge pull request #45054 from rkachach/fix_issue_46655

mgr/cephadm: Delete ceph.target if last cluster

Reviewed-by: Michael Fritch mfritch@suse.com
3 years agoMerge pull request #44873 from kotreshhr/clone-inherit-quota-files
Venky Shankar [Mon, 21 Feb 2022 09:07:44 +0000 (14:37 +0530)]
Merge pull request #44873 from kotreshhr/clone-inherit-quota-files

mgr/volumes: Inherit file quota attr to clone

Reviewed-by: Venky Shankar <vshankar@redhat.com>
3 years agoMerge pull request #44854 from kotreshhr/subvolumegroup_ls
Venky Shankar [Mon, 21 Feb 2022 09:07:03 +0000 (14:37 +0530)]
Merge pull request #44854 from kotreshhr/subvolumegroup_ls

mgr/volumes: Fix subvolumegroup ls

Reviewed-by: Venky Shankar <vshankar@redhat.com>
3 years agoMerge pull request #45089 from athanatos/sjust/wip-seastore-journal-refactor
Samuel Just [Mon, 21 Feb 2022 06:04:04 +0000 (22:04 -0800)]
Merge pull request #45089 from athanatos/sjust/wip-seastore-journal-refactor

seastore: seperate Journal interface from SegmentedJournal implementation

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Myoungwon Oh <myoungwon.oh@samsung.com>
3 years agoMerge pull request #45033 from anthonyeleven/anthonyeleven/releases-tweaks
zdover23 [Mon, 21 Feb 2022 05:59:52 +0000 (15:59 +1000)]
Merge pull request #45033 from anthonyeleven/anthonyeleven/releases-tweaks

doc/releases: Improve capitalization for Octopus

Reviewed-by: Zac Dover <zac.dover@gmail.com>
3 years agoMerge pull request #44994 from ljflores/wip-telemetry-device-assertion-failure
Laura Flores [Mon, 21 Feb 2022 00:52:47 +0000 (18:52 -0600)]
Merge pull request #44994 from ljflores/wip-telemetry-device-assertion-failure

mgr/telemetry: handle empty device report when "send" is triggered

3 years agoseastore: seperate Journal interface from SegmentedJournal implementation 45089/head
myoungwon oh [Fri, 13 Aug 2021 08:15:54 +0000 (17:15 +0900)]
seastore: seperate Journal interface from SegmentedJournal implementation

A subsequent PR will introduce a CircularBoundedJournal implementation
for fast nvme devices.

SegmentCleaner no longer needs a reference to Journal, so dispense with
the set_segment_provider machinery and simply pass it in the
constructor.

Move responsibility for finding the journal segments into the journal
itself.  This does mean that we check the segment headers on the journal
device twice, but that should be a neglible amount of overhead on mount.

SegmentCleaner::init_segments no longer needs to return Journal
segments, so merge with mount().

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
Signed-off-by: Samuel Just <sjust@redhat.com>
3 years agomgr/dashboard: Contact Info should be visible only when Ident channel is checked 44985/head
Sarthak0702 [Wed, 16 Feb 2022 12:45:35 +0000 (18:15 +0530)]
mgr/dashboard: Contact Info should be visible only when Ident channel is checked

Fixes:https://tracker.ceph.com/issues/54133
Signed-off-by: Sarthak0702 <sarthak.0702@gmail.com>
3 years agoMerge pull request #44936 from javacruft/build-compress-common-dep
Kefu Chai [Sun, 20 Feb 2022 17:02:44 +0000 (01:02 +0800)]
Merge pull request #44936 from javacruft/build-compress-common-dep

cmake: add dependency compress->common

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
3 years agocmake: add dependency compression->common 44936/head
James Page [Tue, 8 Feb 2022 09:10:36 +0000 (09:10 +0000)]
cmake: add dependency compression->common

The compression code depends on headers generated during the build
of the common code for Ceph.

Ensure that CMake understands this dependency, avoiding a race
between generation of header files in common and compilation of the
compression module.

Signed-off-by: James Page <james.page@ubuntu.com>
3 years agoMerge pull request #44608 from liumiaomiaoIntel/qatchange
Kefu Chai [Sat, 19 Feb 2022 17:25:44 +0000 (01:25 +0800)]
Merge pull request #44608 from liumiaomiaoIntel/qatchange

common: fix compilation and function issues about compressor and crypto to enable latest QAT driver

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
3 years agoMerge pull request #44904 from chrisphoffman/wip_rbd_default_map_override
Ilya Dryomov [Sat, 19 Feb 2022 16:18:42 +0000 (17:18 +0100)]
Merge pull request #44904 from chrisphoffman/wip_rbd_default_map_override

tools/rbd: expand where option rbd_default_map_options can be set

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
3 years agoMerge pull request #45085 from tchaikov/crimson-fmtlib-v8
Samuel Just [Sat, 19 Feb 2022 01:38:45 +0000 (17:38 -0800)]
Merge pull request #45085 from tchaikov/crimson-fmtlib-v8

crimson: fixes for compiling with fmtlib v8

Reviewed-by: Samuel Just <sjust@redhat.com>
3 years agoMerge pull request #43388 from e337/wip-doc-50499
Laura Flores [Sat, 19 Feb 2022 00:24:02 +0000 (18:24 -0600)]
Merge pull request #43388 from e337/wip-doc-50499

3 years agocrimson: specialize fmt::formatter<>() for crimson types 45085/head
Kefu Chai [Fri, 18 Feb 2022 15:23:54 +0000 (23:23 +0800)]
crimson: specialize fmt::formatter<>() for crimson types

otherwise we'd have FTBFS like

/usr/include/fmt/core.h:1727:3: error: static_assert failed due to requirement 'formattable' "Cannot format an argument. To make type T formattable provide a formatter<T> specialization: https://fmt.dev/latest/api$
  static_assert(
  ^
/usr/include/fmt/core.h:1853:23: note: in instantiation of function template specialization 'fmt::detail::make_arg<true, fmt::basic_format_context<fmt::appender, char>, fmt::detail::type::custom_type, crimson::os:$
        data_{detail::make_arg<

please note, delta_op_t is lifted out of the templated outer class
to avoid the headache of specialization of template of template in
another namespace.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
3 years agoqa/suites/krbd: add rbd_default_map_options override coverage 44904/head
Christopher Hoffman [Wed, 9 Feb 2022 20:28:19 +0000 (20:28 +0000)]
qa/suites/krbd: add rbd_default_map_options override coverage

Add coverage to test precedence, override, and option merge on rbd map.

Signed-off-by: Christopher Hoffman <choffman@redhat.com>
3 years agoqa/suites/krbd: rename rxbounce subsuite
Ilya Dryomov [Fri, 18 Feb 2022 16:06:42 +0000 (17:06 +0100)]
qa/suites/krbd: rename rxbounce subsuite

A new job that doesn't want ms_mode to be set underneath it is about to
be added.  Rename rxbounce to ms_modeless to make this purpose obvious.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
3 years agorbd: support pool and image level overrides for rbd_default_map_options
Christopher Hoffman [Fri, 4 Feb 2022 21:25:53 +0000 (21:25 +0000)]
rbd: support pool and image level overrides for rbd_default_map_options

Fixes: https://tracker.ceph.com/issues/52850
Signed-off-by: Christopher Hoffman <choffman@redhat.com>
3 years agocrimson/os/seastore: drop compile-time fmt validation
Kefu Chai [Fri, 18 Feb 2022 14:44:51 +0000 (22:44 +0800)]
crimson/os/seastore: drop compile-time fmt validation

_format() was deprecated in fmtlib v8, see also
https://github.com/fmtlib/fmt/pull/2646

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
3 years agocompressor: fix compilation issues about QATzip 44608/head
Miaomiao Liu [Wed, 19 Jan 2022 07:27:07 +0000 (15:27 +0800)]
compressor: fix compilation issues about QATzip

Signed-off-by: Miaomiao Liu <miaomiao.liu@intel.com>
Signed-off-by: Hualong Feng <hualong.feng@intel.com>
3 years agoMerge pull request #44933 from liu-chunmei/seastore-support-sparse-read
Samuel Just [Thu, 17 Feb 2022 22:40:27 +0000 (14:40 -0800)]
Merge pull request #44933 from liu-chunmei/seastore-support-sparse-read

crimson/seastore: support sparse_read

Reviewed-by: Samuel Just <sjust@redhat.com>
3 years agoMerge pull request #44955 from aclamk/wip-vselector-check-fix
Neha Ojha [Thu, 17 Feb 2022 18:26:10 +0000 (10:26 -0800)]
Merge pull request #44955 from aclamk/wip-vselector-check-fix

os/bluestore/bluefs: Fix improper vselector tracking in _flush_special()

Reviewed-by: Igor Fedotov <igor.fedotov@croit.io>
3 years agocrimson/seastore: put ObjectDataHandler instance into do_with 44933/head
chunmei-liu [Wed, 16 Feb 2022 03:13:15 +0000 (19:13 -0800)]
crimson/seastore: put ObjectDataHandler instance into do_with

make ObjectDataHandler instance alive before sub functions are resolved.

Signed-off-by: chunmei-liu <chunmei.liu@intel.com>
3 years agocrimson/seastore:: add fiemap and sparse read unit test
chunmei-liu [Sat, 12 Feb 2022 21:36:33 +0000 (13:36 -0800)]
crimson/seastore:: add fiemap and sparse read unit test

Signed-off-by: chunmei-liu <chunmei.liu@intel.com>
3 years agocrimson/seastore: support sparse_read
chunmei-liu [Mon, 7 Feb 2022 22:34:33 +0000 (14:34 -0800)]
crimson/seastore: support sparse_read

add fiemap and readv functions.

Signed-off-by: chunmei-liu <chunmei.liu@intel.com>
3 years agoMerge pull request #45057 from zdover23/wip-doc-2022-02-17-os-recs-nautilus-and-lumin...
zdover23 [Thu, 17 Feb 2022 10:19:35 +0000 (20:19 +1000)]
Merge pull request #45057 from zdover23/wip-doc-2022-02-17-os-recs-nautilus-and-luminous-table-removal

doc/start: remove L and N release-related tables

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
3 years agoMerge pull request #45049 from liu-chunmei/crimson-clang-warning-cleanup
Samuel Just [Wed, 16 Feb 2022 20:07:56 +0000 (12:07 -0800)]
Merge pull request #45049 from liu-chunmei/crimson-clang-warning-cleanup

crimson: eliminate clang build warning in crimson

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
3 years agomgr/telemetry: handle empty device report when "send" is triggered 44994/head
Laura Flores [Fri, 11 Feb 2022 19:37:26 +0000 (19:37 +0000)]
mgr/telemetry: handle empty device report when "send" is triggered

On certain environments, such as the "ceph-dev-docker" environment
(https://github.com/ricardoasmarques/ceph-dev-docker), the mgr
module is unable to fetch device metrics. As a result, the device
report generated by "gather_device_report()" returns an empty dict.
This causes an AssertionError when the "send" function is triggered
(i.e. by running `ceph telemetry status` or `ceph telemetry send`),
and the module crashes.

The fix in this commit checks that the generated device report
contains metrics before trying to send it. If the device report
does not contain metrics (it returns an empty dict), the module
will log an appropriate message in the mgr log and not send the
device report.

If this scenario happens when running the `ceph telemetry send` command,
the user will additionally see this message:
```
Ceph report sent to https://telemetry.ceph.com/report
Unable to send device report: channel is on, but generated report was empty.
```

I also added a few more debug messages in gather_device_report() to make
future debugging easier.

Fixes: https://tracker.ceph.com/issues/54250
Signed-off-by: Laura Flores <lflores@redhat.com>
3 years agomgr/cephadm: Delete ceph.target if last cluster 45054/head
Redouane Kachach [Wed, 16 Feb 2022 11:01:57 +0000 (12:01 +0100)]
mgr/cephadm: Delete ceph.target if last cluster
Fixes: https://tracker.ceph.com/issues/46655
Signed-off-by: Redouane Kachach <rkachach@redhat.com>
3 years agocrimson: eliminate clang build warning in crimson 45049/head
chunmei-liu [Wed, 16 Feb 2022 05:06:24 +0000 (21:06 -0800)]
crimson: eliminate clang build warning in crimson

Signed-off-by: chunmei-liu <chunmei.liu@intel.com>
3 years agodoc/start: remove L and N release-related tables 45057/head
Zac Dover [Wed, 16 Feb 2022 15:21:44 +0000 (01:21 +1000)]
doc/start: remove L and N release-related tables

This PR removes the tables for Luminous and Nautilus,
in order to keep the documentation as current as possible.
This is one a series of PRs intended to update the OS
Recommendations page. The scope of this PR is confined to
the removal of these two tables. Other PRs will update the
information elsewhere on the OS Recommendations page.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
3 years agoMerge pull request #45045 from idryomov/wip-qemu-task-rbd-package
Ilya Dryomov [Wed, 16 Feb 2022 13:15:24 +0000 (14:15 +0100)]
Merge pull request #45045 from idryomov/wip-qemu-task-rbd-package

qa/tasks/qemu: make sure block-rbd.so is installed

Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com>
3 years agoqa/suites/rbd: make sure block-rbd.so is installed 45045/head
Ilya Dryomov [Wed, 16 Feb 2022 09:32:26 +0000 (10:32 +0100)]
qa/suites/rbd: make sure block-rbd.so is installed

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
3 years agoMerge pull request #45021 from idryomov/wip-groupsnapns-operator-less
Ilya Dryomov [Wed, 16 Feb 2022 10:32:10 +0000 (11:32 +0100)]
Merge pull request #45021 from idryomov/wip-groupsnapns-operator-less

cls/rbd: GroupSnapshotNamespace comparator violates ordering rules

Reviewed-by: Mykola Golub <mgolub@suse.com>
Reviewed-by: Sunny Kumar <sunkumar@redhat.com>
3 years agoMerge pull request #45020 from rhcs-dashboard/snmp-priv-protocol-fix
Avan [Wed, 16 Feb 2022 09:52:26 +0000 (15:22 +0530)]
Merge pull request #45020 from rhcs-dashboard/snmp-priv-protocol-fix

mgr/dashboard: change privacy protocol field from required to optional

3 years agoMerge pull request #44659 from ifed01/wip-ifed-alloc-replay-boind-size
Igor Fedotov [Wed, 16 Feb 2022 09:50:08 +0000 (12:50 +0300)]
Merge pull request #44659 from ifed01/wip-ifed-alloc-replay-boind-size

test/alloc_replay_test: be able to cap allocator space with capacity …

Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
3 years agomgr/volumes: Fix subvolumegroup ls 44854/head
Kotresh HR [Tue, 1 Feb 2022 11:06:34 +0000 (16:36 +0530)]
mgr/volumes: Fix subvolumegroup ls

The subvolumegroup ls listed '_deleting' directory which is
internal to 'mgr/volumes' and should not be listed as a
subvolumegroup. This patch fixes the same by filtering it.

Fixes: https://tracker.ceph.com/issues/54099
Signed-off-by: Kotresh HR <khiremat@redhat.com>
3 years agoqa: Add test for subvolumegroup ls filter
Kotresh HR [Tue, 1 Feb 2022 11:08:41 +0000 (16:38 +0530)]
qa: Add test for subvolumegroup ls filter

Fixes: https://tracker.ceph.com/issues/54099
Signed-off-by: Kotresh HR <khiremat@redhat.com>
3 years agoos/bluestore/bluefs: Fix vselector 44955/head
Adam Kupczyk [Tue, 15 Feb 2022 22:13:59 +0000 (23:13 +0100)]
os/bluestore/bluefs: Fix vselector

Fix bluefs volume selector in device_migrate_to_existing.
Fix bluefs volume selector in _rewrite_log_and_layout_sync_LNF_LD.

Fixes: https://tracker.ceph.com/issues/54248
Signed-off-by: Adam Kupczyk <akupczyk@redhat.com>
3 years agoMerge pull request #44997 from pcfe/pcfe-add-cos9-instructions 38123/head
Adam King [Tue, 15 Feb 2022 19:09:31 +0000 (14:09 -0500)]
Merge pull request #44997 from pcfe/pcfe-add-cos9-instructions

doc/cephadm: Add CentOS Stream install instructions

Reviewed-by: Adam King <adking@redhat.com>
3 years agodoc/cephadm: Add CentOS Stream install instructions 44997/head
Patrick C. F. Ernzer [Sun, 13 Feb 2022 01:05:44 +0000 (02:05 +0100)]
doc/cephadm: Add CentOS Stream install instructions

Signed-off-by: Patrick C. F. Ernzer <pcfe@pcfe.net>.
3 years agoMerge pull request #44988 from caisan/FixRGWLogStringError
Casey Bodley [Tue, 15 Feb 2022 14:29:12 +0000 (09:29 -0500)]
Merge pull request #44988 from caisan/FixRGWLogStringError

Fix rgw data sync log info error

Reviewed-by: Yehuda Sadeh <ysadehwe@redhat.com>
3 years agomgr/dashboard: add validation for snmp v3 engine id 45020/head
Avan Thakkar [Tue, 15 Feb 2022 13:13:36 +0000 (18:43 +0530)]
mgr/dashboard: add validation for snmp v3 engine id

Fixes: https://tracker.ceph.com/issues/54270
Signed-off-by: Avan Thakkar <athakkar@redhat.com>
3 years agoqa/tasks/qemu: make sure block-rbd.so is installed
Ilya Dryomov [Tue, 15 Feb 2022 13:57:51 +0000 (14:57 +0100)]
qa/tasks/qemu: make sure block-rbd.so is installed

Fixes: https://tracker.ceph.com/issues/54286
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
3 years agoMerge pull request #45032 from ceph/revert-45018
David Galloway [Tue, 15 Feb 2022 13:55:31 +0000 (08:55 -0500)]
Merge pull request #45032 from ceph/revert-45018

Revert "admin/doc-requirements: pin breathe to 4.32.0"

3 years agoMerge pull request #44951 from votdev/issue_54215_expand_cluster
Ernesto Puerta [Tue, 15 Feb 2022 10:58:49 +0000 (11:58 +0100)]
Merge pull request #44951 from votdev/issue_54215_expand_cluster

mgr/dashboard: "Please expand your cluster first" shouldn't be shown if cluster is already meaningfully running

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
3 years agoMerge pull request #43588 from lxbsz/fsize_support
Venky Shankar [Tue, 15 Feb 2022 09:18:34 +0000 (14:48 +0530)]
Merge pull request #43588 from lxbsz/fsize_support

mds: add truncate size handling support for fscrypt

Reviewed-by: Venky Shankar <vshankar@redhat.com>
3 years agomgr/volumes: Inherit file quota attr to clone 44873/head
Kotresh HR [Fri, 11 Feb 2022 08:40:16 +0000 (14:10 +0530)]
mgr/volumes: Inherit file quota attr to clone

The file quota attribute 'ceph.quota.max_files'
is not inherited to the cloned subvolume. This
patch fixes the same.

Fixes: https://tracker.ceph.com/issues/54121
Signed-off-by: Kotresh HR <khiremat@redhat.com>
3 years agoqa: Validate file quota attrs on clone subvolume
Kotresh HR [Thu, 3 Feb 2022 06:01:48 +0000 (11:31 +0530)]
qa: Validate file quota attrs on clone subvolume

Fixes: https://tracker.ceph.com/issues/54121
Signed-off-by: Kotresh HR <khiremat@redhat.com>
3 years agoMerge pull request #45011 from tchaikov/librados/cleanup
Ilya Dryomov [Mon, 14 Feb 2022 23:16:14 +0000 (00:16 +0100)]
Merge pull request #45011 from tchaikov/librados/cleanup

include/rados/librados.h: drop duplicated function declaration

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
3 years agodoc/releases: Improve capitalization for Octopus 45033/head
Anthony D'Atri [Mon, 14 Feb 2022 22:53:17 +0000 (14:53 -0800)]
doc/releases: Improve capitalization for Octopus

Signed-off-by: Anthony D'Atri <anthony.datri@gmail.com>
3 years agoadmin/doc-requirements.txt: Not breathe=4.33 45032/head
David Galloway [Mon, 14 Feb 2022 20:11:58 +0000 (15:11 -0500)]
admin/doc-requirements.txt: Not breathe=4.33

See https://github.com/michaeljones/breathe/issues/803

Signed-off-by: David Galloway <dgallowa@redhat.com>
3 years agoRevert "admin/doc-requirements: pin breathe to 4.32.0"
David Galloway [Mon, 14 Feb 2022 19:38:16 +0000 (14:38 -0500)]
Revert "admin/doc-requirements: pin breathe to 4.32.0"

This reverts commit d020d07be97c56db88fadd9921e7b3eff11c0802.

Fixed upstream https://github.com/michaeljones/breathe/issues/803#issuecomment-1039341857

Signed-off-by: David Galloway <dgalloway@redhat.com>
3 years agoMerge pull request #44779 from rkachach/fix_issue_53010
Adam King [Mon, 14 Feb 2022 17:35:15 +0000 (12:35 -0500)]
Merge pull request #44779 from rkachach/fix_issue_53010

mgr/cephadm: Adding logic to cleanup several ceph dirs (rm-cluster)

Reviewed-by: Adam King <adking@redhat.com>
3 years agoMerge pull request #45014 from guits/fix-cephadm-ingress
Adam King [Mon, 14 Feb 2022 17:29:36 +0000 (12:29 -0500)]
Merge pull request #45014 from guits/fix-cephadm-ingress

cephadm/ingress: make frontend stats bind on localhost

Reviewed-by: Adam King <adking@redhat.com>
3 years agoMerge pull request #44794 from rzarzynski/wip-common-fix-numa-warning
Yuri Weinstein [Mon, 14 Feb 2022 17:06:28 +0000 (09:06 -0800)]
Merge pull request #44794 from rzarzynski/wip-common-fix-numa-warning

common: fix compilation warnings in numa.cc

Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
3 years agoMerge pull request #44781 from ljflores/wip-basic-channel-additions
Yuri Weinstein [Mon, 14 Feb 2022 17:06:00 +0000 (09:06 -0800)]
Merge pull request #44781 from ljflores/wip-basic-channel-additions

mgr/telemetry: add `basic_pool_usage` and `basic_usage_by_class` collections to the telemetry module

Reviewed-by: Yaarit Hatuka <yaarit@redhat.com>
3 years agoMerge pull request #44746 from ljflores/wip-telemetry-down-osd-fix
Yuri Weinstein [Mon, 14 Feb 2022 17:04:33 +0000 (09:04 -0800)]
Merge pull request #44746 from ljflores/wip-telemetry-down-osd-fix

mgr/telemetry: collect what we can from histograms, mempools, and heap stats

Reviewed-by: Yaarit Hatuka <yaarit@redhat.com>
3 years agoMerge pull request #44670 from rzarzynski/wip-common-dout-gcc12-ftbfs
Yuri Weinstein [Mon, 14 Feb 2022 17:03:51 +0000 (09:03 -0800)]
Merge pull request #44670 from rzarzynski/wip-common-dout-gcc12-ftbfs

common: fix FTBFS due to dout & need_dynamic on GCC-12

Reviewed-by: Kefu Chai <kchai@redhat.com>
3 years agoMerge pull request #44983 from cbodley/wip-52673
Yuri Weinstein [Mon, 14 Feb 2022 17:02:51 +0000 (09:02 -0800)]
Merge pull request #44983 from cbodley/wip-52673

rgw: remove rgw_rados_pool_pg_num_min and its use on pool creation

Reviewed-by: Neha Ojha <nojha@redhat.com>
3 years agoos/bluestore/bluefs: Fix improper vselector tracking in _flush_special()
Adam Kupczyk [Wed, 9 Feb 2022 15:19:56 +0000 (16:19 +0100)]
os/bluestore/bluefs: Fix improper vselector tracking in _flush_special()

Moves vselector size tracking outside _flush_special().
Function _compact_log_async...() updated sizes twice.
Problem could not be solved by making second modification of size just update,
as it will possibly disrupt vselector consistency check (_vselector_check()).
Feature to track vselector consistency relies on the fact that either log.lock or nodes.lock
are taken when the check is performed. Which is not true for _compact_log_async...().

Now _flush_special does not update vselector sizes by itself but leaves the update to
the caller.

Fixes: https://tracker.ceph.com/issues/54248
Signed-off-by: Adam Kupczyk <akupczyk@redhat.com>
3 years agoMerge pull request #44917 from guits/fix_rook_smoke_nvme_loop
Adam King [Mon, 14 Feb 2022 15:55:36 +0000 (10:55 -0500)]
Merge pull request #44917 from guits/fix_rook_smoke_nvme_loop

qa/orch: use hwe kernel in rook/smoke tests (ubuntu 20.04)

Reviewed-by: Neha Ojha nojha@redhat.com
Reviewed-by: Yuri Weinstein yweinste@redhat.com
3 years agoMerge pull request #45018 from tchaikov/wip-doc-breathe
David Galloway [Mon, 14 Feb 2022 15:44:34 +0000 (10:44 -0500)]
Merge pull request #45018 from tchaikov/wip-doc-breathe

admin/doc-requirements: pin breathe to 4.32.0

3 years agomgr/dashboard: change privacy protocol field from required to optional
Avan Thakkar [Mon, 14 Feb 2022 12:18:39 +0000 (17:48 +0530)]
mgr/dashboard: change privacy protocol field from required to optional

Fixes: https://tracker.ceph.com/issues/54270
Signed-off-by: Avan Thakkar <athakkar@redhat.com>
Privacy protocol field shouldn't be a required field.

3 years agocephadm/ingress: make frontend stat bind on localhost 45014/head
Guillaume Abrioux [Fri, 11 Feb 2022 16:39:18 +0000 (17:39 +0100)]
cephadm/ingress: make frontend stat bind on localhost

The current configuration of keepalived makes it do
a curl on localhost:9999 in order to check the endpoint is alive.
Given the endpoint only binds on the vip addr, that doesn't work.

Fixes: https://tracker.ceph.com/issues/53807
Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>
3 years agoMerge pull request #44965 from adk3798/test_cli_timeout
Adam King [Mon, 14 Feb 2022 13:24:32 +0000 (08:24 -0500)]
Merge pull request #44965 from adk3798/test_cli_timeout

qa/tasks/cephadm_cases: increase timeouts in test_cli.py

Reviewed-by: Michael Fritch mfritch@suse.com
3 years agorgw: cmake configure error on fedora-37/rawhide 45022/head
Kaleb S. KEITHLEY [Mon, 14 Feb 2022 12:42:08 +0000 (07:42 -0500)]
rgw: cmake configure error on fedora-37/rawhide

see
https://kojipkgs.fedoraproject.org//work/tasks/6624/82706624/build.log,
excerpted below

...
CMake Error: The inter-target dependency graph contains the following
strongly connected component (cycle): "rgw_common" of type
STATIC_LIBRARY depends on "dbstore" (weak) depends on "sqlite_db" (weak)
"dbstore" of type SHARED_LIBRARY depends on "rgw_common" (weak) depends
on "sqlite_db" (weak) "sqlite_db" of type SHARED_LIBRARY depends on
"rgw_common" (weak) depends on "dbstore" (weak) At least one of these
targets is not a STATIC_LIBRARY. Cyclic dependencies are allowed only
among static libraries. CMake Generate step failed. Build files cannot
be regenerated correctly.
...

https://tracker.ceph.com/issues/54266

Signed-off-by: Kaleb S. KEITHLEY <kkeithle@redhat.com>
3 years agocls/rbd: GroupSnapshotNamespace comparator violates ordering rules 45021/head
Ilya Dryomov [Mon, 14 Feb 2022 12:04:00 +0000 (13:04 +0100)]
cls/rbd: GroupSnapshotNamespace comparator violates ordering rules

For

  GroupSnapshotNamespace a(1, "group-1", "snap-2");
  GroupSnapshotNamespace b(1, "group-2", "snap-1");

both a < b and b < a evaluate to true.  This violates STL strict weak
ordering requirements which is a problem because GroupSnapshotNamespace
is used as a key in std::map (ictx->snap_ids at least), etc.

Fixes: https://tracker.ceph.com/issues/49792
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
3 years agomgr/dashboard: dashboard turns telemetry off when configuring report
Sarthak0702 [Thu, 10 Feb 2022 19:50:42 +0000 (01:20 +0530)]
mgr/dashboard: dashboard turns telemetry off when configuring report

Signed-off-by: Sarthak0702 <sarthak.0702@gmail.com>
3 years agoadmin/doc-requirements: pin breathe to 4.32.0 45018/head
Kefu Chai [Mon, 14 Feb 2022 10:25:26 +0000 (18:25 +0800)]
admin/doc-requirements: pin breathe to 4.32.0

in breathe v4.33, it includes following commit

https://github.com/michaeljones/breathe/commit/2498a437234343503e0087cad793c6f333f1f781

which specfies the app config value of "graphviz_dot". this annoys
sphinx:

WARNING: while setting up extension breathe: node class 'graphviz' is already registered, its visitors will be overridden

Traceback (most recent call last):
  File "/home/docs/checkouts/readthedocs.org/user_builds/ceph/envs/44951/lib/python3.8/site-packages/sphinx/cmd/build.py", line 276, in build_main
    app = Sphinx(args.sourcedir, args.confdir, args.outputdir,
  File "/home/docs/checkouts/readthedocs.org/user_builds/ceph/envs/44951/lib/python3.8/site-packages/sphinx/application.py", line 245, in __init__
    self.setup_extension(extension)
  File "/home/docs/checkouts/readthedocs.org/user_builds/ceph/envs/44951/lib/python3.8/site-packages/sphinx/application.py", line 402, in setup_extension
    self.registry.load_extension(self, extname)
  File "/home/docs/checkouts/readthedocs.org/user_builds/ceph/envs/44951/lib/python3.8/site-packages/sphinx/registry.py", line 430, in load_extension
    metadata = setup(app)
  File "/home/docs/checkouts/readthedocs.org/user_builds/ceph/envs/44951/lib/python3.8/site-packages/breathe/__init__.py", line 14, in setup
    renderer_setup(app)
  File "/home/docs/checkouts/readthedocs.org/user_builds/ceph/envs/44951/lib/python3.8/site-packages/breathe/renderer/sphinxrenderer.py", line 2613, in setup
    app.add_config_value("graphviz_dot", "dot", "html")
  File "/home/docs/checkouts/readthedocs.org/user_builds/ceph/envs/44951/lib/python3.8/site-packages/sphinx/application.py", line 535, in add_config_value
    self.config.add(name, default, rebuild, types)
  File "/home/docs/checkouts/readthedocs.org/user_builds/ceph/envs/44951/lib/python3.8/site-packages/sphinx/config.py", line 282, in add
    raise ExtensionError(__('Config value %r already present') % name)
sphinx.errors.ExtensionError: Config value 'graphviz_dot' already present

Extension error:
Config value 'graphviz_dot' already present

this issue has been reported to upstream, see
https://github.com/michaeljones/breathe/issues/803

before it is fixed upstream, let's stick with 4.32.0
which is known to work.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
3 years agomgr/dashboard: "Please expand your cluster first" shouldn't be shown if cluster is... 44951/head
Volker Theile [Wed, 9 Feb 2022 08:37:48 +0000 (09:37 +0100)]
mgr/dashboard: "Please expand your cluster first" shouldn't be shown if cluster is already meaningfully running

This PR will assume that a cluster is already up and fully running. If this should not be the expected behaviour, deployment tools have to set 'INSTALLED' explicitly. Without this assumption it might happen that upgraded and fully running clusters, e.g. Octopus -> Pacific, will show the 'Expand Cluster' on first log in.

cephadm will take care that the bootstrap phase will write the necessary key to show the 'Expand cluster' page.

Fixes: https://tracker.ceph.com/issues/54215
Signed-off-by: Volker Theile <vtheile@suse.com>
3 years agoMerge pull request #44971 from joscollin/wip-doc-fix-name-id
Venky Shankar [Mon, 14 Feb 2022 06:49:43 +0000 (12:19 +0530)]
Merge pull request #44971 from joscollin/wip-doc-fix-name-id

doc: mention MDS name and ID format in ceph-mds.rst

Reviewed-by: Venky Shankar <vshankar@redhat.com>
3 years agoMerge pull request #39315 from shenhang/fetchkey
Venky Shankar [Mon, 14 Feb 2022 04:23:10 +0000 (09:53 +0530)]
Merge pull request #39315 from shenhang/fetchkey

mds: fetch single dentry instead of complete dirfrag for lookup

Reviewed-by: Venky Shankar <vshankar@redhat.com>
3 years agoinclude/rados/librados.h: drop duplicated function declaration 45011/head
Kefu Chai [Mon, 14 Feb 2022 04:19:35 +0000 (12:19 +0800)]
include/rados/librados.h: drop duplicated function declaration

rados_mgr_command() has been declared in the very same header file
with exactly the same function signature, so there is no need to
repeat it.

in this change, the duplicated declaration of rados_mgr_command()
is dropped. the one with doxygen document is reserved.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
3 years agoMerge pull request #44308 from vshankar/wip-document-mds-locker
Kotresh HR [Sun, 13 Feb 2022 03:11:10 +0000 (08:41 +0530)]
Merge pull request #44308 from vshankar/wip-document-mds-locker

doc: document mds locking operation

3 years agoMerge pull request #44898 from taggelos/patch-1
Anthony D'Atri [Sat, 12 Feb 2022 10:52:16 +0000 (02:52 -0800)]
Merge pull request #44898 from taggelos/patch-1

doc/man/8: Fix spelling in user rename example

3 years agoMerge pull request #44780 from sosodev/dump-blocked-ops-count
Yuri Weinstein [Fri, 11 Feb 2022 22:51:00 +0000 (14:51 -0800)]
Merge pull request #44780 from sosodev/dump-blocked-ops-count

mds, osd: add dump_blocked_ops_count command

Reviewed-by: Neha Ojha <nojha@redhat.com>
3 years agoMerge pull request #44752 from NitzanMordhai/wip-nitzan-osd-status
Yuri Weinstein [Fri, 11 Feb 2022 22:50:31 +0000 (14:50 -0800)]
Merge pull request #44752 from NitzanMordhai/wip-nitzan-osd-status

pybind/mgr: ceph osd status crash with ZeroDivisionError

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
3 years agoMerge pull request #44588 from kamoltat/wip-ksirivad-disable-progress-by-default
Yuri Weinstein [Fri, 11 Feb 2022 22:49:17 +0000 (14:49 -0800)]
Merge pull request #44588 from kamoltat/wip-ksirivad-disable-progress-by-default

pybind/mgr/progress: disable pg recovery event by default

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
3 years agoMerge pull request #44289 from Vicente-Cheng/fix-outgoing-bl-overflow
Yuri Weinstein [Fri, 11 Feb 2022 22:48:18 +0000 (14:48 -0800)]
Merge pull request #44289 from Vicente-Cheng/fix-outgoing-bl-overflow

msg/async: fix outgoing_bl overflow and reset state_offset

Reviewed-by: Kefu Chai <kchai@redhat.com>
3 years agoMerge pull request #44809 from cyx1231st/wip-crimson-cleanup-epm
Samuel Just [Fri, 11 Feb 2022 21:36:57 +0000 (13:36 -0800)]
Merge pull request #44809 from cyx1231st/wip-crimson-cleanup-epm

crimson/os/seastore: allow EPM to make decisions on the general allocation path

Reviewed-by: Xuehan Xu <xxhdx1985126@gmail.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
3 years agodoc: document mds locking operation 44308/head
Venky Shankar [Tue, 14 Dec 2021 12:47:02 +0000 (18:17 +0530)]
doc: document mds locking operation

Signed-off-by: Venky Shankar <vshankar@redhat.com>
3 years agoMerge pull request #44849 from rhcs-dashboard/bugfix-cephfs-invalid-dir-permission
Sarthak0702 [Fri, 11 Feb 2022 09:59:20 +0000 (15:29 +0530)]
Merge pull request #44849 from rhcs-dashboard/bugfix-cephfs-invalid-dir-permission

mgr/dashboard: Directories Menu Can't Use on Ceph File System Dashboard

3 years agoFix rgw data sync log info error 44988/head
caishan [Fri, 11 Feb 2022 09:47:35 +0000 (17:47 +0800)]
Fix rgw data sync log info error

Signed-off-by: caishan <caishan1993@foxmail.com>
3 years agoMerge pull request #44970 from kotreshhr/fix-clone-uid-gid
Venky Shankar [Fri, 11 Feb 2022 07:41:24 +0000 (13:11 +0530)]
Merge pull request #44970 from kotreshhr/fix-clone-uid-gid

mgr/volumes: Fix clone uid/gid mismatch

Reviewed-by: Venky Shankar <vshankar@redhat.com>
3 years agodoc: mention MDS name and ID format in ceph-mds.rst 44971/head
Jos Collin [Thu, 10 Feb 2022 11:13:10 +0000 (16:43 +0530)]
doc: mention MDS name and ID format in ceph-mds.rst

Signed-off-by: Jos Collin <jcollin@redhat.com>
3 years agocrimson/os/seastore: misc log improvements 44809/head
Yingxin Cheng [Sat, 29 Jan 2022 11:13:12 +0000 (19:13 +0800)]
crimson/os/seastore: misc log improvements

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
3 years agocrimson/os/seastore: initialize segment_info_t correctly when open/empty
Yingxin Cheng [Fri, 28 Jan 2022 12:12:10 +0000 (20:12 +0800)]
crimson/os/seastore: initialize segment_info_t correctly when open/empty

Previously, segment_info_t was not initialized for out-of-line segments
when open, including journal_segment_seq and the legacy out_of_line.

And the journal_segment_seq was not reset when empty.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
3 years agocrimson/os/seastore: replace out_of_line by segment_type_t
Yingxin Cheng [Fri, 28 Jan 2022 12:08:04 +0000 (20:08 +0800)]
crimson/os/seastore: replace out_of_line by segment_type_t

Leverage segment_seq_t to identify the type of the segment.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
3 years agocrimson/os/seastore: cleanup dependency between epm and journal
Yingxin Cheng [Fri, 28 Jan 2022 07:12:57 +0000 (15:12 +0800)]
crimson/os/seastore: cleanup dependency between epm and journal

OOL segments won't contain deltas and don't need to replay. There is no
need to assign segment sequence from journal.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
3 years agocrimson/os/seastore: cleanup dependency between epm and lba_manager
Yingxin Cheng [Thu, 27 Jan 2022 15:35:45 +0000 (23:35 +0800)]
crimson/os/seastore: cleanup dependency between epm and lba_manager

Move lba_manamger->update_mapping() from epm to transaction manager.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
3 years agocrimson/os/seastore: update_mapping related cleanups
Yingxin Cheng [Thu, 27 Jan 2022 15:30:54 +0000 (23:30 +0800)]
crimson/os/seastore: update_mapping related cleanups

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
3 years agocrimson/os/seastore: allow EPM to make decisions on the general extent allocation...
Yingxin Cheng [Thu, 27 Jan 2022 07:00:44 +0000 (15:00 +0800)]
crimson/os/seastore: allow EPM to make decisions on the general extent allocation path

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
3 years agocrimson/os/seastore: drop the unnecessary backend_type in every cached extent
Yingxin Cheng [Thu, 27 Jan 2022 06:33:46 +0000 (14:33 +0800)]
crimson/os/seastore: drop the unnecessary backend_type in every cached extent

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
3 years agocrimson/os/seastore/epm: cleanup unnecessary cache dependency when mark extent ool
Yingxin Cheng [Thu, 27 Jan 2022 06:03:43 +0000 (14:03 +0800)]
crimson/os/seastore/epm: cleanup unnecessary cache dependency when mark extent ool

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
3 years agocrimson/os/seastore: cleanup delayed paddr
Yingxin Cheng [Thu, 27 Jan 2022 05:53:08 +0000 (13:53 +0800)]
crimson/os/seastore: cleanup delayed paddr

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>