]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
2 years agoMerge pull request #52501 from lxbsz/wip-62041
Yuri Weinstein [Fri, 4 Aug 2023 16:30:21 +0000 (09:30 -0700)]
Merge pull request #52501 from lxbsz/wip-62041

reef: client: do not send metrics until the MDS rank is ready

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2 years agoMerge pull request #52497 from lxbsz/wip-62044
Yuri Weinstein [Fri, 4 Aug 2023 16:28:42 +0000 (09:28 -0700)]
Merge pull request #52497 from lxbsz/wip-62044

reef: client: trigger to flush the buffer when making snapshot

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2 years agoMerge pull request #52235 from batrick/wip-59373-reef
Yuri Weinstein [Fri, 4 Aug 2023 16:26:13 +0000 (09:26 -0700)]
Merge pull request #52235 from batrick/wip-59373-reef

reef: qa: wait for MDSMonitor tick to replace daemons

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2 years agoMerge pull request #52774 from rhcs-dashboard/wip-62223-reef
Avan [Fri, 4 Aug 2023 16:03:50 +0000 (21:33 +0530)]
Merge pull request #52774 from rhcs-dashboard/wip-62223-reef

reef: mgr/dashboard: empty grafana panels for performance of daemons

Reviewed-by: Juan Miguel Olmo <jolmomar@redhat.com>
2 years agoMerge pull request #52801 from ceph/reef-release
Laura Flores [Fri, 4 Aug 2023 15:07:44 +0000 (10:07 -0500)]
Merge pull request #52801 from ceph/reef-release

v18.2.0

2 years agoMerge pull request #52805 from yaarith/release-checklists-telemetry
yaarith [Fri, 4 Aug 2023 13:18:42 +0000 (09:18 -0400)]
Merge pull request #52805 from yaarith/release-checklists-telemetry

reef: doc/dev/release-checklist: check telemetry validation

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2 years agomgr/prometheus: introduce fetch_perf_counters_metrics module option 52774/head
Avan Thakkar [Thu, 1 Dec 2022 06:06:56 +0000 (11:36 +0530)]
mgr/prometheus: introduce fetch_perf_counters_metrics module option

Fixes: https://tracker.ceph.com/issues/58164
Signed-off-by: Avan Thakkar <athakkar@redhat.com>
Introducing module option in prometheus module to enable/disable support for exporting ceph daemons
perf counters as prometheus metrics, by default this option will be disabled. The use case for this option
is in case if ceph-exporter deployment failed for any reason then user still can have option to fetch metrics
from promethues exporter.

2 years agoMerge pull request #52803 from zdover23/wip-doc-2023-08-04-backport-52800-to-reef
Anthony D'Atri [Fri, 4 Aug 2023 01:22:52 +0000 (21:22 -0400)]
Merge pull request #52803 from zdover23/wip-doc-2023-08-04-backport-52800-to-reef

reef: doc/rgw: several response headers are supported

2 years agodoc/dev/release-checklist: check telemetry validation 52805/head
Yaarit Hatuka [Fri, 4 Aug 2023 00:31:27 +0000 (00:31 +0000)]
doc/dev/release-checklist: check telemetry validation

Signed-off-by: Yaarit Hatuka <yaarit@redhat.com>
2 years agodoc/rgw: several response headers are supported 52803/head
Casey Bodley [Thu, 3 Aug 2023 21:31:31 +0000 (17:31 -0400)]
doc/rgw: several response headers are supported

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit ab6ec66a2f82c3dfb3807d5e76d3290ff30bf613)

2 years agoMerge pull request #52769 from adamemerson/wip-62097-reef
Ilya Dryomov [Thu, 3 Aug 2023 19:50:17 +0000 (21:50 +0200)]
Merge pull request #52769 from adamemerson/wip-62097-reef

reef: build: Remove ceph-libboost* packages in install-deps

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2 years ago18.2.0 52801/head v18.2.0
Ceph Release Team [Thu, 3 Aug 2023 16:53:12 +0000 (16:53 +0000)]
18.2.0

Signed-off-by: Ceph Release Team <ceph-maintainers@ceph.io>
2 years agoMerge pull request #52716 from neha-ojha/wip-reef-stable
Yuri Weinstein [Thu, 3 Aug 2023 14:20:17 +0000 (10:20 -0400)]
Merge pull request #52716 from neha-ojha/wip-reef-stable

reef: src/ceph_release, doc: mark reef stable

Reviewed-by: Yuri Weinstein <yweinste@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: Zac Dover <zac.dover@gmail.com>
2 years agobuild: Remove old ceph-libboost* packages in install-deps 52769/head
Adam Emerson [Wed, 19 Jul 2023 21:12:08 +0000 (17:12 -0400)]
build: Remove old ceph-libboost* packages in install-deps

Here, we extract `clean_boost_on_ubuntu()` and call it before other
installs on Debian distributions so that if we install a system boost,
a potentially newer `ceph-libboost` won't get in the way.

As the sources.list.d being removed in the original cleanup code isn't
the one we're currently installing in the install code, add a removal
for the currently used source, then do apt-update so packages from the
removed source are no longer included as available.

Two subsidiary dev packages from conflicting boost libraries can be
installed, but it leaves apt in an inconsistent state. To clean this
up, add `--fix-missing` to the removal line and call
`clean_boost_on_ubuntu()` before other uses of apt.

Fixes: https://tracker.ceph.com/issues/62097
Signed-off-by: Adam Emerson <aemerson@redhat.com>
(cherry picked from commit 0c3f511e14af639b6509e69b889258b2f718f8fd)

Conflicts:
install-deps.sh
 - Different boost version for Reef than Squid
 - ci_debug does not exist in Reef
 - No INSTALL_EXTRA

Signed-off-by: Adam Emerson <aemerson@redhat.com>
2 years agoMerge pull request #52779 from zdover23/wip-doc-2023-08-03-backport-52775-to-reef
Anthony D'Atri [Thu, 3 Aug 2023 00:40:28 +0000 (20:40 -0400)]
Merge pull request #52779 from zdover23/wip-doc-2023-08-03-backport-52775-to-reef

reef: doc: for EC we recommend K+1

2 years agodoc: for EC we recommend K+1 52779/head
Dan van der Ster [Wed, 2 Aug 2023 21:31:07 +0000 (14:31 -0700)]
doc: for EC we recommend K+1

Update the doc to match the reality in the code. I don't know where
the recommendation to have min_size = k+2 came from, but for awhile
now we've defaulted to K+1. See PR #8008.

Signed-off-by: Dan van der Ster <dan.vanderster@clyso.com>
(cherry picked from commit 68faf88e6babf7e5c2cce2b4d9b80a159b38c30d)

2 years agoexporter: fix instance_id labeld value for rgw in exporter
avanthakkar [Sun, 30 Jul 2023 21:09:36 +0000 (02:39 +0530)]
exporter: fix instance_id labeld value for rgw in exporter

Signed-off-by: avanthakkar <avanjohn@gmail.com>
(cherry picked from commit ca5691834cc30c4f9175bb0b4730750ed9df59cc)

2 years agomgr/dashboard: empty grafana panels for performance of daemons
avanthakkar [Mon, 26 Jun 2023 07:11:24 +0000 (12:41 +0530)]
mgr/dashboard: empty grafana panels for performance of daemons

Fixes: https://tracker.ceph.com/issues/61792
Signed-off-by: avanthakkar <avanjohn@gmail.com>
Removing the `ceph-` prefix from ceph_daemon label to adopt it with the label
format used by queries in grafana dashboards. Also changing the
`instance_id` label for rgw to match the values coming from
exporter and prometheus module

(cherry picked from commit fa2d1f9f0745ffecc671af3a3f0a93e7edaa1222)

2 years agoMerge pull request #52710 from cbodley/wip-62247-reef
Yuri Weinstein [Wed, 2 Aug 2023 14:53:09 +0000 (10:53 -0400)]
Merge pull request #52710 from cbodley/wip-62247-reef

reef: qa/rgw: pacific upgrade disables centos9

Reviewed-by: Yuri Weinstein <yweinste@redhat.com>
2 years agoMerge pull request #52758 from zdover23/wip-doc-2023-08-02-backport-51960-to-reef
Anthony D'Atri [Wed, 2 Aug 2023 14:36:40 +0000 (10:36 -0400)]
Merge pull request #52758 from zdover23/wip-doc-2023-08-02-backport-51960-to-reef

reef: doc: improve doc/dev/encoding.rst

2 years agodoc: improve doc/dev/encoding.rst 52758/head
Radosław Zarzyński [Mon, 5 Jun 2023 14:04:36 +0000 (16:04 +0200)]
doc: improve doc/dev/encoding.rst

Signed-off-by: Radosław Zarzyński <rzarzyns@redhat.com>
(cherry picked from commit 83bef6668d319685923df927f32590b4e1795746)

2 years agoMerge pull request #52731 from rhcs-dashboard/flake8-fix-reef
Casey Bodley [Tue, 1 Aug 2023 18:10:42 +0000 (14:10 -0400)]
Merge pull request #52731 from rhcs-dashboard/flake8-fix-reef

reef: mgr: fix some flake8 complaints

Reviewed-by: Adam King <adking@redhat.com>
2 years agomgr: fix some flake8 complaints 52731/head
Nizamudeen A [Mon, 31 Jul 2023 09:20:57 +0000 (14:50 +0530)]
mgr: fix some flake8 complaints

Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit d199782fb5f3c22f1cd5fda6ddf1d64f40a92726)

2 years agoMerge pull request #52712 from zdover23/wip-doc-2023-08-01-backport-52131-to-reef
zdover23 [Mon, 31 Jul 2023 21:18:37 +0000 (07:18 +1000)]
Merge pull request #52712 from zdover23/wip-doc-2023-08-01-backport-52131-to-reef

reef: doc/radosgw: correct emphasis in rate limit section

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2 years agosrc/ceph_release, doc: mark reef stable 52716/head
Neha Ojha [Mon, 31 Jul 2023 21:12:26 +0000 (21:12 +0000)]
src/ceph_release, doc: mark reef stable

Signed-off-by: Neha Ojha <nojha@redhat.com>
2 years agodoc/radosgw: correct emphasis in rate limit section 52712/head
Piotr Parczewski [Mon, 31 Jul 2023 14:42:26 +0000 (16:42 +0200)]
doc/radosgw: correct emphasis in rate limit section

Signed-off-by: Piotr Parczewski <piotr@stackhpc.com>
(cherry picked from commit 50bfbab6d9a30b3ba6ec4f4c8df9059298c28a7f)

2 years agoqa/rgw: pacific upgrade disables centos9 52710/head
Casey Bodley [Mon, 24 Jul 2023 14:09:28 +0000 (10:09 -0400)]
qa/rgw: pacific upgrade disables centos9

we don't build centos 9 packages for pacific, so the pacific upgrade
suite was failing with errors like:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=pacific

Fixes: https://tracker.ceph.com/issues/62135
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit b16bc1cd07a28d2a5677c2fc107686f0b96648ce)

2 years agoMerge pull request #52679 from zdover23/wip-doc-2023-07-28-backport-52671-to-reef
zdover23 [Sun, 30 Jul 2023 06:22:34 +0000 (16:22 +1000)]
Merge pull request #52679 from zdover23/wip-doc-2023-07-28-backport-52671-to-reef

reef: doc: update README.md install procedure

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2 years agoMerge pull request #52693 from zdover23/wip-doc-2023-07-29-backport-52668-to-reef
Anthony D'Atri [Sat, 29 Jul 2023 12:14:35 +0000 (08:14 -0400)]
Merge pull request #52693 from zdover23/wip-doc-2023-07-29-backport-52668-to-reef

reef: doc/radosgw: Add missing space to date option spec in admin.rst

2 years agoMerge pull request #52695 from zdover23/wip-doc-2023-07-29-backport-52685-to-reef
Anthony D'Atri [Sat, 29 Jul 2023 12:12:58 +0000 (08:12 -0400)]
Merge pull request #52695 from zdover23/wip-doc-2023-07-29-backport-52685-to-reef

reef: doc/mgr/ceph_api: Promptify example commands in index.rst

2 years agodoc/mgr/ceph_api: Promptify example commands in index.rst 52695/head
Ville Ojamo [Fri, 28 Jul 2023 04:49:19 +0000 (11:49 +0700)]
doc/mgr/ceph_api: Promptify example commands in index.rst

Use the more modern prompt block instead of
using code blocks for example commands.

Signed-off-by: Ville Ojamo <14869000+bluikko@users.noreply.github.com>
(cherry picked from commit 4f9bd62f374d2f6bf74296d87e5205960464c349)

2 years agodoc/radosgw: Add missing space to date option spec in admin.rst 52693/head
Ville Ojamo [Thu, 27 Jul 2023 07:56:58 +0000 (14:56 +0700)]
doc/radosgw: Add missing space to date option spec in admin.rst

The start time and end time CLI option specification is missing a space between the date and the optional time value. Also expand the text to talk about "optional time" after the date.

Signed-off-by: Ville Ojamo <14869000+bluikko@users.noreply.github.com>
(cherry picked from commit dd16ad9055f134433d9bd6410cd31eb0fc918723)

2 years agoMerge pull request #52687 from rhcs-dashboard/wip-62220-reef
Avan [Fri, 28 Jul 2023 18:48:39 +0000 (00:18 +0530)]
Merge pull request #52687 from rhcs-dashboard/wip-62220-reef

reef: exporter: ceph-exporter scrapes failing on multi-homed server

Reviewed-by: Juan Miguel Olmo <jolmomar@redhat.com>
2 years agoMerge pull request #52618 from vshankar/tr-62147
Yuri Weinstein [Fri, 28 Jul 2023 16:35:52 +0000 (12:35 -0400)]
Merge pull request #52618 from vshankar/tr-62147

reef: qa: use centos 8.stream for fs:upgrade tests

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Yuri Weinstein <yweinste@redhat.com>
2 years agoMerge pull request #52664 from idryomov/wip-61565-reef
Yuri Weinstein [Fri, 28 Jul 2023 15:38:46 +0000 (11:38 -0400)]
Merge pull request #52664 from idryomov/wip-61565-reef

reef: qa/workunits/rbd: use jammy version of qemu-iotests for centos 9

Reviewed-by: Ramana Raja <rraja@redhat.com>
2 years agoexporter: ceph-exporter scrapes failing on multi-homed server 52687/head
Avan Thakkar [Thu, 15 Jun 2023 11:18:54 +0000 (16:48 +0530)]
exporter: ceph-exporter scrapes failing on multi-homed server

Fixes: https://tracker.ceph.com/issues/61669
Signed-off-by: Avan Thakkar <athakkar@redhat.com>
Adopted ceph-exporter deployment in cephadm
to bind to all addresses on a machine.

(cherry picked from commit 9a6f01d0d229177a23175b5985d12aa140ca6271)

2 years agodoc: update README.md install procedure 52679/head
Zac Dover [Thu, 27 Jul 2023 11:49:19 +0000 (21:49 +1000)]
doc: update README.md install procedure

Add instructions directing the reader to install the "python3-routes"
package. This package is required in order to launch the dashboard after
the installation procedure has completed, but is not yet included in the
install-deps.sh script.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 0b0009bf1fb0cd54cdf0014bd724b00805a3dbd1)

2 years agoMerge pull request #52641 from zdover23/wip-doc-2023-07-26-backport-52630-to-reef
zdover23 [Wed, 26 Jul 2023 23:36:30 +0000 (09:36 +1000)]
Merge pull request #52641 from zdover23/wip-doc-2023-07-26-backport-52630-to-reef

reef: doc: update README.md

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2 years agoqa/workunits/rbd: use jammy version of qemu-iotests for centos 9 52664/head
Ilya Dryomov [Tue, 25 Jul 2023 11:31:25 +0000 (13:31 +0200)]
qa/workunits/rbd: use jammy version of qemu-iotests for centos 9

It's the one we are using for all recent distros.

While at it, get rid of custom bin directory -- it appears that both
v2.3.0 and v2.11.0 tests are happy with just symlinks in the current
directory.

Fixes: https://tracker.ceph.com/issues/61565
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit d49df8d74ca96a3c0fc00f1d7e303d4e12f2f1e3)

2 years agodoc: update README.md 52641/head
Zac Dover [Tue, 25 Jul 2023 13:09:11 +0000 (23:09 +1000)]
doc: update README.md

Correct and improve ceph/README.md.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit ad1202be685c1d35026b5ba96ba3f5cf3aefdb3a)

2 years agoMerge pull request #52616 from ceph/reef-release
Laura Flores [Tue, 25 Jul 2023 21:51:28 +0000 (16:51 -0500)]
Merge pull request #52616 from ceph/reef-release

v18.1.3

2 years agoMerge pull request #52612 from zdover23/wip-doc-2023-07-25-backport-49889-to-reef
zdover23 [Tue, 25 Jul 2023 14:36:12 +0000 (00:36 +1000)]
Merge pull request #52612 from zdover23/wip-doc-2023-07-25-backport-49889-to-reef

reef: doc/rados/configuration: add links to MON DNS

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2 years agoMerge pull request #52608 from zdover23/wip-doc-2023-07-25-backport-52601-to-reef
zdover23 [Tue, 25 Jul 2023 14:35:58 +0000 (00:35 +1000)]
Merge pull request #52608 from zdover23/wip-doc-2023-07-25-backport-52601-to-reef

reef: doc/rados: remove redundant cache tiering deprecation note

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2 years agoqa: use centos 8.stream for fs:upgrade tests 52618/head
Venky Shankar [Mon, 24 Jul 2023 06:54:35 +0000 (12:24 +0530)]
qa: use centos 8.stream for fs:upgrade tests

fs:upgrade tests use n/o/p release packages which aren't
available for centos 9.stream - switch using 8.stream instead.

Fixes: http://tracker.ceph.com/issues/62146
Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit b5756b98f989e8610f310ade4777cf6c87d72e23)

2 years ago18.1.3 52616/head v18.1.3
Ceph Release Team [Tue, 25 Jul 2023 02:48:11 +0000 (02:48 +0000)]
18.1.3

Signed-off-by: Ceph Release Team <ceph-maintainers@ceph.io>
2 years agodoc/rados/configuration: add links to MON DNS 52612/head
Ville Ojamo [Fri, 27 Jan 2023 07:54:11 +0000 (14:54 +0700)]
doc/rados/configuration: add links to MON DNS

Add two links to MON DNS lookup and an anchor in the destination document.

Signed-off-by: Ville Ojamo <14869000+bluikko@users.noreply.github.com>
(cherry picked from commit 06cb5652157a53b25e8ae588f375548b1df72d2d)

2 years agoMerge pull request #52377 from soumyakoduri/wip-skoduri-reef-dbstore
Yuri Weinstein [Mon, 24 Jul 2023 19:11:55 +0000 (15:11 -0400)]
Merge pull request #52377 from soumyakoduri/wip-skoduri-reef-dbstore

[reef]rgw/dbstore: Do not update mtime for attr change

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2 years agodoc/rados: remove redundant cache tiering deprecation note 52608/head
Ilya Dryomov [Mon, 24 Jul 2023 13:01:26 +0000 (15:01 +0200)]
doc/rados: remove redundant cache tiering deprecation note

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 12ccd294663b03f34a44424c6006248bb7469b73)

2 years agoMerge pull request #52574 from cbodley/wip-62106-reef
Yuri Weinstein [Mon, 24 Jul 2023 13:35:13 +0000 (09:35 -0400)]
Merge pull request #52574 from cbodley/wip-62106-reef

reef: valgrind: replace suppression for EVP_DecryptFinal_ex

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
2 years agoMerge pull request #52567 from cbodley/wip-qa-distros-centos9-reef
Yuri Weinstein [Mon, 24 Jul 2023 13:34:37 +0000 (09:34 -0400)]
Merge pull request #52567 from cbodley/wip-qa-distros-centos9-reef

reef: qa/distros: add centos stream 9 as supported distro

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
2 years agoMerge pull request #52566 from cbodley/wip-62104-reef
Yuri Weinstein [Mon, 24 Jul 2023 13:33:50 +0000 (09:33 -0400)]
Merge pull request #52566 from cbodley/wip-62104-reef

reef: test/pybind: replace nose with pytest

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
2 years agoMerge pull request #52078 from guits/wip-61700-reef
Guillaume Abrioux [Mon, 24 Jul 2023 08:07:27 +0000 (10:07 +0200)]
Merge pull request #52078 from guits/wip-61700-reef

reef: ceph-volume: set lvm membership for mpath type devices

2 years agoMerge pull request #52593 from zdover23/wip-doc-2023-07-23-backport-52587-to-reef
Anthony D'Atri [Sun, 23 Jul 2023 14:20:05 +0000 (10:20 -0400)]
Merge pull request #52593 from zdover23/wip-doc-2023-07-23-backport-52587-to-reef

reef: doc/rados: edit ceph-conf.rst (4 of x)

2 years agodoc/rados: edit ceph-conf.rst (4 of x) 52593/head
Zac Dover [Sat, 22 Jul 2023 03:57:51 +0000 (13:57 +1000)]
doc/rados: edit ceph-conf.rst (4 of x)

Edit doc/rados/configuration/ceph-conf.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit ac47899863390ff9f2adf658273e1d61760a68c2)

2 years agoMerge pull request #52588 from zdover23/wip-doc-2023-07-22-backport-52542-to-reef
Anthony D'Atri [Sat, 22 Jul 2023 11:54:50 +0000 (07:54 -0400)]
Merge pull request #52588 from zdover23/wip-doc-2023-07-22-backport-52542-to-reef

reef: doc/rados: edit ceph-conf.rst (3 of x)

2 years agodoc/rados: edit ceph-conf.rst (3 of x) 52588/head
Zac Dover [Wed, 19 Jul 2023 13:00:38 +0000 (23:00 +1000)]
doc/rados: edit ceph-conf.rst (3 of x)

Edit doc/rados/configuration/ceph-conf.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit b1fb80ae088e4f00f207454433111f6597715ed8)

2 years agoMerge pull request #52572 from zdover23/wip-doc-2023-07-21-backport-52563-to-reef
Anthony D'Atri [Fri, 21 Jul 2023 13:46:08 +0000 (09:46 -0400)]
Merge pull request #52572 from zdover23/wip-doc-2023-07-21-backport-52563-to-reef

reef: doc: governance.rst - update D Orman

2 years agovalgrind: remove stale openssl suppressions 52574/head
Casey Bodley [Thu, 20 Jul 2023 13:23:52 +0000 (09:23 -0400)]
valgrind: remove stale openssl suppressions

years ago in commit fe97a000990632dbe9734e0d3a96df627f104f7a, the
signature of authenticated_decrypt_update_final() changed and this
suppression no longer matches its mangled form:

-  fun:_ZN4ceph6crypto6onwire25AES128GCM_OnWireRxHandler34authenticated_decrypt_update_finalEONS_6buffer7v*4listEj
+  fun:_ZN4ceph6crypto6onwire25AES128GCM_OnWireRxHandler34authenticated_decrypt_update_finalERNS_6buffer7v15_2_04listE

the fact that we didn't notice must mean that we don't need the
suppressions anymore

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit d6d9986315481ca13e8823c8e26c03eeac2d1713)

2 years agovalgrind: suppress uninitialized value in OpenSSL
Casey Bodley [Wed, 19 Jul 2023 17:19:46 +0000 (13:19 -0400)]
valgrind: suppress uninitialized value in OpenSSL

Fixes: https://tracker.ceph.com/issues/61566
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit ef61386862a507e993a05e23de75a88d7744f7b4)

2 years agodoc: governance.rst - update D Orman 52572/head
Zac Dover [Thu, 20 Jul 2023 17:35:52 +0000 (03:35 +1000)]
doc: governance.rst - update D Orman

Update David Orman's email address in doc/governance.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 46f503975e124680b29333e3972c4c937a641c10)

2 years agoMerge pull request #52302 from lxbsz/wip-61797
Yuri Weinstein [Thu, 20 Jul 2023 23:12:37 +0000 (19:12 -0400)]
Merge pull request #52302 from lxbsz/wip-61797

reef: client: only wait for write MDS OPs when unmounting

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2 years agoMerge pull request #52525 from cfsnyder/wip-62065-reef
Yuri Weinstein [Thu, 20 Jul 2023 21:43:26 +0000 (17:43 -0400)]
Merge pull request #52525 from cfsnyder/wip-62065-reef

reef: rgw: fix consistency bug with OLH objects

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2 years agoMerge pull request #52562 from rhcs-dashboard/reef-make-check-fix
Laura Flores [Thu, 20 Jul 2023 19:39:37 +0000 (14:39 -0500)]
Merge pull request #52562 from rhcs-dashboard/reef-make-check-fix

reef: install-deps: remove the legacy resolver flags

2 years agoqa/distros/supported-random: add centos_latest.yaml 52567/head
Casey Bodley [Wed, 8 Mar 2023 15:36:36 +0000 (10:36 -0500)]
qa/distros/supported-random: add centos_latest.yaml

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 5e0985a70aa9165157e32efc1eadf39d05c8ccf3)

2 years agoqa/distros/supported: update centos_latest.yaml and add centos_8.stream.yaml
Casey Bodley [Wed, 8 Mar 2023 15:32:10 +0000 (10:32 -0500)]
qa/distros/supported: update centos_latest.yaml and add centos_8.stream.yaml

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 9d2450a7aa6e3bed5065463f6f72d2144f0746c3)

2 years agoqa/distros/all: add centos_latest.yaml symlink to centos_9.stream.yaml
Casey Bodley [Wed, 8 Mar 2023 15:29:07 +0000 (10:29 -0500)]
qa/distros/all: add centos_latest.yaml symlink to centos_9.stream.yaml

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit a85f50c24bd478144fa02df39af47944cb7bc33e)

2 years agoqa/distros/all: add centos_9.stream.yaml
Casey Bodley [Wed, 8 Mar 2023 15:28:44 +0000 (10:28 -0500)]
qa/distros/all: add centos_9.stream.yaml

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 69fe8543dff30bdb42d9029661997a6134a81c3d)

2 years agoqa/suites: install pytest for pybind tasks 52566/head
Casey Bodley [Wed, 21 Jun 2023 12:08:58 +0000 (08:08 -0400)]
qa/suites: install pytest for pybind tasks

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit cbdd5209957646f497b5e0df2f1a8dc6d918267f)

2 years agotest/pybind/rgwfs: convert from nose to pytest
Casey Bodley [Tue, 20 Jun 2023 21:06:23 +0000 (17:06 -0400)]
test/pybind/rgwfs: convert from nose to pytest

* use a fixture for setup_test()
* replace nose assertions

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 136b3ec5323eb392e1017fffba1a538b87b77a58)

2 years agotest/pybind/rados: convert from nose to pytest
Casey Bodley [Tue, 20 Jun 2023 20:29:37 +0000 (16:29 -0400)]
test/pybind/rados: convert from nose to pytest

* replace nose.Skiptest with pytest.skip()
* replace nose attrs with @pytest.mark
* replace nose assertions
* replace setUp/tearDown with setup/teardown_method

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 0d0128f50edd16dd257a4b897bb63d9168497f80)

2 years agotest/pybind/cephfs: convert from nose to pytest
Casey Bodley [Tue, 20 Jun 2023 20:12:14 +0000 (16:12 -0400)]
test/pybind/cephfs: convert from nose to pytest

* use a fixture for setup_test()
* invoke test_cephfs.py with pytest

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 0bd813f069ed7a3ee691fbfb33da017bb00c1a55)

Conflicts:
src/test/pybind/test_cephfs.py
missing https://github.com/ceph/ceph/pull/43546
missing https://github.com/ceph/ceph/pull/46905

2 years agotest/pybind/rbd: convert from nose to pytest
Casey Bodley [Tue, 20 Jun 2023 18:46:40 +0000 (14:46 -0400)]
test/pybind/rbd: convert from nose to pytest

* use fixtures for temporary images and groups
* use pytest.skip instead of nose.SkipTest
* replace setUp/tearDown with setup/teardown_method
* add @pytest.mark.skip_if_crimson
* replace nose assertions

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit af04457a43921bcac85b572098245a4c8a79452e)

2 years agoinstall-deps: remove the legacy resolver flags 52562/head
Nizamudeen A [Wed, 19 Jul 2023 14:05:05 +0000 (19:35 +0530)]
install-deps: remove the legacy resolver flags

This was a workaround that was introduced long time ago. This will be
something that could be deprectaed at some point [1]. And its preventing some of the dependencies to be
downloaded or stored into the wheelhouse. Deps like jsonschema, parse,
mypy, cryptography etc.

[1] https://pip.pypa.io/en/latest/user_guide/#deprecation-timeline

Fixes: https://tracker.ceph.com/issues/62082
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit d179b95ddf57f8ca48633aed9f6229e39ad83fef)

 Conflicts:
install-deps.sh
  - discard the incoming change and edit the line manually

2 years agoMerge pull request #52469 from idryomov/wip-61587-reef
Yuri Weinstein [Wed, 19 Jul 2023 15:58:40 +0000 (11:58 -0400)]
Merge pull request #52469 from idryomov/wip-61587-reef

reef: common: `counter dump` command revision

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
2 years agoMerge pull request #52414 from ljflores/wip-61966-reef
Yuri Weinstein [Wed, 19 Jul 2023 15:58:02 +0000 (11:58 -0400)]
Merge pull request #52414 from ljflores/wip-61966-reef

reef: qa/suites/rados/singleton/all: remove test_envlibrados_for_rocksdb

Reviewed-by: Neha Ojha <nojha@redhat.com>
2 years agoMerge pull request #52399 from mchangir/wip-61959-reef
Yuri Weinstein [Wed, 19 Jul 2023 15:53:32 +0000 (11:53 -0400)]
Merge pull request #52399 from mchangir/wip-61959-reef

reef: mon: block osd pool mksnap for fs pools

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2 years agoMerge pull request #52242 from batrick/wip-61424-reef
Yuri Weinstein [Wed, 19 Jul 2023 15:52:37 +0000 (11:52 -0400)]
Merge pull request #52242 from batrick/wip-61424-reef

reef: mon/MDSMonitor: ignore extraneous up:boot messages

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2 years agoMerge pull request #52238 from batrick/wip-61413-reef
Yuri Weinstein [Wed, 19 Jul 2023 15:52:10 +0000 (11:52 -0400)]
Merge pull request #52238 from batrick/wip-61413-reef

reef: mon/MDSMonitor: do not propose on error in prepare_update

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2 years agoMerge pull request #52232 from batrick/wip-61410-reef
Yuri Weinstein [Wed, 19 Jul 2023 15:51:34 +0000 (11:51 -0400)]
Merge pull request #52232 from batrick/wip-61410-reef

reef: mon/MDSMonitor: check fscid in pending exists in current

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2 years agoMerge pull request #52231 from batrick/wip-61759-reef
Yuri Weinstein [Wed, 19 Jul 2023 15:50:09 +0000 (11:50 -0400)]
Merge pull request #52231 from batrick/wip-61759-reef

reef: pybind/rados: keep byte representation if decode fails

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2 years agoMerge pull request #52229 from batrick/wip-61693-reef
Yuri Weinstein [Wed, 19 Jul 2023 15:48:03 +0000 (11:48 -0400)]
Merge pull request #52229 from batrick/wip-61693-reef

reef:  mon/MDSMonitor: batch last_metadata update with pending

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2 years agoMerge pull request #52126 from joscollin/wip-61735-reef
Yuri Weinstein [Wed, 19 Jul 2023 15:40:46 +0000 (11:40 -0400)]
Merge pull request #52126 from joscollin/wip-61735-reef

reef: mds: display sane hex value (0x0) for empty feature bit

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2 years agoMerge pull request #52073 from joscollin/wip-61694-reef
Yuri Weinstein [Wed, 19 Jul 2023 15:40:19 +0000 (11:40 -0400)]
Merge pull request #52073 from joscollin/wip-61694-reef

reef: debian: install cephfs-mirror systemd unit files and man page

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2 years agoMerge pull request #51684 from lxbsz/wip-61347
Yuri Weinstein [Wed, 19 Jul 2023 15:39:34 +0000 (11:39 -0400)]
Merge pull request #51684 from lxbsz/wip-61347

reef: mds: wait reintegrate to finish when unlinking

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2 years agoMerge pull request #51607 from vshankar/tr-59724
Yuri Weinstein [Wed, 19 Jul 2023 15:39:00 +0000 (11:39 -0400)]
Merge pull request #51607 from vshankar/tr-59724

reef: mds: allow unlink from lost+found directory

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2 years agoMerge pull request #51506 from lxbsz/wip-59708
Yuri Weinstein [Wed, 19 Jul 2023 15:37:25 +0000 (11:37 -0400)]
Merge pull request #51506 from lxbsz/wip-59708

reef: mds: do not take the ino which has been used

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2 years agoMerge pull request #51484 from vshankar/tr-59719
Yuri Weinstein [Wed, 19 Jul 2023 15:36:20 +0000 (11:36 -0400)]
Merge pull request #51484 from vshankar/tr-59719

reef: client: use deep-copy when setting permission during make_request

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2 years agorgw: fix/improve test_rgw_versioning.py tests 52525/head
Cory Snyder [Wed, 12 Jul 2023 14:08:07 +0000 (14:08 +0000)]
rgw: fix/improve test_rgw_versioning.py tests

Signed-off-by: Cory Snyder <csnyder@1111systems.com>
(cherry picked from commit aa1f40e80d78ce08a2f51dad6fadf620866d17a3)

2 years agorgw: apply_olh_log should clear_olh before trimming olh log
Cory Snyder [Wed, 14 Jun 2023 14:01:43 +0000 (14:01 +0000)]
rgw: apply_olh_log should clear_olh before trimming olh log

When pending_removal is true and the log is trimmed prior to
clearing olh, it allows for the possibility that the olh is not
cleared (e.g. due to new pending xattrs on the olh obj), but the
olh log entries are removed.

Signed-off-by: Cory Snyder <csnyder@1111systems.com>
(cherry picked from commit dfbe4f9cb078bad9a0244ce433a9728f8bd6b912)

Conflicts:
src/rgw/driver/rados/rgw_rados.cc

Cherry-pick notes:
- conflicts due to https://github.com/ceph/ceph/pull/50206 on main

2 years agorgw: cancel olh modification by removing pending xattrs in set_olh error scenarios
Cory Snyder [Wed, 31 May 2023 18:01:02 +0000 (18:01 +0000)]
rgw: cancel olh modification by removing pending xattrs in set_olh error scenarios

Makes request threads clean up after themselves and remove their pending
xattrs from OLH objects before they return an error from set_olh.

Fixes: https://tracker.ceph.com/issues/59663
Signed-off-by: Cory Snyder <csnyder@1111systems.com>
(cherry picked from commit 38133e59d293dc8c16c92666967783d9e08a79cd)

Conflicts:
src/rgw/driver/rados/rgw_rados.cc
src/rgw/driver/rados/rgw_rados.h

Cherry-pick notes:
- conflicts due to https://github.com/ceph/ceph/pull/50206 on main but not reef

2 years agorgw: extract apply_olh logic for clearing olh to a method
Cory Snyder [Mon, 3 Jul 2023 19:01:47 +0000 (19:01 +0000)]
rgw: extract apply_olh logic for clearing olh to a method

Also clears stale pending entries prior to attempting to
clear OLH index entries and remove the OLH object.

Signed-off-by: Cory Snyder <csnyder@1111systems.com>
(cherry picked from commit 3437897deaec478f231dcad68b05fa38a7f2cb10)

Conflicts:
src/rgw/driver/rados/rgw_rados.cc
src/rgw/driver/rados/rgw_rados.h

Cherry-pick notes:
- conflicts due to https://github.com/ceph/ceph/pull/50206 on main but not reef

2 years agorgw: is_olh() predicate should use user.rgw.olh.ver xattr
Cory Snyder [Tue, 23 May 2023 09:43:38 +0000 (09:43 +0000)]
rgw: is_olh() predicate should use user.rgw.olh.ver xattr

The predicate which determines whether an object is an OLH object was previously based off of the
user.rgw.olh.info xattr, but this xattr is not set when the OLH object is first created. This
means that in cases where an error prevents that xattr from being set later, the OLH object is
incorrectly interpreted as an empty unversioned object. This change modifies the is_olh function
to use the user.rgw.olh.ver xattr. This xattr is set at the time of OLH creation and therefore
ensures consistency.

Fixes: https://tracker.ceph.com/issues/61359
Signed-off-by: Cory Snyder <csnyder@1111systems.com>
(cherry picked from commit 74ab3eb94a4177eacdac4fe48528542ba355ecfe)

2 years agoqa/workunits/rgw: add test for PUT response during reshard
Cory Snyder [Tue, 23 May 2023 08:39:32 +0000 (08:39 +0000)]
qa/workunits/rgw: add test for PUT response during reshard

Tests that a PUT succeeds when the bucket is actively resharding.

Signed-off-by: Cory Snyder <csnyder@1111systems.com>
(cherry picked from commit 38e027a8c3019f12d108563221419bf38ed8ac5b)

2 years agoradosgw-admin: add --inject-delay-at and --inject-delay-ms
Casey Bodley [Wed, 24 May 2023 17:24:52 +0000 (13:24 -0400)]
radosgw-admin: add --inject-delay-at and --inject-delay-ms

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit f815439ec59538f1d97ef27993510cace3d4fbf4)

2 years agocommon: FaultInjector supports InjectDelay
Casey Bodley [Wed, 24 May 2023 17:14:55 +0000 (13:14 -0400)]
common: FaultInjector supports InjectDelay

instead of injecting an error code or assertion failure, InjectDelay
just injects an artificial delay before returning success

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 86cb15d3a53cff6f562baa9461f79549c6b82b88)

2 years agoclient: do not send metrics until the MDS rank is ready 52501/head
Xiubo Li [Thu, 1 Jun 2023 12:00:01 +0000 (20:00 +0800)]
client: do not send metrics until the MDS rank is ready

In some cases when there are a lot of clients and these clients
have a lots of known requests need to replay too, the metrics
requests will be dropped by the MDS because the MDS is still in
the clientreplay state, and also the useless metric requests will
slow down MDS.

Fixes: https://tracker.ceph.com/issues/61523
Signed-off-by: Xiubo Li <xiubli@redhat.com>
(cherry picked from commit a423e17d5bbd095af4472c087dbbc6ac0c5e9e61)

2 years agoclient: clean up the queue_cap_snap() code to remove unnecessary check 52497/head
Xiubo Li [Mon, 8 May 2023 11:34:19 +0000 (19:34 +0800)]
client: clean up the queue_cap_snap() code to remove unnecessary check

If the 'dirty' is true then 'dirty & CEPH_CAP_ANY_WR' will always be
true.

Fixes: https://tracker.ceph.com/issues/59343
Signed-off-by: Xiubo Li <xiubli@redhat.com>
(cherry picked from commit cebb5a61c507e05fdd391ee1c569e5a3a0860c2a)

2 years agoclient: always add one new capsnap if Fb is used and Fw is not used
Xiubo Li [Mon, 8 May 2023 05:48:43 +0000 (13:48 +0800)]
client: always add one new capsnap if Fb is used and Fw is not used

If we set the 'writing' to 1 when the 'Fb' caps is used then later
if we have any dirty caps it will be skipped and will reuse the
existing capsnap, which is incorrect.

At the same time trigger to flush the buffer when making snapshot
and if the Fb is being used.

Fixes: https://tracker.ceph.com/issues/59343
Signed-off-by: Xiubo Li <xiubli@redhat.com>
(cherry picked from commit 6262351f7da9413d8306a6f1765ecab1f0ab912e)

2 years agoMerge pull request #52486 from zdover23/wip-doc-2023-07-17-backport-52483-to-reef
Anthony D'Atri [Mon, 17 Jul 2023 15:46:01 +0000 (11:46 -0400)]
Merge pull request #52486 from zdover23/wip-doc-2023-07-17-backport-52483-to-reef

reef: doc/mgr/rgw.rst: add missing "ceph" command in cli specification

2 years agodoc/mgr/rgw.rst: add missing "ceph" command in cli specification 52486/head
Ville Ojamo [Mon, 17 Jul 2023 13:05:39 +0000 (20:05 +0700)]
doc/mgr/rgw.rst: add missing "ceph" command in cli specification

The line begins with a prompt so I would
expect it to be a "complete" command,
including the `ceph` binary to run with all
the various listed arguments.

Signed-off-by: Ville Ojamo <14869000+bluikko@users.noreply.github.com>
(cherry picked from commit 37ea3e50f09be5490d7ec614798822aa6f86eaec)