]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
12 months agodoc: Correct link to "Device management" 58488/head
Matthew Vernon [Tue, 9 Jul 2024 16:02:31 +0000 (17:02 +0100)]
doc: Correct link to "Device management"

The current link goes to `cephadm/services/rados/operations/devices` which is a 404, it instead needs to be `rados/operations/devices/`.

Signed-off-by: Matthew Vernon <mvernon@wikimedia.org>
(cherry picked from commit d1a7cc4978adacd4e11df2d3e0886b191b118cc1)

12 months agoMerge pull request #58443 from cbodley/wip-66847-squid
Casey Bodley [Tue, 9 Jul 2024 17:29:50 +0000 (18:29 +0100)]
Merge pull request #58443 from cbodley/wip-66847-squid

squid: rgw: fix multipart get part when count==1

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
12 months agoMerge pull request #58089 from ronen-fr/wip-rf-57865-squid
Yuri Weinstein [Tue, 9 Jul 2024 14:03:33 +0000 (07:03 -0700)]
Merge pull request #58089 from ronen-fr/wip-rf-57865-squid

squid: osd/scrub: allow new scrubs while reserving

Reviewed-by: Samuel Just <sjust@redhat.com>
12 months agoMerge pull request #57623 from sajibreadd/wip-65937-squid
Yuri Weinstein [Tue, 9 Jul 2024 14:02:26 +0000 (07:02 -0700)]
Merge pull request #57623 from sajibreadd/wip-65937-squid

squid: os/bluestore: set rocksdb iterator bounds for Bluestore::_collection_list()

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
12 months agoMerge pull request #57382 from pdvian/wip-65890-squid
Yuri Weinstein [Tue, 9 Jul 2024 14:00:17 +0000 (07:00 -0700)]
Merge pull request #57382 from pdvian/wip-65890-squid

squid: mgr: integrate optracker in ceph-mgr

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Michael Kidd <linuxkidd@gmail.com>
12 months agoMerge pull request #56200 from ifed01/wip-ifed-fix-64443-squi
Yuri Weinstein [Tue, 9 Jul 2024 13:58:51 +0000 (06:58 -0700)]
Merge pull request #56200 from ifed01/wip-ifed-fix-64443-squi

squid: test/store_test: fix DeferredWrite test when prefer_deferred_size=0

Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
12 months agoMerge pull request #58072 from yuvalif/wip-66499-squid
Casey Bodley [Mon, 8 Jul 2024 14:37:18 +0000 (15:37 +0100)]
Merge pull request #58072 from yuvalif/wip-66499-squid

squid: rgw: do not assert on thread name setting failures

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
12 months agoMerge pull request #57784 from yuvalif/wip-66288-squid
Casey Bodley [Mon, 8 Jul 2024 12:58:17 +0000 (13:58 +0100)]
Merge pull request #57784 from yuvalif/wip-66288-squid

squid: rgw/kafka: do not destroy the connection on errors

Reviewed-by: Casey Bodley <cbodley@redhat.com>
12 months agoMerge pull request #57996 from kchheda3/wip-66443-squid
Casey Bodley [Fri, 5 Jul 2024 16:39:06 +0000 (17:39 +0100)]
Merge pull request #57996 from kchheda3/wip-66443-squid

squid:  rgw/notification: Store the value of `persistent_queue` for existing topics and continue commiting events for all topics subscribed to given bucket

Reviewed-by: Casey Bodley <cbodley@redhat.com>
12 months agorgw: fix multipart get part when count==1 58443/head
Casey Bodley [Wed, 26 Jun 2024 14:52:37 +0000 (10:52 -0400)]
rgw: fix multipart get part when count==1

the RGWObjManifest for multipart uploads is subtly different when
there's only a single part. in that case, get_cur_part_id() for the
final rule returns 1 where it otherwise returns (parts_count + 1)

this caused two problems:
* we returned a parts_count of 0 instead 1, and
* the do-while loop got stuck in an infinite loop expecting the last
  rule's part id to be higher than the requested part id

Fixes: https://tracker.ceph.com/issues/66705
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 562e0ce9baac53e714d91a46b4f0114b82827026)

12 months agoMerge pull request #58420 from guits/wip-66830-squid
Guillaume Abrioux [Fri, 5 Jul 2024 08:11:42 +0000 (10:11 +0200)]
Merge pull request #58420 from guits/wip-66830-squid

squid: qa: fix log errors for cephadm tests

12 months agoMerge pull request #58431 from zdover23/wip-doc-2024-07-05-backport-58368-to-squid
Anthony D'Atri [Thu, 4 Jul 2024 20:30:55 +0000 (16:30 -0400)]
Merge pull request #58431 from zdover23/wip-doc-2024-07-05-backport-58368-to-squid

squid: doc/rados: document manually passing search domain

12 months agodoc/rados: document manually passing search domain 58431/head
Zac Dover [Mon, 1 Jul 2024 06:36:02 +0000 (16:36 +1000)]
doc/rados: document manually passing search domain

Document how to manually pass the search domain to "mon_dns_srv_name" in
doc/rados/configuration/mon-lookup-dns.rst.

This commit is made in response to a request by Lander Duncan that was made on the [ceph-users] mailing list, and can be seen here: https://lists.ceph.io/hyperkitty/list/ceph-users@ceph.io/thread/F7V4CWLIYCAJ4JXI2JLNY6QPCFPR4SLA/

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 98938a0312dd0c8e0b293ed9aa2e0760cc9619fa)

12 months agoMerge pull request #58422 from AliMasarweh/wip-66772-squid
Ali Masarwa [Thu, 4 Jul 2024 13:18:05 +0000 (16:18 +0300)]
Merge pull request #58422 from AliMasarweh/wip-66772-squid

squid: RGW|Bucket notification: reload realm correctly

Reviewed-by: yuvalif<ylifshit@redhat.com>
12 months agoMerge pull request #58246 from rhcs-dashboard/wip-66486-squid
Nizamudeen A [Thu, 4 Jul 2024 10:11:38 +0000 (15:41 +0530)]
Merge pull request #58246 from rhcs-dashboard/wip-66486-squid

squid: mgr/dashboard: add dueTime to rgw bucket validator

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
12 months agoRGW|Bucket notification: disable notif v2 to reload realm correctly 58422/head
Ali Masarwa [Thu, 23 May 2024 11:08:56 +0000 (14:08 +0300)]
RGW|Bucket notification: disable notif v2 to reload realm correctly

Signed-off-by: Ali Masarwa <amasarwa@redhat.com>
(cherry picked from commit cce9b3c63ff0d83b3ab337c7c64b140e007290e1)

12 months agoqa: fix log errors for cephadm tests 58420/head
Guillaume Abrioux [Thu, 27 Jun 2024 08:12:10 +0000 (10:12 +0200)]
qa: fix log errors for cephadm tests

This fixes a lot of errors induced by the log scrapper check.

Fixes: https://tracker.ceph.com/issues/66751
Signed-off-by: Guillaume Abrioux <gabrioux@ibm.com>
(cherry picked from commit 53b462764c6fe11282b6cdb21131c176c1ed2350)

12 months agoqa/cephadm: fix ignorelist of CEPHADM_STRAY_DAEMON for rados_api_tests
Adam King [Fri, 10 May 2024 20:21:01 +0000 (16:21 -0400)]
qa/cephadm: fix ignorelist of CEPHADM_STRAY_DAEMON for rados_api_tests

Not every log with this error has the parentheses, so
these warnings were still causing the test to fail

[ERR] [WRN] CEPHADM_STRAY_DAEMON: 2 stray daemon(s)... in cluster log

Signed-off-by: Adam King <adking@redhat.com>
(cherry picked from commit 0a67436e36289b2e1bcf0acf662214b9e659b0de)

12 months agoMerge pull request #57224 from kotreshhr/wip-65404-squid
Xiubo Li [Wed, 3 Jul 2024 09:55:36 +0000 (17:55 +0800)]
Merge pull request #57224 from kotreshhr/wip-65404-squid

squid: mds: log at a lower level when stopping

12 months agoMerge pull request #57981 from dparmar18/wip-66191-squid
Xiubo Li [Wed, 3 Jul 2024 09:55:22 +0000 (17:55 +0800)]
Merge pull request #57981 from dparmar18/wip-66191-squid

squid: client: set LIBMOUNT_FORCE_MOUNT2=always

12 months agoMerge pull request #58085 from rishabh-d-dave/wip-66500-squid
Xiubo Li [Wed, 3 Jul 2024 09:54:38 +0000 (17:54 +0800)]
Merge pull request #58085 from rishabh-d-dave/wip-66500-squid

squid: cephfs-shell: prints warning, hangs and aborts when launched

12 months agoMerge pull request #58389 from zdover23/wip-doc-2024-07-02-backport-58092-to-squid
Zac Dover [Tue, 2 Jul 2024 13:12:10 +0000 (23:12 +1000)]
Merge pull request #58389 from zdover23/wip-doc-2024-07-02-backport-58092-to-squid

squid: doc/start: remove mention of Centos 8 support

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
12 months agodoc/start: remove mention of Centos 8 support 58389/head
Zac Dover [Mon, 17 Jun 2024 15:09:44 +0000 (01:09 +1000)]
doc/start: remove mention of Centos 8 support

Remove information so that it is clear that Centos 8 will no longer be
supported by Ceph.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 6b149e4f6ab2ac716e73f42b0d6c67482a768da9)

12 months agoMerge pull request #58266 from amathuria/wip-66694-squid
Yuri Weinstein [Mon, 1 Jul 2024 22:35:39 +0000 (15:35 -0700)]
Merge pull request #58266 from amathuria/wip-66694-squid

squid: osd/ECBackend.cc: Fix double increment of num_shards_repaired stat

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
12 months agoMerge pull request #58341 from guits/wip-66746-squid
Adam King [Mon, 1 Jul 2024 19:29:52 +0000 (15:29 -0400)]
Merge pull request #58341 from guits/wip-66746-squid

squid: tests: make sure nvmetcli and nvme-cli are up to date

Reviewed-by: Adam King <adking@redhat.com>
12 months agoMerge pull request #58219 from guits/wip-66026-squid
Adam King [Mon, 1 Jul 2024 19:25:10 +0000 (15:25 -0400)]
Merge pull request #58219 from guits/wip-66026-squid

squid: ceph-volume: create LVs when using partitions

Reviewed-by: Adam King <adking@redhat.com>
12 months agoMerge pull request #58151 from guits/wip-66464-squid
Adam King [Mon, 1 Jul 2024 19:22:23 +0000 (15:22 -0400)]
Merge pull request #58151 from guits/wip-66464-squid

squid: ceph-volume: fix set_dmcrypt_no_workqueue()

Reviewed-by: Teoman ONAY <tonay@ibm.com>
12 months agoMerge pull request #58370 from zdover23/wip-doc-2024-07-01-backport-58366-to-squid
Anthony D'Atri [Mon, 1 Jul 2024 15:35:42 +0000 (11:35 -0400)]
Merge pull request #58370 from zdover23/wip-doc-2024-07-01-backport-58366-to-squid

squid: doc/cephfs: update cephfs-shell link

12 months agoMerge pull request #58198 from ljflores/wip-66605-squid
Laura Flores [Mon, 1 Jul 2024 14:54:57 +0000 (09:54 -0500)]
Merge pull request #58198 from ljflores/wip-66605-squid

squid: Telemetry upgrade test fixes

12 months agodoc/cephfs: update cephfs-shell link 58370/head
Zac Dover [Mon, 1 Jul 2024 05:57:40 +0000 (15:57 +1000)]
doc/cephfs: update cephfs-shell link

Repair the link to cephfs-shell.rst in doc/cephfs/cephfs-shell.rst that
was broken in https://github.com/ceph/ceph/pull/41165/ when
doc/cephfs/cephfs-shell.rst was moved to doc/man/8/cephfs-shell.rst.

This commit is made in response to a request by Lander Duncan that was
made on the [ceph-users] mailing list, and can be seen here: https://lists.ceph.io/hyperkitty/list/ceph-users@ceph.io/thread/F7V4CWLIYCAJ4JXI2JLNY6QPCFPR4SLA/

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 4f8903cf80a94596a1b17b4a07affb874f21ae76)

12 months agoMerge pull request #58359 from zdover23/wip-doc-2024-06-30-backport-58358-to-squid
Anthony D'Atri [Sat, 29 Jun 2024 19:22:49 +0000 (15:22 -0400)]
Merge pull request #58359 from zdover23/wip-doc-2024-06-30-backport-58358-to-squid

squid: doc/cephfs: take Anthony's suggestion

12 months agodoc/cephfs: take Anthony's suggestion 58359/head
Zac Dover [Sat, 29 Jun 2024 12:11:55 +0000 (22:11 +1000)]
doc/cephfs: take Anthony's suggestion

Incorporate Anthony's suggestion in
https://github.com/ceph/ceph/pull/57567#discussion_r1607016050 into
doc/cephfs/fs-volumes.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 7a78dda0a92339db27359f91f0cb081703e2e7f9)

12 months agoMerge pull request #58264 from amathuria/wip-66690-squid
Yuri Weinstein [Fri, 28 Jun 2024 14:29:04 +0000 (07:29 -0700)]
Merge pull request #58264 from amathuria/wip-66690-squid

squid: mon, qa: suites override ec profiles with --yes_i_really_mean_it; monitors accept that

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
12 months agoMerge pull request #58262 from amathuria/wip-66688-squid
Yuri Weinstein [Fri, 28 Jun 2024 14:28:22 +0000 (07:28 -0700)]
Merge pull request #58262 from amathuria/wip-66688-squid

squid: qa/suites/rados/thrash/workloads: remove cache tiering workload

Reviewed-by: Neha Ojha <nojha@redhat.com>
12 months agoMerge pull request #57589 from NitzanMordhai/wip-66142-squid
Yuri Weinstein [Fri, 28 Jun 2024 14:20:01 +0000 (07:20 -0700)]
Merge pull request #57589 from NitzanMordhai/wip-66142-squid

squid: common/pick_address: check if address in subnet all public address

Reviewed-by: Laura Flores <lflores@redhat.com>
12 months agotests: make sure nvmetcli and nvme-cli are up to date 58341/head
Guillaume Abrioux [Wed, 26 Jun 2024 10:35:43 +0000 (10:35 +0000)]
tests: make sure nvmetcli and nvme-cli are up to date

Otherwise jobs end up with the following failure:

```
2024-06-25T14:22:18.659 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to write to /dev/nvme-fabrics: Invalid argument
```

Also, the output of nvme list has changed so we have to update
qa/tasks/nvme_loop.py accordingly.

Fixes: https://tracker.ceph.com/issues/66707
Signed-off-by: Guillaume Abrioux <gabrioux@ibm.com>
(cherry picked from commit d707c41eacb513bdcb9fec17c823bfbfdc182700)

12 months agoMerge pull request #58307 from zdover23/wip-doc-2024-06-27-backport-58287-to-squid
Anthony D'Atri [Thu, 27 Jun 2024 16:45:17 +0000 (12:45 -0400)]
Merge pull request #58307 from zdover23/wip-doc-2024-06-27-backport-58287-to-squid

squid: doc/rados: update how to install c++ header files

12 months agoMerge pull request #58304 from zdover23/wip-doc-2024-06-27-backport-58299-to-squid
Anthony D'Atri [Thu, 27 Jun 2024 16:44:57 +0000 (12:44 -0400)]
Merge pull request #58304 from zdover23/wip-doc-2024-06-27-backport-58299-to-squid

squid: doc/dev: Fix typos in encoding.rst

12 months agoMerge pull request #58090 from vshankar/wip-66519-squid
Venky Shankar [Thu, 27 Jun 2024 16:31:09 +0000 (22:01 +0530)]
Merge pull request #58090 from vshankar/wip-66519-squid

squid: qa: use centos9 for fs:upgrade

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
12 months agodoc/rados: update how to install c++ header files 58307/head
Pere Diaz Bou [Wed, 26 Jun 2024 13:57:47 +0000 (15:57 +0200)]
doc/rados: update how to install c++ header files

In this example librados2-devel only install C header files on fedora 40,
therefore I added libradospp-devel to the command to include C++ header files.

Signed-off-by: Pere Diaz Bou <pere-altea@hotmail.com>
(cherry picked from commit 7e87441601db2379488fab62e900cd834086f26d)

12 months agodoc/dev: Fix typos in encoding.rst 58304/head
N Balachandran [Thu, 27 Jun 2024 07:22:09 +0000 (12:52 +0530)]
doc/dev: Fix typos in encoding.rst

Signed-off-by: N Balachandran <nibalach@redhat.com>
(cherry picked from commit 9f43c67a639958a13fef198ffe62cf5241f1f53c)

12 months agoMerge pull request #58271 from zdover23/wip-doc-2024-06-26-backport-58226-to-squid
Anthony D'Atri [Wed, 26 Jun 2024 12:33:53 +0000 (08:33 -0400)]
Merge pull request #58271 from zdover23/wip-doc-2024-06-26-backport-58226-to-squid

squid: doc/rados: edit troubleshooting-osd.rst

12 months agodoc/rados: edit troubleshooting-osd.rst 58271/head
Zac Dover [Mon, 24 Jun 2024 10:32:30 +0000 (20:32 +1000)]
doc/rados: edit troubleshooting-osd.rst

Make minor changes to the "Debugging Slow Requests" section of
doc/rados/troubleshooting/troubleshooting-osd.rst in preparation
for an expansion of this section in response to a reqeust from Joel
Davidow.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 8b211b9c7f9b173bb12028eb7108d13867883d6e)

12 months agoMerge pull request #58257 from zdover23/wip-doc-2024-06-25-backport-58243-to-squid
Zac Dover [Wed, 26 Jun 2024 05:52:22 +0000 (15:52 +1000)]
Merge pull request #58257 from zdover23/wip-doc-2024-06-25-backport-58243-to-squid

squid: doc/rados: credit Prashant for a procedure

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
12 months agoosd/ECBackend.cc: Fix double increment of num_shards_repaired stat 58266/head
Bill Scales [Wed, 19 Jun 2024 08:36:06 +0000 (08:36 +0000)]
osd/ECBackend.cc: Fix double increment of num_shards_repaired stat

Commit https://github.com/ceph/ceph/commit/deffa8209f9c0bd300cfdb54d358402bfc6e41c6 refactored
ECBackend::handle_recovery_push for Crimson but accidentally duplicated the code that increments
the num_shards_repaired OSD statistic.

This caused one of the QA tests to fail because the stat reported twice as much repair work
had been completed than expected:

qa/standalone/scrub/osd-scrub-repair.sh: TEST_repair_stats_ec: test 26 = 13

Fixes: https://tracker.ceph.com/issues/64437
Signed-off-by: Bill Scales <bill_scales@uk.ibm.com>
(cherry picked from commit e618dc01a7a1bdfaa3e1a6fa2a9a9ac13eee11b8)

12 months agomon: settle erasure-code-profile --yes-i-really-mean-it in asok's schema 58264/head
Radoslaw Zarzynski [Fri, 14 Jun 2024 16:40:37 +0000 (16:40 +0000)]
mon: settle erasure-code-profile --yes-i-really-mean-it in asok's schema

Fixes: https://tracker.ceph.com/issues/65183
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
(cherry picked from commit 0e70f679d0f32fafd7db39229325cf7db7f6eb05)

12 months agoqa: tests override ec profiles with --yes-i-really-mean-it
Radosław Zarzyński [Wed, 27 Mar 2024 16:39:34 +0000 (17:39 +0100)]
qa: tests override ec profiles with --yes-i-really-mean-it

This fixes a fallout from 629ba7bd349d48cdaa6d094751e7cfce651ba2bc.
The problem has been nailed down by Laura Flores.

Fixes: https://tracker.ceph.com/issues/65183
Signed-off-by: Radosław Zarzyński <rzarzyns@redhat.com>
(cherry picked from commit 6f813236f8c617b3ff9517cf73ed256b5fede90e)

12 months agoqa/suites/rados/thrash/workloads: remove cache tiering workload 58262/head
Laura Flores [Wed, 19 Jun 2024 17:53:44 +0000 (12:53 -0500)]
qa/suites/rados/thrash/workloads: remove cache tiering workload

Fixes: https://tracker.ceph.com/issues/65852
Signed-off-by: Laura Flores <lflores@ibm.com>
(cherry picked from commit 35505a7f1fd8bcad2047426a4d641b4c016180af)

12 months agodoc/rados: credit Prashant for a procedure 58257/head
Zac Dover [Tue, 25 Jun 2024 04:49:13 +0000 (14:49 +1000)]
doc/rados: credit Prashant for a procedure

Credit Prashant D for creating the stretch-mode workaround procedure for
retrieving the correct size of datacenters.

Follows: https://github.com/ceph/ceph/pull/58109

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 2e777cb4f8bd682b807b97074f930826aa902db9)

12 months agomgr/dashboard: add dueTime to rgw bucket validator 58246/head
Nizamudeen A [Fri, 24 May 2024 15:16:17 +0000 (20:46 +0530)]
mgr/dashboard: add dueTime to rgw bucket validator

the unique async validator which checks if the typed bucket is existing
or not in the bucket creation form sends a request to the backend on
each keystroke. Each keystroke will raise an exception if the bucket is
not found.

Fixes: https://tracker.ceph.com/issues/66221
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit c053782cc5d7f3f4493094d37b164e0531f46caf)

12 months agoMerge pull request #57970 from adk3798/squid-replace-pkg_resources-with-importlib
Adam King [Mon, 24 Jun 2024 19:38:50 +0000 (15:38 -0400)]
Merge pull request #57970 from adk3798/squid-replace-pkg_resources-with-importlib

squid: cephadm: use importlib.metadata for querying ceph_iscsi's version

Reviewed-by: John Mulligan <jmulligan@redhat.com>
12 months agoMerge pull request #57400 from adk3798/squid-cephadm-timeout-ignore-refresh-failed
Adam King [Mon, 24 Jun 2024 19:37:35 +0000 (15:37 -0400)]
Merge pull request #57400 from adk3798/squid-cephadm-timeout-ignore-refresh-failed

squid: qa/cephadm: ignore CEPHADM_REFRESH_FAILED on timeout test

Reviewed-by: John Mulligan <jmulligan@redhat.com>
12 months agoMerge pull request #57768 from adk3798/wip-65722-squid
Adam King [Mon, 24 Jun 2024 19:30:56 +0000 (15:30 -0400)]
Merge pull request #57768 from adk3798/wip-65722-squid

squid: cephadm: have agent check for errors before json loading mgr response

Reviewed-by: John Mulligan <jmulligan@redhat.com>
12 months agoMerge pull request #57398 from adk3798/squid-cephadm-ignore-orch-paused
Adam King [Mon, 24 Jun 2024 19:29:28 +0000 (15:29 -0400)]
Merge pull request #57398 from adk3798/squid-cephadm-ignore-orch-paused

squid: qa/cephadm: ignore CEPHADM_PAUSED on test_orch_cli test

Reviewed-by: John Mulligan <jmulligan@redhat.com>
12 months agoMerge pull request #57187 from adk3798/squid-stray-laundry
Adam King [Mon, 24 Jun 2024 18:55:03 +0000 (14:55 -0400)]
Merge pull request #57187 from adk3798/squid-stray-laundry

squid: qa/cephadm: ignore stray daemon warning during rados_api_tests

Reviewed-by: John Mulligan <jmulligan@redhat.com>
12 months agoMerge pull request #57770 from adk3798/wip-65948-squid
Adam King [Mon, 24 Jun 2024 12:43:23 +0000 (08:43 -0400)]
Merge pull request #57770 from adk3798/wip-65948-squid

squid: mgr/pybind/object_format: fix json-pretty being marked invalid

Reviewed-by: John Mulligan <jmulligan@redhat.com>
12 months agoMerge pull request #57516 from adk3798/wip-65958-squid
Adam King [Mon, 24 Jun 2024 12:41:52 +0000 (08:41 -0400)]
Merge pull request #57516 from adk3798/wip-65958-squid

squid: mgr/cephadm:  update default NVMEoF container image version

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
12 months agoceph-volume: create LVs when using partitions 58219/head
Guillaume Abrioux [Mon, 15 Apr 2024 08:28:24 +0000 (08:28 +0000)]
ceph-volume: create LVs when using partitions

commit [1] introduced a behavior change.
`ceph-volume lvm prepare` used to create VGs/LVs when it was passed partitions
for db and/or wal devices. Since commit [1] has been introduced, it made ceph-volume
consume the partition directly, it doesn't create LV anymore. Although this
doesn't prevent from creating OSDs, this is a behavior change.

Fixes: https://tracker.ceph.com/issues/65477
[1] 1e7223281fa044c9653633e305c0b344e4c9b3a4

Signed-off-by: Guillaume Abrioux <gabrioux@ibm.com>
(cherry picked from commit 11f0173f1299ed6d137159dcf62c4a7a9fd20f82)

12 months agoMerge pull request #58202 from zdover23/wip-doc-2024-06-23-backport-58200-to-squid
Zac Dover [Mon, 24 Jun 2024 00:31:52 +0000 (10:31 +1000)]
Merge pull request #58202 from zdover23/wip-doc-2024-06-23-backport-58200-to-squid

squid: doc/start: add links to Beginner's Guide

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
12 months agodoc/start: add links to Beginner's Guide 58202/head
Zac Dover [Sat, 22 Jun 2024 06:28:12 +0000 (16:28 +1000)]
doc/start: add links to Beginner's Guide

Add two links to Sage Weil's overview talks about Ceph.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 785020f212504cdbf374e0d3ca843fd92309de98)

12 months agoMerge pull request #57936 from zdover23/wip-doc-2024-06-08-backport-57923-to-squid
Zac Dover [Sat, 22 Jun 2024 06:23:55 +0000 (16:23 +1000)]
Merge pull request #57936 from zdover23/wip-doc-2024-06-08-backport-57923-to-squid

squid: doc/src: add inline literals (``) to variables

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
12 months agoMerge pull request #58181 from zdover23/wip-doc-2024-06-21-backport-58109-to-squid
Zac Dover [Sat, 22 Jun 2024 06:22:14 +0000 (16:22 +1000)]
Merge pull request #58181 from zdover23/wip-doc-2024-06-21-backport-58109-to-squid

squid: doc/rados: add stretch_rule workaround

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
12 months agoMerge pull request #58161 from zdover23/wip-doc-2024-06-20-backport-57156-to-squid
Zac Dover [Sat, 22 Jun 2024 06:20:19 +0000 (16:20 +1000)]
Merge pull request #58161 from zdover23/wip-doc-2024-06-20-backport-57156-to-squid

squid: doc/rados: followup to PR#58057

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
12 months agoMerge pull request #58189 from zdover23/wip-doc-2024-06-21-backport-55675-to-squid
Zac Dover [Sat, 22 Jun 2024 06:13:22 +0000 (16:13 +1000)]
Merge pull request #58189 from zdover23/wip-doc-2024-06-21-backport-55675-to-squid

squid: doc/src: invadvisable is not a word

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
12 months agoqa/suites/upgrade/telemetry-upgrade/quincy-x: update image reference 58198/head
Laura Flores [Wed, 19 Jun 2024 23:01:31 +0000 (18:01 -0500)]
qa/suites/upgrade/telemetry-upgrade/quincy-x: update image reference

`quay.io/ceph/daemon-base:latest-quincy` points to the latest quincy tag (v17.2.7),
not the tip of quincy, which is actually what we want to test.

Pulling the daemon-base:latest-quincy image shows it is running v17.2.7:
```
lflores:ceph$ podman run --rm -it daemon-base:latest-quincy
[root@e4eb265e7fa0 /]# ceph -v
ceph version 17.2.7 (b12291d110049b2f35e32e0de30d70e9a4c060d2) quincy (stable)
```

It is important that we test the tip of quincy in case there is a fix there that
we want to pick up.

I referenced this commit to make the change: https://github.com/ceph/ceph/commit/d0381ed7e68a6de7c9ff1e4220698ed8eab28ac6

Signed-off-by: Laura Flores <lflores@ibm.com>
(cherry picked from commit 914149df5f3d7189ea6bf96bbfaf7d948ca4ed01)

12 months agoqa/suites/upgrade/telemetry-upgrade/reef-x: update how cephadm is pulled and change...
Laura Flores [Wed, 19 Jun 2024 21:57:45 +0000 (16:57 -0500)]
qa/suites/upgrade/telemetry-upgrade/reef-x: update how cephadm is pulled and change image reference

Update how cephadm is pulled:

`cephadm_git_url` and `cephadm_branch` are used in releases older than reef
to install cephadm. Both of these keys are needed to install it from the github
repo.

However, in reef and on, the compiled zipapp cephadm needs to be pulled differently
than the old single python script `cephadm` from earlier releases.

This commit is what I referenced for this change: https://github.com/ceph/ceph/commit/967716f2e6c8cd3f7d810a5f8e5e49448717e513

-------

Change image reference:

`quay.io/ceph/daemon-base:latest-reef` points to the latest reef tag (v18.2.2),
not the tip of reef, which is actually what we want to test.

Pulling the daemon-base:latest-reef image shows it is running v18.2.2:
```
lflores:ceph$ podman run --rm -it daemon-base:latest-reef
[root@d4d9a0eb04be /]# ceph -v
ceph version 18.2.2 (531c0d11a1c5d39fbfe6aa8a521f023abf3bf3e2) reef (stable)
```

It is important that we test the tip of reef in case there is a fix there that we
want to pick up.

I referenced this commit to make the change: https://github.com/ceph/ceph/commit/d0381ed7e68a6de7c9ff1e4220698ed8eab28ac6

Signed-off-by: Laura Flores <lflores@ibm.com>
(cherry picked from commit fcb22a022038ce64dcc6e95f9be56cf75a3be4b0)

12 months agoqa/suites/upgrade/telemetry-upgrade: add more ignorelist items and require_osd_releas...
Laura Flores [Wed, 19 Jun 2024 21:07:31 +0000 (16:07 -0500)]
qa/suites/upgrade/telemetry-upgrade: add more ignorelist items and require_osd_release=squid

The warnings added to the ignorelist show up in the cluster log, but they are
expected during upgrades and should thus be ignored.

We also need to set require_osd_release=squid to avoid this warning:
```
cluster [WRN] Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED)
```

Signed-off-by: Laura Flores <lflores@ibm.com>
(cherry picked from commit dc65e55d6e88d1dc24b92837f5ae0f4f9aa5169f)

12 months agoqa/workunits: Opt in to new telemetry collections right away after upgrading
Laura Flores [Tue, 11 Jun 2024 20:19:06 +0000 (15:19 -0500)]
qa/workunits: Opt in to new telemetry collections right away after upgrading

If this does not happen, the test may fail due to the "TELEMETRY_CHANGED" warning
appearing for too long in the cluster log.

Fixes: https://tracker.ceph.com/issues/64458
Signed-off-by: Laura Flores <lflores@ibm.com>
(cherry picked from commit 769d9ccffbd0edb30d65f3e8e0aeb7f2070145ef)

12 months agoqa/suites/upgrade/telemetry-upgrade: upgrade from reef instead of pacific
Laura Flores [Tue, 11 Jun 2024 20:10:01 +0000 (15:10 -0500)]
qa/suites/upgrade/telemetry-upgrade: upgrade from reef instead of pacific

With cephadm upgrades, we are only allowed to upgrade from as far back as N-2
releases. On the main branch, that means we can only upgrade from quincy and reef, and
we can no longer upgrade from pacific.

This test was trying to upgrade from pacific, which isn't allowed, which led to an
`UPGRADE_BAD_TARGET_VERSION` cluster error.

Fixes: https://tracker.ceph.com/issues/65189
Signed-off-by: Laura Flores <lflores@ibm.com>
(cherry picked from commit 0b39555f9fcbb093ca03c7bad15acb4e368b99f0)

12 months agoMerge pull request #58187 from zdover23/wip-doc-2024-06-21-backport-58112-to-squid
Ilya Dryomov [Fri, 21 Jun 2024 21:11:24 +0000 (23:11 +0200)]
Merge pull request #58187 from zdover23/wip-doc-2024-06-21-backport-58112-to-squid

squid: doc/rbd: fix typos in NVMe-oF docs.

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
12 months agoMerge pull request #58171 from idryomov/wip-qemu-task-version-squid
Ilya Dryomov [Fri, 21 Jun 2024 16:00:27 +0000 (18:00 +0200)]
Merge pull request #58171 from idryomov/wip-qemu-task-version-squid

squid: qa/tasks/qemu: Fix OS version comparison

Reviewed-by: Ramana Raja <rraja@redhat.com>
12 months agodoc/src: invadvisable is not a word 58189/head
Doug Whitfield [Tue, 20 Feb 2024 21:13:14 +0000 (15:13 -0600)]
doc/src: invadvisable is not a word

changed to inadvisable on line 4997

Signed-off-by: Doug Whitfield <douglasawh@gmail.com>
(cherry picked from commit fb4a5d09e11b75a2f38c42c489af7e6f148916a7)

12 months agodoc/rbd: fix typos in NVMe-oF docs. 58187/head
N Balachandran [Tue, 18 Jun 2024 10:39:51 +0000 (16:09 +0530)]
doc/rbd: fix typos in NVMe-oF docs.

Signed-off-by: N Balachandran <nibalach@redhat.com>
(cherry picked from commit 0cd415c53b49b2e9168df488340dab91d4c6badc)

12 months agodoc/rados: add stretch_rule workaround 58181/head
Zac Dover [Tue, 18 Jun 2024 05:22:41 +0000 (15:22 +1000)]
doc/rados: add stretch_rule workaround

Add a method for defining a CRUSH rule that returns the actual value of
the total available size.

Fixes: https://tracker.ceph.com/issues/56650
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 007385a3ef05bd92e006fc7d6aba3fbb51792ef7)

12 months agoMerge pull request #57990 from idryomov/wip-66359-squid
Ilya Dryomov [Thu, 20 Jun 2024 17:21:09 +0000 (19:21 +0200)]
Merge pull request #57990 from idryomov/wip-66359-squid

squid: pybind/rbd: parse access and modify timestamps in UTC

Reviewed-by: Ramana Raja <rraja@redhat.com>
12 months agoMerge pull request #58098 from adk3798/wip-66452-squid
Adam King [Thu, 20 Jun 2024 16:45:18 +0000 (12:45 -0400)]
Merge pull request #58098 from adk3798/wip-66452-squid

squid: cephadm: _extract_host_info_from_*() refactor

Reviewed-by: John Mulligan <jmulligan@redhat.com
12 months agoMerge pull request #58096 from adk3798/wip-66429-squid
Adam King [Thu, 20 Jun 2024 16:44:22 +0000 (12:44 -0400)]
Merge pull request #58096 from adk3798/wip-66429-squid

squid: mgr/cephadm: make SMB and NVMEoF upgrade last in staggered upgrade

Reviewed-by: John Mulligan <jmulligan@redhat.com>
12 months agoMerge pull request #58095 from adk3798/wip-66427-squid
Adam King [Thu, 20 Jun 2024 16:43:08 +0000 (12:43 -0400)]
Merge pull request #58095 from adk3798/wip-66427-squid

squid: cephadm: CephExporter doesn't bind to IPv6 in dual stack

Reviewed-by: John Mulligan <jmulligan@redhat.com>
12 months agoMerge pull request #57972 from adk3798/squid-keepalive-security-context
Adam King [Thu, 20 Jun 2024 16:42:29 +0000 (12:42 -0400)]
Merge pull request #57972 from adk3798/squid-keepalive-security-context

squid: cephadm/services/ingress: configure security user in keepalived template

Reviewed-by: John Mulligan <jmulligan@redhat.com>
12 months agoMerge pull request #57773 from adk3798/wip-65968-squid
Adam King [Thu, 20 Jun 2024 16:33:02 +0000 (12:33 -0400)]
Merge pull request #57773 from adk3798/wip-65968-squid

squid: mgr/cephadm: make setting --cgroups=split configurable for adopted daemons

Reviewed-by: John Mulligan <jmulligan@redhat.com>
12 months agoMerge pull request #57772 from adk3798/wip-65955-squid
Adam King [Thu, 20 Jun 2024 16:31:35 +0000 (12:31 -0400)]
Merge pull request #57772 from adk3798/wip-65955-squid

squid: mgr/cephadm: Fix unfound progress events

Reviewed-by: John Mulligan <jmulligan@redhat.com>
12 months agoMerge pull request #57771 from adk3798/wip-65953-squid
Adam King [Thu, 20 Jun 2024 16:18:05 +0000 (12:18 -0400)]
Merge pull request #57771 from adk3798/wip-65953-squid

squid: qa/tasks/cephadm: fix pulling containers from private registries

Reviewed-by: John Mulligan <jmulligan@redhat.com>
12 months agoMerge pull request #57769 from adk3798/wip-65724-squid
Adam King [Thu, 20 Jun 2024 16:16:53 +0000 (12:16 -0400)]
Merge pull request #57769 from adk3798/wip-65724-squid

squid: python-common: handle "anonymous_access: false" in to_json of Grafana spec

Reviewed-by: John Mulligan <jmulligan@redhat.com>
12 months agoMerge pull request #57517 from adk3798/wip-65951-squid
Adam King [Thu, 20 Jun 2024 16:15:28 +0000 (12:15 -0400)]
Merge pull request #57517 from adk3798/wip-65951-squid

squid: mgr/cephadm: cleanup iscsi and nvmeof keyrings upon daemon removal

Reviewed-by: John Mulligan <jmulligan@redhat.com>
12 months agoMerge pull request #57411 from adk3798/squid-cephadm-ignore-stray-on-upgrade
Adam King [Thu, 20 Jun 2024 16:13:58 +0000 (12:13 -0400)]
Merge pull request #57411 from adk3798/squid-cephadm-ignore-stray-on-upgrade

squid: qa/cephadm: ignore CEPHADM_STRAY_DAEMON in upgrade tests

Reviewed-by: John Mulligan <jmulligan@redhat.com>
12 months agoMerge pull request #57397 from adk3798/squid-no-stray-recent-removal
Adam King [Thu, 20 Jun 2024 16:11:54 +0000 (12:11 -0400)]
Merge pull request #57397 from adk3798/squid-no-stray-recent-removal

squid: mgr/cephadm: don't mark daemons created/removed in the last minute as stray

Reviewed-by: John Mulligan <jmulligan@redhat.com>
12 months agoMerge pull request #57396 from adk3798/squid-autotune-testing
Adam King [Thu, 20 Jun 2024 16:11:10 +0000 (12:11 -0400)]
Merge pull request #57396 from adk3798/squid-autotune-testing

squid: mgr/cephadm: additional debug logging for autotuner

Reviewed-by: John Mulligan <jmulligan@redhat.com>
12 months agoMerge pull request #57233 from adk3798/wip-65762-squid
Adam King [Thu, 20 Jun 2024 16:10:19 +0000 (12:10 -0400)]
Merge pull request #57233 from adk3798/wip-65762-squid

squid: mgr/cephadm: set OSD cap for NVMEoF daemon to "profile rbd"

Reviewed-by: John Mulligan <jmulligan@redhat.com>
12 months agoMerge pull request #57186 from adk3798/squid-service-size-cleanup
Adam King [Thu, 20 Jun 2024 16:08:30 +0000 (12:08 -0400)]
Merge pull request #57186 from adk3798/squid-service-size-cleanup

squid: mgr/cephadm: cleanup service size logic block

Reviewed-by: John Mulligan <jmulligan@redhat.com>
12 months agoMerge pull request #57185 from adk3798/squid-cephadm-apply-spec-file
Adam King [Thu, 20 Jun 2024 16:07:59 +0000 (12:07 -0400)]
Merge pull request #57185 from adk3798/squid-cephadm-apply-spec-file

squid: cephadm: check if file exists when passing `--apply_spec`

Reviewed-by: Guillaume Abrioux <gabrioux@ibm.com>
12 months agoMerge pull request #57184 from adk3798/squid-bootstrap-custom-alerts
Adam King [Thu, 20 Jun 2024 16:07:14 +0000 (12:07 -0400)]
Merge pull request #57184 from adk3798/squid-bootstrap-custom-alerts

squid: cephadm: allow passing custom prometheus alerts to bootstrap

Reviewed-by: John Mulligan <jmulligan@redhat.com>
12 months agoqa/tasks/qemu: Fix OS version comparison 58171/head
Zack Cerza [Fri, 14 Jun 2024 19:37:16 +0000 (13:37 -0600)]
qa/tasks/qemu: Fix OS version comparison

See: https://sentry.ceph.com/share/issue/21ed88d705854238bdafbf6711e795ee/
They're strings, not floats.
This surfaced as a result of https://github.com/ceph/teuthology/pull/1953

Signed-off-by: Zack Cerza <zack@redhat.com>
(cherry picked from commit 260a45a03148ba4d2bbfcac9485bcf9a8743cade)

12 months agoMerge pull request #58130 from zdover23/wip-doc-2024-06-19-backport-58123-to-squid
Zac Dover [Thu, 20 Jun 2024 13:48:42 +0000 (23:48 +1000)]
Merge pull request #58130 from zdover23/wip-doc-2024-06-19-backport-58123-to-squid

squid: doc: clarify availability vs integrity

Reviewed-by: Cole Mitchell <cole.mitchell.ceph@gmail.com>
12 months agodoc/rados: followup to PR#58057 58161/head
Zac Dover [Thu, 20 Jun 2024 11:43:53 +0000 (21:43 +1000)]
doc/rados: followup to PR#58057

Incorporate Anthony D'Atri's suggestions in
https://github.com/ceph/ceph/pull/58057

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 2e999a26ef2d3c12d81bd54c187a6225a5fcd7a6)

12 months agopybind/rbd: parse access and modify timestamps in UTC 57990/head
Ilya Dryomov [Wed, 5 Jun 2024 06:36:12 +0000 (08:36 +0200)]
pybind/rbd: parse access and modify timestamps in UTC

It appears that commits 08cee16d0a4b ("pybind/rbd: always parse
timestamps in UTC") and 809c5430c292 ("librbd: add image access/last
modified timestamps") raced with each other and we ended up with two
more timezone-dependent timestamps.

Fixes: https://tracker.ceph.com/issues/66359
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit fafa911b51199f61d0c97bc6dfc71d4f65134db4)

12 months agotest/pybind/rbd: make timestamp tests meaningful
Ilya Dryomov [Tue, 4 Jun 2024 19:37:49 +0000 (21:37 +0200)]
test/pybind/rbd: make timestamp tests meaningful

The existing asserts don't really test anything, with some of them
being for inequality against a literal of a mismatching type.  As
a result, a bug in access_timestamp() and modify_timestamp() went
unnoticed for years.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit a1b6ca863a384fe32e750b9ee8f10688f88dd1e3)

12 months agotest/pybind/rbd: fix tests that compare strings with b''
Ilya Dryomov [Tue, 4 Jun 2024 19:19:40 +0000 (21:19 +0200)]
test/pybind/rbd: fix tests that compare strings with b''

assert_not_equal(b'', self.image.id()) is bogus because Image::id()
returns a string (str), not bytes.  If the types don't match, values
are guaranteed to not match.

The same goes for Image::block_name_prefix().

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 05f7e4f2025c435dca8ae0b34f65425afbc212b5)

12 months agoMerge pull request #57571 from idryomov/wip-65813-squid
Ilya Dryomov [Thu, 20 Jun 2024 10:49:27 +0000 (12:49 +0200)]
Merge pull request #57571 from idryomov/wip-65813-squid

squid: librbd: don't crash on a zero-length read if buffer is NULL

12 months agoMerge pull request #57602 from ajarr/wip-66117-squid
Ilya Dryomov [Thu, 20 Jun 2024 10:48:34 +0000 (12:48 +0200)]
Merge pull request #57602 from ajarr/wip-66117-squid

squid: librbd: create rbd_trash object during pool initialization and namespace creation

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
12 months agoMerge pull request #57766 from idryomov/wip-66232-squid
Ilya Dryomov [Thu, 20 Jun 2024 10:47:10 +0000 (12:47 +0200)]
Merge pull request #57766 from idryomov/wip-66232-squid

squid: qa/suites/rbd: override extra_system_packages directly on install task

Reviewed-by: Ramana Raja <rraja@redhat.com>