]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
12 months agodoc: clarify superuser note for ceph-fuse
Patrick Donnelly [Mon, 15 Jul 2024 14:12:24 +0000 (10:12 -0400)]
doc: clarify superuser note for ceph-fuse

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit d100de9c9ce884beee6e9551b2b221c686b775b5)

12 months agoMerge pull request #57610 from vshankar/wip-65988-squid
Xiubo Li [Tue, 16 Jul 2024 01:29:49 +0000 (09:29 +0800)]
Merge pull request #57610 from vshankar/wip-65988-squid

squid: qa: ignore cluster warnings generated from forward-scrub task

12 months agoMerge pull request #57918 from batrick/wip-66386-squid
Xiubo Li [Tue, 16 Jul 2024 01:28:07 +0000 (09:28 +0800)]
Merge pull request #57918 from batrick/wip-66386-squid

squid: qa: disable mon_warn_on_pool_no_app in fs suite

12 months agoMerge pull request #57922 from batrick/wip-66385-squid
Xiubo Li [Tue, 16 Jul 2024 01:27:42 +0000 (09:27 +0800)]
Merge pull request #57922 from batrick/wip-66385-squid

squid: qa: correct json lookup for new `lock path` output

12 months agoMerge pull request #58155 from vshankar/wip-66325-squid
Xiubo Li [Tue, 16 Jul 2024 01:26:54 +0000 (09:26 +0800)]
Merge pull request #58155 from vshankar/wip-66325-squid

squid: qa: enable debug logs for fs:cephadm:multivolume subsuite

12 months agoMerge pull request #58233 from batrick/wip-66593-squid
Xiubo Li [Tue, 16 Jul 2024 01:26:21 +0000 (09:26 +0800)]
Merge pull request #58233 from batrick/wip-66593-squid

squid: tools/cephfs: recover alternate_name of dentries from journal

12 months agoMerge pull request #58237 from batrick/wip-66619-squid
Xiubo Li [Tue, 16 Jul 2024 01:25:43 +0000 (09:25 +0800)]
Merge pull request #58237 from batrick/wip-66619-squid

squid: mds: initialize epoch for quiescedb

12 months agoMerge pull request #58252 from joscollin/wip-66674-squid
Xiubo Li [Tue, 16 Jul 2024 01:23:59 +0000 (09:23 +0800)]
Merge pull request #58252 from joscollin/wip-66674-squid

squid: qa: enhance per-client labelled perf counters test

12 months agoMerge pull request #58294 from batrick/wip-66623-squid
Xiubo Li [Tue, 16 Jul 2024 01:23:30 +0000 (09:23 +0800)]
Merge pull request #58294 from batrick/wip-66623-squid

squid: mds: do remove the cap when seqs equal or larger than last issue

12 months agoMerge pull request #58317 from batrick/wip-66585-squid
Xiubo Li [Tue, 16 Jul 2024 01:22:01 +0000 (09:22 +0800)]
Merge pull request #58317 from batrick/wip-66585-squid

squid: mds: QuiesceDbManager: mark next retry event during bootstrap

12 months agoMerge pull request #58318 from batrick/wip-66572-squid
Xiubo Li [Tue, 16 Jul 2024 01:21:42 +0000 (09:21 +0800)]
Merge pull request #58318 from batrick/wip-66572-squid

squid: mds/quiesce-db: calculate_quiesce_map: aggregate quiesce roots' TTL as `max`

12 months agoMerge pull request #58319 from batrick/wip-66542-squid
Xiubo Li [Tue, 16 Jul 2024 01:19:37 +0000 (09:19 +0800)]
Merge pull request #58319 from batrick/wip-66542-squid

squid: mds: dump formatter even for errors

12 months agoMerge pull request #58541 from idryomov/wip-66886-squid 57399/head
Yuri Weinstein [Mon, 15 Jul 2024 14:09:42 +0000 (07:09 -0700)]
Merge pull request #58541 from idryomov/wip-66886-squid

squid: qa: account for rbd_trash object in krbd_data_pool.sh + related ceph{,adm} task fixes

Reviewed-by: Ramana Raja <rraja@redhat.com>
12 months agoMerge pull request #58212 from idryomov/wip-66418-squid
Yuri Weinstein [Mon, 15 Jul 2024 14:08:52 +0000 (07:08 -0700)]
Merge pull request #58212 from idryomov/wip-66418-squid

squid: librbd: diff-iterate shouldn't crash on an empty byte range

Reviewed-by: Mykola Golub <mgolub@suse.com>
12 months agoMerge pull request #58206 from idryomov/wip-66300-squid
Yuri Weinstein [Mon, 15 Jul 2024 14:07:51 +0000 (07:07 -0700)]
Merge pull request #58206 from idryomov/wip-66300-squid

squid: librbd: disallow group snap rollback if memberships don't match

Reviewed-by: Ramana Raja <rraja@redhat.com>
12 months agoMerge pull request #58575 from zdover23/wip-doc-2024-07-14-backport-58451-to-squid
Zac Dover [Mon, 15 Jul 2024 13:21:05 +0000 (23:21 +1000)]
Merge pull request #58575 from zdover23/wip-doc-2024-07-14-backport-58451-to-squid

squid: doc/dev: edit "Principles for format change"

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
12 months agoMerge pull request #58385 from smanjara/wip-squid-pr-56874
Casey Bodley [Mon, 15 Jul 2024 13:14:10 +0000 (14:14 +0100)]
Merge pull request #58385 from smanjara/wip-squid-pr-56874

[squid] qa/multisite: stabilize multisite testing

Reviewed-by: Casey Bodley <cbodley@redhat.com>
12 months agoMerge pull request #58578 from zdover23/wip-doc-2024-07-15-backport-58574-to-squid
Anthony D'Atri [Sun, 14 Jul 2024 17:22:24 +0000 (13:22 -0400)]
Merge pull request #58578 from zdover23/wip-doc-2024-07-15-backport-58574-to-squid

squid: doc/cephfs: edit "is mount helper present"

12 months agoMerge pull request #58001 from amathuria/wip-66421-squid
Yuri Weinstein [Sun, 14 Jul 2024 14:25:07 +0000 (07:25 -0700)]
Merge pull request #58001 from amathuria/wip-66421-squid

squid: osd/scrub: Change scrub cost to average object size

Reviewed-by: Sridhar Seshasayee <sseshasa@redhat.com>
12 months agoMerge pull request #57618 from sajibreadd/wip-66143-squid
Yuri Weinstein [Sun, 14 Jul 2024 14:23:25 +0000 (07:23 -0700)]
Merge pull request #57618 from sajibreadd/wip-66143-squid

squid: osd: CEPH_OSD_OP_FLAG_BYPASS_CLEAN_CACHE flag is passed from ECBackend

Reviewed-by: Samuel Just <sjust@redhat.com>
12 months agoMerge pull request #57195 from k0ste/wip-64591-squid
Yuri Weinstein [Sun, 14 Jul 2024 14:21:54 +0000 (07:21 -0700)]
Merge pull request #57195 from k0ste/wip-64591-squid

squid: os/bluestore: fix the problem of l_bluefs_log_compactions double recording

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
12 months agodoc/cephfs: edit "is mount helper present" 58578/head
Zac Dover [Sun, 14 Jul 2024 06:40:14 +0000 (16:40 +1000)]
doc/cephfs: edit "is mount helper present"

Edit the section called "Is mount helper present?", the title of which
prior to this commit was "Is mount helper is present?". Other small
disambiguating improvements have been made to the text in the section.
An unselectable prompt has been added before a command.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 0ebfb3eda8e2fc88662530bbddc84f2efcc4e13c)

12 months agodoc/dev: edit "Principles for format change" 58575/head
Zac Dover [Sun, 7 Jul 2024 03:59:15 +0000 (13:59 +1000)]
doc/dev: edit "Principles for format change"

Improve "Principles for format change" in doc/dev/encoding.rst. This
commit started as a response to Anthony D'Atri's suggestion here: https://github.com/ceph/ceph/pull/58299/files#r1656985564

Review of this section suggested to me that certain minor English usage
improvements would be of benefit. The numbered lists in this section
could still be made a bit clearer.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 570797e5588b67b8c72e5297b61f84d9aa48dc45)

12 months agoMerge pull request #58071 from yuvalif/wip-66497-squid
Casey Bodley [Sat, 13 Jul 2024 16:15:04 +0000 (17:15 +0100)]
Merge pull request #58071 from yuvalif/wip-66497-squid

squid: rgw/admin/notification: add command to dump notifications

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
12 months agoMerge pull request #58538 from cbodley/wip-66913-squid
Casey Bodley [Sat, 13 Jul 2024 16:14:24 +0000 (17:14 +0100)]
Merge pull request #58538 from cbodley/wip-66913-squid

squid: rgw/datalog: fix LazyFIFO race fix

Reviewed-by: Adam Emerson <aemerson@redhat.com>
12 months agoMerge pull request #58545 from smanjara/wip-66919-squid
Casey Bodley [Sat, 13 Jul 2024 16:13:49 +0000 (17:13 +0100)]
Merge pull request #58545 from smanjara/wip-66919-squid

squid: rgw/multisite: allow PutACL replication.

Reviewed-by: Casey Bodley <cbodley@redhat.com>
12 months agoMerge pull request #58550 from idryomov/wip-test-cookie-squid
Ilya Dryomov [Fri, 12 Jul 2024 16:16:44 +0000 (18:16 +0200)]
Merge pull request #58550 from idryomov/wip-test-cookie-squid

squid: test/librbd: clean up unused TEST_COOKIE variable

Reviewed-by: Ramana Raja <rraja@redhat.com>
12 months agoMerge pull request #58477 from afreen23/wip-backport-nvmeof-service
Pedro Gonzalez Gomez [Fri, 12 Jul 2024 14:17:19 +0000 (16:17 +0200)]
Merge pull request #58477 from afreen23/wip-backport-nvmeof-service

Batch backport of nvmeof service configuration

Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
12 months agoMerge pull request #58521 from cbodley/wip-66897-squid
Casey Bodley [Fri, 12 Jul 2024 12:52:41 +0000 (13:52 +0100)]
Merge pull request #58521 from cbodley/wip-66897-squid

squid: install-deps.sh, do_cmake.sh: almalinux is another el flavour

Reviewed-by: Kyr Shatskyy <kyrylo.shatskyy@gmail.com>
Reviewed-by: Dan van der Ster <dan.vanderster@clyso.com>
12 months agotest/ librbd: clean up unused 'TEST_COOKIE' 58550/head
Rongqi Sun [Tue, 9 Jul 2024 02:55:27 +0000 (02:55 +0000)]
test/ librbd: clean up unused 'TEST_COOKIE'

Clean them up because
```
/home/jenkins-build/build/workspace/ceph-pull-requests-arm64/src/test/librbd/exclusive_lock/test_mock_PreAcquireRequest.cc:47:26: error: unused variable 'TEST_COOKIE' [-Werror,-Wunused-const-variable]
static const std::string TEST_COOKIE("auto 123");
                         ^
1 error generated.
```

Ref: https://jenkins.ceph.com/job/ceph-pull-requests-arm64/59242/consoleFull#-5120798632a811ea2-3e7b-466b-84b4-d13df7e35809

Signed-off-by: Rongqi Sun <sunrongqi@huawei.com>
(cherry picked from commit 49869222c816023f696ff2a42898e2d9f3f54215)

12 months agoqa/multisite: add object set acl test 58545/head
Shilpa Jagannath [Wed, 27 Mar 2024 06:14:44 +0000 (02:14 -0400)]
qa/multisite: add object set acl test

Signed-off-by: Shilpa Jagannath <smanjara@redhat.com>
(cherry picked from commit d18b722557af8fc082d578547fa7be07a8ffc49e)

12 months agorgw/multisite: allow modified object acls to be replicated
Shilpa Jagannath [Tue, 19 Mar 2024 14:59:35 +0000 (10:59 -0400)]
rgw/multisite: allow modified object acls to be replicated

Signed-off-by: Shilpa Jagannath <smanjara@redhat.com>
(cherry picked from commit f5f6194c07b40c50913e956e06aaa3709d4d53aa)

12 months agoMerge pull request #58479 from afreen23/wip-backport-nfs
Pedro Gonzalez Gomez [Thu, 11 Jul 2024 15:27:53 +0000 (17:27 +0200)]
Merge pull request #58479 from afreen23/wip-backport-nfs

Batch backport NFS route separation for cephfs and rgw

Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
12 months agoqa/tasks/cephadm: drop --cluster and sudo in create_rbd_pool() 58541/head
Ilya Dryomov [Wed, 10 Jul 2024 09:53:05 +0000 (11:53 +0200)]
qa/tasks/cephadm: drop --cluster and sudo in create_rbd_pool()

The cluster (name) is already specified in the arguments passed to
_shell() and this command doesn't need privileges.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 26cee25873d5c91c704326fd0b708c53b353dd11)

12 months agoqa/tasks/cephadm: don't wait for OSDs in create_rbd_pool()
Ilya Dryomov [Wed, 10 Jul 2024 09:02:47 +0000 (11:02 +0200)]
qa/tasks/cephadm: don't wait for OSDs in create_rbd_pool()

This fails because teuthology.wait_until_osds_up() wants to use
adjust-ulimits wrapper which isn't available in "cephadm shell"
environment.  The whole thing is also redundant because cephadm task
is supposed to wait for OSDs to come up earlier, in ceph_osds().

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 0bda782952a81820752acdbf0b3ab9dbed56fb64)

12 months agoqa/tasks: initialize rbd pool instead of just tagging it
Ilya Dryomov [Wed, 10 Jul 2024 07:10:02 +0000 (09:10 +0200)]
qa/tasks: initialize rbd pool instead of just tagging it

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit fcc440da9aaa6585872e830a5e39aefce1df82fe)

12 months agoqa: krbd_data_pool.sh: account for rbd_trash object
Ilya Dryomov [Wed, 10 Jul 2024 07:10:02 +0000 (09:10 +0200)]
qa: krbd_data_pool.sh: account for rbd_trash object

... created since commit 0bcb5cfce9a2 ("librbd/image: create rbd_trash
object during RBD pool initialization").

Fixes: https://tracker.ceph.com/issues/66886
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit f8e5aecfc75bf7d32523e7a8d2d6034b434d216a)

12 months agorgw/datalog: fix LazyFIFO race fix 58538/head
Casey Bodley [Tue, 9 Jul 2024 21:40:03 +0000 (17:40 -0400)]
rgw/datalog: fix LazyFIFO race fix

initialize `fifo_tmp` to prevent the race on member variable `fifo` that
was identified in 8fa844383f9c22e758f39ecdda74f70de054ad68

Fixes: https://tracker.ceph.com/issues/66880
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 5dfbaac15f0ffb3dfe84ae304643d1cf4eee892d)

12 months agoMerge pull request #58255 from rhcs-dashboard/wip-66254-squid
Pedro Gonzalez Gomez [Thu, 11 Jul 2024 09:06:51 +0000 (11:06 +0200)]
Merge pull request #58255 from rhcs-dashboard/wip-66254-squid

squid: mgr/dashboard: rgw bucket replication management

Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
12 months agoMerge pull request #58244 from rhcs-dashboard/wip-66425-squid
Pedro Gonzalez Gomez [Thu, 11 Jul 2024 07:49:34 +0000 (09:49 +0200)]
Merge pull request #58244 from rhcs-dashboard/wip-66425-squid

squid: mgr/dashboard: fix edit bucket failing in other selected gateways

Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
Reviewed-by: nmunet <NOT@FOUND>
12 months agoMerge pull request #58337 from rhcs-dashboard/wip-66737-squid
Nizamudeen A [Thu, 11 Jul 2024 07:08:31 +0000 (12:38 +0530)]
Merge pull request #58337 from rhcs-dashboard/wip-66737-squid

squid: mgr/dashboard: fix clone async validators with different groups

Reviewed-by: nmunet <NOT@FOUND>
12 months agoMerge pull request #58436 from cbodley/wip-66839-squid
Casey Bodley [Wed, 10 Jul 2024 23:18:35 +0000 (00:18 +0100)]
Merge pull request #58436 from cbodley/wip-66839-squid

squid: doc/rgw: update s3 authentication

Reviewed-by: Zac Dover <zac.dover@proton.me>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
12 months agoinstall-deps.sh, do_cmake.sh: almalinux is another el flavour 58521/head
Dan van der Ster [Thu, 5 Oct 2023 16:50:36 +0000 (09:50 -0700)]
install-deps.sh, do_cmake.sh: almalinux is another el flavour

Signed-off-by: Dan van der Ster <dan.vanderster@clyso.com>
(cherry picked from commit 6e85f76385c3cffd860a8a3054bf14ce85a43b59)

12 months agoMerge pull request #57971 from adk3798/squid-adjust-bootstrap-config-priorities
Adam King [Wed, 10 Jul 2024 15:23:29 +0000 (11:23 -0400)]
Merge pull request #57971 from adk3798/squid-adjust-bootstrap-config-priorities

squid: cephadm: the user config is preferred during the bootstrap

Reviewed-by: John Mulligan <jmulligan@redhat.com>
12 months agomgr/dashboard: fix nav urls for cephfs and nfs 58479/head
Nizamudeen A [Wed, 26 Jun 2024 10:34:31 +0000 (16:04 +0530)]
mgr/dashboard: fix nav urls for cephfs and nfs

Fixes: https://tracker.ceph.com/issues/66697
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit e8d0e76b63079f8d16c470030bda105637e1bb1e)

 Conflicts:
src/pybind/mgr/dashboard/frontend/src/app/core/navigation/navigation/navigation.component.html

12 months agomgr/dashboard: Fix NFS routing
Afreen [Wed, 3 Apr 2024 02:15:32 +0000 (07:45 +0530)]
mgr/dashboard: Fix NFS routing

Fixes https://tracker.ceph.com/issues/65310

The NFS tab in object and File nav uses same route due to which both
gets activated when one of them is clicked.
Hence, this PR separates the routing for Object and File nav.
Object-> NFS: /rgw/nfs
File-> NFS: /cephfs/nfs

Both routes use same NFS List and Form component but under different
routes as mentioned above.

Changes summary
- updated route for File from "/fs" to "/cephfs/<any_other_sub_route>"
  to support both fs and nfs tabs. Since using `/fs` and `/fs/nfs` will
activate both paths and it will be an undesirable user experience.
- `getFsalRouteFromPath` helper function to set the storage backend from
  route.
- removed `stoarge-backend` field from nfs form as now route decides teh
  storage backend
- breadcrumbs redirect to respective navs
- updated e2e tests
- updated unit tests
- changes list page of object-> nfs page to say Bucket instead of Path

Signed-off-by: Afreen <afreen23.git@gmail.com>
(cherry picked from commit 97359d6b1ee8133afcddf1f540b147c26723e24e)

Conflicts:
src/pybind/mgr/dashboard/frontend/src/app/core/navigation/navigation/navigation.component.html

12 months agomgr/dashboard: fix service form count bugs 58477/head
Afreen Misbah [Sat, 22 Jun 2024 02:18:33 +0000 (07:48 +0530)]
mgr/dashboard: fix service form count bugs

Fixes https://tracker.ceph.com/issues/66608

- for services which do not have a count set default count to be null, otherwise the previous selected service's count is used which is wrong
- make count null when label is selected for placement

Signed-off-by: Afreen Misbah <afreen23.git@gmail.com>
(cherry picked from commit 27a8b2f2883fcc1fc4128b3e8995a7819a5ae51e)

Conflicts:
src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/services/service-form/service-form.component.html
src/pybind/mgr/dashboard/frontend/src/app/core/navigation/navigation/navigation.component.html

12 months agomgr/dashboard: fix service page e2e tests
Afreen Misbah [Fri, 14 Jun 2024 05:21:47 +0000 (10:51 +0530)]
mgr/dashboard: fix service page e2e tests

- service page now uses defaults value for the placement count due to which mds test failing
- in test we pass "1" while "2" which is the default count for mds is already populated, making it 21 and causing unable to create mds service

Fixes: https://tracker.ceph.com/issues/66540
Signed-off-by: Afreen Misbah <afreen23.git@gmail.com>
(cherry picked from commit 5a718229dc43953f140a16342f19523a1c075863)
(cherry picked from commit 1da0a4f8cb234ef84729c24cc9a82397361e9534)

Conflicts:
src/pybind/mgr/dashboard/frontend/cypress/e2e/pools/pools.e2e-spec.ts
src/pybind/mgr/dashboard/frontend/cypress/e2e/pools/pools.po.ts

12 months agomgr/dashboard: Configure NVMe/TCP
Afreen [Fri, 31 May 2024 07:54:27 +0000 (13:24 +0530)]
mgr/dashboard: Configure NVMe/TCP

Fixes https://tracker.ceph.com/issues/63686

- creation of Nvme-oF/TCP service
- deletion of Nvme-oF/TCP service
- edit/update Nvme-oF/TCP service
- added unit tests for Nvme-oF/TCP service
- changed Id -> Service Name
- added prefix of service type in service name (similar to <client.> in
  fs access)
- service name and pool are required fields for nvmeof
- placement count now takes default value as mentioned in cephadm
- slight refactors
- prepopulate serviceId for each service type setServiceId()
- in case serviceId is same as servcie type then do not add create service name with<servicetype>.<setrviceid> format

Signed-off-by: Afreen <afreen23.git@gmail.com>
(cherry picked from commit c6cf91766c45cf766c1d5a3851c2e956a80ac9ee)

12 months agoMerge pull request #58488 from zdover23/wip-doc-2024-07-10-backport-58484-to-squid
Zac Dover [Wed, 10 Jul 2024 00:26:53 +0000 (10:26 +1000)]
Merge pull request #58488 from zdover23/wip-doc-2024-07-10-backport-58484-to-squid

squid: doc: Correct link to "Device management"

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
12 months agoMerge pull request #58468 from zdover23/wip-doc-2024-07-09-backport-58454-to-squid
Zac Dover [Wed, 10 Jul 2024 00:26:35 +0000 (10:26 +1000)]
Merge pull request #58468 from zdover23/wip-doc-2024-07-09-backport-58454-to-squid

squid: doc/cephfs: fix typo

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
12 months agodoc: Correct link to "Device management" 58488/head
Matthew Vernon [Tue, 9 Jul 2024 16:02:31 +0000 (17:02 +0100)]
doc: Correct link to "Device management"

The current link goes to `cephadm/services/rados/operations/devices` which is a 404, it instead needs to be `rados/operations/devices/`.

Signed-off-by: Matthew Vernon <mvernon@wikimedia.org>
(cherry picked from commit d1a7cc4978adacd4e11df2d3e0886b191b118cc1)

12 months agoMerge pull request #58443 from cbodley/wip-66847-squid
Casey Bodley [Tue, 9 Jul 2024 17:29:50 +0000 (18:29 +0100)]
Merge pull request #58443 from cbodley/wip-66847-squid

squid: rgw: fix multipart get part when count==1

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
12 months agoMerge pull request #58089 from ronen-fr/wip-rf-57865-squid
Yuri Weinstein [Tue, 9 Jul 2024 14:03:33 +0000 (07:03 -0700)]
Merge pull request #58089 from ronen-fr/wip-rf-57865-squid

squid: osd/scrub: allow new scrubs while reserving

Reviewed-by: Samuel Just <sjust@redhat.com>
12 months agoMerge pull request #57623 from sajibreadd/wip-65937-squid
Yuri Weinstein [Tue, 9 Jul 2024 14:02:26 +0000 (07:02 -0700)]
Merge pull request #57623 from sajibreadd/wip-65937-squid

squid: os/bluestore: set rocksdb iterator bounds for Bluestore::_collection_list()

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
12 months agoMerge pull request #57382 from pdvian/wip-65890-squid
Yuri Weinstein [Tue, 9 Jul 2024 14:00:17 +0000 (07:00 -0700)]
Merge pull request #57382 from pdvian/wip-65890-squid

squid: mgr: integrate optracker in ceph-mgr

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Michael Kidd <linuxkidd@gmail.com>
12 months agoMerge pull request #56200 from ifed01/wip-ifed-fix-64443-squi
Yuri Weinstein [Tue, 9 Jul 2024 13:58:51 +0000 (06:58 -0700)]
Merge pull request #56200 from ifed01/wip-ifed-fix-64443-squi

squid: test/store_test: fix DeferredWrite test when prefer_deferred_size=0

Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
12 months agodoc/cephfs: fix typo 58468/head
spdfnet [Mon, 8 Jul 2024 08:03:28 +0000 (09:03 +0100)]
doc/cephfs: fix typo

blanacer -> balancer

Signed-off-by: spdfnet <32593931+spdfnet@users.noreply.github.com>
(cherry picked from commit d94f90b757189e269882523178a401cd4411a946)

12 months agoMerge pull request #58072 from yuvalif/wip-66499-squid
Casey Bodley [Mon, 8 Jul 2024 14:37:18 +0000 (15:37 +0100)]
Merge pull request #58072 from yuvalif/wip-66499-squid

squid: rgw: do not assert on thread name setting failures

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
12 months agoMerge pull request #57784 from yuvalif/wip-66288-squid
Casey Bodley [Mon, 8 Jul 2024 12:58:17 +0000 (13:58 +0100)]
Merge pull request #57784 from yuvalif/wip-66288-squid

squid: rgw/kafka: do not destroy the connection on errors

Reviewed-by: Casey Bodley <cbodley@redhat.com>
12 months agorgw/admin/notification: add command to dump notifications 58071/head
Yuval Lifshitz [Wed, 5 Jun 2024 16:08:16 +0000 (16:08 +0000)]
rgw/admin/notification: add command to dump notifications

command will dump pending notifications from a persistent queue in JSON
format:

radosgw-admin topic dump --topic <name>

Fixes: https://tracker.ceph.com/issues/66404
Signed-off-by: Yuval Lifshitz <ylifshit@ibm.com>
(cherry picked from commit e63e663dc9095589f4fe28d541fd5178c033bffd)

Conflicts:
src/rgw/driver/rados/rgw_notify.cc
        src/test/rgw/bucket_notification/test_bn.py

12 months agoMerge pull request #57996 from kchheda3/wip-66443-squid
Casey Bodley [Fri, 5 Jul 2024 16:39:06 +0000 (17:39 +0100)]
Merge pull request #57996 from kchheda3/wip-66443-squid

squid:  rgw/notification: Store the value of `persistent_queue` for existing topics and continue commiting events for all topics subscribed to given bucket

Reviewed-by: Casey Bodley <cbodley@redhat.com>
12 months agorgw: fix multipart get part when count==1 58443/head
Casey Bodley [Wed, 26 Jun 2024 14:52:37 +0000 (10:52 -0400)]
rgw: fix multipart get part when count==1

the RGWObjManifest for multipart uploads is subtly different when
there's only a single part. in that case, get_cur_part_id() for the
final rule returns 1 where it otherwise returns (parts_count + 1)

this caused two problems:
* we returned a parts_count of 0 instead 1, and
* the do-while loop got stuck in an infinite loop expecting the last
  rule's part id to be higher than the requested part id

Fixes: https://tracker.ceph.com/issues/66705
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 562e0ce9baac53e714d91a46b4f0114b82827026)

12 months agoMerge pull request #58420 from guits/wip-66830-squid
Guillaume Abrioux [Fri, 5 Jul 2024 08:11:42 +0000 (10:11 +0200)]
Merge pull request #58420 from guits/wip-66830-squid

squid: qa: fix log errors for cephadm tests

12 months agodoc/rgw: update s3 authentication 58436/head
Casey Bodley [Thu, 4 Jul 2024 19:17:52 +0000 (15:17 -0400)]
doc/rgw: update s3 authentication

authentication.rst described the steps to generate a v2 signature,
without reference to aws docs. replace that with sections that reference
aws docs for v2 and v4 signatures. list which values of the request
header x-amz-content-sha256 are supported for v4

Fixes: https://tracker.ceph.com/issues/42888
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 05cab64b9ce3662f0d3e9673dfbbb5d42906caf7)

12 months agoMerge pull request #58431 from zdover23/wip-doc-2024-07-05-backport-58368-to-squid
Anthony D'Atri [Thu, 4 Jul 2024 20:30:55 +0000 (16:30 -0400)]
Merge pull request #58431 from zdover23/wip-doc-2024-07-05-backport-58368-to-squid

squid: doc/rados: document manually passing search domain

12 months agodoc/rados: document manually passing search domain 58431/head
Zac Dover [Mon, 1 Jul 2024 06:36:02 +0000 (16:36 +1000)]
doc/rados: document manually passing search domain

Document how to manually pass the search domain to "mon_dns_srv_name" in
doc/rados/configuration/mon-lookup-dns.rst.

This commit is made in response to a request by Lander Duncan that was made on the [ceph-users] mailing list, and can be seen here: https://lists.ceph.io/hyperkitty/list/ceph-users@ceph.io/thread/F7V4CWLIYCAJ4JXI2JLNY6QPCFPR4SLA/

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 98938a0312dd0c8e0b293ed9aa2e0760cc9619fa)

12 months agoMerge pull request #58422 from AliMasarweh/wip-66772-squid
Ali Masarwa [Thu, 4 Jul 2024 13:18:05 +0000 (16:18 +0300)]
Merge pull request #58422 from AliMasarweh/wip-66772-squid

squid: RGW|Bucket notification: reload realm correctly

Reviewed-by: yuvalif<ylifshit@redhat.com>
12 months agoMerge pull request #58246 from rhcs-dashboard/wip-66486-squid
Nizamudeen A [Thu, 4 Jul 2024 10:11:38 +0000 (15:41 +0530)]
Merge pull request #58246 from rhcs-dashboard/wip-66486-squid

squid: mgr/dashboard: add dueTime to rgw bucket validator

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
12 months agoRGW|Bucket notification: disable notif v2 to reload realm correctly 58422/head
Ali Masarwa [Thu, 23 May 2024 11:08:56 +0000 (14:08 +0300)]
RGW|Bucket notification: disable notif v2 to reload realm correctly

Signed-off-by: Ali Masarwa <amasarwa@redhat.com>
(cherry picked from commit cce9b3c63ff0d83b3ab337c7c64b140e007290e1)

12 months agoqa: fix log errors for cephadm tests 58420/head
Guillaume Abrioux [Thu, 27 Jun 2024 08:12:10 +0000 (10:12 +0200)]
qa: fix log errors for cephadm tests

This fixes a lot of errors induced by the log scrapper check.

Fixes: https://tracker.ceph.com/issues/66751
Signed-off-by: Guillaume Abrioux <gabrioux@ibm.com>
(cherry picked from commit 53b462764c6fe11282b6cdb21131c176c1ed2350)

12 months agoqa/cephadm: fix ignorelist of CEPHADM_STRAY_DAEMON for rados_api_tests
Adam King [Fri, 10 May 2024 20:21:01 +0000 (16:21 -0400)]
qa/cephadm: fix ignorelist of CEPHADM_STRAY_DAEMON for rados_api_tests

Not every log with this error has the parentheses, so
these warnings were still causing the test to fail

[ERR] [WRN] CEPHADM_STRAY_DAEMON: 2 stray daemon(s)... in cluster log

Signed-off-by: Adam King <adking@redhat.com>
(cherry picked from commit 0a67436e36289b2e1bcf0acf662214b9e659b0de)

12 months agoMerge pull request #57224 from kotreshhr/wip-65404-squid
Xiubo Li [Wed, 3 Jul 2024 09:55:36 +0000 (17:55 +0800)]
Merge pull request #57224 from kotreshhr/wip-65404-squid

squid: mds: log at a lower level when stopping

12 months agoMerge pull request #57981 from dparmar18/wip-66191-squid
Xiubo Li [Wed, 3 Jul 2024 09:55:22 +0000 (17:55 +0800)]
Merge pull request #57981 from dparmar18/wip-66191-squid

squid: client: set LIBMOUNT_FORCE_MOUNT2=always

12 months agoMerge pull request #58085 from rishabh-d-dave/wip-66500-squid
Xiubo Li [Wed, 3 Jul 2024 09:54:38 +0000 (17:54 +0800)]
Merge pull request #58085 from rishabh-d-dave/wip-66500-squid

squid: cephfs-shell: prints warning, hangs and aborts when launched

12 months agoMerge pull request #58389 from zdover23/wip-doc-2024-07-02-backport-58092-to-squid
Zac Dover [Tue, 2 Jul 2024 13:12:10 +0000 (23:12 +1000)]
Merge pull request #58389 from zdover23/wip-doc-2024-07-02-backport-58092-to-squid

squid: doc/start: remove mention of Centos 8 support

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
12 months agodoc/start: remove mention of Centos 8 support 58389/head
Zac Dover [Mon, 17 Jun 2024 15:09:44 +0000 (01:09 +1000)]
doc/start: remove mention of Centos 8 support

Remove information so that it is clear that Centos 8 will no longer be
supported by Ceph.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 6b149e4f6ab2ac716e73f42b0d6c67482a768da9)

12 months agomultisite/qa: resolve rebase conflicts 58385/head
Shilpa Jagannath [Thu, 6 Jun 2024 19:06:49 +0000 (12:06 -0700)]
multisite/qa: resolve rebase conflicts

Signed-off-by: Shilpa Jagannath <smanjara@redhat.com>
(cherry picked from commit 6753e27daab5135973fa45e5a45a4e8e5fbac101)

12 months agomultisite/qa: disable sync error injection
Shilpa Jagannath [Tue, 21 May 2024 17:31:31 +0000 (10:31 -0700)]
multisite/qa: disable sync error injection

Signed-off-by: Shilpa Jagannath <smanjara@redhat.com>
(cherry picked from commit da788bc28dbf19bbb54fa91b8c3867063b711551)

12 months agoqa/multisite: disable two-zonegroup and three-zone configs.
Shilpa Jagannath [Mon, 15 Apr 2024 14:54:57 +0000 (10:54 -0400)]
qa/multisite: disable two-zonegroup and three-zone configs.

Signed-off-by: Shilpa Jagannath <smanjara@redhat.com>
(cherry picked from commit fb3186266ee52b352ebdf4ce394d3144a23db8f2)

12 months agoqa/rgw/multisite: enable notification_v2 feature
Casey Bodley [Mon, 15 Apr 2024 14:06:11 +0000 (10:06 -0400)]
qa/rgw/multisite: enable notification_v2 feature

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 1e7fc66683e4dea7294f0ec95f47b22f48b33b7e)
(cherry picked from commit ca460de93f42398e2631ab504b141e11373af1fb)

12 months agoqa/multisite: disable sync policy, endpoint and data_sync_init tests until fixed.
Shilpa Jagannath [Fri, 12 Apr 2024 20:46:11 +0000 (16:46 -0400)]
qa/multisite: disable sync policy, endpoint and data_sync_init tests until fixed.

Signed-off-by: Shilpa Jagannath <smanjara@redhat.com>
(cherry picked from commit 79d520698d4dc3f06535d3c8fc7ad119fd52ada1)

12 months agoqa/rgw/multisite: add two-zone configuration
Casey Bodley [Thu, 9 Nov 2023 21:22:36 +0000 (16:22 -0500)]
qa/rgw/multisite: add two-zone configuration

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 14204442ac2eaaaa3f40a76403da49f0f4ed92c1)
(cherry picked from commit 627dd7b86d0c59768625b508b614fa35d008708b)

12 months agoqa/rgw/multisite: double cluster nodes and osd count
Casey Bodley [Tue, 31 Oct 2023 14:53:25 +0000 (10:53 -0400)]
qa/rgw/multisite: double cluster nodes and osd count

> WARNING: The OSD cluster is overloaded and struggling to complete ops. You need more capacity to serve this level of demand.

give each cluster 2 nodes instead of 1, and 6 osds instead of 3

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 9a80cf4bf473c95c8d0b18fcdce88be20f74f973)
(cherry picked from commit a77c2d42277e44633643bcc1f8969f90724c49ef)

12 months agoqa/rgw/multisite: reduce polling intervals from 20s to 5s
Casey Bodley [Tue, 31 Oct 2023 14:51:28 +0000 (10:51 -0400)]
qa/rgw/multisite: reduce polling intervals from 20s to 5s

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit bc084c0ac64477abdbf54d96bc4981edf41e1343)
(cherry picked from commit 32fb2b923bc07b2228b8fe7d1c1f4bc2f3bf263b)

12 months agorgw/multisite: reconfigure checkpoint delay to 90s
Shilpa Jagannath [Mon, 30 Oct 2023 15:29:06 +0000 (11:29 -0400)]
rgw/multisite: reconfigure checkpoint delay to 90s

Signed-off-by: Shilpa Jagannath <smanjara@redhat.com>
(cherry picked from commit af7c4d83c7f5b61e907a90622c082a373f3995d9)

12 months agoMerge pull request #58266 from amathuria/wip-66694-squid
Yuri Weinstein [Mon, 1 Jul 2024 22:35:39 +0000 (15:35 -0700)]
Merge pull request #58266 from amathuria/wip-66694-squid

squid: osd/ECBackend.cc: Fix double increment of num_shards_repaired stat

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
12 months agoMerge pull request #58341 from guits/wip-66746-squid
Adam King [Mon, 1 Jul 2024 19:29:52 +0000 (15:29 -0400)]
Merge pull request #58341 from guits/wip-66746-squid

squid: tests: make sure nvmetcli and nvme-cli are up to date

Reviewed-by: Adam King <adking@redhat.com>
12 months agoMerge pull request #58219 from guits/wip-66026-squid
Adam King [Mon, 1 Jul 2024 19:25:10 +0000 (15:25 -0400)]
Merge pull request #58219 from guits/wip-66026-squid

squid: ceph-volume: create LVs when using partitions

Reviewed-by: Adam King <adking@redhat.com>
12 months agoMerge pull request #58151 from guits/wip-66464-squid
Adam King [Mon, 1 Jul 2024 19:22:23 +0000 (15:22 -0400)]
Merge pull request #58151 from guits/wip-66464-squid

squid: ceph-volume: fix set_dmcrypt_no_workqueue()

Reviewed-by: Teoman ONAY <tonay@ibm.com>
12 months agoMerge pull request #58370 from zdover23/wip-doc-2024-07-01-backport-58366-to-squid
Anthony D'Atri [Mon, 1 Jul 2024 15:35:42 +0000 (11:35 -0400)]
Merge pull request #58370 from zdover23/wip-doc-2024-07-01-backport-58366-to-squid

squid: doc/cephfs: update cephfs-shell link

12 months agoMerge pull request #58198 from ljflores/wip-66605-squid
Laura Flores [Mon, 1 Jul 2024 14:54:57 +0000 (09:54 -0500)]
Merge pull request #58198 from ljflores/wip-66605-squid

squid: Telemetry upgrade test fixes

12 months agodoc/cephfs: update cephfs-shell link 58370/head
Zac Dover [Mon, 1 Jul 2024 05:57:40 +0000 (15:57 +1000)]
doc/cephfs: update cephfs-shell link

Repair the link to cephfs-shell.rst in doc/cephfs/cephfs-shell.rst that
was broken in https://github.com/ceph/ceph/pull/41165/ when
doc/cephfs/cephfs-shell.rst was moved to doc/man/8/cephfs-shell.rst.

This commit is made in response to a request by Lander Duncan that was
made on the [ceph-users] mailing list, and can be seen here: https://lists.ceph.io/hyperkitty/list/ceph-users@ceph.io/thread/F7V4CWLIYCAJ4JXI2JLNY6QPCFPR4SLA/

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 4f8903cf80a94596a1b17b4a07affb874f21ae76)

12 months agoMerge pull request #58359 from zdover23/wip-doc-2024-06-30-backport-58358-to-squid
Anthony D'Atri [Sat, 29 Jun 2024 19:22:49 +0000 (15:22 -0400)]
Merge pull request #58359 from zdover23/wip-doc-2024-06-30-backport-58358-to-squid

squid: doc/cephfs: take Anthony's suggestion

12 months agodoc/cephfs: take Anthony's suggestion 58359/head
Zac Dover [Sat, 29 Jun 2024 12:11:55 +0000 (22:11 +1000)]
doc/cephfs: take Anthony's suggestion

Incorporate Anthony's suggestion in
https://github.com/ceph/ceph/pull/57567#discussion_r1607016050 into
doc/cephfs/fs-volumes.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 7a78dda0a92339db27359f91f0cb081703e2e7f9)

12 months agoMerge pull request #58264 from amathuria/wip-66690-squid
Yuri Weinstein [Fri, 28 Jun 2024 14:29:04 +0000 (07:29 -0700)]
Merge pull request #58264 from amathuria/wip-66690-squid

squid: mon, qa: suites override ec profiles with --yes_i_really_mean_it; monitors accept that

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
12 months agoMerge pull request #58262 from amathuria/wip-66688-squid
Yuri Weinstein [Fri, 28 Jun 2024 14:28:22 +0000 (07:28 -0700)]
Merge pull request #58262 from amathuria/wip-66688-squid

squid: qa/suites/rados/thrash/workloads: remove cache tiering workload

Reviewed-by: Neha Ojha <nojha@redhat.com>
12 months agoMerge pull request #57589 from NitzanMordhai/wip-66142-squid
Yuri Weinstein [Fri, 28 Jun 2024 14:20:01 +0000 (07:20 -0700)]
Merge pull request #57589 from NitzanMordhai/wip-66142-squid

squid: common/pick_address: check if address in subnet all public address

Reviewed-by: Laura Flores <lflores@redhat.com>
12 months agotests: make sure nvmetcli and nvme-cli are up to date 58341/head
Guillaume Abrioux [Wed, 26 Jun 2024 10:35:43 +0000 (10:35 +0000)]
tests: make sure nvmetcli and nvme-cli are up to date

Otherwise jobs end up with the following failure:

```
2024-06-25T14:22:18.659 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to write to /dev/nvme-fabrics: Invalid argument
```

Also, the output of nvme list has changed so we have to update
qa/tasks/nvme_loop.py accordingly.

Fixes: https://tracker.ceph.com/issues/66707
Signed-off-by: Guillaume Abrioux <gabrioux@ibm.com>
(cherry picked from commit d707c41eacb513bdcb9fec17c823bfbfdc182700)

12 months agotest/librbd: avoid caching effects TestGroup.add_snapshot{,PP} 58206/head
Ilya Dryomov [Wed, 26 Jun 2024 16:24:30 +0000 (18:24 +0200)]
test/librbd: avoid caching effects TestGroup.add_snapshot{,PP}

After rollback started being tested in commit b3977c53c930
("test/librbd: make rollback in TestGroup.add_snapshot{,PP}
meaningful"), these tests can fail on comparing post-rollback
data to expected data if run with exclusive lock disabled.
This doesn't occur with exclusive lock enabled because the RBD
cache gets invalidated implicitly before releasing the lock.

While at it, pass LIBRADOS_OP_FLAG_FADVISE_FUA to avoid relying
on any cache settings that happen to be in effect.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit a7e314c2ef899406eb3ade6c5f862622ce1e698f)