]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
11 months agodoc/start/os-recommendations: remove 16.2.z support for CentOS 7 58720/head
gukaifeng [Tue, 2 Apr 2024 07:28:04 +0000 (15:28 +0800)]
doc/start/os-recommendations: remove 16.2.z support for CentOS 7

(cherry picked from commit 92b07ddece5f717454e5aeaa00ec70e5649539c0)

11 months agoMerge pull request #58712 from zdover23/wip-doc-2024-07-22-backport-58639-to-squid
Anthony D'Atri [Mon, 22 Jul 2024 12:46:10 +0000 (08:46 -0400)]
Merge pull request #58712 from zdover23/wip-doc-2024-07-22-backport-58639-to-squid

squid: doc/start: add tested container host oses

11 months agodoc/start: add tested container host oses 58712/head
Zac Dover [Wed, 17 Jul 2024 06:18:58 +0000 (16:18 +1000)]
doc/start: add tested container host oses

Add a list of OSes that have been tested as container hosts. This commit
is added in response to a request made by Josh Durgin on Slack.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 9485f9723fcf58a0efbc08def27dd85ffe645764)

11 months agoMerge pull request #58557 from rishabh-d-dave/wip-66928-squid
Xiubo Li [Mon, 22 Jul 2024 05:53:17 +0000 (13:53 +0800)]
Merge pull request #58557 from rishabh-d-dave/wip-66928-squid

squid: mgr/vol: handle case where clone index entry goes missing

11 months agoMerge pull request #58561 from rishabh-d-dave/wip-66932-squid
Xiubo Li [Mon, 22 Jul 2024 05:52:15 +0000 (13:52 +0800)]
Merge pull request #58561 from rishabh-d-dave/wip-66932-squid

squid: qa/cephfs: fix test_single_path_authorize_on_nonalphanumeric_fsname

11 months agoMerge pull request #58562 from rishabh-d-dave/wip-66935-squid
Xiubo Li [Mon, 22 Jul 2024 05:51:48 +0000 (13:51 +0800)]
Merge pull request #58562 from rishabh-d-dave/wip-66935-squid

squid: qa/cephfs: improvements for "mds fail" and "fs fail"

11 months agoMerge pull request #58621 from joscollin/wip-66975-squid
Xiubo Li [Mon, 22 Jul 2024 05:51:20 +0000 (13:51 +0800)]
Merge pull request #58621 from joscollin/wip-66975-squid

squid: cephfs_mirror, qa: fix mirror daemon doesn't restart when blocklisted or failed

11 months agoMerge pull request #58331 from mchangir/wip-66669-squid
Xiubo Li [Mon, 22 Jul 2024 02:19:14 +0000 (10:19 +0800)]
Merge pull request #58331 from mchangir/wip-66669-squid

squid: qa: cleanup snapshots before subvolume delete

11 months agoMerge pull request #58394 from joscollin/wip-66774-squid
Xiubo Li [Mon, 22 Jul 2024 02:18:36 +0000 (10:18 +0800)]
Merge pull request #58394 from joscollin/wip-66774-squid

squid: mds: fix bug and error handling of mds STATE_STARTING

11 months agoMerge pull request #58494 from joscollin/wip-66869-squid
Xiubo Li [Mon, 22 Jul 2024 02:17:48 +0000 (10:17 +0800)]
Merge pull request #58494 from joscollin/wip-66869-squid

squid: mds: prevent scrubbing for standby-replay MDS

11 months agoMerge pull request #58495 from joscollin/wip-66728-squid
Xiubo Li [Mon, 22 Jul 2024 02:17:06 +0000 (10:17 +0800)]
Merge pull request #58495 from joscollin/wip-66728-squid

squid: qa/cephfs: mark file system joinable for fs rename tests before unmounting clients

11 months agoMerge pull request #58496 from joscollin/wip-66666-squid
Xiubo Li [Mon, 22 Jul 2024 02:16:24 +0000 (10:16 +0800)]
Merge pull request #58496 from joscollin/wip-66666-squid

squid: mds: set the correct WRLOCK flag always in wrlock_force()

11 months agoMerge pull request #58498 from joscollin/wip-66615-squid
Xiubo Li [Mon, 22 Jul 2024 02:15:39 +0000 (10:15 +0800)]
Merge pull request #58498 from joscollin/wip-66615-squid

squid: common/TrackedOp: do not count the ops marked as nowarn

11 months agoMerge pull request #58525 from joscollin/wip-66781-squid
Xiubo Li [Mon, 22 Jul 2024 02:10:23 +0000 (10:10 +0800)]
Merge pull request #58525 from joscollin/wip-66781-squid

squid: mon/MDSMonitor: set birth time on FSMap during encode

11 months agoMerge pull request #58526 from joscollin/wip-66777-squid
Xiubo Li [Mon, 22 Jul 2024 02:09:22 +0000 (10:09 +0800)]
Merge pull request #58526 from joscollin/wip-66777-squid

squid: mds/client: return -ENODATA when xattr doesn't exist for removexattr

11 months agoMerge pull request #58527 from joscollin/wip-66626-squid
Xiubo Li [Mon, 22 Jul 2024 02:08:35 +0000 (10:08 +0800)]
Merge pull request #58527 from joscollin/wip-66626-squid

squid: mds: set the proper extra bl for the create request

11 months agoMerge pull request #58696 from zdover23/wip-doc-2024-07-21-backport-58695-to-squid
Anthony D'Atri [Sat, 20 Jul 2024 19:12:41 +0000 (15:12 -0400)]
Merge pull request #58696 from zdover23/wip-doc-2024-07-21-backport-58695-to-squid

squid: doc: Amend dev mailing list subscribe instructions.

11 months agodoc: Amend dev mailing list subscribe instructions. 58696/head
Paulo E. Castro [Sat, 20 Jul 2024 16:32:17 +0000 (17:32 +0100)]
doc: Amend dev mailing list subscribe instructions.

Signed-off-by: Paulo E. Castro <pecastro@wormholenet.com>
(cherry picked from commit 3b0360bc2ea1e0b5f7a7c6b04ade483f77e4b5c6)

12 months agoMerge pull request #58680 from zdover23/wip-doc-2024-07-20-backport-58678-to-squid
Anthony D'Atri [Fri, 19 Jul 2024 17:49:51 +0000 (13:49 -0400)]
Merge pull request #58680 from zdover23/wip-doc-2024-07-20-backport-58678-to-squid

squid: doc/cephadm/upgrade: ceph-ci containers are hosted by quay.ceph.io

12 months agoMerge pull request #58683 from zdover23/wip-doc-2024-07-20-backport-58671-to-squid
Anthony D'Atri [Fri, 19 Jul 2024 17:43:59 +0000 (13:43 -0400)]
Merge pull request #58683 from zdover23/wip-doc-2024-07-20-backport-58671-to-squid

squid: doc/start: update mailing list links

12 months agodoc/start: update mailing list links 58683/head
Zac Dover [Fri, 19 Jul 2024 06:44:44 +0000 (16:44 +1000)]
doc/start: update mailing list links

Update the User and Dev mailing list subscription links. This commit is
made in response to a request from Dan van der Ster.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit a242fe3d940d5764cd766dba8e42449501986765)

12 months agodoc/cephadm/upgrade: ceph-ci containers are hosted by quay.ceph.io 58680/head
Casey Bodley [Fri, 19 Jul 2024 14:10:38 +0000 (10:10 -0400)]
doc/cephadm/upgrade: ceph-ci containers are hosted by quay.ceph.io

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 9c77963300fee804f249d512c980cdeac06f14f7)

12 months agoMerge pull request #57403 from k0ste/wip-65915-squid
Yuri Weinstein [Fri, 19 Jul 2024 13:34:14 +0000 (06:34 -0700)]
Merge pull request #57403 from k0ste/wip-65915-squid

squid: kv/RocksDBStore: Configure compact-on-deletion for all CFs

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
12 months agoMerge pull request #58667 from afreen23/wip-backport-nvmeof
Nizamudeen A [Fri, 19 Jul 2024 12:26:20 +0000 (17:56 +0530)]
Merge pull request #58667 from afreen23/wip-backport-nvmeof

Batch backport for nvme listener, namesapces and regression fix

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
12 months agoMerge pull request #58625 from rhcs-dashboard/wip-66982-squid
Pedro Gonzalez Gomez [Fri, 19 Jul 2024 09:51:32 +0000 (11:51 +0200)]
Merge pull request #58625 from rhcs-dashboard/wip-66982-squid

squid: mgr/dashboard: add fields to EC profile form

Reviewed-by: Ankush Behl <cloudbehl@gmail.com>
12 months agomgr/dashboard: Add namespaces views in dashboard 58667/head
Afreen Misbah [Tue, 16 Jul 2024 07:03:26 +0000 (12:33 +0530)]
mgr/dashboard: Add namespaces views in dashboard

Fixes https://tracker.ceph.com/issues/66990

- list namespaces
- create namespaces
- edit namespaces
- delete namespaces
- update NQN regex

Signed-off-by: Afreen Misbah <afreen23.git@gmail.com>
(cherry picked from commit b45eb5579611b56ee033410a4688984ff468fdcd)

Conflicts:
src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/pipes.module.ts

12 months agomgr/dashboard: Create and delete listeners
Afreen Misbah [Wed, 17 Jul 2024 10:16:23 +0000 (15:46 +0530)]
mgr/dashboard: Create and delete listeners

Fixes https://tracker.ceph.com/issues/66996

- list listener under subsystems
- delete listener
- create listener

Signed-off-by: Afreen Misbah <afreen23.git@gmail.com>
(cherry picked from commit a4f2eefe21f973d532a7e08d1ce4e977f39dfe88)

 Conflicts:
src/pybind/mgr/dashboard/frontend/src/app/shared/datatable/table/table.component.ts
src/pybind/mgr/dashboard/frontend/src/app/shared/enum/cell-template.enum.ts

12 months agomgr/dashboard: nvmf apis broken for insecure channel
Nizamudeen A [Tue, 16 Jul 2024 14:33:24 +0000 (20:03 +0530)]
mgr/dashboard: nvmf apis broken for insecure channel

because when no certificate, it raises an exception which stops the api call
abruptly.

Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit 36a4a72959c1428d7295f3e24e5f94c937cff6a6)

12 months agoMerge pull request #58655 from rhcs-dashboard/wip-67002-squid
Ankush Behl [Fri, 19 Jul 2024 06:15:52 +0000 (11:45 +0530)]
Merge pull request #58655 from rhcs-dashboard/wip-67002-squid

squid: mgr/dashboard: add NFS export button for subvolume/ grp

Reviewed-by: Ankush Behl <cloudbehl@gmail.com>
12 months agoMerge pull request #58619 from ceph/squid-sync-policy
Nizamudeen A [Fri, 19 Jul 2024 06:15:23 +0000 (11:45 +0530)]
Merge pull request #58619 from ceph/squid-sync-policy

squid: mgr/dashboard: rgw multisite sync policy management

Reviewed-by: Ankush Behl <cloudbehl@gmail.com>
12 months agoMerge pull request #57457 from badone/wip-tracker-59196-lazy-omap-regex-segfault...
Brad Hubbard [Fri, 19 Jul 2024 02:33:17 +0000 (12:33 +1000)]
Merge pull request #57457 from badone/wip-tracker-59196-lazy-omap-regex-segfault-squid

squid: test/lazy-omap-stats: Convert to boost::regex

Reviewed-by: Nitzan Mordechai <nmordech@redhat.com>
12 months agomgr/dashboard: RGW multisite sync pipe 58619/head
Naman Munet [Thu, 11 Jul 2024 18:40:51 +0000 (00:10 +0530)]
mgr/dashboard: RGW multisite sync pipe

Fixes: https://tracker.ceph.com/issues/66926
Signed-off-by: Naman Munet <nmunet@redhat.com>
(cherry picked from commit d451b4d1795e1429b0a530940558cf646579cdb9)

12 months agomgr/dashboard: add NFS export route from subvolume/subvolume grp 58655/head
Avan Thakkar [Fri, 5 Jul 2024 09:29:13 +0000 (14:59 +0530)]
mgr/dashboard: add NFS export route from subvolume/subvolume grp

Signed-off-by: Avan Thakkar <athakkar@redhat.com>
(cherry picked from commit c0b2db74b2a99eb0ee4e4a37997d6516d8622855)

12 months agoMerge pull request #58620 from rhcs-dashboard/squid-expand-cluster-improvements
Nizamudeen A [Thu, 18 Jul 2024 07:18:24 +0000 (12:48 +0530)]
Merge pull request #58620 from rhcs-dashboard/squid-expand-cluster-improvements

squid: mgr/dashboard: Expand Cluster improvements

Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
12 months agoMerge pull request #58599 from afreen23/wip-backport-nvmeof
Nizamudeen A [Thu, 18 Jul 2024 06:18:58 +0000 (11:48 +0530)]
Merge pull request #58599 from afreen23/wip-backport-nvmeof

Batch backport nvmeof nav and subystems

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
12 months agoMerge pull request #58640 from aaSharma14/wip-66993-squid
Aashish Sharma [Thu, 18 Jul 2024 05:20:14 +0000 (10:50 +0530)]
Merge pull request #58640 from aaSharma14/wip-66993-squid

squid: mgr/dashboard: Block -> Images -> Create form improvements

Reviewed-by: Nizamudeen A <nia@redhat.com>
12 months agoMerge pull request #58614 from zdover23/wip-doc-2024-07-16-backport-58596-to-squid
Zac Dover [Thu, 18 Jul 2024 00:39:30 +0000 (10:39 +1000)]
Merge pull request #58614 from zdover23/wip-doc-2024-07-16-backport-58596-to-squid

squid: doc: clarify superuser note for ceph-fuse

Reviewed-by: Cole Mitchell <cole.mitchell.ceph@gmail.com>
12 months agoMerge pull request #58650 from aclamk/wip-aclamk-denc-compat-check-squid
Radoslaw Zarzynski [Wed, 17 Jul 2024 23:54:21 +0000 (01:54 +0200)]
Merge pull request #58650 from aclamk/wip-aclamk-denc-compat-check-squid

squid: common, os/bluestore: Fix lack of checking for compat on DENC_START

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
12 months agoinclude/denc.h: Review fixes 58650/head
Adam Kupczyk [Tue, 16 Jul 2024 13:15:38 +0000 (13:15 +0000)]
include/denc.h: Review fixes

- Added note to release-checklist
- Created specialized DENC_START_OSD_REQID
- Use CEPH_RELEASE_SQUID (19) value

Signed-off-by: Adam Kupczyk <akupczyk@ibm.com>
(cherry picked from commit 6143b80ef7fd9730705ea564f72542caacf7e379)

12 months agoinclude/denc: Not use fmt::format
Adam Kupczyk [Thu, 4 Jul 2024 17:47:29 +0000 (17:47 +0000)]
include/denc: Not use fmt::format

fmt::format caused linking problems in some compilations.
Instead of fixing them all, discontinue usage.
Moved compatibility throw to separate function.

Signed-off-by: Adam Kupczyk <akupczyk@ibm.com>
(cherry picked from commit 71ca41dbaa5640cc41589d9c2b04ca1b2967ab16)

12 months agotest/encoding.cc: Harmonize expected text with exception
Adam Kupczyk [Wed, 3 Jul 2024 15:14:50 +0000 (15:14 +0000)]
test/encoding.cc: Harmonize expected text with exception

Signed-off-by: Adam Kupczyk <akupczyk@ibm.com>
(cherry picked from commit d4a83b7170657e7eb59507d0c8696238ac62fe32)

12 months agobuild: split ceph_ver.h
Adam Kupczyk [Mon, 24 Jun 2024 08:22:46 +0000 (08:22 +0000)]
build: split ceph_ver.h

Split ceph_ver.h into:
1) ceph_ver.h containing git-related macros
2) ceph_release.h containing just human written ceph version number /
   ceph version name.

The benefit is that denc.h which needs to know CEPH_RELEASE value
can skip including git-related macros. There are many compilation units
that use denc.h and only few that need git-related macros.
Reduces amount of files to recompile after SHA1 changes.
It is only relevant for developer environment.

Signed-off-by: Adam Kupczyk <akupczyk@ibm.com>
(cherry picked from commit 1a56293f2c890d9222fab5e1e91c34e2d864aef9)

12 months agoinclude/encoding.h: Fix message on compat failure
Adam Kupczyk [Tue, 21 May 2024 09:07:49 +0000 (09:07 +0000)]
include/encoding.h: Fix message on compat failure

Change misleading message printed when compat is not met.
Was:
FUNC no longer understand old encoding version 5 < 7
Is:
Decoder at FUNC v=5 cant decode v=11 minimal_decoder=7

Signed-off-by: Adam Kupczyk <akupczyk@ibm.com>
(cherry picked from commit ebd8283e2f2923ca5787483919bb1ab9a3faddea)

12 months agoinclude/denc: Add protection against bumping up compat
Adam Kupczyk [Thu, 6 Jun 2024 18:10:45 +0000 (18:10 +0000)]
include/denc: Add protection against bumping up compat

Added protection against bumping up compat until U_____ release (SQUID+2)

Signed-off-by: Adam Kupczyk <akupczyk@ibm.com>
(cherry picked from commit c94c8baf012b66ba2fe13abbeb2f27c16c717df4)

12 months agoinclude/denc: Add missing check for compat
Adam Kupczyk [Tue, 21 May 2024 09:05:15 +0000 (09:05 +0000)]
include/denc: Add missing check for compat

Now decoder throws if compat signalled in message is higher than version of decoder.

Signed-off-by: Adam Kupczyk <akupczyk@ibm.com>
(cherry picked from commit 62aba6df38df7203b2565f77afc2fb09e4bc43d6)

12 months agotest/denc: Add check for compat
Adam Kupczyk [Tue, 21 May 2024 09:02:25 +0000 (09:02 +0000)]
test/denc: Add check for compat

Add unittest that checks if code throws exception if decoder is outside compat range.

Signed-off-by: Adam Kupczyk <akupczyk@ibm.com>
(cherry picked from commit 59c48b1202b324f0ddffeb4bad1029e799121813)

12 months agoqa: Wait for mirror daemon restart before getting new rados_inst 58621/head
Jos Collin [Thu, 14 Mar 2024 14:42:46 +0000 (20:12 +0530)]
qa: Wait for mirror daemon restart before getting new rados_inst

After blocklisted/failed, wait for the mirror daemon restart
which is after 30 seconds timeout and then check for the new rados_inst.

Fixes: https://tracker.ceph.com/issues/64927
Signed-off-by: Jos Collin <jcollin@redhat.com>
(cherry picked from commit a9a56919ff95d2face436da2ca08fd26580fadb9)

12 months agocephfs_mirror: Fixed negative seconds
Jos Collin [Thu, 30 May 2024 10:18:08 +0000 (15:48 +0530)]
cephfs_mirror: Fixed negative seconds

Fixes: https://tracker.ceph.com/issues/64927
Fixes: https://tracker.ceph.com/issues/51964
Fixes: https://tracker.ceph.com/issues/63931
Fixes: https://tracker.ceph.com/issues/63089
Signed-off-by: Jos Collin <jcollin@redhat.com>
(cherry picked from commit 96c3f8f33d789a065c7ed418679afd53faffa3d8)

12 months agocephfs_mirror: Add ErrorListener to maintain blocklisted/failed timestamp in FSMirror
Jos Collin [Tue, 28 May 2024 14:57:55 +0000 (20:27 +0530)]
cephfs_mirror: Add ErrorListener to maintain blocklisted/failed timestamp in FSMirror

Have FSMirror register a listener with InstanceWatcher/MirrorWatcher which would get invoked when the mirror daemon is blocklisted or failed.
Thus FSMirror can maintain the last blocklisted/failed timestamp and use that for restarting the mirror daemon.

Fixes: https://tracker.ceph.com/issues/64927
Fixes: https://tracker.ceph.com/issues/51964
Fixes: https://tracker.ceph.com/issues/63931
Fixes: https://tracker.ceph.com/issues/63089
Signed-off-by: Jos Collin <jcollin@redhat.com>
(cherry picked from commit 77ec7bfde7a349b0e06b34ecdf328996c7642d43)

12 months agoMerge pull request #57678 from batrick/wip-66188-squid
Xiubo Li [Wed, 17 Jul 2024 07:29:50 +0000 (15:29 +0800)]
Merge pull request #57678 from batrick/wip-66188-squid

squid: mds: use regular dispatch for processing metrics

12 months agomgr/dashboard: Block -> Images -> Create form improvements 58640/head
Aashish Sharma [Tue, 4 Jun 2024 12:29:34 +0000 (17:59 +0530)]
mgr/dashboard: Block -> Images -> Create form improvements

Fixes: https://tracker.ceph.com/issues/66348
Signed-off-by: Aashish Sharma <aasharma@redhat.com>
(cherry picked from commit e3c656440f69fed1a93ed6fa92e2b9e6adf27e45)

12 months agoMerge pull request #58476 from rhcs-dashboard/wip-66872-squid
Avan [Wed, 17 Jul 2024 06:04:07 +0000 (11:34 +0530)]
Merge pull request #58476 from rhcs-dashboard/wip-66872-squid

squid: mgr/dashboard: nfs export enhancement for CEPHFS

Reviewed-by: afreen23 <NOT@FOUND>
12 months agoMerge pull request #58593 from rhcs-dashboard/wip-66785-squid
Pedro Gonzalez Gomez [Tue, 16 Jul 2024 18:10:24 +0000 (20:10 +0200)]
Merge pull request #58593 from rhcs-dashboard/wip-66785-squid

squid: mgr/dashboard: add RGW lifecycle management

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ankush Behl <cloudbehl@gmail.com>
12 months agomgr/dashboard: add fields to EC profile form 58625/head
Pedro Gonzalez Gomez [Wed, 19 Jun 2024 20:23:11 +0000 (22:23 +0200)]
mgr/dashboard: add fields to EC profile form

Fixes: https://tracker.ceph.com/issues/66571
Signed-off-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
(cherry picked from commit 8f7a5de584b04b1dcba04799d1d9301af325d64b)

 Conflicts:
src/pybind/mgr/dashboard/frontend/src/app/ceph/pool/pool-form/pool-form.component.ts

12 months agomgr/dashboard: nfs export enhancement for CEPHFS 58476/head
Avan Thakkar [Thu, 27 Jun 2024 10:06:42 +0000 (15:36 +0530)]
mgr/dashboard: nfs export enhancement for CEPHFS

Fixes: https://tracker.ceph.com/issues/66718
Signed-off-by: Avan Thakkar <athakkar@redhat.com>
(cherry picked from commit 69a45db9c3cc9ed4ac36e7f2d6db78bd7940530b)

12 months agomgr/dashboard: Expand Cluster improvements 58620/head
Naman Munet [Fri, 7 Jun 2024 10:49:23 +0000 (16:19 +0530)]
mgr/dashboard: Expand Cluster improvements

worked on expand cluster screen hide/show and persisting osd form values

Fixes: https://tracker.ceph.com/issues/66344
Signed-off-by: Naman Munet <nmunet@redhat.com>
(cherry picked from commit aa4d6b58459079a3b59ffdd1c9913c0a07a1549a)

12 months agoMerge pull request #58553 from adk3798/squid-cephadm-cert-store
Adam King [Tue, 16 Jul 2024 12:16:38 +0000 (08:16 -0400)]
Merge pull request #58553 from adk3798/squid-cephadm-cert-store

squid: mgr/cephadm: Cert Store + use secure_channel for grpc requests

Reviewed-by: Nizamudeen A <nia@redhat.com>
12 months agomgr/dashboard: RGW multisite sync flow
Naman Munet [Thu, 11 Jul 2024 18:40:51 +0000 (00:10 +0530)]
mgr/dashboard: RGW multisite sync flow

Fixes: https://tracker.ceph.com/issues/66915
Signed-off-by: Naman Munet <nmunet@redhat.com>
(cherry picked from commit 41d46b7b507f95603ec432c061fdf0569f12dc3b)

12 months agomgr/dashboard: RGW sync policy crud operations
Naman Munet [Tue, 2 Jul 2024 06:36:59 +0000 (12:06 +0530)]
mgr/dashboard: RGW sync policy crud operations

sync group crud ops added

Fixes: https://tracker.ceph.com/issues/66798
Signed-off-by: Naman Munet <nmunet@redhat.com>
(cherry picked from commit a784b71abf64ec26d3f424c6298b5ecc97d296e3)

12 months agomgr/dashborad: RGW sync policy
Naman Munet [Tue, 25 Jun 2024 11:54:51 +0000 (17:24 +0530)]
mgr/dashborad: RGW sync policy

Fixes: https://tracker.ceph.com/issues/66576
Signed-off-by: Naman Munet <nmunet@redhat.com>
(cherry picked from commit 94f9a2bf18f43cc5b05dd8c216fe9e0975969106)

12 months agoMerge pull request #58347 from idryomov/wip-66570-squid
Ilya Dryomov [Tue, 16 Jul 2024 06:59:43 +0000 (08:59 +0200)]
Merge pull request #58347 from idryomov/wip-66570-squid

squid: librbd: make diff-iterate in fast-diff mode aware of encryption

Reviewed-by: Ramana Raja <rraja@redhat.com>
12 months agodoc: elide superuser discussion from mount prereq 58614/head
Patrick Donnelly [Mon, 15 Jul 2024 14:18:15 +0000 (10:18 -0400)]
doc: elide superuser discussion from mount prereq

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit 7290bdce6f4dd93be88be6ad54030fa90a8c1ec0)

12 months agodoc: clarify superuser note for ceph-fuse
Patrick Donnelly [Mon, 15 Jul 2024 14:12:24 +0000 (10:12 -0400)]
doc: clarify superuser note for ceph-fuse

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit d100de9c9ce884beee6e9551b2b221c686b775b5)

12 months agoMerge pull request #57610 from vshankar/wip-65988-squid
Xiubo Li [Tue, 16 Jul 2024 01:29:49 +0000 (09:29 +0800)]
Merge pull request #57610 from vshankar/wip-65988-squid

squid: qa: ignore cluster warnings generated from forward-scrub task

12 months agoMerge pull request #57918 from batrick/wip-66386-squid
Xiubo Li [Tue, 16 Jul 2024 01:28:07 +0000 (09:28 +0800)]
Merge pull request #57918 from batrick/wip-66386-squid

squid: qa: disable mon_warn_on_pool_no_app in fs suite

12 months agoMerge pull request #57922 from batrick/wip-66385-squid
Xiubo Li [Tue, 16 Jul 2024 01:27:42 +0000 (09:27 +0800)]
Merge pull request #57922 from batrick/wip-66385-squid

squid: qa: correct json lookup for new `lock path` output

12 months agoMerge pull request #58155 from vshankar/wip-66325-squid
Xiubo Li [Tue, 16 Jul 2024 01:26:54 +0000 (09:26 +0800)]
Merge pull request #58155 from vshankar/wip-66325-squid

squid: qa: enable debug logs for fs:cephadm:multivolume subsuite

12 months agoMerge pull request #58233 from batrick/wip-66593-squid
Xiubo Li [Tue, 16 Jul 2024 01:26:21 +0000 (09:26 +0800)]
Merge pull request #58233 from batrick/wip-66593-squid

squid: tools/cephfs: recover alternate_name of dentries from journal

12 months agoMerge pull request #58237 from batrick/wip-66619-squid
Xiubo Li [Tue, 16 Jul 2024 01:25:43 +0000 (09:25 +0800)]
Merge pull request #58237 from batrick/wip-66619-squid

squid: mds: initialize epoch for quiescedb

12 months agoMerge pull request #58252 from joscollin/wip-66674-squid
Xiubo Li [Tue, 16 Jul 2024 01:23:59 +0000 (09:23 +0800)]
Merge pull request #58252 from joscollin/wip-66674-squid

squid: qa: enhance per-client labelled perf counters test

12 months agoMerge pull request #58294 from batrick/wip-66623-squid
Xiubo Li [Tue, 16 Jul 2024 01:23:30 +0000 (09:23 +0800)]
Merge pull request #58294 from batrick/wip-66623-squid

squid: mds: do remove the cap when seqs equal or larger than last issue

12 months agoMerge pull request #58317 from batrick/wip-66585-squid
Xiubo Li [Tue, 16 Jul 2024 01:22:01 +0000 (09:22 +0800)]
Merge pull request #58317 from batrick/wip-66585-squid

squid: mds: QuiesceDbManager: mark next retry event during bootstrap

12 months agoMerge pull request #58318 from batrick/wip-66572-squid
Xiubo Li [Tue, 16 Jul 2024 01:21:42 +0000 (09:21 +0800)]
Merge pull request #58318 from batrick/wip-66572-squid

squid: mds/quiesce-db: calculate_quiesce_map: aggregate quiesce roots' TTL as `max`

12 months agoMerge pull request #58319 from batrick/wip-66542-squid
Xiubo Li [Tue, 16 Jul 2024 01:19:37 +0000 (09:19 +0800)]
Merge pull request #58319 from batrick/wip-66542-squid

squid: mds: dump formatter even for errors

12 months agomgr/dashboard: Configure subsystems from dashboard 58599/head
Afreen Misbah [Sat, 22 Jun 2024 12:00:49 +0000 (17:30 +0530)]
mgr/dashboard: Configure subsystems from dashboard

Fixes https://tracker.ceph.com/issues/66659

- adds subsytems tab
- adds subsystem listing view
- adds create subsystem modal
- adds delete subsystem
- adds unit tests

Signed-off-by: Afreen Misbah <afreen23.git@gmail.com>
(cherry picked from commit b85f982def41320003ecb632e2b03a8779567fbe)

12 months agomgr/dashboard: Introduce NVMe/TCP navigation
Afreen [Fri, 31 May 2024 07:54:27 +0000 (13:24 +0530)]
mgr/dashboard: Introduce NVMe/TCP navigation

Fixes https://tracker.ceph.com/issues/66346

- adds NVMe/TCP tab under Block nav
- adds overview page for NVMe/TCP nav
- overview page lists gateways
- add default error page when no nvmeof service running
- added unit tests
- fixes service page e2e test

Signed-off-by: Afreen <afreen23.git@gmail.com>
(cherry picked from commit 442346f0efbb5d7d3af3ebdf847586bbe3f93f6d)

Conflicts:
src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/services/service-form/service-form.component.html
src/pybind/mgr/dashboard/frontend/src/app/core/navigation/navigation/navigation.component.html

12 months agolibrbd: make diff-iterate in fast-diff mode aware of encryption 58347/head
Ilya Dryomov [Thu, 20 Jun 2024 19:13:56 +0000 (21:13 +0200)]
librbd: make diff-iterate in fast-diff mode aware of encryption

diff-iterate wasn't updated when librbd was being prepared to support
encryption in commit 8d6a47933269 ("librbd: add crypto image dispatch
layer").  This is even noted in [1]:

> The two places I skipped for now are DiffIterate and TrimRequest.

CryptoImageDispatch has since been removed, but diff-iterate in
fast-diff mode is still unaware of encryption and just assumes that all
offsets are raw.  This means that the callback gets invoked with
incorrect image offsets when encryption is loaded.  For example, for
a LUKS1-formatted image with some data at offsets 0 and 20971520,
diff-iterate with encryption loaded reports

  0~4194304
  4194304~4194304
  25165824~4194304

instead of

  0~4194304
  20971520~4194304

as "exists".  For any piece of code that is using diff-iterate to
optimize block-by-block processing (e.g. copy an encrypted source image
to a differently-encrypted destination image), this is fatal: it would
skip processing block 20971520 which has data and instead process block
25165824 which doesn't have any data and was to be skipped, producing
a corrupted destination image.

[1] https://github.com/ceph/ceph/pull/37935#issue-735278403

Fixes: https://tracker.ceph.com/issues/66570
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit cdeb0efce3f9f857ad6d5b7ff3965f3292cb571a)

12 months agotest/librbd: extend DiffIterateTest.DiffIterateDeterministic{,PP}
Ilya Dryomov [Fri, 21 Jun 2024 13:56:27 +0000 (15:56 +0200)]
test/librbd: extend DiffIterateTest.DiffIterateDeterministic{,PP}

Currently we are laying data only at the beginning of an object.
Extend the skeletons to write to three different offsets in the middle
and also at the end of the object.

Separately, make C and C++ API test variants slightly different in
terms of offsets being targeted to not go through exactly the same
scenario twice.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit da69d1fdbf69cf37ba8b75ea9a230634bb25ae76)

12 months agotest/librbd: refactor DiffIterateTest.DiffIterateDeterministic{,PP}
Ilya Dryomov [Fri, 21 Jun 2024 13:53:05 +0000 (15:53 +0200)]
test/librbd: refactor DiffIterateTest.DiffIterateDeterministic{,PP}

In preparation for extending coverage, extract test logic into a couple
of parametrized helpers.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 1df87998dc30be6e3b4c90f5833539c7ccc70911)

12 months agoMerge pull request #58541 from idryomov/wip-66886-squid 57399/head
Yuri Weinstein [Mon, 15 Jul 2024 14:09:42 +0000 (07:09 -0700)]
Merge pull request #58541 from idryomov/wip-66886-squid

squid: qa: account for rbd_trash object in krbd_data_pool.sh + related ceph{,adm} task fixes

Reviewed-by: Ramana Raja <rraja@redhat.com>
12 months agoMerge pull request #58212 from idryomov/wip-66418-squid
Yuri Weinstein [Mon, 15 Jul 2024 14:08:52 +0000 (07:08 -0700)]
Merge pull request #58212 from idryomov/wip-66418-squid

squid: librbd: diff-iterate shouldn't crash on an empty byte range

Reviewed-by: Mykola Golub <mgolub@suse.com>
12 months agoMerge pull request #58206 from idryomov/wip-66300-squid
Yuri Weinstein [Mon, 15 Jul 2024 14:07:51 +0000 (07:07 -0700)]
Merge pull request #58206 from idryomov/wip-66300-squid

squid: librbd: disallow group snap rollback if memberships don't match

Reviewed-by: Ramana Raja <rraja@redhat.com>
12 months agoMerge pull request #58575 from zdover23/wip-doc-2024-07-14-backport-58451-to-squid
Zac Dover [Mon, 15 Jul 2024 13:21:05 +0000 (23:21 +1000)]
Merge pull request #58575 from zdover23/wip-doc-2024-07-14-backport-58451-to-squid

squid: doc/dev: edit "Principles for format change"

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
12 months agoMerge pull request #58385 from smanjara/wip-squid-pr-56874
Casey Bodley [Mon, 15 Jul 2024 13:14:10 +0000 (14:14 +0100)]
Merge pull request #58385 from smanjara/wip-squid-pr-56874

[squid] qa/multisite: stabilize multisite testing

Reviewed-by: Casey Bodley <cbodley@redhat.com>
12 months agomgr/dashboard: add RGW lifecycle management 58593/head
Pedro Gonzalez Gomez [Thu, 2 May 2024 14:37:38 +0000 (16:37 +0200)]
mgr/dashboard: add RGW lifecycle management

Fixes: https://tracker.ceph.com/issues/50327
Signed-off-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
(cherry picked from commit b54efd44e8d72d9b56fe4c69a96d53934de1df2a)

 Conflicts:
src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/pipes.module.ts

12 months agoMerge pull request #58578 from zdover23/wip-doc-2024-07-15-backport-58574-to-squid
Anthony D'Atri [Sun, 14 Jul 2024 17:22:24 +0000 (13:22 -0400)]
Merge pull request #58578 from zdover23/wip-doc-2024-07-15-backport-58574-to-squid

squid: doc/cephfs: edit "is mount helper present"

12 months agoMerge pull request #58001 from amathuria/wip-66421-squid
Yuri Weinstein [Sun, 14 Jul 2024 14:25:07 +0000 (07:25 -0700)]
Merge pull request #58001 from amathuria/wip-66421-squid

squid: osd/scrub: Change scrub cost to average object size

Reviewed-by: Sridhar Seshasayee <sseshasa@redhat.com>
12 months agoMerge pull request #57618 from sajibreadd/wip-66143-squid
Yuri Weinstein [Sun, 14 Jul 2024 14:23:25 +0000 (07:23 -0700)]
Merge pull request #57618 from sajibreadd/wip-66143-squid

squid: osd: CEPH_OSD_OP_FLAG_BYPASS_CLEAN_CACHE flag is passed from ECBackend

Reviewed-by: Samuel Just <sjust@redhat.com>
12 months agoMerge pull request #57195 from k0ste/wip-64591-squid
Yuri Weinstein [Sun, 14 Jul 2024 14:21:54 +0000 (07:21 -0700)]
Merge pull request #57195 from k0ste/wip-64591-squid

squid: os/bluestore: fix the problem of l_bluefs_log_compactions double recording

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
12 months agodoc/cephfs: edit "is mount helper present" 58578/head
Zac Dover [Sun, 14 Jul 2024 06:40:14 +0000 (16:40 +1000)]
doc/cephfs: edit "is mount helper present"

Edit the section called "Is mount helper present?", the title of which
prior to this commit was "Is mount helper is present?". Other small
disambiguating improvements have been made to the text in the section.
An unselectable prompt has been added before a command.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 0ebfb3eda8e2fc88662530bbddc84f2efcc4e13c)

12 months agodoc/dev: edit "Principles for format change" 58575/head
Zac Dover [Sun, 7 Jul 2024 03:59:15 +0000 (13:59 +1000)]
doc/dev: edit "Principles for format change"

Improve "Principles for format change" in doc/dev/encoding.rst. This
commit started as a response to Anthony D'Atri's suggestion here: https://github.com/ceph/ceph/pull/58299/files#r1656985564

Review of this section suggested to me that certain minor English usage
improvements would be of benefit. The numbered lists in this section
could still be made a bit clearer.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 570797e5588b67b8c72e5297b61f84d9aa48dc45)

12 months agoMerge pull request #58071 from yuvalif/wip-66497-squid
Casey Bodley [Sat, 13 Jul 2024 16:15:04 +0000 (17:15 +0100)]
Merge pull request #58071 from yuvalif/wip-66497-squid

squid: rgw/admin/notification: add command to dump notifications

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
12 months agoMerge pull request #58538 from cbodley/wip-66913-squid
Casey Bodley [Sat, 13 Jul 2024 16:14:24 +0000 (17:14 +0100)]
Merge pull request #58538 from cbodley/wip-66913-squid

squid: rgw/datalog: fix LazyFIFO race fix

Reviewed-by: Adam Emerson <aemerson@redhat.com>
12 months agoMerge pull request #58545 from smanjara/wip-66919-squid
Casey Bodley [Sat, 13 Jul 2024 16:13:49 +0000 (17:13 +0100)]
Merge pull request #58545 from smanjara/wip-66919-squid

squid: rgw/multisite: allow PutACL replication.

Reviewed-by: Casey Bodley <cbodley@redhat.com>
12 months agoMerge pull request #58550 from idryomov/wip-test-cookie-squid
Ilya Dryomov [Fri, 12 Jul 2024 16:16:44 +0000 (18:16 +0200)]
Merge pull request #58550 from idryomov/wip-test-cookie-squid

squid: test/librbd: clean up unused TEST_COOKIE variable

Reviewed-by: Ramana Raja <rraja@redhat.com>
12 months agoqa/cephfs: rename couple of test methods 58562/head
Rishabh Dave [Wed, 8 May 2024 14:24:28 +0000 (19:54 +0530)]
qa/cephfs: rename couple of test methods

New name will make it easier to find these tests by making it similar to
health warnings (MDS_CACHE_OVERSIZED) they do testing for.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
(cherry picked from commit 0f41207dacbd56360689552097789e06dca55446)

12 months agoqa/cephfs: improve and move _get_unhealthy_mds_name to TestMDSFail
Rishabh Dave [Wed, 8 May 2024 13:09:35 +0000 (18:39 +0530)]
qa/cephfs: improve and move _get_unhealthy_mds_name to TestMDSFail

1. Instead of accepting health report as argument, get one directly.
2. Since it is not being used elsewhere move it to the class where it is
   being used.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
(cherry picked from commit b1918686a383e47d51ae0115c8d79ef250ddd0ec)

12 months agoqa/cephfs: use wait_for_health() instead of the new method
Rishabh Dave [Wed, 8 May 2024 12:29:11 +0000 (17:59 +0530)]
qa/cephfs: use wait_for_health() instead of the new method

Signed-off-by: Rishabh Dave <ridave@redhat.com>
(cherry picked from commit 5972cafb7a3750cde83f09c9ac592b97c5f9a9b3)

12 months agoqa/cephfs: make code for generating health warnings reusable
Rishabh Dave [Wed, 8 May 2024 12:08:43 +0000 (17:38 +0530)]
qa/cephfs: make code for generating health warnings reusable

Code to generate MDS_TRIM and MDS_CACHE_OVERSIZED health warnings is
repeated in test methods of TestMDSFail and TestFSFail. Move this code
to separate helper methods so that it can be reused instead of
duplicating it. And move these helper methods to TestAdminCommands so
to make them conveniently available for reuse.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
(cherry picked from commit 79b047b22e1031df74584cfa4b77d7b824b0e42e)

12 months agoqa/cephfs: fix test_single_path_authorize_on_nonalphanumeric_fsname 58561/head
Rishabh Dave [Wed, 26 Jun 2024 13:35:35 +0000 (19:05 +0530)]
qa/cephfs: fix test_single_path_authorize_on_nonalphanumeric_fsname

This test deletes the CephFS already present on the cluster at the very
beginning and unmounts the first client beforehand. But it leaves the
second client mounted on this deleted CephFS that doesn't exist for the
rest of the test. And then at the very end of this test it attempts to
remount the second client (during tearDown()) which hangs and causes
test runner to crash.

Unmount the second client beforehand to prevent the bug and delete
mount_b object to avoid confusion for the readers in future about
whether or not 2nd mountpoint exists.

Fixes: https://tracker.ceph.com/issues/66077
Signed-off-by: Rishabh Dave <ridave@redhat.com>
(cherry picked from commit 2130ec8ebc377364a11be7448ed2773b46b464c0)