]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
11 months agosuite/crimson: enable stats tests 58832/head
Nitzan Mordechai [Tue, 2 Jul 2024 11:37:41 +0000 (11:37 +0000)]
suite/crimson: enable stats tests

Fixes: https://tracker.ceph.com/issues/66382
Signed-off-by: Nitzan Mordechai <nmordech@redhat.com>
(cherry picked from commit d66d9f35d39174ac62450611fd8f9a15654ab99d)

11 months agoMerge pull request #58774 from zdover23/wip-doc-2024-07-24-backport-58524-to-squid
Anthony D'Atri [Wed, 24 Jul 2024 22:28:07 +0000 (18:28 -0400)]
Merge pull request #58774 from zdover23/wip-doc-2024-07-24-backport-58524-to-squid

squid: doc/cephfs: streamline a paragraph

11 months agoMerge pull request #58679 from rhcs-dashboard/squid-sync-policy-routing-fix
Ankush Behl [Wed, 24 Jul 2024 06:11:51 +0000 (11:41 +0530)]
Merge pull request #58679 from rhcs-dashboard/squid-sync-policy-routing-fix

squid: mgr/dashboard: rgw sync policy routing fixes

Reviewed-by: Ankush Behl <cloudbehl@gmail.com>
11 months agodoc/cephfs: streamline a paragraph 58774/head
Zac Dover [Wed, 10 Jul 2024 23:15:38 +0000 (09:15 +1000)]
doc/cephfs: streamline a paragraph

Streamline a paragraph in doc/cephfs/index.rst.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 820f8ead8919483df37c751400bd6842d4c1bd92)

11 months agoMerge pull request #58743 from zdover23/wip-doc-2024-07-23-backport-58705-to-squid
Zac Dover [Wed, 24 Jul 2024 03:03:50 +0000 (13:03 +1000)]
Merge pull request #58743 from zdover23/wip-doc-2024-07-23-backport-58705-to-squid

squid: doc/dev/crimson: clarify and rearrange for userability

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
11 months agoMerge pull request #58623 from adk3798/wip-66413-squid
Adam King [Tue, 23 Jul 2024 18:33:02 +0000 (14:33 -0400)]
Merge pull request #58623 from adk3798/wip-66413-squid

squid: mgr/prometheus: s/pkg_resources.packaging/packaging/

Reviewed-by: John Mulligan <jmulligan@redhat.com>
11 months agoMerge pull request #58516 from adk3798/squid-jinja2-cephadm-rhel9
Adam King [Tue, 23 Jul 2024 15:49:21 +0000 (11:49 -0400)]
Merge pull request #58516 from adk3798/squid-jinja2-cephadm-rhel9

squid: cephadm: make cephadm compatible with jinja2 2.11.3

Reviewed-by: John Mulligan <jmulligan@redhat.com>
Reviewed-by: Ken Dreyer <kdreyer@ibm.com>
11 months agoMerge pull request #58729 from zdover23/wip-doc-2024-07-23-backport-58725-to-squid
Anthony D'Atri [Mon, 22 Jul 2024 20:14:54 +0000 (16:14 -0400)]
Merge pull request #58729 from zdover23/wip-doc-2024-07-23-backport-58725-to-squid

squid: doc/dev_guide: add needs-upgrade-testing label info

11 months agoMerge pull request #58737 from zdover23/wip-doc-2024-07-23-backport-58600-to-squid
Anthony D'Atri [Mon, 22 Jul 2024 20:12:52 +0000 (16:12 -0400)]
Merge pull request #58737 from zdover23/wip-doc-2024-07-23-backport-58600-to-squid

squid: doc/dev: add formatting to basic workflow

11 months agoMerge pull request #58668 from cbodley/wip-67024-squid
Yuri Weinstein [Mon, 22 Jul 2024 19:40:43 +0000 (12:40 -0700)]
Merge pull request #58668 from cbodley/wip-67024-squid

squid: rgw/rados: set_attrs() falls back to existing attrs for index update

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
11 months agoMerge pull request #58570 from cbodley/wip-66210-squid
Yuri Weinstein [Mon, 22 Jul 2024 19:40:04 +0000 (12:40 -0700)]
Merge pull request #58570 from cbodley/wip-66210-squid

squid: rgw/notify: decouple add/remove_persistent_topic() from Manager

Reviewed-by: Yuval Lifshitz <ylifshit@redhat.com>
11 months agoMerge pull request #58569 from cbodley/wip-66243-squid
Yuri Weinstein [Mon, 22 Jul 2024 19:39:31 +0000 (12:39 -0700)]
Merge pull request #58569 from cbodley/wip-66243-squid

squid: test/rgw/notifications: allow http server to buffer more requests

Reviewed-by: Yuval Lifshitz <ylifshit@redhat.com>
11 months agodoc/dev/crimson: clarify and rearrange for userability 58743/head
gitkenan [Sun, 21 Jul 2024 22:02:47 +0000 (23:02 +0100)]
doc/dev/crimson: clarify and rearrange for userability

Signed-off-by: gitkenan <kenan.mth@gmail.com>
(cherry picked from commit 92fea64c1f28a010336b3696863d3f003cd684ef)

11 months agodoc/dev: add formatting to basic workflow 58737/head
Zac Dover [Mon, 15 Jul 2024 16:03:37 +0000 (02:03 +1000)]
doc/dev: add formatting to basic workflow

Add some formatting to a few sections near the end of
doc/dev/developer_guide_basic-workflow.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 4c4063a09759dc3412d89ecafb9ac55a55e6bc01)

11 months agodoc/dev_guide: add needs-upgrade-testing label info 58729/head
Zac Dover [Mon, 22 Jul 2024 15:36:53 +0000 (01:36 +1000)]
doc/dev_guide: add needs-upgrade-testing label info

Add an explanation of the "needs-upgrade-testing" label and explain when
to use it.

Laura is the true author of this text.

Co-authored-by: Laura Flores <lflores@ibm.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 02d5a6a3371c9fa52a32124cf07da16b89a11e27)

11 months agoMerge pull request #58720 from zdover23/wip-doc-2024-07-22-backport-56517-to-squid
Anthony D'Atri [Mon, 22 Jul 2024 14:07:08 +0000 (10:07 -0400)]
Merge pull request #58720 from zdover23/wip-doc-2024-07-22-backport-56517-to-squid

squid: doc/start/os-recommendations: remove 16.2.z support for CentOS 7

11 months agodoc/start/os-recommendations: remove 16.2.z support for CentOS 7 58720/head
gukaifeng [Tue, 2 Apr 2024 07:28:04 +0000 (15:28 +0800)]
doc/start/os-recommendations: remove 16.2.z support for CentOS 7

(cherry picked from commit 92b07ddece5f717454e5aeaa00ec70e5649539c0)

11 months agoMerge pull request #58712 from zdover23/wip-doc-2024-07-22-backport-58639-to-squid
Anthony D'Atri [Mon, 22 Jul 2024 12:46:10 +0000 (08:46 -0400)]
Merge pull request #58712 from zdover23/wip-doc-2024-07-22-backport-58639-to-squid

squid: doc/start: add tested container host oses

11 months agodoc/start: add tested container host oses 58712/head
Zac Dover [Wed, 17 Jul 2024 06:18:58 +0000 (16:18 +1000)]
doc/start: add tested container host oses

Add a list of OSes that have been tested as container hosts. This commit
is added in response to a request made by Josh Durgin on Slack.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 9485f9723fcf58a0efbc08def27dd85ffe645764)

11 months agomgr/dashboard: rgw sync policy routing fixes 58679/head
Naman Munet [Wed, 17 Jul 2024 10:04:55 +0000 (15:34 +0530)]
mgr/dashboard: rgw sync policy routing fixes

Fixes: https://tracker.ceph.com/issues/66977
Signed-off-by: Naman Munet <nmunet@redhat.com>
(cherry picked from commit ca4759b8f48fc62ff61fd290657586abd75c293c)

Conflicts:
src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-multisite-details/rgw-multisite-details.component.html
src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-multisite-details/rgw-multisite-details.component.ts
src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-multisite-wizard/rgw-multisite-wizard.component.ts
src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw.module.ts

11 months agoMerge pull request #58557 from rishabh-d-dave/wip-66928-squid
Xiubo Li [Mon, 22 Jul 2024 05:53:17 +0000 (13:53 +0800)]
Merge pull request #58557 from rishabh-d-dave/wip-66928-squid

squid: mgr/vol: handle case where clone index entry goes missing

11 months agoMerge pull request #58561 from rishabh-d-dave/wip-66932-squid
Xiubo Li [Mon, 22 Jul 2024 05:52:15 +0000 (13:52 +0800)]
Merge pull request #58561 from rishabh-d-dave/wip-66932-squid

squid: qa/cephfs: fix test_single_path_authorize_on_nonalphanumeric_fsname

11 months agoMerge pull request #58562 from rishabh-d-dave/wip-66935-squid
Xiubo Li [Mon, 22 Jul 2024 05:51:48 +0000 (13:51 +0800)]
Merge pull request #58562 from rishabh-d-dave/wip-66935-squid

squid: qa/cephfs: improvements for "mds fail" and "fs fail"

11 months agoMerge pull request #58621 from joscollin/wip-66975-squid
Xiubo Li [Mon, 22 Jul 2024 05:51:20 +0000 (13:51 +0800)]
Merge pull request #58621 from joscollin/wip-66975-squid

squid: cephfs_mirror, qa: fix mirror daemon doesn't restart when blocklisted or failed

11 months agoMerge pull request #58331 from mchangir/wip-66669-squid
Xiubo Li [Mon, 22 Jul 2024 02:19:14 +0000 (10:19 +0800)]
Merge pull request #58331 from mchangir/wip-66669-squid

squid: qa: cleanup snapshots before subvolume delete

11 months agoMerge pull request #58394 from joscollin/wip-66774-squid
Xiubo Li [Mon, 22 Jul 2024 02:18:36 +0000 (10:18 +0800)]
Merge pull request #58394 from joscollin/wip-66774-squid

squid: mds: fix bug and error handling of mds STATE_STARTING

11 months agoMerge pull request #58494 from joscollin/wip-66869-squid
Xiubo Li [Mon, 22 Jul 2024 02:17:48 +0000 (10:17 +0800)]
Merge pull request #58494 from joscollin/wip-66869-squid

squid: mds: prevent scrubbing for standby-replay MDS

11 months agoMerge pull request #58495 from joscollin/wip-66728-squid
Xiubo Li [Mon, 22 Jul 2024 02:17:06 +0000 (10:17 +0800)]
Merge pull request #58495 from joscollin/wip-66728-squid

squid: qa/cephfs: mark file system joinable for fs rename tests before unmounting clients

11 months agoMerge pull request #58496 from joscollin/wip-66666-squid
Xiubo Li [Mon, 22 Jul 2024 02:16:24 +0000 (10:16 +0800)]
Merge pull request #58496 from joscollin/wip-66666-squid

squid: mds: set the correct WRLOCK flag always in wrlock_force()

11 months agoMerge pull request #58498 from joscollin/wip-66615-squid
Xiubo Li [Mon, 22 Jul 2024 02:15:39 +0000 (10:15 +0800)]
Merge pull request #58498 from joscollin/wip-66615-squid

squid: common/TrackedOp: do not count the ops marked as nowarn

11 months agoMerge pull request #58525 from joscollin/wip-66781-squid
Xiubo Li [Mon, 22 Jul 2024 02:10:23 +0000 (10:10 +0800)]
Merge pull request #58525 from joscollin/wip-66781-squid

squid: mon/MDSMonitor: set birth time on FSMap during encode

11 months agoMerge pull request #58526 from joscollin/wip-66777-squid
Xiubo Li [Mon, 22 Jul 2024 02:09:22 +0000 (10:09 +0800)]
Merge pull request #58526 from joscollin/wip-66777-squid

squid: mds/client: return -ENODATA when xattr doesn't exist for removexattr

11 months agoMerge pull request #58527 from joscollin/wip-66626-squid
Xiubo Li [Mon, 22 Jul 2024 02:08:35 +0000 (10:08 +0800)]
Merge pull request #58527 from joscollin/wip-66626-squid

squid: mds: set the proper extra bl for the create request

11 months agoMerge pull request #58696 from zdover23/wip-doc-2024-07-21-backport-58695-to-squid
Anthony D'Atri [Sat, 20 Jul 2024 19:12:41 +0000 (15:12 -0400)]
Merge pull request #58696 from zdover23/wip-doc-2024-07-21-backport-58695-to-squid

squid: doc: Amend dev mailing list subscribe instructions.

11 months agodoc: Amend dev mailing list subscribe instructions. 58696/head
Paulo E. Castro [Sat, 20 Jul 2024 16:32:17 +0000 (17:32 +0100)]
doc: Amend dev mailing list subscribe instructions.

Signed-off-by: Paulo E. Castro <pecastro@wormholenet.com>
(cherry picked from commit 3b0360bc2ea1e0b5f7a7c6b04ade483f77e4b5c6)

11 months agoMerge pull request #58680 from zdover23/wip-doc-2024-07-20-backport-58678-to-squid
Anthony D'Atri [Fri, 19 Jul 2024 17:49:51 +0000 (13:49 -0400)]
Merge pull request #58680 from zdover23/wip-doc-2024-07-20-backport-58678-to-squid

squid: doc/cephadm/upgrade: ceph-ci containers are hosted by quay.ceph.io

11 months agoMerge pull request #58683 from zdover23/wip-doc-2024-07-20-backport-58671-to-squid
Anthony D'Atri [Fri, 19 Jul 2024 17:43:59 +0000 (13:43 -0400)]
Merge pull request #58683 from zdover23/wip-doc-2024-07-20-backport-58671-to-squid

squid: doc/start: update mailing list links

11 months agodoc/start: update mailing list links 58683/head
Zac Dover [Fri, 19 Jul 2024 06:44:44 +0000 (16:44 +1000)]
doc/start: update mailing list links

Update the User and Dev mailing list subscription links. This commit is
made in response to a request from Dan van der Ster.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit a242fe3d940d5764cd766dba8e42449501986765)

11 months agodoc/cephadm/upgrade: ceph-ci containers are hosted by quay.ceph.io 58680/head
Casey Bodley [Fri, 19 Jul 2024 14:10:38 +0000 (10:10 -0400)]
doc/cephadm/upgrade: ceph-ci containers are hosted by quay.ceph.io

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 9c77963300fee804f249d512c980cdeac06f14f7)

11 months agoMerge pull request #57403 from k0ste/wip-65915-squid
Yuri Weinstein [Fri, 19 Jul 2024 13:34:14 +0000 (06:34 -0700)]
Merge pull request #57403 from k0ste/wip-65915-squid

squid: kv/RocksDBStore: Configure compact-on-deletion for all CFs

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
12 months agoMerge pull request #58667 from afreen23/wip-backport-nvmeof
Nizamudeen A [Fri, 19 Jul 2024 12:26:20 +0000 (17:56 +0530)]
Merge pull request #58667 from afreen23/wip-backport-nvmeof

Batch backport for nvme listener, namesapces and regression fix

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
12 months agoMerge pull request #58625 from rhcs-dashboard/wip-66982-squid
Pedro Gonzalez Gomez [Fri, 19 Jul 2024 09:51:32 +0000 (11:51 +0200)]
Merge pull request #58625 from rhcs-dashboard/wip-66982-squid

squid: mgr/dashboard: add fields to EC profile form

Reviewed-by: Ankush Behl <cloudbehl@gmail.com>
12 months agomgr/dashboard: Add namespaces views in dashboard 58667/head
Afreen Misbah [Tue, 16 Jul 2024 07:03:26 +0000 (12:33 +0530)]
mgr/dashboard: Add namespaces views in dashboard

Fixes https://tracker.ceph.com/issues/66990

- list namespaces
- create namespaces
- edit namespaces
- delete namespaces
- update NQN regex

Signed-off-by: Afreen Misbah <afreen23.git@gmail.com>
(cherry picked from commit b45eb5579611b56ee033410a4688984ff468fdcd)

Conflicts:
src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/pipes.module.ts

12 months agomgr/dashboard: Create and delete listeners
Afreen Misbah [Wed, 17 Jul 2024 10:16:23 +0000 (15:46 +0530)]
mgr/dashboard: Create and delete listeners

Fixes https://tracker.ceph.com/issues/66996

- list listener under subsystems
- delete listener
- create listener

Signed-off-by: Afreen Misbah <afreen23.git@gmail.com>
(cherry picked from commit a4f2eefe21f973d532a7e08d1ce4e977f39dfe88)

 Conflicts:
src/pybind/mgr/dashboard/frontend/src/app/shared/datatable/table/table.component.ts
src/pybind/mgr/dashboard/frontend/src/app/shared/enum/cell-template.enum.ts

12 months agomgr/dashboard: nvmf apis broken for insecure channel
Nizamudeen A [Tue, 16 Jul 2024 14:33:24 +0000 (20:03 +0530)]
mgr/dashboard: nvmf apis broken for insecure channel

because when no certificate, it raises an exception which stops the api call
abruptly.

Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit 36a4a72959c1428d7295f3e24e5f94c937cff6a6)

12 months agoMerge pull request #58655 from rhcs-dashboard/wip-67002-squid
Ankush Behl [Fri, 19 Jul 2024 06:15:52 +0000 (11:45 +0530)]
Merge pull request #58655 from rhcs-dashboard/wip-67002-squid

squid: mgr/dashboard: add NFS export button for subvolume/ grp

Reviewed-by: Ankush Behl <cloudbehl@gmail.com>
12 months agoMerge pull request #58619 from ceph/squid-sync-policy
Nizamudeen A [Fri, 19 Jul 2024 06:15:23 +0000 (11:45 +0530)]
Merge pull request #58619 from ceph/squid-sync-policy

squid: mgr/dashboard: rgw multisite sync policy management

Reviewed-by: Ankush Behl <cloudbehl@gmail.com>
12 months agoMerge pull request #57457 from badone/wip-tracker-59196-lazy-omap-regex-segfault...
Brad Hubbard [Fri, 19 Jul 2024 02:33:17 +0000 (12:33 +1000)]
Merge pull request #57457 from badone/wip-tracker-59196-lazy-omap-regex-segfault-squid

squid: test/lazy-omap-stats: Convert to boost::regex

Reviewed-by: Nitzan Mordechai <nmordech@redhat.com>
12 months agorgw/rados: set_attrs() falls back to existing attrs for index update 58668/head
Casey Bodley [Wed, 17 Jul 2024 14:28:08 +0000 (10:28 -0400)]
rgw/rados: set_attrs() falls back to existing attrs for index update

set_attrs() needs the ACLOwner, etag, content-type and storage class for
the bucket index update. if those attrs aren't being updated, consult
their existing attrs in state->attrset

Fixes: https://tracker.ceph.com/issues/64173
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit f433e2ff4568416619af4885314d43c621fb4db9)

12 months agomgr/dashboard: RGW multisite sync pipe 58619/head
Naman Munet [Thu, 11 Jul 2024 18:40:51 +0000 (00:10 +0530)]
mgr/dashboard: RGW multisite sync pipe

Fixes: https://tracker.ceph.com/issues/66926
Signed-off-by: Naman Munet <nmunet@redhat.com>
(cherry picked from commit d451b4d1795e1429b0a530940558cf646579cdb9)

12 months agomgr/dashboard: add NFS export route from subvolume/subvolume grp 58655/head
Avan Thakkar [Fri, 5 Jul 2024 09:29:13 +0000 (14:59 +0530)]
mgr/dashboard: add NFS export route from subvolume/subvolume grp

Signed-off-by: Avan Thakkar <athakkar@redhat.com>
(cherry picked from commit c0b2db74b2a99eb0ee4e4a37997d6516d8622855)

12 months agoMerge pull request #58620 from rhcs-dashboard/squid-expand-cluster-improvements
Nizamudeen A [Thu, 18 Jul 2024 07:18:24 +0000 (12:48 +0530)]
Merge pull request #58620 from rhcs-dashboard/squid-expand-cluster-improvements

squid: mgr/dashboard: Expand Cluster improvements

Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
12 months agoMerge pull request #58599 from afreen23/wip-backport-nvmeof
Nizamudeen A [Thu, 18 Jul 2024 06:18:58 +0000 (11:48 +0530)]
Merge pull request #58599 from afreen23/wip-backport-nvmeof

Batch backport nvmeof nav and subystems

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
12 months agoMerge pull request #58640 from aaSharma14/wip-66993-squid
Aashish Sharma [Thu, 18 Jul 2024 05:20:14 +0000 (10:50 +0530)]
Merge pull request #58640 from aaSharma14/wip-66993-squid

squid: mgr/dashboard: Block -> Images -> Create form improvements

Reviewed-by: Nizamudeen A <nia@redhat.com>
12 months agoMerge pull request #58614 from zdover23/wip-doc-2024-07-16-backport-58596-to-squid
Zac Dover [Thu, 18 Jul 2024 00:39:30 +0000 (10:39 +1000)]
Merge pull request #58614 from zdover23/wip-doc-2024-07-16-backport-58596-to-squid

squid: doc: clarify superuser note for ceph-fuse

Reviewed-by: Cole Mitchell <cole.mitchell.ceph@gmail.com>
12 months agoMerge pull request #58650 from aclamk/wip-aclamk-denc-compat-check-squid
Radoslaw Zarzynski [Wed, 17 Jul 2024 23:54:21 +0000 (01:54 +0200)]
Merge pull request #58650 from aclamk/wip-aclamk-denc-compat-check-squid

squid: common, os/bluestore: Fix lack of checking for compat on DENC_START

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
12 months agoinclude/denc.h: Review fixes 58650/head
Adam Kupczyk [Tue, 16 Jul 2024 13:15:38 +0000 (13:15 +0000)]
include/denc.h: Review fixes

- Added note to release-checklist
- Created specialized DENC_START_OSD_REQID
- Use CEPH_RELEASE_SQUID (19) value

Signed-off-by: Adam Kupczyk <akupczyk@ibm.com>
(cherry picked from commit 6143b80ef7fd9730705ea564f72542caacf7e379)

12 months agoinclude/denc: Not use fmt::format
Adam Kupczyk [Thu, 4 Jul 2024 17:47:29 +0000 (17:47 +0000)]
include/denc: Not use fmt::format

fmt::format caused linking problems in some compilations.
Instead of fixing them all, discontinue usage.
Moved compatibility throw to separate function.

Signed-off-by: Adam Kupczyk <akupczyk@ibm.com>
(cherry picked from commit 71ca41dbaa5640cc41589d9c2b04ca1b2967ab16)

12 months agotest/encoding.cc: Harmonize expected text with exception
Adam Kupczyk [Wed, 3 Jul 2024 15:14:50 +0000 (15:14 +0000)]
test/encoding.cc: Harmonize expected text with exception

Signed-off-by: Adam Kupczyk <akupczyk@ibm.com>
(cherry picked from commit d4a83b7170657e7eb59507d0c8696238ac62fe32)

12 months agobuild: split ceph_ver.h
Adam Kupczyk [Mon, 24 Jun 2024 08:22:46 +0000 (08:22 +0000)]
build: split ceph_ver.h

Split ceph_ver.h into:
1) ceph_ver.h containing git-related macros
2) ceph_release.h containing just human written ceph version number /
   ceph version name.

The benefit is that denc.h which needs to know CEPH_RELEASE value
can skip including git-related macros. There are many compilation units
that use denc.h and only few that need git-related macros.
Reduces amount of files to recompile after SHA1 changes.
It is only relevant for developer environment.

Signed-off-by: Adam Kupczyk <akupczyk@ibm.com>
(cherry picked from commit 1a56293f2c890d9222fab5e1e91c34e2d864aef9)

12 months agoinclude/encoding.h: Fix message on compat failure
Adam Kupczyk [Tue, 21 May 2024 09:07:49 +0000 (09:07 +0000)]
include/encoding.h: Fix message on compat failure

Change misleading message printed when compat is not met.
Was:
FUNC no longer understand old encoding version 5 < 7
Is:
Decoder at FUNC v=5 cant decode v=11 minimal_decoder=7

Signed-off-by: Adam Kupczyk <akupczyk@ibm.com>
(cherry picked from commit ebd8283e2f2923ca5787483919bb1ab9a3faddea)

12 months agoinclude/denc: Add protection against bumping up compat
Adam Kupczyk [Thu, 6 Jun 2024 18:10:45 +0000 (18:10 +0000)]
include/denc: Add protection against bumping up compat

Added protection against bumping up compat until U_____ release (SQUID+2)

Signed-off-by: Adam Kupczyk <akupczyk@ibm.com>
(cherry picked from commit c94c8baf012b66ba2fe13abbeb2f27c16c717df4)

12 months agoinclude/denc: Add missing check for compat
Adam Kupczyk [Tue, 21 May 2024 09:05:15 +0000 (09:05 +0000)]
include/denc: Add missing check for compat

Now decoder throws if compat signalled in message is higher than version of decoder.

Signed-off-by: Adam Kupczyk <akupczyk@ibm.com>
(cherry picked from commit 62aba6df38df7203b2565f77afc2fb09e4bc43d6)

12 months agotest/denc: Add check for compat
Adam Kupczyk [Tue, 21 May 2024 09:02:25 +0000 (09:02 +0000)]
test/denc: Add check for compat

Add unittest that checks if code throws exception if decoder is outside compat range.

Signed-off-by: Adam Kupczyk <akupczyk@ibm.com>
(cherry picked from commit 59c48b1202b324f0ddffeb4bad1029e799121813)

12 months agoqa: Wait for mirror daemon restart before getting new rados_inst 58621/head
Jos Collin [Thu, 14 Mar 2024 14:42:46 +0000 (20:12 +0530)]
qa: Wait for mirror daemon restart before getting new rados_inst

After blocklisted/failed, wait for the mirror daemon restart
which is after 30 seconds timeout and then check for the new rados_inst.

Fixes: https://tracker.ceph.com/issues/64927
Signed-off-by: Jos Collin <jcollin@redhat.com>
(cherry picked from commit a9a56919ff95d2face436da2ca08fd26580fadb9)

12 months agocephfs_mirror: Fixed negative seconds
Jos Collin [Thu, 30 May 2024 10:18:08 +0000 (15:48 +0530)]
cephfs_mirror: Fixed negative seconds

Fixes: https://tracker.ceph.com/issues/64927
Fixes: https://tracker.ceph.com/issues/51964
Fixes: https://tracker.ceph.com/issues/63931
Fixes: https://tracker.ceph.com/issues/63089
Signed-off-by: Jos Collin <jcollin@redhat.com>
(cherry picked from commit 96c3f8f33d789a065c7ed418679afd53faffa3d8)

12 months agocephfs_mirror: Add ErrorListener to maintain blocklisted/failed timestamp in FSMirror
Jos Collin [Tue, 28 May 2024 14:57:55 +0000 (20:27 +0530)]
cephfs_mirror: Add ErrorListener to maintain blocklisted/failed timestamp in FSMirror

Have FSMirror register a listener with InstanceWatcher/MirrorWatcher which would get invoked when the mirror daemon is blocklisted or failed.
Thus FSMirror can maintain the last blocklisted/failed timestamp and use that for restarting the mirror daemon.

Fixes: https://tracker.ceph.com/issues/64927
Fixes: https://tracker.ceph.com/issues/51964
Fixes: https://tracker.ceph.com/issues/63931
Fixes: https://tracker.ceph.com/issues/63089
Signed-off-by: Jos Collin <jcollin@redhat.com>
(cherry picked from commit 77ec7bfde7a349b0e06b34ecdf328996c7642d43)

12 months agoMerge pull request #57678 from batrick/wip-66188-squid
Xiubo Li [Wed, 17 Jul 2024 07:29:50 +0000 (15:29 +0800)]
Merge pull request #57678 from batrick/wip-66188-squid

squid: mds: use regular dispatch for processing metrics

12 months agomgr/dashboard: Block -> Images -> Create form improvements 58640/head
Aashish Sharma [Tue, 4 Jun 2024 12:29:34 +0000 (17:59 +0530)]
mgr/dashboard: Block -> Images -> Create form improvements

Fixes: https://tracker.ceph.com/issues/66348
Signed-off-by: Aashish Sharma <aasharma@redhat.com>
(cherry picked from commit e3c656440f69fed1a93ed6fa92e2b9e6adf27e45)

12 months agoMerge pull request #58476 from rhcs-dashboard/wip-66872-squid
Avan [Wed, 17 Jul 2024 06:04:07 +0000 (11:34 +0530)]
Merge pull request #58476 from rhcs-dashboard/wip-66872-squid

squid: mgr/dashboard: nfs export enhancement for CEPHFS

Reviewed-by: afreen23 <NOT@FOUND>
12 months agoMerge pull request #58593 from rhcs-dashboard/wip-66785-squid
Pedro Gonzalez Gomez [Tue, 16 Jul 2024 18:10:24 +0000 (20:10 +0200)]
Merge pull request #58593 from rhcs-dashboard/wip-66785-squid

squid: mgr/dashboard: add RGW lifecycle management

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ankush Behl <cloudbehl@gmail.com>
12 months agomgr/dashboard: add fields to EC profile form 58625/head
Pedro Gonzalez Gomez [Wed, 19 Jun 2024 20:23:11 +0000 (22:23 +0200)]
mgr/dashboard: add fields to EC profile form

Fixes: https://tracker.ceph.com/issues/66571
Signed-off-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
(cherry picked from commit 8f7a5de584b04b1dcba04799d1d9301af325d64b)

 Conflicts:
src/pybind/mgr/dashboard/frontend/src/app/ceph/pool/pool-form/pool-form.component.ts

12 months agomgr/prometheus: s/pkg_resources.packaging/packaging/ 58623/head
Kefu Chai [Sat, 25 May 2024 05:50:43 +0000 (13:50 +0800)]
mgr/prometheus: s/pkg_resources.packaging/packaging/

instead of relying on the internal implementation of pkg_resources,
let's import packaging directly.

in this change, we also add the dependency to the packaging module
in the packaging recipes.

See also https://github.com/pypa/setuptools/issues/4385

Fixes https://tracker.ceph.com/issues/66201
Signed-off-by: Kefu Chai <tchaikov@gmail.com>
(cherry picked from commit 844b66de419d7bf5f622980b0de3c69b5ad8bc9c)

12 months agomgr/dashboard: nfs export enhancement for CEPHFS 58476/head
Avan Thakkar [Thu, 27 Jun 2024 10:06:42 +0000 (15:36 +0530)]
mgr/dashboard: nfs export enhancement for CEPHFS

Fixes: https://tracker.ceph.com/issues/66718
Signed-off-by: Avan Thakkar <athakkar@redhat.com>
(cherry picked from commit 69a45db9c3cc9ed4ac36e7f2d6db78bd7940530b)

12 months agomgr/dashboard: Expand Cluster improvements 58620/head
Naman Munet [Fri, 7 Jun 2024 10:49:23 +0000 (16:19 +0530)]
mgr/dashboard: Expand Cluster improvements

worked on expand cluster screen hide/show and persisting osd form values

Fixes: https://tracker.ceph.com/issues/66344
Signed-off-by: Naman Munet <nmunet@redhat.com>
(cherry picked from commit aa4d6b58459079a3b59ffdd1c9913c0a07a1549a)

12 months agoMerge pull request #58553 from adk3798/squid-cephadm-cert-store
Adam King [Tue, 16 Jul 2024 12:16:38 +0000 (08:16 -0400)]
Merge pull request #58553 from adk3798/squid-cephadm-cert-store

squid: mgr/cephadm: Cert Store + use secure_channel for grpc requests

Reviewed-by: Nizamudeen A <nia@redhat.com>
12 months agomgr/dashboard: RGW multisite sync flow
Naman Munet [Thu, 11 Jul 2024 18:40:51 +0000 (00:10 +0530)]
mgr/dashboard: RGW multisite sync flow

Fixes: https://tracker.ceph.com/issues/66915
Signed-off-by: Naman Munet <nmunet@redhat.com>
(cherry picked from commit 41d46b7b507f95603ec432c061fdf0569f12dc3b)

12 months agomgr/dashboard: RGW sync policy crud operations
Naman Munet [Tue, 2 Jul 2024 06:36:59 +0000 (12:06 +0530)]
mgr/dashboard: RGW sync policy crud operations

sync group crud ops added

Fixes: https://tracker.ceph.com/issues/66798
Signed-off-by: Naman Munet <nmunet@redhat.com>
(cherry picked from commit a784b71abf64ec26d3f424c6298b5ecc97d296e3)

12 months agomgr/dashborad: RGW sync policy
Naman Munet [Tue, 25 Jun 2024 11:54:51 +0000 (17:24 +0530)]
mgr/dashborad: RGW sync policy

Fixes: https://tracker.ceph.com/issues/66576
Signed-off-by: Naman Munet <nmunet@redhat.com>
(cherry picked from commit 94f9a2bf18f43cc5b05dd8c216fe9e0975969106)

12 months agoMerge pull request #58347 from idryomov/wip-66570-squid
Ilya Dryomov [Tue, 16 Jul 2024 06:59:43 +0000 (08:59 +0200)]
Merge pull request #58347 from idryomov/wip-66570-squid

squid: librbd: make diff-iterate in fast-diff mode aware of encryption

Reviewed-by: Ramana Raja <rraja@redhat.com>
12 months agodoc: elide superuser discussion from mount prereq 58614/head
Patrick Donnelly [Mon, 15 Jul 2024 14:18:15 +0000 (10:18 -0400)]
doc: elide superuser discussion from mount prereq

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit 7290bdce6f4dd93be88be6ad54030fa90a8c1ec0)

12 months agodoc: clarify superuser note for ceph-fuse
Patrick Donnelly [Mon, 15 Jul 2024 14:12:24 +0000 (10:12 -0400)]
doc: clarify superuser note for ceph-fuse

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit d100de9c9ce884beee6e9551b2b221c686b775b5)

12 months agoMerge pull request #57610 from vshankar/wip-65988-squid
Xiubo Li [Tue, 16 Jul 2024 01:29:49 +0000 (09:29 +0800)]
Merge pull request #57610 from vshankar/wip-65988-squid

squid: qa: ignore cluster warnings generated from forward-scrub task

12 months agoMerge pull request #57918 from batrick/wip-66386-squid
Xiubo Li [Tue, 16 Jul 2024 01:28:07 +0000 (09:28 +0800)]
Merge pull request #57918 from batrick/wip-66386-squid

squid: qa: disable mon_warn_on_pool_no_app in fs suite

12 months agoMerge pull request #57922 from batrick/wip-66385-squid
Xiubo Li [Tue, 16 Jul 2024 01:27:42 +0000 (09:27 +0800)]
Merge pull request #57922 from batrick/wip-66385-squid

squid: qa: correct json lookup for new `lock path` output

12 months agoMerge pull request #58155 from vshankar/wip-66325-squid
Xiubo Li [Tue, 16 Jul 2024 01:26:54 +0000 (09:26 +0800)]
Merge pull request #58155 from vshankar/wip-66325-squid

squid: qa: enable debug logs for fs:cephadm:multivolume subsuite

12 months agoMerge pull request #58233 from batrick/wip-66593-squid
Xiubo Li [Tue, 16 Jul 2024 01:26:21 +0000 (09:26 +0800)]
Merge pull request #58233 from batrick/wip-66593-squid

squid: tools/cephfs: recover alternate_name of dentries from journal

12 months agoMerge pull request #58237 from batrick/wip-66619-squid
Xiubo Li [Tue, 16 Jul 2024 01:25:43 +0000 (09:25 +0800)]
Merge pull request #58237 from batrick/wip-66619-squid

squid: mds: initialize epoch for quiescedb

12 months agoMerge pull request #58252 from joscollin/wip-66674-squid
Xiubo Li [Tue, 16 Jul 2024 01:23:59 +0000 (09:23 +0800)]
Merge pull request #58252 from joscollin/wip-66674-squid

squid: qa: enhance per-client labelled perf counters test

12 months agoMerge pull request #58294 from batrick/wip-66623-squid
Xiubo Li [Tue, 16 Jul 2024 01:23:30 +0000 (09:23 +0800)]
Merge pull request #58294 from batrick/wip-66623-squid

squid: mds: do remove the cap when seqs equal or larger than last issue

12 months agoMerge pull request #58317 from batrick/wip-66585-squid
Xiubo Li [Tue, 16 Jul 2024 01:22:01 +0000 (09:22 +0800)]
Merge pull request #58317 from batrick/wip-66585-squid

squid: mds: QuiesceDbManager: mark next retry event during bootstrap

12 months agoMerge pull request #58318 from batrick/wip-66572-squid
Xiubo Li [Tue, 16 Jul 2024 01:21:42 +0000 (09:21 +0800)]
Merge pull request #58318 from batrick/wip-66572-squid

squid: mds/quiesce-db: calculate_quiesce_map: aggregate quiesce roots' TTL as `max`

12 months agoMerge pull request #58319 from batrick/wip-66542-squid
Xiubo Li [Tue, 16 Jul 2024 01:19:37 +0000 (09:19 +0800)]
Merge pull request #58319 from batrick/wip-66542-squid

squid: mds: dump formatter even for errors

12 months agomgr/dashboard: Configure subsystems from dashboard 58599/head
Afreen Misbah [Sat, 22 Jun 2024 12:00:49 +0000 (17:30 +0530)]
mgr/dashboard: Configure subsystems from dashboard

Fixes https://tracker.ceph.com/issues/66659

- adds subsytems tab
- adds subsystem listing view
- adds create subsystem modal
- adds delete subsystem
- adds unit tests

Signed-off-by: Afreen Misbah <afreen23.git@gmail.com>
(cherry picked from commit b85f982def41320003ecb632e2b03a8779567fbe)

12 months agomgr/dashboard: Introduce NVMe/TCP navigation
Afreen [Fri, 31 May 2024 07:54:27 +0000 (13:24 +0530)]
mgr/dashboard: Introduce NVMe/TCP navigation

Fixes https://tracker.ceph.com/issues/66346

- adds NVMe/TCP tab under Block nav
- adds overview page for NVMe/TCP nav
- overview page lists gateways
- add default error page when no nvmeof service running
- added unit tests
- fixes service page e2e test

Signed-off-by: Afreen <afreen23.git@gmail.com>
(cherry picked from commit 442346f0efbb5d7d3af3ebdf847586bbe3f93f6d)

Conflicts:
src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/services/service-form/service-form.component.html
src/pybind/mgr/dashboard/frontend/src/app/core/navigation/navigation/navigation.component.html

12 months agolibrbd: make diff-iterate in fast-diff mode aware of encryption 58347/head
Ilya Dryomov [Thu, 20 Jun 2024 19:13:56 +0000 (21:13 +0200)]
librbd: make diff-iterate in fast-diff mode aware of encryption

diff-iterate wasn't updated when librbd was being prepared to support
encryption in commit 8d6a47933269 ("librbd: add crypto image dispatch
layer").  This is even noted in [1]:

> The two places I skipped for now are DiffIterate and TrimRequest.

CryptoImageDispatch has since been removed, but diff-iterate in
fast-diff mode is still unaware of encryption and just assumes that all
offsets are raw.  This means that the callback gets invoked with
incorrect image offsets when encryption is loaded.  For example, for
a LUKS1-formatted image with some data at offsets 0 and 20971520,
diff-iterate with encryption loaded reports

  0~4194304
  4194304~4194304
  25165824~4194304

instead of

  0~4194304
  20971520~4194304

as "exists".  For any piece of code that is using diff-iterate to
optimize block-by-block processing (e.g. copy an encrypted source image
to a differently-encrypted destination image), this is fatal: it would
skip processing block 20971520 which has data and instead process block
25165824 which doesn't have any data and was to be skipped, producing
a corrupted destination image.

[1] https://github.com/ceph/ceph/pull/37935#issue-735278403

Fixes: https://tracker.ceph.com/issues/66570
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit cdeb0efce3f9f857ad6d5b7ff3965f3292cb571a)

12 months agotest/librbd: extend DiffIterateTest.DiffIterateDeterministic{,PP}
Ilya Dryomov [Fri, 21 Jun 2024 13:56:27 +0000 (15:56 +0200)]
test/librbd: extend DiffIterateTest.DiffIterateDeterministic{,PP}

Currently we are laying data only at the beginning of an object.
Extend the skeletons to write to three different offsets in the middle
and also at the end of the object.

Separately, make C and C++ API test variants slightly different in
terms of offsets being targeted to not go through exactly the same
scenario twice.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit da69d1fdbf69cf37ba8b75ea9a230634bb25ae76)

12 months agotest/librbd: refactor DiffIterateTest.DiffIterateDeterministic{,PP}
Ilya Dryomov [Fri, 21 Jun 2024 13:53:05 +0000 (15:53 +0200)]
test/librbd: refactor DiffIterateTest.DiffIterateDeterministic{,PP}

In preparation for extending coverage, extract test logic into a couple
of parametrized helpers.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 1df87998dc30be6e3b4c90f5833539c7ccc70911)

12 months agoMerge pull request #58541 from idryomov/wip-66886-squid 57399/head
Yuri Weinstein [Mon, 15 Jul 2024 14:09:42 +0000 (07:09 -0700)]
Merge pull request #58541 from idryomov/wip-66886-squid

squid: qa: account for rbd_trash object in krbd_data_pool.sh + related ceph{,adm} task fixes

Reviewed-by: Ramana Raja <rraja@redhat.com>
12 months agoMerge pull request #58212 from idryomov/wip-66418-squid
Yuri Weinstein [Mon, 15 Jul 2024 14:08:52 +0000 (07:08 -0700)]
Merge pull request #58212 from idryomov/wip-66418-squid

squid: librbd: diff-iterate shouldn't crash on an empty byte range

Reviewed-by: Mykola Golub <mgolub@suse.com>