]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
9 months agomgmt-gateway: add e2e testing 58084/head
Teoman ONAY [Mon, 17 Jun 2024 11:16:48 +0000 (13:16 +0200)]
mgmt-gateway: add e2e testing

Add mgmt-gateway teuthology test scenarios

Signed-off-by: Teoman ONAY <tonay@ibm.com>
9 months agoMerge pull request #60173 from rhcs-dashboard/fix-lc
afreen23 [Thu, 17 Oct 2024 11:41:54 +0000 (17:11 +0530)]
Merge pull request #60173 from rhcs-dashboard/fix-lc

mgr/dashboard: fix lifecycle issues

Reviewed-by: Afreen Misbah <afreen@ibm.com>
9 months agoMerge pull request #60260 from ShwetaBhosale1/new_cephadm_command_to_list_default_images
Adam King [Thu, 17 Oct 2024 11:12:01 +0000 (07:12 -0400)]
Merge pull request #60260 from ShwetaBhosale1/new_cephadm_command_to_list_default_images

cephadm: Added cephadm command to list all the default images

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: John Mulligan <jmulligan@redhat.com>
9 months agoMerge pull request #55808 from neesingh-rh/wip-63700
Venky Shankar [Thu, 17 Oct 2024 06:31:27 +0000 (12:01 +0530)]
Merge pull request #55808 from neesingh-rh/wip-63700

cephfs-shell: fixing cephfs-shell test failures

Reviewed-by: Venky Shankar <vshankar@redhat.com>
9 months agomgr/dashboard: fix lifecycle issues 60173/head
Pedro Gonzalez Gomez [Mon, 7 Oct 2024 19:22:20 +0000 (21:22 +0200)]
mgr/dashboard: fix lifecycle issues

Fixes: https://tracker.ceph.com/issues/68434
Signed-off-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
9 months agoMerge pull request #58292 from neesingh-rh/wip-vol-method-name-change
Venky Shankar [Thu, 17 Oct 2024 05:21:16 +0000 (10:51 +0530)]
Merge pull request #58292 from neesingh-rh/wip-vol-method-name-change

mgr/vol : shortening the name of helper method

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
9 months agocephadm: Added new cephadm command to list all the default images 60260/head
Shweta Bhosale [Wed, 9 Oct 2024 09:23:30 +0000 (14:53 +0530)]
cephadm: Added new cephadm command to list all the default images

Fixes: https://tracker.ceph.com/issues/68438
Signed-off-by: Shweta Bhosale <Shweta.Bhosale1@ibm.com>
9 months agoMerge pull request #60058 from mchangir/log-save-thread-name-in-log-entries
Yuri Weinstein [Wed, 16 Oct 2024 20:42:33 +0000 (13:42 -0700)]
Merge pull request #60058 from mchangir/log-save-thread-name-in-log-entries

log: save/fetch thread name infra

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
9 months agoMerge PR #60317 into main
Patrick Donnelly [Wed, 16 Oct 2024 19:34:40 +0000 (15:34 -0400)]
Merge PR #60317 into main

* refs/pull/60317/head:
.github: detect GPL license in PRs

Reviewed-by: Patrick Donnelly <pdonnell@ibm.com>
9 months agoMerge PR #59996 into main
Patrick Donnelly [Wed, 16 Oct 2024 19:32:00 +0000 (15:32 -0400)]
Merge PR #59996 into main

* refs/pull/59996/head:
mailmap: Add dashboard new joinees in maps

Reviewed-by: Patrick Donnelly <pdonnell@ibm.com>
9 months agoMerge pull request #60053 from rkachach/fix_issue_68315
Adam King [Wed, 16 Oct 2024 18:07:30 +0000 (14:07 -0400)]
Merge pull request #60053 from rkachach/fix_issue_68315

mgr/cephadm: move Grafana's subpath handling logic to grafan config

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
9 months agoMerge pull request #59680 from adk3798/bootstrap-apply-spec-fail-continue
Adam King [Wed, 16 Oct 2024 15:49:38 +0000 (11:49 -0400)]
Merge pull request #59680 from adk3798/bootstrap-apply-spec-fail-continue

cephadm: add ability to continue on failure when applying multiple specs

Reviewed-by: John Mulligan <jmulligan@redhat.com>
9 months agoMerge pull request #60077 from adk3798/cephadm-ganesha-conf-allow-set-io-flusher...
Adam King [Wed, 16 Oct 2024 15:37:14 +0000 (11:37 -0400)]
Merge pull request #60077 from adk3798/cephadm-ganesha-conf-allow-set-io-flusher-fail

mgr/cephadm: add "allow_set_io_flusher_fail = true;" to ganesha conf

Reviewed-by: Guillaume Abrioux <gabrioux@ibm.com>
Reviewed-by: John Mulligan <jmulligan@redhat.com>
9 months agoMerge pull request #60300 from avanthakkar/add-smb-ok-to-stop
Adam King [Wed, 16 Oct 2024 15:35:27 +0000 (11:35 -0400)]
Merge pull request #60300 from avanthakkar/add-smb-ok-to-stop

mgr/cephadm: add ok_to_stop func for smb service

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Anoop C S <anoopcs@cryptolab.net>
Reviewed-by: John Mulligan <jmulligan@redhat.com>
9 months agoMerge pull request #60112 from anoopcs9/cephadm-smb-add-ctdb-loglevel
Adam King [Wed, 16 Oct 2024 15:31:54 +0000 (11:31 -0400)]
Merge pull request #60112 from anoopcs9/cephadm-smb-add-ctdb-loglevel

cephadm/smb: Add a provision to specify ctdb log level

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: John Mulligan <jmulligan@redhat.com>
9 months agoMerge pull request #60263 from afreen23/wip-api-update
afreen23 [Wed, 16 Oct 2024 15:23:05 +0000 (20:53 +0530)]
Merge pull request #60263 from afreen23/wip-api-update

mgr/dashboard: Adapt gateway group changes in nvmeof UI

Reviewed-by: Afreen Misbah <afreen@ibm.com>
9 months agoMerge pull request #60306 from cbodley/wip-osdc-rm-completion
Casey Bodley [Wed, 16 Oct 2024 14:01:07 +0000 (10:01 -0400)]
Merge pull request #60306 from cbodley/wip-osdc-rm-completion

osdc: remove unused overloads for async::Completion

Reviewed-by: Adam Emerson <aemerson@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@ibm.com>
9 months agoMerge PR #59503 into main
Venky Shankar [Wed, 16 Oct 2024 13:36:32 +0000 (19:06 +0530)]
Merge PR #59503 into main

* refs/pull/59503/head:
client: Resolve symlink from dirfd for empty pathname
client: Fix symlink open with O_PATH and O_NOFOLLOW

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
9 months agoMerge pull request #60055 from guits/tracker_68312
Guillaume Abrioux [Wed, 16 Oct 2024 07:35:49 +0000 (09:35 +0200)]
Merge pull request #60055 from guits/tracker_68312

ceph-volume: drop unnecessary call to `get_single_lv()`

9 months agoMerge pull request #60291 from rhcs-dashboard/NFS-subvol-list
Nizamudeen A [Wed, 16 Oct 2024 06:40:32 +0000 (12:10 +0530)]
Merge pull request #60291 from rhcs-dashboard/NFS-subvol-list

mgr/dashboard: The subvolumes are missing from the dropdown menu on the "Create NFS export" page

Reviewed-by: Ankush Behl <cloudbehl@gmail.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
9 months agoMerge pull request #60256 from joscollin/wip-doc-update-key-idea
Zac Dover [Wed, 16 Oct 2024 05:14:12 +0000 (15:14 +1000)]
Merge pull request #60256 from joscollin/wip-doc-update-key-idea

doc: update Key Idea in cephfs-mirroring.rst

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: Zac Dover <zac.dover@proton.me>
9 months agoMerge pull request #60222 from rhcs-dashboard/group-name-bug
afreen23 [Tue, 15 Oct 2024 18:30:17 +0000 (00:00 +0530)]
Merge pull request #60222 from rhcs-dashboard/group-name-bug

mgr/dashboard: fix group name bugs in the nvmeof API

Reviewed-by: Afreen Misbah <afreen@ibm.com>
9 months agoMerge pull request #60060 from guits/move-to-quay-io
Adam King [Tue, 15 Oct 2024 18:01:37 +0000 (14:01 -0400)]
Merge pull request #60060 from guits/move-to-quay-io

cephadm: pull container images from quay.io

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
9 months agoMerge pull request #60241 from rhcs-dashboard/sync-policy-display-zonegroup
afreen23 [Tue, 15 Oct 2024 17:08:00 +0000 (22:38 +0530)]
Merge pull request #60241 from rhcs-dashboard/sync-policy-display-zonegroup

mgr/dashboard: sync policy's in Object >> Multi-site >> Sync-policy does not show the zonegroup to which policy belongs to

Reviewed-by: Afreen Misbah <afreen@ibm.com>
9 months agomailmap: Add dashboard new joinees in maps 59996/head
Afreen Misbah [Thu, 26 Sep 2024 11:42:23 +0000 (17:12 +0530)]
mailmap: Add dashboard new joinees in maps

- Afreen Misbah
- Dnyaneshwari Talwekar
- Naman Munet
- Prachi Goel
- Puja Shahu

Signed-off-by: Afreen Misbah <afreen@ibm.com>
9 months agoMerge pull request #60125 from cbodley/wip-doc-rgw-index-filenames
Casey Bodley [Tue, 15 Oct 2024 16:50:00 +0000 (12:50 -0400)]
Merge pull request #60125 from cbodley/wip-doc-rgw-index-filenames

doc/dev/radosgw: update paths that moved under src/rgw/driver/rados/

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
9 months agoMerge pull request #60128 from cbodley/wip-doc-rgw-multisite-secondary-commit
Casey Bodley [Tue, 15 Oct 2024 16:49:45 +0000 (12:49 -0400)]
Merge pull request #60128 from cbodley/wip-doc-rgw-multisite-secondary-commit

doc/radosgw/multisite: fix Configuring Secondary Zones -> Updating the Period

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
9 months agomgr/dashboard: Adapt gateway group changes in nvmeof UI 60263/head
Afreen Misbah [Fri, 11 Oct 2024 15:28:56 +0000 (20:58 +0530)]
mgr/dashboard: Adapt gateway group changes in nvmeof UI

- Added gateway group param in namespace request - GET, POST, PATCH, DELETE
- Added gateway group param in Listeners request - GET
- Added gateway group param in Initiators - GET, POST, DELETE

Fixes https://tracker.ceph.com/issues/68510

Signed-off-by: Afreen Misbah <afreen@ibm.com>
9 months agodoc: update Key Idea in cephfs-mirroring.rst 60256/head
Jos Collin [Fri, 11 Oct 2024 05:03:47 +0000 (10:33 +0530)]
doc: update Key Idea in cephfs-mirroring.rst

Updates the snapdiff feature and it's url.

Signed-off-by: Jos Collin <jcollin@redhat.com>
9 months agoMerge pull request #59706 from Matan-B/wip-matanb-cleanup-snapmap
SrinivasaBharathKanta [Tue, 15 Oct 2024 14:19:02 +0000 (19:49 +0530)]
Merge pull request #59706 from Matan-B/wip-matanb-cleanup-snapmap

osd/PG: make use of SnapMapper::update_snap_map

9 months agoMerge pull request #59844 from spuiuk/mgr_smb_add_public_addrs_cli
Adam King [Tue, 15 Oct 2024 13:43:28 +0000 (09:43 -0400)]
Merge pull request #59844 from spuiuk/mgr_smb_add_public_addrs_cli

mgr/smb: accept public_addrs on cli when creating cluster

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: John Mulligan <jmulligan@redhat.com>
9 months agoMerge pull request #60238 from anoopcs9/cephadm-add-net-raw-ctdbd
Adam King [Tue, 15 Oct 2024 13:41:49 +0000 (09:41 -0400)]
Merge pull request #60238 from anoopcs9/cephadm-add-net-raw-ctdbd

cephadm/smb: Add NET_RAW capability to deploy ctdbd

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: John Mulligan <jmulligan@redhat.com>
9 months agoMerge pull request #60221 from rhcs-dashboard/fix-68461-main
Adam King [Tue, 15 Oct 2024 13:02:34 +0000 (09:02 -0400)]
Merge pull request #60221 from rhcs-dashboard/fix-68461-main

mgr/cephadm: Update multi-site configs before deploying  daemons on rgw service create

Reviewed-by: Adam King <adking@redhat.com>
9 months agoMerge PR #60302 into main
Patrick Donnelly [Tue, 15 Oct 2024 13:01:29 +0000 (09:01 -0400)]
Merge PR #60302 into main

* refs/pull/60302/head:
doc/governance: update my CSC email
mailmap: add my ibm email

Reviewed-by: Anthony D Atri <anthony.datri@gmail.com>
9 months ago.github: detect GPL license in PRs 60317/head
Ernesto Puerta [Tue, 15 Oct 2024 12:09:48 +0000 (14:09 +0200)]
.github: detect GPL license in PRs

Signed-off-by: Ernesto Puerta <epuertat@redhat.com>
9 months agomgr/cephadm: disabling nginx buffering for grafana location 60053/head
Redouane Kachach [Tue, 15 Oct 2024 11:34:32 +0000 (13:34 +0200)]
mgr/cephadm: disabling nginx buffering for grafana location

Disabling Nginx buffering for Grafana, as it may lead to errors or
delays while loading the main Grafana page, particularly when
receiving JavaScript files.

Fixes: https://tracker.ceph.com/issues/68315
Signed-off-by: Redouane Kachach <rkachach@ibm.com>
9 months agolog: thread name save/fetch infra 60058/head
Milind Changire [Fri, 27 Sep 2024 10:40:22 +0000 (16:10 +0530)]
log: thread name save/fetch infra

* pthread name is saved in a thread_local storage
* the thread_local name is copied into Entry object's ctor
* Log::dump_recent() reads the thread name from the Entry
  object's data member when dumping logs

Fixes: https://tracker.ceph.com/issues/50743
Signed-off-by: Milind Changire <mchangir@redhat.com>
9 months agoclient: Resolve symlink from dirfd for empty pathname 59503/head
Anoop C S [Tue, 27 Aug 2024 10:20:44 +0000 (15:50 +0530)]
client: Resolve symlink from dirfd for empty pathname

man readlinkat(2)[1] points at a special case for readlinkat() syscall
as follows:

. . .
Since Linux 2.6.39, pathname can be an empty string, in which case the
call operates on the symbolic link referred to by dirfd (which should
have been obtained using open(2) with the O_PATH and O_NOFOLLOW flags).
. . .

man open(2)[2] further explains the need for such a special case when
a symlink is opened with O_PATH and O_NOFOLLOW:

. . .
If  pathname is a symbolic link and the O_NOFOLLOW flag is also
specified, then the call returns a file descriptor referring to the
symbolic link.  This file descriptor can be used as the dirfd argument
in calls to fchownat(2), fstatat(2), linkat(2), and readlinkat(2) with
an empty pathname to have the calls operate on the symbolic link.
. . .

Accordingly have a check to resolve symlinks out of dirfd when empty
pathnames are encountered within readlinkat(). In addition to that
match the standard file system behavior to return ENOENT instead of
EINVAL when the inode pointed to by dirfd is not a symbolic link with
empty pathnames.

Fixes: https://tracker.ceph.com/issues/67833
[1] https://www.man7.org/linux/man-pages/man2/readlinkat.2.html
[2] https://www.man7.org/linux/man-pages/man2/open.2.html

Signed-off-by: Anoop C S <anoopcs@cryptolab.net>
9 months agoclient: Fix symlink open with O_PATH and O_NOFOLLOW
Anoop C S [Thu, 29 Aug 2024 06:23:44 +0000 (11:53 +0530)]
client: Fix symlink open with O_PATH and O_NOFOLLOW

man open(2)[1] says the following for O_PATH:

. . .
If  pathname is a symbolic link and the O_NOFOLLOW flag is also
specified, then the call returns a file descriptor referring to the
symbolic link.  This file descriptor can be used as the dirfd argument
in calls to fchownat(2), fstatat(2), linkat(2), and readlinkat(2) with
an empty pathname to have the calls operate on the symbolic link.
. . .

symlink check within may_open() failed to consider the O_PATH flag
resulting in a ELOOP error to the client. In order to return a valid
file descriptor we introduce a check for the presence of O_PATH in
the client provided flags.

Fixes: https://tracker.ceph.com/issues/67833
[1] https://www.man7.org/linux/man-pages/man2/open.2.html

Signed-off-by: Anoop C S <anoopcs@cryptolab.net>
9 months agoMerge pull request #60212 from VallariAg/nvmeof-labeler
Vallari Agrawal [Tue, 15 Oct 2024 07:59:41 +0000 (13:29 +0530)]
Merge pull request #60212 from VallariAg/nvmeof-labeler

labeler: add nvmeof labelers

9 months agomgr/dashboard: The subvolumes are missing from the dropdown menu on the "Create NFS... 60291/head
Dnyaneshwari [Mon, 14 Oct 2024 04:26:45 +0000 (09:56 +0530)]
mgr/dashboard: The subvolumes are missing from the dropdown menu on the "Create NFS export" page

Fixes: https://tracker.ceph.com/issues/68519
Signed-off-by: Dnyaneshwari Talwekar <dtalweka@redhat.com>
9 months agoMerge PR #60301 into main
Patrick Donnelly [Tue, 15 Oct 2024 00:21:22 +0000 (20:21 -0400)]
Merge PR #60301 into main

* refs/pull/60301/head:
doc/governance: add new CSC members

Reviewed-by: Laura Flores <lflores@redhat.com>
Reviewed-by: Anthony D Atri <anthony.datri@gmail.com>
9 months agoosdc: remove unused overloads for async::Completion 60306/head
Casey Bodley [Mon, 14 Oct 2024 20:07:38 +0000 (16:07 -0400)]
osdc: remove unused overloads for async::Completion

ea67f3dee2a3f8fcdcbb0bc0e80e38ec70378f05 switched to
asio::any_completion_handler<> for completions, but left some converting
overloads behind for compatibility. none of those overloads appear to be
used, so remove them

Signed-off-by: Casey Bodley <cbodley@redhat.com>
9 months agodoc/governance: update my CSC email 60302/head
Patrick Donnelly [Mon, 14 Oct 2024 18:57:31 +0000 (14:57 -0400)]
doc/governance: update my CSC email

Signed-off-by: Patrick Donnelly <pdonnell@ibm.com>
9 months agomailmap: add my ibm email
Patrick Donnelly [Mon, 14 Oct 2024 18:50:41 +0000 (14:50 -0400)]
mailmap: add my ibm email

Signed-off-by: Patrick Donnelly <pdonnell@ibm.com>
9 months agodoc/governance: add new CSC members 60301/head
Patrick Donnelly [Mon, 14 Oct 2024 16:14:53 +0000 (12:14 -0400)]
doc/governance: add new CSC members

Congratulations!

Election: https://vote.heliosvoting.org/helios/elections/f276a15a-84c5-11ef-a0e4-b69e035002b0/view
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
9 months agomgr/cephadm: add ok_to_stop func for smb service 60300/head
Avan Thakkar [Mon, 14 Oct 2024 14:02:11 +0000 (19:32 +0530)]
mgr/cephadm: add ok_to_stop func for smb service

Fixes: https://tracker.ceph.com/issues/68527
Signed-off-by: Avan Thakkar <athakkar@redhat.com>
9 months agoMerge pull request #60158 from aclamk/wip-aclamk-bluefs-truncate-allocations
Laura Flores [Mon, 14 Oct 2024 17:19:53 +0000 (12:19 -0500)]
Merge pull request #60158 from aclamk/wip-aclamk-bluefs-truncate-allocations

os/bluestore: Make truncate() drop unused allocations

9 months agoMerge pull request #59914 from xxhdx1985126/wip-68174
Matan Breizman [Mon, 14 Oct 2024 15:51:51 +0000 (18:51 +0300)]
Merge pull request #59914 from xxhdx1985126/wip-68174

crimson/osd/pg: remove snapmapper objects when eventually removing collections at the last moment of pg deleting, just as pg meta objects

Reviewed-by: Samuel Just <sjust@redhat.com>
9 months agoMerge pull request #60169 from lee-j-sanders/wip-ljs-rmcosbench
Lee Sanders [Mon, 14 Oct 2024 15:14:49 +0000 (16:14 +0100)]
Merge pull request #60169 from lee-j-sanders/wip-ljs-rmcosbench

qa/suites/tasks/cbt.py: Deprecating cosbench from Teuthology in preparation for deletion of cosbench from CBT

9 months agoMerge pull request #59888 from phlogistonjohn/jjm-mypy-more
Adam King [Mon, 14 Oct 2024 15:11:36 +0000 (11:11 -0400)]
Merge pull request #59888 from phlogistonjohn/jjm-mypy-more

prepare mypy checking for newer python (3.12)

Reviewed-by: Adam King <adking@redhat.com>
9 months agoMerge pull request #59942 from ronen-fr/wip-rf-store2-steps
Ronen Friedman [Mon, 14 Oct 2024 12:44:55 +0000 (15:44 +0300)]
Merge pull request #59942 from ronen-fr/wip-rf-store2-steps

osd/scrub: separate shallow vs deep errors storage

Reviewed-by: Samuel Just <sjust@redhat.com>
9 months agoMerge pull request #60242 from zdover23/wip-doc-2024-10-10-SubmittingPatches-backports
Zac Dover [Mon, 14 Oct 2024 11:24:22 +0000 (21:24 +1000)]
Merge pull request #60242 from zdover23/wip-doc-2024-10-10-SubmittingPatches-backports

doc: SubmittingPatches-backports - remove backports team

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
9 months agoMerge PR #60219 into main
Venky Shankar [Mon, 14 Oct 2024 09:51:15 +0000 (15:21 +0530)]
Merge PR #60219 into main

* refs/pull/60219/head:
qa/cephfs: update earmark values to valid ones in test_volumes.py

Reviewed-by: John Mulligan <jmulligan@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
9 months agomgr/dashboard: sync policy's in Object >> Multi-site >> Sync-policy, does not show... 60241/head
Naman Munet [Tue, 8 Oct 2024 09:24:32 +0000 (14:54 +0530)]
mgr/dashboard: sync policy's in Object >> Multi-site >> Sync-policy, does not show the zonegroup to which policy belongs to

Fixes: https://tracker.ceph.com/issues/68355
Fixes Includes: Added default zonegroup name with the sync policy details

Signed-off-by: Naman Munet <namanmunet@li-ff83bccc-26af-11b2-a85c-a4b04bfb1003.ibm.com>
9 months agoMerge pull request #60247 from leonidc/101024-fix-no-listeners
leonidc [Mon, 14 Oct 2024 08:45:27 +0000 (11:45 +0300)]
Merge pull request #60247 from leonidc/101024-fix-no-listeners

mon/nvmeofgw*: fix HA usecase when gateway has no listeners: behaves â€¦

9 months agoMerge pull request #59905 from rhcs-dashboard/osd-perf-impr
afreen23 [Mon, 14 Oct 2024 08:22:55 +0000 (13:52 +0530)]
Merge pull request #59905 from rhcs-dashboard/osd-perf-impr

mgr/dashboard: introduce server side pagination for osds

Reviewed-by: Afreen Misbah <afreen23.git@gmail.com>
9 months agoMerge pull request #60259 from afreen23/wip-listener-del
afreen23 [Mon, 14 Oct 2024 08:21:49 +0000 (13:51 +0530)]
Merge pull request #60259 from afreen23/wip-listener-del

mgr/dashboard: Fix listener deletion

Reviewed-by: Afreen Misbah <afreen23.git@gmail.com>
9 months agoMerge pull request #59572 from xxhdx1985126/wip-67874
Matan Breizman [Mon, 14 Oct 2024 07:03:30 +0000 (10:03 +0300)]
Merge pull request #59572 from xxhdx1985126/wip-67874

crimson/osd/backfill_state: add the object to be pushed in the peer missing set of PeeringState

Reviewed-by: Samuel Just <sjust@redhat.com>
9 months agoMerge pull request #59878 from xxhdx1985126/wip-68147
Matan Breizman [Mon, 14 Oct 2024 07:02:21 +0000 (10:02 +0300)]
Merge pull request #59878 from xxhdx1985126/wip-68147

crimson/osd/backfill_state: push peer pg infos' last_backfills only when all objects before them are backfilled

Reviewed-by: Matan Breizman <mbreizma@redhat.com>
9 months agoMerge pull request #60198 from ronen-fr/wip-rf-rm-recovery-2
Ronen Friedman [Sun, 13 Oct 2024 15:52:33 +0000 (18:52 +0300)]
Merge pull request #60198 from ronen-fr/wip-rf-rm-recovery-2

qa/standalone/scrub: remove TEST_recovery_scrub_2

Reviewed-by: Matan Breizman <mbreizma@redhat.com>
9 months agoMerge pull request #59916 from xxhdx1985126/wip-68175
Matan Breizman [Sun, 13 Oct 2024 13:04:27 +0000 (16:04 +0300)]
Merge pull request #59916 from xxhdx1985126/wip-68175

crimson/osd/backfill_state: do at least one time of replica scanning if necessary in the Enqueuing state

Reviewed-by: Samuel Just <sjust@redhat.com>
9 months agoMerge pull request #59776 from xxhdx1985126/wip-68061
Matan Breizman [Sun, 13 Oct 2024 13:00:13 +0000 (16:00 +0300)]
Merge pull request #59776 from xxhdx1985126/wip-68061

crimson/osd/backfill_state: always go to Enqueuing when object is pushed during Waiting

Reviewed-by: Samuel Just <sjust@redhat.com>
9 months agoMerge pull request #59853 from xxhdx1985126/wip-crimson-pg-purge-strays
Matan Breizman [Sun, 13 Oct 2024 12:54:56 +0000 (15:54 +0300)]
Merge pull request #59853 from xxhdx1985126/wip-crimson-pg-purge-strays

crimson/osd: purge strays when PGs go clean

Reviewed-by: Matan Breizman <mbreizma@redhat.com>
9 months agoMerge pull request #60255 from dmick/wip-fix-container-arch
Dan Mick [Fri, 11 Oct 2024 19:59:17 +0000 (12:59 -0700)]
Merge pull request #60255 from dmick/wip-fix-container-arch

container/build.sh: fix arm architecture tagging

9 months agoMerge pull request #60028 from rkachach/fix_issue_add_internal_mtls_check
Adam King [Fri, 11 Oct 2024 12:56:57 +0000 (08:56 -0400)]
Merge pull request #60028 from rkachach/fix_issue_add_internal_mtls_check

mgr/cephadm: adding config to enforce clients cert check for internal nginx (mTLS)

Reviewed-by: Adam King <adking@redhat.com>
9 months agomgr/dashboard: Fix listener deletion 60259/head
Afreen Misbah [Fri, 11 Oct 2024 08:57:24 +0000 (14:27 +0530)]
mgr/dashboard: Fix listener deletion

Listener deletion is broken due to passing wrong gateway address.
Including `traddr` in DELETE API of listener to choose correct gateway address for deletion.

The same fix we did for POST API here: https://github.com/afreen23/ceph/commit/287ff3b3603291763b3cd08f9b1543fe60d5f3b9

Fixes: https://tracker.ceph.com/issues/68506
Signed-off-by: Afreen Misbah <afreen23.git@gmail.com>
9 months agomgr/dashboard: fix group name bugs in the nvmeof API 60222/head
Nizamudeen A [Wed, 9 Oct 2024 14:45:55 +0000 (20:15 +0530)]
mgr/dashboard: fix group name bugs in the nvmeof API

there are 2 issues

1. in cephadm, i was always using the first daemon to populate the group
   in all the services for the dashboard config.

2. in the API, if there are more than 1 gateways listed in the config,
   rather than chosing a random gateway from the group, raise an
   exception and warn user to specify the gw_group parameter in the api
   request

Fixes: https://tracker.ceph.com/issues/68463
Signed-off-by: Nizamudeen A <nia@redhat.com>
9 months agomgr/dashboard: introduce server side pagination for osds 59905/head
Nizamudeen A [Fri, 20 Sep 2024 15:05:38 +0000 (20:35 +0530)]
mgr/dashboard: introduce server side pagination for osds

Fixes: https://tracker.ceph.com/issues/56511
Signed-off-by: Nizamudeen A <nia@redhat.com>
9 months agomgr/cephadm: RGW service deployment defaults to 'default' realm/zonegroup/zone despit... 60221/head
Aashish Sharma [Wed, 9 Oct 2024 14:02:49 +0000 (19:32 +0530)]
mgr/cephadm: RGW service deployment defaults to 'default' realm/zonegroup/zone despite non-default spec in service

When we create an RGW service using the ceph orch apply command, the service is always deployed in the default realm, zonegroup, and zone, even if we specify a different realm, zonegroup, or zone in the service spec. This happens because certain configuration values, like rgw_realm, rgw_zonegroup, and rgw_zone, need to be set for the RGW instances before the daemons are deployed. Currently, these configurations are being applied after the RGW daemons are deployed, which requires a service restart to reflect the correct realm, zonegroup, and zone. Ideally, these configurations should be applied before the RGW daemons are deployed, so they are correctly placed in the desired realm, zonegroup, and zone from the start.

Fixes: https://tracker.ceph.com/issues/68461
Signed-off-by: Aashish Sharma <aasharma@redhat.com>
9 months agoMerge pull request #59720 from myoungwon/wip-fix-overlapped-write
Yingxin [Fri, 11 Oct 2024 03:38:05 +0000 (11:38 +0800)]
Merge pull request #59720 from myoungwon/wip-fix-overlapped-write

crimson/os/seastore: fix data inconsistency during ool writes

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
9 months agocontainer/build.sh: fix arm architecture tagging 60255/head
Dan Mick [Thu, 10 Oct 2024 23:38:58 +0000 (16:38 -0700)]
container/build.sh: fix arm architecture tagging

The wrong string was used for comparison, and for tagging,
so the arm64 branch and sha1 images overwrote and destroyed
the amd64 images.

Signed-off-by: Dan Mick <dmick@redhat.com>
9 months agomgr/cephadm: adding more UT for mgmt-gateway service
Redouane Kachach [Tue, 1 Oct 2024 08:39:37 +0000 (10:39 +0200)]
mgr/cephadm: adding more UT for mgmt-gateway service

Signed-off-by: Redouane Kachach <rkachach@ibm.com>
9 months agoMerge pull request #60147 from rhcs-dashboard/sync-policy-pipe-edit-fixes
afreen23 [Thu, 10 Oct 2024 20:30:24 +0000 (02:00 +0530)]
Merge pull request #60147 from rhcs-dashboard/sync-policy-pipe-edit-fixes

mgr/dashboard: unable to edit pipe config for bucket level policy of bucket

Reviewed-by: Afreen Misbah <afreen23.git@gmail.com>
9 months agoMerge pull request #59045 from pereman2/ignore-pg-degrade-upgrade
Laura Flores [Thu, 10 Oct 2024 19:08:23 +0000 (14:08 -0500)]
Merge pull request #59045 from pereman2/ignore-pg-degrade-upgrade

qa/rados/upgrade: ignore PG_DEGRADED

9 months agoMerge pull request #60206 from VallariAg/wip-nvmeof-fix-test
Vallari Agrawal [Thu, 10 Oct 2024 18:14:31 +0000 (23:44 +0530)]
Merge pull request #60206 from VallariAg/wip-nvmeof-fix-test

qa/suites/nvmeof: Fix broken suite by using --no-group-append tag

9 months agoqa/standalone/scrub: remove TEST_recovery_scrub_2 60198/head
Ronen Friedman [Tue, 8 Oct 2024 13:25:56 +0000 (08:25 -0500)]
qa/standalone/scrub: remove TEST_recovery_scrub_2

That test does no longer match the actual requirements and
implementation of scrubbing.
It was already deactivated in
https://github.com/ceph/ceph/pull/59590. Here - it is
fully removed, mainly for the sake of backporting.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
9 months agoMerge pull request #60243 from zdover23/wip-doc-2024-10-10-dev-dev-guide-essentials...
Anthony D'Atri [Thu, 10 Oct 2024 16:30:12 +0000 (12:30 -0400)]
Merge pull request #60243 from zdover23/wip-doc-2024-10-10-dev-dev-guide-essentials-backporting

doc/dev: remove "Stable Releases and Backports"

9 months agoosd/scrub: modify ScrubStore contents retrieval 59942/head
Ronen Friedman [Sat, 5 Oct 2024 12:33:49 +0000 (07:33 -0500)]
osd/scrub: modify ScrubStore contents retrieval

A separate commit added a simple test to verify the new
store implementation (creating both shallow & deep errors),
scrubbing (step 1), deep scrubbing (step 2), then shallow
scrubbing again (step 3). The test verifies that
the results after step 2 include all shallow errors data (*),
and that the results after step 3 include all deep errors
data.

The test highlighted the need to correctly partition and
retrieve the "shards inconsistencies" and the "selected
shard" data, which was not fully implemented in the
previous commit. Thus, this commit adds the following:

- add_object_error() no longer filters out data saved during
  deep scrubbing; it also filters less of the shallow scrubs
  "shards inconsistencies" data;

- merge_encoded_error_wrappers() now merges the "shards
  inconsistencies" data correctly, handling the multiple
  scenarios possible.

(*) note the special case of not being able to read the
   object's version during deep scrubbing (due to a read
   error). In this case - the data collected during the
   shallow scrub will not be reported.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
9 months agoqa/standalone/scrub: test new ScrubStore implementation
Ronen Friedman [Mon, 7 Oct 2024 06:49:18 +0000 (01:49 -0500)]
qa/standalone/scrub: test new ScrubStore implementation

The ScrubStore is now comprised of two separate data
structures, one for shallow errors and one for deep.

A new test is added to verify the main objective of that
design change: shallow scrubs should not overwrite deep
scrub data.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
9 months agoosd/scrub: separate shallow vs deep errors storage
Ronen Friedman [Tue, 24 Sep 2024 04:09:51 +0000 (23:09 -0500)]
osd/scrub: separate shallow vs deep errors storage

The ScrubStore now holds two ScrubStore::at_level_t objects,
one for the shallow errors and one for the deep errors.

The shallow errors DB is recreated at the start of every scrub,
while the deep errors DB is only recreated at the start of a
deep scrub.

When queried by the operator for known scrub errors, the
ScrubStore will return the union of the errors from both
DBs.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
9 months agocommon/scrub,osd/scrub: minor cleanups to ScrubStore
Ronen Friedman [Mon, 23 Sep 2024 13:51:22 +0000 (08:51 -0500)]
common/scrub,osd/scrub: minor cleanups to ScrubStore

Including:
- introducing 'no out param' encode() for the inconsistent wrappers;
- renaming the ambiguous 'empty()' to 'is_empty()';
- removing unused code;
- a few other minor cleanups.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
9 months agocommon: extend MapCacher API
Ronen Friedman [Mon, 23 Sep 2024 10:25:05 +0000 (05:25 -0500)]
common: extend MapCacher API

to include 'no out' version of get_next()

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
9 months agoosd/scrub: add dout() capability to the ScrubStore
Ronen Friedman [Mon, 23 Sep 2024 10:15:57 +0000 (05:15 -0500)]
osd/scrub: add dout() capability to the ScrubStore

now that the ScrubSTore object is directly created by the
scrubber, (and has a lifetime that does not extend beyond
the scrubber object), we can add the same dout()
mechanism used by the other scrubber sub-objects.

Note: that mechanism will be changed shortly, so that the
sub-objects would use one prefix() creator supplied by
the Scrubber object.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
9 months agoosd/scrub: directly create or reinit the ScrubStore
Ronen Friedman [Mon, 23 Sep 2024 08:58:59 +0000 (03:58 -0500)]
osd/scrub: directly create or reinit the ScrubStore

The ScrubStore is now directly created or reinitialized by the
Scrubber. Note that the store object is not identical to the
errors DB: the errors DB is an entity in the OSD store (a
collection of OMap entries in a uniquely-named object(s)),
while the ScrubSTore object is a cacher and accessor for
that entity. That one can be recreated or disposed of at
will.

We now do not recreate the ScrubStore object for every scrub.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
9 months agoosd/scrub: introduce ScrubStore::at_level_t
Ronen Friedman [Mon, 23 Sep 2024 06:59:30 +0000 (01:59 -0500)]
osd/scrub: introduce ScrubStore::at_level_t

to hold the caching and backend details related to the representation
of scrub-detected errors as OMap entries of a uniquely-named object.

In a followup commit - the ScrubStore is modified to hold two of
these objects, one for the shallow errors and one for the deep errors.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
9 months agomgr/cephadm: move Grafana's subpath handling logic to grafana config
Redouane Kachach [Tue, 1 Oct 2024 08:38:39 +0000 (10:38 +0200)]
mgr/cephadm: move Grafana's subpath handling logic to grafana config

Fixes: https://tracker.ceph.com/issues/68315
So far, Grafana's subpath handling has been managed on the Nginx
server side using a rewrite rule. Let's move this logic to the Grafana
side to make it consistent with the rest of the monitoring services.

Signed-off-by: Redouane Kachach <rkachach@ibm.com>
9 months agomon/nvmeofgw*: fix HA usecase when gateway has no listeners: behaves like no-subsystems 60247/head
Leonid Chernin [Wed, 9 Oct 2024 06:59:09 +0000 (06:59 +0000)]
mon/nvmeofgw*: fix HA usecase when gateway has no listeners: behaves like no-subsystems

Signed-off-by: Leonid Chernin <leonidc@il.ibm.com>
9 months agoMerge PR #60011 into main
Patrick Donnelly [Thu, 10 Oct 2024 12:32:09 +0000 (08:32 -0400)]
Merge PR #60011 into main

* refs/pull/60011/head:
qa: do not fail cephfs QA tests for slow bluestore ops

Reviewed-by: Kotresh Hiremath Ravishankar <khiremat@redhat.com>
9 months agomgr/dashboard: unable to edit pipe config for bucket level policy of a bucket 60147/head
Naman Munet [Mon, 7 Oct 2024 05:11:29 +0000 (10:41 +0530)]
mgr/dashboard: unable to edit pipe config for bucket level policy of a bucket

Fixes: https://tracker.ceph.com/issues/68387
Fixes Includes:
1) Passing additional parameter for 'user' and 'mode' as the user can be either system/dashboard or other values while creating pipe.
2) Previously while removing the src/dest bucket field, we were getting same old values on editing pipe, but now it will become '*' if empty value passed from frontend.

Signed-off-by: Naman Munet <namanmunet@li-ff83bccc-26af-11b2-a85c-a4b04bfb1003.ibm.com>
9 months agodoc/dev: remove "Stable Releases and Backports" 60243/head
Zac Dover [Thu, 10 Oct 2024 12:17:12 +0000 (22:17 +1000)]
doc/dev: remove "Stable Releases and Backports"

Remove mention of "Stable Releases and Backports" from
doc/dev/developer_guide/essentials.rst.

Co-authored-by: Laura Flores <lflores@ibm.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
9 months agoMerge pull request #59987 from kotreshhr/licephfs-aio-nfsganesha
Venky Shankar [Thu, 10 Oct 2024 12:11:49 +0000 (17:41 +0530)]
Merge pull request #59987 from kotreshhr/licephfs-aio-nfsganesha

client: Fix libcephfs aio metadata corruption.

Reviewed-by: Venky Shankar <vshankar@redhat.com>
9 months agodoc: SubmittingPatches-backports - remove backports team 60242/head
Zac Dover [Thu, 10 Oct 2024 12:11:22 +0000 (22:11 +1000)]
doc: SubmittingPatches-backports - remove backports team

Remove all references to the "Stable Releases and Backports Team", which
as of October 2024 does not exist.

Fixes: https://tracker.ceph.com/issues/68471
Co-authored-by: Laura Flores <lflores@ibm.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
9 months agoMerge pull request #60161 from NitzanMordhai/wip-nitzan-crimson-perf-suites-adding...
Matan Breizman [Thu, 10 Oct 2024 10:46:05 +0000 (13:46 +0300)]
Merge pull request #60161 from NitzanMordhai/wip-nitzan-crimson-perf-suites-adding-ssh-auth

qa/suites/crimson-rados/perf: add ssh keys

Reviewed-by: Matan Breizman <mbreizma@redhat.com>
9 months agoAdd cosbench deprecation warning to qa/README 60169/head
Lee Sanders [Thu, 10 Oct 2024 10:21:46 +0000 (11:21 +0100)]
Add cosbench deprecation warning to qa/README

Signed-off-by: Lee Sanders <ljsanders@uk.ibm.com>
9 months agoqa/suites/tasks/cbt.py: Deprecating cosbench from Teuthology in preparation for delet...
Lee Sanders [Fri, 4 Oct 2024 14:13:57 +0000 (15:13 +0100)]
qa/suites/tasks/cbt.py: Deprecating cosbench from Teuthology in preparation for deletion of cosbench support
from CBT. The code being deleting is infrastructure code, no qa test suite uses this function. Therefore it can
be safely deleted.

Signed-off-by: Lee Sanders <ljsanders@uk.ibm.com>
9 months agoqa/workunits/nvmeof/setup_subsystem.sh: use --no-group-append 60206/head
Vallari Agrawal [Wed, 9 Oct 2024 07:27:32 +0000 (12:57 +0530)]
qa/workunits/nvmeof/setup_subsystem.sh: use --no-group-append

In newer version of nvmeof cli, "subsystem add" needs
this tag to ensure subsystem name is value of --subsystem.
Otherwise, in newer cli version, the gateway group is appended
at the end of the subsystem name.

This fixes the teuthology nvmeof suite (currently all jobs fails
because of this).

Signed-off-by: Vallari Agrawal <val.agl002@gmail.com>
9 months agoqa/suites/nvmeof: use "latest" image of gateway and cli
Vallari Agrawal [Tue, 1 Oct 2024 11:06:21 +0000 (16:36 +0530)]
qa/suites/nvmeof: use "latest" image of gateway and cli

Change nvmeof gateway and cli image from 1.2 to "latest".

Signed-off-by: Vallari Agrawal <val.agl002@gmail.com>
9 months agocephadm/smb: Add NET_RAW capability to deploy ctdbd 60238/head
Anoop C S [Thu, 10 Oct 2024 05:30:03 +0000 (11:00 +0530)]
cephadm/smb: Add NET_RAW capability to deploy ctdbd

CTDB heavily depends on raw sockets to send gratuitous ARPs[1](see the
second point from the list of reasons to use gratuitous ARPs). As per
the current design it is also inevitable while sending tickle ACKs[2]
in the event of an IP failover. man capabilities(7)[3] further mandates
CAP_NET_RAW to use raw sockets. Therefore append NET_RAW to the list of
capabilties while deploying ctdbd containers.

[1] https://wiki.wireshark.org/Gratuitous_ARP
[2] https://ctdb.samba.org/manpages/ctdb.1.html
[3] https://www.man7.org/linux/man-pages/man7/capabilities.7.html

Signed-off-by: Anoop C S <anoopcs@cryptolab.net>
9 months agoMerge pull request #59692 from cyx1231st/wip-seastore-improve-log
Matan Breizman [Thu, 10 Oct 2024 08:34:22 +0000 (11:34 +0300)]
Merge pull request #59692 from cyx1231st/wip-seastore-improve-log

crimson/os/seastore: refine seastore and transaction_manager logs, cleanups

Reviewed-by: Matan Breizman <mbreizma@redhat.com>