]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
22 months agomgr/dashboard: cleanup rbd-mirror process in dashboard e2e 53211/head
Nizamudeen A [Tue, 29 Aug 2023 19:48:03 +0000 (01:18 +0530)]
mgr/dashboard: cleanup rbd-mirror process in dashboard e2e

Fixes: https://tracker.ceph.com/issues/61703
Signed-off-by: Nizamudeen A <nia@redhat.com>
22 months agoMerge PR #53144 into main
Patrick Donnelly [Mon, 28 Aug 2023 14:27:55 +0000 (10:27 -0400)]
Merge PR #53144 into main

* refs/pull/53144/head:
doc: reformat so note is not part of code

Reviewed-by: Anthony D Atri <anthony.datri@gmail.com>
22 months agoMerge PR #50502 into main
Patrick Donnelly [Mon, 28 Aug 2023 13:28:14 +0000 (09:28 -0400)]
Merge PR #50502 into main

* refs/pull/50502/head:
mon/OSDMonitor: do not propose on error in prepare_update

Reviewed-by: Laura Flores <lflores@redhat.com>
22 months agoMerge PR #52292 into main
Patrick Donnelly [Mon, 28 Aug 2023 13:26:17 +0000 (09:26 -0400)]
Merge PR #52292 into main

* refs/pull/52292/head:
mgr: register OSDs in ms_handle_accept
msg: indicate ms_handle_authentication is fast

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
22 months agoMerge pull request #51979 from rhcs-dashboard/angular-14
Nizamudeen A [Mon, 28 Aug 2023 13:21:39 +0000 (18:51 +0530)]
Merge pull request #51979 from rhcs-dashboard/angular-14

mgr/dashboard: update to angular 14

Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
22 months agoMerge pull request #53096 from zdover23/wip-doc-2023-08-24-start-os-recommendations...
zdover23 [Mon, 28 Aug 2023 12:27:58 +0000 (22:27 +1000)]
Merge pull request #53096 from zdover23/wip-doc-2023-08-24-start-os-recommendations-platforms

doc/start: edit os-recommendations.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
22 months agoMerge pull request #48052 from rzarzynski/wip-crimson-qa-backfill
Matan Breizman [Mon, 28 Aug 2023 12:12:00 +0000 (15:12 +0300)]
Merge pull request #48052 from rzarzynski/wip-crimson-qa-backfill

qa/suites/crimson-rados: bring backfill testing

Reviewed-by: Samuel Just <sjust@redhat.com>
22 months agodoc/start: edit os-recommendations.rst 53096/head
Zac Dover [Wed, 23 Aug 2023 15:15:54 +0000 (01:15 +1000)]
doc/start: edit os-recommendations.rst

Improve the grammar in one sentence of the "Platforms" section of
doc/start/os-recommendations.rst. Improving that grammar involved
splitting the sentence into two sentences, but that's life. Update:
Anthony substantially rewrote this, so credit for this should rightly
go to him.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
22 months agoMerge PR #52921 into main
Venky Shankar [Mon, 28 Aug 2023 06:22:42 +0000 (11:52 +0530)]
Merge PR #52921 into main

* refs/pull/52921/head:
pybind/mgr/volumes: log mutex locks to help debug deadlocks

Reviewed-by: Venky Shankar <vshankar@redhat.com>
22 months agoMerge PR #52940 into main
Venky Shankar [Mon, 28 Aug 2023 06:21:11 +0000 (11:51 +0530)]
Merge PR #52940 into main

* refs/pull/52940/head:
qa: Wait for purge to complete in test_volume_info_pending_subvol_deletions

Reviewed-by: Jos Collin <jcollin@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
22 months agoMerge pull request #52005 from rhcs-dashboard/entries
Nizamudeen A [Mon, 28 Aug 2023 04:41:36 +0000 (10:11 +0530)]
Merge pull request #52005 from rhcs-dashboard/entries

mgr/dashboard: n/a entries behind primary snapshot mode

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
22 months agoMerge pull request #53015 from ceph/dependabot-npm_and_yarn-src-pybind-mgr-dashboard...
Nizamudeen A [Mon, 28 Aug 2023 04:40:17 +0000 (10:10 +0530)]
Merge pull request #53015 from ceph/dependabot-npm_and_yarn-src-pybind-mgr-dashboard-frontend-protobufjs-6.11.4

mgr/dashboard: bump protobufjs from 6.11.3 to 6.11.4 in /src/pybind/mgr/dashboard/frontend

Reviewed-by: Nizamudeen A <nia@redhat.com>
22 months agoMerge pull request #53066 from rhcs-dashboard/fix-protect-option-rbd
Nizamudeen A [Mon, 28 Aug 2023 04:39:41 +0000 (10:09 +0530)]
Merge pull request #53066 from rhcs-dashboard/fix-protect-option-rbd

mgr/dashboard: disable protect if layering is not enabled on the image

Reviewed-by: Ankush Behl <cloudbehl@gmail.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
22 months agoMerge pull request #53082 from Matan-B/wip-matanb-crimson-asock-cleanup
Matan Breizman [Sun, 27 Aug 2023 13:11:30 +0000 (16:11 +0300)]
Merge pull request #53082 from Matan-B/wip-matanb-crimson-asock-cleanup

crimson/admin/admin_socket: remove path file if it exists

Reviewed-by: Radosław Zarzyński <rzarzyns@redhat.com>
22 months agocrimson/admin/admin_socket: remove path file if it exists 53082/head
Matan Breizman [Wed, 23 Aug 2023 08:10:32 +0000 (08:10 +0000)]
crimson/admin/admin_socket: remove path file if it exists

Signed-off-by: Matan Breizman <mbreizma@redhat.com>
22 months agoqa: bring backfill testing to crimson-rados 48052/head
Radoslaw Zarzynski [Fri, 9 Sep 2022 14:36:19 +0000 (14:36 +0000)]
qa: bring backfill testing to crimson-rados

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
22 months agoMerge pull request #53031 from xxhdx1985126/wip-crimson-backfill-state
Matan Breizman [Sun, 27 Aug 2023 08:12:14 +0000 (11:12 +0300)]
Merge pull request #53031 from xxhdx1985126/wip-crimson-backfill-state

crimson/osd/pg: check if backfill_state exists when judging objects'

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Matan Breizman <mbreizma@redhat.com>
22 months agoMerge pull request #53163 from zdover23/wip-doc-2023-08-27-cephadm-services-mgr
zdover23 [Sat, 26 Aug 2023 20:55:50 +0000 (06:55 +1000)]
Merge pull request #53163 from zdover23/wip-doc-2023-08-27-cephadm-services-mgr

doc/cephadm: edit sentence in mgr.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
22 months agodoc/cephadm: edit sentence in mgr.rst 53163/head
Zac Dover [Sat, 26 Aug 2023 20:31:12 +0000 (06:31 +1000)]
doc/cephadm: edit sentence in mgr.rst

Improve the grammar in the first sentence of
doc/cephadm/services/mgr.rst. This is a small change, but I could not
resist.

Signed-off-by: Zac Dover <zac.dover@proton.me>
22 months agoMerge pull request #52663 from ronen-fr/wip-rf-map-update
Ronen Friedman [Sat, 26 Aug 2023 13:26:10 +0000 (16:26 +0300)]
Merge pull request #52663 from ronen-fr/wip-rf-map-update

osd/scrub: reduce calls to on_scrub_schedule_input_change()

Reviewed-by: Samuel Just <sjust@redhat.com>
22 months agoMerge pull request #53161 from Svelar/doc_cephadm
zdover23 [Sat, 26 Aug 2023 07:00:29 +0000 (17:00 +1000)]
Merge pull request #53161 from Svelar/doc_cephadm

doc/cephadm: update cephadm reef version

Reviewed-by: Zac Dover <zac.dover@proton.me>
22 months agodoc/cephadm: update cephadm reef version 53161/head
Rongqi Sun [Sat, 26 Aug 2023 06:50:00 +0000 (14:50 +0800)]
doc/cephadm: update cephadm reef version

Signed-off-by: Rongqi Sun <sunrongqi@huawei.com>
22 months agoMerge pull request #52532 from guits/fix-tracker-58946
Laura Flores [Fri, 25 Aug 2023 18:16:32 +0000 (13:16 -0500)]
Merge pull request #52532 from guits/fix-tracker-58946

python-common: drive_selection: fix KeyError when osdspec_affinity is not set

22 months agoMerge pull request #53141 from rhcs-dashboard/fix-host-e2e
Laura Flores [Fri, 25 Aug 2023 14:30:23 +0000 (09:30 -0500)]
Merge pull request #53141 from rhcs-dashboard/fix-host-e2e

mgr/dashboard: remove unnecessary failing hosts e2e

22 months agoMerge PR #52944 into main
Venky Shankar [Fri, 25 Aug 2023 13:16:19 +0000 (18:46 +0530)]
Merge PR #52944 into main

* refs/pull/52944/head:
PendingReleaseNotes: add a note for `mds_session_metadata_threshold` mds config
test: add test to verify that a buggy client is blocklisted
mds: add perf counter to track number of sessions evicted due to metadata threshold being exceeded
mds: blocklist clients with "bloated" session metadata

Reviewed-by: Robin H. Johnson <robbat2@orbis-terrarum.net>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
22 months agoMerge pull request #53131 from rhcs-dashboard/subvolume-e2e-test
Pedro Gonzalez Gomez [Fri, 25 Aug 2023 11:47:29 +0000 (13:47 +0200)]
Merge pull request #53131 from rhcs-dashboard/subvolume-e2e-test

mgr/dashboard: cephfs subvolume management e2e tests

Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
22 months agomgr/dashboard: n/a entries behind primary snapshot mode 52005/head
Pere Diaz Bou [Mon, 12 Jun 2023 09:16:33 +0000 (11:16 +0200)]
mgr/dashboard: n/a entries behind primary snapshot mode

Fixes: https://tracker.ceph.com/issues/62576
Signed-off-by: Pere Diaz Bou <pere-altea@hotmail.com>
22 months agomgr/dashboard: adapt jest unit tests to angular 14 51979/head
Nizamudeen A [Fri, 9 Jun 2023 14:06:41 +0000 (19:36 +0530)]
mgr/dashboard: adapt jest unit tests to angular 14

Important change would be the introduction of `TypedFormControl` which
is now more stricter in typing the FormControl and FormGroups as well.
Right now the dashboard has many number of untypedforms which by default
is migrated to an `UntypedFormControl` class when I ran the angular
upgrade script

Fixes: https://tracker.ceph.com/issues/61641
Signed-off-by: Nizamudeen A <nia@redhat.com>
22 months agoMerge pull request #52723 from lxbsz/wip-62245
Milind Changire [Fri, 25 Aug 2023 05:16:35 +0000 (10:46 +0530)]
Merge pull request #52723 from lxbsz/wip-62245

libcephfs/deleg: Wait for the delegation to be timedout

Teuthology run: http://pulpito.front.sepia.ceph.com/mchangir-2023-08-09_06:59:15-fs-wip-mchangir-testing-20230808.041738-testing-default-smithi/

Reviewed-by: Milind Changire <mchangir@redhat.com>
22 months agoMerge pull request #53074 from cbodley/wip-62504
Ali Maredia [Thu, 24 Aug 2023 20:43:03 +0000 (16:43 -0400)]
Merge pull request #53074 from cbodley/wip-62504

qa/rgw: add new POOL_APP_NOT_ENABLED failures to log-ignorelist

Reviewed-by: Ali Maredia <amaredia@redhat.com>
22 months agoMerge pull request #53125 from batrick/volume-spec
zdover23 [Thu, 24 Aug 2023 20:29:44 +0000 (06:29 +1000)]
Merge pull request #53125 from batrick/volume-spec

doc: expand and consolidate mds placement

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
22 months agodoc: reformat so note is not part of code 53144/head
Patrick Donnelly [Thu, 24 Aug 2023 18:03:34 +0000 (14:03 -0400)]
doc: reformat so note is not part of code

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
22 months agomgr/dashboard: remove unnecessary failing hosts e2e 53141/head
Pedro Gonzalez Gomez [Thu, 24 Aug 2023 14:48:37 +0000 (16:48 +0200)]
mgr/dashboard: remove unnecessary failing hosts e2e

These host e2e test were failing, since we are already checking this on the Dashboard Cephadm e2e tests we can get rid of these ones.

Fixes: https://tracker.ceph.com/issues/62491
Signed-off-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
22 months agoqa/rgw: add new POOL_APP_NOT_ENABLED failures to log-ignorelist 53074/head
Casey Bodley [Mon, 21 Aug 2023 19:43:04 +0000 (15:43 -0400)]
qa/rgw: add new POOL_APP_NOT_ENABLED failures to log-ignorelist

Fixes: https://tracker.ceph.com/issues/62504
Signed-off-by: Casey Bodley <cbodley@redhat.com>
22 months agoMerge pull request #53039 from AliMasarweh/wip-alimasa-persistant-q-enhance-fix
Ali Masarwa [Thu, 24 Aug 2023 15:39:45 +0000 (18:39 +0300)]
Merge pull request #53039 from AliMasarweh/wip-alimasa-persistant-q-enhance-fix

RGW | Bucket Notification: Fix the issue of miscounting the entries to remove

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
22 months agomgr/dashboard: cephfs subvolume management e2e tests 53131/head
Nizamudeen A [Fri, 18 Aug 2023 08:17:31 +0000 (13:47 +0530)]
mgr/dashboard: cephfs subvolume management e2e tests

includes subvolume and subvolume groups e2es

Also taking care of renaming of Volume to File Systems in the remaining
actions like Edit and Remove

Fixes: https://tracker.ceph.com/issues/62564
Signed-off-by: Nizamudeen A <nia@redhat.com>
22 months agoMerge pull request #53091 from rhcs-dashboard/fix-62453-main
Pedro Gonzalez Gomez [Thu, 24 Aug 2023 14:33:03 +0000 (16:33 +0200)]
Merge pull request #53091 from rhcs-dashboard/fix-62453-main

mgr/dashboard: Create realm sets to default

Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
Reviewed-by: Ankush Behl <cloudbehl@gmail.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
22 months agodoc: expand and consolidate mds placement 53125/head
Patrick Donnelly [Thu, 24 Aug 2023 00:36:12 +0000 (20:36 -0400)]
doc: expand and consolidate mds placement

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
22 months agoMerge PR #52575 into main
Venky Shankar [Thu, 24 Aug 2023 12:06:53 +0000 (17:36 +0530)]
Merge PR #52575 into main

* refs/pull/52575/head:
ceph_fs.h: add separate owner_{u,g}id fields

Reviewed-by: Xiubo Li <xiubli@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
22 months agoMerge PR #52676 into main
Venky Shankar [Thu, 24 Aug 2023 12:05:04 +0000 (17:35 +0530)]
Merge PR #52676 into main

* refs/pull/52676/head:
mds/Server: mark a cap acquisition throttle event in the request

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Kotresh Hiremath Ravishankar <khiremat@redhat.com>
Reviewed-by: Xiubo Li <xiubli@redhat.com>
22 months agomgr/dashboard: disable protect if layering is not enabled on the image 53066/head
avanthakkar [Mon, 21 Aug 2023 13:34:53 +0000 (19:04 +0530)]
mgr/dashboard: disable protect if layering is not enabled on the image

Fixes: https://tracker.ceph.com/issues/62498
Signed-off-by: avanthakkar <avanjohn@gmail.com>
22 months agomgr/dashboard: cleanup behave logics
Nizamudeen A [Fri, 18 Aug 2023 08:16:02 +0000 (13:46 +0530)]
mgr/dashboard: cleanup behave logics

Fixes: https://tracker.ceph.com/issues/62564
Signed-off-by: Nizamudeen A <nia@redhat.com>
22 months agoMerge pull request #52829 from rhcs-dashboard/cephfs-e2e-test
Nizamudeen A [Thu, 24 Aug 2023 09:47:38 +0000 (15:17 +0530)]
Merge pull request #52829 from rhcs-dashboard/cephfs-e2e-test

mgr/dashboard: add e2e tests for cephfs management

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
22 months agomgr/dashboard: Create realm sets to default 53091/head
Aashish Sharma [Wed, 23 Aug 2023 09:59:44 +0000 (15:29 +0530)]
mgr/dashboard: Create realm sets to default

In Multisite page, When we create a realm the realm sets to default even if some other realm is already default and default checkbox in unchecked as well while creating.

Fixes: https://tracker.ceph.com/issues/62453
Signed-off-by: Aashish Sharma <aasharma@redhat.com>
22 months agoMerge pull request #52895 from cloudbehl/minor-improvements
Nizamudeen A [Thu, 24 Aug 2023 08:29:04 +0000 (13:59 +0530)]
Merge pull request #52895 from cloudbehl/minor-improvements

mgr/dashboard: Added some minor usability improvements

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
22 months agoMerge pull request #52896 from cyx1231st/wip-seastar-multi-core-msgr-UT
Yingxin [Thu, 24 Aug 2023 07:37:59 +0000 (15:37 +0800)]
Merge pull request #52896 from cyx1231st/wip-seastar-multi-core-msgr-UT

crimson/net: consolidate messenger implementations and enable multi-shard UTs

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Matan Breizman <mbreizma@redhat.com>
22 months agoMerge pull request #53083 from Matan-B/wip-matanb-crimson-centos9-supp
Matan Breizman [Thu, 24 Aug 2023 07:05:19 +0000 (10:05 +0300)]
Merge pull request #53083 from Matan-B/wip-matanb-crimson-centos9-supp

crimson/osd/lsan_suppressions: add MallocExtension::Register

Reviewed-by: Radosław Zarzyński <rzarzyns@redhat.com>
22 months agoMerge pull request #53117 from batrick/doc-name-fix
zdover23 [Thu, 24 Aug 2023 05:13:23 +0000 (15:13 +1000)]
Merge pull request #53117 from batrick/doc-name-fix

doc: correct option name

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
22 months agoMerge pull request #53104 from ceph/revert-49428-maintain_prefix_itr
Radoslaw Zarzynski [Wed, 23 Aug 2023 22:36:46 +0000 (00:36 +0200)]
Merge pull request #53104 from ceph/revert-49428-maintain_prefix_itr

Revert "osd/SnapMapper: Maintain the prefix_itr between calls to avoid search…"

Reviewed-by: Gabriel BenHanokh <gbenhano@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
22 months agodoc: correct option name 53117/head
Patrick Donnelly [Wed, 23 Aug 2023 20:23:46 +0000 (16:23 -0400)]
doc: correct option name

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
22 months agoRevert "osd/SnapMapper: Maintain the prefix_itr between calls to avoid search…" 53104/head
Radoslaw Zarzynski [Wed, 23 Aug 2023 18:05:25 +0000 (20:05 +0200)]
Revert "osd/SnapMapper: Maintain the prefix_itr between calls to avoid search…"

Signed-off-by: Radosław Zarzyński <rzarzyns@redhat.com>
22 months agoMerge PR #53053 into main
Patrick Donnelly [Wed, 23 Aug 2023 17:57:25 +0000 (13:57 -0400)]
Merge PR #53053 into main

* refs/pull/53053/head:
libcephsqlite: fill 0s in unread portion of buffer

Reviewed-by: Casey Bodley <cbodley@redhat.com>
22 months agoMerge pull request #49428 from benhanokh/maintain_prefix_itr
Gabriel Benhanokh [Wed, 23 Aug 2023 15:34:22 +0000 (18:34 +0300)]
Merge pull request #49428 from benhanokh/maintain_prefix_itr

osd/SnapMapper: Maintain the prefix_itr between calls to avoid search…

22 months agoosd/SnapMapper: 49428/head
Gabriel BenHanokh [Wed, 14 Dec 2022 12:55:19 +0000 (12:55 +0000)]
osd/SnapMapper:
Maintain the prefix_itr between calls to SnapMapper::get_next_objects_to_trim() to prevent searching depleted prefixes.
We got 8 distinct hash prefixes used for searching objects owned by a given PG.
On each call to SnapMapper::get_next_objects_to_trim() we start from the first prefix even after all objects mapped to it were depleted.
This means that we will be searching for 1 non-existing prefix after the first prefix was depleted, 2 after the first two prefixes were depleted... and so on until we will search 7 non-existing prefixes after the first 7 prefixes were depleted.

This is a performance improvement PR only!
It maintains the existing behavior and does not try to fix/change any of the TRIM logic.
I added an extra step after the last object is trimmed doing a full scan of the DB and only if no object was found it will return ENOENT.
This should make the new code no-worse than existing code which returns ENOENT after a full scan found no object.
It should not impact performance in real life snaps as it should only happen once per-snap.

added snap-mapper tests to rados-test-suite
disabled osd_debug_trim_objects when running (SnapMapperTest, prefix_itr) to prevent asserts(as this code does illegal inserts into DELETED snaps)
Code beautifing

Signed-off-by: Gabriel BenHanokh <gbenhano@redhat.com>
22 months agoMerge pull request #53076 from zdover23/wip-doc-2023-08-22-start-os-recommendations...
zdover23 [Wed, 23 Aug 2023 11:47:51 +0000 (21:47 +1000)]
Merge pull request #53076 from zdover23/wip-doc-2023-08-22-start-os-recommendations-chart

doc/start: refactor ABC test chart

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
22 months agoMerge PR #53077 into main
Venky Shankar [Wed, 23 Aug 2023 05:37:24 +0000 (11:07 +0530)]
Merge PR #53077 into main

* refs/pull/53077/head:
qa: add `POOL_APP_NOT_ENABLED` to ignorelist for cephfs tests

Reviewed-by: Jos Collin <jcollin@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
22 months agoMerge pull request #53051 from xxhdx1985126/wip-crimson-omap-list
Yingxin [Wed, 23 Aug 2023 05:11:08 +0000 (13:11 +0800)]
Merge pull request #53051 from xxhdx1985126/wip-crimson-omap-list

crimson/os/seastore/omap_manager: fix the entry leak issue in BtreeOMapManager::omap_list()

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
22 months agotest/crimson: increase smp settings for test_socket and test_messenger 52896/head
Yingxin Cheng [Thu, 3 Aug 2023 07:51:31 +0000 (15:51 +0800)]
test/crimson: increase smp settings for test_socket and test_messenger

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
22 months agotest/crimson/test_messenger: add delay to suite markdown
Yingxin Cheng [Thu, 3 Aug 2023 07:45:16 +0000 (15:45 +0800)]
test/crimson/test_messenger: add delay to suite markdown

markdown() needs delay to be propagated to the primary core.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
22 months agotest/crimson/test_messenger: enable multi-core messenger in FailoverSuite
Yingxin Cheng [Thu, 3 Aug 2023 07:43:37 +0000 (15:43 +0800)]
test/crimson/test_messenger: enable multi-core messenger in FailoverSuite

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
22 months agotest/crimson/test_messenger: support cross-core protocol-level tests
Yingxin Cheng [Thu, 3 Aug 2023 07:42:45 +0000 (15:42 +0800)]
test/crimson/test_messenger: support cross-core protocol-level tests

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
22 months agocrimson/net: support cross-core blocking for interceptor
Yingxin Cheng [Thu, 3 Aug 2023 07:30:10 +0000 (15:30 +0800)]
crimson/net: support cross-core blocking for interceptor

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
22 months agocrimson/net: should not check shutdown from a different core
Yingxin Cheng [Thu, 3 Aug 2023 07:28:08 +0000 (15:28 +0800)]
crimson/net: should not check shutdown from a different core

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
22 months agocrimson/net: rework interceptor to support cross-core interceptions
Yingxin Cheng [Thu, 3 Aug 2023 07:26:54 +0000 (15:26 +0800)]
crimson/net: rework interceptor to support cross-core interceptions

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
22 months agolibcephsqlite: fill 0s in unread portion of buffer 53053/head
Patrick Donnelly [Fri, 18 Aug 2023 17:43:27 +0000 (13:43 -0400)]
libcephsqlite: fill 0s in unread portion of buffer

Unfortunately, this code is filling 0s at the beginning of the short-read
buffer.

Fixes: https://tracker.ceph.com/issues/62492
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
22 months agoMerge pull request #52984 from tchaikov/cmake-python3
Yuri Weinstein [Tue, 22 Aug 2023 18:34:10 +0000 (11:34 -0700)]
Merge pull request #52984 from tchaikov/cmake-python3

cmake: update FindPython3 module

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Zack Cerza <zack@redhat.com>
22 months agoMerge pull request #52904 from ronen-fr/wip-rf-ost-fmt
Yuri Weinstein [Tue, 22 Aug 2023 18:32:16 +0000 (11:32 -0700)]
Merge pull request #52904 from ronen-fr/wip-rf-ost-fmt

commom,osd: support for default fmtlib formatters

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
22 months agoMerge pull request #52809 from sseshasa/wip-mclock-client-lim-62293
Yuri Weinstein [Tue, 22 Aug 2023 18:31:22 +0000 (11:31 -0700)]
Merge pull request #52809 from sseshasa/wip-mclock-client-lim-62293

osd/scheduler/mClockScheduler: Use same profile and client ids for all clients to ensure allocated QoS limit consumption.

Reviewed-by: Samuel Just <sjust@redhat.com>
22 months agoMerge pull request #52339 from Matan-B/wip-matanb-trim-maps-refactor
Yuri Weinstein [Tue, 22 Aug 2023 18:31:05 +0000 (11:31 -0700)]
Merge pull request #52339 from Matan-B/wip-matanb-trim-maps-refactor

osd/OSD: Simplify trim_maps

Reviewed-by: Samuel Just <sjust@redhat.com>
22 months agoMerge pull request #51868 from NitzanMordhai/wip-nitzan-admin-socket-new-session...
Yuri Weinstein [Tue, 22 Aug 2023 18:30:37 +0000 (11:30 -0700)]
Merge pull request #51868 from NitzanMordhai/wip-nitzan-admin-socket-new-session-mon-shutdown

mon/Monitor: during shutdown don't accept new authentication and crea…

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
22 months agoMerge pull request #50216 from rhcs-dashboard/log-runway
Yuri Weinstein [Tue, 22 Aug 2023 18:30:17 +0000 (11:30 -0700)]
Merge pull request #50216 from rhcs-dashboard/log-runway

os/bluestore: expand BlueFS log if available space is insufficient

Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
Reviewed-by: Igor Fedotov <ifedotov@suse.com>
22 months agoMerge pull request #53038 from ronen-fr/wip-rf-max-utime
Ronen Friedman [Tue, 22 Aug 2023 18:16:50 +0000 (21:16 +0300)]
Merge pull request #53038 from ronen-fr/wip-rf-max-utime

common: add a utime_t::max constant

Reviewed-by: Samuel Just <sjust@redhat.com>
22 months agoMerge pull request #50200 from adk3798/drain-leave-etc-ceph
Adam King [Tue, 22 Aug 2023 16:31:33 +0000 (12:31 -0400)]
Merge pull request #50200 from adk3798/drain-leave-etc-ceph

mgr/cephadm: allow draining host without removing conf/keyring files

Reviewed-by: John Mulligan <jmulligan@redhat.com>
22 months agoMerge pull request #53008 from adk3798/cephadm-bind-to-specific-ip
Adam King [Tue, 22 Aug 2023 16:29:27 +0000 (12:29 -0400)]
Merge pull request #53008 from adk3798/cephadm-bind-to-specific-ip

mgr/cephadm: allow ingress services with same frontend port and different VIP

Reviewed-by: John Mulligan <jmulligan@redhat.com>
22 months agocephadm: have attempt_bind raise up OSErrors 53008/head
Adam King [Fri, 18 Aug 2023 16:32:38 +0000 (12:32 -0400)]
cephadm: have attempt_bind raise up OSErrors

Before it was always converting the OSError to
our self-defined "Error" class. This causes an issue
with the port_in_use function that has special handling
for OSError when the errno is EADDRNOTAVAIL or
EAFNOSUPPORT. Since the error being raised was no
longer an OSError it wasn't being caught and checked
properly in port_in_use.

This has the additional property of being necessary
to check port availability for haproxy on its VIP. If
we fail deployment when EADDRNOTAVAIL is raised, it becomes
difficult to deploy the ingress service. If we deploy
haproxy first it fails because the VIP isn't available
yet (since keepalive isn't up) and it fails saying the port
it wants to bind to is unavailable (specifically EADDRNOTAVAIL).
If we try to deploy keepalive first it fails because it
needs to know the location of the haproxy daemons in
order to build its config file. This has worked in the past
by just having the haproxy fail to bind at first and then
fix itself once the keepalive daemon is deployed. That
no longer works if the haproxy daemon fails to deploy
because cephadm is reporting the port it needs is
unavailable. Since EADDRNOTAVAIL when deploying
haproxy likely means the VIP is not up rather than
something else is taking up the port it needs, fixing
the handling of this allows ingress deployment to
work while also allowing multiple haproxy daemons
on the same host to use the same frontend port
bound to different VIPs.

Signed-off-by: Adam King <adking@redhat.com>
22 months agomgr/cephadm: only check haproxy frontend_port conflicts on VIP
Adam King [Fri, 11 Aug 2023 18:00:31 +0000 (14:00 -0400)]
mgr/cephadm: only check haproxy frontend_port conflicts on VIP

If we know what IP the frontend_port will be binding
to, we can pass that down through the port_ips mapping
so cephadm will only check if that port on that specific
VIP if in use. This allows multiple haproxy daemons
to be bound to the same port on different VIPs on the
same host.

Note that you still must use a different monitor port
for the two different ingress services as that port
is bound to on the actual IP of the host. Only the
frontend port can be the same for haproxies on the
same host as long as the VIP is different.

Fixes: https://tracker.ceph.com/issues/57614
Signed-off-by: Adam King <adking@redhat.com>
22 months agocephadm: support for specifying IP a port will be bound to on
Adam King [Fri, 11 Aug 2023 17:35:10 +0000 (13:35 -0400)]
cephadm: support for specifying IP a port will be bound to on

This is mostly for checking for port conflicts.
Currently, we just check if the port is bound to
on any IP on the host. This mechanism should allow
certain daemon types to specify a port -> IP mapping
that will be passed to the cephadm binary. That
mapping will then be used by cephadm to only
check for the port being bound to on that specific
IP rather than any IP on the host. The end result
is we could have daemons bound to the same
port on different IPs on the same node.

It's expected that daemon types will set this
up as part of their prepare_create or generate_config
functions where they may have more info about the
specific IPs and ports they need.

Signed-off-by: Adam King <adking@redhat.com>
22 months agocrimson/osd/lsan_suppressions: add MallocExtension::Register 53083/head
Matan Breizman [Tue, 22 Aug 2023 13:14:06 +0000 (13:14 +0000)]
crimson/osd/lsan_suppressions: add MallocExtension::Register

```
=================================================================
==80592==ERROR: LeakSanitizer: detected memory leaks

Direct leak of 8 byte(s) in 1 object(s) allocated from:
    #0 0x7f5c76eb6367 in operator new(unsigned long) (/lib64/libasan.so.6+0xb6367)
    #1 0x7f5c76a2fb81 in MallocExtension::Register(MallocExtension*) (/lib64/libtcmalloc.so.4+0x2fb81)

SUMMARY: AddressSanitizer: 8 byte(s) leaked in 1 allocation(s)
```

Signed-off-by: Matan Breizman <mbreizma@redhat.com>
22 months agocommon: add a utime_t::max constant 53038/head
Ronen Friedman [Thu, 17 Aug 2023 14:20:33 +0000 (09:20 -0500)]
common: add a utime_t::max constant

a convenient init value when searching for some early timepoint.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
22 months agoMerge pull request #52700 from cloudbehl/utilization-improvements
Aashish Sharma [Tue, 22 Aug 2023 13:02:28 +0000 (18:32 +0530)]
Merge pull request #52700 from cloudbehl/utilization-improvements

mgr/dashboard: Adding legends and fixing queries

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
22 months agoMerge pull request #53040 from ronen-fr/wip-rf-conf-minor
Ronen Friedman [Tue, 22 Aug 2023 12:52:45 +0000 (15:52 +0300)]
Merge pull request #53040 from ronen-fr/wip-rf-conf-minor

osd: minor changes to the descriptions of some configuration items

Reviewed-by: Samuel Just <sjust@redhat.com>
22 months agoMerge pull request #53036 from ceph/revert-52416-ior-make-failures
Rishabh Dave [Tue, 22 Aug 2023 09:46:42 +0000 (15:16 +0530)]
Merge pull request #53036 from ceph/revert-52416-ior-make-failures

Revert "qa/cephfs: fix ior build failure"

Reviewed-by: Rishabh Dave <ridave@redhat.com>
22 months agoMerge PR #52111 into main
Venky Shankar [Tue, 22 Aug 2023 07:57:17 +0000 (13:27 +0530)]
Merge PR #52111 into main

* refs/pull/52111/head:
ceph: allow xlock state to be LOCK_SYNC when putting it
ceph: allow xlock state to be LOCK_PREXLOCK when putting it

Reviewed-by: Venky Shankar <vshankar@redhat.com>
22 months agoMerge PR #52335 into main
Venky Shankar [Tue, 22 Aug 2023 07:56:02 +0000 (13:26 +0530)]
Merge PR #52335 into main

* refs/pull/52335/head:
client: move the Inode to new auth mds session when changing auth cap
client: check the xlists in ~MetaSession()

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
22 months agoMerge PR #52520 into main
Venky Shankar [Tue, 22 Aug 2023 07:55:07 +0000 (13:25 +0530)]
Merge PR #52520 into main

* refs/pull/52520/head:
mds: acquire inode snaplock in open

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Milind Changire <mchangir@redhat.com>
22 months agoMerge PR #52741 into main
Venky Shankar [Tue, 22 Aug 2023 07:53:40 +0000 (13:23 +0530)]
Merge PR #52741 into main

* refs/pull/52741/head:
qa/cephfs: switch to python3 for centos stream 9

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
22 months agoqa: add `POOL_APP_NOT_ENABLED` to ignorelist for cephfs tests 53077/head
Venky Shankar [Tue, 22 Aug 2023 06:14:55 +0000 (11:44 +0530)]
qa: add `POOL_APP_NOT_ENABLED` to ignorelist for cephfs tests

Fixes: http://tracker.ceph.com/issues/62508
Signed-off-by: Venky Shankar <vshankar@redhat.com>
22 months agodoc/start: refactor ABC test chart 53076/head
Zac Dover [Tue, 22 Aug 2023 05:30:21 +0000 (15:30 +1000)]
doc/start: refactor ABC test chart

Refactor the ABC test chart so that the information about which tests
have been run is presented in the center of the chart instead of, as it
was before, in a superscript.

Signed-off-by: Zac Dover <zac.dover@proton.me>
22 months agoPendingReleaseNotes: add a note for `mds_session_metadata_threshold` mds config 52944/head
Venky Shankar [Thu, 17 Aug 2023 04:40:37 +0000 (10:10 +0530)]
PendingReleaseNotes: add a note for `mds_session_metadata_threshold` mds config

Signed-off-by: Venky Shankar <vshankar@redhat.com>
22 months agotest: add test to verify that a buggy client is blocklisted
Venky Shankar [Fri, 11 Aug 2023 08:40:36 +0000 (04:40 -0400)]
test: add test to verify that a buggy client is blocklisted

... when its session metadata is bloated due to buildup of
`completed_requests`.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
22 months agomds: add perf counter to track number of sessions evicted due to metadata threshold...
Venky Shankar [Mon, 21 Aug 2023 07:50:22 +0000 (03:50 -0400)]
mds: add perf counter to track number of sessions evicted due to metadata threshold being exceeded

Signed-off-by: Venky Shankar <vshankar@redhat.com>
22 months agomds: blocklist clients with "bloated" session metadata
Venky Shankar [Fri, 11 Aug 2023 08:36:52 +0000 (04:36 -0400)]
mds: blocklist clients with "bloated" session metadata

Buggy clients (or maybe a MDS bug) causes a huge buildup of
`completed_requests` metadata in its session information.
This could cause the MDS to go read-only when its flushing
session metadata to the journal since the bloated metadata
causes the ODSOp payload to exceed the maximum write size.

Blocklist such clients so as to allow the MDS to continue
servicing requests.

Fixes: http://tracker.ceph.com/issues/61947
Signed-off-by: Venky Shankar <vshankar@redhat.com>
22 months agoMerge pull request #53069 from zdover23/wip-doc-2023-08-22-start-os-recommendations...
zdover23 [Tue, 22 Aug 2023 04:36:42 +0000 (14:36 +1000)]
Merge pull request #53069 from zdover23/wip-doc-2023-08-22-start-os-recommendations-platforms

doc/start: update "platforms" table

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
22 months agoMerge pull request #53068 from zdover23/wip-doc-2023-08-21-README-md-cmake-options
zdover23 [Tue, 22 Aug 2023 04:35:19 +0000 (14:35 +1000)]
Merge pull request #53068 from zdover23/wip-doc-2023-08-21-README-md-cmake-options

doc/README.md - improve "CMake Options"

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
22 months agoMerge pull request #53046 from cyx1231st/wip-crimson-msgr-perf-random-client-nonce
Yingxin [Tue, 22 Aug 2023 01:29:49 +0000 (09:29 +0800)]
Merge pull request #53046 from cyx1231st/wip-crimson-msgr-perf-random-client-nonce

crimson/tools/perf_crimson_msgr: randomize client nonce

Reviewed-by: Samuel Just <sjust@redhat.com>
22 months agoMerge pull request #52673 from tobias-urdin/options-anon-auth-presigned
Casey Bodley [Mon, 21 Aug 2023 19:52:25 +0000 (15:52 -0400)]
Merge pull request #52673 from tobias-urdin/options-anon-auth-presigned

rgw: handle http options CORS with v4 auth

Reviewed-by: Casey Bodley <cbodley@redhat.com>
22 months agoMerge PR #52868 into main
Casey Bodley [Mon, 21 Aug 2023 19:16:44 +0000 (15:16 -0400)]
Merge PR #52868 into main

* refs/pull/52868/head:
mailmap: update affiliations for reef release
script: fix credits.sh showing 0 lines changed for mapped emails
script: credits.sh uses grep -E

Reviewed-by: Joshua Baergen <jbaergen@digitalocean.com>
Reviewed-by: Mykola Golub <mgolub@suse.com>
Reviewed-by: Zack Cerza <zack@redhat.com>
Reviewed-by: John Mulligan <jmulligan@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Parth Arora <paarora@redhat.com>
Reviewed-by: Guillaume Abrioux <gabrioux@redhat.com>
Reviewed-by: zmc <NOT@FOUND>
22 months agodoc/start: update "platforms" table 53069/head
Zac Dover [Mon, 21 Aug 2023 15:18:40 +0000 (01:18 +1000)]
doc/start: update "platforms" table

Update the table that reports which versions of which Linux releases
have been used in tests of Ceph.

Fixes: https://tracker.ceph.com/issues/62354
Signed-off-by: Zac Dover <zac.dover@proton.me>
22 months agoosd: minor changes to the descriptions of some configuration items 53040/head
Ronen Friedman [Thu, 17 Aug 2023 15:28:06 +0000 (10:28 -0500)]
osd: minor changes to the descriptions of some configuration items

... mostly scrub-related.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
22 months agomailmap: update affiliations for reef release 52868/head
Casey Bodley [Mon, 7 Aug 2023 20:03:46 +0000 (16:03 -0400)]
mailmap: update affiliations for reef release

Signed-off-by: Casey Bodley <cbodley@redhat.com>