]>
git.apps.os.sepia.ceph.com Git - ceph.git/log
Nizamudeen A [Tue, 29 Aug 2023 19:48:03 +0000 (01:18 +0530)]
mgr/dashboard: cleanup rbd-mirror process in dashboard e2e
Fixes: https://tracker.ceph.com/issues/61703
Signed-off-by: Nizamudeen A <nia@redhat.com>
Patrick Donnelly [Mon, 28 Aug 2023 14:27:55 +0000 (10:27 -0400)]
Merge PR #53144 into main
* refs/pull/53144/head:
doc: reformat so note is not part of code
Reviewed-by: Anthony D Atri <anthony.datri@gmail.com>
Patrick Donnelly [Mon, 28 Aug 2023 13:28:14 +0000 (09:28 -0400)]
Merge PR #50502 into main
* refs/pull/50502/head:
mon/OSDMonitor: do not propose on error in prepare_update
Reviewed-by: Laura Flores <lflores@redhat.com>
Patrick Donnelly [Mon, 28 Aug 2023 13:26:17 +0000 (09:26 -0400)]
Merge PR #52292 into main
* refs/pull/52292/head:
mgr: register OSDs in ms_handle_accept
msg: indicate ms_handle_authentication is fast
Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Nizamudeen A [Mon, 28 Aug 2023 13:21:39 +0000 (18:51 +0530)]
Merge pull request #51979 from rhcs-dashboard/angular-14
mgr/dashboard: update to angular 14
Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
zdover23 [Mon, 28 Aug 2023 12:27:58 +0000 (22:27 +1000)]
Merge pull request #53096 from zdover23/wip-doc-2023-08-24-start-os-recommendations-platforms
doc/start: edit os-recommendations.rst
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Matan Breizman [Mon, 28 Aug 2023 12:12:00 +0000 (15:12 +0300)]
Merge pull request #48052 from rzarzynski/wip-crimson-qa-backfill
qa/suites/crimson-rados: bring backfill testing
Reviewed-by: Samuel Just <sjust@redhat.com>
Zac Dover [Wed, 23 Aug 2023 15:15:54 +0000 (01:15 +1000)]
doc/start: edit os-recommendations.rst
Improve the grammar in one sentence of the "Platforms" section of
doc/start/os-recommendations.rst. Improving that grammar involved
splitting the sentence into two sentences, but that's life. Update:
Anthony substantially rewrote this, so credit for this should rightly
go to him.
Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
Venky Shankar [Mon, 28 Aug 2023 06:22:42 +0000 (11:52 +0530)]
Merge PR #52921 into main
* refs/pull/52921/head:
pybind/mgr/volumes: log mutex locks to help debug deadlocks
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Venky Shankar [Mon, 28 Aug 2023 06:21:11 +0000 (11:51 +0530)]
Merge PR #52940 into main
* refs/pull/52940/head:
qa: Wait for purge to complete in test_volume_info_pending_subvol_deletions
Reviewed-by: Jos Collin <jcollin@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Nizamudeen A [Mon, 28 Aug 2023 04:41:36 +0000 (10:11 +0530)]
Merge pull request #52005 from rhcs-dashboard/entries
mgr/dashboard: n/a entries behind primary snapshot mode
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Nizamudeen A [Mon, 28 Aug 2023 04:40:17 +0000 (10:10 +0530)]
Merge pull request #53015 from ceph/dependabot-npm_and_yarn-src-pybind-mgr-dashboard-frontend-protobufjs-6.11.4
mgr/dashboard: bump protobufjs from 6.11.3 to 6.11.4 in /src/pybind/mgr/dashboard/frontend
Reviewed-by: Nizamudeen A <nia@redhat.com>
Nizamudeen A [Mon, 28 Aug 2023 04:39:41 +0000 (10:09 +0530)]
Merge pull request #53066 from rhcs-dashboard/fix-protect-option-rbd
mgr/dashboard: disable protect if layering is not enabled on the image
Reviewed-by: Ankush Behl <cloudbehl@gmail.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Matan Breizman [Sun, 27 Aug 2023 13:11:30 +0000 (16:11 +0300)]
Merge pull request #53082 from Matan-B/wip-matanb-crimson-asock-cleanup
crimson/admin/admin_socket: remove path file if it exists
Reviewed-by: Radosław Zarzyński <rzarzyns@redhat.com>
Matan Breizman [Wed, 23 Aug 2023 08:10:32 +0000 (08:10 +0000)]
crimson/admin/admin_socket: remove path file if it exists
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
Radoslaw Zarzynski [Fri, 9 Sep 2022 14:36:19 +0000 (14:36 +0000)]
qa: bring backfill testing to crimson-rados
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
Matan Breizman [Sun, 27 Aug 2023 08:12:14 +0000 (11:12 +0300)]
Merge pull request #53031 from xxhdx1985126/wip-crimson-backfill-state
crimson/osd/pg: check if backfill_state exists when judging objects'
Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Matan Breizman <mbreizma@redhat.com>
zdover23 [Sat, 26 Aug 2023 20:55:50 +0000 (06:55 +1000)]
Merge pull request #53163 from zdover23/wip-doc-2023-08-27-cephadm-services-mgr
doc/cephadm: edit sentence in mgr.rst
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Zac Dover [Sat, 26 Aug 2023 20:31:12 +0000 (06:31 +1000)]
doc/cephadm: edit sentence in mgr.rst
Improve the grammar in the first sentence of
doc/cephadm/services/mgr.rst. This is a small change, but I could not
resist.
Signed-off-by: Zac Dover <zac.dover@proton.me>
Ronen Friedman [Sat, 26 Aug 2023 13:26:10 +0000 (16:26 +0300)]
Merge pull request #52663 from ronen-fr/wip-rf-map-update
osd/scrub: reduce calls to on_scrub_schedule_input_change()
Reviewed-by: Samuel Just <sjust@redhat.com>
zdover23 [Sat, 26 Aug 2023 07:00:29 +0000 (17:00 +1000)]
Merge pull request #53161 from Svelar/doc_cephadm
doc/cephadm: update cephadm reef version
Reviewed-by: Zac Dover <zac.dover@proton.me>
Rongqi Sun [Sat, 26 Aug 2023 06:50:00 +0000 (14:50 +0800)]
doc/cephadm: update cephadm reef version
Signed-off-by: Rongqi Sun <sunrongqi@huawei.com>
Laura Flores [Fri, 25 Aug 2023 18:16:32 +0000 (13:16 -0500)]
Merge pull request #52532 from guits/fix-tracker-58946
python-common: drive_selection: fix KeyError when osdspec_affinity is not set
Laura Flores [Fri, 25 Aug 2023 14:30:23 +0000 (09:30 -0500)]
Merge pull request #53141 from rhcs-dashboard/fix-host-e2e
mgr/dashboard: remove unnecessary failing hosts e2e
Venky Shankar [Fri, 25 Aug 2023 13:16:19 +0000 (18:46 +0530)]
Merge PR #52944 into main
* refs/pull/52944/head:
PendingReleaseNotes: add a note for `mds_session_metadata_threshold` mds config
test: add test to verify that a buggy client is blocklisted
mds: add perf counter to track number of sessions evicted due to metadata threshold being exceeded
mds: blocklist clients with "bloated" session metadata
Reviewed-by: Robin H. Johnson <robbat2@orbis-terrarum.net>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Pedro Gonzalez Gomez [Fri, 25 Aug 2023 11:47:29 +0000 (13:47 +0200)]
Merge pull request #53131 from rhcs-dashboard/subvolume-e2e-test
mgr/dashboard: cephfs subvolume management e2e tests
Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Pere Diaz Bou [Mon, 12 Jun 2023 09:16:33 +0000 (11:16 +0200)]
mgr/dashboard: n/a entries behind primary snapshot mode
Fixes: https://tracker.ceph.com/issues/62576
Signed-off-by: Pere Diaz Bou <pere-altea@hotmail.com>
Nizamudeen A [Fri, 9 Jun 2023 14:06:41 +0000 (19:36 +0530)]
mgr/dashboard: adapt jest unit tests to angular 14
Important change would be the introduction of `TypedFormControl` which
is now more stricter in typing the FormControl and FormGroups as well.
Right now the dashboard has many number of untypedforms which by default
is migrated to an `UntypedFormControl` class when I ran the angular
upgrade script
Fixes: https://tracker.ceph.com/issues/61641
Signed-off-by: Nizamudeen A <nia@redhat.com>
Milind Changire [Fri, 25 Aug 2023 05:16:35 +0000 (10:46 +0530)]
Merge pull request #52723 from lxbsz/wip-62245
libcephfs/deleg: Wait for the delegation to be timedout
Teuthology run: http://pulpito.front.sepia.ceph.com/mchangir-2023-08-09_06:59:15-fs-wip-mchangir-testing-
20230808 .041738-testing-default-smithi/
Reviewed-by: Milind Changire <mchangir@redhat.com>
Ali Maredia [Thu, 24 Aug 2023 20:43:03 +0000 (16:43 -0400)]
Merge pull request #53074 from cbodley/wip-62504
qa/rgw: add new POOL_APP_NOT_ENABLED failures to log-ignorelist
Reviewed-by: Ali Maredia <amaredia@redhat.com>
zdover23 [Thu, 24 Aug 2023 20:29:44 +0000 (06:29 +1000)]
Merge pull request #53125 from batrick/volume-spec
doc: expand and consolidate mds placement
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Patrick Donnelly [Thu, 24 Aug 2023 18:03:34 +0000 (14:03 -0400)]
doc: reformat so note is not part of code
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
Pedro Gonzalez Gomez [Thu, 24 Aug 2023 14:48:37 +0000 (16:48 +0200)]
mgr/dashboard: remove unnecessary failing hosts e2e
These host e2e test were failing, since we are already checking this on the Dashboard Cephadm e2e tests we can get rid of these ones.
Fixes: https://tracker.ceph.com/issues/62491
Signed-off-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
Casey Bodley [Mon, 21 Aug 2023 19:43:04 +0000 (15:43 -0400)]
qa/rgw: add new POOL_APP_NOT_ENABLED failures to log-ignorelist
Fixes: https://tracker.ceph.com/issues/62504
Signed-off-by: Casey Bodley <cbodley@redhat.com>
Ali Masarwa [Thu, 24 Aug 2023 15:39:45 +0000 (18:39 +0300)]
Merge pull request #53039 from AliMasarweh/wip-alimasa-persistant-q-enhance-fix
RGW | Bucket Notification: Fix the issue of miscounting the entries to remove
Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
Nizamudeen A [Fri, 18 Aug 2023 08:17:31 +0000 (13:47 +0530)]
mgr/dashboard: cephfs subvolume management e2e tests
includes subvolume and subvolume groups e2es
Also taking care of renaming of Volume to File Systems in the remaining
actions like Edit and Remove
Fixes: https://tracker.ceph.com/issues/62564
Signed-off-by: Nizamudeen A <nia@redhat.com>
Pedro Gonzalez Gomez [Thu, 24 Aug 2023 14:33:03 +0000 (16:33 +0200)]
Merge pull request #53091 from rhcs-dashboard/fix-62453-main
mgr/dashboard: Create realm sets to default
Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
Reviewed-by: Ankush Behl <cloudbehl@gmail.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Patrick Donnelly [Thu, 24 Aug 2023 00:36:12 +0000 (20:36 -0400)]
doc: expand and consolidate mds placement
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
Venky Shankar [Thu, 24 Aug 2023 12:06:53 +0000 (17:36 +0530)]
Merge PR #52575 into main
* refs/pull/52575/head:
ceph_fs.h: add separate owner_{u,g}id fields
Reviewed-by: Xiubo Li <xiubli@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Venky Shankar [Thu, 24 Aug 2023 12:05:04 +0000 (17:35 +0530)]
Merge PR #52676 into main
* refs/pull/52676/head:
mds/Server: mark a cap acquisition throttle event in the request
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Kotresh Hiremath Ravishankar <khiremat@redhat.com>
Reviewed-by: Xiubo Li <xiubli@redhat.com>
avanthakkar [Mon, 21 Aug 2023 13:34:53 +0000 (19:04 +0530)]
mgr/dashboard: disable protect if layering is not enabled on the image
Fixes: https://tracker.ceph.com/issues/62498
Signed-off-by: avanthakkar <avanjohn@gmail.com>
Nizamudeen A [Fri, 18 Aug 2023 08:16:02 +0000 (13:46 +0530)]
mgr/dashboard: cleanup behave logics
Fixes: https://tracker.ceph.com/issues/62564
Signed-off-by: Nizamudeen A <nia@redhat.com>
Nizamudeen A [Thu, 24 Aug 2023 09:47:38 +0000 (15:17 +0530)]
Merge pull request #52829 from rhcs-dashboard/cephfs-e2e-test
mgr/dashboard: add e2e tests for cephfs management
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Aashish Sharma [Wed, 23 Aug 2023 09:59:44 +0000 (15:29 +0530)]
mgr/dashboard: Create realm sets to default
In Multisite page, When we create a realm the realm sets to default even if some other realm is already default and default checkbox in unchecked as well while creating.
Fixes: https://tracker.ceph.com/issues/62453
Signed-off-by: Aashish Sharma <aasharma@redhat.com>
Nizamudeen A [Thu, 24 Aug 2023 08:29:04 +0000 (13:59 +0530)]
Merge pull request #52895 from cloudbehl/minor-improvements
mgr/dashboard: Added some minor usability improvements
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Yingxin [Thu, 24 Aug 2023 07:37:59 +0000 (15:37 +0800)]
Merge pull request #52896 from cyx1231st/wip-seastar-multi-core-msgr-UT
crimson/net: consolidate messenger implementations and enable multi-shard UTs
Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Matan Breizman <mbreizma@redhat.com>
Matan Breizman [Thu, 24 Aug 2023 07:05:19 +0000 (10:05 +0300)]
Merge pull request #53083 from Matan-B/wip-matanb-crimson-centos9-supp
crimson/osd/lsan_suppressions: add MallocExtension::Register
Reviewed-by: Radosław Zarzyński <rzarzyns@redhat.com>
zdover23 [Thu, 24 Aug 2023 05:13:23 +0000 (15:13 +1000)]
Merge pull request #53117 from batrick/doc-name-fix
doc: correct option name
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Radoslaw Zarzynski [Wed, 23 Aug 2023 22:36:46 +0000 (00:36 +0200)]
Merge pull request #53104 from ceph/revert-49428-maintain_prefix_itr
Revert "osd/SnapMapper: Maintain the prefix_itr between calls to avoid search…"
Reviewed-by: Gabriel BenHanokh <gbenhano@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Patrick Donnelly [Wed, 23 Aug 2023 20:23:46 +0000 (16:23 -0400)]
doc: correct option name
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
Radoslaw Zarzynski [Wed, 23 Aug 2023 18:05:25 +0000 (20:05 +0200)]
Revert "osd/SnapMapper: Maintain the prefix_itr between calls to avoid search…"
Signed-off-by: Radosław Zarzyński <rzarzyns@redhat.com>
Patrick Donnelly [Wed, 23 Aug 2023 17:57:25 +0000 (13:57 -0400)]
Merge PR #53053 into main
* refs/pull/53053/head:
libcephsqlite: fill 0s in unread portion of buffer
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Gabriel Benhanokh [Wed, 23 Aug 2023 15:34:22 +0000 (18:34 +0300)]
Merge pull request #49428 from benhanokh/maintain_prefix_itr
osd/SnapMapper: Maintain the prefix_itr between calls to avoid search…
Gabriel BenHanokh [Wed, 14 Dec 2022 12:55:19 +0000 (12:55 +0000)]
osd/SnapMapper:
Maintain the prefix_itr between calls to SnapMapper::get_next_objects_to_trim() to prevent searching depleted prefixes.
We got 8 distinct hash prefixes used for searching objects owned by a given PG.
On each call to SnapMapper::get_next_objects_to_trim() we start from the first prefix even after all objects mapped to it were depleted.
This means that we will be searching for 1 non-existing prefix after the first prefix was depleted, 2 after the first two prefixes were depleted... and so on until we will search 7 non-existing prefixes after the first 7 prefixes were depleted.
This is a performance improvement PR only!
It maintains the existing behavior and does not try to fix/change any of the TRIM logic.
I added an extra step after the last object is trimmed doing a full scan of the DB and only if no object was found it will return ENOENT.
This should make the new code no-worse than existing code which returns ENOENT after a full scan found no object.
It should not impact performance in real life snaps as it should only happen once per-snap.
added snap-mapper tests to rados-test-suite
disabled osd_debug_trim_objects when running (SnapMapperTest, prefix_itr) to prevent asserts(as this code does illegal inserts into DELETED snaps)
Code beautifing
Signed-off-by: Gabriel BenHanokh <gbenhano@redhat.com>
zdover23 [Wed, 23 Aug 2023 11:47:51 +0000 (21:47 +1000)]
Merge pull request #53076 from zdover23/wip-doc-2023-08-22-start-os-recommendations-chart
doc/start: refactor ABC test chart
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Venky Shankar [Wed, 23 Aug 2023 05:37:24 +0000 (11:07 +0530)]
Merge PR #53077 into main
* refs/pull/53077/head:
qa: add `POOL_APP_NOT_ENABLED` to ignorelist for cephfs tests
Reviewed-by: Jos Collin <jcollin@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Yingxin [Wed, 23 Aug 2023 05:11:08 +0000 (13:11 +0800)]
Merge pull request #53051 from xxhdx1985126/wip-crimson-omap-list
crimson/os/seastore/omap_manager: fix the entry leak issue in BtreeOMapManager::omap_list()
Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Yingxin Cheng [Thu, 3 Aug 2023 07:51:31 +0000 (15:51 +0800)]
test/crimson: increase smp settings for test_socket and test_messenger
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
Yingxin Cheng [Thu, 3 Aug 2023 07:45:16 +0000 (15:45 +0800)]
test/crimson/test_messenger: add delay to suite markdown
markdown() needs delay to be propagated to the primary core.
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
Yingxin Cheng [Thu, 3 Aug 2023 07:43:37 +0000 (15:43 +0800)]
test/crimson/test_messenger: enable multi-core messenger in FailoverSuite
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
Yingxin Cheng [Thu, 3 Aug 2023 07:42:45 +0000 (15:42 +0800)]
test/crimson/test_messenger: support cross-core protocol-level tests
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
Yingxin Cheng [Thu, 3 Aug 2023 07:30:10 +0000 (15:30 +0800)]
crimson/net: support cross-core blocking for interceptor
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
Yingxin Cheng [Thu, 3 Aug 2023 07:28:08 +0000 (15:28 +0800)]
crimson/net: should not check shutdown from a different core
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
Yingxin Cheng [Thu, 3 Aug 2023 07:26:54 +0000 (15:26 +0800)]
crimson/net: rework interceptor to support cross-core interceptions
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
Patrick Donnelly [Fri, 18 Aug 2023 17:43:27 +0000 (13:43 -0400)]
libcephsqlite: fill 0s in unread portion of buffer
Unfortunately, this code is filling 0s at the beginning of the short-read
buffer.
Fixes: https://tracker.ceph.com/issues/62492
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
Yuri Weinstein [Tue, 22 Aug 2023 18:34:10 +0000 (11:34 -0700)]
Merge pull request #52984 from tchaikov/cmake-python3
cmake: update FindPython3 module
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Zack Cerza <zack@redhat.com>
Yuri Weinstein [Tue, 22 Aug 2023 18:32:16 +0000 (11:32 -0700)]
Merge pull request #52904 from ronen-fr/wip-rf-ost-fmt
commom,osd: support for default fmtlib formatters
Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Yuri Weinstein [Tue, 22 Aug 2023 18:31:22 +0000 (11:31 -0700)]
Merge pull request #52809 from sseshasa/wip-mclock-client-lim-62293
osd/scheduler/mClockScheduler: Use same profile and client ids for all clients to ensure allocated QoS limit consumption.
Reviewed-by: Samuel Just <sjust@redhat.com>
Yuri Weinstein [Tue, 22 Aug 2023 18:31:05 +0000 (11:31 -0700)]
Merge pull request #52339 from Matan-B/wip-matanb-trim-maps-refactor
osd/OSD: Simplify trim_maps
Reviewed-by: Samuel Just <sjust@redhat.com>
Yuri Weinstein [Tue, 22 Aug 2023 18:30:37 +0000 (11:30 -0700)]
Merge pull request #51868 from NitzanMordhai/wip-nitzan-admin-socket-new-session-mon-shutdown
mon/Monitor: during shutdown don't accept new authentication and crea…
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Yuri Weinstein [Tue, 22 Aug 2023 18:30:17 +0000 (11:30 -0700)]
Merge pull request #50216 from rhcs-dashboard/log-runway
os/bluestore: expand BlueFS log if available space is insufficient
Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
Reviewed-by: Igor Fedotov <ifedotov@suse.com>
Ronen Friedman [Tue, 22 Aug 2023 18:16:50 +0000 (21:16 +0300)]
Merge pull request #53038 from ronen-fr/wip-rf-max-utime
common: add a utime_t::max constant
Reviewed-by: Samuel Just <sjust@redhat.com>
Adam King [Tue, 22 Aug 2023 16:31:33 +0000 (12:31 -0400)]
Merge pull request #50200 from adk3798/drain-leave-etc-ceph
mgr/cephadm: allow draining host without removing conf/keyring files
Reviewed-by: John Mulligan <jmulligan@redhat.com>
Adam King [Tue, 22 Aug 2023 16:29:27 +0000 (12:29 -0400)]
Merge pull request #53008 from adk3798/cephadm-bind-to-specific-ip
mgr/cephadm: allow ingress services with same frontend port and different VIP
Reviewed-by: John Mulligan <jmulligan@redhat.com>
Adam King [Fri, 18 Aug 2023 16:32:38 +0000 (12:32 -0400)]
cephadm: have attempt_bind raise up OSErrors
Before it was always converting the OSError to
our self-defined "Error" class. This causes an issue
with the port_in_use function that has special handling
for OSError when the errno is EADDRNOTAVAIL or
EAFNOSUPPORT. Since the error being raised was no
longer an OSError it wasn't being caught and checked
properly in port_in_use.
This has the additional property of being necessary
to check port availability for haproxy on its VIP. If
we fail deployment when EADDRNOTAVAIL is raised, it becomes
difficult to deploy the ingress service. If we deploy
haproxy first it fails because the VIP isn't available
yet (since keepalive isn't up) and it fails saying the port
it wants to bind to is unavailable (specifically EADDRNOTAVAIL).
If we try to deploy keepalive first it fails because it
needs to know the location of the haproxy daemons in
order to build its config file. This has worked in the past
by just having the haproxy fail to bind at first and then
fix itself once the keepalive daemon is deployed. That
no longer works if the haproxy daemon fails to deploy
because cephadm is reporting the port it needs is
unavailable. Since EADDRNOTAVAIL when deploying
haproxy likely means the VIP is not up rather than
something else is taking up the port it needs, fixing
the handling of this allows ingress deployment to
work while also allowing multiple haproxy daemons
on the same host to use the same frontend port
bound to different VIPs.
Signed-off-by: Adam King <adking@redhat.com>
Adam King [Fri, 11 Aug 2023 18:00:31 +0000 (14:00 -0400)]
mgr/cephadm: only check haproxy frontend_port conflicts on VIP
If we know what IP the frontend_port will be binding
to, we can pass that down through the port_ips mapping
so cephadm will only check if that port on that specific
VIP if in use. This allows multiple haproxy daemons
to be bound to the same port on different VIPs on the
same host.
Note that you still must use a different monitor port
for the two different ingress services as that port
is bound to on the actual IP of the host. Only the
frontend port can be the same for haproxies on the
same host as long as the VIP is different.
Fixes: https://tracker.ceph.com/issues/57614
Signed-off-by: Adam King <adking@redhat.com>
Adam King [Fri, 11 Aug 2023 17:35:10 +0000 (13:35 -0400)]
cephadm: support for specifying IP a port will be bound to on
This is mostly for checking for port conflicts.
Currently, we just check if the port is bound to
on any IP on the host. This mechanism should allow
certain daemon types to specify a port -> IP mapping
that will be passed to the cephadm binary. That
mapping will then be used by cephadm to only
check for the port being bound to on that specific
IP rather than any IP on the host. The end result
is we could have daemons bound to the same
port on different IPs on the same node.
It's expected that daemon types will set this
up as part of their prepare_create or generate_config
functions where they may have more info about the
specific IPs and ports they need.
Signed-off-by: Adam King <adking@redhat.com>
Matan Breizman [Tue, 22 Aug 2023 13:14:06 +0000 (13:14 +0000)]
crimson/osd/lsan_suppressions: add MallocExtension::Register
```
=================================================================
==80592==ERROR: LeakSanitizer: detected memory leaks
Direct leak of 8 byte(s) in 1 object(s) allocated from:
#0 0x7f5c76eb6367 in operator new(unsigned long) (/lib64/libasan.so.6+0xb6367)
#1 0x7f5c76a2fb81 in MallocExtension::Register(MallocExtension*) (/lib64/libtcmalloc.so.4+0x2fb81)
SUMMARY: AddressSanitizer: 8 byte(s) leaked in 1 allocation(s)
```
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
Ronen Friedman [Thu, 17 Aug 2023 14:20:33 +0000 (09:20 -0500)]
common: add a utime_t::max constant
a convenient init value when searching for some early timepoint.
Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
Aashish Sharma [Tue, 22 Aug 2023 13:02:28 +0000 (18:32 +0530)]
Merge pull request #52700 from cloudbehl/utilization-improvements
mgr/dashboard: Adding legends and fixing queries
Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Ronen Friedman [Tue, 22 Aug 2023 12:52:45 +0000 (15:52 +0300)]
Merge pull request #53040 from ronen-fr/wip-rf-conf-minor
osd: minor changes to the descriptions of some configuration items
Reviewed-by: Samuel Just <sjust@redhat.com>
Rishabh Dave [Tue, 22 Aug 2023 09:46:42 +0000 (15:16 +0530)]
Merge pull request #53036 from ceph/revert-52416-ior-make-failures
Revert "qa/cephfs: fix ior build failure"
Reviewed-by: Rishabh Dave <ridave@redhat.com>
Venky Shankar [Tue, 22 Aug 2023 07:57:17 +0000 (13:27 +0530)]
Merge PR #52111 into main
* refs/pull/52111/head:
ceph: allow xlock state to be LOCK_SYNC when putting it
ceph: allow xlock state to be LOCK_PREXLOCK when putting it
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Venky Shankar [Tue, 22 Aug 2023 07:56:02 +0000 (13:26 +0530)]
Merge PR #52335 into main
* refs/pull/52335/head:
client: move the Inode to new auth mds session when changing auth cap
client: check the xlists in ~MetaSession()
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Venky Shankar [Tue, 22 Aug 2023 07:55:07 +0000 (13:25 +0530)]
Merge PR #52520 into main
* refs/pull/52520/head:
mds: acquire inode snaplock in open
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Milind Changire <mchangir@redhat.com>
Venky Shankar [Tue, 22 Aug 2023 07:53:40 +0000 (13:23 +0530)]
Merge PR #52741 into main
* refs/pull/52741/head:
qa/cephfs: switch to python3 for centos stream 9
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Venky Shankar [Tue, 22 Aug 2023 06:14:55 +0000 (11:44 +0530)]
qa: add `POOL_APP_NOT_ENABLED` to ignorelist for cephfs tests
Fixes: http://tracker.ceph.com/issues/62508
Signed-off-by: Venky Shankar <vshankar@redhat.com>
Zac Dover [Tue, 22 Aug 2023 05:30:21 +0000 (15:30 +1000)]
doc/start: refactor ABC test chart
Refactor the ABC test chart so that the information about which tests
have been run is presented in the center of the chart instead of, as it
was before, in a superscript.
Signed-off-by: Zac Dover <zac.dover@proton.me>
Venky Shankar [Thu, 17 Aug 2023 04:40:37 +0000 (10:10 +0530)]
PendingReleaseNotes: add a note for `mds_session_metadata_threshold` mds config
Signed-off-by: Venky Shankar <vshankar@redhat.com>
Venky Shankar [Fri, 11 Aug 2023 08:40:36 +0000 (04:40 -0400)]
test: add test to verify that a buggy client is blocklisted
... when its session metadata is bloated due to buildup of
`completed_requests`.
Signed-off-by: Venky Shankar <vshankar@redhat.com>
Venky Shankar [Mon, 21 Aug 2023 07:50:22 +0000 (03:50 -0400)]
mds: add perf counter to track number of sessions evicted due to metadata threshold being exceeded
Signed-off-by: Venky Shankar <vshankar@redhat.com>
Venky Shankar [Fri, 11 Aug 2023 08:36:52 +0000 (04:36 -0400)]
mds: blocklist clients with "bloated" session metadata
Buggy clients (or maybe a MDS bug) causes a huge buildup of
`completed_requests` metadata in its session information.
This could cause the MDS to go read-only when its flushing
session metadata to the journal since the bloated metadata
causes the ODSOp payload to exceed the maximum write size.
Blocklist such clients so as to allow the MDS to continue
servicing requests.
Fixes: http://tracker.ceph.com/issues/61947
Signed-off-by: Venky Shankar <vshankar@redhat.com>
zdover23 [Tue, 22 Aug 2023 04:36:42 +0000 (14:36 +1000)]
Merge pull request #53069 from zdover23/wip-doc-2023-08-22-start-os-recommendations-platforms
doc/start: update "platforms" table
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
zdover23 [Tue, 22 Aug 2023 04:35:19 +0000 (14:35 +1000)]
Merge pull request #53068 from zdover23/wip-doc-2023-08-21-README-md-cmake-options
doc/README.md - improve "CMake Options"
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Yingxin [Tue, 22 Aug 2023 01:29:49 +0000 (09:29 +0800)]
Merge pull request #53046 from cyx1231st/wip-crimson-msgr-perf-random-client-nonce
crimson/tools/perf_crimson_msgr: randomize client nonce
Reviewed-by: Samuel Just <sjust@redhat.com>
Casey Bodley [Mon, 21 Aug 2023 19:52:25 +0000 (15:52 -0400)]
Merge pull request #52673 from tobias-urdin/options-anon-auth-presigned
rgw: handle http options CORS with v4 auth
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Casey Bodley [Mon, 21 Aug 2023 19:16:44 +0000 (15:16 -0400)]
Merge PR #52868 into main
* refs/pull/52868/head:
mailmap: update affiliations for reef release
script: fix credits.sh showing 0 lines changed for mapped emails
script: credits.sh uses grep -E
Reviewed-by: Joshua Baergen <jbaergen@digitalocean.com>
Reviewed-by: Mykola Golub <mgolub@suse.com>
Reviewed-by: Zack Cerza <zack@redhat.com>
Reviewed-by: John Mulligan <jmulligan@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Parth Arora <paarora@redhat.com>
Reviewed-by: Guillaume Abrioux <gabrioux@redhat.com>
Reviewed-by: zmc <NOT@FOUND>
Zac Dover [Mon, 21 Aug 2023 15:18:40 +0000 (01:18 +1000)]
doc/start: update "platforms" table
Update the table that reports which versions of which Linux releases
have been used in tests of Ceph.
Fixes: https://tracker.ceph.com/issues/62354
Signed-off-by: Zac Dover <zac.dover@proton.me>
Ronen Friedman [Thu, 17 Aug 2023 15:28:06 +0000 (10:28 -0500)]
osd: minor changes to the descriptions of some configuration items
... mostly scrub-related.
Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
Casey Bodley [Mon, 7 Aug 2023 20:03:46 +0000 (16:03 -0400)]
mailmap: update affiliations for reef release
Signed-off-by: Casey Bodley <cbodley@redhat.com>