]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
2 years agocrimson/common: bring green_get() to interruptor
Radoslaw Zarzynski [Tue, 6 Dec 2022 12:06:39 +0000 (12:06 +0000)]
crimson/common: bring green_get() to interruptor

The rationale
=============
Calling `get()` on an unavailable future can result in yielding
the reactor, so -- from the interruptor's POV -- the interrupt
condition must be handled exactly like it is done for `yield()`.

Interruptor takes care about that but, at the moment, only for the
interruptible futures; there is mechanism for plain `seastar::future`.
This patch paves the way for handling them as well.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2 years agocrimson/common: trace management of interrupt_cond in interruptor::async()
Radoslaw Zarzynski [Mon, 5 Dec 2022 19:51:14 +0000 (19:51 +0000)]
crimson/common: trace management of interrupt_cond in interruptor::async()

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2 years agocrimson/common: fix method name in interrupt_cond_t::reset()'s debugs
Radoslaw Zarzynski [Mon, 5 Dec 2022 19:46:36 +0000 (19:46 +0000)]
crimson/common: fix method name in interrupt_cond_t::reset()'s debugs

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2 years agoosd: fix intersecion of green threads and interuptible
Radoslaw Zarzynski [Sat, 3 Dec 2022 21:24:56 +0000 (21:24 +0000)]
osd: fix intersecion of green threads and interuptible

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2 years agocrimson/osd: wire SnapMapper::add_oid() with OpsExecuter
Radoslaw Zarzynski [Fri, 25 Nov 2022 22:48:04 +0000 (22:48 +0000)]
crimson/osd: wire SnapMapper::add_oid() with OpsExecuter

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2 years agocrimson/osd: settle snap_trimq in PG and wire it up
Radoslaw Zarzynski [Thu, 24 Nov 2022 22:50:17 +0000 (22:50 +0000)]
crimson/osd: settle snap_trimq in PG and wire it up

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2 years agocrimson/osd: settle SnapMapper within crimson'o PG
Radoslaw Zarzynski [Thu, 24 Nov 2022 16:26:38 +0000 (16:26 +0000)]
crimson/osd: settle SnapMapper within crimson'o PG

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2 years agocrimson/osd: PerShardState::start_operation() doesn't assume Ret is seastar::future<>
Radoslaw Zarzynski [Wed, 23 Nov 2022 21:30:02 +0000 (21:30 +0000)]
crimson/osd: PerShardState::start_operation() doesn't assume Ret is seastar::future<>

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2 years agocrimson/osd: implement SnapMapper::OSDriver for crimson
Radoslaw Zarzynski [Tue, 22 Nov 2022 18:21:01 +0000 (18:21 +0000)]
crimson/osd: implement SnapMapper::OSDriver for crimson

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2 years agocrimson/ertr: let ErrVisitorT return plain value if ValueFuncT returns seastar::future
Radoslaw Zarzynski [Tue, 22 Nov 2022 16:03:42 +0000 (16:03 +0000)]
crimson/ertr: let ErrVisitorT return plain value if ValueFuncT returns seastar::future

The following corner case was unsupported till now:

```cpp
  return os->omap_get_values(
    ch, hoid, keys
  ).safe_then([] (FuturizedStore::omap_values_t&& vals) {
    return 0;
  }, FuturizedStore::read_errorator::all_same_way([] (auto&) {
    return -1;
  })).get();
```
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2 years agocommon/ceph_mutex: add green thread-requiring condition variable for crimson
Radoslaw Zarzynski [Mon, 21 Nov 2022 19:06:02 +0000 (19:06 +0000)]
common/ceph_mutex: add green thread-requiring condition variable for crimson

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2 years agocrimson/osd, osd: share SnapMapper with crimson
Radoslaw Zarzynski [Fri, 18 Nov 2022 19:15:27 +0000 (19:15 +0000)]
crimson/osd, osd: share SnapMapper with crimson

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2 years agoosd: drop the scrub_purged_snaps() declaration from SnapMapper
Radoslaw Zarzynski [Fri, 18 Nov 2022 18:43:24 +0000 (18:43 +0000)]
osd: drop the scrub_purged_snaps() declaration from SnapMapper

Nowadays this is a dead code; the actual definition is in `OSD`.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2 years agocrimson/osd: SnapMapper::record_purged_snaps() takes abstratced store and txn
Radoslaw Zarzynski [Fri, 18 Nov 2022 17:47:16 +0000 (17:47 +0000)]
crimson/osd: SnapMapper::record_purged_snaps() takes abstratced store and txn

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2 years agocrimson/osd: convert SnapMapper::record_purged_snaps() to OSTransaction
Radoslaw Zarzynski [Fri, 18 Nov 2022 16:12:10 +0000 (16:12 +0000)]
crimson/osd: convert SnapMapper::record_purged_snaps() to OSTransaction

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2 years agocrimson/osd: initialize OSDriver in SnapMapper::record_purged_snaps()
Radoslaw Zarzynski [Fri, 18 Nov 2022 15:53:38 +0000 (15:53 +0000)]
crimson/osd: initialize OSDriver in SnapMapper::record_purged_snaps()

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2 years agocommon, osd: switch SnapMapper::_lookup_purged_snap to use OSDriver
Radoslaw Zarzynski [Thu, 17 Nov 2022 21:29:20 +0000 (21:29 +0000)]
common, osd: switch SnapMapper::_lookup_purged_snap to use OSDriver

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2 years agocrimson/osd: fix debug in Orderer::clear_and_cancel()
Radoslaw Zarzynski [Thu, 17 Nov 2022 15:22:02 +0000 (15:22 +0000)]
crimson/osd: fix debug in Orderer::clear_and_cancel()

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2 years agoosd: don't build unnecessary parts of SnapMapper for crimson
Radoslaw Zarzynski [Wed, 16 Nov 2022 16:47:49 +0000 (16:47 +0000)]
osd: don't build unnecessary parts of SnapMapper for crimson

This commits skips building two call-sites of `omap_get_iterator()`
of `ObjectStore` which are bypassing the `OSDriver` abstraction
layer.

1. `SnapMapper::convert_legacy()` likely never be needed by
crimson and we can leave it unchanged.

2. `SnapMapper::Subber` isn't needed right now but will be
needed in the future.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2 years agocrimson/osd: bring SnapTrimObjSubEvent
Radosław Zarzyński [Tue, 6 Dec 2022 21:20:15 +0000 (22:20 +0100)]
crimson/osd: bring SnapTrimObjSubEvent

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2 years agocrimson/osd: wire SnapTrimEvent with SnapMapper up
Radosław Zarzyński [Tue, 6 Dec 2022 20:26:42 +0000 (21:26 +0100)]
crimson/osd: wire SnapTrimEvent with SnapMapper up

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2 years agocrimson/osd: bring SubOpBlocker to SnapTrimEvent
Radoslaw Zarzynski [Wed, 16 Nov 2022 16:40:51 +0000 (16:40 +0000)]
crimson/osd: bring SubOpBlocker to SnapTrimEvent

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2 years agocrimson/osd: implement the basics of SnapTrimEvent
Radoslaw Zarzynski [Wed, 16 Nov 2022 15:19:41 +0000 (15:19 +0000)]
crimson/osd: implement the basics of SnapTrimEvent

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2 years agocrimson/osd/osd_operations: flatten indentation of InternalClientRequest
Radoslaw Zarzynski [Tue, 8 Nov 2022 13:55:37 +0000 (13:55 +0000)]
crimson/osd/osd_operations: flatten indentation of InternalClientRequest

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2 years agocrimson/osd: drop the residue of CompoundPeeringRequest
Radoslaw Zarzynski [Fri, 4 Nov 2022 13:07:13 +0000 (13:07 +0000)]
crimson/osd: drop the residue of CompoundPeeringRequest

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2 years agocrimson/osd: simplify ShardServices::snap_request_reservation()
Radoslaw Zarzynski [Wed, 26 Oct 2022 18:55:22 +0000 (18:55 +0000)]
crimson/osd: simplify ShardServices::snap_request_reservation()

`on_preempt` is not used by snap trimming; we can left its default.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2 years agocrimson/osd: bring the skeleton of SnapTrimEvent
Radoslaw Zarzynski [Wed, 26 Oct 2022 18:46:37 +0000 (18:46 +0000)]
crimson/osd: bring the skeleton of SnapTrimEvent

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2 years agocrimson/osd: settle snap_reserver within ShardServices
Radoslaw Zarzynski [Wed, 26 Oct 2022 17:45:50 +0000 (17:45 +0000)]
crimson/osd: settle snap_reserver within ShardServices

This bit will be used by the upcoming `SnapTrimRequest`.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2 years agocrimson/osd: move the SnapTrimmer-related handlers of PeeringState from .h to .cc
Radoslaw Zarzynski [Wed, 26 Oct 2022 11:50:22 +0000 (11:50 +0000)]
crimson/osd: move the SnapTrimmer-related handlers of PeeringState from .h to .cc

This commit is solely about code shuffling.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2 years agoMerge pull request #49836 from rkachach/fix_issue_58548
Adam King [Tue, 28 Feb 2023 14:31:21 +0000 (09:31 -0500)]
Merge pull request #49836 from rkachach/fix_issue_58548

cephadm: using ip instead of short hostname for prometheus urls

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2 years agoMerge pull request #50083 from adk3798/pids-limit
Adam King [Tue, 28 Feb 2023 14:28:34 +0000 (09:28 -0500)]
Merge pull request #50083 from adk3798/pids-limit

cephadm: set pids-limit unlimited for all ceph daemons

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
Reviewed-by: Vikhyat Umrao <vikhyat@redhat.com>
2 years agoMerge PR #50268 into main
Venky Shankar [Tue, 28 Feb 2023 13:45:32 +0000 (19:15 +0530)]
Merge PR #50268 into main

* refs/pull/50268/head:
mds: memset the head by default to fix the readable.sh test failure

Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Kotresh Hiremath Ravishankar <khiremat@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2 years agoMerge pull request #46601 from rkachach/fix_issue_55814
Adam King [Tue, 28 Feb 2023 13:41:50 +0000 (08:41 -0500)]
Merge pull request #46601 from rkachach/fix_issue_55814

mgr/cephadm: adding support for a secure ceph monitoring stack

Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2 years agoMerge pull request #50006 from idryomov/wip-58647
Ilya Dryomov [Tue, 28 Feb 2023 12:31:02 +0000 (13:31 +0100)]
Merge pull request #50006 from idryomov/wip-58647

mon/MgrMap: dump last_failure_osd_epoch and active_clients at top level

Reviewed-by: Ramana Raja <rraja@redhat.com>
2 years agoMerge pull request #50285 from ceph/epuertat-patch-1
Ernesto Puerta [Tue, 28 Feb 2023 11:41:56 +0000 (12:41 +0100)]
Merge pull request #50285 from ceph/epuertat-patch-1

.github: update add-to-project action

Reviewed-by: Nizamudeen A <nia@redhat.com>
2 years agoMerge pull request #50299 from rhcs-dashboard/fix-broken-styles-crud
Nizamudeen A [Tue, 28 Feb 2023 10:57:32 +0000 (16:27 +0530)]
Merge pull request #50299 from rhcs-dashboard/fix-broken-styles-crud

mgr/dashboard: minor fixes to crud form UI

Reviewed-by: Pegonzal <NOT@FOUND>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
2 years agoMerge pull request #50085 from myoungwon/wip-fix-initialization-vstart-rbm
Yingxin [Tue, 28 Feb 2023 08:33:32 +0000 (16:33 +0800)]
Merge pull request #50085 from myoungwon/wip-fix-initialization-vstart-rbm

crimson/os/seastore: RBM fixes during vstart startup time

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2 years agoMerge PR #50197 into main
Venky Shankar [Tue, 28 Feb 2023 07:01:59 +0000 (12:31 +0530)]
Merge PR #50197 into main

* refs/pull/50197/head:
cephfs-top: navigate to home screen while selecting sort field, if no filesystems.
cephfs-top: display_menu() isn't triggered when all fs' are removed

Reviewed-by: Jos Collin <jcollin@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2 years agomgr/dashboard: minor fixes to crud form UI 50299/head
Nizamudeen A [Tue, 28 Feb 2023 06:18:16 +0000 (11:48 +0530)]
mgr/dashboard: minor fixes to crud form UI

Fixes: https://tracker.ceph.com/issues/58864
Signed-off-by: Nizamudeen A <nia@redhat.com>
2 years agoMerge pull request #50295 from zdover23/wip-doc-2023-02-28-radosgw-multisite-zonegrou...
Anthony D'Atri [Tue, 28 Feb 2023 06:02:03 +0000 (01:02 -0500)]
Merge pull request #50295 from zdover23/wip-doc-2023-02-28-radosgw-multisite-zonegroup-correction-and-formatting

doc/radosgw: s/zone group/zonegroup/g et alia

2 years agoMerge pull request #50273 from cyx1231st/wip-seastore-fix-submitter-roll-segment
Yingxin [Tue, 28 Feb 2023 05:29:36 +0000 (13:29 +0800)]
Merge pull request #50273 from cyx1231st/wip-seastore-fix-submitter-roll-segment

crimson/os/seastore/journal: allow pending i/o in a full record_submitter when rolling the segment 2

Reviewed-by: Xuehan Xu <xxhdx1985126@gmail.com>
2 years agodoc/radosgw: s/zone group/zonegroup/g et alia 50295/head
Zac Dover [Tue, 28 Feb 2023 02:55:08 +0000 (12:55 +1000)]
doc/radosgw: s/zone group/zonegroup/g et alia

s/zone group/zonegroup/ where simple greps failed to find instances of
"zone group" that were spread across two lines; break a paragraph into
two paragraphs so that each paragraph has a thematic idea of its own.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2 years agoMerge pull request #50276 from zdover23/wip-doc-2023-02-27-radosgw-multisite-caption...
zdover23 [Tue, 28 Feb 2023 02:10:02 +0000 (12:10 +1000)]
Merge pull request #50276 from zdover23/wip-doc-2023-02-27-radosgw-multisite-caption-zone-data-replication

doc/rgw: caption a diagram

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2 years agoMerge pull request #48010 from ljflores/wip-lflores-primary-balancer
Laura Flores [Mon, 27 Feb 2023 23:55:52 +0000 (17:55 -0600)]
Merge pull request #48010 from ljflores/wip-lflores-primary-balancer

osd, tools, test/osd: implement read balancer

2 years agoMerge pull request #49482 from amathuria/wip-amathuria-mclock-high-prio-queue
Laura Flores [Mon, 27 Feb 2023 23:55:43 +0000 (17:55 -0600)]
Merge pull request #49482 from amathuria/wip-amathuria-mclock-high-prio-queue

mClock: Add ability to handle high priority operations

2 years agomon/MgrMap: dump last_failure_osd_epoch and active_clients at top level 50006/head
Ilya Dryomov [Mon, 6 Feb 2023 16:56:00 +0000 (17:56 +0100)]
mon/MgrMap: dump last_failure_osd_epoch and active_clients at top level

Currently last_failure_osd_epoch and active_clients are dumped in the
always_on_modules dictionary in "ceph mgr dump" output.  This goes back
to when these fields were added in commits f2986a4400bb ("mon/MgrMonitor:
blacklist previous instance") and df507cde8d71 ("mgr: forward RADOS
client instances for potential blacklist") but is wrong as these fields
have nothing to do with always-on modules.

Fixes: https://tracker.ceph.com/issues/58647
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2 years agoMerge pull request #48706 from Matan-B/wip-matanb-max-oldest-map
Yuri Weinstein [Mon, 27 Feb 2023 20:12:59 +0000 (12:12 -0800)]
Merge pull request #48706 from Matan-B/wip-matanb-max-oldest-map

OSD: Fix check_past_interval_bounds()

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2 years agoMerge pull request #49990 from rzarzynski/wip-osd-mon-public_bind_in_bindv
Laura Flores [Mon, 27 Feb 2023 20:10:49 +0000 (14:10 -0600)]
Merge pull request #49990 from rzarzynski/wip-osd-mon-public_bind_in_bindv

mon, osd: rework the public_bind_addr support. Bring it to OSD

2 years agoMerge pull request #50047 from rhcs-dashboard/post-css-error-teuth
Yuri Weinstein [Mon, 27 Feb 2023 19:56:27 +0000 (11:56 -0800)]
Merge pull request #50047 from rhcs-dashboard/post-css-error-teuth

mgr/dashboard: fix conflicting peer dependency: postcss@8.4.21

Reviewed-by: Laura Flores <lflores@redhat.com>
2 years agoMerge pull request #49507 from Matan-B/wip-matanb-check_pg_num-edit
Yuri Weinstein [Mon, 27 Feb 2023 19:56:00 +0000 (11:56 -0800)]
Merge pull request #49507 from Matan-B/wip-matanb-check_pg_num-edit

mon/OSDMontior: Simplify check_pg_num()

Reviewed-by: Nitzan Mordechai <nmordech@redhat.com>
2 years agoMerge pull request #48192 from amathuria/amathuria-edit-pg-deletion-cost
Yuri Weinstein [Mon, 27 Feb 2023 19:54:33 +0000 (11:54 -0800)]
Merge pull request #48192 from amathuria/amathuria-edit-pg-deletion-cost

osd: Change default value of osd_pg_delete_cost

Reviewed-by: Sridhar Seshasayee <sseshasa@redhat.com>
2 years agoMerge pull request #48657 from alimaredia/wip-rgw-labeled-perf-counters-cache
Ilya Dryomov [Mon, 27 Feb 2023 19:05:54 +0000 (20:05 +0100)]
Merge pull request #48657 from alimaredia/wip-rgw-labeled-perf-counters-cache

Labeled Perf Counters

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2 years agodoc/rgw: caption a diagram 50276/head
Zac Dover [Mon, 27 Feb 2023 09:00:04 +0000 (19:00 +1000)]
doc/rgw: caption a diagram

Add an explanation of a diagram that shows how object data is replicated
between zones within a zonegroup.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
2 years ago.github: update add-to-project action 50285/head
Ernesto Puerta [Mon, 27 Feb 2023 15:01:33 +0000 (16:01 +0100)]
.github: update add-to-project action

Signed-off-by: Ernesto Puerta <37327689+epuertat@users.noreply.github.com>
2 years agoMerge pull request #50274 from zdover23/wip-doc-2023-02-27-radosgw-multisite-remove...
Anthony D'Atri [Mon, 27 Feb 2023 13:43:58 +0000 (08:43 -0500)]
Merge pull request #50274 from zdover23/wip-doc-2023-02-27-radosgw-multisite-remove-tertiary

doc/rgw: remove "tertiary", link to procedure

2 years agoMerge pull request #50230 from idryomov/wip-58833
Ilya Dryomov [Mon, 27 Feb 2023 13:15:31 +0000 (14:15 +0100)]
Merge pull request #50230 from idryomov/wip-58833

librbd: call apply_changes() after setting librados_thread_count

Reviewed-by: Mykola Golub <mgolub@suse.com>
Reviewed-by: Christopher Hoffman <choffman@redhat.com>
2 years agoMerge pull request #50232 from idryomov/wip-qa-workunits-windows-ownership
Ilya Dryomov [Mon, 27 Feb 2023 10:24:40 +0000 (11:24 +0100)]
Merge pull request #50232 from idryomov/wip-qa-workunits-windows-ownership

CODEOWNERS: assign qa/workunits/windows to RBD

Reviewed-by: Lucian Petrut <lpetrut@cloudbasesolutions.com>
2 years agomds: memset the head by default to fix the readable.sh test failure 50268/head
Xiubo Li [Mon, 27 Feb 2023 04:55:59 +0000 (12:55 +0800)]
mds: memset the head by default to fix the readable.sh test failure

Introduced-by: cbd7e304020(ceph_fs.h: add 32 bits extended num_retry and num_fwd support)
Fixes: https://tracker.ceph.com/issues/58853
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2 years agoMerge pull request #50264 from zdover23/wip-doc-2023-02-27-radosgw-multisite-infernal...
zdover23 [Mon, 27 Feb 2023 09:01:36 +0000 (19:01 +1000)]
Merge pull request #50264 from zdover23/wip-doc-2023-02-27-radosgw-multisite-infernalis-changes

doc/radosgw: multisite - edit "functional changes"

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2 years agocrimson/os/seastore/journal: move segment rolling asserts to ceph_asserts 50273/head
Yingxin Cheng [Mon, 27 Feb 2023 08:18:26 +0000 (16:18 +0800)]
crimson/os/seastore/journal: move segment rolling asserts to ceph_asserts

Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2 years agocrimson/os/seastore/journal: allow pending i/o in a full record_submitter when rollin...
Yingxin Cheng [Mon, 27 Feb 2023 08:14:16 +0000 (16:14 +0800)]
crimson/os/seastore/journal: allow pending i/o in a full record_submitter when rolling the segment

Fixes: https://tracker.ceph.com/issues/58824
Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2 years agodoc/rgw: remove "tertiary", link to procedure 50274/head
Zac Dover [Mon, 27 Feb 2023 08:40:14 +0000 (18:40 +1000)]
doc/rgw: remove "tertiary", link to procedure

Remove the term "tertiary zone" and replace it with "second secondary
zone" (because there is no such thing as a tertiary zone). Link to the
procedure for creating a secondary zone in a place where such a link is
helpful to the reader.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2 years agodoc/radosgw: multisite - edit "functional changes" 50264/head
Zac Dover [Sun, 26 Feb 2023 16:52:02 +0000 (02:52 +1000)]
doc/radosgw: multisite - edit "functional changes"

Improve the wording of the section "Functional Changes from Infernalis"
in doc/radosgw/multisite.rst.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
2 years agoMerge PR #50178 into main
Venky Shankar [Mon, 27 Feb 2023 05:52:42 +0000 (11:22 +0530)]
Merge PR #50178 into main

* refs/pull/50178/head:
client: add comment about how quota affect space usage report

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Xiubo Li <xiubli@redhat.com>
2 years agoMerge PR #44240 into main
Venky Shankar [Mon, 27 Feb 2023 05:36:01 +0000 (11:06 +0530)]
Merge PR #44240 into main

* refs/pull/44240/head:
qa/cephfs: upgrade xfstests_dev.py for FUSE mounts

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Xiubo Li <xiubli@redhat.com>
2 years agoMerge pull request #50238 from rhcs-dashboard/fix-fix-58827_2-main
Nizamudeen A [Mon, 27 Feb 2023 04:43:45 +0000 (10:13 +0530)]
Merge pull request #50238 from rhcs-dashboard/fix-fix-58827_2-main

mgr/dashboard: fix constraints.txt again

Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
2 years agoMerge pull request #50236 from ronen-fr/wip-rf-total-dump
Ronen Friedman [Sun, 26 Feb 2023 19:30:30 +0000 (21:30 +0200)]
Merge pull request #50236 from ronen-fr/wip-rf-total-dump

test/osd-scrub-dump.sh: fix scrub chunk size

Reviewed-by: Samuel Just <sjust@redhat.com>-
2 years agoMerge pull request #50267 from zdover23/wip-doc-2023-02-27-glossary-zone
Anthony D'Atri [Sun, 26 Feb 2023 18:42:11 +0000 (13:42 -0500)]
Merge pull request #50267 from zdover23/wip-doc-2023-02-27-glossary-zone

doc/glossary: Add "zone" to glossary.rst

2 years agodoc/glossary: Add "zone" to glossary.rst 50267/head
Zac Dover [Sun, 26 Feb 2023 18:18:50 +0000 (04:18 +1000)]
doc/glossary: Add "zone" to glossary.rst

Add "Zone" to the glossary.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
2 years agoCODEOWNERS: assign qa/workunits/windows to RBD 50232/head
Ilya Dryomov [Thu, 23 Feb 2023 13:07:46 +0000 (14:07 +0100)]
CODEOWNERS: assign qa/workunits/windows to RBD

Assume ownership of qa/workunits/windows.  Despite the generic name,
currently it has just rbd-wnbd tests.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2 years agoMerge pull request #49299 from weirdwiz/status-update
Ilya Dryomov [Sun, 26 Feb 2023 13:13:07 +0000 (14:13 +0100)]
Merge pull request #49299 from weirdwiz/status-update

rbd-mirror: add information about the last snapshot sync to image status

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
2 years agotest/osd-scrub-dump.sh: fix scrub chunk size 50236/head
Ronen Friedman [Thu, 23 Feb 2023 15:53:56 +0000 (17:53 +0200)]
test/osd-scrub-dump.sh: fix scrub chunk size

The test performs shallow scrubs, intentionally using small chunk
sizes to allow dump commands time to check specific details.
Following commit ffda64119fc6165cebffd0b26619ad47b13daf51
(PR#44749), shallow scrubs chunks are controlled by a separate
configuration parameter. This PR fixes the test to use the
correct parameter.

An additional minor change is an adjustment to the test loop sleep time:
it is now reduced to guarantee that a dump followed by a counter
increase will be performed in more-or-less the scrubs frequency.

Fixes: https://tracker.ceph.com/issues/58797
Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2 years agoMerge pull request #50260 from zdover23/wip-doc-2023-02-26-glossary-client
zdover23 [Sat, 25 Feb 2023 20:16:42 +0000 (06:16 +1000)]
Merge pull request #50260 from zdover23/wip-doc-2023-02-26-glossary-client

doc/glossary: add "client" to glossary

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>
2 years agodoc/glossary: add "client" to glossary 50260/head
Zac Dover [Sat, 25 Feb 2023 19:51:07 +0000 (05:51 +1000)]
doc/glossary: add "client" to glossary

Add a definition of "client" to doc/glossary.rst.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
2 years agoMerge pull request #50257 from zdover23/wip-doc-2023-02-25-glossary-application
zdover23 [Sat, 25 Feb 2023 19:03:36 +0000 (05:03 +1000)]
Merge pull request #50257 from zdover23/wip-doc-2023-02-25-glossary-application

doc/glossary: add "application" to the glossary

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2 years agodoc/glossary: add "application" to the glossary 50257/head
Zac Dover [Sat, 25 Feb 2023 10:12:16 +0000 (20:12 +1000)]
doc/glossary: add "application" to the glossary

Add an admittedly-stub definition of "application" to the glossary.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
2 years agoqa/cephfs: upgrade xfstests_dev.py for FUSE mounts 44240/head
Rishabh Dave [Mon, 6 Dec 2021 12:31:40 +0000 (18:01 +0530)]
qa/cephfs: upgrade xfstests_dev.py for FUSE mounts

Add support for testing CephFS mounted with FUSE using xfstests-dev.

Fixes: https://tracker.ceph.com/issues/55354
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2 years agotest/crimson/seastore/rbm: use normal initialization path instead of open and set_blo... 50085/head
myoungwon oh [Sat, 25 Feb 2023 01:31:31 +0000 (10:31 +0900)]
test/crimson/seastore/rbm: use normal initialization path instead of open and set_block_size for test

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2 years agocrimson/os/seastore/rbm: add do_mount() and use it in derived classes
myoungwon oh [Fri, 24 Feb 2023 12:18:38 +0000 (21:18 +0900)]
crimson/os/seastore/rbm: add do_mount() and use it in derived classes

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2 years agocrimson/os/seastore/rbm: only set block_size at mkfs time
myoungwon oh [Fri, 24 Feb 2023 09:41:11 +0000 (18:41 +0900)]
crimson/os/seastore/rbm: only set block_size at mkfs time

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2 years agocrimson/os/seastore/rbm: move RBMDevice related functions to rbm_device.cc
myoungwon oh [Tue, 21 Feb 2023 08:10:20 +0000 (17:10 +0900)]
crimson/os/seastore/rbm: move RBMDevice related functions to rbm_device.cc

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2 years agocrimson/os/seastore/rbm: drop set_device_id() in RBMDevice
myoungwon oh [Tue, 21 Feb 2023 07:59:38 +0000 (16:59 +0900)]
crimson/os/seastore/rbm: drop set_device_id() in RBMDevice

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2 years agocrimson/os/seastore/rbm: remove read_rbm_header in BlockRBManager::open(), and use...
myoungwon oh [Tue, 21 Feb 2023 06:05:51 +0000 (15:05 +0900)]
crimson/os/seastore/rbm: remove read_rbm_header in BlockRBManager::open(), and use mount to load superblock

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2 years agocrimson/os/seastore/rbm: reset stream_index_to_open in NVMeBlockDevice at close()
myoungwon oh [Mon, 13 Feb 2023 02:44:02 +0000 (11:44 +0900)]
crimson/os/seastore/rbm: reset stream_index_to_open in NVMeBlockDevice at close()

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2 years agocrimson/os/seastore/rbm: use do_with() to prevent from freeing allocated memory
myoungwon oh [Mon, 13 Feb 2023 02:37:21 +0000 (11:37 +0900)]
crimson/os/seastore/rbm: use do_with() to prevent from freeing allocated memory

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2 years agocrimson/os/seastore/rbm: add mount() to NVMeBlockDevice
myoungwon oh [Mon, 13 Feb 2023 02:26:56 +0000 (11:26 +0900)]
crimson/os/seastore/rbm: add mount() to NVMeBlockDevice

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2 years agocrimson/os/seastore/rbm: In mkfs, add open() before write_rbm_header()
myoungwon oh [Mon, 13 Feb 2023 01:54:41 +0000 (10:54 +0900)]
crimson/os/seastore/rbm: In mkfs, add open() before write_rbm_header()

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2 years agocrimson/os/seastore/rbm: generalize shared logic and set cbjournal_size in mkfs()
myoungwon oh [Mon, 13 Feb 2023 01:41:49 +0000 (10:41 +0900)]
crimson/os/seastore/rbm: generalize shared logic and set cbjournal_size in mkfs()

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2 years agocrimson/os/seastore/rbm: do not set block_size in open()
myoungwon oh [Mon, 20 Feb 2023 02:49:54 +0000 (11:49 +0900)]
crimson/os/seastore/rbm: do not set block_size in open()

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2 years agocrimson/os/seastore/rbm: fix stat_deivce() to return correct device size
myoungwon oh [Mon, 13 Feb 2023 01:31:01 +0000 (10:31 +0900)]
crimson/os/seastore/rbm: fix stat_deivce() to return correct device size

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2 years agocrimson/os/seastore: create random_block_device using make_device at startup time
myoungwon oh [Mon, 13 Feb 2023 01:17:58 +0000 (10:17 +0900)]
crimson/os/seastore: create random_block_device using make_device at startup time

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2 years agoMerge pull request #50142 from rishabh-d-dave/fs-xfstests_dev-distro
Rishabh Dave [Fri, 24 Feb 2023 17:21:20 +0000 (22:51 +0530)]
Merge pull request #50142 from rishabh-d-dave/fs-xfstests_dev-distro

qa/cephfs: add 'rhel' to family of RH OS in xfstest_dev.py

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Xiubo Li <xiubli@redhat.com>
2 years agoMerge pull request #50250 from tnyeanderson/fix-service-spec-link
zdover23 [Fri, 24 Feb 2023 08:33:52 +0000 (18:33 +1000)]
Merge pull request #50250 from tnyeanderson/fix-service-spec-link

doc/cephadm/host-management: add service spec link

Reviewed-by: Zac Dover <zac.dover@proton.me>
2 years agoMerge pull request #50191 from xxhdx1985126/wip-weak-backref-retrieval-trans-issue-fix
Yingxin [Fri, 24 Feb 2023 06:35:36 +0000 (14:35 +0800)]
Merge pull request #50191 from xxhdx1985126/wip-weak-backref-retrieval-trans-issue-fix

crimson/os/seastore: make weak transactions conflict with others on ROOT

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2 years agodoc/cephadm/host-management: add service spec link 50250/head
thomas [Fri, 24 Feb 2023 06:00:00 +0000 (01:00 -0500)]
doc/cephadm/host-management: add service spec link

The old "(below)" text is not accurate, the service spec definition is
not in the same file at this point in time. This commit adds a ref link
to the actual service specification section.

Signed-off-by: thomas <me@thomasanderson.cloud>
2 years agoMerge pull request #48516 from athanatos/sjust/wip-57801
Samuel Just [Fri, 24 Feb 2023 02:39:27 +0000 (18:39 -0800)]
Merge pull request #48516 from athanatos/sjust/wip-57801

crimson,mon: add guards to avoid accidental crimson deployment and to avoid usage of unsupported features with crimson

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2 years agoMerge pull request #50246 from zdover23/wip-doc-2023-02-24-glossary-bucket-2
zdover23 [Fri, 24 Feb 2023 02:15:54 +0000 (12:15 +1000)]
Merge pull request #50246 from zdover23/wip-doc-2023-02-24-glossary-bucket-2

doc/glossary: add AWS links to bucket info

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2 years agodoc/glossary: add AWS/OpenStack bucket info 50246/head
Zac Dover [Fri, 24 Feb 2023 01:07:12 +0000 (11:07 +1000)]
doc/glossary: add AWS/OpenStack bucket info

Add links to AWS's documentation of buckets, in accordance with Casey
Bodley's suggestions here:
https://github.com/ceph/ceph/pull/50221#discussion_r1115900879

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
2 years agoMerge pull request #50202 from rzarzynski/wip-librbd-drop-cxx11-from-example
Ilya Dryomov [Thu, 23 Feb 2023 17:25:14 +0000 (18:25 +0100)]
Merge pull request #50202 from rzarzynski/wip-librbd-drop-cxx11-from-example

examples/librbd: drop -std=c++11 from CXXFLAGS

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2 years agocommon: Add labeled perf counters 48657/head
Ali Maredia [Tue, 19 Jul 2022 21:39:02 +0000 (17:39 -0400)]
common: Add labeled perf counters

Add the ability to dump labeled perf counters
for a daemon. Labeled perf counters are stored
in a CephContext's PerfCountersCollection.

Labeled and unlabeled perf counters are dumped
to the admin socket via `counters dump` command.

The schema for labeled and unlabeled perf
counters are dumped to the admin socket via
`counters schema` command.

This commit includes docs and additional unit tests

Signed-off-by: Ali Maredia <amaredia@redhat.com>