]>
git.apps.os.sepia.ceph.com Git - ceph.git/log
Nizamudeen A [Thu, 16 Mar 2023 06:28:45 +0000 (11:58 +0530)]
Merge pull request #50541 from rhcs-dashboard/wip-59072-reef
reef: mgr/dashboard: fix prometheus api issues on landing page v3
Reviewed-by: Pegonzal <NOT@FOUND>
zdover23 [Thu, 16 Mar 2023 01:30:32 +0000 (11:30 +1000)]
Merge pull request #50532 from zdover23/wip-doc-2023-03-15-backport-50390-to-reef
reef: doc/crimson: add SeaStore when using vstart.
Reviewed-by: Cole Mitchell <cole.mitchell.ceph@gmail.com>
Nizamudeen A [Wed, 22 Feb 2023 16:52:56 +0000 (22:22 +0530)]
mgr/dashboard: improve the logic on the alert viewer
only fetch the alerts when you toggle the alert viewer. don't fetch it
every 5 second cause its going to cause a heavy toll on the api.
Fixes: https://tracker.ceph.com/issues/58867
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit
6cb0679aaf28b5f128ca3cae5f962cac50d084af )
Nizamudeen A [Wed, 22 Feb 2023 07:33:34 +0000 (13:03 +0530)]
mgr/dashboard: fix prometheus api error on landing page v3
When no prometheus is configured in the cluster, it gives out error
while polling to the prometheus endpoint. so a proper check needs to be
added there.
Also some improvements to the exisiting behaviour
Fixes: https://tracker.ceph.com/issues/58867
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit
2d80e57dd4a60cbf52074d982ba3ebd4471a14ca )
Ernesto Puerta [Tue, 14 Mar 2023 20:17:18 +0000 (21:17 +0100)]
Merge pull request #50525 from epuertat/wip-59050-reef
reef: mgr/dashboard: force TLS 1.3
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
Rongqi Sun [Mon, 6 Mar 2023 06:01:51 +0000 (14:01 +0800)]
doc/crimson: add SeaStore when using vstart.
Signed-off-by: Rongqi Sun <sunrongqi@huawei.com>
(cherry picked from commit
055bb2bd5364e66c6e7f87760b9c409f2b8c7935 )
Ernesto Puerta [Mon, 13 Mar 2023 10:03:37 +0000 (11:03 +0100)]
mgr/dashboard: force TLS 1.3
Fixes: https://tracker.ceph.com/issues/58942
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>
(cherry picked from commit
cd8946631b222dfff1727083d75dfe2dd825d1a4 )
Nizamudeen A [Tue, 14 Mar 2023 07:07:47 +0000 (12:37 +0530)]
Merge pull request #50460 from rhcs-dashboard/custom-image-kcli-bootstrap-reef
reef: mgr/dashboard: custom image for kcli bootstrap script
Reviewed-by: Pegonzal <NOT@FOUND>
Anthony D'Atri [Tue, 14 Mar 2023 02:26:17 +0000 (22:26 -0400)]
Merge pull request #50517 from zdover23/wip-doc-2023-03-14-backport-50500-to-reef
reef: doc/dev/release-checklist: add another step for ceph-build
Josh Durgin [Mon, 13 Mar 2023 14:45:07 +0000 (07:45 -0700)]
doc/dev/release-checklist: add another step for ceph-build
Signed-off-by: Josh Durgin <jdurgin@redhat.com>
(cherry picked from commit
4fcad7161fa094af210229b6f15cded63781080e )
Laura Flores [Mon, 13 Mar 2023 20:16:33 +0000 (15:16 -0500)]
Merge pull request #50464 from ljflores/wip-tracker-58496-reef-backport
reef: osd/scrub: only call publish_stats_to_osd() where allowed and needed
Laura Flores [Mon, 13 Mar 2023 20:16:08 +0000 (15:16 -0500)]
Merge pull request #50424 from ljflores/wip-tracker-58925-reef
reef: qa: suppress memory leak in rocksdb
zdover23 [Sat, 11 Mar 2023 04:22:45 +0000 (14:22 +1000)]
Merge pull request #50414 from zdover23/wip-doc-2023-03-07-backport-50384-to-reef
reef: doc/radosgw: Redd up s3select.rst as followup to #49411
Reviewed-by: Cole Mitchell <cole.mitchell.ceph@gmail.com>
Anthony D'Atri [Fri, 10 Mar 2023 21:35:25 +0000 (16:35 -0500)]
Merge pull request #50476 from zdover23/wip-doc-2023-03-11-backport-50470-to-reef
reef: doc/index: remove "uniquely" from landing page
Zac Dover [Fri, 10 Mar 2023 10:35:18 +0000 (20:35 +1000)]
doc/index: remove "uniquely" from landing page
Change "Ceph uniquely delivers[...]" to "Ceph delivers[...]"
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit
6e5be7ad66aa76cb798c52c87e34f8fe079cda5c )
zdover23 [Fri, 10 Mar 2023 07:08:44 +0000 (17:08 +1000)]
Merge pull request #50452 from zdover23/wip-doc-2023-03-09-backport-50439-to-reef
reef: doc/rados/operations: Improve wording, capitalization, formatting
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Ronen Friedman [Sat, 11 Feb 2023 19:16:32 +0000 (21:16 +0200)]
osd/scrub: only call publish_stats_to_osd() where allowed and needed
This patch removes several unnecessary calls to publish_stats_to_osd() in
the clear_pgscrub_state pathway used during interval changes. We didn't
actually have anything to publish and we can't validly call publish_stats_to_osd()
when we aren't an active primary anyway (which we can't be during an interval
change).
Fixes: https://tracker.ceph.com/issues/58496
Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
(cherry picked from commit
aeff19db99ab53fbaec7eb530e35d578e6254e4c )
Nizamudeen A [Thu, 9 Mar 2023 11:51:44 +0000 (17:21 +0530)]
mgr/dashboard: custom image for kcli bootstrap script
the stable branches like quincy pulls from the quay.io/ceph/ceph:v17 to
bootstrap the ceph cluster in test environments. This will cause issues
because the branches are changing constantly but the image is not. So
using the quay.ceph.io repo to bring the cluster in test environment.
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit
be8f1e7f4a81dbf04692446edcc429d93d59e09d )
zdover23 [Thu, 9 Mar 2023 10:09:47 +0000 (20:09 +1000)]
Merge pull request #50387 from zdover23/wip-doc-2023-03-06-backport-50386-to-reef
reef: doc/rgw - fix grammar in table in s3.rst
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Anthony D'Atri [Wed, 8 Mar 2023 12:29:55 +0000 (07:29 -0500)]
doc/rados/operations: Improve wording, capitalizatiopn, formatting
Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
(cherry picked from commit
5f2060c0829992b31a0d17e23d7b1d2fb2280ac0 )
zdover23 [Wed, 8 Mar 2023 04:01:03 +0000 (14:01 +1000)]
Merge pull request #50431 from zdover23/wip-doc-2023-03-08-backport-50430-to-reef
reef: doc/install: update index.rst
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Zac Dover [Wed, 8 Mar 2023 01:52:12 +0000 (11:52 +1000)]
doc/install: update index.rst
Update index.rst by making minor grammar improvements. This file was
long overdue for a backport to Reef, Quincy, and Pacific, so this commit
was a good way to pass a human eyeball over the text before making those
backports.
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit
82d748ff590cfd31fefddc094b10622d090b054f )
Casey Bodley [Tue, 7 Mar 2023 13:45:47 +0000 (08:45 -0500)]
Merge pull request #50417 from soumyakoduri/wip-skoduri-reef
[Reef] rgw/tests: Reset endpoint before creating additional zones
Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
Soumya Koduri [Mon, 6 Mar 2023 14:23:08 +0000 (19:53 +0530)]
rgw/tests: Reset endpoint before creating additional zones
Signed-off-by: Soumya Koduri <skoduri@redhat.com>
Fixes: https://tracker.ceph.com/issues/58822
Anthony D'Atri [Sun, 5 Mar 2023 16:31:36 +0000 (11:31 -0500)]
doc/radosgw: Redd up s3select.rst as followup to #49411
Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
(cherry picked from commit
78b42ee0d27995a322cdd3998fb9726e490007a0 )
zdover23 [Mon, 6 Mar 2023 23:13:47 +0000 (09:13 +1000)]
Merge pull request #50399 from zdover23/wip-doc-2023-03-07-backport-50398-to-reef
reef: doc/dev: add full stop to sentence in basic-wo
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Casey Bodley [Mon, 6 Mar 2023 22:11:02 +0000 (17:11 -0500)]
Merge pull request #50374 from cbodley/wip-rgw-reef-s3select-json
reef: json integration: identifying new data-source and execute json flow.
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: Ali Maredia <amaredia@redhat.com>
Laura Flores [Mon, 6 Mar 2023 21:46:31 +0000 (21:46 +0000)]
qa: suppress memory leak in rocksdb
Fixes: https://tracker.ceph.com/issues/58925
Signed-off-by: Laura Flores <lflores@redhat.com>
(cherry picked from commit
7d6390dfbdadaf05a9b0cd2fd9f0fc5ac253832b )
Casey Bodley [Mon, 6 Mar 2023 22:05:09 +0000 (17:05 -0500)]
Merge pull request #50358 from cbodley/wip-qa-rgw-reef-tests
reef: qa/rgw: point all test repos at new ceph-reef branch
Reviewed-by: Ali Maredia <amaredia@redhat.com>
Casey Bodley [Mon, 6 Mar 2023 19:44:13 +0000 (14:44 -0500)]
Merge pull request #50376 from cbodley/wip-58891-reef
reef: rgw/reshard: treat old RGWBucketInfo::num_shards=0 as 1 shard
Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
Zac Dover [Mon, 6 Mar 2023 16:15:27 +0000 (02:15 +1000)]
doc/dev: add full stop to sentence in basic-wo
Add a full stop to a sentence in basic-workflow.rst. I looked at this
document and noticed that it wasn't there, and it was just bugging me.
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit
262b115b7554b7931cc174500eb12ac7a5d67513 )
Anthony D'Atri [Mon, 6 Mar 2023 15:04:55 +0000 (10:04 -0500)]
Merge pull request #50394 from zdover23/wip-doc-2023-03-06-backport-50382-to-reef
reef: doc/rgw: fix caption
Zac Dover [Sun, 5 Mar 2023 06:43:38 +0000 (16:43 +1000)]
doc/rgw: fix caption
Rewrite the third paragraph of the caption to the figure depicting how a
zonegroup works.
Follows https://github.com/ceph/ceph/pull/50316.
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit
8fa521466023635436305c1af31501bbbe20e857 )
Zac Dover [Mon, 6 Mar 2023 00:09:24 +0000 (10:09 +1000)]
doc/rgw - fix grammar in table in s3.rst
Put an "only" in the correct place. Also, this is a very small change
that will allow me to see if Jenkins is working (it probably isn't).
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit
1beab1e8abf59088be628cca972c59202526637d )
Anthony D'Atri [Fri, 3 Mar 2023 23:04:36 +0000 (18:04 -0500)]
Merge pull request #50377 from zdover23/wip-doc-2023-03-04-backport-50375-to-reef
reef: doc/rgw: refine keycloak.rst
Zac Dover [Fri, 3 Mar 2023 19:36:35 +0000 (05:36 +1000)]
doc/rgw: refine keycloak.rst
Full line-edit of doc/radosgw/keycloak.rst. Corrected syntax, grammar,
RST, and broken links.
Co-authored-by: Cole Mitchell <cole.mitchell.ceph@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit
5706ff1e451e6c7b3c3d40d492985377161b0133 )
Casey Bodley [Wed, 1 Mar 2023 22:20:06 +0000 (17:20 -0500)]
rgw/reshard: avoid infinite loop if bi_list() returns -ENOENT
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit
3e10944ff551e7bbb3d9083cb351ceb53c6b07b9 )
Casey Bodley [Wed, 1 Mar 2023 21:06:14 +0000 (16:06 -0500)]
rgw/rados: RGWSI_BucketIndex_RADOS requires layouts, not num_shards
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit
46f89cbae76d68af83a712f42443466e466681a3 )
Casey Bodley [Wed, 1 Mar 2023 15:48:30 +0000 (10:48 -0500)]
rgw/rados: use rgw::num_shards() helper
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit
c8908fdd4cf4bb6dd14787dd7a49f75b32cc53ce )
Casey Bodley [Wed, 1 Mar 2023 15:44:31 +0000 (10:44 -0500)]
rgw/reshard: refuse to reshard to new_num_shards=0
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit
4db197e858a4cedef4ad86af66d9b2cd2f4e4e31 )
Casey Bodley [Wed, 1 Mar 2023 15:44:09 +0000 (10:44 -0500)]
rgw/reshard: use the rgw::num_shards() helper
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit
e376080940605e21ba4189597706371bd7a29d9b )
Casey Bodley [Wed, 1 Mar 2023 15:02:11 +0000 (10:02 -0500)]
rgw: rgw::num_shards() returns 1 instead of 0
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit
4497ce51c40fe04688d7a80e9b3241fe89e1db5e )
galsalomon66 [Tue, 13 Dec 2022 14:31:43 +0000 (16:31 +0200)]
json integration: identifying new data-source and execute json flow.
s3select submodule
integrate the limit-operator into RGW. current changes is for CSV format
integrate the limit-operator with CSV-flow, and JSON-flow. an update of s3select submodule
a fix for the input-serialization-type selection
debug functionality.
fix for error handling
adding the scan-range feature. i.e. enables the user to define the range of processing(text only)
remove the temp variable(the s3select-layer handles the sql-result setting upon JSON flow)
adding documentation. for JSON, SQL limit-operator, scan-range option.
a fix for JSON test framework in s3select module
investigate crash. replace len with it.length()
editorial changes; non-initialized variables
adding validation for offset&length. (it seems that the offset&length causes Invalid reads, in some cases)
changes related to trino integration.(1) syntax issues related to trino-engine statement conbersions(s3select parser handles that) (2).
(2). trino rejects(HIVE_CURSUR_ERROR) some of the s3select responses do to its size, the change is about control the size of the respond.
update JSON documentation
trino changes: response in paging (limitation on size), trino syntax issues.
Signed-off-by: galsalomon66 <gal.salomon@gmail.com>
(cherry picked from commit
9f20e75a0b611a9de96e67070ce6078e23f6ba41 )
Anthony D'Atri [Fri, 3 Mar 2023 15:55:32 +0000 (10:55 -0500)]
Merge pull request #50366 from zdover23/wip-doc-2023-03-03-backport-50364-to-reef
reef: doc/cephadm: Redd up compatibility.rst
Anthony D'Atri [Fri, 3 Mar 2023 07:44:26 +0000 (02:44 -0500)]
doc/cephadm: Redd up compatibility.rst
Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
(cherry picked from commit
d608dec43b84c9a06990458219dda769829e05f8 )
Anthony D'Atri [Fri, 3 Mar 2023 06:48:42 +0000 (01:48 -0500)]
Merge pull request #50361 from zdover23/wip-doc-2023-03-03-backport-50354-to-reef
reef: doc/rgw: clean zone-sync.svg
zdover23 [Fri, 3 Mar 2023 05:05:38 +0000 (15:05 +1000)]
Merge pull request #50355 from zdover23/wip-doc-2023-03-03-backport-50351-to-reef
reef: doc/radosgw: format admonitions
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Zac Dover [Thu, 2 Mar 2023 19:24:00 +0000 (05:24 +1000)]
doc/rgw: clean zone-sync.svg
Refine zone-sync.svg (fix kerning and use fonts that render properly).
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit
064fdc9d9b4ad3393bfb5069d2f97dc622aaf12d )
Casey Bodley [Thu, 2 Mar 2023 23:30:26 +0000 (18:30 -0500)]
qa/rgw: point all test repos at new ceph-reef branch
Signed-off-by: Casey Bodley <cbodley@redhat.com>
Casey Bodley [Thu, 2 Mar 2023 23:29:44 +0000 (18:29 -0500)]
qa/smoke: use rgw/s3tests-branch.yaml
Signed-off-by: Casey Bodley <cbodley@redhat.com>
Zac Dover [Thu, 2 Mar 2023 18:04:30 +0000 (04:04 +1000)]
doc/radosgw: format admonitions
Break up the text of two similar admonitions into three paragraphs (in
each of the two instances). This makes the content of the admonition
much easier to read at a glance.
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit
4db68f5711f48b190f0135a3a7a6df8dfcf5abfa )
zdover23 [Thu, 2 Mar 2023 03:59:45 +0000 (13:59 +1000)]
Merge pull request #50338 from zdover23/wip-doc-2023-03-02-backport-50335-to-reef
reef: doc/cephadm: update cephadm compatability and stability page
Reviewed-by: Adam King <adking@redhat.com>
Adam King [Wed, 1 Mar 2023 21:10:41 +0000 (16:10 -0500)]
doc/cephadm: update cephadm compatability and stability page
This page is very out of date. This commit probably doesn't
cover everything there is to say about stability and compatability
in cephadm, but it at least gets it noticeably closer to reality
Signed-off-by: Adam King <adking@redhat.com>
(cherry picked from commit
383f46aa79e7a6f5571405a352ad023983560625 )
zdover23 [Wed, 1 Mar 2023 18:04:25 +0000 (04:04 +1000)]
Merge pull request #50316 from zdover23/wip-doc-2023-03-01-radosgw-multisite-diagram-object-replication-text-revision
doc/rgw: improve diagram caption
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Zac Dover [Wed, 1 Mar 2023 07:36:18 +0000 (17:36 +1000)]
doc/rgw: improve diagram caption
Improve the syntax and semantics of the caption of the diagram
"Replication of Object Data Between Zones" in doc/radosgw/multisite.rst.
Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
Yuval Lifshitz [Wed, 1 Mar 2023 14:13:55 +0000 (16:13 +0200)]
Merge pull request #50256 from yuvalif/wip-yuval-zipper-notifications
rgw/notifications: add bucket notification configuration to zipper
Reviewed-By: dang, cbodley
Yuval Lifshitz [Wed, 1 Mar 2023 14:12:47 +0000 (16:12 +0200)]
Merge pull request #48181 from huynp1999/wip-rgw-kafka-add-sasl-mechanism
src/rgw: SASL mechanism implem
Reviewed-By: ivancich, anthonyeleven, yuvalif
Radoslaw Zarzynski [Wed, 1 Mar 2023 07:57:27 +0000 (08:57 +0100)]
Merge pull request #49286 from rzarzynski/wip-crimson-snaptrimmer
crimson/osd, osd: bring snap trimming to crimson
Reviewed-by: Samuel Just <sjust@redhat.com>
Venky Shankar [Wed, 1 Mar 2023 02:24:18 +0000 (07:54 +0530)]
Merge PR #48720 into main
* refs/pull/48720/head:
qa: fix api failure issue caused during a dashboard test
PendingReleaseNotes: noted new MDSMap field refuse_client_session
qa: added two testcases
client: do not initiate session if flag refuse_client_session is set
mds: do not reconnect when refuse_client_session is set
mds: add new feature to block clients from establishing sessions
Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Kotresh Hiremath Ravishankar <khiremat@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Milind Changire <mchangir@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Neha Ojha [Tue, 28 Feb 2023 23:50:21 +0000 (15:50 -0800)]
Merge pull request #49006 from yanghonggang/yhg-upgrade-rocksdb-7.7.3
rocksdb: Upgrade rocksdb to latest facebook's v7.9.2
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Mark Nelson <mnelson@redhat.com>
Radoslaw Zarzynski [Tue, 28 Feb 2023 20:58:24 +0000 (20:58 +0000)]
qa/valgrind.supp: suppress the ColumnFamily ctor called on init
```
<frame>
<ip>0x1712F1E</ip>
<obj>/home/rzarzynski/ceph3/build/bin/ceph-mon</obj>
<fn>rocksdb::BytewiseComparator()</fn>
<dir>/home/rzarzynski/ceph3/src/rocksdb/util</dir>
<file>comparator.cc</file>
<line>304</line>
</frame>
<frame>
<ip>0x162361C</ip>
<obj>/home/rzarzynski/ceph3/build/bin/ceph-mon</obj>
<fn>rocksdb::ColumnFamilyOptions::ColumnFamilyOptions()</fn>
<dir>/home/rzarzynski/ceph3/src/rocksdb/options</dir>
<file>options.cc</file>
<line>123</line>
</frame>
<frame>
<ip>0x12CA21E</ip>
<obj>/home/rzarzynski/ceph3/build/bin/ceph-mon</obj>
<fn>Options</fn>
<dir>/home/rzarzynski/ceph3/build/../src/rocksdb/include/rocksdb</dir>
<file>options.h</file>
<line>1409</line>
</frame>
<frame>
<ip>0x12CA21E</ip>
<obj>/home/rzarzynski/ceph3/build/bin/ceph-mon</obj>
<fn>RocksDBStore::init(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >)</fn>
<dir>/home/rzarzynski/ceph3/build/../src/kv</dir>
<file>RocksDBStore.cc</file>
<line>400</line>
</frame>
```
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Radoslaw Zarzynski [Tue, 28 Feb 2023 20:42:31 +0000 (20:42 +0000)]
qa/valgrind.supp: suppress the get-or-create CacheItemHelper
```
// Get an CacheItemHelper pointer for value type T and role R.
template <typename T, CacheEntryRole R>
Cache::CacheItemHelper* GetCacheItemHelperForRole() {
static Cache::CacheItemHelper cache_helper(
BlocklikeTraits<T>::SizeCallback, BlocklikeTraits<T>::SaveToCallback,
GetCacheEntryDeleterForRole<T, R>());
return &cache_helper;
}
```
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Radoslaw Zarzynski [Tue, 28 Feb 2023 20:35:33 +0000 (20:35 +0000)]
qa/valgrind.supp: even broader suppression for rocksdb's init
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Adam King [Tue, 28 Feb 2023 19:57:44 +0000 (14:57 -0500)]
Merge pull request #50308 from adk3798/mock-fqdn-secure-alertmanager
mgr/cephadm: mock get_fqdn in secure alertmanager config test
Reviewed-by: Redouane Kachach <rkachach@redhat.com>
Radoslaw Zarzynski [Tue, 28 Feb 2023 17:52:12 +0000 (17:52 +0000)]
qa/valgrind.supp: ingore rocksdb leak in option parsing
This suppression is needed since upgrading to v7.9.2.
See PR https://github.com/ceph/ceph/pull/49006.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Radoslaw Zarzynski [Tue, 17 Jan 2023 19:11:44 +0000 (19:11 +0000)]
crimson/osd: fix compilation guard around specialization for libfmt => 9
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Radoslaw Zarzynski [Thu, 22 Dec 2022 15:32:49 +0000 (15:32 +0000)]
crimson/osd: handle snap trim's interruption as any other error
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Radoslaw Zarzynski [Tue, 20 Dec 2022 15:27:14 +0000 (15:27 +0000)]
crimson/osd: handle PG_STATE_SNAPTRIM_ERROR when trimming snaps
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Radoslaw Zarzynski [Mon, 19 Dec 2022 21:44:12 +0000 (21:44 +0000)]
crimson/osd: errorate SnapTrimEvent
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Radoslaw Zarzynski [Mon, 19 Dec 2022 20:19:52 +0000 (20:19 +0000)]
crimson/osd: manage PG_STATE_SNAPTRIM when trimming snaps
After a few tries:
```
$ bin/ceph -s
*** DEVELOPER MODE: setting PATH, PYTHONPATH and LD_LIBRARY_PATH ***
2022-12-19T20:18:21.856+0000
7ff87b46f700 -1 WARNING: all dangerous and experimental features are enabled.
2022-12-19T20:18:21.857+0000
7ff87b46f700 1 build_initial for_mkfs: 0
2022-12-19T20:18:21.860+0000
7ff87b46f700 -1 WARNING: all dangerous and experimental features are enabled.
2022-12-19T20:18:21.861+0000
7ff87b46f700 1 build_initial for_mkfs: 0
cluster:
id:
347aedc9 -d72f-4a34-98fc-
26cb04b0c2fc
health: HEALTH_WARN
11 mgr modules have failed dependencies
1 pool(s) do not have an application enabled
1 pool(s) have no replicas configured
services:
mon: 1 daemons, quorum a (age 3m)
mgr: x(active, since 3m)
osd: 1 osds: 1 up (since 3m), 1 in (since 3m)
data:
pools: 1 pools, 1 pgs
objects: 95 objects, 6 B
usage: 1.0 GiB used, 100 GiB / 101 GiB avail
pgs: 1 active+clean+snaptrim
io:
client: 1.2 KiB/s wr, 0 op/s rd, 1 op/s wr
```
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Radoslaw Zarzynski [Wed, 14 Dec 2022 20:18:19 +0000 (20:18 +0000)]
crimson/osd: drop C++'s ranges to workaround unbuildability on Clang
```
/home/jenkins-build/build/workspace/ceph-pull-requests/src/crimson/osd/osd_operations/snaptrim_event.cc:38:33: note: while checking constraint satisfaction for template 'operator|<const std::ranges::views::_Elements<0> &, const std::vector<std::pair<unsigned long, crimson::interruptible::interruptible_future_detail<crimson::osd::IOInterruptCondition, seastar::future<>>>> &>' required here
for (const auto &i : subops | std::views::keys) {
^
/home/jenkins-build/build/workspace/ceph-pull-requests/src/crimson/osd/osd_operations/snaptrim_event.cc:38:33: note: in instantiation of function template specialization 'std::ranges::views::__adaptor::operator|<const std::ranges::views::_Elements<0> &, const std::vector<std::pair<unsigned long, crimson::interruptible::interruptible_future_detail<crimson::osd::IOInterruptCondition, seastar::future<>>>> &>' requested here
/usr/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/iterator_concepts.h:963:7: note: candidate template ignored: constraints not satisfied [with _Tp = std::ranges::ref_view<const std
```
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Radoslaw Zarzynski [Tue, 13 Dec 2022 13:28:43 +0000 (13:28 +0000)]
crimson/osd: simplify SnapTrimObjSubEvent::start()
Throwing away the NOP-looking-like `maybe_delay` concept became
possible after eradication of the `with_interruption` call nested
within `SnapTrimSubEvent`. Before, on Ubuntu and GCC 11.2.1, lack
of it was the reson behind assertion failures on resetting the
`thread_local` intteruption condition.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Radoslaw Zarzynski [Tue, 13 Dec 2022 18:30:28 +0000 (18:30 +0000)]
crimson/osd: drop the nested interruptors in snap trimming
`crimson::interruptible` does not support that. See the
`DISABLED_nested_interruptors` unit test.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Radoslaw Zarzynski [Mon, 12 Dec 2022 19:12:11 +0000 (19:12 +0000)]
crimson/test: verify nesting of interruptors
It doesn't work.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Radoslaw Zarzynski [Mon, 12 Dec 2022 20:56:42 +0000 (20:56 +0000)]
crimson/osd: errorate SnapTrimObjSubEvent::remove_clone()
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Radoslaw Zarzynski [Sun, 11 Dec 2022 16:38:38 +0000 (16:38 +0000)]
crimson/osd: convert SnapTrimObjSubEvent::remove_or_update to ertr
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Radoslaw Zarzynski [Sat, 10 Dec 2022 22:42:06 +0000 (22:42 +0000)]
crimson/osd: dissect snapset update into SnapTrimObjSubEvent::update_head()
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Radoslaw Zarzynski [Sat, 10 Dec 2022 22:28:55 +0000 (22:28 +0000)]
crimson/osd: dissect head whiteout removal into SnapTrimObjSubEvent::remove_head_whiteout()
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Radoslaw Zarzynski [Sat, 10 Dec 2022 22:03:11 +0000 (22:03 +0000)]
crimson/osd: drop data aliases from SnapTrimObjSubEvent::adjust_snaps()
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Radoslaw Zarzynski [Sat, 10 Dec 2022 21:54:26 +0000 (21:54 +0000)]
crimson/osd: dissect clone removal into SnapTrimObjSubEvent::remove_clone()
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Radoslaw Zarzynski [Sat, 10 Dec 2022 21:29:26 +0000 (21:29 +0000)]
crimson/osd: drop data aliases from SnapTrimObjSubEvent::remove_or_update()
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Radoslaw Zarzynski [Fri, 9 Dec 2022 01:13:30 +0000 (01:13 +0000)]
crimson/osd: simplify informing SnapMapper about new mappings
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Radoslaw Zarzynski [Wed, 7 Dec 2022 20:41:07 +0000 (20:41 +0000)]
crimson/osd: implement basic osd_snap_trim_sleep support
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Radoslaw Zarzynski [Tue, 6 Dec 2022 14:04:17 +0000 (14:04 +0000)]
crimson/osd: introduce WaitSubop stage to SnapTrimEvent
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Radoslaw Zarzynski [Tue, 6 Dec 2022 14:01:44 +0000 (14:01 +0000)]
crimson/osd: snap trimming informs OpsExecuter about altered objects
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Radoslaw Zarzynski [Tue, 6 Dec 2022 10:55:39 +0000 (10:55 +0000)]
common: add debugs to crimson's green_condition_variable
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Radoslaw Zarzynski [Mon, 5 Dec 2022 20:17:19 +0000 (20:17 +0000)]
crimson/osd: drop unused declaration of PG::fill_op_params_bump_pg_version()
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Radoslaw Zarzynski [Mon, 5 Dec 2022 20:00:55 +0000 (20:00 +0000)]
osd: SnapMapper::OSDriver uses crimson's interruptor::green_get().
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Radoslaw Zarzynski [Tue, 6 Dec 2022 12:06:39 +0000 (12:06 +0000)]
crimson/common: bring green_get() to interruptor
The rationale
=============
Calling `get()` on an unavailable future can result in yielding
the reactor, so -- from the interruptor's POV -- the interrupt
condition must be handled exactly like it is done for `yield()`.
Interruptor takes care about that but, at the moment, only for the
interruptible futures; there is mechanism for plain `seastar::future`.
This patch paves the way for handling them as well.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Radoslaw Zarzynski [Mon, 5 Dec 2022 19:51:14 +0000 (19:51 +0000)]
crimson/common: trace management of interrupt_cond in interruptor::async()
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Radoslaw Zarzynski [Mon, 5 Dec 2022 19:46:36 +0000 (19:46 +0000)]
crimson/common: fix method name in interrupt_cond_t::reset()'s debugs
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Radoslaw Zarzynski [Sat, 3 Dec 2022 21:24:56 +0000 (21:24 +0000)]
osd: fix intersecion of green threads and interuptible
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Radoslaw Zarzynski [Fri, 25 Nov 2022 22:48:04 +0000 (22:48 +0000)]
crimson/osd: wire SnapMapper::add_oid() with OpsExecuter
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Radoslaw Zarzynski [Thu, 24 Nov 2022 22:50:17 +0000 (22:50 +0000)]
crimson/osd: settle snap_trimq in PG and wire it up
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Radoslaw Zarzynski [Thu, 24 Nov 2022 16:26:38 +0000 (16:26 +0000)]
crimson/osd: settle SnapMapper within crimson'o PG
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Radoslaw Zarzynski [Wed, 23 Nov 2022 21:30:02 +0000 (21:30 +0000)]
crimson/osd: PerShardState::start_operation() doesn't assume Ret is seastar::future<>
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Radoslaw Zarzynski [Tue, 22 Nov 2022 18:21:01 +0000 (18:21 +0000)]
crimson/osd: implement SnapMapper::OSDriver for crimson
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Radoslaw Zarzynski [Tue, 22 Nov 2022 16:03:42 +0000 (16:03 +0000)]
crimson/ertr: let ErrVisitorT return plain value if ValueFuncT returns seastar::future
The following corner case was unsupported till now:
```cpp
return os->omap_get_values(
ch, hoid, keys
).safe_then([] (FuturizedStore::omap_values_t&& vals) {
return 0;
}, FuturizedStore::read_errorator::all_same_way([] (auto&) {
return -1;
})).get();
```
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Radoslaw Zarzynski [Mon, 21 Nov 2022 19:06:02 +0000 (19:06 +0000)]
common/ceph_mutex: add green thread-requiring condition variable for crimson
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Radoslaw Zarzynski [Fri, 18 Nov 2022 19:15:27 +0000 (19:15 +0000)]
crimson/osd, osd: share SnapMapper with crimson
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>