]> git-server-git.apps.pok.os.sepia.ceph.com Git - ceph.git/log
ceph.git
3 years agotests/osd: fix a test to follow an output formatting change 52256/head
Ronen Friedman [Thu, 4 Aug 2022 15:46:11 +0000 (15:46 +0000)]
tests/osd: fix a test to follow an output formatting change

PR#47255 modified the formatting of std::set-s. That broke
the osd-scrub-snaps.sh standalone test.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
(cherry picked from commit b04ef6ebfc5fa1e3d0df87af800249d240d92082)

Conflict: unimportant grep-string changes. Cherry-picked commit selected
Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
3 years agoosd/scrub: modify SnapMapper.cc to use ceph::buffer::list
Ronen Friedman [Tue, 23 Aug 2022 14:16:09 +0000 (14:16 +0000)]
osd/scrub: modify SnapMapper.cc to use ceph::buffer::list

... systematically, over ceph::bufferlist.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
(cherry picked from commit a85ef8e7980b30c60cf5f85acff153ae2c267fa2)

Manual change: osd-mapper.sh:
 That file wasn't supposed to be in this original commit; I did not
 merge its changes to the correct commit in order to maintain
 compatibility with the original PR. I did reduce that debug level,
 which was mistakenly set to dev level.

3 years agotests/osd: creating a Teuthology test re missing SnapMapper entries
Ronen Friedman [Tue, 23 Aug 2022 05:12:18 +0000 (05:12 +0000)]
tests/osd: creating a Teuthology test re missing SnapMapper entries

The test (in the standalone/scrub suite) verifies that the scrubber
detects (and issues a cluster-log error) whenever a mapping entry
("SNA_") is missing in the SnapMapper DB.

Specifically, here the entry is corrupted - shortened as per
https://tracker.ceph.com/issues/56147.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
(cherry picked from commit 84d9c4d177bb1b197910e2b93a4b186a9ccd13f1)

Conflicts: a comment change in scrub_backend was manually recreated
  in pg_scrubber
Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
3 years agoosd/scrub: verify SnapMapper consistency
Ronen Friedman [Mon, 1 Aug 2022 10:14:58 +0000 (10:14 +0000)]
osd/scrub: verify SnapMapper consistency

Whenever the scrubber access the SnapMapper for the snaps of a specific
clone, the mapper will now verify that the snaps have the required
mapping DB entries (the 'SNA_' keys).

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
(cherry picked from commit dc254da593956eb05f585a7ff30614d3cc694504)

Conflicts:
- changes moved from scrub_backend to the pg_scrubber

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
3 years agoosd/osd_types_fmt: mark fmt::formatter<>::format() const
Ronen Friedman [Thu, 6 Jul 2023 11:18:55 +0000 (06:18 -0500)]
osd/osd_types_fmt: mark fmt::formatter<>::format() const

For some formatters missed or added after PR#47830 (that fixed
most of the missing 'const's in this file)

Required to allow the use of the formatters in const member functions.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
(cherry picked from commit fc635888226a14fabe3979c1da761be68c955ff9)

3 years agoosd/scrub: move snap_mapper_{fix/op}_t to the Scrub namespace
Ronen Friedman [Wed, 3 Aug 2022 13:04:00 +0000 (13:04 +0000)]
osd/scrub: move snap_mapper_{fix/op}_t to the Scrub namespace

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
(cherry picked from commit d32b1b41b8f1843dcc2a5a0542410f09ea82e466)

Conflicts:
- changes that had to be made to pg_scrubber instead of
  scrub_backend
- fmt formatters required to compile

3 years agoquincy: osd/scrub: changes moved from scrub_backend
Ronen Friedman [Wed, 28 Jun 2023 19:30:14 +0000 (14:30 -0500)]
quincy: osd/scrub: changes moved from scrub_backend

Created as part of the backporting of PR47388 to Quincy:

Changes in the cherry-picking of d9a1b54 that had to be recreated
manually in the pre-refactoring files.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
3 years agoosd/scrub: improve SnapMapper's API used by the scrubber
Ronen Friedman [Sun, 24 Jul 2022 13:25:55 +0000 (13:25 +0000)]
osd/scrub: improve SnapMapper's API used by the scrubber

By:
- defining the interface;
- avoiding 'out' parameters where possible
- (forced to) improved const correctness

(cherry picked from commit d9a1b54e1990558c7e2ec55ba1df8571aa6b4dbe)

Conflicts:
  - important changes to scrub_backend.{h,cc} had to be copied manually
    into pre-backend-refactoring files;
  - removed the irrelevant test file

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
3 years agoneorados: compile with fmt v9
Tim Serong [Wed, 26 Oct 2022 09:42:53 +0000 (20:42 +1100)]
neorados: compile with fmt v9

neorados FTBFS on openSUSE Tumbleweed which includes fmt version 9.
On the assumption it's still desirable to support building with older
versions, I've put "#if FMT_VERSION" guards around the additions here.

Signed-off-by: Tim Serong <tserong@suse.com>
(cherry picked from commit fe1e6b6c4eb55cd2103309a957a8baecc473021a)

3 years agocommon/LogEntry: specialize fmt::formatter<LogEntry>
Kefu Chai [Sat, 27 Aug 2022 03:00:20 +0000 (11:00 +0800)]
common/LogEntry: specialize fmt::formatter<LogEntry>

so we can use the formatter defined for `LogEntry` in fmtlib v9.
in this new version of fmtlib, it is required to define a specialization
for the formatted type even when it comes to the types with an override of
operator<<(). since we already have an override for `LogEntry`, let's define
the specialization for `fmt::formatter<LogEntry>`.

this change should address the FTBFS when building with fmtlib v9.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
(cherry picked from commit 2901943618f071060f72d69cf632a4097e439df4)

3 years agocommon/Journald: include msg/msg_fmt.h
Kefu Chai [Sat, 27 Aug 2022 02:27:01 +0000 (10:27 +0800)]
common/Journald: include msg/msg_fmt.h

so we can use the formatter defined for `entity_name_t`. in fmtlib v9,
it is required to define a specialization for the formatted type even
the type has an override of operator<<(). now that we already have a
formatter for `entity_name_t`, let's just use it.

this change should address the FTBFS when building with fmtlib v9.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
(cherry picked from commit 6e223a6802152fc689ecdbf38fb4a410123844c7)

3 years agoinclude/rados: define iterator without std::iterator<>
Kefu Chai [Mon, 28 Feb 2022 15:01:27 +0000 (23:01 +0800)]
include/rados: define iterator without std::iterator<>

std::iterator<> is deprecated in C++17, so let's just
define the required traits directly.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
(cherry picked from commit 905969611d256b6613bd86347bd51ddeb0603b79)

3 years agoinclude/xlist: define iterator without std::iterator<>
Kefu Chai [Tue, 1 Mar 2022 16:14:09 +0000 (00:14 +0800)]
include/xlist: define iterator without std::iterator<>

std::iterator<> is deprecated in C++17, so let's just
define the required traits directly.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
(cherry picked from commit 77a3ed56a7b7326814ea5d37214bec1d88ec334e)

3 years agoinclude: Remove deprecated std::iterator from xlist
Adam C. Emerson [Mon, 7 Mar 2022 22:58:38 +0000 (17:58 -0500)]
include: Remove deprecated std::iterator from xlist

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
(cherry picked from commit 691119c389e119a03aea606b7c4093d46c6db43d)

3 years agoMerge pull request #52137 from ljflores/wip-61601-quincy
Yuri Weinstein [Mon, 26 Jun 2023 14:27:42 +0000 (10:27 -0400)]
Merge pull request #52137 from ljflores/wip-61601-quincy

quincy: qa/suites/rados: whitelist POOL_APP_NOT_ENABLED for cls tests

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
3 years agoMerge pull request #52134 from rzarzynski/wip-61741-quincy
Yuri Weinstein [Mon, 26 Jun 2023 14:27:10 +0000 (10:27 -0400)]
Merge pull request #52134 from rzarzynski/wip-61741-quincy

quincy: mon/MonClient: before complete auth with error, reopen session

Reviewed-by: Laura Flores <lflores@redhat.com>
3 years agoMerge pull request #52120 from cbodley/wip-61381-quincy
Yuri Weinstein [Mon, 26 Jun 2023 14:26:35 +0000 (10:26 -0400)]
Merge pull request #52120 from cbodley/wip-61381-quincy

quincy: Fix FTBFS on gcc 13

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
3 years agoMerge pull request #52118 from cbodley/wip-61731-quincy
Yuri Weinstein [Mon, 26 Jun 2023 14:25:41 +0000 (10:25 -0400)]
Merge pull request #52118 from cbodley/wip-61731-quincy

quincy: librados: aio operate functions can set times

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
3 years agoMerge pull request #51801 from NitzanMordhai/wip-61451-quincy
Yuri Weinstein [Mon, 26 Jun 2023 14:24:48 +0000 (10:24 -0400)]
Merge pull request #51801 from NitzanMordhai/wip-61451-quincy

quincy: test: monitor thrasher wait until quorum

Reviewed-by: Kamoltat (Junior) Sirivadhna <ksirivad@redhat.com>
3 years agoMerge pull request #51603 from Svelar/quincy-vstart-mgr-status
Yuri Weinstein [Mon, 26 Jun 2023 14:24:14 +0000 (10:24 -0400)]
Merge pull request #51603 from Svelar/quincy-vstart-mgr-status

quincy: vstart: check mgr status after starting mgr

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
3 years agoMerge pull request #51244 from k0ste/wip-59565-quincy
Yuri Weinstein [Mon, 26 Jun 2023 14:23:11 +0000 (10:23 -0400)]
Merge pull request #51244 from k0ste/wip-59565-quincy

quincy: mgr/telemetry: fixed log exceptions as "exception" instead of "error"

Reviewed-by: Yaarit Hatuka <yaarithatuka@gmail.com>
3 years agoMerge pull request #52184 from zdover23/wip-doc-2023-06-25-backport-52181-to-quincy
zdover23 [Sun, 25 Jun 2023 23:23:17 +0000 (09:23 +1000)]
Merge pull request #52184 from zdover23/wip-doc-2023-06-25-backport-52181-to-quincy

quincy: doc/radosgw: remove pipes from s3select.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
3 years agodoc/radosgw: remove pipes from s3select.rst 52184/head
Zac Dover [Sun, 25 Jun 2023 09:03:07 +0000 (19:03 +1000)]
doc/radosgw: remove pipes from s3select.rst

Remove strange formatting introduced in
61d6813726fc08980903c6a6c50b0a5797ba7193.

Note to the documentation team: This is not a line-edit. This commit
includes nothing but the removal of pipes added to the left of much of
the text in this file. Several future commits will line-edit this file
and correct its formatting.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit a4d302ee1a6e2f71263a898109ebed28e7e8eaca)

3 years agoMerge pull request #52180 from zdover23/wip-doc-2023-06-24-backport-52167-to-quincy
Anthony D'Atri [Sat, 24 Jun 2023 14:06:00 +0000 (10:06 -0400)]
Merge pull request #52180 from zdover23/wip-doc-2023-06-24-backport-52167-to-quincy

quincy: doc/rados: edit crush-map-edits.rst (1 of x)

3 years agodoc/rados: edit crush-map-edits.rst (1 of x) 52180/head
Zac Dover [Fri, 23 Jun 2023 00:59:10 +0000 (10:59 +1000)]
doc/rados: edit crush-map-edits.rst (1 of x)

Edit doc/rados/operations/crush-map-edits.rst.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Co-authored-by: Cole Mitchell <cole.mitchell.ceph@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit f447c290a877c84cb14f0141ff5330f7147b2f6a)

3 years agoMerge pull request #51809 from rhcs-dashboard/wip-61485-quincy
Nizamudeen A [Fri, 23 Jun 2023 05:46:22 +0000 (11:16 +0530)]
Merge pull request #51809 from rhcs-dashboard/wip-61485-quincy

quincy: mgr/dashboard: fix issues with read-only user on landing page

Reviewed-by: Nizamudeen A <nia@redhat.com>
3 years agoMerge pull request #52169 from zdover23/wip-doc-2023-06-23-backport-45746-to-quincy
zdover23 [Fri, 23 Jun 2023 03:26:43 +0000 (13:26 +1000)]
Merge pull request #52169 from zdover23/wip-doc-2023-06-23-backport-45746-to-quincy

doc,test: clean up crush rule min/max_size leftovers

Reviewed-by: Cole Mitchell <cole.mitchell.ceph@gmail.com>
3 years agodoc,test: clean up crush rule min/max_size leftovers 52169/head
Ilya Dryomov [Mon, 28 Mar 2022 18:35:35 +0000 (20:35 +0200)]
doc,test: clean up crush rule min/max_size leftovers

These fields were removed in quincy in commit f95eb04411cd ("crush:
eliminate min_size and max_size").

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 1ab943cabb7677f9465e92a00a84d2bfca60beb7)

3 years agotest/librados: test ability to set mtimes with aio_operate 52118/head
Casey Bodley [Tue, 23 May 2023 17:53:32 +0000 (13:53 -0400)]
test/librados: test ability to set mtimes with aio_operate

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit ec2923453766ddfee2b3dd330610179022b7d3cb)

Conflicts:
src/test/librados/aio.cc:
  removed test case for rados_aio_write_op_operate2()
which wasn't backported
  test case for rados_aio_write_op_operate() uses rados_stat()
instead of rados_stat2() which doesn't exist on quincy

3 years agoMerge pull request #52153 from zdover23/wip-doc-2023-06-22-backport-52123-to-quincy
Anthony D'Atri [Thu, 22 Jun 2023 12:29:27 +0000 (08:29 -0400)]
Merge pull request #52153 from zdover23/wip-doc-2023-06-22-backport-52123-to-quincy

quincy: doc/rados: edit control.rst (1 of x)

3 years agodoc/rados: edit control.rst (1 of x) 52153/head
Zac Dover [Tue, 20 Jun 2023 02:12:44 +0000 (12:12 +1000)]
doc/rados: edit control.rst (1 of x)

Edit doc/rados/operations/control.rst.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit d14b828a1ac2f82525dce2cc0524ad83d2cdc80d)

3 years agoMerge pull request #52140 from zdover23/wip-doc-2023-06-21-backport-52104-to-quincy
Anthony D'Atri [Tue, 20 Jun 2023 23:04:36 +0000 (19:04 -0400)]
Merge pull request #52140 from zdover23/wip-doc-2023-06-21-backport-52104-to-quincy

quincy: doc/rados/operations: Improve formatting in crush-map.rst

3 years agoMerge pull request #52142 from zdover23/wip-doc-2023-06-21-backport-52105-to-quincy
Anthony D'Atri [Tue, 20 Jun 2023 23:02:49 +0000 (19:02 -0400)]
Merge pull request #52142 from zdover23/wip-doc-2023-06-21-backport-52105-to-quincy

quincy: doc/mgr/dashboard: fix a typo

3 years agodoc/mgr/dashboard: fix a typo 52142/head
gsantella [Sat, 17 Jun 2023 13:49:15 +0000 (09:49 -0400)]
doc/mgr/dashboard: fix a typo

Signed-off-by: Guido Santella <gsantella@southhills.edu>
(cherry picked from commit d64c52150c48c993a214bb80b3802652d0685174)

3 years agodoc/rados/operations: Improve formatting in crush-map.rst 52140/head
Anthony D'Atri [Sat, 17 Jun 2023 10:37:58 +0000 (06:37 -0400)]
doc/rados/operations: Improve formatting in crush-map.rst

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
(cherry picked from commit 540d6ce3ee014a6ad1560e628c8d04e694a0c599)

3 years agoMerge pull request #52016 from ljflores/wip-61606-quincy
Laura Flores [Tue, 20 Jun 2023 17:25:59 +0000 (12:25 -0500)]
Merge pull request #52016 from ljflores/wip-61606-quincy

quincy: qa/suites/rados: remove rook coverage from the rados suite

3 years agoqa/suites/rados: whitelist POOL_APP_NOT_ENABLED for rados cls tests 52137/head
Laura Flores [Mon, 5 Jun 2023 20:35:54 +0000 (15:35 -0500)]
qa/suites/rados: whitelist POOL_APP_NOT_ENABLED for rados cls tests

Fixes: https://tracker.ceph.com/issues/59192
Signed-off-by: Laura Flores <lflores@redhat.com>
(cherry picked from commit 66a6e7fdebe294f233bf34d5c833742bf15c9f03)

3 years agomon/MonClient: before complete auth with error, reopen session 52134/head
Nitzan Mordechai [Wed, 10 May 2023 09:42:07 +0000 (09:42 +0000)]
mon/MonClient: before complete auth with error, reopen session
When monClient try to authenticate and fail with -EAGAIN there is
a possibility that we no longer hunting and not have active_con.
that will result of disconnecting the monClient and ticks will continue
without having open session.
the solution is to check at the end of auth, that we don't have -EAGAIN
error, and if we do, reopen the session and on the next tick try auth again

Fixes: https://tracker.ceph.com/issues/58379
Signed-off-by: Nitzan Mordechai <nmordech@redhat.com>
(cherry picked from commit f8dad00f07f52d58d8ec67083e8bf568deec3277)

3 years agocommon, librbd, msg, test: fix FTBFS on gcc 13 52120/head
Tim Serong [Wed, 8 Mar 2023 02:53:29 +0000 (13:53 +1100)]
common, librbd, msg, test: fix FTBFS on gcc 13

This is based on 0024-gcc-13.patch from https://tracker.ceph.com/issues/58477
but with an extra #include <cstdint> to avoid dropping std:: prefixes on
integer types.

Fixes: https://tracker.ceph.com/issues/58477
Signed-off-by: Tim Serong <tserong@suse.com>
(cherry picked from commit 796ce63667b460ba9b8d40891f30e45981ba237a)

3 years agolibrados: rados_write_op_operate() uses ObjectOperationImpl for mtime
Casey Bodley [Tue, 23 May 2023 16:56:34 +0000 (12:56 -0400)]
librados: rados_write_op_operate() uses ObjectOperationImpl for mtime

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit b888821da72de1b02e06693b3e693aab7bc90ad7)

3 years agolibrados: rados_aio_write_op_operate() propagates mtime
Casey Bodley [Tue, 23 May 2023 16:56:03 +0000 (12:56 -0400)]
librados: rados_aio_write_op_operate() propagates mtime

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 0bfb144ee64fe9ecd3f27cf94fca832e3ab3b39b)

3 years agolibrados: use ObjectOperationImpl for rados_write_op_t
Casey Bodley [Tue, 23 May 2023 16:31:54 +0000 (12:31 -0400)]
librados: use ObjectOperationImpl for rados_write_op_t

the c++ api uses ObjectOperationImpl to wrap ObjectOperation with
additional storage for an optional mtime. the c api now reuses
ObjectOperationImpl for its write operations only - the mtime isn't
needed for read ops

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 4c8f694741b5d4ba38e934f90e91ff269da96e2a)

3 years agolibrados: aio_operate() supports ObjectWriteOperation::mtime2()
Casey Bodley [Mon, 22 May 2023 21:36:43 +0000 (17:36 -0400)]
librados: aio_operate() supports ObjectWriteOperation::mtime2()

copy the optional mtime logic from operate(), so that mtimes set on the
ObjectOperation are propagated through aio_operate() as well

Fixes: https://tracker.ceph.com/issues/61349
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit cdf54ff1ca5ab95ee0559329b0820a1686d21c54)

3 years agoMerge pull request #52103 from zdover23/wip-doc-2023-06-17-backport-52100-to-quincy
Anthony D'Atri [Sat, 17 Jun 2023 10:40:17 +0000 (06:40 -0400)]
Merge pull request #52103 from zdover23/wip-doc-2023-06-17-backport-52100-to-quincy

quincy: doc/rados: edit firefly tunables section

3 years agodoc/rados: edit firefly tunables section 52103/head
Zac Dover [Sat, 17 Jun 2023 00:51:51 +0000 (10:51 +1000)]
doc/rados: edit firefly tunables section

Edit the firefly tunables section in
/doc/rados/operations/crush-map.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 66eb789d6ce3f38de70e731bcb7d92a307a95181)

3 years agoMerge pull request #52099 from zdover23/wip-doc-2023-06-17-backport-52092-to-quincy
Anthony D'Atri [Fri, 16 Jun 2023 22:51:14 +0000 (18:51 -0400)]
Merge pull request #52099 from zdover23/wip-doc-2023-06-17-backport-52092-to-quincy

quincy: doc/rados: edit crush-map.rst (4 of x)

3 years agodoc/rados: edit crush-map.rst (4 of x) 52099/head
Zac Dover [Fri, 16 Jun 2023 08:49:09 +0000 (18:49 +1000)]
doc/rados: edit crush-map.rst (4 of x)

Edit doc/rados/operations/crush-map.rst.

This cherry-pick required me to alter a crush rule before I could
resolve a merge conflict.

https://tracker.ceph.com/issues/58485

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 01e4d189e020db2ffbe388b8e5cfe01b060c7543)

3 years agoMerge pull request #52094 from zdover23/wip-doc-2023-06-16-backport-52067-to-quincy
Anthony D'Atri [Fri, 16 Jun 2023 21:27:24 +0000 (17:27 -0400)]
Merge pull request #52094 from zdover23/wip-doc-2023-06-16-backport-52067-to-quincy

quincy: doc/rados: edit crush-map.rst (3 of x)

3 years agodoc/rados: edit crush-map.rst (3 of x) 52094/head
Zac Dover [Thu, 15 Jun 2023 03:36:45 +0000 (13:36 +1000)]
doc/rados: edit crush-map.rst (3 of x)

Edit doc/rados/operations/crush-map.rst.

https://tracker.ceph.com/issues/58485

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit c2b08690173374ade7a476fd0ed9d7ea8bb9a87f)

3 years agoMerge pull request #51978 from sseshasa/wip-61624-quincy
Sridhar Seshasayee [Fri, 16 Jun 2023 07:44:09 +0000 (13:14 +0530)]
Merge pull request #51978 from sseshasa/wip-61624-quincy

quincy: PendingReleaseNotes: Document mClock scheduler fixes and enhancements

Reviewed-by: Neha Ojha <nojha@redhat.com>
3 years agoMerge pull request #51689 from vshankar/tr-59726
Yuri Weinstein [Thu, 15 Jun 2023 20:32:35 +0000 (16:32 -0400)]
Merge pull request #51689 from vshankar/tr-59726

quincy: mds: allow unlink from lost+found directory

Reviewed-by: Milind Changire <mchangir@redhat.com>
Reviewed-by: Xiubo Li <xiubli@redhat.com>
3 years agoMerge pull request #51688 from vshankar/tr-61233
Yuri Weinstein [Thu, 15 Jun 2023 20:31:16 +0000 (16:31 -0400)]
Merge pull request #51688 from vshankar/tr-61233

quincy: mds: rdlock_path_xlock_dentry supports returning auth target inode

Reviewed-by: Milind Changire <mchangir@redhat.com>
3 years agoMerge pull request #51507 from lxbsz/wip-59707
Yuri Weinstein [Thu, 15 Jun 2023 20:30:43 +0000 (16:30 -0400)]
Merge pull request #51507 from lxbsz/wip-59707

quincy: mds: do not take the ino which has been used

Reviewed-by: Milind Changire <mchangir@redhat.com>
3 years agoMerge pull request #51486 from vshankar/tr-59718
Yuri Weinstein [Thu, 15 Jun 2023 20:30:07 +0000 (16:30 -0400)]
Merge pull request #51486 from vshankar/tr-59718

quincy: client: use deep-copy when setting permission during make_request

Reviewed-by: Milind Changire <mchangir@redhat.com>
3 years agoMerge pull request #51354 from joscollin/wip-59483-quincy
Yuri Weinstein [Thu, 15 Jun 2023 20:29:36 +0000 (16:29 -0400)]
Merge pull request #51354 from joscollin/wip-59483-quincy

quincy: cephfs-top: check the minimum compatible python version

Reviewed-by: Milind Changire <mchangir@redhat.com>
3 years agoMerge pull request #50989 from lxbsz/wip-59266
Yuri Weinstein [Thu, 15 Jun 2023 20:28:29 +0000 (16:28 -0400)]
Merge pull request #50989 from lxbsz/wip-59266

quincy: client: clear the suid/sgid in fallocate path

Reviewed-by: Milind Changire <mchangir@redhat.com>
3 years agoMerge pull request #50985 from lxbsz/wip-59385
Yuri Weinstein [Thu, 15 Jun 2023 20:26:53 +0000 (16:26 -0400)]
Merge pull request #50985 from lxbsz/wip-59385

quincy: mds: wait for unlink operation to finish

Reviewed-by: Milind Changire <mchangir@redhat.com>
3 years agoMerge pull request #52066 from zdover23/wip-doc-2023-06-15-backport-52040-to-quincy
Anthony D'Atri [Thu, 15 Jun 2023 14:06:49 +0000 (10:06 -0400)]
Merge pull request #52066 from zdover23/wip-doc-2023-06-15-backport-52040-to-quincy

quincy: doc/rados: fix list in crush-map.rst

3 years agoMerge pull request #52070 from zdover23/wip-doc-2023-06-15-backport-52039-to-quincy
Anthony D'Atri [Thu, 15 Jun 2023 13:37:56 +0000 (09:37 -0400)]
Merge pull request #52070 from zdover23/wip-doc-2023-06-15-backport-52039-to-quincy

quincy: doc/rados: edit crush-map.rst (2 of x)

3 years agodoc/rados: edit crush-map.rst (2 of x) 52070/head
Zac Dover [Tue, 13 Jun 2023 15:41:09 +0000 (01:41 +1000)]
doc/rados: edit crush-map.rst (2 of x)

Edit doc/rados/operations/crush-map.rst.

https://tracker.ceph.com/issues/58485

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 77f48d0a88cce844c766c75e330234e0a9169f64)

3 years agodoc/rados: fix list in crush-map.rst 52066/head
Zac Dover [Tue, 13 Jun 2023 16:11:53 +0000 (02:11 +1000)]
doc/rados: fix list in crush-map.rst

Correct the numbering and formatting of an ordered list in
doc/rados/operations/crush-map.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit a1fdd02146883981de21457cb9c9dece21636f82)

3 years agoMerge pull request #51952 from rhcs-dashboard/wip-61282-quincy
Nizamudeen A [Wed, 14 Jun 2023 11:37:18 +0000 (17:07 +0530)]
Merge pull request #51952 from rhcs-dashboard/wip-61282-quincy

quincy: mgr/dashboard: SSO error: AttributeError: 'str' object has no attribute 'decode'

Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
3 years agoMerge pull request #52027 from rhcs-dashboard/wip-61655-quincy
Nizamudeen A [Wed, 14 Jun 2023 05:40:28 +0000 (11:10 +0530)]
Merge pull request #52027 from rhcs-dashboard/wip-61655-quincy

quincy: mgr/dashboard: add popover to cluster status card

Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
3 years agoMerge pull request #52038 from zdover23/wip-doc-2023-06-14-backport-52009-to-quincy
zdover23 [Tue, 13 Jun 2023 17:31:32 +0000 (03:31 +1000)]
Merge pull request #52038 from zdover23/wip-doc-2023-06-14-backport-52009-to-quincy

quincy: doc/rados: add math markup to placement-groups.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
3 years agoMerge pull request #52031 from zdover23/wip-doc-2023-06-13-backport-52018-to-quincy
zdover23 [Tue, 13 Jun 2023 17:31:03 +0000 (03:31 +1000)]
Merge pull request #52031 from zdover23/wip-doc-2023-06-13-backport-52018-to-quincy

quincy: doc/rados: edit crush-map.rst (1 of x)

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
3 years agoMerge pull request #52035 from zdover23/wip-doc-2023-06-14-backport-52028-to-quincy
Anthony D'Atri [Tue, 13 Jun 2023 15:21:20 +0000 (11:21 -0400)]
Merge pull request #52035 from zdover23/wip-doc-2023-06-14-backport-52028-to-quincy

quincy: doc/dev: fix "deploying dev cluster" link

3 years agodoc/rados: add math markup to placement-groups.rst 52038/head
Zac Dover [Mon, 12 Jun 2023 11:32:14 +0000 (21:32 +1000)]
doc/rados: add math markup to placement-groups.rst

Add some math markup to some of the mathematical expressions in
doc/rados/operations/placement-groups.rst.

This change has advantages as well as disadvantages. On the one hand,
the mathematical expressions look nicer and are easier to read.  On the
other hand, the rendered mathematical expressions are not searchable as
a part of the text, which makes CTRL+F searches useless in finding them.

This PR is offered as an RFC on the matter of whether mathematical
expressions should be rendered with the :math: extension.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit b953dbca56bc8c987ad0288a4e2ac50212c3ad81)

3 years agodoc/dev: fix "deploying dev cluster" link 52035/head
Zac Dover [Tue, 13 Jun 2023 11:51:26 +0000 (21:51 +1000)]
doc/dev: fix "deploying dev cluster" link

Fix a link to "Deploying a Development Cluster" that had been broken
since the transition from master to main.

This is the first part of an initiative to improve the vstart
documentation.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit e83949e7edaabe865d77e68be6ea2e41864cc6f4)

3 years agodoc/rados: edit crush-map.rst (1 of x) 52031/head
Zac Dover [Mon, 12 Jun 2023 20:02:59 +0000 (06:02 +1000)]
doc/rados: edit crush-map.rst (1 of x)

Edit doc/rados/operations/crush-map.rst.

https://tracker.ceph.com/issues/58485

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 2e168ed68807cffe6a5199c4be70f519a9f35404)

3 years agomgr/dashboard: add popover to cluster status card 52027/head
Nizamudeen A [Wed, 7 Jun 2023 08:17:56 +0000 (13:47 +0530)]
mgr/dashboard: add popover to cluster status card

Previous dashboard has a popover for the status when there are some
warnings in the Cluster Health. Introducing the same behaviour on the
new landing page

Fixes: https://tracker.ceph.com/issues/61611
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit 947df3d8ed5d9c34614a31df157e672e77d3042c)

3 years agoMerge pull request #51877 from idryomov/wip-61382-quincy
Yuri Weinstein [Mon, 12 Jun 2023 19:31:48 +0000 (15:31 -0400)]
Merge pull request #51877 from idryomov/wip-61382-quincy

quincy: osd/OSDCap: allow rbd.metadata_list method under rbd-read-only profile

Reviewed-by: Mykola Golub <mgolub@suse.com>
3 years agoMerge pull request #51854 from petrutlucian94/wip-61527-quincy
Yuri Weinstein [Mon, 12 Jun 2023 19:31:12 +0000 (15:31 -0400)]
Merge pull request #51854 from petrutlucian94/wip-61527-quincy

quincy: librbd: avoid decrementing iterator before first element

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
3 years agoMerge pull request #51834 from dang/wip-61510-quincy
Yuri Weinstein [Mon, 12 Jun 2023 19:30:35 +0000 (15:30 -0400)]
Merge pull request #51834 from dang/wip-61510-quincy

quincy: RGW - Use correct multipart upload time

3 years agoMerge pull request #51601 from alimaredia/wip-58583-quincy
Yuri Weinstein [Mon, 12 Jun 2023 19:30:01 +0000 (15:30 -0400)]
Merge pull request #51601 from alimaredia/wip-58583-quincy

quincy: rgw: set keys from from master zone on admin api user create

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
3 years agoqa/suites/rados: remove rook coverage from the rados suite 52016/head
Laura Flores [Mon, 5 Jun 2023 20:23:42 +0000 (15:23 -0500)]
qa/suites/rados: remove rook coverage from the rados suite

The rook team relies on a daily CI system to validate
rook changes. It doesn't seem that the teuthology tests
are maintained, so it makes sense to remove them from the
rados suite.

By removing this symlink, rook test coverage will remain
in the orch suite, and coverage will only be removed from the
rados suite.

Workaround for: https://tracker.ceph.com/issues/58585
Signed-off-by: Laura Flores <lflores@redhat.com>
(cherry picked from commit c26674ef4c6cbbdd94c54cafbd66e98704f044d7)

3 years agoMerge pull request #52002 from zdover23/wip-doc-2023-06-12-backport-51994-to-quincy
Anthony D'Atri [Sun, 11 Jun 2023 22:04:37 +0000 (18:04 -0400)]
Merge pull request #52002 from zdover23/wip-doc-2023-06-12-backport-51994-to-quincy

quincy: doc/rados: edit placement-groups.rst (3 of x)

3 years agodoc/rados: edit placement-groups.rst (3 of x) 52002/head
Zac Dover [Sat, 10 Jun 2023 23:00:38 +0000 (09:00 +1000)]
doc/rados: edit placement-groups.rst (3 of x)

Edit doc/rados/operations/placement-groups.rst.

https://tracker.ceph.com/issues/58485

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 25224acac004e9e153018dbff708190df165f5ba)

3 years agoMerge pull request #51999 from zdover23/wip-doc-2023-06-11-backport-51992-to-quincy
Anthony D'Atri [Sun, 11 Jun 2023 13:56:21 +0000 (09:56 -0400)]
Merge pull request #51999 from zdover23/wip-doc-2023-06-11-backport-51992-to-quincy

quincy: doc/rados: edit change-mon-elections

3 years agoMerge pull request #51997 from zdover23/wip-doc-2023-06-11-backport-51991-to-quincy
Anthony D'Atri [Sun, 11 Jun 2023 13:53:41 +0000 (09:53 -0400)]
Merge pull request #51997 from zdover23/wip-doc-2023-06-11-backport-51991-to-quincy

quincy: doc/rados: edit placement-groups.rst (2 of x)

3 years agodoc/rados: edit change-mon-elections 51999/head
Zac Dover [Sat, 10 Jun 2023 02:08:41 +0000 (12:08 +1000)]
doc/rados: edit change-mon-elections

Edit doc/rados/operations/change-mon-elections.rst.

https://tracker.ceph.com/issues/58485

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit dc93181f04f772b53f0c86a34ef43a14bfba6ef8)

3 years agodoc/rados: edit placement-groups.rst (2 of x) 51997/head
Zac Dover [Sat, 10 Jun 2023 01:44:33 +0000 (11:44 +1000)]
doc/rados: edit placement-groups.rst (2 of x)

Edit doc/rados/operations/placement-groups.rst.

https://tracker.ceph.com/issues/58485

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 8bdd27165cbc5249547f7cf776faa37d690b8e5c)

3 years agoMerge pull request #51990 from zdover23/wip-doc-2023-06-09-rados-operations-placement...
colemitchell [Sat, 10 Jun 2023 01:08:08 +0000 (21:08 -0400)]
Merge pull request #51990 from zdover23/wip-doc-2023-06-09-rados-operations-placement-groups-1-of-x-cleanup

quincy: doc/rados: remove git tag in placement-groups in q

Reviewed-by: Cole Mitchell <cole.mitchell.ceph@gmail.com>
3 years agodoc/rados: remove git tag in placement-groups in q 51990/head
Zac Dover [Fri, 9 Jun 2023 23:47:11 +0000 (09:47 +1000)]
doc/rados: remove git tag in placement-groups in q

Remove a merge conflict tag that was left in the Quincy branch as of
commit e3a39c213fc2c666450da05aa320751cf49f58b9. This is a cleanup of a
previous backport.

Signed-off-by: Zac Dover <zac.dover@proton.me>
3 years agoMerge pull request #51985 from zdover23/wip-doc-2023-06-09-backport-51975-to-quincy
Anthony D'Atri [Fri, 9 Jun 2023 13:51:10 +0000 (09:51 -0400)]
Merge pull request #51985 from zdover23/wip-doc-2023-06-09-backport-51975-to-quincy

quincy: doc/rados: edit placement-groups.rst (1 of x)

3 years agodoc/rados: edit placement-groups.rst (1 of x) 51985/head
Zac Dover [Thu, 8 Jun 2023 18:53:34 +0000 (04:53 +1000)]
doc/rados: edit placement-groups.rst (1 of x)

Edit doc/rados/operations/placement-groups.rst.

https://tracker.ceph.com/issues/58485

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Co-authored-by: Cole Mitchell <cole.mitchell.ceph@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit d6e1116d0dfeea54a1aba717dcc6643c2263209c)

3 years agoPendingReleaseNotes: Document mClock scheduler fixes and enhancements 51978/head
Sridhar Seshasayee [Mon, 5 Jun 2023 08:11:28 +0000 (13:41 +0530)]
PendingReleaseNotes: Document mClock scheduler fixes and enhancements

Signed-off-by: Sridhar Seshasayee <sseshasa@redhat.com>
(cherry picked from commit 49aad118aa41a8e66ab65f229c5633ee18c6a3b2)

Conflicts:
   PendingReleaseNotes
- Moved note under ">=17.2.7" section
- Modified doc URL to point to quincy

3 years agoqa: fix journal flush failure issue due to the MDS daemon crashes 51507/head
Xiubo Li [Fri, 5 May 2023 10:41:54 +0000 (18:41 +0800)]
qa: fix journal flush failure issue due to the MDS daemon crashes

After the MDS daemon crashing, the journal flush request will fail.

Signed-off-by: Xiubo Li <xiubli@redhat.com>
(cherry picked from commit d851a9475c30d0b6fa4418c38d04fd602bc785eb)

3 years agoqa: add test support for the alloc ino failing
Xiubo Li [Sat, 18 Sep 2021 02:34:19 +0000 (10:34 +0800)]
qa: add test support for the alloc ino failing

Fixes: https://tracker.ceph.com/issues/52280
Signed-off-by: Xiubo Li <xiubli@redhat.com>
(cherry picked from commit 71797091a25d3153d12def815ee7bd9b361593cd)

3 years agomds: do not take the ino which has been used
Xiubo Li [Wed, 15 Sep 2021 12:58:22 +0000 (20:58 +0800)]
mds: do not take the ino which has been used

When replaying the journals, if the inodetable or the sessionmap
versions do not match, the CInode will be added to the inode_map,
but the ino may still be in the inodetable or sessions' prealloc
inos list.

So when allocating new CInode we should skip them.

Fixes: https://tracker.ceph.com/issues/52280
Signed-off-by: Xiubo Li <xiubli@redhat.com>
(cherry picked from commit a8c63c7919a78497190995b1a542fbcc05e68d92)

3 years agoMerge pull request #50731 from joscollin/wip-58983-quincy
Yuri Weinstein [Thu, 8 Jun 2023 16:29:10 +0000 (12:29 -0400)]
Merge pull request #50731 from joscollin/wip-58983-quincy

quincy: cephfs-top: navigate to home screen when no fs

Reviewed-by: Milind Changire <mchangir@redhat.com>
3 years agoMerge pull request #50732 from lxbsz/wip-58825
Yuri Weinstein [Thu, 8 Jun 2023 16:13:36 +0000 (12:13 -0400)]
Merge pull request #50732 from lxbsz/wip-58825

quincy: mds: make num_fwd and num_retry to __u32

Reviewed-by: Milind Changire <mchangir@redhat.com>
3 years agoMerge pull request #50724 from lxbsz/wip-59006
Yuri Weinstein [Thu, 8 Jun 2023 16:12:46 +0000 (12:12 -0400)]
Merge pull request #50724 from lxbsz/wip-59006

quincy: mds: force replay sessionmap version

Reviewed-by: Milind Changire <mchangir@redhat.com>
3 years agoMerge pull request #50717 from joscollin/wip-58808-quincy
Yuri Weinstein [Thu, 8 Jun 2023 16:11:40 +0000 (12:11 -0400)]
Merge pull request #50717 from joscollin/wip-58808-quincy

quincy: cephfs-top: dump values to stdout and -d [--delay] option fix

Reviewed-by: Milind Changire <mchangir@redhat.com>
3 years agoMerge pull request #50668 from gf-mse/quincy-latest
Yuri Weinstein [Thu, 8 Jun 2023 16:11:16 +0000 (12:11 -0400)]
Merge pull request #50668 from gf-mse/quincy-latest

quincy: backport commit 70425c7 -- client/fuse: set max_idle_threads to the correct value (critical, ceph-fuse with libfuse3 is nearly useless without it)

Reviewed-by: Milind Changire <mchangir@redhat.com>
3 years agoMerge pull request #50528 from mchangir/wip-59000-quincy
Yuri Weinstein [Thu, 8 Jun 2023 16:10:41 +0000 (12:10 -0400)]
Merge pull request #50528 from mchangir/wip-59000-quincy

quincy: cephfs_mirror: correctly set top level dir permissions

Reviewed-by: Kotresh HR <khiremat@redhat.com>
3 years agoMerge pull request #50522 from trociny/wip-59018-quincy
Yuri Weinstein [Thu, 8 Jun 2023 16:09:58 +0000 (12:09 -0400)]
Merge pull request #50522 from trociny/wip-59018-quincy

quincy: tools/cephfs-data-scan: support for multi-datapool

Reviewed-by: Milind Changire <mchangir@redhat.com>
3 years agoMerge pull request #51940 from zdover23/wip-doc-2023-06-06-backport-51914-to-quincy
zdover23 [Thu, 8 Jun 2023 14:06:47 +0000 (00:06 +1000)]
Merge pull request #51940 from zdover23/wip-doc-2023-06-06-backport-51914-to-quincy

quincy: doc/rados: edit pools.rst (2 of x)

Reviewed-by: Cole Mitchell <cole.mitchell.ceph@gmail.com>
3 years agoMerge pull request #51971 from zdover23/wip-doc-2023-06-08-backport-51958-to-quincy
Anthony D'Atri [Thu, 8 Jun 2023 12:28:43 +0000 (08:28 -0400)]
Merge pull request #51971 from zdover23/wip-doc-2023-06-08-backport-51958-to-quincy

quincy: doc/rados: edit pools.rst (4 of x)

3 years agodoc/rados: edit pools.rst (4 of x) 51971/head
Zac Dover [Wed, 7 Jun 2023 10:32:03 +0000 (20:32 +1000)]
doc/rados: edit pools.rst (4 of x)

Edit doc/operations/rados/pools.rst.

https://tracker.ceph.com/issues/58485

Co-authored-by: Cole Mitchell <cole.mitchell.ceph@gmail.com>
Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 92cf93b1fe185ec8b4c77cf2dcd0b21b25931d5d)

3 years agoMerge pull request #51944 from ljflores/wip-verify-quincy
Laura Flores [Wed, 7 Jun 2023 14:14:09 +0000 (09:14 -0500)]
Merge pull request #51944 from ljflores/wip-verify-quincy

quincy: .github: Give folks 30 seconds to fill out the checklist