]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
19 months agocephadm: black format daemons/nvmeof.py
John Mulligan [Thu, 9 Nov 2023 18:58:41 +0000 (13:58 -0500)]
cephadm: black format daemons/nvmeof.py

Signed-off-by: John Mulligan <jmulligan@redhat.com>
19 months agocephadm: black format daemons/nfs.py
John Mulligan [Thu, 9 Nov 2023 18:58:30 +0000 (13:58 -0500)]
cephadm: black format daemons/nfs.py

Signed-off-by: John Mulligan <jmulligan@redhat.com>
19 months agocephadm: black format daemons/monitoring.py
John Mulligan [Thu, 9 Nov 2023 18:58:17 +0000 (13:58 -0500)]
cephadm: black format daemons/monitoring.py

Signed-off-by: John Mulligan <jmulligan@redhat.com>
19 months agocephadm: black format daemons/iscsi.py
John Mulligan [Thu, 9 Nov 2023 18:58:03 +0000 (13:58 -0500)]
cephadm: black format daemons/iscsi.py

Signed-off-by: John Mulligan <jmulligan@redhat.com>
19 months agocephadm: black format daemons/ingress.py
John Mulligan [Thu, 9 Nov 2023 18:57:49 +0000 (13:57 -0500)]
cephadm: black format daemons/ingress.py

Signed-off-by: John Mulligan <jmulligan@redhat.com>
19 months agocephadm: black format daemons/custom.py
John Mulligan [Thu, 9 Nov 2023 18:57:34 +0000 (13:57 -0500)]
cephadm: black format daemons/custom.py

Signed-off-by: John Mulligan <jmulligan@redhat.com>
19 months agocephadm: black format daemons/ceph.py
John Mulligan [Thu, 9 Nov 2023 18:57:15 +0000 (13:57 -0500)]
cephadm: black format daemons/ceph.py

Signed-off-by: John Mulligan <jmulligan@redhat.com>
19 months agocephadm: convert all deploy tests to use funkypatch fixture
John Mulligan [Thu, 9 Nov 2023 19:26:35 +0000 (14:26 -0500)]
cephadm: convert all deploy tests to use funkypatch fixture

During the refactor of various daemon type classes some of the tests had
been converted to funkypatch in order to deal with imports occuring over
multiple files. However, this conversion was done piece by piece in
order to make clear what was changing. This left the functions in this
file inconsistent. Change all the remaining function to use funkypatch
for consistency.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
19 months agocephadm: sort imports import daemons/__init__.py
John Mulligan [Thu, 9 Nov 2023 18:49:03 +0000 (13:49 -0500)]
cephadm: sort imports import daemons/__init__.py

Signed-off-by: John Mulligan <jmulligan@redhat.com>
19 months agocephadm: move ceph classes to a new file
John Mulligan [Thu, 9 Nov 2023 18:46:45 +0000 (13:46 -0500)]
cephadm: move ceph classes to a new file

Move the ceph classes (Ceph, OSD, CephExporter) along with a few heavily
linked functions to a new ceph.py file under the daemons dir.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
19 months agocephadm: move snmp class to a new file
John Mulligan [Thu, 9 Nov 2023 18:11:21 +0000 (13:11 -0500)]
cephadm: move snmp class to a new file

Signed-off-by: John Mulligan <jmulligan@redhat.com>
19 months agocephadm: move monitoring class to a new file
John Mulligan [Thu, 9 Nov 2023 18:02:20 +0000 (13:02 -0500)]
cephadm: move monitoring class to a new file

Signed-off-by: John Mulligan <jmulligan@redhat.com>
19 months agocephadm: move nfs class to a new file
John Mulligan [Thu, 9 Nov 2023 14:57:56 +0000 (09:57 -0500)]
cephadm: move nfs class to a new file

Signed-off-by: John Mulligan <jmulligan@redhat.com>
19 months agocephadm: move iscsi class to a new file
John Mulligan [Thu, 9 Nov 2023 00:42:27 +0000 (19:42 -0500)]
cephadm: move iscsi class to a new file

Signed-off-by: John Mulligan <jmulligan@redhat.com>
19 months agocephadm: move nvmeof class to a new file
John Mulligan [Thu, 9 Nov 2023 00:34:58 +0000 (19:34 -0500)]
cephadm: move nvmeof class to a new file

Signed-off-by: John Mulligan <jmulligan@redhat.com>
19 months agocephadm: move haproxy and keepalived classes to a new file
John Mulligan [Thu, 9 Nov 2023 00:23:20 +0000 (19:23 -0500)]
cephadm: move haproxy and keepalived classes to a new file

Signed-off-by: John Mulligan <jmulligan@redhat.com>
19 months agocephadm: move tracing class to a new file
John Mulligan [Wed, 8 Nov 2023 21:04:15 +0000 (16:04 -0500)]
cephadm: move tracing class to a new file

Signed-off-by: John Mulligan <jmulligan@redhat.com>
19 months agocephadm: move custom container class to a new file
John Mulligan [Wed, 8 Nov 2023 20:58:36 +0000 (15:58 -0500)]
cephadm: move custom container class to a new file

Signed-off-by: John Mulligan <jmulligan@redhat.com>
19 months agocephadm: start a cephadmlib.daemons package
John Mulligan [Wed, 8 Nov 2023 20:45:13 +0000 (15:45 -0500)]
cephadm: start a cephadmlib.daemons package

Signed-off-by: John Mulligan <jmulligan@redhat.com>
19 months agocephamd: update tests to use should_log_to_journald from context_getters
John Mulligan [Thu, 9 Nov 2023 18:46:04 +0000 (13:46 -0500)]
cephamd: update tests to use should_log_to_journald from context_getters

Update tests to import should_log_to_journald from context_getters - the
module that actually defines that function. This makes later refactoring
easier.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
19 months agocephadm: update tests to import dict_get* functions from proper module
John Mulligan [Thu, 9 Nov 2023 14:57:24 +0000 (09:57 -0500)]
cephadm: update tests to import dict_get* functions from proper module

Update the test that import dict_get and dict_get_join to use the
context_getters module - the module that actually defines the functions.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
19 months agocephadm: use funkypatch for setting up common patches in deploy tests
John Mulligan [Thu, 9 Nov 2023 00:21:10 +0000 (19:21 -0500)]
cephadm: use funkypatch for setting up common patches in deploy tests

Add a shim function and convert to the use of the FunkyPatcher class in
the test_deploy.py test functions. Use a shim as to not have to change
all the tests (yet).

Signed-off-by: John Mulligan <jmulligan@redhat.com>
19 months agocephadm: create deployment_utils module
John Mulligan [Sun, 5 Nov 2023 21:03:53 +0000 (16:03 -0500)]
cephadm: create deployment_utils module

Create a deployment_utils module for deployment related functions that
don't have a better home.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
19 months agocephadm: convert test_mon_crush_location to use funkypatch fixture
John Mulligan [Wed, 8 Nov 2023 19:31:12 +0000 (14:31 -0500)]
cephadm: convert test_mon_crush_location to use funkypatch fixture

The test_mon_crush_location test always seems to have me tinkering
with it during refactoring. Re-do the fixtures to use funkpatch instead
of mock.patch and normal monkeypatch. This looks nicer (IMO) and should
avoid having to frequently mess with it when moving functions during future
refactoring.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
19 months agocephadm: update test to use funkypatch fixture
John Mulligan [Sun, 20 Aug 2023 17:50:31 +0000 (13:50 -0400)]
cephadm: update test to use funkypatch fixture

Signed-off-by: John Mulligan <jmulligan@redhat.com>
19 months agocephadm: add a new funkypatch fixture based on mock.patch and pytest
John Mulligan [Sun, 20 Aug 2023 17:50:00 +0000 (13:50 -0400)]
cephadm: add a new funkypatch fixture based on mock.patch and pytest

This fixture acts like a combination of mock.patch and pytest's
monkeypatch fixture. It has the additional feature of automatically
finding and patching the same object imported in other modules.  If you
have 'from x import y', where y is a function or class, in both a.py and
b.py it will patch both instances (so long as both a and b are already
imported).
This behavior is useful for cephadm because of the heavy use of the
`from x import y` idiom and how cephadm is being actively refactored.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
19 months agocephadm: add a make_run_dir function
John Mulligan [Sun, 5 Nov 2023 21:03:34 +0000 (16:03 -0500)]
cephadm: add a make_run_dir function

This function is roughly the same as make_var_run only it doesn't rely
on shelling out to the install command. Eventually, it will be used
to replace make_var_run in certain locations.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
19 months agoMerge pull request #54304 from cyx1231st/wip-crimson-make-crosscore-send-ordered
Matan Breizman [Thu, 30 Nov 2023 12:39:31 +0000 (14:39 +0200)]
Merge pull request #54304 from cyx1231st/wip-crimson-make-crosscore-send-ordered

crimson/osd: support to send messages concurrently with exclusive phases

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: chunmei-liu <chunmei.liu@intel.com>
19 months agoMerge pull request #54697 from yuvalif/wip-yuval-63314
Yuval Lifshitz [Thu, 30 Nov 2023 12:23:28 +0000 (14:23 +0200)]
Merge pull request #54697 from yuvalif/wip-yuval-63314

rgw/kafka/amqp: fix race conditionn in async completion handlers

reviewed-by: cbodley

19 months agoMerge pull request #54305 from rhcs-dashboard/add-tags
Nizamudeen A [Thu, 30 Nov 2023 09:07:29 +0000 (14:37 +0530)]
Merge pull request #54305 from rhcs-dashboard/add-tags

mgr/dashboard: add tags to edit bucket

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ankush Behl <cloudbehl@gmail.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
19 months agoMerge pull request #54355 from nobuto-m/info-rbd-stats-pools
Nizamudeen A [Thu, 30 Nov 2023 08:08:54 +0000 (13:38 +0530)]
Merge pull request #54355 from nobuto-m/info-rbd-stats-pools

mgr/dashboard: info on why RBD graphs are empty

Reviewed-by: Ankush Behl <cloudbehl@gmail.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
19 months agoMerge PR #53431 into main
Venky Shankar [Thu, 30 Nov 2023 05:58:10 +0000 (11:28 +0530)]
Merge PR #53431 into main

* refs/pull/53431/head:
qa: add test cases to verify error reporting works as expected
mgr: fix some doc strings in object_format.py
mgr/tests: test returning error status works as expected
mgr: make object_format's Responder class capable of responding err status
mgr/nfs: report proper errno with err status

Reviewed-by: John Mulligan <jmulligan@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
19 months agoMerge pull request #54631 from rishabh-d-dave/mgr-vol-tests
Rishabh Dave [Thu, 30 Nov 2023 05:17:42 +0000 (10:47 +0530)]
Merge pull request #54631 from rishabh-d-dave/mgr-vol-tests

qa/cephfs: improvements for name generators in test_volumes.py

Reviewed-by: Venky Shankar <vshankar@redhat.com>
19 months agoMerge pull request #50359 from adamemerson/wip-remove-rgwsi_rados
Casey Bodley [Wed, 29 Nov 2023 21:54:36 +0000 (21:54 +0000)]
Merge pull request #50359 from adamemerson/wip-remove-rgwsi_rados

rgw: Remove `RGWSI_RADOS`

Reviewed-by: Casey Bodley <cbodley@redhat.com>
19 months agoMerge pull request #54616 from rishabh-d-dave/mgr-vol-improvements
Rishabh Dave [Wed, 29 Nov 2023 19:20:26 +0000 (00:50 +0530)]
Merge pull request #54616 from rishabh-d-dave/mgr-vol-improvements

mgr/vol: make some improvements

Reviewed-by: Venky Shankar <vshankar@redhat.com>
19 months agoMerge pull request #54308 from rishabh-d-dave/mgr-vol-flake-warnings
Rishabh Dave [Wed, 29 Nov 2023 19:19:28 +0000 (00:49 +0530)]
Merge pull request #54308 from rishabh-d-dave/mgr-vol-flake-warnings

mgr/vol: fix flake8 warnings

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Milind Changire <mchangir@redhat.com>
19 months agoMerge pull request #54424 from phlogistonjohn/jjm-cephadm-daemon-to-container
Adam King [Wed, 29 Nov 2023 18:48:46 +0000 (13:48 -0500)]
Merge pull request #54424 from phlogistonjohn/jjm-cephadm-daemon-to-container

cephadm: add a more generic daemon_to_container function

Reviewed-by: Adam King <adking@redhat.com>
19 months agorgw: Remove `RGWSI_RADOS` 50359/head
Adam C. Emerson [Tue, 6 Dec 2022 00:51:25 +0000 (19:51 -0500)]
rgw: Remove `RGWSI_RADOS`

And remove the last places that reference it.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
19 months agorgw: Remove `RGWSI_RADOS` from `RGWSI_SysObj*`
Adam C. Emerson [Mon, 5 Dec 2022 22:10:51 +0000 (17:10 -0500)]
rgw: Remove `RGWSI_RADOS` from `RGWSI_SysObj*`

Simply use the RADOS handle and `rgw_rados_ref` directly.

Also make `rgw::AccessListFilter` a std::function.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
19 months agorgw: Remove `RGWSI_RADOS` from `RGWSI_User_RADOS`
Adam C. Emerson [Fri, 2 Dec 2022 07:59:11 +0000 (02:59 -0500)]
rgw: Remove `RGWSI_RADOS` from `RGWSI_User_RADOS`

Simply use the RADOS handle and `rgw_rados_ref` directly.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
19 months agorgw: Remove `RGWSI_RADOS` from `RGWSI_Zone_Tools`
Adam C. Emerson [Fri, 2 Dec 2022 07:49:09 +0000 (02:49 -0500)]
rgw: Remove `RGWSI_RADOS` from `RGWSI_Zone_Tools`

Simply use the RADOS handle directly.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
19 months agorgw: Remove `RGWSI_RADOS` from `RGWSI_Zone`
Adam C. Emerson [Fri, 2 Dec 2022 07:30:39 +0000 (02:30 -0500)]
rgw: Remove `RGWSI_RADOS` from `RGWSI_Zone`

Simply use the RADOS handle directly.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
19 months agorgw: Remove `RGWSI_RADOS` from `RGWSI_Notify`
Adam C. Emerson [Fri, 2 Dec 2022 07:17:44 +0000 (02:17 -0500)]
rgw: Remove `RGWSI_RADOS` from `RGWSI_Notify`

Simply use the RADOS handle directly.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
19 months agorgw: Remove `RGWSI_RADOS` from `RGWSI_MDLog`
Adam C. Emerson [Fri, 2 Dec 2022 06:55:47 +0000 (01:55 -0500)]
rgw: Remove `RGWSI_RADOS` from `RGWSI_MDLog`

Simply use the RADOS handle and `rgw_rados_ref` directly.

Also move `async_processor` out from `RGWSI_RADOS` and into
`RGWServices_Def`. This is as good a place as it for any, for now, as
it's reachable by everyone who needs it and exists through the
lifetime of the process.

Eventually it's going to go away due to coroutinization, anyway.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
19 months agorgw: Remove `RGWSI_RADOS` from `RGWSI_ConfigKey_RADOS`
Adam C. Emerson [Fri, 2 Dec 2022 06:14:02 +0000 (01:14 -0500)]
rgw: Remove `RGWSI_RADOS` from `RGWSI_ConfigKey_RADOS`

Simply use the RADOS handle directly.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
19 months agorgw: Remove `RGWSI_RADOS` from `RGWSI_Cls`
Adam C. Emerson [Fri, 2 Dec 2022 05:55:48 +0000 (00:55 -0500)]
rgw: Remove `RGWSI_RADOS` from `RGWSI_Cls`

Simply use the RADOS handle and `rgw_rados_ref` directly.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
19 months agorgw: Remove RGWSI_RADOS from RGWSI_BI_RADOS
Adam C. Emerson [Fri, 2 Dec 2022 05:26:00 +0000 (00:26 -0500)]
rgw: Remove RGWSI_RADOS from RGWSI_BI_RADOS

Simply use the RADOS handle and `rgw_rados_ref` directly.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
19 months agorgw: Distentangle `rgw_rados_ref` from `RGWSI_RADOS`
Adam C. Emerson [Fri, 2 Dec 2022 04:25:54 +0000 (23:25 -0500)]
rgw: Distentangle `rgw_rados_ref` from `RGWSI_RADOS`

`RGWSI_RADOS` has no reason to exist. `rgw_rados_ref`, on the other
hand, is fairly useful. Move `rgw_rados_ref` to
`store/rados/rgw_tools.h` along with a function to create one.

Then clean up the fallout.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
19 months agoMerge pull request #54619 from cbodley/wip-rgw-sal-get-stats-async
Casey Bodley [Wed, 29 Nov 2023 16:24:26 +0000 (16:24 +0000)]
Merge pull request #54619 from cbodley/wip-rgw-sal-get-stats-async

rgw/sal: clean up read_stats_async() callbacks

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
19 months agoMerge pull request #54582 from phlogistonjohn/jjm-cephadm-more-template-error
Adam King [Wed, 29 Nov 2023 15:55:54 +0000 (10:55 -0500)]
Merge pull request #54582 from phlogistonjohn/jjm-cephadm-more-template-error

cephadm: add a custom template not found exception with diagnostic info

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
19 months agoqa/cephfs: improvements for name generators in test_volumes.py 54631/head
Rishabh Dave [Thu, 23 Nov 2023 10:40:00 +0000 (16:10 +0530)]
qa/cephfs: improvements for name generators in test_volumes.py

Generate a name that is shorter and easier to remember.

Also, write a simpler, faster & better helper method for generating
unique names. This method will also have shorter and more concise name,
so this will be easier to type and easier to read.

Fixes: https://tracker.ceph.com/issues/63680
Signed-off-by: Rishabh Dave <ridave@redhat.com>
19 months agoMerge pull request #54618 from alimaredia/wip-remove-vstart-runner-radosgw-admin...
Casey Bodley [Wed, 29 Nov 2023 15:18:57 +0000 (15:18 +0000)]
Merge pull request #54618 from alimaredia/wip-remove-vstart-runner-radosgw-admin-task

qa: remove vstart runner from radosgw_admin task

Reviewed-by: Casey Bodley <cbodley@redhat.com>
19 months agoMerge pull request #54578 from ronen-fr/wip-rf-dedup-clang
Ronen Friedman [Wed, 29 Nov 2023 13:39:37 +0000 (15:39 +0200)]
Merge pull request #54578 from ronen-fr/wip-rf-dedup-clang

tools: modify ceph_dedup_tool to maintain Clang 15 compatibility

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
19 months agoMerge pull request #48483 from batrick/i48673
Venky Shankar [Wed, 29 Nov 2023 10:13:54 +0000 (15:43 +0530)]
Merge pull request #48483 from batrick/i48673

mds: revert standby-replay trimming changes

Reviewed-by: Venky Shankar <vshankar@redhat.com>
19 months agorgw/kafka/amqp: fix race conditionn in async completion handlers 54697/head
Yuval Lifshitz [Tue, 28 Nov 2023 17:49:03 +0000 (17:49 +0000)]
rgw/kafka/amqp: fix race conditionn in async completion handlers

Fixes: https://tracker.ceph.com/issues/63314
Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>
19 months agoMerge pull request #54287 from Matan-B/wip-matanb-crimson-do_osd_ops_execute-v3
Matan Breizman [Wed, 29 Nov 2023 08:13:41 +0000 (10:13 +0200)]
Merge pull request #54287 from Matan-B/wip-matanb-crimson-do_osd_ops_execute-v3

crimson/osd: execute `submit_error_log` as an ExclusivePhase

Reviewed-by: Samuel Just <sjust@redhat.com>
19 months agoMerge pull request #54209 from VallariAg/wip-xml-scanner
Vallari Agrawal [Wed, 29 Nov 2023 06:51:02 +0000 (12:21 +0530)]
Merge pull request #54209 from VallariAg/wip-xml-scanner

qa: use Remote.run_unit_test and ValgrindScanner

19 months agoMerge pull request #54685 from zdover23/wip-doc-2023-11-28-rados-tshooting-log-and...
zdover23 [Wed, 29 Nov 2023 04:39:10 +0000 (05:39 +0100)]
Merge pull request #54685 from zdover23/wip-doc-2023-11-28-rados-tshooting-log-and-debug-small-repair

doc/rados: improve "Ceph Subsystems"

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
19 months agoMerge pull request #54684 from zdover23/wip-doc-2023-11-28-rados-ops-pgs-typo
zdover23 [Wed, 29 Nov 2023 04:34:43 +0000 (05:34 +0100)]
Merge pull request #54684 from zdover23/wip-doc-2023-11-28-rados-ops-pgs-typo

doc/rados: ops/pgs: s/power of 2/power of two

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
19 months agodoc/rados: improve "Ceph Subsystems" 54685/head
Zac Dover [Tue, 28 Nov 2023 05:08:48 +0000 (06:08 +0100)]
doc/rados: improve "Ceph Subsystems"

Improve the English in the subsection "Ceph Subsystems" in the section
"Subsystem, Log and Debug Settings" [sic] in
doc/rados/troubleshooting/log-and-debug.rst.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
19 months agodoc/rados: ops/pgs: s/power of 2/power of two 54684/head
Zac Dover [Tue, 28 Nov 2023 04:29:50 +0000 (05:29 +0100)]
doc/rados: ops/pgs: s/power of 2/power of two

Change "power of 2" to "power of two" in
doc/rados/operations/placement-groups.rst.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
19 months agoMerge pull request #51229 from jsoref/spelling-rgw
Daniel Gryniewicz [Tue, 28 Nov 2023 14:38:01 +0000 (09:38 -0500)]
Merge pull request #51229 from jsoref/spelling-rgw

rgw: Fix spelling

19 months agoMerge pull request #53456 from petrutlucian94/dokan_case_insensitive
Venky Shankar [Tue, 28 Nov 2023 13:58:20 +0000 (19:28 +0530)]
Merge pull request #53456 from petrutlucian94/dokan_case_insensitive

dokan: simple case insensitive emulation

Reviewed-by: Venky Shankar <vshankar@redhat.com>
19 months agomgr/vol: rectify variable name 54616/head
Rishabh Dave [Sun, 19 Nov 2023 10:46:27 +0000 (16:16 +0530)]
mgr/vol: rectify variable name

Method "open_clone_subvolume_pair()" returns subvolumes, yet return
value is named as clone_volume. Rectify this mistake.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
19 months agoqa: remove vstart runner from radosgw_admin task 54618/head
Ali Maredia [Wed, 22 Nov 2023 15:57:41 +0000 (10:57 -0500)]
qa: remove vstart runner from radosgw_admin task

Fixes: https://tracker.ceph.com/issues/63583
Signed-off-by: Ali Maredia <amaredia@redhat.com>
19 months agoMerge pull request #54621 from cbodley/wip-rgw-posix-warning 54658/head
Casey Bodley [Mon, 27 Nov 2023 17:16:05 +0000 (17:16 +0000)]
Merge pull request #54621 from cbodley/wip-rgw-posix-warning

rgw/posix: fix unused variable warning

Reviewed-by: Jiffin Tony Thottan <thottanjiffin@gmail.com>
Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
19 months agorgw: fix spelling errors 51229/head
Josh Soref [Thu, 23 Jun 2022 01:24:12 +0000 (21:24 -0400)]
rgw: fix spelling errors

* access
* acquire
* across
* algorithm
* alternatively
* ambiguous
* attributes
* authenticated
* automatically
* based
* between
* beware
* bootstrap
* bucket
* cache
* character
* check
* cleanup
* combinations
* committed
* comparison
* compatibility
* concurrent
* conditions
* conjunction
* connections
* considered
* contains
* correct
* creates
* crypto
* dependencies
* dequeued
* dequeuing
* derivative
* described
* determine
* deterministic
* detritus
* discrepancy
* display
* either way
* elements
* entirely
* entries
* error
* everything
* expected
* explicitly
* extend
* false
* fclose
* feature
* following
* foreign
* format
* forward
* functionality
* functions
* generated
* getting
* gracefully
* happened
* hashicorp
* healthcheck
* hierarchy
* however
* http
* identify
* idleness
* ignored
* incremental
* information
* initialization
* length
* locally
* macros
* malformed
* means
* mechanism
* multipart
* multiple
* must
* namespace
* necessary
* nonexistent
* notifications
* occurred
* official
* outputs
* outputted
* overridden
* ownership
* parallelism
* partition
* passthrough
* pause
* penguin
* perform
* permission
* populated
* position
* preferably
* prefixes
* presumably
* previous
* print
* quadruple
* reference
* regardless
* registry
* renewed
* request
* requires
* reshard
* resource
* result to
* satisfy
* secret
* separate
* separator
* setting
* shouldn't
* skipping
* some
* somehow
* something
* specific
* struct
* succeeded
* success
* successful
* successfully
* syntax
* testing
* truncated
* unambiguously
* unittest
* unmodified
* unnecessary
* valid_action
* verifying
* versioning
* visible
* whatever
* whenever

Signed-off-by: Josh Soref <2119212+jsoref@users.noreply.github.com>
19 months agorgw: rewrite rgw_admin help text
Josh Soref [Thu, 23 Jun 2022 08:11:09 +0000 (04:11 -0400)]
rgw: rewrite rgw_admin help text

* The line wrapping was fairly random.
* There were cases where words appeared to be doubled.
  - In fact one was an argument
  - the other was the start of the help text.

Signed-off-by: Josh Soref <2119212+jsoref@users.noreply.github.com>
19 months agoMerge pull request #54626 from cbodley/wip-cmake-rocksdb-uring
Casey Bodley [Mon, 27 Nov 2023 14:20:31 +0000 (14:20 +0000)]
Merge pull request #54626 from cbodley/wip-cmake-rocksdb-uring

cmake/rocksdb: make sure dependencies build before rocksdb

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
19 months agoMerge pull request #54531 from rhcs-dashboard/port-manipulation-rgw
Nizamudeen A [Mon, 27 Nov 2023 12:18:33 +0000 (17:48 +0530)]
Merge pull request #54531 from rhcs-dashboard/port-manipulation-rgw

mgr/dashboard: get rgw port from ssl_endpoint

Reviewed-by: Ankush Behl <cloudbehl@gmail.com>
19 months agoMerge pull request #54459 from AliMasarweh/wip-alimasa-2pc-remove-issue
Ali Masarwa [Mon, 27 Nov 2023 10:43:46 +0000 (12:43 +0200)]
Merge pull request #54459 from AliMasarweh/wip-alimasa-2pc-remove-issue

RGW: make new rados support old RGW 2pc remove

Reviewed-by: yuvalif, cbodley
19 months agoMerge pull request #54664 from zdover23/wip-doc-2023-11-27-rados-troubleshooting...
zdover23 [Mon, 27 Nov 2023 05:57:01 +0000 (15:57 +1000)]
Merge pull request #54664 from zdover23/wip-doc-2023-11-27-rados-troubleshooting-troubleshooting-mon-everything-failed

doc/rados: edit "Everything Failed! Now What?"

Reviewed-by: Antony D'Atri <anthony.datri@gmail.com>
19 months agodoc/rados: edit "Everything Failed! Now What?" 54664/head
Zac Dover [Mon, 27 Nov 2023 00:17:17 +0000 (10:17 +1000)]
doc/rados: edit "Everything Failed! Now What?"

Edit the section "Everything Failed! Now what?" in
doc/rados/troubleshooting/troubleshooting-mon.rst.

Co-authored-by: Anthoy D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
19 months agoRGW: make new rados support old RGW 2pc remove 54459/head
Ali Masarwa [Tue, 31 Oct 2023 13:55:41 +0000 (15:55 +0200)]
RGW: make new rados support old RGW 2pc remove

Signed-off-by: Ali Masarwa <ali.saed.masarwa@gmail.com>
19 months agoMerge pull request #53290 from ThomasLamprecht/debian-fix-ceph-mgr-requires
Kefu Chai [Sun, 26 Nov 2023 08:28:55 +0000 (16:28 +0800)]
Merge pull request #53290 from ThomasLamprecht/debian-fix-ceph-mgr-requires

debian: add missing bcrypt to ceph-mgr .requires to fix resulting package dependencies

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
19 months agoMerge pull request #54656 from zdover23/wip-doc-2023-11-25-rados-troubleshooting...
zdover23 [Sun, 26 Nov 2023 04:04:20 +0000 (14:04 +1000)]
Merge pull request #54656 from zdover23/wip-doc-2023-11-25-rados-troubleshooting-mon-mon-store-failures-1-of-x

doc/rados: edit "monitor store failures"

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
19 months agodebian: add missing bcrypt to manager .requires 53290/head
Thomas Lamprecht [Tue, 5 Sep 2023 11:28:07 +0000 (13:28 +0200)]
debian: add missing bcrypt to manager .requires

The `ceph-mgr` package lost its dependency on `python3-bcrypt` when
the dependencies got moved from d/control to a dh_python3 compatible
requires file. Add it again as the bcrypt module is still used there.

Otherwise one gets errors when, e.g., calling `ceph -s` after a fresh
installation:

> 13 mgr modules have failed dependencies
> Module 'balancer' has failed dependency: No module named 'bcrypt'
> Module 'crash' has failed dependency: No module named 'bcrypt'
> Module 'devicehealth' has failed dependency: No module named 'bcrypt'
> Module 'iostat' has failed dependency: No module named 'bcrypt'
> Module 'nfs' has failed dependency: No module named 'bcrypt'
> Module 'orchestrator' has failed dependency: No module named 'bcrypt'
> Module 'pg_autoscaler' has failed dependency: No module named 'bcrypt'
> Module 'progress' has failed dependency: No module named 'bcrypt'
> Module 'rbd_support' has failed dependency: No module named 'bcrypt'
> Module 'restful' has failed dependency: No module named 'bcrypt'
> Module 'status' has failed dependency: No module named 'bcrypt'
> Module 'telemetry' has failed dependency: No module named 'bcrypt'
> Module 'volumes' has failed dependency: No module named 'bcrypt'

Fixes: https://tracker.ceph.com/issues/63637
Fixes: ef19547e83e ("debian: add .requires for specifying python3 deps")
Signed-off-by: Thomas Lamprecht <t.lamprecht@proxmox.com>
19 months agodoc/rados: edit "monitor store failures" 54656/head
Zac Dover [Fri, 24 Nov 2023 21:33:24 +0000 (07:33 +1000)]
doc/rados: edit "monitor store failures"

Edit the section "Monitor Store Failures" in
doc/rados/troubleshooting/troubleshooting-mon.rst.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
19 months agomgr/vol: re-write for better readability
Rishabh Dave [Sun, 19 Nov 2023 10:56:16 +0000 (16:26 +0530)]
mgr/vol: re-write for better readability

Instead of writing like this  -

  if abcd1.abcd2(abcd3) and abcd4 == abcd5
print('efgh6')
  if abcd7.abcd8(abcd9) and abcd4 == abcd5
print('efgh10')

Write like this because it easier to read, especially in case of the
patch where condition under is really long -

  if abcd4 == abcd5:
    if abcd1.abcd2(abcd3):
print('abcd4')
    if abcd5.abcd8(abcd9):
print('abcd5')

Signed-off-by: Rishabh Dave <ridave@redhat.com>
19 months agoMerge pull request #54625 from zdover23/wip-doc-2023-11-23-rados-troubleshooting...
zdover23 [Fri, 24 Nov 2023 21:06:53 +0000 (07:06 +1000)]
Merge pull request #54625 from zdover23/wip-doc-2023-11-23-rados-troubleshooting-mon-client-cant-connect

doc/rados: edit "client can't connect..."

Reviewed-by: Cole Mitchell <cole.mitchell.ceph@gmail.com>
19 months agoMerge pull request #52931 from yuvalif/wip-yuval-lua-teuthology
Yuval Lifshitz [Fri, 24 Nov 2023 09:38:51 +0000 (11:38 +0200)]
Merge pull request #52931 from yuvalif/wip-yuval-lua-teuthology

rgw/test/lua: add lua integration tests suite

reviewed-by: TRYTOBE8TME, cbodley

19 months agoMerge pull request #54637 from yuvalif/wip-yuval-62136
Yuval Lifshitz [Fri, 24 Nov 2023 09:36:03 +0000 (11:36 +0200)]
Merge pull request #54637 from yuvalif/wip-yuval-62136

rgw/test/kafka: let consumer read events from the beginning

reviewed-by: thotz

19 months agoMerge pull request #54516 from cbodley/wip-63537
Casey Bodley [Fri, 24 Nov 2023 02:47:55 +0000 (02:47 +0000)]
Merge pull request #54516 from cbodley/wip-63537

rgw: object lock avoids 32-bit truncation of RetainUntilDate

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
19 months agoencoding: use concepts for chrono encoding 54516/head
Casey Bodley [Wed, 15 Nov 2023 20:28:46 +0000 (15:28 -0500)]
encoding: use concepts for chrono encoding

Signed-off-by: Casey Bodley <cbodley@redhat.com>
19 months agorgw: object lock uses 64-bit encoding for RetainUntilDate
Casey Bodley [Wed, 15 Nov 2023 21:24:47 +0000 (16:24 -0500)]
rgw: object lock uses 64-bit encoding for RetainUntilDate

the default encoding of ceph::real_time truncates seconds to uint32_t,
so stores the wrong timestamp for object lock enforcement

Fixes: https://tracker.ceph.com/issues/63537
Signed-off-by: Casey Bodley <cbodley@redhat.com>
19 months agoencoding: add round_trip_encode()/decode() for chrono types
Casey Bodley [Wed, 15 Nov 2023 20:29:35 +0000 (15:29 -0500)]
encoding: add round_trip_encode()/decode() for chrono types

the default encodings for chrono types were made to be
backward-compatible with utime_t, so truncated seconds to 32 bits

adds new functions that encode these chrono types using their underlying
representation, which for ceph::real_time and ceph::timespan is
'nanoseconds as uint64_t'

Signed-off-by: Casey Bodley <cbodley@redhat.com>
19 months agoMerge pull request #54600 from cbodley/wip-rgw-period-realm-name-encode
Casey Bodley [Fri, 24 Nov 2023 00:15:53 +0000 (00:15 +0000)]
Merge pull request #54600 from cbodley/wip-rgw-period-realm-name-encode

rgw: fix RGWPeriod encoding after removing realm_name

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
Reviewed-by: Jiffin Tony Thottan <thottanjiffin@gmail.com>
19 months agoMerge pull request #54297 from linuxbox2/wip-librgw-tcmalloc
Casey Bodley [Fri, 24 Nov 2023 00:15:02 +0000 (00:15 +0000)]
Merge pull request #54297 from linuxbox2/wip-librgw-tcmalloc

rgw: link only radosgw with ALLOC_LIBS

Reviewed-by: Casey Bodley <cbodley@redhat.com>
19 months agoMerge pull request #53504 from davidhall586/Bug62105
Casey Bodley [Fri, 24 Nov 2023 00:14:08 +0000 (00:14 +0000)]
Merge pull request #53504 from davidhall586/Bug62105

rgw: SignatureDoesNotMatch for certain RGW Admin Ops endpoints w/v4 auth

Reviewed-by: Casey Bodley <cbodley@redhat.com>
19 months agoMerge pull request #50148 from cbodley/wip-58750
Casey Bodley [Fri, 24 Nov 2023 00:13:17 +0000 (00:13 +0000)]
Merge pull request #50148 from cbodley/wip-58750

rgw: Head/GetObject support partNumber

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
19 months agoMerge pull request #50790 from jzhu116-bloomberg/wip-51772
Casey Bodley [Fri, 24 Nov 2023 00:10:01 +0000 (00:10 +0000)]
Merge pull request #50790 from jzhu116-bloomberg/wip-51772

rgw/swift: preserve dashes/underscores in swift user metadata names

Reviewed-by: Casey Bodley <cbodley@redhat.com>
19 months agorgw: fix the ret cond check CreateBucket::Execute() 50790/head
Jane Zhu [Wed, 1 Nov 2023 16:32:52 +0000 (12:32 -0400)]
rgw: fix the ret cond check CreateBucket::Execute()

Signed-off-by: Juan Zhu <jzhu4@dev-10-34-20-139.pw1.bcc.bloomberg.com>
19 months agorgw: modify ret cond in middle of CreateBucket::Execute()
Ali Maredia [Wed, 20 Sep 2023 04:12:15 +0000 (04:12 +0000)]
rgw: modify ret cond in middle of CreateBucket::Execute()

Return prevents swift metadata from being removed
if bucket already exists.

Signed-off-by: Ali Maredia <amaredia@redhat.com>
19 months agorgw/swift: convert underscores to hyphens in swift user metadata names
Jane Zhu [Tue, 8 Aug 2023 08:17:47 +0000 (04:17 -0400)]
rgw/swift: convert underscores to hyphens in swift user metadata names

Signed-off-by: Juan Zhu <jzhu4@dev-10-34-20-139.pw1.bcc.bloomberg.com>
19 months agorgw/swift: preserve dashes/underscores in swift user metadata names
Jane Zhu [Thu, 30 Mar 2023 05:23:55 +0000 (01:23 -0400)]
rgw/swift: preserve dashes/underscores in swift user metadata names

Signed-off-by: Juan Zhu <jzhu116@bloomberg.net>
19 months agoMerge pull request #54641 from likid0/ceph_session_tags_fixes
Anthony D'Atri [Thu, 23 Nov 2023 22:38:42 +0000 (17:38 -0500)]
Merge pull request #54641 from likid0/ceph_session_tags_fixes

doc/radosgw: Fix JSON typo in Principal Tag example code snippet

19 months agodoc/radosgw: Fix JSON typo in Principal Tag example code snippet 54641/head
Daniel Parkes [Thu, 23 Nov 2023 21:15:52 +0000 (22:15 +0100)]
doc/radosgw: Fix JSON typo in Principal Tag example code snippet

Signed-off-by: Daniel Parkes <dparkes@redhat.com>
19 months agorgw/quota: remove base class AsyncRefreshHandler 54619/head
Casey Bodley [Wed, 22 Nov 2023 19:42:07 +0000 (14:42 -0500)]
rgw/quota: remove base class AsyncRefreshHandler

instead of using a virtual `allocate_refresh_handler()` to create an
object to call the virtual `AsyncRefreshHandler::init_fetch()` on, just
provide one virtual `init_refresh()` to start the operation. this avoids
the need for `AsyncRefreshHandler` altogether

Signed-off-by: Casey Bodley <cbodley@redhat.com>
19 months agorgw/quota: use intrusive_ptr for RefCountedWaitObject
Casey Bodley [Wed, 22 Nov 2023 19:29:23 +0000 (14:29 -0500)]
rgw/quota: use intrusive_ptr for RefCountedWaitObject

instead of relying on async_refresh_response/fail to manage ref counts
manually, just stash an intrusive_ptr in AsyncRefreshHandler for the
duration of the async operation

Signed-off-by: Casey Bodley <cbodley@redhat.com>
19 months agocls/rgw: cls_bucket_head_async uses intrusive_ptr for RGWGetDirHeader_CB
Casey Bodley [Wed, 22 Nov 2023 17:32:14 +0000 (12:32 -0500)]
cls/rgw: cls_bucket_head_async uses intrusive_ptr for RGWGetDirHeader_CB

Signed-off-by: Casey Bodley <cbodley@redhat.com>