]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
16 months agodoc/glossary: add "Crimson" entry 56072/head
Zac Dover [Fri, 8 Mar 2024 17:17:59 +0000 (03:17 +1000)]
doc/glossary: add "Crimson" entry

Add a "Crimson" entry to the glossary.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit b31e061cc087b31a7e9e841dd21e7403a2197378)

16 months agoMerge pull request #56039 from zdover23/wip-doc-2024-03-08-backport-56010-to-squid
zdover23 [Sat, 9 Mar 2024 07:20:51 +0000 (17:20 +1000)]
Merge pull request #56039 from zdover23/wip-doc-2024-03-08-backport-56010-to-squid

squid: doc/start: add Slack invite link

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
16 months agoMerge pull request #55998 from guits/wip-64749-squid
Adam King [Fri, 8 Mar 2024 19:59:45 +0000 (14:59 -0500)]
Merge pull request #55998 from guits/wip-64749-squid

squid: mgr/node-proxy: handle 'None' statuses returned by RedFish

Reviewed-by: Adam King <adking@redhat.com>
16 months agoMerge pull request #56056 from zdover23/wip-doc-2024-03-08-backport-56045-to-squid
Anthony D'Atri [Fri, 8 Mar 2024 15:59:42 +0000 (10:59 -0500)]
Merge pull request #56056 from zdover23/wip-doc-2024-03-08-backport-56045-to-squid

squid: doc/rados: restore PGcalc tool

16 months agodoc/rados: restore PGcalc tool 56056/head
Zac Dover [Thu, 7 Mar 2024 17:29:50 +0000 (03:29 +1000)]
doc/rados: restore PGcalc tool

Restore the PGcalc tool to the documentation suite.

Co-authored-by: Josh Durgin <jdurgin@redhat.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit eaaf72253123de1a66f163f651046817faa97a1a)

16 months agodoc/start: add Slack invite link 56039/head
Zac Dover [Thu, 7 Mar 2024 03:01:47 +0000 (13:01 +1000)]
doc/start: add Slack invite link

Add a link to the ceph-storage Slack invitation page. Previously the
link went to a plain old "this is the ceph-storage Slack" page that did
not direct the reader to sign up.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit dee319e61204b2ee9ac13562c2c7075ef0f2ea4b)

16 months agoMerge pull request #56011 from zdover23/wip-doc-2024-03-07-backport-55995-to-squid
Anthony D'Atri [Thu, 7 Mar 2024 15:34:54 +0000 (10:34 -0500)]
Merge pull request #56011 from zdover23/wip-doc-2024-03-07-backport-55995-to-squid

squid: doc/architecture: correct typo

16 months agoMerge pull request #55926 from idryomov/wip-pr-55897-squid
Ilya Dryomov [Thu, 7 Mar 2024 14:00:39 +0000 (15:00 +0100)]
Merge pull request #55926 from idryomov/wip-pr-55897-squid

squid: src/seastar: update seastar submodule to fix FTBFS

Reviewed-by: Kefu Chai <kefu.chai@scylladb.com>
16 months agoMerge pull request #55992 from rhcs-dashboard/wip-64731-squid
Nizamudeen A [Thu, 7 Mar 2024 04:31:27 +0000 (10:01 +0530)]
Merge pull request #55992 from rhcs-dashboard/wip-64731-squid

squid: mgr/dashboard: fixed cephfs mount command

Reviewed-by: Nizamudeen A <nia@redhat.com>
16 months agodoc/architecture: correct typo 56011/head
Zac Dover [Wed, 6 Mar 2024 11:40:10 +0000 (21:40 +1000)]
doc/architecture: correct typo

s/client/clients/ where necessary, and add a link to the glossary.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit ae08855cf870173dce2a47a28f3bbb22e7ae0ca2)

16 months agoMerge pull request #56001 from zdover23/wip-doc-2024-03-07-backport-55982-to-squid
Anthony D'Atri [Wed, 6 Mar 2024 22:22:29 +0000 (17:22 -0500)]
Merge pull request #56001 from zdover23/wip-doc-2024-03-07-backport-55982-to-squid

squid: doc/dev: edit teuthology workflow

16 months agodoc/dev: edit teuthology workflow 56001/head
Zac Dover [Wed, 6 Mar 2024 07:15:20 +0000 (17:15 +1000)]
doc/dev: edit teuthology workflow

Improve a couple of sentences in
doc/dev/developer_guide_testing_integration_tests/tests-integration-testing-teutology-workflow.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 51796e80f35da8ca13b72f31eeafefd4c1e40773)

16 months agomgr/node-proxy: handle 'None' statuses returned by RedFish 55998/head
Guillaume Abrioux [Tue, 5 Mar 2024 10:05:18 +0000 (10:05 +0000)]
mgr/node-proxy: handle 'None' statuses returned by RedFish

Looks like RedFish might return 'None' values for some attributes.

for instance:

```
[root@ceph-node-01 ~]# curl -s -k -X GET https://169.254.1.1/redfish/v1/Systems/System.Embedded.1/Storage/AHCI.SL.6-1/Drives/Disk.Direct.0-0:AHCI.SL.6-1 -H "X-Auth-Token: 3264251c28191fa5e7c9ebec49ef90fc"  | jq .Status
{
  "Health": "OK",
  "HealthRollup": "OK",
  "State": "Enabled"
}
[root@ceph-node-01 ~]# curl -s -k -X GET https://169.254.1.1/redfish/v1/Systems/System.Embedded.1/Storage/NonRAID.Slot.2-1/Drives/Disk.Bay.0:Enclosure.Internal.0-1:NonRAID.Slot.2-1 -H "X-Auth-Token: 3264251c28191fa5e7c9ebec49ef90fc" | jq .Status
{
  "Health": null,
  "HealthRollup": null,
  "State": "Enabled"
}
[root@ceph-node-01 ~]#
```

Although this seems to be a bug from RedFish, we need to handle
the case when it happens otherwise it makes the mgr orchestrator module
throw an error.

The idea here is to create a new status "unknown" when we can't fetch the
real status of a component.

Fixes: https://tracker.ceph.com/issues/64712
Signed-off-by: Guillaume Abrioux <gabrioux@ibm.com>
(cherry picked from commit cc279a3dd23d9219e508b80512f363a4ae577392)

16 months agomgr/dashboard: fixed cephfs mount command 55992/head
Ivo Almeida [Tue, 5 Mar 2024 12:37:21 +0000 (12:37 +0000)]
mgr/dashboard: fixed cephfs mount command

Fixes: https://tracker.ceph.com/issues/64716
Signed-off-by: Ivo Almeida <ialmeida@redhat.com>
(cherry picked from commit eeb09b19581d353fb68f86bb4c2871f026a35c29)

16 months agoMerge pull request #55935 from zdover23/wip-doc-2024-03-05-backport-55918-to-squid
Anthony D'Atri [Tue, 5 Mar 2024 00:53:54 +0000 (19:53 -0500)]
Merge pull request #55935 from zdover23/wip-doc-2024-03-05-backport-55918-to-squid

squid: doc/rados: link to pg setting commands

16 months agoMerge pull request #55932 from zdover23/wip-doc-2024-03-05-backport-55924-to-squid
Anthony D'Atri [Tue, 5 Mar 2024 00:52:44 +0000 (19:52 -0500)]
Merge pull request #55932 from zdover23/wip-doc-2024-03-05-backport-55924-to-squid

squid: doc/architecture: remove pleonasm

16 months agodoc/rados: link to pg setting commands 55935/head
Zac Dover [Mon, 4 Mar 2024 10:41:16 +0000 (20:41 +1000)]
doc/rados: link to pg setting commands

Link to the instructions for manually setting the number of PGs per
pool, from the mention of placement groups. These instructions are
included here in response to a request from Ronen Friedman on the
occasion of the removal of links to the PGcalc (see
https://github.com/ceph/ceph/pull/55899#pullrequestreview-1912940118).

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 9da81b87ca161370c869b49f5d4e6b50edd54a0e)

16 months agodoc/architecture: remove pleonasm 55932/head
Zac Dover [Mon, 4 Mar 2024 13:41:20 +0000 (23:41 +1000)]
doc/architecture: remove pleonasm

Remove the word "detailed" in a sentence immediately following a
sentence containing the word "detail".

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 7791509741d8c21e273a46374a087dcca53a2816)

16 months agoMerge pull request #55893 from petrutlucian94/wip-64675-squid
Ilya Dryomov [Mon, 4 Mar 2024 18:29:38 +0000 (19:29 +0100)]
Merge pull request #55893 from petrutlucian94/wip-64675-squid

squid: rbd-wnbd: use a single daemon process per host

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
16 months agosrc/seastar: update seastar submodule to fix FTBFS 55926/head
Matan Breizman [Sun, 3 Mar 2024 09:45:56 +0000 (09:45 +0000)]
src/seastar: update seastar submodule to fix FTBFS

See: https://github.com/ceph/seastar/commit/d382f247629a7349afc0cea495a1cd0502dc0b22

Signed-off-by: Matan Breizman <mbreizma@redhat.com>
(cherry picked from commit 945b18195465583334cb88ba69c12bbf42aedd6d)

16 months agoMerge pull request #55873 from cbodley/wip-64663-squid
Casey Bodley [Mon, 4 Mar 2024 17:25:45 +0000 (17:25 +0000)]
Merge pull request #55873 from cbodley/wip-64663-squid

squid: unittest-seastar-socket: tolerate connection_reset in test_unexpected_down

Reviewed-by: Matan Breizman <mbreizma@redhat.com>
16 months agoMerge pull request #55907 from idryomov/wip-64589-squid
Ilya Dryomov [Mon, 4 Mar 2024 17:04:00 +0000 (18:04 +0100)]
Merge pull request #55907 from idryomov/wip-64589-squid

squid: crimson: update seastar submodule to fix prometheus build error

Reviewed-by: Samuel Just <sjust@redhat.com>
16 months agocrimson/.../interruptible_future: remove SEASTAR_CONCEPT guard 55907/head
Samuel Just [Fri, 1 Mar 2024 20:00:32 +0000 (20:00 +0000)]
crimson/.../interruptible_future: remove SEASTAR_CONCEPT guard

Seastar commit 8dc3398a removed this macro, no longer necessary.

Signed-off-by: Samuel Just <sjust@redhat.com>
(cherry picked from commit 2806cdb15109c391c828b3419e9d141991d4003d)

16 months agosrc/seastar: update seastar submodule to fix prometheus build failure
Samuel Just [Fri, 1 Mar 2024 19:10:00 +0000 (19:10 +0000)]
src/seastar: update seastar submodule to fix prometheus build failure

Fixes: https://tracker.ceph.com/issues/64589
Signed-off-by: Samuel Just <sjust@redhat.com>
(cherry picked from commit 7f42b1d0b7295c2b62d204d14ebe38b6654ba0ac)

16 months agoMerge pull request #55900 from zdover23/wip-doc-2024-03-03-backport-55899-to-squid
Anthony D'Atri [Sun, 3 Mar 2024 13:07:35 +0000 (08:07 -0500)]
Merge pull request #55900 from zdover23/wip-doc-2024-03-03-backport-55899-to-squid

squid: doc/rados: remove PGcalc from docs

16 months agodoc/rados: remove PGcalc from docs 55900/head
Zac Dover [Sun, 3 Mar 2024 10:28:00 +0000 (20:28 +1000)]
doc/rados: remove PGcalc from docs

Remove mention of the "PG calc" tool from the documentation. I have
removed all mention of this in one fell swoop to help posterity restore
mention of this tool if we decide we need to do so.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit ccb851d2a431647124754e1252df66ed11d0e900)

16 months agorbd-wnbd: use the right AdminSocket instance 55893/head
Lucian Petrut [Tue, 26 Sep 2023 11:52:31 +0000 (11:52 +0000)]
rbd-wnbd: use the right AdminSocket instance

The rbd-wnbd daemon currently caches one rados context per cluster.
However, it's registering hooks against the global context
admin socket, which won't be available. For this reason,
the "rbd-wnbd stats" command no longer works.

To address this issue, we'll ensure that rbd-wnbd sets command hooks
against the right admin socket instance, leveraging the image
context.

Signed-off-by: Lucian Petrut <lpetrut@cloudbasesolutions.com>
(cherry picked from commit a14003c492ad26ed4eef13e3d73e42212dd2bd93)

16 months agorbd-wnbd: adjust admin socket hook to accept image path
Lucian Petrut [Tue, 26 Sep 2023 08:00:19 +0000 (08:00 +0000)]
rbd-wnbd: adjust admin socket hook to accept image path

For each rbd-wnbd mapping we set an admin socket hook that can
be used to retrieve IO stats.

Now that the same daemon is reused for multiple mappings, we need
to distinguish the images when receiving a "stats" request.

For this reason, we'll add the image identifier to "wnbd stats"
admin socket commands.

Signed-off-by: Lucian Petrut <lpetrut@cloudbasesolutions.com>
(cherry picked from commit 83d58ab307063b4a37f3a297af2b0e6ba27e84dc)

16 months agoqa: update rbd-wnbd test, retrying image rm operations
Lucian Petrut [Wed, 2 Aug 2023 09:50:37 +0000 (09:50 +0000)]
qa: update rbd-wnbd test, retrying image rm operations

The "rbd-wnbd unmap" command is currently telling the WNBD driver
to remove the mapping without contacting the rbd-wnbd daemon
and waiting for it to perform its cleanup.

For this reason, attempting to delete the image immediately after
unmapping it can fail due to existing watchers.

As a temporary solution, we'll retry the image remove operation.
At a later time, we'll update the "rbd-wnbd unmap" command to go
through the rbd-wnbd daemon, ensuring that all the necessary
cleanup is performed before returning.

While at it, we're dropping a redundant LOG.error call so that we
won't print expected exceptions.

Signed-off-by: Lucian Petrut <lpetrut@cloudbasesolutions.com>
(cherry picked from commit 0d73d31b6f92d45c602d704b39d11d11536b0a93)

16 months agorbd-wnbd: update registry settings handling
Lucian Petrut [Wed, 19 Jul 2023 12:32:40 +0000 (12:32 +0000)]
rbd-wnbd: update registry settings handling

This commit will store the mapping config in the Windows registry
only after initializing the mapping. This ensures that we aren't
replacing the registry settings for already mapped images.

We'll also check if the registry setting was added by us before
cleaning it up.

Signed-off-by: Lucian Petrut <lpetrut@cloudbasesolutions.com>
(cherry picked from commit 5f9c69d53c522f3b939c91c974cedb9fdd085a60)

16 months agorbd-wnbd: use one daemon process per host
Lucian Petrut [Mon, 12 Jun 2023 13:16:39 +0000 (13:16 +0000)]
rbd-wnbd: use one daemon process per host

We're currently using one rbd-wnbd process per image mapping.
Since OSD connections aren't shared across those processes,
we end up with an excessive amount of TCP sessions, potentially
exceeding Windows limits:
https://ask.cloudbase.it/question/3598/ceph-for-windows-tcp-session-count/

In order to improve rbd-wnbd's scalability, we're going to use
a single process per host (unless "-f" is passed when mapping the
image, in which case the daemon will run as part of the same
process). This allows OSD sessions to be shared across image
mappings.

Another advantage is that the "ceph-rbd" service starts faster,
especially when having a large number of image mappings.

Signed-off-by: Lucian Petrut <lpetrut@cloudbasesolutions.com>
(cherry picked from commit 661c55002db8bc91037d8150278dacb9a1cfe46b)

16 months agorbd-wnbd: introduce RbdMapping class
Lucian Petrut [Mon, 12 Jun 2023 08:00:40 +0000 (08:00 +0000)]
rbd-wnbd: introduce RbdMapping class

We're moving most of the WNBD mapping handling to a separate
class called RbdMapping. This simplifies cleanup and makes it
easier to reuse.

The WnbdHandler class covers WNBD specific operations and IO
callbacks while the RbdMapping wrapper will take care of RBD
operations.

A subsequent change will make use of it while switching from
one process per mapping to a single process per host.

While at it, we're also moving the rbd-wnbd config helpers
to separate files.

Signed-off-by: Lucian Petrut <lpetrut@cloudbasesolutions.com>
(cherry picked from commit 96e8850ff3b6661c86eb361051282c8d66ca2031)

16 months agoMerge pull request #55879 from zdover23/wip-doc-2024-03-02-backport-55869-to-squid
Anthony D'Atri [Fri, 1 Mar 2024 23:59:06 +0000 (18:59 -0500)]
Merge pull request #55879 from zdover23/wip-doc-2024-03-02-backport-55869-to-squid

squid: doc/install: add manual RADOSGW install procedure

16 months agodoc/install: add manual RADOSGW install procedure 55879/head
Zac Dover [Fri, 1 Mar 2024 12:11:14 +0000 (22:11 +1000)]
doc/install: add manual RADOSGW install procedure

Add a manual RADOSGW installation procedure to
doc/install/manual-deployment.rst. This procedure was developed by Janne
Johansson and reported to the ceph-users mailing list on 29 Jan 2024
here: https://lists.ceph.io/hyperkitty/list/ceph-users@ceph.io/message/LB3YRIKAPOHXYCW7MKLVUJPYWYRQVARU/

Co-authored-by: Janne Johansson <icepic.dz@gmail.com>
Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 565bc9503838906995fa48f59debcd2843775b18)

16 months agounittest-seastar-socket: tolerate connection_reset in test_unexpected_down 55873/head
Samuel Just [Fri, 16 Feb 2024 21:40:17 +0000 (21:40 +0000)]
unittest-seastar-socket: tolerate connection_reset in test_unexpected_down

Fixes: https://tracker.ceph.com/issues/64457
Signed-off-by: Samuel Just <sjust@redhat.com>
(cherry picked from commit e84518e63806ca5beef57d995923dcd3698276e9)

16 months agounittest-seastar-socket: debug to error on unexpected return from dispatch_rw_bounded
Samuel Just [Fri, 16 Feb 2024 00:04:05 +0000 (00:04 +0000)]
unittest-seastar-socket: debug to error on unexpected return from dispatch_rw_bounded

Related: https://tracker.ceph.com/issues/64457
Signed-off-by: Samuel Just <sjust@redhat.com>
(cherry picked from commit 66969c07dc0cd5e0f01685ec19de26dae09279f5)

16 months agoMerge pull request #55826 from afreen23/wip-64639-squid
Nizamudeen A [Fri, 1 Mar 2024 05:14:14 +0000 (10:44 +0530)]
Merge pull request #55826 from afreen23/wip-64639-squid

squid: mgr/dashboard: fix roles page for roles without policies

Reviewed-by: Nizamudeen A <nia@redhat.com>
16 months agoMerge pull request #55851 from zdover23/wip-doc-2024-03-01-backport-55834-to-squid
Anthony D'Atri [Fri, 1 Mar 2024 01:35:08 +0000 (20:35 -0500)]
Merge pull request #55851 from zdover23/wip-doc-2024-03-01-backport-55834-to-squid

squid: doc/dev: edit internals.rst

16 months agodoc/dev: edit internals.rst 55851/head
Zac Dover [Thu, 29 Feb 2024 07:40:57 +0000 (17:40 +1000)]
doc/dev: edit internals.rst

Edit doc/dev/internals.rst. Make a few sentences pithier.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit e16ab1df72c3640db907e377da7ca97ce3eaa26e)

16 months agoMerge pull request #55848 from zdover23/wip-doc-2024-03-01-backport-55835-to-squid
Anthony D'Atri [Thu, 29 Feb 2024 23:44:36 +0000 (18:44 -0500)]
Merge pull request #55848 from zdover23/wip-doc-2024-03-01-backport-55835-to-squid

squid: doc/glossary: improve "MDS" entry

16 months agodoc/glossary: improve "MDS" entry 55848/head
Zac Dover [Thu, 29 Feb 2024 08:08:10 +0000 (18:08 +1000)]
doc/glossary: improve "MDS" entry

Improve the entry for "MDS" in doc/glossary.rst by linking to the
"ceph-mds" man page and mentioning the relationship between clients and
MDS (or MDSes).

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 2c6983d8b4e841f2bfbc4e4f82bb0e41e10aec7e)

16 months agoMerge pull request #55654 from cbodley/wip-64501-squid
Casey Bodley [Thu, 29 Feb 2024 15:45:33 +0000 (15:45 +0000)]
Merge pull request #55654 from cbodley/wip-64501-squid

squid: rgw/datalog: RGWDataChangesLog::add_entry() uses null_yield

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
16 months agoMerge pull request #55791 from cbodley/wip-64601-squid
Casey Bodley [Thu, 29 Feb 2024 15:44:46 +0000 (15:44 +0000)]
Merge pull request #55791 from cbodley/wip-64601-squid

squid: test/rgw: increase timeouts in unittest_rgw_dmclock_scheduler

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
16 months agoMerge pull request #55673 from BBoozmen/oozmen_squid_backport_55286
Casey Bodley [Thu, 29 Feb 2024 13:05:01 +0000 (13:05 +0000)]
Merge pull request #55673 from BBoozmen/oozmen_squid_backport_55286

squid: backport: rgw/lc: decorating log events with more details

Reviewed-by: Casey Bodley <cbodley@redhat.com>
16 months agoMerge pull request #55810 from rhcs-dashboard/wip-64609-squid
Nizamudeen A [Thu, 29 Feb 2024 11:09:53 +0000 (16:39 +0530)]
Merge pull request #55810 from rhcs-dashboard/wip-64609-squid

squid: mgr/dashboard: fix subvolume group edit

Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
16 months agomgr/dashboard: fix roles page for roles without policies 55826/head
Nizamudeen A [Tue, 27 Feb 2024 07:18:56 +0000 (12:48 +0530)]
mgr/dashboard: fix roles page for roles without policies

If there is no permission policies attached to a role, it fails the
UI with an exception.

Fixes: https://tracker.ceph.com/issues/64588
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit 5f3f31921c9f3ed909a94f287bfd4cc3f0987649)

16 months agoMerge pull request #55728 from cbodley/wip-squid-pr-55627
Casey Bodley [Wed, 28 Feb 2024 15:00:20 +0000 (15:00 +0000)]
Merge pull request #55728 from cbodley/wip-squid-pr-55627

squid: rgw: set log_data_change to true during link olh only in multisite config

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
16 months agomgr/dashboard: fix subvolume group edit 55810/head
Ivo Almeida [Mon, 19 Feb 2024 12:42:34 +0000 (12:42 +0000)]
mgr/dashboard: fix subvolume group edit

Fixes: https://tracker.ceph.com/issues/64487
Signed-off-by: Ivo Almeida <ialmeida@redhat.com>
(cherry picked from commit 8aaa0bca47fa49073e797ee427bcec282ef1adbe)

16 months agoMerge pull request #55798 from zdover23/wip-doc-2024-02-28-backport-55782-to-squid
Anthony D'Atri [Tue, 27 Feb 2024 23:51:59 +0000 (18:51 -0500)]
Merge pull request #55798 from zdover23/wip-doc-2024-02-28-backport-55782-to-squid

squid: doc/rados: add "change public network" procedure

16 months agodoc/rados: add "change public network" procedure 55798/head
Zac Dover [Mon, 26 Feb 2024 10:03:48 +0000 (20:03 +1000)]
doc/rados: add "change public network" procedure

Add a procedure to /doc/rados/operations/add-or-rm-mons.rst that
explains how to change the public_network in a Ceph cluster deployed
with cephadm. This procedure was developed by Eugen Block, and can be
seen in its original form here:
https://heiterbiswolkig.blogs.nde.ag/2024/02/22/cephadm-change-public-network/

Co-authored-by: Eugen Block <eblock@nde.ag>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 0b6739a4aa2dd931d97b8af9b3a352969f8767c2)

16 months agotest/rgw: increase timeouts in unittest_rgw_dmclock_scheduler 55791/head
Casey Bodley [Mon, 26 Feb 2024 14:38:52 +0000 (09:38 -0500)]
test/rgw: increase timeouts in unittest_rgw_dmclock_scheduler

1ms sleeps are generally below the timer's resolution. increase run_for()
durations to 50ms to make the tests far less sensitive to timing. in
practice, none of the sleeps actually wait the full 50ms

Fixes: https://tracker.ceph.com/issues/64568
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit b4f3ddfe4385c12baa0f44fff9d2708c445625d3)

16 months agoMerge pull request #55703 from afreen23/wip-64529-squid
Pedro Gonzalez Gomez [Tue, 27 Feb 2024 10:39:05 +0000 (11:39 +0100)]
Merge pull request #55703 from afreen23/wip-64529-squid

squid: mgr/dashboard: Handle errors for /api/osd/settings

Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
Reviewed-by: ivoalmeida <NOT@FOUND>
16 months agoMerge pull request #55753 from zdover23/wip-doc-2024-02-26-backport-55683-to-squid
zdover23 [Mon, 26 Feb 2024 10:25:58 +0000 (20:25 +1000)]
Merge pull request #55753 from zdover23/wip-doc-2024-02-26-backport-55683-to-squid

squid: doc/man/8/mount.ceph.rst: add more mount options

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
16 months agodoc/man/8/mount.ceph.rst: add more mount options 55753/head
Xiubo Li [Wed, 22 Nov 2023 08:13:08 +0000 (16:13 +0800)]
doc/man/8/mount.ceph.rst: add more mount options

Fixes: https://tracker.ceph.com/issues/62837
Signed-off-by: Xiubo Li <xiubli@redhat.com>
(cherry picked from commit d5639cc670d248da7c84e6f2eaf73ce40bd93db4)

16 months agoMerge pull request #55748 from zdover23/wip-doc-2024-02-26-backport-55739-to-squid
Anthony D'Atri [Mon, 26 Feb 2024 06:09:33 +0000 (01:09 -0500)]
Merge pull request #55748 from zdover23/wip-doc-2024-02-26-backport-55739-to-squid

squid: doc/glossary: Add "OMAP" to glossary

16 months agodoc/glossary: Add "OMAP" to glossary 55748/head
Zac Dover [Sun, 25 Feb 2024 21:14:25 +0000 (07:14 +1000)]
doc/glossary: Add "OMAP" to glossary

Add an entry for "OMAP" to the glossary. This commit represents only the
first improvement to the documentation of OMAP in the Ceph docs suite.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 1d8baa1d4c3583f4a8dc0f46d81f198a3d027e4d)

16 months agoMerge pull request #55736 from zdover23/wip-doc-2024-02-25-backport-55731-to-squid
Anthony D'Atri [Sun, 25 Feb 2024 05:57:40 +0000 (00:57 -0500)]
Merge pull request #55736 from zdover23/wip-doc-2024-02-25-backport-55731-to-squid

squid: doc/dev: fix spelling in crimson.rst

16 months agodoc/dev: fix spelling in crimson.rst 55736/head
Zac Dover [Fri, 23 Feb 2024 16:21:54 +0000 (02:21 +1000)]
doc/dev: fix spelling in crimson.rst

Repair a confusing sentence in doc/dev/crimson.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit dfdb5e124a19e0c5ce1e7ba47e574e0504e7091f)

16 months agoMerge pull request #55734 from zdover23/wip-doc-2024-02-24-backport-55529-to-squid
Anthony D'Atri [Fri, 23 Feb 2024 17:32:11 +0000 (12:32 -0500)]
Merge pull request #55734 from zdover23/wip-doc-2024-02-24-backport-55529-to-squid

squid: doc/rbd: repair ordered list

16 months agodoc/rbd: repair ordered list 55734/head
Zac Dover [Fri, 23 Feb 2024 16:05:42 +0000 (02:05 +1000)]
doc/rbd: repair ordered list

Fix the numbering in an ordered list. The numbering was thrown off
because a ".. prompt" directive was improperly indented (it wasn't
indented at all).

See https://github.com/ceph/ceph/pull/55540#discussion_r1500051264

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 6df12da2cd0946092fa49f8dbb7661e4487c3c22)

16 months agoMerge pull request #55723 from zdover23/wip-doc-2024-02-23-backport-55540-to-squid
zdover23 [Fri, 23 Feb 2024 16:07:32 +0000 (02:07 +1000)]
Merge pull request #55723 from zdover23/wip-doc-2024-02-23-backport-55540-to-squid

squid: doc: Add NVMe-oF gateway documentation

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
16 months agorgw: set log_data_change to true during link olh only in 55728/head
Shilpa Jagannath [Sat, 17 Feb 2024 05:09:07 +0000 (00:09 -0500)]
rgw: set log_data_change to true during link olh only in
multisite config

Signed-off-by: Shilpa Jagannath <smanjara@redhat.com>
(cherry picked from commit 6cc1c2d4e0c8fd4a29ee63b2eee954f909eec2bc)

16 months agodoc: Add NVMe-oF gateway documentation 55723/head
Orit Wasserman [Mon, 12 Feb 2024 12:39:38 +0000 (14:39 +0200)]
doc: Add NVMe-oF gateway documentation

- Add nvmeof-initiator-esx.rst
- Add nvmeof-initiator-linux.rst
- Add nvmeof-initiators.rst
- Add nvmeof-overview.rst
- Add nvmeof-requirements.rst
- Add nvmeof-target-configure.rst
- Add links to rbd-integrations.rst

Co-authored-by: Ilya Dryomov <idryomov@redhat.com>
Co-authored-by: Zac Dover <zac.dover@proton.me>
Signed-off-by: Orit Wasserman <owasserm@ibm.com>
(cherry picked from commit 9f86c35a0d308c6ff24d3a033f5314ec86bf896b)

16 months agoMerge pull request #55707 from rkachach/fix_issue_64523_64522
Redouane Kachach [Thu, 22 Feb 2024 14:17:29 +0000 (15:17 +0100)]
Merge pull request #55707 from rkachach/fix_issue_64523_64522

squid: backport of mgr/rook recent changes

16 months agomgr/rook: adding empty calls to upgrade_ls and upgrade_status 55707/head
Redouane Kachach [Thu, 22 Feb 2024 09:19:06 +0000 (10:19 +0100)]
mgr/rook: adding empty calls to upgrade_ls and upgrade_status

added empty calls to upgrade_ls and upgrade_status to avoid
dashboard errors when entering the view Cluster > Upgrade. Empty
calls are used because we don't support the upgrade functionality
in rook as we do for normal Ceph deployments. In case of rook user
has to follow a different process to upgrade Ceph.

Fixes: https://tracker.ceph.com/issues/64516
Signed-off-by: Redouane Kachach <rkachach@redhat.com>
16 months agomgr/rook: raise an exception when user calls OSD related methods
Redouane Kachach [Thu, 22 Feb 2024 09:18:48 +0000 (10:18 +0100)]
mgr/rook: raise an exception when user calls OSD related methods

Signed-off-by: Redouane Kachach <rkachach@redhat.com>
16 months agomgr/rook: removing all the code related to OSDs creation/removal
Redouane Kachach [Thu, 22 Feb 2024 09:18:28 +0000 (10:18 +0100)]
mgr/rook: removing all the code related to OSDs creation/removal
Fixes: https://tracker.ceph.com/issues/64211
Signed-off-by: Redouane Kachach <rkachach@redhat.com>
16 months agomgr/dashboard: Handle errors for /api/osd/settings 55703/head
Afreen [Tue, 13 Feb 2024 10:26:09 +0000 (15:56 +0530)]
mgr/dashboard: Handle errors for /api/osd/settings

Fixes https://tracker.ceph.com/issues/62089

issue:
=====
/api/osd/settings returns "TypeError: string indices must be
integers" sometimes.
The result is coming from `osd dump` command which instead of returning
an object returns an error message which then displays error on
dashboard.

fix:
====
Added a try-catch block to handle error and updated frontend code to
handle those

Signed-off-by: Afreen <afreen23.git@gmail.com>
(cherry picked from commit 518bff9c7ed6f6756aff8aa8013c48a5bfdd7b32)

17 months agorgw/lc: decorating log events with more details 55673/head
Oguzhan Ozmen [Tue, 23 Jan 2024 15:25:44 +0000 (10:25 -0500)]
rgw/lc: decorating log events with more details

  * some minor typos in the log event strings
  * correcting the names of the owning functions in some of the log events
  * adding worker index to the events in LCWorker::entry()
  * adding worker index to the cycle-finished events
  * adding bucket name to the interval budget expired events
  * adding bucket name to the events found in RGWLC::bucket_lc_process()
  * adding event to capture the end and the return code for the call to
    bucket_lc_process()

Signed-off-by: Oguzhan Ozmen <oozmen@bloomberg.net>
(cherry picked from commit 9d6b463a6442ed5ea3ada5f0926214173f4b7576)

17 months agorgw/datalog: RGWDataChangesLog::add_entry() uses null_yield 55654/head
Casey Bodley [Fri, 9 Feb 2024 18:38:49 +0000 (13:38 -0500)]
rgw/datalog: RGWDataChangesLog::add_entry() uses null_yield

work around a deadlock under RGWDataChangesLog::add_entry() with
multi-object delete by making the push() call synchronous

this is a partial revert of d38a69b6e18cb798528d64a2c6c3e439212fe6d2

Fixes: https://tracker.ceph.com/issues/63373
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 692c2e4d555dd0afe8db6a40634caf446bbc13a7)

17 months agotest/rgw: add multisite test case for DeleteObjects
Casey Bodley [Fri, 9 Feb 2024 17:49:10 +0000 (12:49 -0500)]
test/rgw: add multisite test case for DeleteObjects

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 3e6e36c9cc5662f4816ee47f4db4e47d168fc2b4)

17 months agoMerge pull request #55605 from ronen-fr/wip-rf-warns0224
Ronen Friedman [Fri, 16 Feb 2024 18:57:45 +0000 (20:57 +0200)]
Merge pull request #55605 from ronen-fr/wip-rf-warns0224

osd: clean compiler warnings

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
17 months agoMerge pull request #54922 from pponnuvel/disable_network_stats
Radoslaw Zarzynski [Fri, 16 Feb 2024 16:54:02 +0000 (17:54 +0100)]
Merge pull request #54922 from pponnuvel/disable_network_stats

mon, mgr: do not output network ping stats

Reviewed-by: Laura Flores <lflores@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
17 months agoMerge pull request #53565 from pereman2/shared-blob-to-blob
Adam Kupczyk [Fri, 16 Feb 2024 16:26:54 +0000 (17:26 +0100)]
Merge pull request #53565 from pereman2/shared-blob-to-blob

os/bluestore: optional SharedBlob on Blob structure

17 months agoMerge pull request #55570 from rzarzynski/wip-bug-64192
Laura Flores [Fri, 16 Feb 2024 16:23:21 +0000 (10:23 -0600)]
Merge pull request #55570 from rzarzynski/wip-bug-64192

osd: always send returnvec-on-errors for client's retry

17 months agoMerge pull request #55602 from ceph/wip-yuriw-add-squid-main
Yuri Weinstein [Fri, 16 Feb 2024 15:11:52 +0000 (07:11 -0800)]
Merge pull request #55602 from ceph/wip-yuriw-add-squid-main

qa/tests: added squid option

Reviewed-by: Laura Flores <lflores@redhat.com>
17 months agoMerge pull request #55582 from cbodley/wip-63642
Casey Bodley [Fri, 16 Feb 2024 14:59:31 +0000 (14:59 +0000)]
Merge pull request #55582 from cbodley/wip-63642

rgw/putobj: RadosWriter uses part head object for multipart parts

Reviewed-by: Mark Kogan <mkogan@ibm.com>
Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
17 months agoMerge pull request #55453 from ronen-fr/wip-rf-0741-logs
Ronen Friedman [Fri, 16 Feb 2024 14:24:13 +0000 (16:24 +0200)]
Merge pull request #55453 from ronen-fr/wip-rf-0741-logs

osd/scrub: improve scheduling decision logs

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
17 months agoMerge pull request #54856 from linuxbox2/wip-accept-new-awssigv4
Casey Bodley [Fri, 16 Feb 2024 13:52:34 +0000 (13:52 +0000)]
Merge pull request #54856 from linuxbox2/wip-accept-new-awssigv4

rgw: cumulatively fix 6 AWS SigV4 request failure cases

Reviewed-by: Casey Bodley <cbodley@redhat.com>
17 months agomon, mgr: do not output network ping stats 54922/head
Ponnuvel Palaniyappan [Thu, 15 Sep 2022 14:55:06 +0000 (15:55 +0100)]
mon, mgr: do not output network ping stats

When doing PG dump using 'ceph pg dump --format json-pretty'
the output is extremely big that the command hangs and also
the ceph-mgr hangs and eventuall fails over.

The exact size depends on the number of OSDs in the cluster
and the number of peers for each OSD.

In tests, it's been identified that the network ping times
is the largest component in terms of size which is removed
from the output now so as to limit the overall size.

Fixes https://tracker.ceph.com/issues/57460

Signed-off-by: Ponnuvel Palaniyappan <pponnuvel@gmail.com>
17 months agoMerge pull request #55579 from idryomov/wip-64423
Ilya Dryomov [Fri, 16 Feb 2024 09:24:02 +0000 (10:24 +0100)]
Merge pull request #55579 from idryomov/wip-64423

librbd: fix split() for SparseExtent and SparseBufferlistExtent

Reviewed-by: Mykola Golub <mgolub@suse.com>
17 months agoMerge pull request #55530 from trociny/wip-64376
Ilya Dryomov [Fri, 16 Feb 2024 09:22:50 +0000 (10:22 +0100)]
Merge pull request #55530 from trociny/wip-64376

tools/rbd: make 'children' command support --image-id

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
17 months agotest/osd: fix test_scrub_sched following scrubber changes 55453/head
Ronen Friedman [Mon, 12 Feb 2024 14:50:22 +0000 (08:50 -0600)]
test/osd: fix test_scrub_sched following scrubber changes

Replacing PgScrubber::determine_scrub_time() with a local copy,
as a stop-gap measure to keep the test running.
The scrub scheduling refactoring will remove the need for
this function, and the test will be updated accordingly.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
17 months agoosd/scrub: log parameter entering scrub_requested()
Ronen Friedman [Mon, 5 Feb 2024 12:02:14 +0000 (06:02 -0600)]
osd/scrub: log parameter entering scrub_requested()

... and a minor formatting fix in the same function.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
17 months agoMerge pull request #53289 from rzarzynski/wip-mon-set-allow-crimson
Yuri Weinstein [Fri, 16 Feb 2024 00:24:53 +0000 (16:24 -0800)]
Merge pull request #53289 from rzarzynski/wip-mon-set-allow-crimson

mon/OSDMonitor: fix the hint for set-allow-crimson

Reviewed-by: Samuel Just <sjust@redhat.com>
17 months agoMerge pull request #55404 from JoshSalomon/fix-warn
Laura Flores [Fri, 16 Feb 2024 00:20:05 +0000 (18:20 -0600)]
Merge pull request #55404 from JoshSalomon/fix-warn

osd: Fix compilation warnings for PR https://github.com/ceph/ceph/pull/55198

17 months agoMerge pull request #54930 from rzarzynski/wip-osd-ec-rework
Laura Flores [Thu, 15 Feb 2024 19:41:31 +0000 (13:41 -0600)]
Merge pull request #54930 from rzarzynski/wip-osd-ec-rework

osd: rework EC for the sake of integration with crimson

17 months agoosd: avoid copying chunks in a loop 55605/head
Ronen Friedman [Thu, 15 Feb 2024 18:17:57 +0000 (12:17 -0600)]
osd: avoid copying chunks in a loop

to clear a static analyzer warning

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
17 months agoosd: clean compiler warnings
Ronen Friedman [Thu, 15 Feb 2024 18:11:22 +0000 (12:11 -0600)]
osd: clean compiler warnings

... for unused variables, for code that has no effect, and
for trying to std::move out of a const lvalue.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
17 months agoqa/tests: added squid option 55602/head
Yuri Weinstein [Thu, 15 Feb 2024 17:14:12 +0000 (09:14 -0800)]
qa/tests: added squid option

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
17 months agoMerge pull request #55566 from zdover23/wip-doc-2024-02-14-cephadm-services-nfs
Adam King [Thu, 15 Feb 2024 14:42:50 +0000 (09:42 -0500)]
Merge pull request #55566 from zdover23/wip-doc-2024-02-14-cephadm-services-nfs

doc/cephadm: correct nfs config pool name

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
Reviewed-by: John Mulligan <jmulligan@redhat.com>
17 months agoMerge pull request #55539 from zdover23/wip-doc-2024-02-12-glossary-osd-terms
zdover23 [Thu, 15 Feb 2024 14:24:49 +0000 (00:24 +1000)]
Merge pull request #55539 from zdover23/wip-doc-2024-02-12-glossary-osd-terms

doc/glossary: improve OSD definitions

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
17 months agoMerge pull request #55537 from guits/node-proxy-handle-fetch-oob-error
Guillaume Abrioux [Thu, 15 Feb 2024 08:04:20 +0000 (09:04 +0100)]
Merge pull request #55537 from guits/node-proxy-handle-fetch-oob-error

node-proxy: improve http error handling in fetch_oob_details

17 months agoMerge pull request #55297 from VallariAg/fix-gtest-xml-path
Vallari Agrawal [Thu, 15 Feb 2024 04:29:29 +0000 (09:59 +0530)]
Merge pull request #55297 from VallariAg/fix-gtest-xml-path

qa/workunits/rados/test.sh: fix GTEST_OUTPUT path

17 months agodoc/glossary: improve OSD definitions 55539/head
Zac Dover [Mon, 12 Feb 2024 13:08:27 +0000 (23:08 +1000)]
doc/glossary: improve OSD definitions

Remove expletive construction from three OSD-id-related terms.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
17 months agoMerge pull request #55585 from zdover23/wip-doc-2024-02-15-rados-operations-placement...
Anthony D'Atri [Wed, 14 Feb 2024 20:28:27 +0000 (15:28 -0500)]
Merge pull request #55585 from zdover23/wip-doc-2024-02-15-rados-operations-placement-groups-sage-blog-post

doc/rados: add link to pg blog post

17 months agoMerge pull request #55584 from batrick/backport-create-squid
Ilya Dryomov [Wed, 14 Feb 2024 18:40:54 +0000 (19:40 +0100)]
Merge pull request #55584 from batrick/backport-create-squid

script: add squid release to backport-create-issue

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
17 months agoqa: move cert import into rgw task 54856/head
Ali Maredia [Mon, 12 Feb 2024 23:25:17 +0000 (18:25 -0500)]
qa: move cert import into rgw task

Signed-off-by: Ali Maredia <amaredia@redhat.com>
17 months agoqa: enable test_awssdkv4_sig workunit to run in teuthology
Ali Maredia [Mon, 5 Feb 2024 16:52:38 +0000 (11:52 -0500)]
qa: enable test_awssdkv4_sig workunit to run in teuthology

Signed-off-by: Ali Maredia <amaredia@redhat.com>
17 months agorgw_sigv4: catch exceptions on client builder
Matt Benjamin [Thu, 8 Feb 2024 19:17:39 +0000 (14:17 -0500)]
rgw_sigv4: catch exceptions on client builder

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>