]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
22 months agomgr/dashboard: add more e2e for cephx users 51867/head
Nizamudeen A [Wed, 24 May 2023 16:45:59 +0000 (22:15 +0530)]
mgr/dashboard: add more e2e for cephx users

Fixes: https://tracker.ceph.com/issues/61421
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit 6bac361b54eb6233b04dfb34c62086a9d3df3c43)

2 years agomgr/dashboard: fix the rgw roles page
Nizamudeen A [Wed, 24 May 2023 16:44:24 +0000 (22:14 +0530)]
mgr/dashboard: fix the rgw roles page

Fixes: https://tracker.ceph.com/issues/61421
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit b27e15902cc8262a496a4c9c10c607c09b14a527)

 Conflicts:
src/pybind/mgr/dashboard/controllers/rgw.py
 - Remove `CreatePermission` import because its not yet there in  quincy
src/pybind/mgr/dashboard/openapi.yaml
 - generate a new spec

2 years agoMerge pull request #51866 from rhcs-dashboard/wip-61555-quincy
Nizamudeen A [Thu, 1 Jun 2023 09:03:00 +0000 (14:33 +0530)]
Merge pull request #51866 from rhcs-dashboard/wip-61555-quincy

quincy: mgr/dashboard: fix test_dashboard_e2e.sh failure

Reviewed-by: Pegonzal <NOT@FOUND>
2 years agomgr/dashboard: fix test_dashboard_e2e.sh failure 51866/head
Nizamudeen A [Wed, 31 May 2023 05:39:25 +0000 (11:09 +0530)]
mgr/dashboard: fix test_dashboard_e2e.sh failure

The qa e2e is failing because the script is not adapted with cypress 10.

Fixes: https://tracker.ceph.com/issues/61519
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit 7c5d92ad489637473d60e83fe064e2a2474fd192)

2 years agoMerge pull request #51768 from rhcs-dashboard/wip-61323-quincy
Nizamudeen A [Thu, 1 Jun 2023 06:29:49 +0000 (11:59 +0530)]
Merge pull request #51768 from rhcs-dashboard/wip-61323-quincy

quincy: mgr/dashboard: batch backport hackathon prs

Reviewed-by: Pegonzal <NOT@FOUND>
Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: cloudbehl <NOT@FOUND>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
2 years agoMerge pull request #51835 from cbodley/wip-61512
Yuri Weinstein [Wed, 31 May 2023 21:50:38 +0000 (17:50 -0400)]
Merge pull request #51835 from cbodley/wip-61512

quincy: radosgw-admin: try reshard even if bucket is resharding

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
2 years agoMerge pull request #51761 from ljflores/wip-quincy-backport-pr-51270
Laura Flores [Tue, 30 May 2023 20:34:38 +0000 (15:34 -0500)]
Merge pull request #51761 from ljflores/wip-quincy-backport-pr-51270

quincy: mgr/telemetry: compile all channels and collections in selftest

2 years agoMerge pull request #51825 from zdover23/wip-doc-2023-05-30-backport-51798-to-quincy
Anthony D'Atri [Tue, 30 May 2023 14:33:25 +0000 (10:33 -0400)]
Merge pull request #51825 from zdover23/wip-doc-2023-05-30-backport-51798-to-quincy

quincy: doc/rados: edit balancer.rst

2 years agoradosgw-admin: try reshard even if bucket is resharding 51835/head
Casey Bodley [Mon, 1 Feb 2021 17:02:44 +0000 (12:02 -0500)]
radosgw-admin: try reshard even if bucket is resharding

allow reshard in case a previous reshard failed. if the reshard is
actually still in progress, we'll fail to get the reshard lock

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 122da8f14a1dae247a5f2f62a3a6e219a9c9de8f)

Conflicts:
src/rgw/rgw_admin.cc  no rgw::current_num_shards()

2 years agodoc/rados: edit balancer.rst 51825/head
Zac Dover [Mon, 29 May 2023 01:18:00 +0000 (09:18 +0800)]
doc/rados: edit balancer.rst

Edit doc/rados/operations/balancer.rst.

https://tracker.ceph.com/issues/58485

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit d3660aa20d737729dac708264ceed37560362f91)

2 years agoMerge pull request #49936 from NitzanMordhai/wip-58614-quincy
Radoslaw Zarzynski [Mon, 29 May 2023 14:32:34 +0000 (16:32 +0200)]
Merge pull request #49936 from NitzanMordhai/wip-58614-quincy

quincy: Wip nitzan pglog ec getattr error

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2 years agomgr/dashboard: ignore Details card in applitools vrt 51768/head
Nizamudeen A [Thu, 20 Apr 2023 07:35:46 +0000 (13:05 +0530)]
mgr/dashboard: ignore Details card in applitools vrt

because the details card includes the FSID and Ceph Version which can
change on different clusters.

also don't run the 800x600 resolution because for new dashboard it looks
really weird.

Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit f31053b5fa149082d656b4c7e403183bc0124003)

2 years agomgr/dashboard: remove deprecated preserveOnce
Nizamudeen A [Thu, 25 May 2023 08:13:12 +0000 (13:43 +0530)]
mgr/dashboard: remove deprecated preserveOnce

cypress is deprecating preserveOnce and instead favoring using
cy.session(). session is already introduced as part of the upgrade to
cypress 10. So removing the preserveOnce here

Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit 54e8e8b96baf02d7924aa8d5497763af7ef14ba7)

2 years agomgr/dashboard: update landing page e2e tests
Pedro Gonzalez Gomez [Fri, 31 Mar 2023 17:51:16 +0000 (19:51 +0200)]
mgr/dashboard: update landing page e2e tests

ignore the region that can vary on different clusters like charts

fixes: https://tracker.ceph.com/issues/59142
Signed-off-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
(cherry picked from commit 1157e3bff978b19573549c1af1a8fac720b678f6)

2 years agomgr/dashboard: fix the hosts e2e failure
Nizamudeen A [Wed, 24 May 2023 15:05:51 +0000 (20:35 +0530)]
mgr/dashboard: fix the hosts e2e failure

Fixes: https://tracker.ceph.com/issues/61354
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit 3279afa920a1b732c9c85c242670d6b5e72780b5)

2 years agomgr/dashboard: fix the cephadm grafana e2e failure
Nizamudeen A [Wed, 24 May 2023 08:35:32 +0000 (14:05 +0530)]
mgr/dashboard: fix the cephadm grafana e2e failure

Fixes: https://tracker.ceph.com/issues/61354
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit c56e10af0b71b65f405f4a1c6a8c137bc6a62a13)

2 years agomgr/dashboard: update to cypress 10
Nizamudeen A [Wed, 8 Feb 2023 15:49:31 +0000 (21:19 +0530)]
mgr/dashboard: update to cypress 10

Fixes: https://tracker.ceph.com/issues/61354
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit 222dec3750304385dff51a2a4bfb91e12eb4e9aa)

2 years agomgr/dashboard: fix create snapshot is disabled for rbd images
Nizamudeen A [Fri, 19 May 2023 11:18:14 +0000 (16:48 +0530)]
mgr/dashboard: fix create snapshot is disabled for rbd images

also the rename and rollback option in the snapshot list is enabled even if there isn't anything in the list

also disabled the Mirror Image Snapshot option in the Create RBD
Snapshot form (only shown for images configured with Snapshot mirroring)
with the helpe

Fixes: https://tracker.ceph.com/issues/61296
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit 896ae75901b564677ea1611a89f4d61da881a6e1)

2 years agoMerge pull request #50749 from rhcs-dashboard/wip-59214-quincy
Avan [Mon, 29 May 2023 12:25:00 +0000 (17:55 +0530)]
Merge pull request #50749 from rhcs-dashboard/wip-59214-quincy

quincy: exporter: user only counter dump/schema commands for extacting counters

Reviewed-by: Juan Miguel Olmo <jolmomar@redhat.com>
2 years agoMerge pull request #51793 from zdover23/wip-doc-2023-05-28-backport-51587-to-quincy
zdover23 [Sun, 28 May 2023 01:39:43 +0000 (11:39 +1000)]
Merge pull request #51793 from zdover23/wip-doc-2023-05-28-backport-51587-to-quincy

quincy: doc/rados: edit bluestore-config-ref.rst (2 of x)

2 years agodoc/rados: edit bluestore-config-ref.rst (2 of x) 51793/head
Zac Dover [Fri, 26 May 2023 18:44:18 +0000 (04:44 +1000)]
doc/rados: edit bluestore-config-ref.rst (2 of x)

Edit the second part of doc/rados/configuration/bluestore-config-ref.rst.

https://tracker.ceph.com/issues/58485

Co-authored-by: Anthoy D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 1ceeab30ebde767aaf675fe46e79b9b7d28b881a)

2 years agoMerge pull request #51790 from zdover23/wip-doc-2023-05-27-backport-51771-to-quincy
Anthony D'Atri [Fri, 26 May 2023 22:40:09 +0000 (18:40 -0400)]
Merge pull request #51790 from zdover23/wip-doc-2023-05-27-backport-51771-to-quincy

quincy: doc/rados: edit bluestore-config-ref.rst (1 of x)

2 years agodoc/rados: edit bluestore-config-ref.rst (1 of x) 51790/head
Zac Dover [Fri, 26 May 2023 08:59:36 +0000 (18:59 +1000)]
doc/rados: edit bluestore-config-ref.rst (1 of x)

Edit the first part of doc/rados/configuration/bluestore-config-ref.rst.

https://tracker.ceph.com/issues/58485

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 3879e4ad417dddef1247521c199925a679d490ac)

2 years agoMerge pull request #51617 from adk3798/wip-59635-quincy
Adam King [Fri, 26 May 2023 21:06:30 +0000 (17:06 -0400)]
Merge pull request #51617 from adk3798/wip-59635-quincy

quincy: mgr/cephadm: allow configuring anonymous access for grafana

Reviewed-by: Redouane Kachach <rkachach@redhat.com>
2 years agoMerge pull request #51664 from sseshasa/wip-61335-quincy
Yuri Weinstein [Fri, 26 May 2023 13:50:03 +0000 (09:50 -0400)]
Merge pull request #51664 from sseshasa/wip-61335-quincy

quincy: osd/scheduler: Reset ephemeral changes to mClock built-in profile

Reviewed-by: Samuel Just <sjust@redhat.com>
2 years agoMerge pull request #51413 from kamoltat/wip-ksirivad-backport-quincy
Yuri Weinstein [Fri, 26 May 2023 13:48:55 +0000 (09:48 -0400)]
Merge pull request #51413 from kamoltat/wip-ksirivad-backport-quincy

quincy:mon/Monitor.cc: exit function if !osdmon()->is_writeable() && mon/OSDMonitor: Added extra check before mon.go_recovery_stretch_mode()

Reviewed-by: Laura Flores <lflores@redhat.com>
2 years agoMerge pull request #50931 from ifed01/wip-ifed-fix-spillover-alert-qui
Yuri Weinstein [Fri, 26 May 2023 13:48:16 +0000 (09:48 -0400)]
Merge pull request #50931 from ifed01/wip-ifed-fix-spillover-alert-qui

quincy: os/bluestore: fix spillover alert

Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
2 years agoMerge pull request #49938 from NitzanMordhai/wip-58612-quincy
Yuri Weinstein [Fri, 26 May 2023 13:47:22 +0000 (09:47 -0400)]
Merge pull request #49938 from NitzanMordhai/wip-58612-quincy

quincy: Wip nitzan fixing few rados/test.sh

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2 years agoMerge pull request #51129 from petrutlucian94/wip-59479-quincy
Ilya Dryomov [Fri, 26 May 2023 10:38:48 +0000 (12:38 +0200)]
Merge pull request #51129 from petrutlucian94/wip-59479-quincy

quincy: win32_deps_build: avoid pip

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2 years agomgr/dashboard: fix broken daemon details tab
Nizamudeen A [Mon, 22 May 2023 08:11:00 +0000 (13:41 +0530)]
mgr/dashboard: fix broken daemon details tab

Fixes: https://tracker.ceph.com/issues/61329
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit 156cb50eab15414232d3dbad3467572d024a9c9f)

2 years agomgr/dashboard: add helper on the rgw user Suspended
Nizamudeen A [Thu, 18 May 2023 12:10:42 +0000 (17:40 +0530)]
mgr/dashboard: add helper on the rgw user Suspended

Fixes: https://tracker.ceph.com/issues/61247
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit b187dda20ca9a2d66a64d79d5bd3c746ce54729a)

2 years agomgr/dashboard: fix rgw roles breadcrumbs
Nizamudeen A [Thu, 18 May 2023 10:48:08 +0000 (16:18 +0530)]
mgr/dashboard: fix rgw roles breadcrumbs

Fixes: https://tracker.ceph.com/issues/61241
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit 9518cd9d70020bcf5197dea6d61ea0bd2b21ae54)

2 years agomgr/dashboard: put some default values on rgw encryption config form
Nizamudeen A [Thu, 18 May 2023 12:03:44 +0000 (17:33 +0530)]
mgr/dashboard: put some default values on rgw encryption config form

Fixes: https://tracker.ceph.com/issues/61246
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit 024ba4ee38212138d9c5aa85bd3e12be68e5a40c)

2 years agomgr/dashboard: default encryption type to sse-s3 in rgw
Nizamudeen A [Wed, 17 May 2023 10:57:59 +0000 (16:27 +0530)]
mgr/dashboard: default encryption type to sse-s3 in rgw

by default the form doesn't select any values, so i am defaulting it to
sse-s3

Fixes: https://tracker.ceph.com/issues/61211
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit a08f89e777852f73d4900808a69bfcae0e4aa961)

2 years agomgr/dashboard:Change Daemons > Object Gateway section to Gateways
Ankush Behl [Thu, 18 May 2023 11:55:56 +0000 (17:25 +0530)]
mgr/dashboard:Change Daemons > Object Gateway section to Gateways
- Change the Daemons to Gateways
- Changing the breadcrums to call it Gateways
- In list page Calling Daemons List as Gateways List

Fixes: https://tracker.ceph.com/issues/61245
Signed-off-by: Ankush Behl <cloudbehl@gmail.com>
(cherry picked from commit eda2c573b285a61e365acb48384123f8854aa790)

2 years agomgr/dashboard: remove Selected Object Gateway dropdown
Nizamudeen A [Thu, 18 May 2023 06:24:53 +0000 (11:54 +0530)]
mgr/dashboard: remove Selected Object Gateway dropdown

Only from Daemons and Multisite page because its not needed there.

Fixes: https://tracker.ceph.com/issues/61230
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit 075fce3cf8f8bc5150abd4684bc87e56e993da5e)

2 years agomgr/dashboard: reorder rgw daemons list items
Nizamudeen A [Wed, 17 May 2023 11:54:52 +0000 (17:24 +0530)]
mgr/dashboard: reorder rgw daemons list items

Fixes: https://tracker.ceph.com/issues/61212
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit 130a52ed508761dcbf5f722ba98ffb4500a6a5b3)

2 years agomgr/dashboard: merge running and size columns in services page
Pere Diaz Bou [Fri, 19 May 2023 09:54:38 +0000 (11:54 +0200)]
mgr/dashboard: merge running and size columns in services page

Fixes: https://tracker.ceph.com/issues/61295
Signed-off-by: Pere Diaz Bou <pere-altea@hotmail.com>
(cherry picked from commit 3eeca5c5c42c85d1925828a2e9ac3d87c83a401b)

2 years agomgr/dashboard: show the host's IP address on Hosts page
Aashish Sharma [Wed, 17 May 2023 13:40:35 +0000 (19:10 +0530)]
mgr/dashboard: show the host's IP address on Hosts page

Fixes: https://tracker.ceph.com/issues/61222
Signed-off-by: Aashish Sharma <aasharma@redhat.com>
(cherry picked from commit ef9d53027ad472d8ee5e0e8524fce6ce7a40af89)

2 years agomgr/dashboard: Show a helper for Unmanaged checkbox in service creation form
Aashish Sharma [Wed, 17 May 2023 12:31:41 +0000 (18:01 +0530)]
mgr/dashboard: Show a helper for Unmanaged checkbox in service creation form

Fixes: https://tracker.ceph.com/issues/61216
Signed-off-by: Aashish Sharma <aasharma@redhat.com>
(cherry picked from commit aa60bb88a5564f9e854b91b1cdc5a3a8945d1940)

2 years agomgr/dashboard: Status column in Cluster > Hosts shows empty
Aashish Sharma [Wed, 17 May 2023 12:07:41 +0000 (17:37 +0530)]
mgr/dashboard: Status column in Cluster > Hosts shows empty

Fixes: https://tracker.ceph.com/issues/61215
Signed-off-by: Aashish Sharma <aasharma@redhat.com>
(cherry picked from commit 930e48008403ce246105a0cc631efba2974494f4)

2 years agomgr/dashboard: add warning message on why osd creation disabled
Pere Diaz Bou [Wed, 17 May 2023 14:32:43 +0000 (16:32 +0200)]
mgr/dashboard: add warning message on why osd creation disabled

When no options are present when creating OSDs, you can see the form
with lots of things disabled without having a clear explanation. This
PR introduces a warning banner with a description on why it is
happening.

Fixes: https://tracker.ceph.com/issues/61223
Signed-off-by: Pere Diaz Bou <pere-altea@hotmail.com>
(cherry picked from commit 1d6b318b1a95dc961838dba5b06ebb70b039ee86)

2 years agomgr/dashboard: filte hosts by services
Pere Diaz Bou [Wed, 17 May 2023 16:17:50 +0000 (18:17 +0200)]
mgr/dashboard: filte hosts by services

Fixes: https://tracker.ceph.com/issues/61242
Signed-off-by: Pere Diaz Bou <pere-altea@hotmail.com>
(cherry picked from commit 510a582fa8bd04125a565afe12d245fc4dadff2f)

2 years agomgr/dashboard: Rename Cluster > Monitoring to Alerts and change Cluster>Users to...
Aashish Sharma [Wed, 17 May 2023 11:17:15 +0000 (16:47 +0530)]
mgr/dashboard: Rename Cluster > Monitoring to Alerts and change Cluster>Users to Cluster>Ceph Users

Fixes: https://tracker.ceph.com/issues/61213
Signed-off-by: Aashish Sharma <aasharma@redhat.com>
(cherry picked from commit 31b692f4e38e94d3e690921418f8eeebc2b48212)

2 years agomgr/dashboard: rename Service>Details to Service>Daemons
Pere Diaz Bou [Wed, 17 May 2023 11:19:10 +0000 (13:19 +0200)]
mgr/dashboard: rename Service>Details to Service>Daemons

Daemons and services are not interchangeable in cephadm terms. As stated
in the docs: `A daemon is a systemd unit that is running and part of a
service.` https://docs.ceph.com/en/latest/cephadm/services/#daemon-status

Fixes: https://tracker.ceph.com/issues/61214
Signed-off-by: Pere Diaz Bou <pere-altea@hotmail.com>
(cherry picked from commit a0c59bf580adacb755334d9cc8f7c452223f9706)

2 years agomgr/dashboard: remove title tooltip of cards landing page
Pedro Gonzalez Gomez [Thu, 18 May 2023 12:16:10 +0000 (14:16 +0200)]
mgr/dashboard: remove title tooltip of cards landing page

Fixes: https://tracker.ceph.com/issues/61250
Signed-off-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
(cherry picked from commit ac73126362f3ea0f26ae32218b86ad9f9ab73670)

2 years agomgr/dashboard: add-scroll-in-key-value-tables
Pedro Gonzalez Gomez [Thu, 18 May 2023 07:14:50 +0000 (09:14 +0200)]
mgr/dashboard: add-scroll-in-key-value-tables

Fixes: https://tracker.ceph.com/issues/61220
Signed-off-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
(cherry picked from commit 1ae6a035b4ebfcee0009ee67740d485a2f9b8a9b)

2 years agomgr/dashboard: fix spacing of embedded grafana buttons
Pedro Gonzalez Gomez [Thu, 18 May 2023 10:10:11 +0000 (12:10 +0200)]
mgr/dashboard: fix spacing of embedded grafana buttons

Fixes: https://tracker.ceph.com/issues/61220
Signed-off-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
(cherry picked from commit 5b7e850f67097f37276bc4bda87a65a79ce71b6c)

2 years agomgr/dashboard: fix tooltip for alerts silence matchers
avanthakkar [Wed, 17 May 2023 12:14:00 +0000 (17:44 +0530)]
mgr/dashboard: fix tooltip for alerts silence matchers

Fixes: https://tracker.ceph.com/issues/61208
Signed-off-by: avanthakkar <avanjohn@gmail.com>
(cherry picked from commit 82ea356879c6fc6404b9bd76da3bbc5418ea5a2d)

2 years agomgr/dashboard: fix Nan undefined values and add empty pipe on expand-cluster
Pedro Gonzalez Gomez [Thu, 18 May 2023 11:47:16 +0000 (13:47 +0200)]
mgr/dashboard: fix Nan undefined values and add empty pipe on expand-cluster

Fixes: https://tracker.ceph.com/issues/61207
Signed-off-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
(cherry picked from commit 764a1b67392f09a288a6f38d9d4f89d2a203cf57)

2 years agowin32_deps_build: avoid pip 51129/head
Lucian Petrut [Thu, 6 Apr 2023 11:05:47 +0000 (11:05 +0000)]
win32_deps_build: avoid pip

We're currently installing cython with pip when using Ubuntu
to cross compile Ceph for Windows. This can fail with recent
Python versions if attempting to use the global env:

  error: externally-managed-environment

  Ã— This environment is externally managed
  â•°â”€> To install Python packages system-wide, try apt install
      python3-xyz, where xyz is the package you are trying to
      install.

Cython isn't really needed by the Windows build so we can go
ahead and drop it. We were hoping to use the Python bindings
on Windows, however Python extensions can't be cross compiled.

We're no longer using pip either, so we're dropping the dependency.
g++ was getting installed as a pip dependency, so we'll have to
include that instead. Note that g++ is used when building the boost
b2 tool.

While at it, we'll also ensure that git is installed.

Fixes: https://tracker.ceph.com/issues/59354
Signed-off-by: Lucian Petrut <lpetrut@cloudbasesolutions.com>
(cherry picked from commit 041618ea9b9b09b8dcf00170417b246eaaabce8b)

Conflicts:
win32_deps_build.sh
        -> commit 4954fe1 ("win32: add rhel option") not in quincy

[1] https://github.com/ceph/ceph/commit/4954fe19e5594ca5cac1d639fcfa49941abbbfa9

2 years agowin32: install wget when building on ubuntu
Ken Dreyer [Tue, 13 Sep 2022 16:44:18 +0000 (12:44 -0400)]
win32: install wget when building on ubuntu

The build process requires wget. Install this on Ubuntu platforms.

Signed-off-by: Ken Dreyer <kdreyer@redhat.com>
(cherry picked from commit 1b4db7c477151d554a32fc937410d699318a290e)

2 years agowin32: install deps with DEBIAN_FRONTEND=noninteractive
Ken Dreyer [Tue, 13 Sep 2022 16:44:05 +0000 (12:44 -0400)]
win32: install deps with DEBIAN_FRONTEND=noninteractive

This simplifies the installation process when I run it in an interactive
terminal.

Signed-off-by: Ken Dreyer <kdreyer@redhat.com>
(cherry picked from commit 100990cfa628d20cceed5d74c6d2374f32dc58ff)

2 years agoMerge pull request #51728 from amathuria/wip-quincy-change-default-scrub-cost
Laura Flores [Thu, 25 May 2023 23:00:33 +0000 (18:00 -0500)]
Merge pull request #51728 from amathuria/wip-quincy-change-default-scrub-cost

quincy: osd: Change scrub cost in case of mClock scheduler

2 years agomgr/cephadm: allow configuring anonymous access for grafana 51617/head
Adam King [Tue, 21 Mar 2023 18:12:03 +0000 (14:12 -0400)]
mgr/cephadm: allow configuring anonymous access for grafana

In case users want to not allow anonymous viewers
to view the grafana dashboard but don't want to use
a full custom config

Fixes: https://tracker.ceph.com/issues/59117
Signed-off-by: Adam King <adking@redhat.com>
(cherry picked from commit e6690dde7b384d7d13e1a17119c648acfadee638)

2 years agomgr/telemetry: compile all channels and collections in selftest 51761/head
Laura Flores [Thu, 27 Apr 2023 18:22:47 +0000 (18:22 +0000)]
mgr/telemetry: compile all channels and collections in selftest

The selftest currently compiles only channels and collections that
are on by default. This change tests the compilation of all channels
and collections.

Signed-off-by: Laura Flores <lflores@redhat.com>
(cherry picked from commit 70c5a4d54833f20a07f48488f29d9410d19f6bd4)

2 years agoMerge pull request #50562 from ljflores/wip-59092-quincy
Laura Flores [Thu, 25 May 2023 15:04:23 +0000 (10:04 -0500)]
Merge pull request #50562 from ljflores/wip-59092-quincy

quincy: rgw: LDAP fix resource leak with wrong credentials

2 years agoMerge pull request #51616 from adk3798/wip-59630-quincy
Adam King [Thu, 25 May 2023 14:24:47 +0000 (10:24 -0400)]
Merge pull request #51616 from adk3798/wip-59630-quincy

quincy: mgr/cephadm: support for nfs backed by VIP

Reviewed-by: Redouane Kachach <rkachach@redhat.com>
2 years agoMerge pull request #51218 from adk3798/wip-59549-quincy
Adam King [Thu, 25 May 2023 14:23:36 +0000 (10:23 -0400)]
Merge pull request #51218 from adk3798/wip-59549-quincy

quincy: mgr/cephadm: asyncio based universal timeout for ssh/cephadm commands

Reviewed-by: John Mulligan <jmulligan@redhat.com>
2 years agoMerge pull request #51756 from zdover23/wip-doc-2023-05-25-backport-51754-to-quincy
Anthony D'Atri [Thu, 25 May 2023 11:14:22 +0000 (07:14 -0400)]
Merge pull request #51756 from zdover23/wip-doc-2023-05-25-backport-51754-to-quincy

quincy: doc/rados: fix link in common.rst

2 years agodoc/rados: fix link in common.rst 51756/head
Zac Dover [Thu, 25 May 2023 09:01:49 +0000 (19:01 +1000)]
doc/rados: fix link in common.rst

Fix a link in doc/rados/configuration/common.rst that was missing its
final letter, causing a 404 error when readers attempted to follow it.

This bug was reported by stalwart friend of the Ceph documentation
project Eugen Block, who is here credited as a co-author. This bug was
reported at https://pad.ceph.com/p/Report_Documentation_Bugs.

Co-authored-by: Eugen Block <eblock@nde.ag>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 8128ce20fef3d75c6251691d10af21861c01e155)

2 years agoMerge pull request #51752 from zdover23/wip-doc-2023-05-25-backport-51745-to-quincy
Anthony D'Atri [Thu, 25 May 2023 10:01:40 +0000 (06:01 -0400)]
Merge pull request #51752 from zdover23/wip-doc-2023-05-25-backport-51745-to-quincy

quincy: doc/rados: edit filestore-config-ref.rst

2 years agodoc/rados: edit filestore-config-ref.rst 51752/head
Zac Dover [Thu, 25 May 2023 00:16:51 +0000 (10:16 +1000)]
doc/rados: edit filestore-config-ref.rst

Edit doc/rados/configuration/filestore-config-ref.rst.

https://tracker.ceph.com/issues/58485

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 1202e4207bc182d83f193adb1557359d52687103)

2 years agoosd: mClock default_min reservation should be 0 51728/head
Aishwarya Mathuria [Tue, 23 May 2023 10:43:08 +0000 (16:13 +0530)]
osd: mClock default_min reservation should be 0

All the mClock profiles enforce no minimum reservation for the background best-effort client.
For this purpose, the default_min value should 0 and not 1.

Signed-off-by: Aishwarya Mathuria <amathuri@redhat.com>
(cherry picked from commit 05848b4957713c5c98c249e15eb8de01d1c6a1e6)

2 years agoosd: Change scrub cost in case of mClock scheduler
Aishwarya Mathuria [Fri, 19 May 2023 11:46:11 +0000 (17:16 +0530)]
osd: Change scrub cost in case of mClock scheduler

With osd_op_queue as WPQ, high costs were assigned to scrub in order to throttle it effectively.
In the case of mClock scheduler, mClock parameters are used to do the throttling and the cost should represent a realistic value.

Fixes: https://tracker.ceph.com/issues/61313
Signed-off-by: Aishwarya Mathuria <amathuri@redhat.com>
(cherry picked from commit 43544d296c5fc14aaf638ddf21de9ea9d99f6059)

src/osd/OSD.cc: We are using osd_scrub_chunk_max in the scrub cost calculation here.

2 years agoMerge pull request #51740 from zdover23/wip-doc-2023-05-25-backport-50858-to-quincy
Anthony D'Atri [Thu, 25 May 2023 02:14:32 +0000 (22:14 -0400)]
Merge pull request #51740 from zdover23/wip-doc-2023-05-25-backport-50858-to-quincy

quincy: doc/rados/operations: Acting Set question

2 years agoMerge pull request #51743 from zdover23/wip-doc-2023-05-25-backport-51730-to-quincy
Anthony D'Atri [Thu, 25 May 2023 02:13:42 +0000 (22:13 -0400)]
Merge pull request #51743 from zdover23/wip-doc-2023-05-25-backport-51730-to-quincy

quincy: doc/rados/operations: Fix erasure-code-jerasure.rst fix

2 years agodoc/rados/operations: Fix erasure-code-jerasure.rst fix 51743/head
Anthony D'Atri [Wed, 24 May 2023 13:57:42 +0000 (09:57 -0400)]
doc/rados/operations: Fix erasure-code-jerasure.rst fix

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
(cherry picked from commit 2a3177e60d93742d3125f3ef0913dfeb8743e8bf)

2 years agodoc/rados/operations: Acting Set question 51740/head
Zac Dover [Tue, 4 Apr 2023 03:59:46 +0000 (13:59 +1000)]
doc/rados/operations: Acting Set question

Clear up a paragraph that describes the behavior of the Acting Set.

https://tracker.ceph.com/issues/58485

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 3bc9cfd83b3b836775433c7f1b075fe397b56463)

2 years agoMerge pull request #51568 from amathuria/wip-61231-quincy
Ilya Dryomov [Wed, 24 May 2023 20:41:13 +0000 (22:41 +0200)]
Merge pull request #51568 from amathuria/wip-61231-quincy

quincy: qa/tasks: Changing default mClock profile to high_recovery_ops

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2 years agoMerge pull request #51428 from idryomov/wip-59393-quincy
Ilya Dryomov [Wed, 24 May 2023 20:15:24 +0000 (22:15 +0200)]
Merge pull request #51428 from idryomov/wip-59393-quincy

quincy: librbd: localize snap_remove op for mirror snapshots

Reviewed-by: Christopher Hoffman <choffman@redhat.com>
2 years agoMerge pull request #51217 from adk3798/wip-59547-quincy
Adam King [Wed, 24 May 2023 19:40:10 +0000 (15:40 -0400)]
Merge pull request #51217 from adk3798/wip-59547-quincy

quincy: mgr/cephadm: allow setting mon crush locations through mon service spec

Reviewed-by: John Mulligan <jmulligan@redhat.com>
2 years agoMerge pull request #51455 from ajarr/wip-59711-quincy
Ilya Dryomov [Wed, 24 May 2023 18:12:02 +0000 (20:12 +0200)]
Merge pull request #51455 from ajarr/wip-59711-quincy

quincy:  mgr/rbd_support: recover from rados client blocklisting

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2 years agoMerge pull request #51060 from idryomov/wip-59431-quincy
Ilya Dryomov [Wed, 24 May 2023 18:10:42 +0000 (20:10 +0200)]
Merge pull request #51060 from idryomov/wip-59431-quincy

quincy: qa/suites/rbd: install qemu-utils in addition to qemu-block-extra on Ubuntu

Reviewed-by: Ramana Raja <rraja@redhat.com>
2 years agoMerge pull request #50920 from chrisphoffman/wip-59369-quincy
Ilya Dryomov [Wed, 24 May 2023 18:09:42 +0000 (20:09 +0200)]
Merge pull request #50920 from chrisphoffman/wip-59369-quincy

quincy: librbd: don't wait for a watch in send_acquire_lock() if client is blocklisted

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2 years agoMerge pull request #50873 from idryomov/wip-59208-quincy
Ilya Dryomov [Wed, 24 May 2023 18:09:02 +0000 (20:09 +0200)]
Merge pull request #50873 from idryomov/wip-59208-quincy

quincy: librbd: fix wrong attribute for rbd_quiesce_complete api

Reviewed-by: Mykola Golub <mgolub@suse.com>
2 years agoMerge pull request #50837 from pkalever/wip-59062-quincy
Ilya Dryomov [Wed, 24 May 2023 18:07:47 +0000 (20:07 +0200)]
Merge pull request #50837 from pkalever/wip-59062-quincy

quincy: librbd: report better errors when failing to enable mirroring on an image

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2 years agoMerge pull request #51432 from Svelar/wip-59686-quincy
Adam King [Wed, 24 May 2023 18:06:21 +0000 (14:06 -0400)]
Merge pull request #51432 from Svelar/wip-59686-quincy

quincy: cephadm: eliminate duplication of sections

Reviewed-by: Adam King <adking@redhat.com>
2 years agolibrbd: localize snap_remove op for mirror snapshots 51428/head
Christopher Hoffman [Wed, 19 Apr 2023 15:26:27 +0000 (15:26 +0000)]
librbd: localize snap_remove op for mirror snapshots

A client may attempt a lock request not quickly enough to
obtain exclusive lock for operations when another competing
client responds quicker. This can happen when a peer site has
different performance characteristics or latency. Instead of
relying on this unpredictable behavior, localize operation to
primary cluster.

Fixes: https://tracker.ceph.com/issues/59393
Signed-off-by: Christopher Hoffman <choffman@redhat.com>
(cherry picked from commit ac552c9b4d65198db8038d397a3060d5a030917d)

Conflicts:
src/cls/rbd/cls_rbd.cc [ commit 3a93b40721a1 ("librbd:
  s/boost::variant/std::variant/") not in quincy ]
src/librbd/mirror/snapshot/UnlinkPeerRequest.cc [ ditto ]

2 years agoMerge pull request #51356 from rhcs-dashboard/wip-59632-quincy
Adam King [Wed, 24 May 2023 18:04:16 +0000 (14:04 -0400)]
Merge pull request #51356 from rhcs-dashboard/wip-59632-quincy

quincy: mgr/cephadm: update monitoring stack versions

Reviewed-by: Adam King <adking@redhat.com>
2 years agomgr/cephadm: asyncio based universal timeout for ssh/cephadm commands 51218/head
Adam King [Mon, 20 Mar 2023 19:31:12 +0000 (15:31 -0400)]
mgr/cephadm: asyncio based universal timeout for ssh/cephadm commands

Since we already have make use of asyncio for our ssh commands,
we can use asyncio's timeout on waiting for concurrent futures to complete
as a way to have universal timeouts on our cephadm commands.
This change also creates a contextmanager that will catch any asyncio.TimeoutError.
Using the contextmanager along with calls to the wait_async function
will catch any timeout exception raised and convert it into an appropriate
OrchetratorError including information about what and where for the timeout
if it was provided (host where run, what command). This allows us to guarantee a
background ssh command eventually returns and inform users of any
timeouts by raising a health warning or logging the error instead
of sitting idle indefinitely

Fixes: https://tracker.ceph.com/issues/54024
Signed-off-by: Adam King <adking@redhat.com>
(cherry picked from commit adf13c82ebb75a132709aa0b0bbc1d4fef7643a7)

Conflicts:
src/pybind/mgr/cephadm/services/osd.py
src/pybind/mgr/cephadm/tests/test_cephadm.py

2 years agoMerge pull request #51173 from idryomov/wip-58887-quincy
Ilya Dryomov [Wed, 24 May 2023 17:53:26 +0000 (19:53 +0200)]
Merge pull request #51173 from idryomov/wip-58887-quincy

quincy: librbd: remove previous incomplete primary snapshot after successfully creating a new one

Reviewed-by: Christopher Hoffman <choffman@redhat.com>
2 years agomgr/cephadm: pass --timeout to cephadm binary commands
Adam King [Thu, 16 Mar 2023 18:20:48 +0000 (14:20 -0400)]
mgr/cephadm: pass --timeout to cephadm binary commands

Signed-off-by: Adam King <adking@redhat.com>
(cherry picked from commit 00d4203ec60ed42840b1b318af49e4e697bd04f2)

2 years agomgr/cephadm: verify mon spec exists before trying to grab from spec store 51217/head
Adam King [Tue, 2 May 2023 22:59:18 +0000 (18:59 -0400)]
mgr/cephadm: verify mon spec exists before trying to grab from spec store

In a normal deployment, we generally shouldn't have
to worry about this. This is more for teuthology
which does deployments in a weird way that can cause
there to be no mon spec in the cluster. Fixes an issue
seen when backporting the mon crush location work
to quincy where an upgrade test would fail with

```
[WRN] UPGRADE_REDEPLOY_DAEMON: Upgrading daemon mon.b on host smithi047 failed.
    Upgrade daemon: mon.b: Service mon not found.
```

Signed-off-by: Adam King <adking@redhat.com>
(cherry picked from commit 8aab7beefbb52f47573ad7fce932552ad5c0b2fa)

2 years agodoc/cephadm: document setting mon crush locations through spec
Adam King [Thu, 12 Jan 2023 20:13:15 +0000 (15:13 -0500)]
doc/cephadm: document setting mon crush locations through spec

Signed-off-by: Adam King <adking@redhat.com>
(cherry picked from commit cd96b70b676369298bfb06acb394d415918d0683)

2 years agoqa/suites/orch/cephadm: teuth test for mon crush locations
Adam King [Thu, 12 Jan 2023 20:00:12 +0000 (15:00 -0500)]
qa/suites/orch/cephadm: teuth test for mon crush locations

Trying to add a feature where mon crush locations
can be set through the orchestrator using the mon
service spec. This is meant to be a test for that.

Signed-off-by: Adam King <adking@redhat.com>
(cherry picked from commit 8c52a0a77b2ddad077d1de47ea67b89904e47e99)

2 years agomgr/cephadm: Set mon crush locations based on service spec
Adam King [Mon, 28 Nov 2022 16:59:59 +0000 (11:59 -0500)]
mgr/cephadm: Set mon crush locations based on service spec

The part of this that added the --set-crush-location flag
when deploying the mon was handled in another commit. This
piece is to finish the functionality by having cephadm set
the location through commands to handle when multiple
bucket=loc pairs are specified for a single monitor

Fixes: https://tracker.ceph.com/issues/58101
Signed-off-by: Adam King <adking@redhat.com>
(cherry picked from commit 2672a719067bdc71486240e99d98e42678681d44)

2 years agomgr/cephadm: redo service level config when spec is updated
Adam King [Mon, 28 Nov 2022 19:14:58 +0000 (14:14 -0500)]
mgr/cephadm: redo service level config when spec is updated

Previously, the service config function was only called
when we deploy a new daemon for that service. That meant
that updates to the spec such as changing a cert that don't
affect the daemon placement wouldn't trigger the service level
config to happen again. With this change, we now mark
the service as needing its config function ran if a daemon
for the service is added/removed or if the spec is updated.

Fixes: https://tracker.ceph.com/issues/58100
Signed-off-by: Adam King <adking@redhat.com>
(cherry picked from commit 1d50a2cdfb32b60b352cc03a83f8d1c35f2ae178)

2 years agomgr/cephadm: set --set-crush-location for mons based on crush location in spec
Adam King [Thu, 17 Nov 2022 11:42:33 +0000 (06:42 -0500)]
mgr/cephadm: set --set-crush-location for mons based on crush location in spec

Necessary to do this for stretch mode tiebreaker mon replacement

Fixes: https://tracker.ceph.com/issues/58101
Signed-off-by: Adam King <adking@redhat.com>
(cherry picked from commit ffec37156ffea174292ccabe6ede524333b30789)

2 years agopython-common/service_spec: introduce mon spec with new crush_locations field
Adam King [Thu, 10 Nov 2022 20:01:33 +0000 (15:01 -0500)]
python-common/service_spec: introduce mon spec with new crush_locations field

In order to allow having cephadm set the crush locations
for the mons. For helping with setting up stretch mode
with a cephadm cluster

Signed-off-by: Adam King <adking@redhat.com>
(cherry picked from commit 416da86b04b6a35fdeae9105728c99020a0ce6df)

2 years agoMerge pull request #51216 from adk3798/wip-59545-quincy
Adam King [Wed, 24 May 2023 17:32:13 +0000 (13:32 -0400)]
Merge pull request #51216 from adk3798/wip-59545-quincy

quincy: cephadm: reschedule haproxy from an offline host

Reviewed-by: Michael Fritch <mfritch@suse.com>
2 years agoMerge pull request #51215 from adk3798/wip-59521-quincy
Adam King [Wed, 24 May 2023 17:30:53 +0000 (13:30 -0400)]
Merge pull request #51215 from adk3798/wip-59521-quincy

quincy: orchestrator: add `--no-destroy` arg to `ceph orch osd rm`

Reviewed-by: Guillaume Abrioux <gabrioux@ibm.com>
2 years agoMerge pull request #51053 from adk3798/quincy-revert-cephadm-ceph-exporter
Adam King [Wed, 24 May 2023 17:29:34 +0000 (13:29 -0400)]
Merge pull request #51053 from adk3798/quincy-revert-cephadm-ceph-exporter

quincy: Revert "ceph-exporter: cephadm changes"

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2 years agoMerge pull request #51329 from trociny/wip-59618-quincy
Mykola Golub [Wed, 24 May 2023 16:53:51 +0000 (19:53 +0300)]
Merge pull request #51329 from trociny/wip-59618-quincy

quincy: rgw/rados: check_quota() uses real bucket owner

2 years agoMerge pull request #51044 from kotreshhr/wip-59416-quincy
Yuri Weinstein [Wed, 24 May 2023 14:29:08 +0000 (10:29 -0400)]
Merge pull request #51044 from kotreshhr/wip-59416-quincy

quincy: mgr: Add one finisher thread per module

Reviewed-by: Kotresh HR <khiremat@redhat.com>
2 years agoMerge pull request #51300 from yuvalif/wip-yuval-bucket-name-quincy
Shilpa Jagannath [Wed, 24 May 2023 13:18:03 +0000 (09:18 -0400)]
Merge pull request #51300 from yuvalif/wip-yuval-bucket-name-quincy

quincy: rgw/lua: allow bucket name override in pre request

2 years agoMerge pull request #51726 from zdover23/wip-doc-2023-05-24-backport-51273-to-quincy
zdover23 [Wed, 24 May 2023 03:15:10 +0000 (13:15 +1000)]
Merge pull request #51726 from zdover23/wip-doc-2023-05-24-backport-51273-to-quincy

quincy: doc: Update jerasure.org references

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2 years agodoc: Update jerasure.org references 51726/head
Anthony D'Atri [Tue, 23 May 2023 23:13:33 +0000 (19:13 -0400)]
doc: Update jerasure.org references

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
(cherry picked from commit 5e60e0de275f7260aeae9e664ca22ebfdf8fc5f9)

2 years agoMerge pull request #51721 from zdover23/wip-doc-2023-05-24-backport-51679-to-quincy
Anthony D'Atri [Tue, 23 May 2023 22:29:02 +0000 (18:29 -0400)]
Merge pull request #51721 from zdover23/wip-doc-2023-05-24-backport-51679-to-quincy

quincy: doc/mgr: edit "leaderboard" in telemetry.rst

2 years agoMerge pull request #51653 from zdover23/wip-doc-2023-05-22-backport-51319-to-quincy
zdover23 [Tue, 23 May 2023 22:13:01 +0000 (08:13 +1000)]
Merge pull request #51653 from zdover23/wip-doc-2023-05-22-backport-51319-to-quincy

quincy: doc: deprecate the cache tiering

Reviewed-by: Cole Mitchell <cole.mitchell.ceph@gmail.com>