]> git-server-git.apps.pok.os.sepia.ceph.com Git - ceph.git/log
ceph.git
3 years agocephadm: give disk rescan its own parser object 47372/head
Adam King [Thu, 28 Jul 2022 00:27:54 +0000 (20:27 -0400)]
cephadm: give disk rescan its own parser object

It was using the same name as the agent. Missed this
in https://github.com/ceph/ceph/pull/46420/commits/6584c49bdf254e8750d23ed529478e6a9289e12f

Signed-off-by: Adam King <adking@redhat.com>
(cherry picked from commit f8eae87accf1f79646d761e50656838d1933662d)

Conflicts:
src/cephadm/cephadm

3 years agocephadm: Add tests for rescan function
Paul Cuzner [Mon, 27 Jun 2022 06:41:27 +0000 (18:41 +1200)]
cephadm: Add tests for rescan function

Adds unittets for the rescan code

Signed-off-by: Paul Cuzner <pcuzner@redhat.com>
(cherry picked from commit 972fb0ab3c519141b2f07ac4f2d6bbb6b855441a)

Conflicts:
src/cephadm/tests/test_cephadm.py

3 years agodocs: Add docs for new host rescan feature
Paul Cuzner [Mon, 30 May 2022 01:55:27 +0000 (13:55 +1200)]
docs: Add docs for new host rescan feature

Signed-off-by: Paul Cuzner <pcuzner@redhat.com>
(cherry picked from commit 4525113fa123a5b1e8a23d6aefc306e6772326bc)

3 years agomgr/cephadm: Add new host rescan command
Paul Cuzner [Mon, 30 May 2022 01:54:33 +0000 (13:54 +1200)]
mgr/cephadm: Add new host rescan command

Adds a host rescan command to invoke cephadm's
rescan-disks subcommand

Signed-off-by: Paul Cuzner <pcuzner@redhat.com>
(cherry picked from commit cc9eb1812e9aa138d7af7426b42657ace9020bea)

3 years agocephadm: Add rescan_disks subcommand
Paul Cuzner [Mon, 30 May 2022 01:52:57 +0000 (13:52 +1200)]
cephadm: Add rescan_disks subcommand

Add a new subcommand to probe each HBA to
force discovery of decies not automatically detected
by the kernel.

Signed-off-by: Paul Cuzner <pcuzner@redhat.com>
(cherry picked from commit 6584c49bdf254e8750d23ed529478e6a9289e12f)

Conflicts:
src/cephadm/cephadm

3 years agoMerge pull request #47375 from adk3798/wip-56985-pacific
Adam King [Wed, 3 Aug 2022 12:02:42 +0000 (08:02 -0400)]
Merge pull request #47375 from adk3798/wip-56985-pacific

pacific: mgr/cephadm: clear error message when resuming upgrade

Reviewed-by: Guillaume Abrioux <gabrioux@redhat.com>
3 years agoMerge pull request #47376 from adk3798/wip-56984-pacific
Adam King [Wed, 3 Aug 2022 12:02:09 +0000 (08:02 -0400)]
Merge pull request #47376 from adk3798/wip-56984-pacific

pacific: cephadm: Fix repo_gpgkey should return 2 vars

Reviewed-by: Guillaume Abrioux <gabrioux@redhat.com>
3 years agoMerge pull request #47271 from vumrao/wip-vumrao-56701
Yuri Weinstein [Tue, 2 Aug 2022 22:06:57 +0000 (15:06 -0700)]
Merge pull request #47271 from vumrao/wip-vumrao-56701

pacific: libcephsqlite: ceph-mgr crashes when compiled with gcc12

Reviewed-by: Laura Flores <lflores@redhat.com>
3 years agoMerge pull request #47416 from zdover23/wip-doc-2022-08-03-backport-47197-to-pacific
zdover23 [Tue, 2 Aug 2022 20:27:16 +0000 (06:27 +1000)]
Merge pull request #47416 from zdover23/wip-doc-2022-08-03-backport-47197-to-pacific

pacific: doc/dev: Elaborate on boost .deb creation

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
3 years agoMerge pull request #47296 from aclamk/wip-56669-pacific
Laura Flores [Tue, 2 Aug 2022 16:52:38 +0000 (11:52 -0500)]
Merge pull request #47296 from aclamk/wip-56669-pacific

pacific: os/bluestore: Fix collision between BlueFS and BlueStore deferred writes

3 years agodoc/dev: Elaborate on boost .deb creation 47416/head
David Galloway [Wed, 20 Jul 2022 21:07:44 +0000 (17:07 -0400)]
doc/dev: Elaborate on boost .deb creation

Signed-off-by: David Galloway <dgallowa@redhat.com>
(cherry picked from commit 3222485d6582ba6ab3ee908c13b6459c2e2b6302)

3 years agoMerge pull request #47304 from cbodley/wip-56731
Casey Bodley [Tue, 2 Aug 2022 15:02:10 +0000 (11:02 -0400)]
Merge pull request #47304 from cbodley/wip-56731

pacific: rgw/rgw_string.h: add missing includes for alpine and boost 1.75

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
3 years agoMerge pull request #47393 from adk3798/pacific-fix-flake8
Ilya Dryomov [Tue, 2 Aug 2022 09:37:27 +0000 (11:37 +0200)]
Merge pull request #47393 from adk3798/pacific-fix-flake8

pacific: pybind/mgr: fix flake8

Reviewed-by: Guillaume Abrioux <gabrioux@redhat.com>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
3 years agomgr/cephadm: fix flake8 47393/head
Avan Thakkar [Mon, 1 Aug 2022 09:23:14 +0000 (14:53 +0530)]
mgr/cephadm: fix flake8

Signed-off-by: Avan Thakkar <athakkar@redhat.com>
(cherry picked from commit a124f6c47b119a8741f347ea5a809f3fb48d6679)

3 years agocephadm: ceph.manual.gpg cleanup 47376/head
Laurent Barbe [Fri, 29 Jul 2022 07:33:36 +0000 (09:33 +0200)]
cephadm: ceph.manual.gpg cleanup

Cleanup file /etc/apt/trusted.gpg.d/ceph.manual.gpg when repo is removed

Signed-off-by: Laurent Barbe <laurent@ksperis.com>
(cherry picked from commit bf0951353a80dc17edcc85a7914cfaf2b956d544)

3 years agocephadm: Fix repo_gpgkey should return 2 vars
Laurent Barbe [Thu, 28 Jul 2022 07:30:59 +0000 (09:30 +0200)]
cephadm: Fix repo_gpgkey should return 2 vars

when option --gpg-url is specified, the name used for the gpg filename is missing and throws an exception
this adds the string "manual" to the gpg key : /etc/apt/trusted.gpg.d/ceph.manual.gpg

Fixes: https://tracker.ceph.com/issues/56950
Signed-off-by: Laurent Barbe <laurent@ksperis.com>
(cherry picked from commit 79c805546c9bf4747a9019f4ad59f55e03c9fcef)

3 years agomgr/cephadm: clear error message when resuming upgrade 47375/head
Adam King [Tue, 26 Jul 2022 13:55:05 +0000 (09:55 -0400)]
mgr/cephadm: clear error message when resuming upgrade

the message field in the output of "ceph orch upgrade status"
will first take the value of the error field of the UpgradeState,
and if only if it blank/None, display an info string we periodically
update throughout the upgrade with useful info such as that
we're upgrading a daemon of a particular type or pulling an image
on a certain host. When an upgrade fails, we set the error field
of the UpgradeState, pause the upgrade and raise a health warning.
Sometimes, the user is able to resolve the issue and simply resume
the upgrade. The issue here is, in that case, the error field of
the UpgradeState is still set, so instead of seeing the useful info
messages, it will continue to display an error message that may
no longer be relevant. By emptying the error field of the UpgradeState
when upgrades are resumed, we return to normal behavior of
displaying the info string, and will only show another error message
if another error actually occurs.

Fixes: https://tracker.ceph.com/issues/56714
Signed-off-by: Adam King <adking@redhat.com>
(cherry picked from commit 429561ccb7b524f071214ff3aad99ba8830a924c)

3 years agoMerge pull request #47319 from adk3798/wip-56739-pacific
Adam King [Fri, 29 Jul 2022 21:21:27 +0000 (17:21 -0400)]
Merge pull request #47319 from adk3798/wip-56739-pacific

pacific: cephadm: add "su root root" to cephadm.log logrotate config

Reviewed-by: Guillaume Abrioux <gabrioux@redhat.com>
3 years agoMerge pull request #47320 from adk3798/wip-56737-pacific
Adam King [Fri, 29 Jul 2022 18:11:22 +0000 (14:11 -0400)]
Merge pull request #47320 from adk3798/wip-56737-pacific

pacific: qa/workunits/cephadm: update test_repos master -> main

Reviewed-by: Guillaume Abrioux <gabrioux@redhat.com>
3 years agoMerge pull request #47360 from zdover23/wip-doc-2022-07-29-backport-47347-to-pacific
zdover23 [Fri, 29 Jul 2022 13:13:58 +0000 (23:13 +1000)]
Merge pull request #47360 from zdover23/wip-doc-2022-07-29-backport-47347-to-pacific

pacific: doc/radosgw: Uppercase s3

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
3 years agodoc/radosgw: make s3 uppercase 47360/head
Anthony D'Atri [Fri, 29 Jul 2022 07:11:22 +0000 (00:11 -0700)]
doc/radosgw: make s3 uppercase

s/s3/S3/ (Also, a "the" has been added.)

(cherry picked from commit 73f0d5707d275529416d5110160b9ff5ead23d22)

Signed-off-by: Anthony D'Atri <anthony.datri@gmail.com>
3 years agoMerge pull request #47259 from aaSharma14/wip-56686-pacific
Nizamudeen A [Thu, 28 Jul 2022 05:24:07 +0000 (10:54 +0530)]
Merge pull request #47259 from aaSharma14/wip-56686-pacific

pacific: os/bluestore: Better readability of perf output

Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: sunilangadi2 <NOT@FOUND>
3 years agoqa/workunits/cephadm: update test_repos master -> main 47320/head
Adam King [Mon, 25 Jul 2022 20:46:39 +0000 (16:46 -0400)]
qa/workunits/cephadm: update test_repos master -> main

Missed this one, it seems the test was still passing until
recently but I guess the "master" builds are now gone

Signed-off-by: Adam King <adking@redhat.com>
(cherry picked from commit 9b08edf939752d16b5933e1d7fd5bc33d08c2d4a)

3 years agocephadm: add "su root root" to cephadm.log logrotate config 47319/head
Adam King [Tue, 19 Jul 2022 19:02:47 +0000 (15:02 -0400)]
cephadm: add "su root root" to cephadm.log logrotate config

Fixes: https://tracker.ceph.com/issues/56639
Signed-off-by: Adam King <adking@redhat.com>
(cherry picked from commit c0929e7e3ea14b0f8bfc71dc8ff74efddafb3ffc)

3 years agorgw/rgw_string.h: add missing includes for alpine and boost 1.75 47304/head
Duncan Bellamy [Fri, 21 May 2021 05:30:10 +0000 (06:30 +0100)]
rgw/rgw_string.h: add missing includes for alpine and boost 1.75
alpine needs: string, stdexcept

Fixes: https://tracker.ceph.com/issues/50924
Signed-off-by: Duncan Bellamy <dunk@denkimushi.com>
(cherry picked from commit ebf3a0398f18eab67d2ba25e6a10b41ff140f6a4)

3 years agoos/bluestore: Fix deferred writes corrupting RocksDB 47296/head
Adam Kupczyk [Wed, 29 Jun 2022 08:31:43 +0000 (10:31 +0200)]
os/bluestore: Fix deferred writes corrupting RocksDB

Deferred writes can sometimes update regions that are no longer mapped to any object.
This cannot happen when BlueStore is running, as blobs are being held,
and allocations are not released until deferred op is executed.
However in case of restart allocations that deferred is targetting are already freed.
Deferred replay is done on BlueStore bootup, before any new object can be allocated,
so no collision with object is possible.
But BlueFS can allocate space from block with deferred ops still pending.

Fixes: https://tracker.ceph.com/issues/54547
Signed-off-by: Adam Kupczyk <akupczyk@redhat.com>
(cherry picked from commit 2afb951a490aac9ca4d01614867396cbd06b793d)

Conflicts: src/os/bluestore/BlueStore.cc
Modified non-critical BlueFS call foreach_block_extents to get_block_extents.

3 years agocommon/interval_set: Add operator-- to iterator
Adam Kupczyk [Wed, 29 Jun 2022 08:28:37 +0000 (10:28 +0200)]
common/interval_set: Add operator-- to iterator

Only ++ was allowed. Extend iterator manipulation to -- too.

Signed-off-by: Adam Kupczyk <akupczyk@redhat.com>
(cherry picked from commit 58860ce3f60489d258aaa10fd783e68083261937)

3 years agotest/objectstore: Add test for deferred writes
Adam Kupczyk [Mon, 27 Jun 2022 12:50:10 +0000 (12:50 +0000)]
test/objectstore: Add test for deferred writes

Add test that recreates situation when BlueStore deferred writes
can cause RocksDB files corruption.

Signed-off-by: Adam Kupczyk <akupczyk@redhat.com>
(cherry picked from commit 42de47ae8468d000d5bca62bd537d7a1028bae42)

Conflicts: src/test/objectstore/test_deferred.cc
Non-critical code parts.

3 years agolibcephsqlite: ceph-mgr crashes when compiled with gcc12 47271/head
Ganesh Maharaj Mahalingam [Mon, 11 Apr 2022 17:15:43 +0000 (10:15 -0700)]
libcephsqlite: ceph-mgr crashes when compiled with gcc12

regex in libcephsqlite, when compiled with GCC12 treats '-' as a range
operator resulting in the following error.
"Invalid start of '[x-x]' range in regular expression"

Fixes: https://tracker.ceph.com/issues/55304
Signed-off-by: Ganesh Maharaj Mahalingam <ganesh.mahalingam@intel.com>
(cherry picked from commit ac043a09c5ffb4b434b8644920004b3d5b7f9d8c)

3 years agoMerge pull request #47087 from kamoltat/wip-ksirivad-pacific-backport-46029
Yuri Weinstein [Mon, 25 Jul 2022 14:03:47 +0000 (07:03 -0700)]
Merge pull request #47087 from kamoltat/wip-ksirivad-pacific-backport-46029

pacific:mon/Elector: notify_rank_removed erase rank from both live_pinging and dead_pinging sets for highest ranked MON

Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
3 years agoos/bluestore: Better readability of perf output 47259/head
Adam Kupczyk [Thu, 16 Dec 2021 14:59:20 +0000 (15:59 +0100)]
os/bluestore: Better readability of perf output

Get rid of bluestore_ prefix for some stats.

Signed-off-by: Adam Kupczyk <akupczyk@redhat.com>
(cherry picked from commit b5f2cc7755b221ea0a4e4d11c0e8f1866dbdc052)

3 years agoMerge pull request #46873 from ronen-fr/wip-rf-46860-pacific
Ronen Friedman [Sun, 24 Jul 2022 05:25:53 +0000 (08:25 +0300)]
Merge pull request #46873 from ronen-fr/wip-rf-46860-pacific

Pacific: osd/scrub: late-arriving reservation grants are not an error

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
3 years agoMerge pull request #47220 from ceph/16210
David Galloway [Fri, 22 Jul 2022 20:18:04 +0000 (16:18 -0400)]
Merge pull request #47220 from ceph/16210

v16.2.10

3 years agoqa: Remove unused variable 47220/head
Kotresh HR [Fri, 22 Jul 2022 13:50:33 +0000 (19:20 +0530)]
qa: Remove unused variable

Signed-off-by: Kotresh HR <khiremat@redhat.com>
(cherry picked from commit c8416c3f0e15e49dde4b9bca6f732231d9b5d16b)

3 years ago16.2.10 v16.2.10
Jenkins Build Slave User [Thu, 21 Jul 2022 17:28:56 +0000 (17:28 +0000)]
16.2.10

3 years agorgw: s3website check for bucket before retargeting
Seena Fallah [Fri, 1 Jul 2022 21:19:40 +0000 (23:19 +0200)]
rgw: s3website check for bucket before retargeting

On requesting s3website API without a bucket name it will crash because s->bucket is null

Fixes: https://tracker.ceph.com/issues/56281
Signed-off-by: Seena Fallah <seenafallah@gmail.com>
(cherry picked from commit 933dbabb3a2a43fd016bc61cc0ee5e27f7ad32e7)

Conflicts:
  src/rgw/rgw_rest_s3.cc rgw::sal::Bucket -> rgw::sal::RGWBucket
(cherry picked from commit 5b3e3874433acdfec415eae2b7a02878afe00734)

3 years agoqa: validate subvolume discover on upgrade
Kotresh HR [Fri, 4 Feb 2022 09:58:39 +0000 (15:28 +0530)]
qa: validate subvolume discover on upgrade

Validate subvolume discover on upgrade from
legacy subvolume to v1. The handcrafted
`.meta' file on legacy subvolume root should
not be used for any subvolume apis like getpath,
authorize.

Signed-off-by: Kotresh HR <khiremat@redhat.com>
(cherry picked from commit fcc118500c545fe6018cd3f2742127b92c657def)
(cherry picked from commit 34d280e306e2287f4fd9b5cac1c70607263ccc23)

3 years agomgr/volumes: V2 Fix for test_subvolume_retain_snapshot_invalid_recreate
Kotresh HR [Thu, 9 Jun 2022 08:00:59 +0000 (13:30 +0530)]
mgr/volumes: V2 Fix for test_subvolume_retain_snapshot_invalid_recreate

Signed-off-by: Kotresh HR <khiremat@redhat.com>
(cherry picked from commit 5bb46ee690591411d4890b613c6380fced9d04b4)

3 years agomgr/volumes: Fix subvolume discover during upgrade
Kotresh HR [Fri, 4 Feb 2022 09:25:03 +0000 (14:55 +0530)]
mgr/volumes: Fix subvolume discover during upgrade

Fixes the subvolume discover to use the correct
metadata file after an upgrade from legacy subvolume
to v1. The fix makes sure, it doesn't use the
handcrafted metadata file placed in the subvolume
root of legacy subvolume.

Co-authored-by: Arthur Outhenin-Chalandre <arthur.outhenin-chalandre@cern.ch>
Co-authored-by: Dan van der Ster <daniel.vanderster@cern.ch>
Co-authored-by: Ramana Raja <rraja@redhat.com>
Signed-off-by: Kotresh HR <khiremat@redhat.com>
(cherry picked from commit 7eba9cab6cfb9a13a84062177d7a0fa228311e13)
(cherry picked from commit f8c04135150a7fb3c43607b43a8214e0d57547bc)

3 years agoMerge pull request #47095 from aaSharma14/wip-56559-pacific
Ernesto Puerta [Wed, 20 Jul 2022 18:28:31 +0000 (20:28 +0200)]
Merge pull request #47095 from aaSharma14/wip-56559-pacific

pacific: os/bluestore: update perf counter priorities

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
Reviewed-by: neha-ojha <NOT@FOUND>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Yuri Weinstein <yweins@redhat.com>
3 years agoos/bluestore: update priorities and nicks of bluestore perf counters 47095/head
Laura Flores [Mon, 4 Oct 2021 04:41:10 +0000 (04:41 +0000)]
os/bluestore: update priorities and nicks of bluestore perf counters

These perf counters do not show up in telemetry unless they are set to a "useful" priority or higher. Fetching these counters in telemetry may help to diagnose problems with RocksDB / BlueFS prefetching / insufficient cache sizes.

Signed-off-by: Laura Flores <lflores@redhat.com>
(cherry picked from commit 8790f04c5469d86daebb3bbe1eb780a86b7404ce)

Note: This backport (and the original PR) exposed an extra 34 perf counters/OSD to Prometheus. Given Pacific is a stable release and not to add that much extra load we are adapting this backport and only exposing the 2 required perf-coun>

3 years agoMerge pull request #46553 from adk3798/pacific-preserve-cephadm-user
Kefu Chai [Tue, 19 Jul 2022 13:34:34 +0000 (21:34 +0800)]
Merge pull request #46553 from adk3798/pacific-preserve-cephadm-user

pacific: cephadm: preserve cephadm user during RPM upgrade

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
3 years agoMerge pull request #47093 from rhcs-dashboard/wip-56546-pacific
Pedro Gonzalez Gomez [Tue, 19 Jul 2022 06:51:51 +0000 (08:51 +0200)]
Merge pull request #47093 from rhcs-dashboard/wip-56546-pacific

pacific: mgr/dashboard: don't log tracebacks on 404s

Reviewed-by: Pegonzal <pegonzal@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
3 years agoMerge pull request #47027 from tchaikov/pacific-56466
David Galloway [Mon, 18 Jul 2022 16:36:26 +0000 (12:36 -0400)]
Merge pull request #47027 from tchaikov/pacific-56466

pacific: make-dist: patch boost source to support python 3.10  â€¦

3 years agoMerge pull request #47145 from s0nea/wip-56594-pacific
Pedro Gonzalez Gomez [Mon, 18 Jul 2022 13:35:10 +0000 (15:35 +0200)]
Merge pull request #47145 from s0nea/wip-56594-pacific

pacific: mgr/dashboard: prevent alert redirect

3 years agoMerge pull request #46695 from votdev/dashboard_pull_i18n_transifex
Nizamudeen A [Mon, 18 Jul 2022 12:33:57 +0000 (18:03 +0530)]
Merge pull request #46695 from votdev/dashboard_pull_i18n_transifex

mgr/dashboard: Pull latest languages from Transifex

Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
3 years agomgr/dashboard: prevent alert redirect 47145/head
Tatjana Dehler [Thu, 7 Jul 2022 15:21:14 +0000 (17:21 +0200)]
mgr/dashboard: prevent alert redirect

Prevent Alertmanager alerts from being redirected to the active mgr
dashboard instance. There are two reasons for it:

1. It doesn't bring any additional benefit. The Alertmanager config
   includes all available mgr instances - active and passive ones. In
   case of an alert, it will be sent to all of them. It ensures that
   the active mgr dashboard will receive the alert in any case.
2. The redirect URL includes the mgr IP and NOT the FQDN. This leads
   to issues in environments where an SSL certificate is configured and
   matches the FQDNs, only.

Fixes: https://tracker.ceph.com/issues/56401
Signed-off-by: Tatjana Dehler <tdehler@suse.com>
(cherry picked from commit 965005e0789e566ccadce7a326b0e197ab8d7f5f)

3 years agoMerge pull request #47008 from rhcs-dashboard/wip-56125-pacific
Nizamudeen A [Mon, 18 Jul 2022 07:52:39 +0000 (13:22 +0530)]
Merge pull request #47008 from rhcs-dashboard/wip-56125-pacific

pacific: mgr/dashboard: display helpfull message when the iframe-embedded Grafana dashboard failed to load

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: nSedrickm <NOT@FOUND>
3 years agoMerge pull request #46969 from guits/wip-56471-2-pacific
Guillaume Abrioux [Mon, 18 Jul 2022 07:18:41 +0000 (09:18 +0200)]
Merge pull request #46969 from guits/wip-56471-2-pacific

pacific: ceph-volume: avoid unnecessary subprocess calls

3 years agoMerge pull request #47122 from zdover23/wip-doc-2022-07-16-backport-47109-to-pacific
zdover23 [Sat, 16 Jul 2022 18:45:42 +0000 (04:45 +1000)]
Merge pull request #47122 from zdover23/wip-doc-2022-07-16-backport-47109-to-pacific

pacific: doc/start: update hardware recs

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
3 years agoMerge pull request #47084 from rhcs-dashboard/wip-56544-pacific
Nizamudeen A [Sat, 16 Jul 2022 13:58:50 +0000 (19:28 +0530)]
Merge pull request #47084 from rhcs-dashboard/wip-56544-pacific

pacific: mgr/dashboard: ingress backend service should list all supported services

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
3 years agocmake: patch boost source to support python 3.10 47027/head
Kefu Chai [Sat, 9 Jul 2022 01:58:32 +0000 (21:58 -0400)]
cmake: patch boost source to support python 3.10

Python 3.10 doesn't include the _Py_fopen() function.  Boost
1.75.0 includes a patch which switches to using fopen() for
python versions >= 3.1, but Pacific is using boost 1.73.0,
which still uses _Py_fopen().  This commit adds the boost
1.75.0 patch to `make-dist`, so it's applied to our copy of
the boost source which is then used when building RPM packages.

the included patch comes from
https://github.com/boostorg/python/commit/d9f06052e28873037db7f98629bce72182a42410

Fixes: https://tracker.ceph.com/issues/56466
please note, this change is not cherry-picked from the
"main" branch. as we use boost 1.75 already in that branch,
but to minimize the risk of switching boost from 1.73 to
1.75 in a LTS branch like pacific, we just add a fix to
address this particular issue in boost 1.73.

Signed-off-by: Tim Serong <tserong@suse.com>
Signed-off-by: Kefu Chai <tchaikov@gmail.com>
3 years agodoc/start: update hardware recs 47122/head
Zac Dover [Thu, 14 Jul 2022 19:29:11 +0000 (05:29 +1000)]
doc/start: update hardware recs

This PR picks up the parts of
https://github.com/ceph/ceph/pull/44466
that were not merged back in January, when that
pull request was raised.

Matters added here:
* improved organzation of matter
* emphasis of IOPs per core over cores per OSD

Signed-off-by: Zac Dover <zac.dover@gmail.com>
(cherry picked from commit 29c44a3bd6919f7fc23083d75d22e84c8b51e1c1)

3 years agoMerge pull request #47103 from adk3798/pacific-osd-removal-docs-update
Adam King [Thu, 14 Jul 2022 17:27:57 +0000 (13:27 -0400)]
Merge pull request #47103 from adk3798/pacific-osd-removal-docs-update

pacific: doc/cephadm: add note about OSDs being recreated to OSD removal section

Reviewed-by: <Anthony D'Atri anthonyeleven@users.noreply.github.com>
3 years agodoc/cephadm: add note about OSDs being recreated to OSD removal section 47103/head
Adam King [Tue, 12 Jul 2022 20:54:19 +0000 (16:54 -0400)]
doc/cephadm: add note about OSDs being recreated to OSD removal section

Signed-off-by: Adam King <adking@redhat.com>
(cherry picked from commit d4a39cd046b93cb7bb5b7ce0311139d9f6552802)

3 years agomgr/dashboard: don't log tracebacks on 404s 47093/head
Ernesto Puerta [Wed, 29 Jun 2022 18:09:21 +0000 (20:09 +0200)]
mgr/dashboard: don't log tracebacks on 404s

Currently we're logging tracebacks on expected request errors as 404,
401, etc. This may cause confusion to users, which might think that
something really wrong was happening there.

This should be extended to many DashboardExceptions that simply return
expected HTTP error codes (403, 415, 3xx, etc).

Fixes: https://tracker.ceph.com/issues/55720
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>
(cherry picked from commit 3928fe91a4b8c313a52e38cab9ba31e54ff1ae51)

3 years agomon/Elector: notify_rank_removed correctly nuke highest ranked MON 47087/head
Kamoltat [Mon, 25 Apr 2022 19:54:02 +0000 (19:54 +0000)]
mon/Elector: notify_rank_removed correctly nuke highest ranked MON

Added a case where we are removing the highest rank monitor
in `notify_rank_removed`, the old version did not deal with this
since it would only go into the loop when rank_removed < paxos_size().
Therefore, we added an else case for when rank_removed == paxos_size(),
we erase the rank from both `live_pinging` and `dead_pinging` set.

Fixes: https://tracker.ceph.com/issues/55435
Signed-off-by: Kamoltat <ksirivad@redhat.com>
(cherry picked from commit 13f09d0d8a3907ea948343f7d0a092e8ab288439)

3 years agomgr/dashboard: ingress backend service should list all supported services 47084/head
Avan Thakkar [Wed, 6 Jul 2022 09:24:26 +0000 (14:54 +0530)]
mgr/dashboard: ingress backend service should list all supported services

Fixes: https://tracker.ceph.com/issues/56478
Signed-off-by: Avan Thakkar <athakkar@redhat.com>
(cherry picked from commit 32118522cb71722c3cc20a1e1a9ca9ffdf7897e4)

3 years agoMerge pull request #46675 from rhcs-dashboard/wip-56038-pacific
Nizamudeen A [Wed, 13 Jul 2022 07:37:13 +0000 (13:07 +0530)]
Merge pull request #46675 from rhcs-dashboard/wip-56038-pacific

pacific: mgr/dashboard: stop polling when page is not visible

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
3 years agoMerge pull request #46953 from idryomov/wip-56387-pacific
Yuri Weinstein [Tue, 12 Jul 2022 13:31:05 +0000 (06:31 -0700)]
Merge pull request #46953 from idryomov/wip-56387-pacific

pacific: rbd-fuse: librados will filter out -r option from command-line

Reviewed-by: Mykola Golub <mgolub@suse.com>
Reviewed-by: Christopher Hoffman <choffman@redhat.com>
3 years agoMerge pull request #46767 from ronen-fr/wip-rf-42780-pacific
Yuri Weinstein [Tue, 12 Jul 2022 13:30:10 +0000 (06:30 -0700)]
Merge pull request #46767 from ronen-fr/wip-rf-42780-pacific

pacific: osd/scrub: mark PG as being scrubbed, from scrub initiation to Inacti…

Reviewed-by: Neha Ojha <nojha@redhat.com>
3 years agoMerge pull request #47049 from zdover23/wip-doc-2022-07-12-backport-47045-to-pacific
zdover23 [Mon, 11 Jul 2022 21:00:27 +0000 (07:00 +1000)]
Merge pull request #47049 from zdover23/wip-doc-2022-07-12-backport-47045-to-pacific

pacific: doc/dev: s/github/GitHub/ in essentials.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
3 years agoMerge pull request #47050 from zdover23/wip-doc-2022-07-12-backport-47031-to-pacific
zdover23 [Mon, 11 Jul 2022 20:55:21 +0000 (06:55 +1000)]
Merge pull request #47050 from zdover23/wip-doc-2022-07-12-backport-47031-to-pacific

pacific: doc/dev: edit delayed-delete.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
3 years agodoc/dev: s/github/GitHub/ in essentials.rst 47049/head
Zac Dover [Mon, 11 Jul 2022 16:58:18 +0000 (02:58 +1000)]
doc/dev: s/github/GitHub/ in essentials.rst

This addresses a typo that Anthony D'Atri pointed out in
PR#47032. It didn't get addressed there, so it's being
addressed here.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
(cherry picked from commit f7581e05b08d6ab55446088b0fb9f29b1dd6441b)

3 years agodoc/dev: edit delayed-delete.rst 47050/head
Zac Dover [Sat, 9 Jul 2022 16:10:31 +0000 (02:10 +1000)]
doc/dev: edit delayed-delete.rst

This PR improves the English in the "CephFS Delayed
Deletion" chapter of the Ceph Internals Guide (which
is stored in the doc/dev/ directory).

There was no pressing need to rewrite this. I just saw
that it could be tightened up, and I had the fifteen
minutes I needed to do it.

Co-author: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@gmail.com>
(cherry picked from commit c186c5ec6cb2ea1999cb14500aaa64d6aa72dddd)

3 years agoMerge pull request #47043 from zdover23/wip-doc-2022-07-12-backport-47032-to-pacific
zdover23 [Mon, 11 Jul 2022 18:15:19 +0000 (04:15 +1000)]
Merge pull request #47043 from zdover23/wip-doc-2022-07-12-backport-47032-to-pacific

pacific: doc/dev: add Dependabot section to essentials.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
3 years agodoc/dev: add Dependabot section to essentials.rst 47043/head
Zac Dover [Sat, 9 Jul 2022 18:05:47 +0000 (04:05 +1000)]
doc/dev: add Dependabot section to essentials.rst

This PR adds a section to the Developer Guide chapter
"Essentials" that explains what Dependabot is. This
section is adapted from an email from Ernesto Puerta
to the CLT that was sent on 08 Jul 2022.

Co-authored-by: Ernesto Puerta <epuertat@redhat.com>>
Signed-off-by: Zac Dover <zac.dover@gmail.com>
(cherry picked from commit 2711e8de80edea121503e022cca37683f8abdfa9)

3 years agoMerge pull request #46921 from ceph/revert-46429-wip-55309-pacific
Yuri Weinstein [Mon, 11 Jul 2022 13:36:20 +0000 (06:36 -0700)]
Merge pull request #46921 from ceph/revert-46429-wip-55309-pacific

Revert "pacific: mgr, mgr/prometheus: Fix regression with prometheus metrics"

Reviewed-by: Laura Flores <lflores@redhat.com>
3 years agoMerge pull request #46920 from ceph/revert-46427-wip-55308-pacific
Yuri Weinstein [Mon, 11 Jul 2022 13:35:50 +0000 (06:35 -0700)]
Merge pull request #46920 from ceph/revert-46427-wip-55308-pacific

Revert "pacific: mgr, mon: Keep upto date metadata with mgr for MONs"

Reviewed-by: Laura Flores <lflores@redhat.com>
3 years agoMerge pull request #46845 from ronen-fr/wip-rf-46727-pacific
Yuri Weinstein [Mon, 11 Jul 2022 13:34:46 +0000 (06:34 -0700)]
Merge pull request #46845 from ronen-fr/wip-rf-46727-pacific

Pacific: osd/scrubber/pg_scrubber.cc: fix bug where scrub machine gets stuck

Reviewed-by: Neha Ojha <nojha@redhat.com>
3 years agoMerge pull request #46806 from nmshelke/wip-56104-pacific
Yuri Weinstein [Mon, 11 Jul 2022 13:34:03 +0000 (06:34 -0700)]
Merge pull request #46806 from nmshelke/wip-56104-pacific

pacific: mgr/volumes: subvolume ls command crashes if groupname as '_nogroup'

Reviewed-by: Venky Shankar <vshankar@redhat.com>
3 years agoMerge pull request #46803 from nmshelke/wip-56107-pacific
Yuri Weinstein [Mon, 11 Jul 2022 13:33:18 +0000 (06:33 -0700)]
Merge pull request #46803 from nmshelke/wip-56107-pacific

pacific: mgr/volumes: remove incorrect 'size' from output of 'snapshot info'

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
3 years agoMerge pull request #46677 from ljflores/wip-51287-pacific
Yuri Weinstein [Mon, 11 Jul 2022 13:31:11 +0000 (06:31 -0700)]
Merge pull request #46677 from ljflores/wip-51287-pacific

pacific: ceph_test_librados_service: wait longer for servicemap to update

Reviewed-by: Kefu Chai <kchai@redhat.com>
3 years agoMerge pull request #46939 from zdover23/wip-doc-2022-07-03-backport-46938-to-pacific
zdover23 [Sat, 9 Jul 2022 16:12:27 +0000 (02:12 +1000)]
Merge pull request #46939 from zdover23/wip-doc-2022-07-03-backport-46938-to-pacific

pacific: doc/dev: add IRC registration instructions

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
3 years agodoc/dev: add IRC registration instructions 46939/head
Zac Dover [Sat, 2 Jul 2022 15:47:02 +0000 (01:47 +1000)]
doc/dev: add IRC registration instructions

This PR adds to the Developer Guide a link to the OFTC's IRC nick
registration instructions.

(cherry picked from commit 893e68a8f57b22cc025c82586ad0b42da2a6477c)

3 years agoMerge pull request #46340 from zdover23/wip-doc-pr-45209-backport-pacific
zdover23 [Fri, 8 Jul 2022 17:49:58 +0000 (03:49 +1000)]
Merge pull request #46340 from zdover23/wip-doc-pr-45209-backport-pacific

pacific: doc/start: alphabetize hardware-recs links

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
3 years agoMerge pull request #46347 from zdover23/wip-min-hardware-typo-pacific-backport-2022...
zdover23 [Fri, 8 Jul 2022 17:36:45 +0000 (03:36 +1000)]
Merge pull request #46347 from zdover23/wip-min-hardware-typo-pacific-backport-2022-05-19

pacific: Wip min hardware typo pacific backport 2022 05 19

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
3 years agoMerge pull request #46976 from adk3798/wip-56436-pacific
Adam King [Fri, 8 Jul 2022 12:23:31 +0000 (08:23 -0400)]
Merge pull request #46976 from adk3798/wip-56436-pacific

pacific: doc/cephadm: enhancing daemon operations documentation

Reviewed-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
3 years agoMerge pull request #46977 from adk3798/wip-56158-pacific
Adam King [Fri, 8 Jul 2022 12:22:17 +0000 (08:22 -0400)]
Merge pull request #46977 from adk3798/wip-56158-pacific

pacific: doc/cephadm: Add post-upgrade section

Reviewed-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
3 years agoMerge pull request #46974 from adk3798/wip-56473-pacific
Adam King [Fri, 8 Jul 2022 12:06:34 +0000 (08:06 -0400)]
Merge pull request #46974 from adk3798/wip-56473-pacific

pacific: pybind/mgr/cephadm/serve: don't remove ceph.conf which leads to qa failure

Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
3 years agoMerge pull request #46069 from guits/wip-55479-pacific
Guillaume Abrioux [Fri, 8 Jul 2022 05:20:38 +0000 (07:20 +0200)]
Merge pull request #46069 from guits/wip-55479-pacific

pacific: ceph-volume: only warn when config file isn't found

3 years agoMerge pull request #46729 from guits/wip-56084-pacific
Guillaume Abrioux [Fri, 8 Jul 2022 05:15:38 +0000 (07:15 +0200)]
Merge pull request #46729 from guits/wip-56084-pacific

pacific: ceph-volume: do not log sensitive details

3 years agoMerge pull request #46731 from guits/wip-56040-pacific
Guillaume Abrioux [Fri, 8 Jul 2022 05:14:36 +0000 (07:14 +0200)]
Merge pull request #46731 from guits/wip-56040-pacific

pacific: ceph-volume: make is_valid() optional

3 years agoMerge pull request #46967 from guits/wip-56472-pacific
Guillaume Abrioux [Fri, 8 Jul 2022 05:13:03 +0000 (07:13 +0200)]
Merge pull request #46967 from guits/wip-56472-pacific

pacific: ceph-volume: decrease number of `pvs` calls in `lvm list`

3 years agoMerge pull request #47018 from guits/wip-56493-pacific
Guillaume Abrioux [Fri, 8 Jul 2022 04:10:05 +0000 (06:10 +0200)]
Merge pull request #47018 from guits/wip-56493-pacific

pacific: ceph-volume: allow listing devices by OSD ID

3 years agoMerge pull request #46975 from adk3798/wip-56455-pacific
Adam King [Fri, 8 Jul 2022 00:36:30 +0000 (20:36 -0400)]
Merge pull request #46975 from adk3798/wip-56455-pacific

pacific: mgr/cephadm: fixing scheduler consistent hashing

Reviewed-by: Redouane Kachach <rkachach@redhat.com>
3 years agoceph-volume: move get_lvs_from_path() to api/lvm.py 47018/head
Rishabh Dave [Mon, 30 Nov 2020 09:40:30 +0000 (15:10 +0530)]
ceph-volume: move get_lvs_from_path() to api/lvm.py

This makes this method reusable across ceph-volume codebase.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
(cherry picked from commit 0ea399c01143673f0225b1b4a48136af75b0b6c5)

3 years agoceph-volume: allow listing devices by OSD ID
Rishabh Dave [Thu, 19 Nov 2020 13:06:38 +0000 (18:36 +0530)]
ceph-volume: allow listing devices by OSD ID

Adds the ability to list devices by OSD IDs, i.e. "ceph-volume lvm list
3" would list all devices under OSD ID 3 (which can be up to 2 and 3
devices under filestore and bluestore OSDs respectively).

Fixes: https://tracker.ceph.com/issues/41294
Signed-off-by: Rishabh Dave <ridave@redhat.com>
(cherry picked from commit 0792a396ce61b356ad004ac3dbd96fabed739eac)

3 years agoceph-volume: add methods to get LV from OSD ID
Rishabh Dave [Thu, 19 Nov 2020 13:05:39 +0000 (18:35 +0530)]
ceph-volume: add methods to get LV from OSD ID

Signed-off-by: Rishabh Dave <ridave@redhat.com>
(cherry picked from commit 7bf4937a597b37d98d3c4e69e2751c07992e33e4)

3 years agomgr/dashboard: Dashboard should display some helpful (error) message when the iframe... 47008/head
Ngwa Sedrick Meh [Mon, 14 Feb 2022 05:17:47 +0000 (06:17 +0100)]
mgr/dashboard: Dashboard should display some helpful (error) message when the iframe-embedded Grafana dashboard failed to load

This commit adds checks for successful grafana panel loads before displaying dashboards and informs the user if the request is blocked by the browser
Fixes: https://tracker.ceph.com/issues/54206
Signed-off-by: Ngwa Sedrick Meh <nsedrick101@gmail.com>
(cherry picked from commit a4b66efb2a2139bd88a6a088af9bd5e079e46105)

3 years agoMerge pull request #46934 from zdover23/wip-doc-2022-06-30-backport-46906-to-pacific
zdover23 [Thu, 7 Jul 2022 11:25:19 +0000 (21:25 +1000)]
Merge pull request #46934 from zdover23/wip-doc-2022-06-30-backport-46906-to-pacific

pacific: doc/dev: s/the the/the/ in basic-workflow.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
3 years agoRevert "pacific: mgr, mgr/prometheus: Fix regression with prometheus metrics" 46921/head
Prashant D [Fri, 1 Jul 2022 05:19:14 +0000 (15:19 +1000)]
Revert "pacific: mgr, mgr/prometheus: Fix regression with prometheus metrics"

This reverts pacific commit f07e47ae405218dbe4029ed9c82559d0cf1667a5

Reason: The pacific commit 98760e36c7bbbb48657e4d033bcbb080a56bbf7b has
added a new MMgrUpdate message which incorrectly handled service_daemon.
Reverting PR#46429 as a result of revert of PR#46427.

More details in https://tracker.ceph.com/issues/55322

Signed-off-by: Prashant D <pdhange@redhat.com>
3 years agoRevert "pacific: mgr, mon: Keep upto date metadata with mgr for MONs" 46920/head
Prashant D [Fri, 1 Jul 2022 05:18:24 +0000 (15:18 +1000)]
Revert "pacific: mgr, mon: Keep upto date metadata with mgr for MONs"

This reverts pacific commit 98760e36c7bbbb48657e4d033bcbb080a56bbf7b

Reason: The service_daemon is related to client daemons like rgw,
iscsi demons and it should not be handled in MMgrUpdate.

More details in https://tracker.ceph.com/issues/55322

Signed-off-by: Prashant D <pdhange@redhat.com>
3 years agodoc/cephadm: Add post-upgrade section 46977/head
Redouane Kachach [Thu, 16 Jun 2022 14:28:30 +0000 (16:28 +0200)]
doc/cephadm: Add post-upgrade section
Fixes: https://tracker.ceph.com/issues/54474
Signed-off-by: Redouane Kachach <rkachach@redhat.com>
(cherry picked from commit 49b234ae744dd3a2afc130d9c215f4f00c1ee4b8)

3 years agodoc/cephadm: enhancing daemon operations documentation 46976/head
Redouane Kachach [Wed, 15 Jun 2022 10:35:30 +0000 (12:35 +0200)]
doc/cephadm: enhancing daemon operations documentation
Fixes: https://tracker.ceph.com/issues/54399
Signed-off-by: Redouane Kachach <rkachach@redhat.com>
(cherry picked from commit df1aaacb7d09322528e42ae90c0d98793e9c254e)

3 years agomgr/cephadm: fixing E128 warning 46975/head
Redouane Kachach [Wed, 29 Jun 2022 15:03:10 +0000 (17:03 +0200)]
mgr/cephadm: fixing E128 warning

Signed-off-by: Redouane Kachach <rkachach@redhat.com>
(cherry picked from commit e37924c623d797b3118ddd9a804818432a5704dd)

3 years agomgr/cephadm: fixing scheduler consistent hashing
Redouane Kachach [Tue, 28 Jun 2022 13:32:19 +0000 (15:32 +0200)]
mgr/cephadm: fixing scheduler consistent hashing

Signed-off-by: Redouane Kachach <rkachach@redhat.com>
(cherry picked from commit 5d5829cd370e9278cb8b70d6426094e595badb5d)

3 years agopybind/mgr/cephadm/serve: don't remove ceph.conf which leads to qa failure 46974/head
dparmar18 [Tue, 14 Jun 2022 20:30:48 +0000 (02:00 +0530)]
pybind/mgr/cephadm/serve: don't remove ceph.conf which leads to qa failure

Fixes: https://tracker.ceph.com/issues/56024
Signed-off-by: Dhairya Parmar <dparmar@redhat.com>
(cherry picked from commit 6436acc4b51b52635f8fa0e56cd79ba66c028d81)

3 years agoMerge pull request #46744 from mkogan1/rgw-backport-pacific-t54363
Yuri Weinstein [Tue, 5 Jul 2022 14:39:27 +0000 (07:39 -0700)]
Merge pull request #46744 from mkogan1/rgw-backport-pacific-t54363

pacific: rgwlc: fix segfault resharding during lc

Reviewed-by: Casey Bodley <cbodley@redhat.com>
3 years agoMerge pull request #46715 from mkogan1/rgw-pacific-fix-fips-segf
Yuri Weinstein [Tue, 5 Jul 2022 14:38:48 +0000 (07:38 -0700)]
Merge pull request #46715 from mkogan1/rgw-pacific-fix-fips-segf

pacific rgw: on FIPS enabled, fix segfault performing s3 multipart PUT

Reviewed-by: Casey Bodley <cbodley@redhat.com>