Xiubo Li [Thu, 23 Feb 2023 02:37:39 +0000 (10:37 +0800)]
qa: make the xfstests tmp directories to be readable and excutable
The user namespace test case will excute some commands as the other
user. And the temporary direcotry now has the rx permission for
other users by default. The test then will fail otherwise.
Fixes: https://tracker.ceph.com/issues/58760 Signed-off-by: Xiubo Li <xiubli@redhat.com>
Venky Shankar [Tue, 28 Feb 2023 07:01:59 +0000 (12:31 +0530)]
Merge PR #50197 into main
* refs/pull/50197/head:
cephfs-top: navigate to home screen while selecting sort field, if no filesystems.
cephfs-top: display_menu() isn't triggered when all fs' are removed
Reviewed-by: Jos Collin <jcollin@redhat.com> Reviewed-by: Venky Shankar <vshankar@redhat.com>
Zac Dover [Tue, 28 Feb 2023 02:55:08 +0000 (12:55 +1000)]
doc/radosgw: s/zone group/zonegroup/g et alia
s/zone group/zonegroup/ where simple greps failed to find instances of
"zone group" that were spread across two lines; break a paragraph into
two paragraphs so that each paragraph has a thematic idea of its own.
Ilya Dryomov [Mon, 6 Feb 2023 16:56:00 +0000 (17:56 +0100)]
mon/MgrMap: dump last_failure_osd_epoch and active_clients at top level
Currently last_failure_osd_epoch and active_clients are dumped in the
always_on_modules dictionary in "ceph mgr dump" output. This goes back
to when these fields were added in commits f2986a4400bb ("mon/MgrMonitor:
blacklist previous instance") and df507cde8d71 ("mgr: forward RADOS
client instances for potential blacklist") but is wrong as these fields
have nothing to do with always-on modules.
Zac Dover [Mon, 27 Feb 2023 08:40:14 +0000 (18:40 +1000)]
doc/rgw: remove "tertiary", link to procedure
Remove the term "tertiary zone" and replace it with "second secondary
zone" (because there is no such thing as a tertiary zone). Link to the
procedure for creating a secondary zone in a place where such a link is
helpful to the reader.
Ronen Friedman [Thu, 23 Feb 2023 15:53:56 +0000 (17:53 +0200)]
test/osd-scrub-dump.sh: fix scrub chunk size
The test performs shallow scrubs, intentionally using small chunk
sizes to allow dump commands time to check specific details.
Following commit ffda64119fc6165cebffd0b26619ad47b13daf51
(PR#44749), shallow scrubs chunks are controlled by a separate
configuration parameter. This PR fixes the test to use the
correct parameter.
An additional minor change is an adjustment to the test loop sleep time:
it is now reduced to guarantee that a dump followed by a counter
increase will be performed in more-or-less the scrubs frequency.
thomas [Fri, 24 Feb 2023 06:00:00 +0000 (01:00 -0500)]
doc/cephadm/host-management: add service spec link
The old "(below)" text is not accurate, the service spec definition is
not in the same file at this point in time. This commit adds a ref link
to the actual service specification section.
Zac Dover [Fri, 24 Feb 2023 01:07:12 +0000 (11:07 +1000)]
doc/glossary: add AWS/OpenStack bucket info
Add links to AWS's documentation of buckets, in accordance with Casey
Bodley's suggestions here:
https://github.com/ceph/ceph/pull/50221#discussion_r1115900879
Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com> Signed-off-by: Zac Dover <zac.dover@proton.me>
Casey Bodley [Wed, 17 Aug 2022 13:27:42 +0000 (09:27 -0400)]
common: add abstraction for label-aware perf counter keys
a flat representation of a set of prometheus labels, returned as a
std::string. this string can either be used for sorting an ordered
container of perf counters, or for hashing an unordered container
Rishabh Dave [Thu, 16 Feb 2023 12:02:37 +0000 (17:32 +0530)]
qa/cephfs: add 'rhel' to family of RH OS in xfstest_dev.py
The string returned by get_system_type() for RHEL 8.4 recently wasn't
one of the strings that xfstests_dev.py expects. The string returned
this time was instead "rhel". Add this string to the list of strings
that xfstests_dev.py expects for Red Hat OS family so that this failure
won't occur again in future. Also log the detected distro and version so
that it is easier to debug when this issue occurs next time.
Fixes: https://tracker.ceph.com/issues/58726 Signed-off-by: Rishabh Dave <ridave@redhat.com>
Ernesto Puerta [Thu, 23 Feb 2023 16:22:10 +0000 (17:22 +0100)]
mgr/dashboard: fix constraints.txt again
The previous attempt to fix this issue
(https://github.com/ceph/ceph/pull/50207) was not successful, since the
PIP syntax for compatible versions (~=) behaves differently compared to
other package management tools (e.g.: npm).
In this case, package~=x.y.z equasl to package>=x.y.z;package==x.y.*,
instead of the desired package>=x.y.z;package==x.*.
Temporarily disable teuthology cron jobs before
the Reef dev freeze. This commit is intended to
lessen the load on the teuthology queue as we
test final patches for Reef, but should be reverted
after the dev freeze.
Laura Flores [Thu, 12 Jan 2023 23:36:50 +0000 (23:36 +0000)]
test/osd: add read balancer unit tests
This commit adds unit test coverage to the read balancing
feature, including small vs. large osdmap scenarios,
random osdmap scenarios, and scenarios that involve
tweaking primary affinity on an OSD.
Laura Flores [Wed, 1 Feb 2023 23:52:17 +0000 (23:52 +0000)]
tools, test/cli: add read balancer to osdmaptool
This commit adds the capability to balance reads on a
given osdmap with the osdmaptool. The user has the option
of performing a "dry run" of read balancing OR taking it a
step further and applying the results to a live cluster.
Performing a "dry run" would involve simply running an
osdmaptool command and inspecting the results.
The template for the command is:
`osdmaptool <osd map file> --read <file for command output> --read-pool <pool name>`
An example command a user might run is:
`osdmaptool om --read out.txt --read-pool default.rgw.control`
This commit also adds a `--vstart` flag that allows a user to print ceph
commands in the outfile formatted for a vstart cluster. An example command
a user might run is:
`./bin/osdmaptool om --vstart --read out.txt --read-pool default.rgw.control`
The out.txt file would contain ceph commands prefixed with `./bin/`.
The `--vstart` flag may also be applied to an `--upmap` osdmaptool command.
If the user wants to apply read balancing results from their dry run to a
live cluster, they may either manually apply the ceph commands from the out
file, or run `source <outfile>`.
Laura Flores [Wed, 1 Feb 2023 23:50:53 +0000 (23:50 +0000)]
osd: implement read balancer
This commit implements two functions:
1. calc_desired_primary_distribution
Based on the number of pgs in a pool and the pool's
replica count, we calculate the ideal number of primary
pgs that should be assigned to each OSD on that pool in
order for reads to be balanced.
2. balance_primaries
This is the overall algorithm used to balance reads (primary
pgs) in a pool. Based on the first function, we re-distribute
primaries on the OSDs in a pool so each OSD has the ideal
number of primaries. This is done without data movement.
Rishabh Dave [Mon, 20 Feb 2023 07:51:25 +0000 (13:21 +0530)]
doc/cephfs: describe conf opt "client quota df" in quota doc
The ceph config file option (from the client section) "client quota df"
is mentioned in "CephFS Client Capabilities" document but not in the
"CephFS Quota" document. Adding information about this option to this
document too would make it easier for CephFS users to discover,
understand and use this option.
Rishabh Dave [Mon, 20 Feb 2023 07:47:03 +0000 (13:17 +0530)]
doc/cephfs: rearrange CephFS Quota document
CephFS users, especially new users, would find it easier to discover,
understand and use CephFS Quota when basic information (like setting,
viewing and removing CephFS quota from a CephFS directory) is mentioned
in the documentation before advanced information (like limitations &
implementation details of CephFS Quota).