thomas [Fri, 24 Feb 2023 06:00:00 +0000 (01:00 -0500)]
doc/cephadm/host-management: add service spec link
The old "(below)" text is not accurate, the service spec definition is
not in the same file at this point in time. This commit adds a ref link
to the actual service specification section.
Zac Dover [Fri, 24 Feb 2023 01:07:12 +0000 (11:07 +1000)]
doc/glossary: add AWS/OpenStack bucket info
Add links to AWS's documentation of buckets, in accordance with Casey
Bodley's suggestions here:
https://github.com/ceph/ceph/pull/50221#discussion_r1115900879
Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com> Signed-off-by: Zac Dover <zac.dover@proton.me>
Rishabh Dave [Thu, 16 Feb 2023 12:02:37 +0000 (17:32 +0530)]
qa/cephfs: add 'rhel' to family of RH OS in xfstest_dev.py
The string returned by get_system_type() for RHEL 8.4 recently wasn't
one of the strings that xfstests_dev.py expects. The string returned
this time was instead "rhel". Add this string to the list of strings
that xfstests_dev.py expects for Red Hat OS family so that this failure
won't occur again in future. Also log the detected distro and version so
that it is easier to debug when this issue occurs next time.
Fixes: https://tracker.ceph.com/issues/58726 Signed-off-by: Rishabh Dave <ridave@redhat.com>
Temporarily disable teuthology cron jobs before
the Reef dev freeze. This commit is intended to
lessen the load on the teuthology queue as we
test final patches for Reef, but should be reverted
after the dev freeze.
Rishabh Dave [Mon, 20 Feb 2023 07:51:25 +0000 (13:21 +0530)]
doc/cephfs: describe conf opt "client quota df" in quota doc
The ceph config file option (from the client section) "client quota df"
is mentioned in "CephFS Client Capabilities" document but not in the
"CephFS Quota" document. Adding information about this option to this
document too would make it easier for CephFS users to discover,
understand and use this option.
Rishabh Dave [Mon, 20 Feb 2023 07:47:03 +0000 (13:17 +0530)]
doc/cephfs: rearrange CephFS Quota document
CephFS users, especially new users, would find it easier to discover,
understand and use CephFS Quota when basic information (like setting,
viewing and removing CephFS quota from a CephFS directory) is mentioned
in the documentation before advanced information (like limitations &
implementation details of CephFS Quota).
Rishabh Dave [Tue, 31 May 2022 03:14:51 +0000 (08:44 +0530)]
qa/cephfs: save results dir from xfstests-dev repo
The "results" directory in xfstests-dev repo contains logs that are
created by it during execution of its tests. Copying this directory to
Ceph log directory saves it from being erased during tear down conducted
by teuthology test runner. These logs allow deeper inspection in to the
cause of failure of tests.
Rishabh Dave [Wed, 8 Jun 2022 17:04:51 +0000 (22:34 +0530)]
qa/cephfs: modify user creation code for xfstests-dev
Create user "fsgqa2" and, since xfstests-dev's README uses option "-m"
while creating user "fsgqa", do the same in our codebase.
Creating user "fsgqa2" is optional along with other users according to
xfstests-dev's README. Create all these users is a preventive step since
tests needing user/users maybe skipped during execution.
Rishabh Dave [Wed, 8 Jun 2022 16:58:34 +0000 (22:28 +0530)]
qa/cephfs: minor changes in xfstests_dev.py
In xfstests-dev repo, local.config options "SCRATCH_DEV" and
"SCRATCH_MNT" were enabled in commit 2ba6b871056c10d7ea75b526489baa3586024fbf but TODO comment for the
wasn't deleted. Let's delete that and use format string instead of
format function on regular string.
Rishabh Dave [Sat, 7 May 2022 03:42:52 +0000 (09:12 +0530)]
qa/cephfs: make it easier to use xfstests-dev using vstart_runner
The intention of this re-arrangement is to make it easier for developers
to use an already cloned and built xfstests-dev repo with
vstart_runner.py.
The re-arrangements are -
* move tearDown() closer to setUp() (so that devs can
enable/disable parts of them easily),
* carve out separate methods (so that these codeblocks can be disabled
in a single go) for -
** deleting groups and users,
** deleting xfstests-dev and xfsprogs-dev repo and
** building xfstests-dev repo
* carve out method for deleting xfstests-dev and xfsprogs-dev repos
* add self.xfstests_repo_path comment (for devs to set path to
xfstests-dev repo), and,
* add a note showing how to use already cloned and built xfstests-dev
repo
Venky Shankar [Wed, 22 Feb 2023 09:11:09 +0000 (14:41 +0530)]
Merge PR #45669 into main
* refs/pull/45669/head:
client: switch to use 32 bits ext_num_fwd
client: switch to use 32 bits ext_num_retry
ceph_fs.h: add 32 bits extended num_retry and num_fwd support
ceph_fs.h: switch to use its own encode/decode helpers
Venky Shankar [Wed, 22 Feb 2023 06:11:44 +0000 (11:41 +0530)]
Merge PR #49934 into main
* refs/pull/49934/head:
qa: add test_fscrypt_dummy_encryption test case support
qa: add 'options' parameter support for write_local_config
qa: add ceph.exclude file to exclude individual tests
qa: add require_kernel_mount helper support
qa: rename test_fscrypt to test_fscrypt_encrypt
Zac Dover [Wed, 22 Feb 2023 03:36:40 +0000 (13:36 +1000)]
doc/rgw: clarify multisite.rst top matter
Improve the pragmatics of the top matter of multisite.rst. Organize the
text into sections, where doing so makes the nature of multi-site
configurations clearer.
In terms of `CXXFLAGS` this commit does for `examples/librbd`
exactly what be838652fae1ee4683b62785192a58992a76d1fe already
did to `examples/librados`. Together they cover the purpose
of the long-waiting PR #44738.
Commit dc69033763cc116c6ccdf1f97149a74248691042 moves cephfs-shell from
"<CEPH-REPO-ROOT>/src/tools/cephfs/" to
"<CEPH-REPO-ROOT>/src/tools/cephfs/shell" but cephfs-shell's location in
src/vstart.sh and qa/tasks/cephfs/test_cephfs_shell.py is left
un-updated. This produces a broken vstart_environment.sh and broken
export command in test_cephfs_shell.py.
Introduced-by: dc69033763cc116c6ccdf1f97149a74248691042 Fixes: https://tracker.ceph.com/issues/58795 Signed-off-by: Rishabh Dave <ridave@redhat.com>
Soumya Koduri [Mon, 13 Feb 2023 15:00:21 +0000 (20:30 +0530)]
rgw/cloud: Add custom headers for objects transitioned to cloud
Some of the cloud services, (like MCG Noobaa/Azure Namespace store),
may not be able to map and store the objects which contain s3 style
metadata keys.
To help such services determine if the objects being transitioned
are from RGW and whether or not ignore such attrs, added below two
headers for the objects being copied/transitioned from RGW -
1) x-rgw-cloud : true/false
(set to "true" if the object is being transitioned/synced from RGW)
2) x-rgw-cloud-keep-attrs : true/false
- if set to default "true" , the cloud service should store all the
x-amz-meta-* attrs. If cannot be mapped/stored, the operation
should fail
- if set to "false", the destination cloud can ignore such attrs and
just store the object data being sent.
Also fixed a bug in the cloudtier module wherein the user-defined attrs
were not being copied to the cloud endpoint as part of transition
Lucian Petrut [Fri, 17 Feb 2023 10:55:07 +0000 (10:55 +0000)]
librados/asio: use boost::system::generic_category on Windows
librados uses "errno.h" error codes. On Windows,
boost::system::system_category refers to errors from winerror.h.
That being considered, we'll add a platform check and use
boost::system::generic_category on Windows. This ensures that
error code comparisons work as expected.
This issue was brought up by the following test assertion failure:
ft2.4: ceph_test_rados_api_asio.AsioRados.AsyncWriteCallbacktesttools.
testresult.real._StringException: details: {{{
/ceph/src/test/librados/asio.cc:148
Expected equality of these values:
boost::system::errc::read_only_file_system
Which is: 30
ec
Which is: system:30
}}}