]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
2 years agoqa/cephfs: add 'rhel' to family of RH OS in xfstest_dev.py 50142/head
Rishabh Dave [Thu, 16 Feb 2023 12:02:37 +0000 (17:32 +0530)]
qa/cephfs: add 'rhel' to family of RH OS in xfstest_dev.py

The string returned by get_system_type() for RHEL 8.4 recently wasn't
one of the strings that xfstests_dev.py expects. The string returned
this time was instead "rhel". Add this string to the list of strings
that xfstests_dev.py expects for Red Hat OS family so that this failure
won't occur again in future. Also log the detected distro and version so
that it is easier to debug when this issue occurs next time.

Fixes: https://tracker.ceph.com/issues/58726
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2 years agoMerge pull request #46574 from rishabh-d-dave/xfstests-dev-improvements
Rishabh Dave [Thu, 23 Feb 2023 11:38:53 +0000 (17:08 +0530)]
Merge pull request #46574 from rishabh-d-dave/xfstests-dev-improvements

qa/cephfs: improvements for xfstests_dev.py

Reviewed-by: Xiubo Li <xiubli@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2 years agoMerge pull request #49528 from NitzanMordhai/wip-nitzan-filestore-removal
Radoslaw Zarzynski [Thu, 23 Feb 2023 11:20:49 +0000 (12:20 +0100)]
Merge pull request #49528 from NitzanMordhai/wip-nitzan-filestore-removal

Reef: filestore removal

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2 years agoMerge pull request #50176 from xxhdx1985126/wip-seastore-throttle
Yingxin [Thu, 23 Feb 2023 08:49:03 +0000 (16:49 +0800)]
Merge pull request #50176 from xxhdx1985126/wip-seastore-throttle

crimson/os/seastore: throttle concurrent transactions in seastore

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2 years agoMerge pull request #50226 from anthonyeleven/anthonyeleven/tweak-cephadm-troubleshooting
Anthony D'Atri [Thu, 23 Feb 2023 07:39:10 +0000 (02:39 -0500)]
Merge pull request #50226 from anthonyeleven/anthonyeleven/tweak-cephadm-troubleshooting

doc: preen cephadm/troubleshooting.rst and radosgw/placement.rst

2 years agodoc: preen cephadm/troubleshooting.rst and radosgw/placement.rst 50226/head
Anthony D'Atri [Thu, 23 Feb 2023 06:31:31 +0000 (01:31 -0500)]
doc: preen cephadm/troubleshooting.rst and radosgw/placement.rst

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
2 years agoMerge pull request #50221 from zdover23/wip-doc-2023-02-23-glossary-bucket
Anthony D'Atri [Thu, 23 Feb 2023 06:06:19 +0000 (01:06 -0500)]
Merge pull request #50221 from zdover23/wip-doc-2023-02-23-glossary-bucket

doc/glossary: add "Bucket"

2 years agoMerge pull request #50220 from tnyeanderson/fix-word-repeat
Anthony D'Atri [Thu, 23 Feb 2023 05:59:16 +0000 (00:59 -0500)]
Merge pull request #50220 from tnyeanderson/fix-word-repeat

doc: remove word repeat in docs

2 years agodoc/glossary: add "Bucket" 50221/head
Zac Dover [Thu, 23 Feb 2023 05:53:39 +0000 (15:53 +1000)]
doc/glossary: add "Bucket"

Add "Bucket" to the glossary. The definition added here is just a first
attempt, but a man's reach must exceed his grasp, or what's a heaven
for?

Signed-off-by: Zac Dover <zac.dover@proton.me>
2 years agodoc/cephadm/troubleshooting: remove word repeat 50220/head
thomas [Thu, 23 Feb 2023 05:41:34 +0000 (00:41 -0500)]
doc/cephadm/troubleshooting: remove word repeat

The original text was "In case the cluster the last MGR of a cluster"

Signed-off-by: thomas <me@thomasanderson.cloud>
2 years agoMerge PR #50196 into main
Venky Shankar [Thu, 23 Feb 2023 05:46:21 +0000 (11:16 +0530)]
Merge PR #50196 into main

* refs/pull/50196/head:
qa: export DIFF_LENGTH env parameter to print the full git diff

Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2 years agoMerge pull request #50179 from rishabh-d-dave/doc-fs-quota
Anthony D'Atri [Thu, 23 Feb 2023 05:36:36 +0000 (00:36 -0500)]
Merge pull request #50179 from rishabh-d-dave/doc-fs-quota

doc/cephfs: improve CephFS Quota document

2 years agoMerge pull request #50213 from pponnuvel/osd_backfill_doc
zdover23 [Thu, 23 Feb 2023 05:16:33 +0000 (15:16 +1000)]
Merge pull request #50213 from pponnuvel/osd_backfill_doc

doc/rados: update OSD_BACKFILLFULL description

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2 years agoMerge pull request #50215 from ljflores/wip-temporarily-disable-cronjobs
Laura Flores [Thu, 23 Feb 2023 01:29:20 +0000 (19:29 -0600)]
Merge pull request #50215 from ljflores/wip-temporarily-disable-cronjobs

2 years agoqa/crontab: temporarily disable teuthology cronjobs 50215/head
Laura Flores [Wed, 22 Feb 2023 23:17:19 +0000 (23:17 +0000)]
qa/crontab: temporarily disable teuthology cronjobs

Temporarily disable teuthology cron jobs before
the Reef dev freeze. This commit is intended to
lessen the load on the teuthology queue as we
test final patches for Reef, but should be reverted
after the dev freeze.

Signed-off-by: Laura Flores <lflores@redhat.com>
2 years agoMerge pull request #50201 from ceph/fix-github_action-main
Nizamudeen A [Wed, 22 Feb 2023 17:19:44 +0000 (22:49 +0530)]
Merge pull request #50201 from ceph/fix-github_action-main

.github/workflows: update failing action

Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: rkachach <NOT@FOUND>
2 years agoMerge pull request #48127 from petrutlucian94/cephfs_tests
Ilya Dryomov [Wed, 22 Feb 2023 16:43:17 +0000 (17:43 +0100)]
Merge pull request #48127 from petrutlucian94/cephfs_tests

Windows tests follow-up (librados_asio error category, disable some tests)

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2 years agodoc/rados: update OSD_BACKFILLFULL description 50213/head
Ponnuvel Palaniyappan [Wed, 22 Feb 2023 16:20:46 +0000 (16:20 +0000)]
doc/rados: update OSD_BACKFILLFULL description

Document that this warning can happen even when the OSDs' limits
haven't hit the backfill_full_ratio.

Signed-off-by: Ponnuvel Palaniyappan <pponnuvel@gmail.com>
2 years agodoc/cephfs: describe conf opt "client quota df" in quota doc 50179/head
Rishabh Dave [Mon, 20 Feb 2023 07:51:25 +0000 (13:21 +0530)]
doc/cephfs: describe conf opt "client quota df" in quota doc

The ceph config file option (from the client section) "client quota df"
is mentioned in "CephFS Client Capabilities" document but not in the
"CephFS Quota" document. Adding information about this option to this
document too would make it easier for CephFS users to discover,
understand and use this option.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2 years agodoc/cephfs: rearrange CephFS Quota document
Rishabh Dave [Mon, 20 Feb 2023 07:47:03 +0000 (13:17 +0530)]
doc/cephfs: rearrange CephFS Quota document

CephFS users, especially new users, would find it easier to discover,
understand and use CephFS Quota when basic information (like setting,
viewing and removing CephFS quota from a CephFS directory) is mentioned
in the documentation before advanced information (like limitations &
implementation details of CephFS Quota).

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2 years agoqa/cephfs: save results dir from xfstests-dev repo 46574/head
Rishabh Dave [Tue, 31 May 2022 03:14:51 +0000 (08:44 +0530)]
qa/cephfs: save results dir from xfstests-dev repo

The "results" directory in xfstests-dev repo contains logs that are
created by it during execution of its tests. Copying this directory to
Ceph log directory saves it from being erased during tear down conducted
by teuthology test runner. These logs allow deeper inspection in to the
cause of failure of tests.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2 years agoqa/cephfs: don't create symlinks for xfstests-dev
Rishabh Dave [Wed, 8 Jun 2022 16:49:59 +0000 (22:19 +0530)]
qa/cephfs: don't create symlinks for xfstests-dev

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2 years agoqa/cephfs: modify user creation code for xfstests-dev
Rishabh Dave [Wed, 8 Jun 2022 17:04:51 +0000 (22:34 +0530)]
qa/cephfs: modify user creation code for xfstests-dev

Create user "fsgqa2" and, since xfstests-dev's README uses option "-m"
while creating user "fsgqa", do the same in our codebase.

Creating user "fsgqa2" is optional along with other users according to
xfstests-dev's README. Create all these users is a preventive step since
tests needing user/users maybe skipped during execution.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2 years agoqa/cephfs: log xfstests-dev local.config
Rishabh Dave [Wed, 8 Jun 2022 17:02:27 +0000 (22:32 +0530)]
qa/cephfs: log xfstests-dev local.config

Log contents of xfstests-dev repo config file "local.config" to make
debugging easier.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2 years agoqa/cephfs: minor changes in xfstests_dev.py
Rishabh Dave [Wed, 8 Jun 2022 16:58:34 +0000 (22:28 +0530)]
qa/cephfs: minor changes in xfstests_dev.py

In xfstests-dev repo, local.config options "SCRATCH_DEV" and
"SCRATCH_MNT" were enabled in commit
2ba6b871056c10d7ea75b526489baa3586024fbf but TODO comment for the
wasn't deleted. Let's delete that and use format string instead of
format function on regular string.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2 years agoMerge pull request #50207 from rhcs-dashboard/fix-58827-main
Ernesto Puerta [Wed, 22 Feb 2023 14:57:38 +0000 (15:57 +0100)]
Merge pull request #50207 from rhcs-dashboard/fix-58827-main

mgr/dashboard: fix constraints.txt

Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
2 years agoqa/cephfs: make it easier to use xfstests-dev using vstart_runner
Rishabh Dave [Sat, 7 May 2022 03:42:52 +0000 (09:12 +0530)]
qa/cephfs: make it easier to use xfstests-dev using vstart_runner

The intention of this re-arrangement is to make it easier for developers
to use an already cloned and built xfstests-dev repo  with
vstart_runner.py.

The re-arrangements are -

* move tearDown() closer to setUp() (so that devs can
  enable/disable parts of them easily),

* carve out separate methods (so that these codeblocks can be disabled
  in a single go) for -
  ** deleting groups and users,
  ** deleting xfstests-dev and xfsprogs-dev repo and
  ** building xfstests-dev repo

* carve out method for deleting xfstests-dev and xfsprogs-dev repos

* add self.xfstests_repo_path comment (for devs to set path to
  xfstests-dev repo), and,

* add a note showing how to use already cloned and built xfstests-dev
  repo

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2 years agoqa/cephfs: use standard name for logging variable
Rishabh Dave [Tue, 19 Apr 2022 16:31:49 +0000 (22:01 +0530)]
qa/cephfs: use standard name for logging variable

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2 years agoMerge PR #50175 into main
Venky Shankar [Wed, 22 Feb 2023 14:17:43 +0000 (19:47 +0530)]
Merge PR #50175 into main

* refs/pull/50175/head:
cephfs: upgrade cephfs-shell's path wherever necessary

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
2 years agoMerge pull request #49979 from ceph/dependabot-npm_and_yarn-src-pybind-mgr-dashboard...
Ernesto Puerta [Wed, 22 Feb 2023 13:56:05 +0000 (14:56 +0100)]
Merge pull request #49979 from ceph/dependabot-npm_and_yarn-src-pybind-mgr-dashboard-frontend-http-cache-semantics-4.1.1

mgr/dashboard: bump http-cache-semantics from 4.1.0 to 4.1.1 in /src/pybind/mgr/dashboard/frontend

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2 years agoMerge pull request #49192 from ceph/dependabot-npm_and_yarn-src-pybind-mgr-dashboard...
Ernesto Puerta [Wed, 22 Feb 2023 11:09:25 +0000 (12:09 +0100)]
Merge pull request #49192 from ceph/dependabot-npm_and_yarn-src-pybind-mgr-dashboard-frontend-decode-uri-component-0.2.2

mgr/dashboard: bump decode-uri-component from 0.2.0 to 0.2.2 in /src/pybind/mgr/dashboard/frontend

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2 years agomgr/dashboard: fix constraints.txt 50207/head
Ernesto Puerta [Wed, 22 Feb 2023 10:31:47 +0000 (11:31 +0100)]
mgr/dashboard: fix constraints.txt

Replaces strict version matching with compatible version syntax.

Reference: https://peps.python.org/pep-0440/#version-specifiers

Fixes: https://tracker.ceph.com/issues/58827
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>
2 years agoMerge PR #45669 into main
Venky Shankar [Wed, 22 Feb 2023 09:11:09 +0000 (14:41 +0530)]
Merge PR #45669 into main

* refs/pull/45669/head:
client: switch to use 32 bits ext_num_fwd
client: switch to use 32 bits ext_num_retry
ceph_fs.h: add 32 bits extended num_retry and num_fwd support
ceph_fs.h: switch to use its own encode/decode helpers

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2 years agoqa: export DIFF_LENGTH env parameter to print the full git diff 50196/head
Xiubo Li [Tue, 21 Feb 2023 05:20:50 +0000 (13:20 +0800)]
qa: export DIFF_LENGTH env parameter to print the full git diff

From the xfstests-dev's README doc set DIFF_LENGTH to 0 will print
the full diff instead of the default 10.

This will be very helpful to debug the test failures, or we will
lose many valuable debug infomation.

Signed-off-by: Xiubo Li <xiubli@redhat.com>
2 years agoMerge PR #49934 into main
Venky Shankar [Wed, 22 Feb 2023 06:11:44 +0000 (11:41 +0530)]
Merge PR #49934 into main

* refs/pull/49934/head:
qa: add test_fscrypt_dummy_encryption test case support
qa: add 'options' parameter support for write_local_config
qa: add ceph.exclude file to exclude individual tests
qa: add require_kernel_mount helper support
qa: rename test_fscrypt to test_fscrypt_encrypt

Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2 years agoMerge pull request #50203 from zdover23/wip-doc-2023-02-22-radosgw-multisite-refine...
zdover23 [Wed, 22 Feb 2023 04:23:01 +0000 (14:23 +1000)]
Merge pull request #50203 from zdover23/wip-doc-2023-02-22-radosgw-multisite-refine-top-matter

doc/rgw: clarify multisite.rst top matter

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2 years agodoc/rgw: clarify multisite.rst top matter 50203/head
Zac Dover [Wed, 22 Feb 2023 03:36:40 +0000 (13:36 +1000)]
doc/rgw: clarify multisite.rst top matter

Improve the pragmatics of the top matter of multisite.rst. Organize the
text into sections, where doing so makes the nature of multi-site
configurations clearer.

Co-authored-by: Cole Mitchell <cole.mitchell@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
2 years agoMerge pull request #49605 from myoungwon/wip-rbm-integration-step2
Yingxin [Wed, 22 Feb 2023 01:37:07 +0000 (09:37 +0800)]
Merge pull request #49605 from myoungwon/wip-rbm-integration-step2

crimson/os/seastore: enable metadata (*_INTERNAL and *_LEAF ) allocation using OOL path

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2 years agoMerge pull request #49722 from ceph/dependabot-npm_and_yarn-src-pybind-mgr-dashboard...
Ernesto Puerta [Wed, 22 Feb 2023 00:48:01 +0000 (01:48 +0100)]
Merge pull request #49722 from ceph/dependabot-npm_and_yarn-src-pybind-mgr-dashboard-frontend-loader-utils-1.4.2

mgr/dashboard: bump loader-utils from 1.4.0 to 1.4.2 in /src/pybind/mgr/dashboard/frontend

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2 years agoMerge pull request #50042 from ceph/dependabot-npm_and_yarn-src-pybind-mgr-dashboard...
Ernesto Puerta [Tue, 21 Feb 2023 23:26:23 +0000 (00:26 +0100)]
Merge pull request #50042 from ceph/dependabot-npm_and_yarn-src-pybind-mgr-dashboard-frontend-sideway-formula-3.0.1

mgr/dashboard: bump @sideway/formula from 3.0.0 to 3.0.1 in /src/pybind/mgr/dashboard/frontend

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2 years ago.github/workflows: update failing action 50201/head
Ernesto Puerta [Tue, 21 Feb 2023 19:47:31 +0000 (20:47 +0100)]
.github/workflows: update failing action

[Example](https://github.com/ceph/ceph/actions/runs/4222995073/jobs/7360873373) of failing run.

Signed-off-by: Ernesto Puerta <37327689+epuertat@users.noreply.github.com>
2 years agocephfs: upgrade cephfs-shell's path wherever necessary 50175/head
Rishabh Dave [Mon, 20 Feb 2023 04:47:10 +0000 (10:17 +0530)]
cephfs: upgrade cephfs-shell's path wherever necessary

Commit dc69033763cc116c6ccdf1f97149a74248691042 moves cephfs-shell from
"<CEPH-REPO-ROOT>/src/tools/cephfs/" to
"<CEPH-REPO-ROOT>/src/tools/cephfs/shell" but cephfs-shell's location in
src/vstart.sh and qa/tasks/cephfs/test_cephfs_shell.py is left
un-updated. This produces a broken vstart_environment.sh and broken
export command in test_cephfs_shell.py.

Introduced-by: dc69033763cc116c6ccdf1f97149a74248691042
Fixes: https://tracker.ceph.com/issues/58795
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2 years agoqa: add test_fscrypt_dummy_encryption test case support 49934/head
Xiubo Li [Tue, 31 Jan 2023 02:33:07 +0000 (10:33 +0800)]
qa: add test_fscrypt_dummy_encryption test case support

This will test around 130 test cases with the test_dummy_encryption
option enabled.

Signed-off-by: Xiubo Li <xiubli@redhat.com>
2 years agoMerge pull request #50165 from zdover23/wip-doc-2023-02-19-radosgw-multisite-multisit...
zdover23 [Tue, 21 Feb 2023 04:52:21 +0000 (14:52 +1000)]
Merge pull request #50165 from zdover23/wip-doc-2023-02-19-radosgw-multisite-multisite-top-matter-cleanup

doc/rgw: multisite ref. top matter cleanup

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2 years agoqa: add 'options' parameter support for write_local_config
Xiubo Li [Tue, 31 Jan 2023 13:58:39 +0000 (21:58 +0800)]
qa: add 'options' parameter support for write_local_config

This will allow the fscrypt test case to add dedicated options.

Signed-off-by: Xiubo Li <xiubli@redhat.com>
2 years agoqa: add ceph.exclude file to exclude individual tests
Xiubo Li [Tue, 31 Jan 2023 03:09:16 +0000 (11:09 +0800)]
qa: add ceph.exclude file to exclude individual tests

Skip some tests, which will take to much time or will fail, for now.

Signed-off-by: Xiubo Li <xiubli@redhat.com>
2 years agoMerge pull request #50186 from zdover23/wip-doc-2023-02-21-radosgw-session-tags-rende...
zdover23 [Tue, 21 Feb 2023 04:09:30 +0000 (14:09 +1000)]
Merge pull request #50186 from zdover23/wip-doc-2023-02-21-radosgw-session-tags-render-fix

doc/rgw: session-tags.rst - fix link to keycloak

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>
2 years agoMerge PR #49154 into main
Venky Shankar [Tue, 21 Feb 2023 04:03:18 +0000 (09:33 +0530)]
Merge PR #49154 into main

* refs/pull/49154/head:
qa: add tests for cephfs-top
doc: updates --dump and --dumpfs
cephfs-top: dump values to stdout

Reviewed-by: Neeraj Pratap Singh <neesingh@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Anthony D Atri <anthony.datri@gmail.com>
2 years agodoc/rgw: session-tags.rst - fix link to keycloak 50186/head
Zac Dover [Tue, 21 Feb 2023 03:55:03 +0000 (13:55 +1000)]
doc/rgw: session-tags.rst - fix link to keycloak

Fix a link in the doc/radosgw/session-tags.rst file that was intended to
link to the doc/radosgw/keycloak.rst file.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2 years agoMerge pull request #43145 from pritha-srivastava/wip-rgw-sts-doc-fixes
zdover23 [Tue, 21 Feb 2023 03:48:28 +0000 (13:48 +1000)]
Merge pull request #43145 from pritha-srivastava/wip-rgw-sts-doc-fixes

rgw/sts: correcting documentation errors.

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2 years agoMerge pull request #49843 from shreyanshjain7174/compression_58410
Yuri Weinstein [Mon, 20 Feb 2023 22:29:38 +0000 (14:29 -0800)]
Merge pull request #49843 from shreyanshjain7174/compression_58410

rados: Set snappy as default value in ms_osd_compression_algorithm

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2 years agoMerge pull request #49487 from trociny/wip-58269
Yuri Weinstein [Mon, 20 Feb 2023 22:28:49 +0000 (14:28 -0800)]
Merge pull request #49487 from trociny/wip-58269

mgr: don't dump global config holding gil

Reviewed-by: Tim Serong <tserong@suse.com>
2 years agoMerge pull request #49379 from zhsgao/osd_deep_scrub_stride
Yuri Weinstein [Mon, 20 Feb 2023 22:27:31 +0000 (14:27 -0800)]
Merge pull request #49379 from zhsgao/osd_deep_scrub_stride

osd/scrub: add a variable to store osd_deep_scrub_stride

Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
2 years agoMerge pull request #49199 from ifed01/wip-ifed-fix-require-osd-release
Yuri Weinstein [Mon, 20 Feb 2023 22:26:39 +0000 (14:26 -0800)]
Merge pull request #49199 from ifed01/wip-ifed-fix-require-osd-release

mon: avoid exception when setting require-osd-release more than 2

Reviewed-by: Neha Ojha <nojha@redhat.com>
2 years agoMerge pull request #45414 from ifed01/wip-ifed-log-before-assert-in-avl
Yuri Weinstein [Mon, 20 Feb 2023 22:26:11 +0000 (14:26 -0800)]
Merge pull request #45414 from ifed01/wip-ifed-log-before-assert-in-avl

os/bluestore: log before assert in AvlAllocator

Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
2 years agoMerge pull request #49335 from yuvalif/wip-yuval-fix-58167
Yuval Lifshitz [Mon, 20 Feb 2023 20:29:51 +0000 (22:29 +0200)]
Merge pull request #49335 from yuvalif/wip-yuval-fix-58167

prevent anonymous topic operations

Reviewed-By: pritha-srivastava, cbodley
2 years agoMerge pull request #48709 from yanghonggang/yhg-jaeger-port
Yuval Lifshitz [Mon, 20 Feb 2023 20:27:06 +0000 (22:27 +0200)]
Merge pull request #48709 from yanghonggang/yhg-jaeger-port

common: add a config option for jaeger agent port

Reviewed-By: tchaikov, zenomri, yuvalif
2 years agoMerge pull request #49910 from myoungwon/fix-58587
Laura Flores [Mon, 20 Feb 2023 20:24:03 +0000 (14:24 -0600)]
Merge pull request #49910 from myoungwon/fix-58587

qa/workunits/rados/test_dedup_tool.sh: reset dedup tier during tests

2 years agoMerge pull request #49950 from cbodley/wip-qa-ragweed-tox
Casey Bodley [Mon, 20 Feb 2023 14:29:50 +0000 (09:29 -0500)]
Merge pull request #49950 from cbodley/wip-qa-ragweed-tox

qa/rgw: run ragweed tests with tox

Reviewed-by: Ali Maredia <amaredia@redhat.com>
2 years agoMerge pull request #49962 from robbat2/main-post_object_upload_size_rgw_chunk_size_bug
Casey Bodley [Mon, 20 Feb 2023 14:28:41 +0000 (09:28 -0500)]
Merge pull request #49962 from robbat2/main-post_object_upload_size_rgw_chunk_size_bug

rgw: Fix Browser POST content-length-range min value

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2 years agolibrados/asio: use boost::system::generic_category on Windows 48127/head
Lucian Petrut [Fri, 17 Feb 2023 10:55:07 +0000 (10:55 +0000)]
librados/asio: use boost::system::generic_category on Windows

librados uses "errno.h" error codes. On Windows,
boost::system::system_category refers to errors from winerror.h.

That being considered, we'll add a platform check and use
boost::system::generic_category on Windows. This ensures that
error code comparisons work as expected.

This issue was brought up by the following test assertion failure:

  ft2.4: ceph_test_rados_api_asio.AsioRados.AsyncWriteCallbacktesttools.
    testresult.real._StringException: details: {{{
  /ceph/src/test/librados/asio.cc:148
  Expected equality of these values:
    boost::system::errc::read_only_file_system
      Which is: 30
    ec
      Which is: system:30
  }}}

Signed-off-by: Lucian Petrut <lpetrut@cloudbasesolutions.com>
2 years agotest/librados: avoid using rlimit on Windows
Lucian Petrut [Thu, 15 Sep 2022 08:42:10 +0000 (08:42 +0000)]
test/librados: avoid using rlimit on Windows

One of the librados tests is temporarily adjusting the file
rlimit. This is unsupported on Windows, so we're skipping it.

At the same time, asprintf is not available, so we'll switch
to sprint with a predefined buffer.

Signed-off-by: Lucian Petrut <lpetrut@cloudbasesolutions.com>
2 years agocrimson/os/seastore: count transactions pending on seastore's throttler 50176/head
Xuehan Xu [Mon, 20 Feb 2023 08:44:29 +0000 (08:44 +0000)]
crimson/os/seastore: count transactions pending on seastore's throttler

Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
2 years agoMerge pull request #50166 from zdover23/wip-doc-2023-02-19-radosgw-multisite-zonegrou...
zdover23 [Mon, 20 Feb 2023 08:21:16 +0000 (18:21 +1000)]
Merge pull request #50166 from zdover23/wip-doc-2023-02-19-radosgw-multisite-zonegroup-setup-cleanup

doc/rgw: refine "Setting a Zonegroup"

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2 years agodoc/rgw: refine "Setting a Zonegroup" 50166/head
Zac Dover [Sun, 19 Feb 2023 13:50:43 +0000 (23:50 +1000)]
doc/rgw: refine "Setting a Zonegroup"

Streamline the "Setting a Zonegroup" section by separating out the
necessary prerequisite reading from the procedure itself.

I also corrected a typo in the word "following" in an unrelated section.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
2 years agocrimson/os/seastore: throttle concurrent transactions in seastore
Xuehan Xu [Mon, 20 Feb 2023 06:07:26 +0000 (06:07 +0000)]
crimson/os/seastore: throttle concurrent transactions in seastore

Fixes: https://tracker.ceph.com/issues/57215
Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
2 years agoMerge pull request #50164 from zdover23/wip-doc-2023-02-19-radosgw-multisite-execute...
zdover23 [Mon, 20 Feb 2023 00:55:32 +0000 (10:55 +1000)]
Merge pull request #50164 from zdover23/wip-doc-2023-02-19-radosgw-multisite-execute-removal

doc/radosgw: s/execute/run/ in multisite.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2 years agoMerge pull request #50160 from cbodley/wip-qa-rgw-notification-example
Casey Bodley [Sun, 19 Feb 2023 13:41:52 +0000 (08:41 -0500)]
Merge pull request #50160 from cbodley/wip-qa-rgw-notification-example

qa/rgw: update boto3 example path in notification_tests.py

Reviewed-by: Yuval Lifshitz <ylifshit@redhat.com>
2 years agodoc/rgw: multisite ref. top matter cleanup 50165/head
Zac Dover [Sun, 19 Feb 2023 13:20:45 +0000 (23:20 +1000)]
doc/rgw: multisite ref. top matter cleanup

Edit the top matter in "Multi-site Configuration Reference" so that it
is semantically more natural.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2 years agodoc/radosgw: s/execute/run/ in multisite.rst 50164/head
Zac Dover [Sun, 19 Feb 2023 06:46:49 +0000 (16:46 +1000)]
doc/radosgw: s/execute/run/ in multisite.rst

Replace "execute" with "run" in fourteen out of fifteen instances in
multisite.rst. "Execute" is plain old too grand in most of these
instances.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2 years agoMerge pull request #48683 from linuxbox2/wip-rgwlc-faststop
J. Eric Ivancich [Sat, 18 Feb 2023 18:58:02 +0000 (13:58 -0500)]
Merge pull request #48683 from linuxbox2/wip-rgwlc-faststop

rgwlc: prevent lc for one bucket from exceeding time budget

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
2 years agoMerge pull request #49785 from theanalyst/rgw-swift-key
J. Eric Ivancich [Sat, 18 Feb 2023 18:56:14 +0000 (13:56 -0500)]
Merge pull request #49785 from theanalyst/rgw-swift-key

rgw: swift : check for valid key in POST forms

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
2 years agoMerge pull request #49951 from ivancich/wip-clean-up-2023-Jan-23-coverity
J. Eric Ivancich [Sat, 18 Feb 2023 18:54:26 +0000 (13:54 -0500)]
Merge pull request #49951 from ivancich/wip-clean-up-2023-Jan-23-coverity

rgw: clean up January 21, 2023 coverity scan issues

Reviewed-by: Soumya Koduri <skoduri@redhat.com>
Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
2 years agoMerge pull request #50157 from guits/fix-simple-scan-cv
Guillaume Abrioux [Sat, 18 Feb 2023 18:26:25 +0000 (19:26 +0100)]
Merge pull request #50157 from guits/fix-simple-scan-cv

ceph-volume: legacy_encrypted() shouldn't call lsblk() when device is 'tmpfs'

2 years agoqa/rgw: update boto3 example path in notification_tests.py 50160/head
Casey Bodley [Sat, 18 Feb 2023 14:30:36 +0000 (09:30 -0500)]
qa/rgw: update boto3 example path in notification_tests.py

fallout from https://github.com/ceph/ceph/pull/50102

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2 years agoceph-volume: legacy_encrypted() shouldn't call lsblk() when device is 'tmpfs' 50157/head
Guillaume Abrioux [Sat, 18 Feb 2023 02:05:51 +0000 (03:05 +0100)]
ceph-volume: legacy_encrypted() shouldn't call lsblk() when device is 'tmpfs'

When the device variable is rebound and become 'tmpfs', lsblk() shouldn't be called.

Fixes: https://tracker.ceph.com/issues/58784
Signed-off-by: Guillaume Abrioux <gabrioux@ibm.com>
2 years agoMerge pull request #50154 from zdover23/wip-doc-2023-02-18-glossary-period-rgw
Anthony D'Atri [Sat, 18 Feb 2023 00:01:31 +0000 (19:01 -0500)]
Merge pull request #50154 from zdover23/wip-doc-2023-02-18-glossary-period-rgw

doc/glossary: add "Period" to glossary

2 years agodoc/glossary: add "Period" to glossary 50154/head
Zac Dover [Fri, 17 Feb 2023 22:03:06 +0000 (08:03 +1000)]
doc/glossary: add "Period" to glossary

Add definition for "period" to glossary.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2 years agoMerge pull request #50020 from rkachach/fix_issue_58660
Adam King [Fri, 17 Feb 2023 18:10:28 +0000 (13:10 -0500)]
Merge pull request #50020 from rkachach/fix_issue_58660

mgr/rgw: fix module crash because of typing_extensions missing

Reviewed-by: John Mulligan <jmulligan@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2 years agoMerge pull request #49728 from rkachach/fix_issue_58241
Adam King [Fri, 17 Feb 2023 18:07:21 +0000 (13:07 -0500)]
Merge pull request #49728 from rkachach/fix_issue_58241

cephadm: Adding poststop actions and setting TimeoutStartSec to 200s

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
2 years agoMerge pull request #49754 from adk3798/ha-nfs-active-failover
Adam King [Fri, 17 Feb 2023 18:02:08 +0000 (13:02 -0500)]
Merge pull request #49754 from adk3798/ha-nfs-active-failover

mgr/cephadm: fix backends service in haproxy config with multiple nfs of same rank

Reviewed-by: John Mulligan <jmulligan@redhat.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
Reviewed-by: Redouane Kachach <rkachach@redhat.com>
2 years agoMerge pull request #48973 from trociny/wip-58051
Adam King [Fri, 17 Feb 2023 17:47:59 +0000 (12:47 -0500)]
Merge pull request #48973 from trociny/wip-58051

mgr/cephadm: try to avoid pull when getting container image info

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
2 years agoMerge pull request #50016 from max-licc/nobjects_begin_crash
J. Eric Ivancich [Fri, 17 Feb 2023 17:40:00 +0000 (12:40 -0500)]
Merge pull request #50016 from max-licc/nobjects_begin_crash

rgw: catches nobjects_begin() exceptions

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2 years agoMerge pull request #50041 from cbodley/wip-cls-rgw-cancel-deleted
J. Eric Ivancich [Fri, 17 Feb 2023 17:26:47 +0000 (12:26 -0500)]
Merge pull request #50041 from cbodley/wip-cls-rgw-cancel-deleted

cls/rgw: remove index entry after cancelling last racing delete op

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
Reviewed-by: Cory Snyder <csnyder@iland.com>
2 years agoMerge pull request #50059 from cbodley/wip-rgw-stream-errors
J. Eric Ivancich [Fri, 17 Feb 2023 17:25:41 +0000 (12:25 -0500)]
Merge pull request #50059 from cbodley/wip-rgw-stream-errors

rgw/beast: StreamIO remembers connection errors for graceful shutdown

Reviewed-by: Yixin Jin <yjin77@yahoo.ca>
2 years agoMerge pull request #50131 from yima77/rgw_fix_segfault_due_to_concurrent_socket_use_a...
J. Eric Ivancich [Fri, 17 Feb 2023 17:21:48 +0000 (12:21 -0500)]
Merge pull request #50131 from yima77/rgw_fix_segfault_due_to_concurrent_socket_use_at_timeout

rgw: Fix segfault due to concurrent socket use at timeout

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2 years agoMerge pull request #50143 from ivancich/wip-flight-getobj-fix
J. Eric Ivancich [Fri, 17 Feb 2023 17:21:19 +0000 (12:21 -0500)]
Merge pull request #50143 from ivancich/wip-flight-getobj-fix

rgw/flight: don't access non-existant flight store during GetObj

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
2 years agoMerge pull request #50096 from nbalacha/syncpercent-fix
Ilya Dryomov [Fri, 17 Feb 2023 17:11:03 +0000 (18:11 +0100)]
Merge pull request #50096 from nbalacha/syncpercent-fix

rbd-mirror: fix syncing_percent calculation logic in get_replay_status()

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2 years agoMerge pull request #49614 from isodude/wip-librbd-misalign-discard
Ilya Dryomov [Fri, 17 Feb 2023 17:09:39 +0000 (18:09 +0100)]
Merge pull request #49614 from isodude/wip-librbd-misalign-discard

librbd: Fix local rbd mirror journals growing forever

Reviewed-by: Mykola Golub <mgolub@suse.com>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2 years agomgr/cephadm: fix error_ok not being passed in unit tests 48973/head
Adam King [Sun, 22 Jan 2023 16:52:10 +0000 (11:52 -0500)]
mgr/cephadm: fix error_ok not being passed in unit tests

Signed-off-by: Adam King <adking@redhat.com>
2 years agomgr/cephadm: try to avoid pull when getting container image info
Mykola Golub [Sun, 20 Nov 2022 13:11:11 +0000 (13:11 +0000)]
mgr/cephadm: try to avoid pull when getting container image info

Fixes: https://tracker.ceph.com/issues/58051
Signed-off-by: Mykola Golub <mykola.golub@clyso.com>
2 years agomgr/cephadm: allow _run_cephadm_json to be silent on error
Mykola Golub [Sat, 26 Nov 2022 08:39:54 +0000 (08:39 +0000)]
mgr/cephadm: allow _run_cephadm_json to be silent on error

Signed-off-by: Mykola Golub <mykola.golub@clyso.com>
2 years agoMerge pull request #49866 from rkachach/fix_issue_58466
Adam King [Fri, 17 Feb 2023 15:32:06 +0000 (10:32 -0500)]
Merge pull request #49866 from rkachach/fix_issue_58466

cephadm: using short hostname to create the initial mon and mgr

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: John Mulligan <jmulligan@redhat.com>
2 years agowin32_build.sh: build "ceph_test*"
Lucian Petrut [Thu, 15 Sep 2022 08:41:56 +0000 (08:41 +0000)]
win32_build.sh: build "ceph_test*"

At the moment, win32_build.sh builds the "tests" target, which
only includes the "unittest_*" tests.

We'll update the build script to include "ceph_test_*" targets
as well.

Note that we can't just build all the targets that were generated
by cmake since some of them are unavailable on Windows. When
doing the Windows port, we decided to avoid polluting the Cmake
files and keep the amount of Windows checks to a minimum.

Signed-off-by: Lucian Petrut <lpetrut@cloudbasesolutions.com>
2 years agotest/libcephfs: add missing includes
Lucian Petrut [Tue, 13 Sep 2022 14:19:54 +0000 (14:19 +0000)]
test/libcephfs: add missing includes

Some tests will need to include "compat.h" and "fs_types.h" in
order to build for Windows.

Signed-off-by: Lucian Petrut <lpetrut@cloudbasesolutions.com>
2 years agoMerge pull request #49961 from stefan-chivu/test_rbd_wnbd_latency
Lucian Petrut [Fri, 17 Feb 2023 10:11:15 +0000 (12:11 +0200)]
Merge pull request #49961 from stefan-chivu/test_rbd_wnbd_latency

qa: Added latency to results table in test_rbd_wnbd.py

2 years agocrimson/os/seastore: fix traversal behavior in scan_mapped_space to avoid replay... 49605/head
myoungwon oh [Tue, 14 Feb 2023 09:39:54 +0000 (18:39 +0900)]
crimson/os/seastore: fix traversal behavior in scan_mapped_space to avoid replay-allocation conflicts

1. Traverse the allocations from backref-tree leaf-node entries;
2. Traverse the pending alloc-deltas by sequence;
3. Traverse the allocations from backref-tree internal-node entries;

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2 years agoqa/rgw: add tox task before ragweed 49950/head
Casey Bodley [Tue, 31 Jan 2023 18:09:36 +0000 (13:09 -0500)]
qa/rgw: add tox task before ragweed

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2 years agoqa/ragweed: run ragweed tests with tox
Casey Bodley [Tue, 31 Jan 2023 18:07:34 +0000 (13:07 -0500)]
qa/ragweed: run ragweed tests with tox

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2 years agoMerge pull request #49709 from yima77/rgw_fix_mp_upload_obj_leak_due_to_reupload
Casey Bodley [Thu, 16 Feb 2023 17:22:41 +0000 (12:22 -0500)]
Merge pull request #49709 from yima77/rgw_fix_mp_upload_obj_leak_due_to_reupload

rgw: fix multipart upload object leaks due to re-upload

Reviewed-by: Casey Bodley <cbodley@redhat.com>