]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
8 weeks ago17.2.9 quincy-release 63385/head v17.2.9
Ceph Release Team [Tue, 20 May 2025 16:52:45 +0000 (16:52 +0000)]
17.2.9

Signed-off-by: Ceph Release Team <ceph-maintainers@ceph.io>
8 weeks agoos/bluestore: fix _extend_log seq advance
Pere Diaz Bou [Fri, 29 Sep 2023 11:17:03 +0000 (13:17 +0200)]
os/bluestore: fix _extend_log seq advance

when extending the log, the sequence was left on a bad state because it would first create a transaction to update with the current seq number but leave the "real" transaction with the same sequence number which should be `extend_log_transaction.seq + 1`.

Signed-off-by: Pere Diaz Bou <pdiabou@redhat.com>
Fixes: https://tracker.ceph.com/issues/71199
(cherry picked from commit 0210f57a5ec8a8c0ea76a72984f39dae24986cb0)
(cherry picked from commit b76623504a544feba2adf7a196ddbd59d1b8b8f4)

8 weeks agoos/bluestore: test _extend_log sequence advance
Pere Diaz Bou [Fri, 29 Sep 2023 11:16:42 +0000 (13:16 +0200)]
os/bluestore: test _extend_log sequence advance

Signed-off-by: Pere Diaz Bou <pdiabou@redhat.com>
(cherry picked from commit e785ef23339eba41bf786a68bba845f1916feb61)
(cherry picked from commit a71c33869d174a67c6c9eedca4997442a48f3a6c)

8 months ago17.2.8 60706/head v17.2.8
Ceph Release Team [Mon, 11 Nov 2024 21:31:50 +0000 (21:31 +0000)]
17.2.8

Signed-off-by: Ceph Release Team <ceph-maintainers@ceph.io>
8 months agomgr/dashboard: remove cherrypy_backports.py
Nizamudeen A [Mon, 4 Nov 2024 05:42:32 +0000 (11:12 +0530)]
mgr/dashboard: remove cherrypy_backports.py

since its mostly used only for older cherrypy versions which we don't
support anymore in any of our recent upstream releases, we could remove
it completely

Fixes: https://tracker.ceph.com/issues/68802
Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit 7ae56f4f561999898a7411840f94e742981ca6bc)

 Conflicts:
src/pybind/mgr/prometheus/module.py
 -  resolve conflicting import by just removing the version import

(cherry picked from commit 8713c8c2266c5075d6a0eb8da6e77152cda44c11)

8 months agomgr/dashboard: update translations for quincy
Nizamudeen A [Thu, 17 Oct 2024 04:58:50 +0000 (10:28 +0530)]
mgr/dashboard: update translations for quincy

Signed-off-by: Nizamudeen A <nia@redhat.com>
(cherry picked from commit 1ba918183898d869c33feb9f626469954909f996)

8 months agoqa/fsx: use a specified sha1 to build the xfstest-dev
Xiubo Li [Mon, 6 May 2024 01:57:39 +0000 (09:57 +0800)]
qa/fsx: use a specified sha1 to build the xfstest-dev

This sha1 is the latest master head and works well for our tests.

Fixes: https://tracker.ceph.com/issues/64572
Signed-off-by: Xiubo Li <xiubli@redhat.com>
(cherry picked from commit 740025da227e75575fa7732141c60c6398442e43)
(cherry picked from commit 4ccbf359add7c4f07ea088dd4693480bd8c1a242)

8 months agoqa/fsx: use the master branch to build the xfstest-dev
Xiubo Li [Wed, 6 Mar 2024 07:28:44 +0000 (15:28 +0800)]
qa/fsx: use the master branch to build the xfstest-dev

The upstream linux has removed ALLOCSP/FREESP ioctls, and also
the same with xfsprogs-devel package. So for the old xfstest-dev
the huild will fail, because it stil will depend on them.

Fixes: https://tracker.ceph.com/issues/64572
Signed-off-by: Xiubo Li <xiubli@redhat.com>
(cherry picked from commit bc215d9e21e97382434579cb89e90936c8d9c54b)
(cherry picked from commit c10ba90650800807749dfbe07bc6efc04b1c0870)

8 months agoMerge pull request #60479 from smanjara/wip-quincy-pr-56874
Yuri Weinstein [Tue, 29 Oct 2024 14:56:36 +0000 (07:56 -0700)]
Merge pull request #60479 from smanjara/wip-quincy-pr-56874

[quincy] qa/multisite: stabilize multisite testing

Reviewed-by: Casey Bodley <cbodley@redhat.com>
8 months agoMerge pull request #60527 from zdover23/wip-doc-2024-10-29-backport-60470-to-quincy
Anthony D'Atri [Tue, 29 Oct 2024 14:18:13 +0000 (10:18 -0400)]
Merge pull request #60527 from zdover23/wip-doc-2024-10-29-backport-60470-to-quincy

quincy: doc: explain the consequence of enabling mirroring through monitor co…

8 months agodoc: explain the consequence of enabling mirroring through monitor commands 60527/head
Jos Collin [Thu, 24 Oct 2024 06:03:19 +0000 (11:33 +0530)]
doc: explain the consequence of enabling mirroring through monitor commands

Signed-off-by: Jos Collin <jcollin@redhat.com>
(cherry picked from commit ed3ce72fbc0b097131945cbb39caa0831401b94a)

8 months agoMerge pull request #60458 from cbodley/wip-64399-quincy
Shilpa Jagannath [Mon, 28 Oct 2024 16:58:02 +0000 (09:58 -0700)]
Merge pull request #60458 from cbodley/wip-64399-quincy

quincy: rgw/auth: ignoring signatures for HTTP OPTIONS calls

8 months agoMerge pull request #60502 from zdover23/wip-doc-2024-10-26-backport-60444-to-quincy
Anthony D'Atri [Sat, 26 Oct 2024 13:46:18 +0000 (09:46 -0400)]
Merge pull request #60502 from zdover23/wip-doc-2024-10-26-backport-60444-to-quincy

quincy: doc/rados: standardize markup of "clean"

8 months agoMerge pull request #60505 from zdover23/wip-doc-2024-10-26-backport-60434-to-quincy
Anthony D'Atri [Sat, 26 Oct 2024 13:42:11 +0000 (09:42 -0400)]
Merge pull request #60505 from zdover23/wip-doc-2024-10-26-backport-60434-to-quincy

quincy: doc/glossary: add "PLP" to glossary

8 months agodoc/glossary: add "PLP" to glossary 60505/head
Zac Dover [Wed, 23 Oct 2024 00:50:25 +0000 (10:50 +1000)]
doc/glossary: add "PLP" to glossary

Add "PLP" to the glossary.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 599bdbf0a240ee718ed6da4104141b0f23330fbe)

8 months agodoc/rados: standardize markup of "clean" 60502/head
Zac Dover [Wed, 23 Oct 2024 08:34:25 +0000 (18:34 +1000)]
doc/rados: standardize markup of "clean"

Standardize the markup around the status "clean" in the documentation so
that readers don't mistakenly get the idea that inconsistent
presentation of the word "clean" implies a never-stated difference
between one instance and the other.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit c8b4155d2d27228917d4be1f11514504100c55c7)

8 months agoMerge pull request #60498 from zdover23/wip-doc-2024-10-26-backport-58647-to-quincy 60469/head
Zac Dover [Sat, 26 Oct 2024 00:44:20 +0000 (10:44 +1000)]
Merge pull request #60498 from zdover23/wip-doc-2024-10-26-backport-58647-to-quincy

quincy: doc/cephfs: add doc for disabling mgr/volumes plugin

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
8 months agoqa/multisite: disable two-zonegroup and three-zone configs. 60479/head
Shilpa Jagannath [Mon, 15 Apr 2024 14:54:57 +0000 (10:54 -0400)]
qa/multisite: disable two-zonegroup and three-zone configs.

Signed-off-by: Shilpa Jagannath <smanjara@redhat.com>
(cherry picked from commit fb3186266ee52b352ebdf4ce394d3144a23db8f2)
(cherry picked from commit 7f0ae8e03636cf81811b295f62fdb4a5fddafbf2)
(cherry picked from commit 824fce5521b1e3223767ae7e362aad77b1e48a3d)

8 months agodoc/cephfs: add doc for disabling mgr/volumes plugin 60498/head
Rishabh Dave [Sun, 28 Jul 2024 17:28:49 +0000 (22:58 +0530)]
doc/cephfs: add doc for disabling mgr/volumes plugin

Signed-off-by: Rishabh Dave <ridave@redhat.com>
(cherry picked from commit 373910de34fc9e1d98218aed0361cd9bf3badffa)

8 months agoqa/rgw/multisite: add two-zone configuration
Casey Bodley [Thu, 9 Nov 2023 21:22:36 +0000 (16:22 -0500)]
qa/rgw/multisite: add two-zone configuration

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 14204442ac2eaaaa3f40a76403da49f0f4ed92c1)
(cherry picked from commit 627dd7b86d0c59768625b508b614fa35d008708b)
(cherry picked from commit baf6c678bb3648a6147f1eb5bd1442a300cd0110)

8 months agoqa/rgw/multisite: double cluster nodes and osd count
Casey Bodley [Tue, 31 Oct 2023 14:53:25 +0000 (10:53 -0400)]
qa/rgw/multisite: double cluster nodes and osd count

> WARNING: The OSD cluster is overloaded and struggling to complete ops. You need more capacity to serve this level of demand.

give each cluster 2 nodes instead of 1, and 6 osds instead of 3

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 9a80cf4bf473c95c8d0b18fcdce88be20f74f973)
(cherry picked from commit a77c2d42277e44633643bcc1f8969f90724c49ef)
(cherry picked from commit 89c09ea3a2e9f4d32bab2c4b0b5c0f529d08d4c6)

8 months agoqa/rgw/multisite: reduce polling intervals from 20s to 5s
Casey Bodley [Tue, 31 Oct 2023 14:51:28 +0000 (10:51 -0400)]
qa/rgw/multisite: reduce polling intervals from 20s to 5s

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit bc084c0ac64477abdbf54d96bc4981edf41e1343)
(cherry picked from commit 32fb2b923bc07b2228b8fe7d1c1f4bc2f3bf263b)
(cherry picked from commit 95116915489d60f78038445d31549804e0745e29)

8 months agorgw/multisite: reconfigure checkpoint delay to 90s
Shilpa Jagannath [Mon, 30 Oct 2023 15:29:06 +0000 (11:29 -0400)]
rgw/multisite: reconfigure checkpoint delay to 90s

Signed-off-by: Shilpa Jagannath <smanjara@redhat.com>
(cherry picked from commit af7c4d83c7f5b61e907a90622c082a373f3995d9)
(cherry picked from commit e1acebe9e710f704ca59980b125e9a93f51dc71a)

8 months agoMerge pull request #60484 from zdover23/wip-doc-2024-10-25-backport-60480-to-quincy
Anthony D'Atri [Fri, 25 Oct 2024 03:44:10 +0000 (23:44 -0400)]
Merge pull request #60484 from zdover23/wip-doc-2024-10-25-backport-60480-to-quincy

quincy: doc/cephfs: use 'p' flag to set layouts or quotas

8 months agodoc/cephfs: use 'p' flag to set layouts or quotas 60484/head
TruongSinh Tran-Nguyen [Thu, 24 Oct 2024 20:57:49 +0000 (13:57 -0700)]
doc/cephfs: use 'p' flag to set layouts or quotas

Remind users that clients must use the 'p' flag when writing file
layouts.

This PR is made in response to
https://www.reddit.com/r/ceph/comments/1gbad51/comment/ltkgd5v/

Co-authored-by: Zac Dover <zac.dover@proton.me>
Signed-off-by: TruongSinh Tran-Nguyen <i@truongsinh.pro>
(cherry picked from commit 13c7c9d99881c7b4491ba1a693283c047161ea8a)

8 months agoMerge pull request #58769 from adk3798/quincy-orch-centos-9-teuth
Yuri Weinstein [Thu, 24 Oct 2024 16:38:19 +0000 (09:38 -0700)]
Merge pull request #58769 from adk3798/quincy-orch-centos-9-teuth

quincy: qa/orch: drop centos 8 and rhel 8.6 for orch suite tests

Reviewed-by: Laura Flores <lflores@redhat.com>
8 months agoMerge pull request #60463 from zdover23/wip-doc-2024-10-24-backport-60460-to-quincy
Anthony D'Atri [Thu, 24 Oct 2024 01:55:14 +0000 (21:55 -0400)]
Merge pull request #60463 from zdover23/wip-doc-2024-10-24-backport-60460-to-quincy

quincy: doc/start: add vstart install guide

8 months agodoc/start: add vstart install guide 60463/head
Zac Dover [Wed, 23 Oct 2024 23:04:08 +0000 (09:04 +1000)]
doc/start: add vstart install guide

Add "vstart Cluster Installation and Configuration Procedure" to the
Beginner's Guide.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit a42be085bd7b9159f4924853ac2b2d92c37884b0)

8 months agoqa/upgrade: change pacific/octopus upgrade tests to use published image 58769/head
Adam King [Tue, 27 Aug 2024 13:29:14 +0000 (09:29 -0400)]
qa/upgrade: change pacific/octopus upgrade tests to use published image

Since we no longer build octopus or pacific, we can't use
the ci build for these tests any more

Signed-off-by: Adam King <adking@redhat.com>
8 months agoqa/distros: reinstall nvme-cli on centos 9 nodes
Adam King [Thu, 22 Aug 2024 17:53:38 +0000 (13:53 -0400)]
qa/distros: reinstall nvme-cli on centos 9 nodes

To work around a potential linking issue between
nvme-cli ad libnvme that prevents nvme-cli from
correctly generating a hostnqn, causing

nvme_fabrics: found same hostid edb4e426-766f-44c6-b127-da2a5b7446ef but different hostnqn hostnqn

messages in dmesg and the inability to setup nvme
loop devices

Fixes: https://tracker.ceph.com/issues/67684
Signed-off-by: Adam King <adking@redhat.com>
(cherry picked from commit 4e5f269c01dd94741fbddaa7f76ebe4ac155e650)

8 months agoqa/workunits/cephadm: enable nodejs:18 on centos 9 stream
Laura Flores [Mon, 22 Jan 2024 20:52:58 +0000 (20:52 +0000)]
qa/workunits/cephadm: enable nodejs:18 on centos 9 stream

Signed-off-by: Laura Flores <lflores@ibm.com>
(cherry picked from commit a602e5f0e0e48c40fd728ae382502826ca354828)

8 months agoqa/cephadm: fix iscsi pids limit check for centos 9
Adam King [Mon, 11 Dec 2023 20:44:30 +0000 (15:44 -0500)]
qa/cephadm: fix iscsi pids limit check for centos 9

Centos 9 uses cgroups v2 which has a slightly
different file location for the pids.max. This commit
updates the test to also check the new location
so the test can pass on centos 9

Signed-off-by: Adam King <adking@redhat.com>
(cherry picked from commit 97efa97c2c72dba32774d0f105ae90462b93ac4e)

8 months agotests: make sure nvmetcli and nvme-cli are up to date
Guillaume Abrioux [Wed, 26 Jun 2024 10:35:43 +0000 (10:35 +0000)]
tests: make sure nvmetcli and nvme-cli are up to date

Otherwise jobs end up with the following failure:

```
2024-06-25T14:22:18.659 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to write to /dev/nvme-fabrics: Invalid argument
```

Also, the output of nvme list has changed so we have to update
qa/tasks/nvme_loop.py accordingly.

Fixes: https://tracker.ceph.com/issues/66707
Signed-off-by: Guillaume Abrioux <gabrioux@ibm.com>
(cherry picked from commit d707c41eacb513bdcb9fec17c823bfbfdc182700)

Conflicts:
qa/distros/container-hosts/centos_9.stream.yaml

Conflicts:
qa/distros/container-hosts/centos_9.stream.yaml

8 months agoqa/suites/upgrade/quincy-p2p: update supported-all-distro to centos 9
Laura Flores [Tue, 23 Jul 2024 22:00:05 +0000 (17:00 -0500)]
qa/suites/upgrade/quincy-p2p: update supported-all-distro to centos 9

Signed-off-by: Laura Flores <lflores@ibm.com>
8 months agoqa/cephadm: drop centos 8 and rhel 8.6 from test distros
Adam King [Tue, 23 Jul 2024 21:25:50 +0000 (17:25 -0400)]
qa/cephadm: drop centos 8 and rhel 8.6 from test distros

Since we don't build either of these any more on
quincy

Signed-off-by: Adam King <adking@redhat.com>
8 months agoqa/distros: add supported-container-hosts for cephadm and upgrade suites
Casey Bodley [Thu, 25 Jan 2024 17:41:39 +0000 (12:41 -0500)]
qa/distros: add supported-container-hosts for cephadm and upgrade suites

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 849a58b0873154a6713b4c8d838634f13b0b806d)

Conflicts:
qa/suites/upgrade/telemetry-upgrade/quincy-x/0-random-distro$

8 months agorgw/auth: ignoring signatures for HTTP OPTIONS calls 60458/head
Tobias Urdin [Tue, 6 Feb 2024 07:50:55 +0000 (07:50 +0000)]
rgw/auth: ignoring signatures for HTTP OPTIONS calls

Before [1] we always sent all HTTP OPTIONS requests to
the S3AnonymousEngine and ignored any provided AWSv4
credentials sent in the request.

That PR changed so that if we got credentials in the
request we instead sent it through the authentication
code in order to solve HTTP OPTIONS requests on tenanted
users to start working (because we need to resolve the
tenant, also called bucket tenant in the code, and we can't
only rely on the bucket name since it will not be found).

We solved this by modifying the canonical HTTP method used
when calculating the AWSv4 signature by instead using the
access-control-request-method header which worked good.

This change did not take into account that when you generated
a presigned URL for a put_object request you can also pass in
extra parameters like a canned ACL [2] to the Params variable
in for example boto3's generated_presigned_url().

Doing that will cause the client to add the x-amz-acl header
to x-amz-signedheaders and also use that in their signature
calculation.

When doing a HTTP OPTIONS calls for CORS on that presigned URL
the browser will never send a x-amz-acl header with the correct
data since that is something that the actual PUT request should
include later, so that HTTP OPTIONS call should pass even though
the signature can never be calculated correctly server-side like
verified against AWS S3 in tracker [3].

This patch as a result skips the signature calculation when doing
EC2 auth using the LocalEngine but we still need to pass the request
there in order to lookup the user to support buckets in a tenant.

For the Keystone EC2 auth we're pretty out of luck in the sense that
Keystone's API itself requires us to send the AWSv4 signature in the
request with the access_key in order to obtain a token, and we cannot
leave the signature out, we also cannot spoof the signature from
rgw -> keystone since we don't have access to the secret_key if it's
not in our cache.

For that approach we simply pass on to get_access_token() that if it's
an HTTP OPTIONS and we find the access_key in the cache we pull that
and ignore verifying signature and pass it on for validation. This means
that the cache must be warm if using Keystone auth and adding extra
params to a presigned URL.

This partly makes some of the commits in [1] redundant for EC2
LocalEngine auth but we still need it for tenanted bucket support.

[1] https://github.com/ceph/ceph/pull/52673
[2] https://docs.aws.amazon.com/AmazonS3/latest/userguide/acl-overview.html#canned-acl
[3] https://tracker.ceph.com/issues/64308

Fixes: https://tracker.ceph.com/issues/64308
Signed-off-by: Tobias Urdin <tobias.urdin@binero.se>
(cherry picked from commit fe15b52edb5d228d2ed56679c62cf48493ae2d54)

Conflicts: no optional_yield argument in quincy
src/rgw/rgw_auth_keystone.cc
src/rgw/rgw_auth_keystone.h

8 months agoMerge pull request #60437 from zdover23/wip-doc-2024-10-23-backport-60433-to-quincy
Anthony D'Atri [Wed, 23 Oct 2024 01:50:59 +0000 (21:50 -0400)]
Merge pull request #60437 from zdover23/wip-doc-2024-10-23-backport-60433-to-quincy

quincy: doc/cephfs: rearrange subvolume group information

8 months agodoc/cephfs: rearrange subvolume group information 60437/head
Indira Sawant [Tue, 22 Oct 2024 21:45:10 +0000 (16:45 -0500)]
doc/cephfs: rearrange subvolume group information

Rearranging the documentation to align it with CephFS encapsulation design.

Signed-off-by: Indira Sawant <indira.sawant@ibm.com>
(cherry picked from commit f6cf7ae5281f5740ac78bfa5e2a22913353b8167)

8 months agoMerge pull request #60314 from vshankar/wip-client-secfix
Yuri Weinstein [Tue, 22 Oct 2024 01:59:18 +0000 (18:59 -0700)]
Merge pull request #60314 from vshankar/wip-client-secfix

quincy: client: disallow unprivileged users to escalate root privileges

Reviewed-by: Venky Shankar vshankar@redhat.com
8 months agoMerge pull request #58843 from lxbsz/wip-67163
Yuri Weinstein [Mon, 21 Oct 2024 18:05:29 +0000 (11:05 -0700)]
Merge pull request #58843 from lxbsz/wip-67163

quincy: mds: try to choose a new batch head in request_clientup()

Reviewed-by: Venky Shankar <vshankar@redhat.com>
8 months agoMerge pull request #58296 from batrick/wip-66624-quincy
Yuri Weinstein [Mon, 21 Oct 2024 18:03:43 +0000 (11:03 -0700)]
Merge pull request #58296 from batrick/wip-66624-quincy

quincy: mds: do remove the cap when seqs equal or larger than last issue

Reviewed-by: Venky Shankar <vshankar@redhat.com>
8 months agoMerge pull request #54549 from k0ste/wip-62817-quincy
Yuri Weinstein [Fri, 18 Oct 2024 15:07:30 +0000 (08:07 -0700)]
Merge pull request #54549 from k0ste/wip-62817-quincy

quincy: osd: ensure async recovery does not drop a pg below min_size

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
9 months agoMerge pull request #60124 from adamemerson/wip-40692-quincy
Yuri Weinstein [Thu, 17 Oct 2024 14:13:05 +0000 (07:13 -0700)]
Merge pull request #60124 from adamemerson/wip-40692-quincy

quincy: global: Call getnam_r with a 64KiB buffer on the heap

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
9 months agoMerge pull request #59498 from pponnuvel/wip-67606-quincy
Yuri Weinstein [Thu, 17 Oct 2024 14:12:00 +0000 (07:12 -0700)]
Merge pull request #59498 from pponnuvel/wip-67606-quincy

quincy: os/bluestore: allow use BtreeAllocator

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
9 months agoMerge pull request #57406 from k0ste/wip-58815-quincy
Yuri Weinstein [Thu, 17 Oct 2024 14:11:19 +0000 (07:11 -0700)]
Merge pull request #57406 from k0ste/wip-58815-quincy

quincy: rados: Set snappy as default value in ms_osd_compression_algorithm

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
9 months agoMerge pull request #57363 from batrick/wip-65871-quincy
Yuri Weinstein [Thu, 17 Oct 2024 14:10:18 +0000 (07:10 -0700)]
Merge pull request #57363 from batrick/wip-65871-quincy

quincy: common/StackStringStream: update pointer to newly allocated memory in overflow()

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Rongqi Sun <sunrongqi@huawei.com>
9 months agoMerge pull request #54557 from k0ste/wip-57795-quincy
Yuri Weinstein [Thu, 17 Oct 2024 14:08:42 +0000 (07:08 -0700)]
Merge pull request #54557 from k0ste/wip-57795-quincy

quincy: common:  intrusive_lru destructor add

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
9 months agoMerge pull request #60337 from dmick/wip-quincy-container-ceph-node-proxy
Dan Mick [Wed, 16 Oct 2024 18:22:04 +0000 (11:22 -0700)]
Merge pull request #60337 from dmick/wip-quincy-container-ceph-node-proxy

quincy: ceph-node-proxy not present, not part of container

9 months agoMerge pull request #60334 from cbodley/wip-doc-rgw-multisite-secondary-commit-quincy
Casey Bodley [Wed, 16 Oct 2024 15:05:03 +0000 (11:05 -0400)]
Merge pull request #60334 from cbodley/wip-doc-rgw-multisite-secondary-commit-quincy

quincy: doc/radosgw/multisite: fix Configuring Secondary Zones -> Updating the Period

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
9 months agoMerge pull request #56702 from joscollin/wip-65320-quincy
Venky Shankar [Wed, 16 Oct 2024 13:30:39 +0000 (19:00 +0530)]
Merge pull request #56702 from joscollin/wip-65320-quincy

quincy: cephfs-mirror: various fixes

Reviewed-by: Venky Shankar <vshankar@redhat.com>
9 months agoMerge pull request #58333 from mchangir/wip-66671-quincy
Venky Shankar [Wed, 16 Oct 2024 13:30:24 +0000 (19:00 +0530)]
Merge pull request #58333 from mchangir/wip-66671-quincy

quincy: qa: cleanup snapshots before subvolume delete

Reviewed-by: Venky Shankar <vshankar@redhat.com>
9 months agoMerge pull request #58724 from neesingh-rh/wip-67076-quincy
Venky Shankar [Wed, 16 Oct 2024 13:30:13 +0000 (19:00 +0530)]
Merge pull request #58724 from neesingh-rh/wip-67076-quincy

quincy: mds: fix session/client evict command.

Reviewed-by: Venky Shankar <vshankar@redhat.com>
9 months agoMerge pull request #58773 from lxbsz/wip-66668
Venky Shankar [Wed, 16 Oct 2024 13:29:57 +0000 (18:59 +0530)]
Merge pull request #58773 from lxbsz/wip-66668

quincy: mds: set the correct WRLOCK flag always in wrlock_force()

Reviewed-by: Venky Shankar <vshankar@redhat.com>
9 months agoMerge pull request #58799 from neesingh-rh/wip-66870-quincy
Venky Shankar [Wed, 16 Oct 2024 13:29:40 +0000 (18:59 +0530)]
Merge pull request #58799 from neesingh-rh/wip-66870-quincy

quincy: mds: prevent scrubbing for standby-replay MDS

Reviewed-by: Venky Shankar <vshankar@redhat.com>
9 months agoMerge pull request #58806 from lxbsz/wip-67150
Venky Shankar [Wed, 16 Oct 2024 13:29:28 +0000 (18:59 +0530)]
Merge pull request #58806 from lxbsz/wip-67150

quincy: cephfs: Fixed a bug in the readdir_cache_cb function that may have us…

Reviewed-by: Venky Shankar <vshankar@redhat.com>
9 months agoMerge pull request #58807 from lxbsz/wip-67119
Venky Shankar [Wed, 16 Oct 2024 12:59:55 +0000 (18:29 +0530)]
Merge pull request #58807 from lxbsz/wip-67119

quincy: qa: ignore container checkpoint/restore related selinux denials for c…

Reviewed-by: Venky Shankar <vshankar@redhat.com>
9 months agoMerge pull request #59037 from vshankar/wip-quincy-rm-centos8
Venky Shankar [Wed, 16 Oct 2024 12:59:17 +0000 (18:29 +0530)]
Merge pull request #59037 from vshankar/wip-quincy-rm-centos8

quincy: qa/cephfs: no reliance on centos

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
9 months agoMerge pull request #59067 from joscollin/wip-67381-quincy
Venky Shankar [Wed, 16 Oct 2024 12:30:52 +0000 (18:00 +0530)]
Merge pull request #59067 from joscollin/wip-67381-quincy

quincy: qa/suites: drop --show-reachable=yes from fs:valgrind tests

Reviewed-by: Venky Shankar <vshankar@redhat.com>
9 months agoquincy: ceph-node-proxy not present, not part of container 60337/head
Dan Mick [Tue, 15 Oct 2024 19:55:20 +0000 (12:55 -0700)]
quincy: ceph-node-proxy not present, not part of container

Signed-off-by: Dan Mick <dmick@redhat.com>
9 months agodoc/radosgw/multisite: fix Configuring Secondary Zones -> Updating the Period 60334/head
Casey Bodley [Fri, 4 Oct 2024 19:50:05 +0000 (15:50 -0400)]
doc/radosgw/multisite: fix Configuring Secondary Zones -> Updating the Period

this was copy/pasted from Configuring a Master Zone -> Update the Period
but still referred to the 'master zone'

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit cfe254758b1ca9647c4dcfb13b6a3310558b88d2)

9 months agoMerge pull request #59403 from Matan-B/wip-67665-quincy
SrinivasaBharathKanta [Tue, 15 Oct 2024 14:12:26 +0000 (19:42 +0530)]
Merge pull request #59403 from Matan-B/wip-67665-quincy

quincy: mon/OSDMonitor: Add force-remove-snap mon command

9 months agoMerge pull request #59308 from batrick/wip-67476-quincy
SrinivasaBharathKanta [Tue, 15 Oct 2024 14:12:08 +0000 (19:42 +0530)]
Merge pull request #59308 from batrick/wip-67476-quincy

quincy: mon/MonClient: handle ms_handle_fast_authentication return

9 months agoMerge pull request #59278 from k0ste/wip-67240-quincy
SrinivasaBharathKanta [Tue, 15 Oct 2024 14:11:49 +0000 (19:41 +0530)]
Merge pull request #59278 from k0ste/wip-67240-quincy

quincy: mon: fix inconsistencies in class param

9 months agoMerge pull request #60201 from zdover23/wip-doc-2024-10-09-backport-60163-to-quincy
Zac Dover [Tue, 15 Oct 2024 12:20:05 +0000 (22:20 +1000)]
Merge pull request #60201 from zdover23/wip-doc-2024-10-09-backport-60163-to-quincy

quincy: doc/man: supplant "wsync" with "nowsync" as the default

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
9 months agoMerge pull request #55216 from ifed01/wip-ifed-refactor-spillover-tests-qui
Igor Fedotov [Tue, 15 Oct 2024 09:38:32 +0000 (12:38 +0300)]
Merge pull request #55216 from ifed01/wip-ifed-refactor-spillover-tests-qui

quincy: test/store_test: refactor spillover tests

Reviewed-by: Pere Diaz Bou <pere-altea@hotmail.com>
9 months agoclient: disallow unprivileged users to escalate root privileges 60314/head
Xiubo Li [Wed, 3 Apr 2024 11:02:08 +0000 (19:02 +0800)]
client: disallow unprivileged users to escalate root privileges

An unprivileged user can `chmod 777` a directory owned by root
and gain access. Fix this bug and also add a test case for the
same.

Signed-off-by: Xiubo Li <xiubli@redhat.com>
Signed-off-by: Venky Shankar <vshankar@redhat.com>
9 months agotest/store_test: refactor spillover tests 55216/head
Igor Fedotov [Thu, 19 Oct 2023 11:59:16 +0000 (14:59 +0300)]
test/store_test: refactor spillover tests

Fixes: https://tracker.ceph.com/issues/62401
Signed-off-by: Igor Fedotov <igor.fedotov@croit.io>
(cherry picked from commit 5019495659359bbc19c8ab3988e3d9e12c5f58c1)

 Conflicts:
src/test/objectstore/store_test.cc
 * trivial

9 months agoos/bluestore: provide some reference for BlueFSVolumeSelector's interface.
Igor Fedotov [Wed, 8 Nov 2023 21:22:28 +0000 (00:22 +0300)]
os/bluestore: provide some reference for BlueFSVolumeSelector's interface.

Signed-off-by: Igor Fedotov <igor.fedotov@croit.io>
(cherry picked from commit 243d21ef1c18d561b35acf309e8e1c13b0781658)

9 months agoos/bluestore: rework vselector calls
Igor Fedotov [Thu, 19 Oct 2023 11:57:23 +0000 (14:57 +0300)]
os/bluestore: rework vselector calls

We can provide fnode delta to vseector now. Which is a bit more
effective.

Signed-off-by: Igor Fedotov <igor.fedotov@croit.io>
(cherry picked from commit 3e04ac48779f62394ebd9587298823bf6b20a570)

 Conflicts:
src/os/bluestore/BlueFS.cc
 * trival

9 months agoMerge pull request #60230 from dmick/wip-68470-quincy
Laura Flores [Mon, 14 Oct 2024 23:00:09 +0000 (18:00 -0500)]
Merge pull request #60230 from dmick/wip-68470-quincy

quincy: Add Containerfile and build.sh to build it.

9 months agoMerge pull request #59442 from amathuria/wip-65946-quincy
Yuri Weinstein [Mon, 14 Oct 2024 17:49:20 +0000 (10:49 -0700)]
Merge pull request #59442 from amathuria/wip-65946-quincy

quincy: msg/async: Encode message once features are set

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
9 months agoMerge pull request #54356 from leonid-s-usov/bp/mds-raise/quincy
Yuri Weinstein [Mon, 14 Oct 2024 17:47:13 +0000 (10:47 -0700)]
Merge pull request #54356 from leonid-s-usov/bp/mds-raise/quincy

quincy: common/admin_socket: add a command to raise a signal

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
9 months agoMerge pull request #48310 from k0ste/wip-56637-quincy
Yuri Weinstein [Mon, 14 Oct 2024 17:46:35 +0000 (10:46 -0700)]
Merge pull request #48310 from k0ste/wip-56637-quincy

quincy: log: Make log_max_recent have an effect again.

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
9 months agocontainer/build.sh: fix arm architecture tagging 60230/head
Dan Mick [Thu, 10 Oct 2024 23:38:58 +0000 (16:38 -0700)]
container/build.sh: fix arm architecture tagging

The wrong string was used for comparison, and for tagging,
so the arm64 branch and sha1 images overwrote and destroyed
the amd64 images.

Signed-off-by: Dan Mick <dmick@redhat.com>
(cherry picked from commit 7e03ee798f4ed3aa4a0bb1a9e9d62df52e54406d)

9 months agoMerge pull request #55775 from ifed01/wip-ifed-no-death-tests-qui
Yuri Weinstein [Mon, 14 Oct 2024 14:57:38 +0000 (07:57 -0700)]
Merge pull request #55775 from ifed01/wip-ifed-no-death-tests-qui

quincy: test/store_test: get rid off assert_death.

Reviewed-by: Md Mahamudur Rahaman Sajib <mahamudur.sajib@croit.io>
9 months agoMerge pull request #60299 from zdover23/wip-doc-2024-10-14-backport-60242-to-quincy
Anthony D'Atri [Mon, 14 Oct 2024 14:49:36 +0000 (10:49 -0400)]
Merge pull request #60299 from zdover23/wip-doc-2024-10-14-backport-60242-to-quincy

quincy: doc: SubmittingPatches-backports - remove backports team

9 months agoMerge pull request #60274 from zdover23/wip-doc-2024-10-12-backport-60243-to-quincy
Zac Dover [Mon, 14 Oct 2024 13:57:58 +0000 (23:57 +1000)]
Merge pull request #60274 from zdover23/wip-doc-2024-10-12-backport-60243-to-quincy

quincy: doc/dev: remove "Stable Releases and Backports"

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
9 months agodoc: SubmittingPatches-backports - remove backports team 60299/head
Zac Dover [Thu, 10 Oct 2024 12:11:22 +0000 (22:11 +1000)]
doc: SubmittingPatches-backports - remove backports team

Remove all references to the "Stable Releases and Backports Team", which
as of October 2024 does not exist.

Fixes: https://tracker.ceph.com/issues/68471
Co-authored-by: Laura Flores <lflores@ibm.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 0317b5f87ac22399f6242d72f0bb9924794687de)

9 months agodoc/dev: remove "Stable Releases and Backports" 60274/head
Zac Dover [Thu, 10 Oct 2024 12:17:12 +0000 (22:17 +1000)]
doc/dev: remove "Stable Releases and Backports"

Remove mention of "Stable Releases and Backports" from
doc/dev/developer_guide/essentials.rst.

Co-authored-by: Laura Flores <lflores@ibm.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 95916c91906604c516e78b550010e9de511fc1e9)

9 months agoMerge pull request #60271 from zdover23/wip-doc-2024-10-12-backport-59507-to-quincy
Anthony D'Atri [Fri, 11 Oct 2024 20:06:02 +0000 (16:06 -0400)]
Merge pull request #60271 from zdover23/wip-doc-2024-10-12-backport-59507-to-quincy

quincy: doc/rbd: add namespace information for mirror commands

9 months agodoc/rbd: add namespace information for mirror commands 60271/head
N Balachandran [Thu, 29 Aug 2024 09:04:44 +0000 (14:34 +0530)]
doc/rbd: add namespace information for mirror commands

Updates the rbd man page to clarify  that some mirror commands
can apply to pools and namespaces.

Signed-off-by: N Balachandran <nibalach@redhat.com>
(cherry picked from commit 5e64748927d029ceffc27edbc6cbf7c774a7b291)

9 months agoMerge pull request #60235 from zdover23/wip-doc-2024-10-10-backport-60204-to-quincy
Anthony D'Atri [Thu, 10 Oct 2024 12:45:16 +0000 (08:45 -0400)]
Merge pull request #60235 from zdover23/wip-doc-2024-10-10-backport-60204-to-quincy

quincy: doc: fix email

9 months agodoc: fix email 60235/head
Ernesto Puerta [Wed, 9 Oct 2024 06:12:42 +0000 (08:12 +0200)]
doc: fix email

Signed-off-by: Ernesto Puerta <37327689+epuertat@users.noreply.github.com>
(cherry picked from commit 512eea1af52126e9b082744ee7b870c12c23d55d)

9 months agoAdd Containerfile and build.sh to build it.
Dan Mick [Wed, 26 Jun 2024 02:07:41 +0000 (19:07 -0700)]
Add Containerfile and build.sh to build it.

The intent is to replace ceph-container.git, at first for ci containers
only, and eventually production containers as well.

There is code present for production containers, including
a separate "make-manifest-list.py" to scan for and glue the two
arch-specific containers into a 'manifest-list' 'fat' container,
but that code is not yet fully tested.

This code will not be used until a corresponding change to the
Jenkins jobs in ceph-build.git is pushed.

Note that this tooling does not authenticate to the container repo;
it is assumed that will be done elsewhere.  Authentication is
verified by pushing a minimal image to the requested repo.

Signed-off-by: Dan Mick <dmick@redhat.com>
(cherry picked from commit 5c40a5c1737cf0628c899c4e9f788017b8b4fca8)

9 months agorados: Set snappy as default value in ms_osd_compression_algorithm instead of list... 57406/head
shreyanshjain7174 [Tue, 24 Jan 2023 14:11:58 +0000 (08:11 -0600)]
rados: Set snappy as default value in ms_osd_compression_algorithm instead of list of algorithms.

The OSDs choose the preferred algorithm based on mutual understanding between OSDs. The proposed solution to this problem was to set "snappy" as default algorithm and provide flexibility to user to change the algorithm of their choice.

Fixes: https://tracker.ceph.com/issues/58410
Signed-off-by: shreyanshjain7174 <ssanchet@redhat.com>
(cherry picked from commit 158986a3b73a42db8e31f3366912e906c743f145)

9 months agolog: Make log_max_recent have an effect again. 48310/head
Joshua Baergen [Thu, 16 Jun 2022 16:14:12 +0000 (10:14 -0600)]
log: Make log_max_recent have an effect again.

The log improvements in a747aeac13daf3dba43343120659e802cb569f6b
unfortunately left log_max_recent broken because m_max_recent wasn't
used anymore.

Eliminate m_max_recent and set the capacity of the m_recent ring buffer
when log_max_recent changes. In order to call set_capacity(),
ConcreteEntry needed its move constructor set noexcept.

I haven't followed the boost code all the way down but I suspect that
setting the ring buffer capacity to anything less than 1 entry will
probably cause problems, so restrict log_max_recent to >=1.

Also fix a wrong variable used for printing the max new entries during
"log dump".

Signed-off-by: Joshua Baergen <jbaergen@digitalocean.com>
(cherry picked from commit 3d59ba1671e3e76326fb706a76b8d9638d782924)

9 months agoMerge pull request #55598 from NitzanMordhai/wip-63976-quincy
Yuri Weinstein [Tue, 8 Oct 2024 18:05:54 +0000 (11:05 -0700)]
Merge pull request #55598 from NitzanMordhai/wip-63976-quincy

quincy: Tools/rados: Improve Error Messaging for Object Name Resolution

Reviewed-by: Matan Breizman <Matan.Brz@gmail.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
9 months agoMerge pull request #55597 from NitzanMordhai/wip-63982-quincy
Yuri Weinstein [Tue, 8 Oct 2024 18:05:04 +0000 (11:05 -0700)]
Merge pull request #55597 from NitzanMordhai/wip-63982-quincy

quincy: mon/Monitor: during shutdown don't accept new authentication and crea…

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Matan Breizman <Matan.Brz@gmail.com>
9 months agoMerge pull request #54555 from k0ste/wip-57473-quincy
Yuri Weinstein [Tue, 8 Oct 2024 18:02:59 +0000 (11:02 -0700)]
Merge pull request #54555 from k0ste/wip-57473-quincy

quincy: mgr: fix a race condition in DaemonServer::handle_report()

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
9 months agoMerge pull request #54012 from k0ste/wip-63036-quincy
Yuri Weinstein [Tue, 8 Oct 2024 18:02:17 +0000 (11:02 -0700)]
Merge pull request #54012 from k0ste/wip-63036-quincy

quincy: mgr: add throttle policy for DaemonServer

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
9 months agoMerge pull request #50193 from trociny/wip-58806-quincy
Yuri Weinstein [Tue, 8 Oct 2024 18:01:13 +0000 (11:01 -0700)]
Merge pull request #50193 from trociny/wip-58806-quincy

quincy: mgr: don't dump global config holding gil

Reviewed-by: Tim Serong <tserong@suse.com>
9 months agodoc/man: supplant "wsync" with "nowsync" as the default 60201/head
Zac Dover [Mon, 7 Oct 2024 13:21:02 +0000 (23:21 +1000)]
doc/man: supplant "wsync" with "nowsync" as the default

Change the default from "wsync" to "nowsync". "nowsync" has been the
default since kernel version 5.16.

This information was reported on
https://pad.ceph.com/p/Report_Documentation_Bugs by Benjamin Mare on 07
Oct 2024.

The commit relevant to this change can be seen here, in Linus's main
branch:
https://github.com/torvalds/linux/commit/f7a67b463fb83a4b9b11ceaa8ec4950b8fb7f902

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 9f0af5d75dc64ef0520fd78f29815d2a824a859b)

9 months agoMerge pull request #59523 from badone/wip-67822-quincy
Yuri Weinstein [Tue, 8 Oct 2024 14:59:10 +0000 (07:59 -0700)]
Merge pull request #59523 from badone/wip-67822-quincy

quincy: test/lazy-omap-stats: Convert to boost::regex

Reviewed-by: Laura Flores <lflores@redhat.com>
9 months agoMerge pull request #60064 from sajibreadd/wip-68325-quincy
Yuri Weinstein [Mon, 7 Oct 2024 23:41:04 +0000 (16:41 -0700)]
Merge pull request #60064 from sajibreadd/wip-68325-quincy

quincy: common/Formatter: dump inf/nan as null

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
9 months agoMerge pull request #59532 from ifed01/wip-ifed-fix-spillover-qui
Yuri Weinstein [Mon, 7 Oct 2024 23:40:17 +0000 (16:40 -0700)]
Merge pull request #59532 from ifed01/wip-ifed-fix-spillover-qui

quincy: test/store_test: enforce sync compactions for spillover tests

Reviewed-by: Md Mahamudur Rahaman Sajib <mahamudur.sajib@croit.io>
9 months agoMerge pull request #59468 from sajibreadd/wip-67039-quincy
Yuri Weinstein [Mon, 7 Oct 2024 23:39:00 +0000 (16:39 -0700)]
Merge pull request #59468 from sajibreadd/wip-67039-quincy

quincy: os/bluestore: Warning added for slow operations and stalled read

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
9 months agoMerge pull request #58674 from ifed01/wip-ifed-many-many-extents-read-qui
Yuri Weinstein [Mon, 7 Oct 2024 23:38:00 +0000 (16:38 -0700)]
Merge pull request #58674 from ifed01/wip-ifed-many-many-extents-read-qui

quincy: blk/aio: fix long batch (64+K entries) submission

Reviewed-by: Laura Flores <lflores@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
9 months agoMerge pull request #56138 from ifed01/wip-ifed-fix-global-repair-stats-qui
Yuri Weinstein [Mon, 7 Oct 2024 23:36:41 +0000 (16:36 -0700)]
Merge pull request #56138 from ifed01/wip-ifed-fix-global-repair-stats-qui

quincy: os/store_test: Retune tests to current code

Reviewed-by: Md Mahamudur Rahaman Sajib <mahamudur.sajib@croit.io>
9 months agoMerge pull request #55133 from ifed01/wip-ifed-refresh-perf-counters-qui
Yuri Weinstein [Mon, 7 Oct 2024 23:35:39 +0000 (16:35 -0700)]
Merge pull request #55133 from ifed01/wip-ifed-refresh-perf-counters-qui

quincy: os: introduce ObjectStore::refresh_perf_counters() method

Reviewed-by: Md Mahamudur Rahaman Sajib <mahamudur.sajib@croit.io>