]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
7 months agodoc/dev/release-process.rst: New container build/release process 60971/head
Dan Mick [Wed, 4 Dec 2024 01:15:41 +0000 (17:15 -0800)]
doc/dev/release-process.rst: New container build/release process

Signed-off-by: Dan Mick <dan.mick@redhat.com>
(cherry picked from commit 178036924e7d1ec8eb62663f00f82d0b092c7ca1)

7 months agoMerge pull request #60962 from dmick/wip-69119-squid
Dan Mick [Thu, 5 Dec 2024 23:25:30 +0000 (15:25 -0800)]
Merge pull request #60962 from dmick/wip-69119-squid

squid: Modify container/ software to support release containers and the promotion of prerelease containers

7 months agoMerge pull request #60447 from mohit84/wip-68665-squid
SrinivasaBharathKanta [Thu, 5 Dec 2024 09:26:08 +0000 (14:56 +0530)]
Merge pull request #60447 from mohit84/wip-68665-squid

squid: AsyncMessenger: Don't decrease l_msgr_active_connections if it is negative

7 months agoMerge pull request #59973 from sseshasa/wip-68223-squid
SrinivasaBharathKanta [Thu, 5 Dec 2024 09:25:20 +0000 (14:55 +0530)]
Merge pull request #59973 from sseshasa/wip-68223-squid

squid: common/options: Change HDD OSD shard configuration defaults for mClock

7 months agocontainer/{Containerfile,build.sh}: use a secret to pass secrets 60962/head
Dan Mick [Thu, 21 Nov 2024 03:11:24 +0000 (19:11 -0800)]
container/{Containerfile,build.sh}: use a secret to pass secrets

Use podman's build --secret mechanism to pass credentials for
download.ceph.com

Signed-off-by: Dan Mick <dan.mick@redhat.com>
(cherry picked from commit 4b3c0cb8f3f130563d9e1309beb7a8e0b59ea83e)

7 months agocontainer/Containerfile: allow failure from curl to stop build
Dan Mick [Thu, 21 Nov 2024 02:23:50 +0000 (18:23 -0800)]
container/Containerfile: allow failure from curl to stop build

curl doesn't actually fail unless -f is used; also, add
some sh -e flags.

Signed-off-by: Dan Mick <dan.mick@redhat.com>
(cherry picked from commit 18d14b22f31c65ad3db79c7930a841157b68deee)

7 months agocontainer/Containerfile: purge .repo files with secrets before commit
Dan Mick [Thu, 21 Nov 2024 02:18:59 +0000 (18:18 -0800)]
container/Containerfile: purge .repo files with secrets before commit

ceph.repo had creds in it for download.ceph.com/prerelease.
Remove the .repo files we construct, since they're not necessary
once the container is built (no one should be dnf'ing anything
in the container).

Signed-off-by: Dan Mick <dan.mick@redhat.com>
(cherry picked from commit 08432ef54212aa2aba724102854082e76f0cd847)

7 months agocontainer/Containerfile fix boolean IS_RELEASE usage
Dan Mick [Wed, 20 Nov 2024 00:44:17 +0000 (16:44 -0800)]
container/Containerfile fix boolean IS_RELEASE usage

Existing syntax was just wrong.

Signed-off-by: Dan Mick <dan.mick@redhat.com>
(cherry picked from commit ce74f14de5042774b8386b0eff04497b517eaacc)

7 months agocontainer/make-manifest-list.py: use LOCALMANIFEST throughout
Dan Mick [Wed, 20 Nov 2024 00:40:05 +0000 (16:40 -0800)]
container/make-manifest-list.py: use LOCALMANIFEST throughout

Signed-off-by: Dan Mick <dan.mick@redhat.com>
(cherry picked from commit a3a9f188cabf714de2c39e310bccbe848ed66671)

7 months agocontainers/make-manifest.py: Add --promote
Dan Mick [Sat, 16 Nov 2024 00:21:26 +0000 (16:21 -0800)]
containers/make-manifest.py: Add --promote

The promote function finds the latest image on the prerelease repo,
finds all its tags, and copies them all to the release repo.

Signed-off-by: Dan Mick <dan.mick@redhat.com>
(cherry picked from commit 4f050d7811fa6ec347c3414d5749e0f86480d7f4)

7 months agocontainer/Containerfile, build.sh: Add PRERELEASE_USERNAME/PASSWORD
Dan Mick [Fri, 15 Nov 2024 01:49:15 +0000 (17:49 -0800)]
container/Containerfile, build.sh: Add PRERELEASE_USERNAME/PASSWORD

Used for accessing download.ceph.com

Signed-off-by: Dan Mick <dan.mick@redhat.com>
(cherry picked from commit 7374b9b1114da08f1fdb9dfcfe2ef37c2178c8f5)

7 months agocontainer/build.sh:
Dan Mick [Thu, 14 Nov 2024 22:28:32 +0000 (14:28 -0800)]
container/build.sh:

- change repo path to prerelease
- remove image id arg for release push
- include 'v' in version name for release push

Signed-off-by: Dan Mick <dan.mick@redhat.com>
(cherry picked from commit 6c8e9984253a61c261cfe6e0981dda58895500ae)

7 months agocontainer/make-manifest-list.py
Dan Mick [Fri, 1 Nov 2024 02:55:36 +0000 (19:55 -0700)]
container/make-manifest-list.py

- don't print command failure in worker; let the caller print them
  if desired (allow silent failure)
- allow for empty tags list
- look for CEPH_SHA1.  GIT_COMMIT was the sha1 of the ceph-container.git
  commit
- change default paths to prerelease
- add --dry-run to avoid final push
- rename 'HOST' to 'CONTAINER_HOST'
- Use ARCH_SPECIFIC_HOST instead of CONTAINER_HOST (which is used by podman)

Signed-off-by: Dan Mick <dan.mick@redhat.com>
(cherry picked from commit 44b2fc4d5e1fd909370018ca9ec210686f98cefa)

7 months agoMerge pull request #60949 from zdover23/wip-doc-2024-12-04-backport-60930-to-squid
Anthony D'Atri [Wed, 4 Dec 2024 21:37:47 +0000 (22:37 +0100)]
Merge pull request #60949 from zdover23/wip-doc-2024-12-04-backport-60930-to-squid

squid: doc/rados: fix sentences in health-checks (3 of x)

7 months agodoc/rados: fix sentences in health-checks (3 of x) 60949/head
Zac Dover [Wed, 4 Dec 2024 02:13:05 +0000 (03:13 +0100)]
doc/rados: fix sentences in health-checks (3 of x)

Make sentences agree at the head of each section in
doc/rados/operations/health-checks.rst. The sentences were sometimes in
the imperative mood and sometimes in the declarative mood.

This commit edits the second third of
doc/rados/operations/health-checks.rst.

Note to (I hope soon) future Zac: There are a a couple of places near
the end of this file where the sentences are ungrammatical. Update these
in a separate PR (in isolation, so that the grammar and technical
accuracy of these sentences can be the primary focus of the reviewers).

Zac: cf. 000228

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 97df4479d90b7f1b659b71ac172ff1094d58a50e)

7 months agoMerge pull request #60931 from zdover23/wip-doc-2024-12-04-backport-60619-to-squid
Anthony D'Atri [Wed, 4 Dec 2024 07:58:56 +0000 (08:58 +0100)]
Merge pull request #60931 from zdover23/wip-doc-2024-12-04-backport-60619-to-squid

squid: doc/rados: fix sentences in health-checks (2 of x)

7 months agodoc/rados: fix sentences in health-checks (2 of x) 60931/head
Zac Dover [Tue, 3 Dec 2024 11:02:43 +0000 (12:02 +0100)]
doc/rados: fix sentences in health-checks (2 of x)

Make sentences agree at the head of each section in
doc/rados/operations/health-checks.rst. The sentences were sometimes in
the imperative mood and sometimes in the declarative mood.

This commit edits the second third of
doc/rados/operations/health-checks.rst.

Zac: cf. 000228

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit ee0ef765349ed8e170f8cd31c4fa0c7570105a96)

7 months agoMerge pull request #60920 from zdover23/wip-doc-2024-12-03-backport-60917-to-squid
Anthony D'Atri [Tue, 3 Dec 2024 14:35:23 +0000 (15:35 +0100)]
Merge pull request #60920 from zdover23/wip-doc-2024-12-03-backport-60917-to-squid

squid: doc/rados: make sentences agree in health-checks.rst

7 months agodoc/rados: make sentences agree in health-checks.rst 60920/head
Zac Dover [Tue, 3 Dec 2024 08:28:09 +0000 (09:28 +0100)]
doc/rados: make sentences agree in health-checks.rst

Make sentences agree at the head of each section in
doc/rados/operations/health-checks.rst. The sentences were sometimes in
the imperative mood and sometimes in the declarative mood.

This commit edits the first third of
doc/rados/operations/health-checks.rst.

Zac: cf. 000228

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit aec87b9188a92d2722c7310e753462a054cb12c7)

7 months agoMerge pull request #60880 from ShwetaBhosale1/fix_issue_69075_cephadm_bootstrap_messa...
Adam King [Mon, 2 Dec 2024 13:48:40 +0000 (08:48 -0500)]
Merge pull request #60880 from ShwetaBhosale1/fix_issue_69075_cephadm_bootstrap_message_with_default_image

Squid: cephadm: bootstrap should not have "This is a development version of cephadm" message

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Redouane Kachach <rkachach@ibm.com>
7 months agoMerge pull request #60893 from zdover23/wip-doc-2024-12-01-backport-60882-to-squid
Anthony D'Atri [Sun, 1 Dec 2024 13:48:40 +0000 (08:48 -0500)]
Merge pull request #60893 from zdover23/wip-doc-2024-12-01-backport-60882-to-squid

squid: os/bluestore: Improve documentation introduced by #57722

7 months agoMerge pull request #60896 from zdover23/wip-doc-2024-12-01-backport-60892-to-squid
Anthony D'Atri [Sun, 1 Dec 2024 13:47:26 +0000 (08:47 -0500)]
Merge pull request #60896 from zdover23/wip-doc-2024-12-01-backport-60892-to-squid

squid: doc/glossary.rst: add "Dashboard Plugin"

7 months agodoc/glossary.rst: add "Dashboard Plugin" 60896/head
Zac Dover [Sat, 30 Nov 2024 16:50:53 +0000 (17:50 +0100)]
doc/glossary.rst: add "Dashboard Plugin"

Add an entry below the (Mimic-era and therefore outdated but
nonetheless historically important) Dashboard Plugin key word in the
glosssary, which before now had never been added to the glossary.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit a1cec3de5704cedd7f7c8ce185144a96d72520d3)

7 months agoos/bluestore: Improve documentation introduced by #57722 60893/head
Anthony D'Atri [Thu, 28 Nov 2024 18:09:39 +0000 (13:09 -0500)]
os/bluestore: Improve documentation introduced by #57722

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
(cherry picked from commit b6eb98cc10895e0cdc4bc147f6f83145c10cba41)

7 months agoMerge pull request #60662 from zdover23/wip-doc-2024-11-07-backport-60642-to-squid
Zac Dover [Sat, 30 Nov 2024 15:40:46 +0000 (01:40 +1000)]
Merge pull request #60662 from zdover23/wip-doc-2024-11-07-backport-60642-to-squid

squid: doc/rgw/notification: clarified the notification_v2 behavior upon upg…

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
7 months agoMerge pull request #60885 from zdover23/wip-doc-2024-11-29-backport-60884-to-squid
Anthony D'Atri [Fri, 29 Nov 2024 22:52:22 +0000 (17:52 -0500)]
Merge pull request #60885 from zdover23/wip-doc-2024-11-29-backport-60884-to-squid

squid: doc/radosgw: update rgw_dns_name doc

7 months agodoc/radosgw: update rgw_dns_name doc 60885/head
Zac Dover [Fri, 29 Nov 2024 03:12:02 +0000 (13:12 +1000)]
doc/radosgw: update rgw_dns_name doc

Update doc/radosgw/s3/commons.rst with the changes made by Jiffin Tony
Thottan in https://github.com/ceph/ceph/pull/54524 and the suggestions
made in that same PR by Anthony D'Atri.

Explain how to set rgw_dns_name to a domain name in order to configure
access to virtual hosted buckets.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 45ff7e3365eaaa01ccb4ead71a14dd1dd9741c2f)

7 months agoMerge pull request #60867 from zdover23/wip-doc-2024-11-28-backport-60860-to-squid
Anthony D'Atri [Fri, 29 Nov 2024 01:55:50 +0000 (20:55 -0500)]
Merge pull request #60867 from zdover23/wip-doc-2024-11-28-backport-60860-to-squid

squid: doc/radosgw: Improve archive-sync-module.rst more

7 months agoMerge pull request #60107 from cbodley/wip-68378-squid
SrinivasaBharathKanta [Fri, 29 Nov 2024 01:30:56 +0000 (07:00 +0530)]
Merge pull request #60107 from cbodley/wip-68378-squid

squid: cmake: use ExternalProjects to build isa-l and isa-l_crypto libraries

7 months agoMerge pull request #59147 from NitzanMordhai/wip-67473-squid
SrinivasaBharathKanta [Fri, 29 Nov 2024 01:30:18 +0000 (07:00 +0530)]
Merge pull request #59147 from NitzanMordhai/wip-67473-squid

squid: suites: test should ignore osd_down warnings

7 months agocommon/options: Change HDD OSD shard configuration defaults for mClock 59973/head
Sridhar Seshasayee [Tue, 3 Sep 2024 05:39:08 +0000 (11:09 +0530)]
common/options: Change HDD OSD shard configuration defaults for mClock

Based on tests performed at scale on a HDD based cluster, it was found
that scheduling with mClock was not optimal with multiple OSD shards. For
e.g., in the scaled cluster with multiple OSD node failures, the client
throughput was found to be inconsistent across test runs coupled with
multiple reported slow requests.

However, the same test with a single OSD shard and with multiple worker
threads yielded significantly better results in terms of consistency of
client and recovery throughput across multiple test runs.

For more details see https://tracker.ceph.com/issues/66289.

Therefore, as an interim measure until the issue with multiple OSD shards
(or multiple mClock queues per OSD) is investigated and fixed, the
following change to the default HDD OSD shard configuration is made:

 - osd_op_num_shards_hdd = 1 (was 5)
 - osd_op_num_threads_per_shard_hdd = 5 (was 1)

The other changes in this commit include:
 - Doc change to the OSD and mClock config reference describing
   this change.
 - OSD troubleshooting entry on the procedure to change the shard
   configuration for clusters affected by this issue running on older
   releases.
 - Add release note for this change.

Fixes: https://tracker.ceph.com/issues/66289
Signed-off-by: Sridhar Seshasayee <sseshasa@redhat.com>
(cherry picked from commit 0d81e721378e6d7a647c5a4f6aab3cede1a828d3)

Conflicts:
        doc/rados/troubleshooting/troubleshooting-osd.rst
- Included the troubleshooting entry before the "Flapping OSDs" section.
        PendingReleaseNotes
- Moved the release note under 19.0.0 section.

7 months agocephadm: bootstap should not have "This is a development version of cephadm" message 60880/head
Shweta Bhosale [Thu, 28 Nov 2024 10:52:57 +0000 (16:22 +0530)]
cephadm: bootstap should not have "This is a development version of cephadm" message

Fixes: https://tracker.ceph.com/issues/69075
Signed-off-by: Shweta Bhosale <Shweta.Bhosale1@ibm.com>
7 months agoMerge pull request #60864 from zdover23/wip-doc-2024-11-28-backport-59225-to-squid
Zac Dover [Thu, 28 Nov 2024 05:04:28 +0000 (15:04 +1000)]
Merge pull request #60864 from zdover23/wip-doc-2024-11-28-backport-59225-to-squid

squid: doc/glossary: add "flapping OSD"

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
7 months agodoc/radosgw: Improve archive-sync-module.rst more 60867/head
Anthony D'Atri [Wed, 27 Nov 2024 16:39:38 +0000 (11:39 -0500)]
doc/radosgw: Improve archive-sync-module.rst more

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
(cherry picked from commit c24dc78484cbca8660c87742a6612c15935953c4)

7 months agodoc/glossary: add "flapping OSD" 60864/head
Zac Dover [Wed, 14 Aug 2024 18:08:14 +0000 (04:08 +1000)]
doc/glossary: add "flapping OSD"

Add an entry for "Flapping OSD" to the glossary.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 1ca89e6ca3d9e0042702b7ac3af9a3e596330c1d)

7 months agoMerge pull request #60616 from YiteGu/wip-68790-squid
SrinivasaBharathKanta [Wed, 27 Nov 2024 12:18:33 +0000 (17:48 +0530)]
Merge pull request #60616 from YiteGu/wip-68790-squid

squid: blk/KernelDevice: using join() to wait thread end is more safe

7 months agoMerge pull request #60660 from sseshasa/wip-68856-squid
SrinivasaBharathKanta [Wed, 27 Nov 2024 12:18:21 +0000 (17:48 +0530)]
Merge pull request #60660 from sseshasa/wip-68856-squid

squid: common,osd: Use last valid OSD IOPS value if measured IOPS is unrealistic

7 months agoMerge pull request #59372 from NitzanMordhai/wip-67646-squid
SrinivasaBharathKanta [Wed, 27 Nov 2024 12:17:41 +0000 (17:47 +0530)]
Merge pull request #59372 from NitzanMordhai/wip-67646-squid

squid: mgr/rest: Trim  requests array and limit size

7 months agoMerge pull request #60852 from zdover23/wip-doc-2024-11-27-backport-60846-to-squid
Anthony D'Atri [Tue, 26 Nov 2024 21:59:03 +0000 (16:59 -0500)]
Merge pull request #60852 from zdover23/wip-doc-2024-11-27-backport-60846-to-squid

squid: doc/radosgw: Improve archive-sync-module.rst

7 months agodoc/radosgw: Improve archive-sync-module.rst 60852/head
Anthony D'Atri [Tue, 26 Nov 2024 16:13:06 +0000 (11:13 -0500)]
doc/radosgw: Improve archive-sync-module.rst

Signed-off-by: Anthony D'Atri <anthony.datri@gmail.com>
(cherry picked from commit 303ce155a34fdf2cde63b948d204aca339dd5682)

7 months agoMerge pull request #60823 from cbodley/wip-69025-squid
Yuri Weinstein [Tue, 26 Nov 2024 20:50:02 +0000 (12:50 -0800)]
Merge pull request #60823 from cbodley/wip-69025-squid

squid: rgw: RGWAccessKey::decode_json() preserves default value of 'active'

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
7 months agoMerge pull request #60824 from zdover23/wip-doc-2024-11-25-backport-60813-to-squid
Anthony D'Atri [Mon, 25 Nov 2024 23:25:48 +0000 (18:25 -0500)]
Merge pull request #60824 from zdover23/wip-doc-2024-11-25-backport-60813-to-squid

squid: doc/rados/troubleshooting: Improve log-and-debug.rst

7 months agoMerge pull request #60774 from yuvalif/wip-68984-squid
Yuri Weinstein [Mon, 25 Nov 2024 22:57:34 +0000 (14:57 -0800)]
Merge pull request #60774 from yuvalif/wip-68984-squid

squid: RGW|Bucket notification: fix for v2 topics rgw-admin list operation

Reviewed-by: Adam Emerson <aemerson@redhat.com>
7 months agoMerge pull request #60792 from smanjara/wip-69003-squid
Yuri Weinstein [Mon, 25 Nov 2024 22:56:57 +0000 (14:56 -0800)]
Merge pull request #60792 from smanjara/wip-69003-squid

squid: rgw/multisite: metadata polling event based on unmodified mdlog_marker

Reviewed-by: Adam Emerson <aemerson@redhat.com>
7 months agoqa/rgw: the rgw/verify suite runs java tests last 60823/head
Casey Bodley [Fri, 22 Nov 2024 16:19:37 +0000 (11:19 -0500)]
qa/rgw: the rgw/verify suite runs java tests last

a band-aid for https://tracker.ceph.com/issues/68991 to make sure all
other tests run before the failing java tests

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 49e76c23de1b5c1f1e84e50a6d8207329ce4093e)

7 months agodoc/rados/troubleshooting: Improve log-and-debug.rst 60824/head
Anthony D'Atri [Mon, 25 Nov 2024 01:24:18 +0000 (20:24 -0500)]
doc/rados/troubleshooting: Improve log-and-debug.rst

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
(cherry picked from commit 44c9519cc3eb013104c52014c302ba71ba806f8f)

7 months agorgw: RGWAccessKey::decode_json() preserves default value of 'active'
Casey Bodley [Tue, 19 Nov 2024 19:02:02 +0000 (14:02 -0500)]
rgw: RGWAccessKey::decode_json() preserves default value of 'active'

squid added the new "bool active" member that defaults to true, but
RGWAccessKey::decode_json() sets it to false when "active" isn't present

this is an issue for multisite when a squid zone replicates user
metadata from a master zone running reef

Fixes: https://tracker.ceph.com/issues/68985
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 8ba6c2de830129ec0533652a3cb33391b584006d)

7 months agoMerge pull request #60737 from zdover23/wip-doc-2024-11-15-backport-60703-to-squid
Zac Dover [Mon, 25 Nov 2024 03:12:02 +0000 (13:12 +1000)]
Merge pull request #60737 from zdover23/wip-doc-2024-11-15-backport-60703-to-squid

squid: doc/rados: correct "full ratio" note

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
7 months agoMerge pull request #60809 from zdover23/wip-doc-2024-11-24-backport-60804-to-squid...
Anthony D'Atri [Sun, 24 Nov 2024 15:33:38 +0000 (10:33 -0500)]
Merge pull request #60809 from zdover23/wip-doc-2024-11-24-backport-60804-to-squid-test-2

squid: doc/cephadm: Clarify "Deploying a new Cluster"

7 months agodoc/cephadm: Clarify "Deploying a new Cluster" 60809/head
Zac Dover [Sat, 23 Nov 2024 12:32:13 +0000 (22:32 +1000)]
doc/cephadm: Clarify "Deploying a new Cluster"

Change the title of the section "Deploying a new Ceph cluster" to "Using
cephadm to Deploy a New Ceph Cluster". This is part of the initiative to
separate package-related documentation from container-based
documenation.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 8cf77d03a1f3ecb73931ddf96d13ef098aa61c1a)

7 months agoMerge pull request #60751 from idryomov/wip-68743-squid
Yuri Weinstein [Fri, 22 Nov 2024 18:31:05 +0000 (10:31 -0800)]
Merge pull request #60751 from idryomov/wip-68743-squid

squid: Make mon addrs consistent with mon info

Reviewed-by: Laura Flores <lflores@redhat.com>
7 months agoMerge pull request #60718 from ljflores/wip-68910-squid
Laura Flores [Thu, 21 Nov 2024 23:40:10 +0000 (17:40 -0600)]
Merge pull request #60718 from ljflores/wip-68910-squid

squid: mgr/balancer: optimize 'balancer status detail'

7 months agoMerge pull request #58914 from ljflores/wip-67245-squid
Laura Flores [Thu, 21 Nov 2024 23:39:11 +0000 (17:39 -0600)]
Merge pull request #58914 from ljflores/wip-67245-squid

squid: mon: Remove any pg_upmap_primary mapping during remove a pool

7 months agorgw/multisite: in order to sleep between mdlog polling events, we check if the mdlog_... 60792/head
Shilpa Jagannath [Mon, 17 Jul 2023 16:52:07 +0000 (12:52 -0400)]
rgw/multisite: in order to sleep between mdlog polling events, we check if the mdlog_marker is not modified by comparing
mdlog_marker and max_marker. but max_marker is exposed to changes from RGWReadMDLogEntriesCR, and if there is a race
coming from mdlog trimming which could render max_marker empty, then its comparison with mdlog polling can be incorrect.
To fix this, we now save the previous mdlog marker and compare with the updated mdlog marker.

Signed-off-by: Shilpa Jagannath <smanjara@redhat.com>
(cherry picked from commit bae10f22e8b008088f0861db2785d8c0ba7ee506)

7 months agoMerge pull request #60766 from zdover23/wip-doc-2024-11-19-backport-60765-to-squid
Zac Dover [Tue, 19 Nov 2024 22:40:24 +0000 (08:40 +1000)]
Merge pull request #60766 from zdover23/wip-doc-2024-11-19-backport-60765-to-squid

squid: doc/start: update os-recommendations.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
7 months agorgw/notification: fix segmentation fault and topic listing logic 60774/head
Oshrey Avraham [Mon, 18 Nov 2024 10:06:22 +0000 (12:06 +0200)]
rgw/notification: fix segmentation fault and topic listing logic

- Fixed a segmentation fault caused by a null bucket pointer in RGWPSListTopicsOp::execute()
- Corrected logic to use get_topics_v2 when supported, with fallback otherwise

Fixes: https://tracker.ceph.com/issues/68756
Signed-off-by: Oshrey Avraham <oshrey16@gmail.com>
(cherry picked from commit d27dab240d568a705ff45e2231be650673279ebe)

7 months agoRGW|Bucket notification: fix for v2 topics rgw-admin list operation
Ali Masarwa [Sun, 29 Sep 2024 12:00:13 +0000 (15:00 +0300)]
RGW|Bucket notification: fix for v2 topics rgw-admin list operation

Signed-off-by: Ali Masarwa <amasarwa@redhat.com>
(cherry picked from commit 575a19d2a81e959d21f64d1a9ed39a5db3b92957)

7 months agodoc/start: update os-recommendations.rst 60766/head
Zac Dover [Tue, 19 Nov 2024 00:37:56 +0000 (10:37 +1000)]
doc/start: update os-recommendations.rst

Remove information about the operating systems that support Ceph's
official container images from the "Platforms" table in
doc/start/os-recommendations.rst and add that information to the (new)
table that shows the operating systems that support Ceph's official
container images.

Credit for this change should go to Enrico Bocchi, who noticed a
discrepancy that motivated it.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit c2f1fac3b94e946b253bc64e579429660cbc2d59)

7 months agoMerge pull request #60164 from cbodley/wip-68425-squid
Yuri Weinstein [Mon, 18 Nov 2024 15:17:24 +0000 (07:17 -0800)]
Merge pull request #60164 from cbodley/wip-68425-squid

squid: cls/user: reset stats only returns marker when truncated

Reviewed-by: Adam Emerson <aemerson@redhat.com>
7 months agoMerge pull request #59302 from yuvalif/wip-67574-squid
Yuri Weinstein [Mon, 18 Nov 2024 15:16:50 +0000 (07:16 -0800)]
Merge pull request #59302 from yuvalif/wip-67574-squid

squid: rgw/notifications: fixing radosgw-admin notification json

Reviewed-by: Adam Emerson <aemerson@redhat.com>
7 months agoMerge pull request #59120 from k0ste/wip-64499-squid
Yuri Weinstein [Mon, 18 Nov 2024 15:16:10 +0000 (07:16 -0800)]
Merge pull request #59120 from k0ste/wip-64499-squid

squid: rgw: add s3select usage to log usage

Reviewed-by: Adam Emerson <aemerson@redhat.com>
7 months agoMerge pull request #59931 from adk3798/wip-68136-squid
Adam King [Mon, 18 Nov 2024 13:02:22 +0000 (08:02 -0500)]
Merge pull request #59931 from adk3798/wip-68136-squid

squid: mgr/cephadm: add command to expose systemd units of all daemons

Reviewed-by: John Mulligan <jmulligan@redhat.com>
7 months agoMerge pull request #60734 from guits/wip-68961-squid
Guillaume Abrioux [Mon, 18 Nov 2024 12:39:10 +0000 (13:39 +0100)]
Merge pull request #60734 from guits/wip-68961-squid

squid: ceph-volume: fix dmcrypt activation regression

8 months agoMerge pull request #60130 from cbodley/wip-68399-squid
Yuri Weinstein [Fri, 15 Nov 2024 16:57:25 +0000 (08:57 -0800)]
Merge pull request #60130 from cbodley/wip-68399-squid

squid: rgw: decrypt multipart get part when encrypted

Reviewed-by: Adam Emerson <aemerson@redhat.com>
8 months agoMerge pull request #59754 from yuvalif/wip-68047-squid
Yuri Weinstein [Fri, 15 Nov 2024 16:56:49 +0000 (08:56 -0800)]
Merge pull request #59754 from yuvalif/wip-68047-squid

squid: rgw/kafka: refactor topic creation to avoid rd_kafka_topic_name()

Reviewed-by: Adam Emerson <aemerson@redhat.com>
8 months agoMerge pull request #59678 from jzhu116-bloomberg/wip-67959-squid
Yuri Weinstein [Fri, 15 Nov 2024 16:56:08 +0000 (08:56 -0800)]
Merge pull request #59678 from jzhu116-bloomberg/wip-67959-squid

squid: rgw/multipart: use cls_version to avoid racing between part upload and multipart complete

Reviewed-by: Adam Emerson <aemerson@redhat.com>
8 months agoMerge pull request #59123 from k0ste/wip-67099-squid
Yuri Weinstein [Fri, 15 Nov 2024 16:16:24 +0000 (08:16 -0800)]
Merge pull request #59123 from k0ste/wip-67099-squid

squid: [RGW] Fix the handling of HEAD requests that do not comply with RFC standards

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
8 months agoMake mon addrs consistent with mon info 60751/head
shenjiatong [Sat, 2 Nov 2024 08:10:38 +0000 (16:10 +0800)]
Make mon addrs consistent with mon info

For legacy librbd clients, sanitize_mons will panic if addrs are not
consistent with mon_info_t.

Signed-off-by: shenjiatong <yshxxsjt715@163.com>
fixes: https://tracker.ceph.com/issues/68743
(cherry picked from commit 14b09519739f3b2dc715647fd0f04dd22c17aeb3)

8 months agodoc/rados: correct "full ratio" note 60737/head
Zac Dover [Mon, 11 Nov 2024 23:31:28 +0000 (09:31 +1000)]
doc/rados: correct "full ratio" note

Correct a note that directed users not to add an OSD after the cluster
has reached its "full ratio". The note now says "Do not let your cluster
reach its full ratio before adding an OSD."

Hat tip: Oskar Berggren

Fixes: https://tracker.ceph.com/issues/68900
Co-authored-by: Oskar Berggren <oskar.berggren@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit f1a2637c79a15c26a769661dd72ca68d766b2f0d)

8 months agoMerge pull request #60671 from zdover23/wip-doc-2024-11-08-backport-56771-to-squid
Zac Dover [Thu, 14 Nov 2024 14:52:57 +0000 (00:52 +1000)]
Merge pull request #60671 from zdover23/wip-doc-2024-11-08-backport-56771-to-squid

squid: doc: Document which options are disabled by mClock.

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
8 months agoceph-volume: fix dmcrypt activation regression 60734/head
Guillaume Abrioux [Wed, 13 Nov 2024 15:23:36 +0000 (16:23 +0100)]
ceph-volume: fix dmcrypt activation regression

`ceph.with_tpm` tag is actually a `str`, which means that
`bool('0')` will return `True`.

Fixes: https://tracker.ceph.com/issues/68944
Signed-off-by: Guillaume Abrioux <gabrioux@ibm.com>
(cherry picked from commit 3cf00cde820ec838e4fbda1799d2ce336c9e2d86)

8 months agoMerge pull request #59948 from aaSharma14/wip-68203-squid
Adam King [Wed, 13 Nov 2024 20:58:27 +0000 (15:58 -0500)]
Merge pull request #59948 from aaSharma14/wip-68203-squid

squid: mgr/cephadm: use host address while updating rgw zone endpoints

Reviewed-by: Adam King <adking@redhat.com>
8 months agoMerge pull request #59945 from aaSharma14/wip-68201-squid
Adam King [Wed, 13 Nov 2024 20:57:26 +0000 (15:57 -0500)]
Merge pull request #59945 from aaSharma14/wip-68201-squid

squid: mgr/rgwam: use realm/zonegroup/zone method arguments for period update

Reviewed-by: Adam King <adking@redhat.com>
8 months agoMerge pull request #59935 from adk3798/squid-cephadm-no-exception-cert-store-get
Adam King [Wed, 13 Nov 2024 20:56:49 +0000 (15:56 -0500)]
Merge pull request #59935 from adk3798/squid-cephadm-no-exception-cert-store-get

squid: mgr/cephadm: add --no-exception-when-missing flag to cert-store cert/key get

Reviewed-by: Nizamudeen A <nia@redhat.com>
8 months agoMerge pull request #59934 from adk3798/squid-cephadm-iscsi-teuth-extension
Adam King [Wed, 13 Nov 2024 20:55:58 +0000 (15:55 -0500)]
Merge pull request #59934 from adk3798/squid-cephadm-iscsi-teuth-extension

squid: qa/cephadm: extend iscsi teuth test

Reviewed-by: John Mulligan <jmulligan@redhat.com>
8 months agoMerge pull request #59933 from adk3798/wip-68159-squid
Adam King [Wed, 13 Nov 2024 20:55:13 +0000 (15:55 -0500)]
Merge pull request #59933 from adk3798/wip-68159-squid

squid: cephadm: Support Docker Live Restore

Reviewed-by: John Mulligan <jmulligan@redhat.com>
8 months agoMerge pull request #59930 from adk3798/wip-68114-squid
Adam King [Wed, 13 Nov 2024 20:52:32 +0000 (15:52 -0500)]
Merge pull request #59930 from adk3798/wip-68114-squid

squid: qa/task: update alertmanager endpoints version

Reviewed-by: John Mulligan <jmulligan@redhat.com>
8 months agoMerge pull request #59929 from adk3798/wip-68019-squid
Adam King [Wed, 13 Nov 2024 20:51:43 +0000 (15:51 -0500)]
Merge pull request #59929 from adk3798/wip-68019-squid

squid: cephadm: emit warning if daemon's image is not to be used

Reviewed-by: John Mulligan <jmulligan@redhat.com>
8 months agoMerge pull request #59710 from adk3798/cephadm-squid-ssh-keepalive-configurable
Adam King [Wed, 13 Nov 2024 20:40:44 +0000 (15:40 -0500)]
Merge pull request #59710 from adk3798/cephadm-squid-ssh-keepalive-configurable

squid: mgr/cephadm: make ssh keepalive settings configurable

Reviewed-by: John Mulligan <jmulligan@redhat.com>
8 months agoMerge pull request #59472 from adk3798/wip-67462-squid
Adam King [Wed, 13 Nov 2024 20:39:33 +0000 (15:39 -0500)]
Merge pull request #59472 from adk3798/wip-67462-squid

squid: qa/upgrade: fix checks to make sure upgrade is still in progress

Reviewed-by: John Mulligan <jmulligan@redhat.com>
8 months agoMerge pull request #58711 from rhcs-dashboard/bump-monitoring-stack-squid
Adam King [Wed, 13 Nov 2024 20:38:47 +0000 (15:38 -0500)]
Merge pull request #58711 from rhcs-dashboard/bump-monitoring-stack-squid

squid: mgr/cephadm: bump monitoring stacks version

Reviewed-by: John Mulligan <jmulligan@redhat.com>
8 months agoMerge pull request #58515 from adk3798/squid-cephadm-ingress-fix-ipv6-binding
Adam King [Wed, 13 Nov 2024 20:37:54 +0000 (15:37 -0500)]
Merge pull request #58515 from adk3798/squid-cephadm-ingress-fix-ipv6-binding

squid: mgr/cephadm/services/ingress Fix HAProxy to listen on IPv4 and IPv6

Reviewed-by: John Mulligan <jmulligan@redhat.com>
8 months agoMerge pull request #58381 from adk3798/squid-cephadm-haproxy-bugged-config
Adam King [Wed, 13 Nov 2024 20:37:01 +0000 (15:37 -0500)]
Merge pull request #58381 from adk3798/squid-cephadm-haproxy-bugged-config

squid: cephadm/services/ingress: fixed keepalived config bug

Reviewed-by: John Mulligan <jmulligan@redhat.com>
8 months agoMerge pull request #60466 from rhcs-dashboard/wip-68686-squid
afreen23 [Wed, 13 Nov 2024 20:25:35 +0000 (01:55 +0530)]
Merge pull request #60466 from rhcs-dashboard/wip-68686-squid

squid: mgr/dashboard: fix bucket get for s3 account owned bucket

Reviewed-by: Afreen Misbah <afreen@ibm.com>
8 months agoMerge pull request #60620 from YiteGu/wip-67094-squid
afreen23 [Wed, 13 Nov 2024 20:23:37 +0000 (01:53 +0530)]
Merge pull request #60620 from YiteGu/wip-67094-squid

squid: mgr/dashboard: add cephfs rename REST API

Reviewed-by: Afreen Misbah <afreen@ibm.com>
8 months agoMerge pull request #60632 from rhcs-dashboard/wip-68844-squid
Nizamudeen A [Wed, 13 Nov 2024 15:54:41 +0000 (21:24 +0530)]
Merge pull request #60632 from rhcs-dashboard/wip-68844-squid

squid: mgr/dashboard: remove cherrypy_backports.py

8 months agodoc: document balancer configurable "update_pg_upmap_activity" 60718/head
Laura Flores [Fri, 1 Nov 2024 22:49:46 +0000 (22:49 +0000)]
doc: document balancer configurable "update_pg_upmap_activity"

Signed-off-by: Laura Flores <lflores@ibm.com>
(cherry picked from commit c4274c0c3a608eeb0b1183c8a96ef3a314bf797c)

8 months agomgr/balancer: tie `update_pg_upmap_activity` to a configurable
Laura Flores [Fri, 1 Nov 2024 22:44:17 +0000 (22:44 +0000)]
mgr/balancer: tie `update_pg_upmap_activity` to a configurable

This addition gives users the option of enabling/disabling this feature.

They can do so by running:
ceph config set mgr mgr/balancer/update_pg_upmap_activity <True|False>

The feature is off by default.

Signed-off-by: Laura Flores <lflores@ibm.com>
(cherry picked from commit 62c9f152e31affe3e19eb50e917cbeb10624f8fd)

8 months agomgr/balancer: optimize 'balancer status detail'
Laura Flores [Mon, 28 Oct 2024 22:40:13 +0000 (22:40 +0000)]
mgr/balancer: optimize 'balancer status detail'

Before, we were updating the balancer status by
iterating through all pg upmap entires. This was
affecting the loading time of other mgr modules
on clusters with a large number of pgs (600+).

This can be optimized by simply pulling from
the incremental.

Fixes: https://tracker.ceph.com/issues/68657
Signed-off-by: Laura Flores <lflores@ibm.com>
(cherry picked from commit 31c498da96fa1acc1700515edcd544dead86dab9)

8 months agoMerge pull request #60707 from zdover23/wip-doc-2024-11-12-backport-60705-to-squid
Anthony D'Atri [Tue, 12 Nov 2024 04:14:00 +0000 (23:14 -0500)]
Merge pull request #60707 from zdover23/wip-doc-2024-11-12-backport-60705-to-squid

squid: doc/radosgw: s/Poliicy/Policy/

8 months agoMerge pull request #60708 from zdover23/wip-doc-2024-11-12-backport-60704-to-squid
Anthony D'Atri [Tue, 12 Nov 2024 04:12:09 +0000 (23:12 -0500)]
Merge pull request #60708 from zdover23/wip-doc-2024-11-12-backport-60704-to-squid

squid: doc/start: fix "are are" typo

8 months agodoc/start: fix "are are" typo 60708/head
Zac Dover [Mon, 11 Nov 2024 23:47:21 +0000 (09:47 +1000)]
doc/start: fix "are are" typo

Fix typo reading "They are are single-threaded".
s/are are/are/

Fixes: https://tracker.ceph.com/issues/68901
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 22010719d7edf2a6cf7de7b115ed797e7942ec47)

8 months agodoc/radosgw: s/Poliicy/Policy/ 60707/head
Zac Dover [Mon, 11 Nov 2024 23:54:56 +0000 (09:54 +1000)]
doc/radosgw: s/Poliicy/Policy/

Correct "AttachGroupPoliicy" to "AttachGroupPolicy".

Fixes: https://tracker.ceph.com/issues/68902
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 961aef1bb4e59912ac1c8827a392c18b912c71f0)

8 months agoMerge pull request #60698 from zdover23/wip-doc-2024-11-12-backport-60529-to-squid
Anthony D'Atri [Tue, 12 Nov 2024 02:15:40 +0000 (21:15 -0500)]
Merge pull request #60698 from zdover23/wip-doc-2024-11-12-backport-60529-to-squid

squid: doc/start: separate package chart from container chart

8 months agodoc/start: separate package chart from container chart 60698/head
Zac Dover [Tue, 29 Oct 2024 07:27:43 +0000 (17:27 +1000)]
doc/start: separate package chart from container chart

Separate the packages-and-containers chart into two charts:
   (1) a chart that shows which OSes Ceph builds packages for
   (2) a chart that shows which OSes support Ceph's containers

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit e5ff1916e3d5e2cc3f47b4cea2762730dfd335c0)

8 months agodoc/mgr/restful: update max_request config 59372/head
nmordech@redhat.com [Wed, 21 Feb 2024 10:01:25 +0000 (10:01 +0000)]
doc/mgr/restful: update max_request config

Signed-off-by: Nitzan Mordechai <nmordech@redhat.com>
(cherry picked from commit dd7e8bbde6df5efdf4706279e5f8b8281ebaee16)

8 months agoMerge pull request #60679 from zdover23/wip-doc-2024-11-09-backport-60605-to-squid
Anthony D'Atri [Sat, 9 Nov 2024 14:48:07 +0000 (09:48 -0500)]
Merge pull request #60679 from zdover23/wip-doc-2024-11-09-backport-60605-to-squid

squid: doc/cephadm: clean "Adv. OSD Service Specs"

8 months agodoc/cephadm: clean "Adv. OSD Service Specs" 60679/head
Zac Dover [Mon, 4 Nov 2024 08:46:49 +0000 (18:46 +1000)]
doc/cephadm: clean "Adv. OSD Service Specs"

Clean the English grammar and the .RST in the section "Advanced OSD
Service Specifications" in the file doc/cephadm/services/osd.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit f6b56f9ee5d9f0b54dcaf1832d7a977895eb9c94)

8 months agoMerge pull request #59035 from sseshasa/wip-67355-squid
SrinivasaBharathKanta [Fri, 8 Nov 2024 11:03:45 +0000 (16:33 +0530)]
Merge pull request #59035 from sseshasa/wip-67355-squid

squid: osd/scheduler: add mclock queue length perfcounter

8 months agoMerge pull request #58785 from sseshasa/wip-67108-squid
SrinivasaBharathKanta [Fri, 8 Nov 2024 11:03:28 +0000 (16:33 +0530)]
Merge pull request #58785 from sseshasa/wip-67108-squid

squid: qa/suites/rados/verify/validater: increase heartbeat grace timeout