the returned-bytes metric was missing upon parquet flow.
s3select submodule

Signed-off-by: Gal Salomon <gal.salomon@gmail.com>

move the parquet-reader-setup call location.
editorial.

Signed-off-by: Gal Salomon <gal.salomon@gmail.com>

removing the JSON format part, it is not align with the current s3-tests (will be done on different part)

Signed-off-by: Gal Salomon <gal.salomon@gmail.com>

s3select submodule.
RGW option per parquet read-buffer.
identation.
alignment with s3select updated APIs.

Signed-off-by: Gal Salomon <gal.salomon@gmail.com>

s3select submodule

Signed-off-by: Gal Salomon <gal.salomon@gmail.com>

Merge pull request #59842 from chanyoung/set-journaling-feature

rbd: set journaling feature when --mirror-image-mode is journal

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>

Merge PR #59874 into main

* refs/pull/59874/head:
mds: invalid id for client eviction is to be treated as success

Reviewed-by: Neeraj Pratap Singh <neesingh@redhat.com>

Merge pull request #60029 from rhcs-dashboard/fix-68295

mgr/dashboard: fix doc links in rgw-multisite

Reviewed-by: Nizamudeen A <nia@redhat.com>

Merge pull request #60031 from guits/cv-quick-fix

ceph-volume: docstring and typing corrections

Merge PR #52623 into main

* refs/pull/52623/head:
ceph-dencoder: MDS - Add missing types

Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #60039 from zdover23/wip-doc-2024-09-29-rados-tshooting-tshooting-pg

doc/rados: edit "Placement Groups Never Get Clean"

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #59999 from leonidc/tracking-gw-deleting

mon/nvmeofgw*: fix tracking gateways in DELETING state

doc/rados: edit "Placement Groups Never Get Clean"

Make grammar improvements (and correct a verb disagreement) in the
section "Placement Groups Never Get Clean" in
doc/rados/troubleshooting/troubleshooting-pg.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>

Merge pull request #60036 from solmagd/main

reef: doc: Adds release date.

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #60038 from zdover23/wip-doc-2024-09-28-releases-squid-dashboard

doc/releases: move Dashboard items from CephFS

doc/releases: move Dashboard items from CephFS

Move three dashboard-related items from beneath a heading reading
"CephFS" and put them beneath a heading reading "Dashboard".

Fixes: https://github.com/ceph/ceph/pull/59539#discussion_r1777960130
Signed-off-by: Zac Dover <zac.dover@proton.me>

Merge pull request #59366 from athanatos/sjust/wip-67640-module-fix

.gitmodules: remove shallow=true config from nvmeof/gateway

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

doc: Adds release date.

Signed-off-on-by: Joel Davidow <jdavidow@nso.edu>

Merge pull request #58598 from sajibreadd/wip-66215

common/Formatter: dump inf/nan as null

Merge pull request #57659 from mkogan1/wip-graceful-shutdown

rgw: delay the RGW process exit until all actice requests have completed

Merge pull request #60030 from petrutlucian94/document_windows_ci

doc: Document the Windows CI job

Reviewed-by: Zac Dover <zac.dover@proton.me>

Merge pull request #60026 from batrick/i68291

osdc: fix mutex assert for !debug builds

Reviewed-by: Casey Bodley <cbodley@redhat.com>

doc: Document the Windows CI job

We're adding a document that describes:

* the steps performed by the Windows CI job
* artifact structure
* frequently asked questions

The document is meant to assist the Ceph developers in investigating
CI failures. This is especially important as the Windows CI job runs
integration tests that would otherwise only be executed by
Teuthology, thus helping catch potential regressions quickly.

Note that the identified regressions are not necessarily Windows
specific, usually affecting Linux builds as well.

Signed-off-by: Lucian Petrut <lpetrut@cloudbasesolutions.com>

ceph-volume: docstring and typing corrections

This corrects some error in disk.py:

- get_partitions has an incorrect typing
  + adding docstring for this function.
- get_lvm_mapper_path_from_dm docstring is wrong

Signed-off-by: Guillaume Abrioux <gabrioux@ibm.com>

mgr/dashboard: fix doc links in rgw-multisite

Fixes: https://tracker.ceph.com/issues/68295
Signed-off-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>

osdc: fix mutex assert for !debug builds

Fixes: 55652f0819761d410bddcf3688b1c3e10ed64f5b
Fixes: https://tracker.ceph.com/issues/68291
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>

mon/nvmeofgw*: fix tracking gateways in DELETING state
1.Ignore subsystems of GWs in state DELETING when calculate number namespaces
2.Call tracking function always in the monitor's tick - not just if the
  beacon is active

Signed-off-by: Leonid Chernin <leonidc@il.ibm.com>

Merge pull request #57836 from guojidan/warn-pool-app

src/mon/PGMap: raise POOL_APP_NOT_ENABLED after some time for new pool

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>

Merge pull request #59539 from zdover23/wip-doc-2024-08-31-add-squid-19-2-0-release-notes

doc: Add Squid 19.2.0 release notes

doc/releases: add highlights section

Signed-off-by: Laura Flores <lflores@ibm.com>

Merge pull request #58461 from cbodley/wip-cls-rgw-index-async

cls/rgw: warn about CLSRGWConcurrentIO use in asio threads

Reviewed-by: Adam Emerson <aemerson@redhat.com>

Merge pull request #59726 from avanthakkar/earmark-nfs

mgr/nfs: earmark resolver for subvolume

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: John Mulligan <jmulligan@redhat.com>

doc/releases: update squid release date

Signed-off-by: Laura Flores <lflores@ibm.com>

doc/releases: Add warning about iSCSI bug

Add a warning about an iSCSI-related bug encountered when upgrading from
19.1.1 to 19.2.0.

Signed-off-by: Zac Dover <zac.dover@proton.me>

Merge PR #58936 into main

* refs/pull/58936/head:
mds: do not duplicate journaler write heads
mds: use Journaler getters
osdc: properly acquire locks for getters
osdc: add print method for Journaler::Header
mds: do not trim segments after open file table commit
mds: delay expiry if LogSegment is ahead of committed oft seq
mds: do not write journal head twice on trim
mds: simplify and explain expiry finisher ctx
mds: add mds_lock asserts for journal flush
mds: skip second wait_for_safe
mds: trim only to the LogSegment created for flush
mds: allow passing explicit seq to trim to
mds: quiet unhelpful debug message
mds: add C_IO_Wrapper completion debugging
mds: add dout for new segment

Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #59864 from cbodley/wip-68134

rgw/rados: RGWRados::delete_objs_inline() uses AioThrottle

Reviewed-by: Pritha Srivastava <prsrivas@redhat.com>

Merge pull request #59536 from smanjara/rgw-full-sync-cr

rg/multisite: handle errors properly in RGWDataFullSyncSingleEntryCR()

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #57146 from kamoltat/wip-ksirivad-fix-connection-score-json

src/mon/ConnectionTracker.cc: Fix dump function
Reviewed-by Kamoltat Sirivadhna <ksirivad@redhat.com>

Merge pull request #58472 from YiteGu/reinforce-mon-scrub-db-get-error

mon/scrub: log error details of store access failures
Reviewed-by Kamoltat Sirivadhna <ksirivad@redhat.com>

Merge pull request #59609 from cbodley/wip-rgw-dir-suggest-reshard

rgw/rados: guard against dir suggest during reshard

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>

Merge pull request #59441 from ceph/wip-oozmen-67656-integration-test

test/rgw/notifications: integration test for the procedure of migrating an existing v2 topic to an account

Reviewed-by: Yuval Lifshitz <ylifshit@ibm.com>

Merge pull request #59244 from cbodley/wip-rgw-notification-token-waiter

rgw/notify: process_queue() constructs wait tokens when spawning

Reviewed-by: Yuval Lifshitz <ylifshit@ibm.com>

Merge pull request #59981 from guits/fix_68231

node-proxy: fix a regression when processing the RedFish API

Merge pull request #59946 from rhcs-dashboard/rbd-snapshot

mgr/dashboard: Forbid snapshot name "." and any containing "/".

Reviewed-by: Afreen Misbah <afreen23.git@gmail.com>

Merge pull request #59986 from nbalacha/wip-nbalacha-doc-typo

doc: fix typo

Reviewed-by: Zac Dover <zac.dover@proton.me>

Merge pull request #59846 from rhcs-dashboard/usermanagment-roles

mgr/dashboard: carbonize user management-role form

Reviewed-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: nmunet <NOT@FOUND>

Merge pull request #59194 from rhcs-dashboard/add-ssl-prometheus-federate

mgr/dashboard: Add ssl prometheus federate

Reviewed-by: Redouane Kachach <rkachach@ibm.com>

doc: fix typo

Fixed a typo in the jaeger traces documentation.

Signed-off-by: N Balachandran <nibalach@redhat.com>

Merge pull request #58719 from rhcs-dashboard/add-progress-multisite-automation

mgr/dashboard: Add progress step to multisite automation wizard

Reviewed-by: afreen23 <NOT@FOUND>
Reviewed-by: Ankush Behl <cloudbehl@gmail.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>

Merge PR #56776 into main

* refs/pull/56776/head:
client: fix d_reclen for readdir

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge PR #59467 into main

* refs/pull/59467/head:
qa: correct daemon for warning conf
qa: print config dump after setting

Reviewed-by: Adam King <adking@redhat.com>

Merge PR #59504 into main

* refs/pull/59504/head:
mds: dump next_snap when checking dentry corruption

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge PR #59810 into main

* refs/pull/59810/head:
client: remove hypertable

Reviewed-by: Greg Farnum <gfarnum@redhat.com>

doc/_ext: accomodate three active releases in the Ceph timeline

Avoid this error:
```
/home/jenkins-build/build/workspace/ceph-pr-docs/doc/releases/index.rst:64: ERROR: Error in "ceph_timeline" directive:
maximum 3 argument(s) allowed, 4 supplied.
```

Signed-off-by: Laura Flores <lflores@ibm.com>

mds: do not duplicate journaler write heads

The MDS can unnecessarily write out the journaler head multiple times. Check
the last_written Header to see if it's necessary to write and gather waiters.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>

mds: use Journaler getters

To access the Journaler::Header safely.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>

osdc: properly acquire locks for getters

This was left as a TODO. : /

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>

osdc: add print method for Journaler::Header

For dout prints.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>

mds: do not trim segments after open file table commit

Previously, the trimming of expired segments would only occur if the open file
table's committed sequence number is past the segment to be trimmed. This is
now part of the expiry checks so it's no longer necessary to restart trimming
when the open file table commit completes.

Furthermore, this was confusing to `flush journal` as it was waiting for the
journal head write but the open file table commit already triggered the trim.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>

mds: delay expiry if LogSegment is ahead of committed oft seq

And remove the misplaced conditional in ::trim_expiring_segments.

This is necessary as the `flush journal` command gets confused by missing a
wait_for_expiry on a LogSegment that is not actually expired.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>

mds: do not write journal head twice on trim

Add context to wait for MDLog::trim_expired_segments to write the journal head.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>

mds: simplify and explain expiry finisher ctx

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>

mds: add mds_lock asserts for journal flush

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>

mds: skip second wait_for_safe

Now that we only trim up to the segment created for the flush, this second wait
should no longer be necessary.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>

mds: trim only to the LogSegment created for flush

This neatly avoids a situation where the MDS trims past the segment created for
the `flush journal` command.

Here's what it looks like:

    2024-07-30T20:15:51.679+0000 7f70a809a640  1 mds.d asok_command: flush journal {prefix=flush journal} (starting...)
    2024-07-30T20:15:51.679+0000 7f70a809a640 10 mds.1.26 handle_asok_command: flush journal
    2024-07-30T20:15:51.679+0000 7f70a809a640 20 mds.1.26 send
    2024-07-30T20:15:51.679+0000 7f70a809a640 20 mds.1.26 flush_mdlog
    2024-07-30T20:15:51.679+0000 7f70a809a640 10 mds.1.cache create_subtree_map 106 subtrees, 105 fullauth
    ...
    2024-07-30T20:15:51.680+0000 7f70a809a640 20 mds.1.log _submit_entry ESubtreeMap 105 subtrees , 0 ambiguous [metablob 0x101, 107 dirs]
    2024-07-30T20:15:51.680+0000 7f70a809a640 20 mds.1.log _start_new_segment: seq = 522843 starting new segment LogSegment(522843/0xffffffffffffffff events=0)
    ...
    2024-07-30T20:15:51.686+0000 7f709e887640 20 mds.1.26 handle_clear_mdlog: r=0
    2024-07-30T20:15:51.686+0000 7f709e887640  5 mds.1.26 trim_mdlog: beginning segment expiry
    2024-07-30T20:15:51.686+0000 7f709e887640 10 mds.1.log trim_to: 522843 23/0/0
    ...
    2024-07-30T20:15:51.858+0000 7f709e887640 20 mds.1.26 expire_segments
    2024-07-30T20:15:51.858+0000 7f709e887640  5 mds.1.26 expire_segments: waiting for 22 segments to expire
    ...
    2024-07-30T20:15:52.386+0000 7f70a008a640 20 mds.1.26 handle_expire_segments: r=0
    2024-07-30T20:15:52.386+0000 7f70a008a640 20 mds.1.26 trim_segments
    2024-07-30T20:15:52.386+0000 7f709e887640  5 mds.1.26 trim_expired_segments: expiry complete, expire_pos/trim_pos is now 22f4c774/22c00000
    2024-07-30T20:15:52.386+0000 7f709e887640 20 mds.1.log _trim_expired_segments: examining LogSegment(503314/0x22f4c774 events=649)
    2024-07-30T20:15:52.386+0000 7f709e887640 10 mds.1.log _trim_expired_segments: maybe expiring LogSegment(503314/0x22f4c774 events=649)
    2024-07-30T20:15:52.386+0000 7f709e887640 20 mds.1.log _trim_expired_segments: examining LogSegment(503963/0x230019e6 events=1024)
    2024-07-30T20:15:52.386+0000 7f709e887640 10 mds.1.log _trim_expired_segments: maybe expiring LogSegment(503963/0x230019e6 events=1024)
    2024-07-30T20:15:52.386+0000 7f709e887640 20 mds.1.log _trim_expired_segments: examining LogSegment(504987/0x23119d93 events=1024)
    2024-07-30T20:15:52.386+0000 7f709e887640 10 mds.1.log _trim_expired_segments: maybe expiring LogSegment(504987/0x23119d93 events=1024)
    2024-07-30T20:15:52.386+0000 7f709e887640 20 mds.1.log _trim_expired_segments: examining LogSegment(506011/0x23234d24 events=1024)
    2024-07-30T20:15:52.386+0000 7f709e887640 10 mds.1.log _trim_expired_segments: maybe expiring LogSegment(506011/0x23234d24 events=1024)
    2024-07-30T20:15:52.386+0000 7f709e887640 20 mds.1.log _trim_expired_segments: examining LogSegment(507035/0x23392678 events=397)
    2024-07-30T20:15:52.386+0000 7f709e887640 10 mds.1.log _trim_expired_segments: maybe expiring LogSegment(507035/0x23392678 events=397)
    2024-07-30T20:15:52.386+0000 7f709e887640 20 mds.1.log _trim_expired_segments: examining LogSegment(507432/0x23400db4 events=1024)
    2024-07-30T20:15:52.386+0000 7f709e887640 10 mds.1.log _trim_expired_segments: maybe expiring LogSegment(507432/0x23400db4 events=1024)
    2024-07-30T20:15:52.386+0000 7f709e887640 20 mds.1.log _trim_expired_segments: examining LogSegment(508456/0x2351c0af events=1024)
    2024-07-30T20:15:52.386+0000 7f709e887640 10 mds.1.log _trim_expired_segments: maybe expiring LogSegment(508456/0x2351c0af events=1024)
    2024-07-30T20:15:52.386+0000 7f709e887640 20 mds.1.log _trim_expired_segments: examining LogSegment(509480/0x23639df0 events=1024)
    2024-07-30T20:15:52.386+0000 7f709e887640 10 mds.1.log _trim_expired_segments: maybe expiring LogSegment(509480/0x23639df0 events=1024)
    2024-07-30T20:15:52.386+0000 7f709e887640 20 mds.1.log _trim_expired_segments: examining LogSegment(510504/0x2375912d events=607)
    2024-07-30T20:15:52.386+0000 7f709e887640 10 mds.1.log _trim_expired_segments: maybe expiring LogSegment(510504/0x2375912d events=607)
    2024-07-30T20:15:52.386+0000 7f709e887640 20 mds.1.log _trim_expired_segments: examining LogSegment(511111/0x2380290f events=1024)
    2024-07-30T20:15:52.386+0000 7f709e887640 10 mds.1.log _trim_expired_segments: maybe expiring LogSegment(511111/0x2380290f events=1024)
    2024-07-30T20:15:52.386+0000 7f709e887640 20 mds.1.log _trim_expired_segments: examining LogSegment(512135/0x2391b7f3 events=1024)
    2024-07-30T20:15:52.386+0000 7f709e887640 10 mds.1.log _trim_expired_segments: maybe expiring LogSegment(512135/0x2391b7f3 events=1024)
    2024-07-30T20:15:52.386+0000 7f709e887640 20 mds.1.log _trim_expired_segments: examining LogSegment(513159/0x23a6a15f events=1024)
    2024-07-30T20:15:52.386+0000 7f709e887640 10 mds.1.log _trim_expired_segments: maybe expiring LogSegment(513159/0x23a6a15f events=1024)
    2024-07-30T20:15:52.386+0000 7f709e887640 20 mds.1.log _trim_expired_segments: examining LogSegment(514183/0x23b855e7 events=442)
    2024-07-30T20:15:52.386+0000 7f709e887640 10 mds.1.log _trim_expired_segments: maybe expiring LogSegment(514183/0x23b855e7 events=442)
    2024-07-30T20:15:52.386+0000 7f709e887640 20 mds.1.log _trim_expired_segments: examining LogSegment(514625/0x23c01325 events=979)
    2024-07-30T20:15:52.386+0000 7f709e887640 10 mds.1.log _trim_expired_segments: maybe expiring LogSegment(514625/0x23c01325 events=979)
    2024-07-30T20:15:52.386+0000 7f709e887640 20 mds.1.log _trim_expired_segments: examining LogSegment(515604/0x23d0e086 events=1024)
    2024-07-30T20:15:52.386+0000 7f709e887640 10 mds.1.log _trim_expired_segments: expiring up to this major segment seq=515604
    2024-07-30T20:15:52.386+0000 7f709e887640 20 mds.1.log _trim_expired_segments: expiring LogSegment(503314/0x22f4c774 events=649)
    2024-07-30T20:15:52.386+0000 7f709e887640 20 mds.1.log _trim_expired_segments: expiring LogSegment(503963/0x230019e6 events=1024)
    2024-07-30T20:15:52.386+0000 7f709e887640 20 mds.1.log _trim_expired_segments: expiring LogSegment(504987/0x23119d93 events=1024)
    2024-07-30T20:15:52.386+0000 7f709e887640 20 mds.1.log _trim_expired_segments: expiring LogSegment(506011/0x23234d24 events=1024)
    2024-07-30T20:15:52.386+0000 7f709e887640 20 mds.1.log _trim_expired_segments: expiring LogSegment(507035/0x23392678 events=397)
    2024-07-30T20:15:52.386+0000 7f709e887640 20 mds.1.log _trim_expired_segments: expiring LogSegment(507432/0x23400db4 events=1024)
    2024-07-30T20:15:52.386+0000 7f709e887640 20 mds.1.log _trim_expired_segments: expiring LogSegment(508456/0x2351c0af events=1024)
    2024-07-30T20:15:52.386+0000 7f709e887640 20 mds.1.log _trim_expired_segments: expiring LogSegment(509480/0x23639df0 events=1024)
    2024-07-30T20:15:52.386+0000 7f709e887640 20 mds.1.log _trim_expired_segments: expiring LogSegment(510504/0x2375912d events=607)
    2024-07-30T20:15:52.386+0000 7f709e887640 20 mds.1.log _trim_expired_segments: expiring LogSegment(511111/0x2380290f events=1024)
    2024-07-30T20:15:52.386+0000 7f709e887640 20 mds.1.log _trim_expired_segments: expiring LogSegment(512135/0x2391b7f3 events=1024)
    2024-07-30T20:15:52.386+0000 7f709e887640 20 mds.1.log _trim_expired_segments: expiring LogSegment(513159/0x23a6a15f events=1024)
    2024-07-30T20:15:52.386+0000 7f709e887640 20 mds.1.log _trim_expired_segments: expiring LogSegment(514183/0x23b855e7 events=442)
    2024-07-30T20:15:52.386+0000 7f709e887640 20 mds.1.log _trim_expired_segments: expiring LogSegment(514625/0x23c01325 events=979)
    2024-07-30T20:15:52.386+0000 7f709e887640 10 mds.1.log _trim_expired_segments: maybe expiring LogSegment(515604/0x23d0e086 events=1024)
    2024-07-30T20:15:52.386+0000 7f709e887640 20 mds.1.log _trim_expired_segments: examining LogSegment(516628/0x23e2a879 events=1024)
    2024-07-30T20:15:52.386+0000 7f709e887640 10 mds.1.log _trim_expired_segments: maybe expiring LogSegment(516628/0x23e2a879 events=1024)
    2024-07-30T20:15:52.386+0000 7f709e887640 20 mds.1.log _trim_expired_segments: examining LogSegment(517652/0x23f47dbf events=665)
    2024-07-30T20:15:52.386+0000 7f709e887640 10 mds.1.log _trim_expired_segments: maybe expiring LogSegment(517652/0x23f47dbf events=665)
    2024-07-30T20:15:52.386+0000 7f709e887640 20 mds.1.log _trim_expired_segments: examining LogSegment(518317/0x240007be events=1024)
    2024-07-30T20:15:52.386+0000 7f709e887640 10 mds.1.log _trim_expired_segments: maybe expiring LogSegment(518317/0x240007be events=1024)
    2024-07-30T20:15:52.386+0000 7f709e887640 20 mds.1.log _trim_expired_segments: examining LogSegment(519341/0x2411af83 events=1024)
    2024-07-30T20:15:52.386+0000 7f709e887640 10 mds.1.log _trim_expired_segments: maybe expiring LogSegment(519341/0x2411af83 events=1024)
    2024-07-30T20:15:52.386+0000 7f709e887640 20 mds.1.log _trim_expired_segments: examining LogSegment(520365/0x24234a83 events=1024)
    2024-07-30T20:15:52.386+0000 7f709e887640 10 mds.1.log _trim_expired_segments: maybe expiring LogSegment(520365/0x24234a83 events=1024)
    2024-07-30T20:15:52.386+0000 7f709e887640 20 mds.1.log _trim_expired_segments: examining LogSegment(521389/0x24344292 events=691)
    2024-07-30T20:15:52.386+0000 7f709e887640 10 mds.1.log _trim_expired_segments: maybe expiring LogSegment(521389/0x24344292 events=691)
    2024-07-30T20:15:52.386+0000 7f709e887640 20 mds.1.log _trim_expired_segments: examining LogSegment(522080/0x24400e24 events=763)
    2024-07-30T20:15:52.386+0000 7f709e887640 10 mds.1.log _trim_expired_segments: maybe expiring LogSegment(522080/0x24400e24 events=763)
    2024-07-30T20:15:52.386+0000 7f709e887640 20 mds.1.log _trim_expired_segments: examining LogSegment(522843/0x244c4fda events=1)
    2024-07-30T20:15:52.386+0000 7f709e887640 10 mds.1.log _trim_expired_segments: expiring up to this major segment seq=522843
    2024-07-30T20:15:52.386+0000 7f709e887640 20 mds.1.log _trim_expired_segments: expiring LogSegment(515604/0x23d0e086 events=1024)
    2024-07-30T20:15:52.386+0000 7f709e887640 20 mds.1.log _trim_expired_segments: expiring LogSegment(516628/0x23e2a879 events=1024)
    2024-07-30T20:15:52.386+0000 7f709e887640 20 mds.1.log _trim_expired_segments: expiring LogSegment(517652/0x23f47dbf events=665)
    2024-07-30T20:15:52.386+0000 7f709e887640 20 mds.1.log _trim_expired_segments: expiring LogSegment(518317/0x240007be events=1024)
    2024-07-30T20:15:52.386+0000 7f709e887640 20 mds.1.log _trim_expired_segments: expiring LogSegment(519341/0x2411af83 events=1024)
    2024-07-30T20:15:52.386+0000 7f709e887640 20 mds.1.log _trim_expired_segments: expiring LogSegment(520365/0x24234a83 events=1024)
    2024-07-30T20:15:52.386+0000 7f709e887640 20 mds.1.log _trim_expired_segments: expiring LogSegment(521389/0x24344292 events=691)
    2024-07-30T20:15:52.386+0000 7f709e887640 20 mds.1.log _trim_expired_segments: expiring LogSegment(522080/0x24400e24 events=763)
    2024-07-30T20:15:52.386+0000 7f709e887640 10 mds.1.log _trim_expired_segments waiting for expiry LogSegment(522843/0x244c4fda events=1)
    2024-07-30T20:15:52.386+0000 7f709e887640  1 -- [v2:127.0.0.1:6872/1197350146,v1:127.0.0.1:6873/1197350146] --> [v2:127.0.0.1:6850/2027314847,v1:127.0.0.1:6851/2027314847] -- osd_op(unknown.0.26:131573 2.7 2:ea85266a:::201.00000000:head [writefull 0~90 [fadvise_dontneed] in=90b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e76) -- 0x555daee1ac00 con 0x555da2bc7180
    2024-07-30T20:15:52.386+0000 7f709e887640  5 mds.1.26 trim_expired_segments: trim complete, expire_pos/trim_pos is now 244c4fda/22c00000
    2024-07-30T20:15:52.386+0000 7f709e887640 20 mds.1.26 write_journal_head

Related-to: https://tracker.ceph.com/issues/59119
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>

mds: allow passing explicit seq to trim to

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>

mds: quiet unhelpful debug message

looks like

    2024-08-15T06:08:36.056+0000 7f29379f4640 10 mds.0.journal try_to_expire waiting for purge of []

Nothing to purge!

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>

mds: add C_IO_Wrapper completion debugging

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>

mds: add dout for new segment

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>

doc/releases: add fixes

Signed-off-by: Laura Flores <lflores@ibm.com>

mgr/dashboard: Forbid snapshot name "." and any containing "/".

Fixes: https://tracker.ceph.com/issues/68198
Signed-off-by: Dnyaneshwari Talwekar <dtalweka@redhat.com>

Merge pull request #59959 from idryomov/wip-librbd-supports-group-snap-get-info-define

librbd: add LIBRBD_SUPPORTS_GROUP_SNAP_GET_INFO define

Reviewed-by: N Balachandran <nibalach@redhat.com>

Merge pull request #59958 from adk3798/drop-py37-mgr-tox

pybind/mgr: drop py37 test from  tox.ini

Reviewed-by: John Mulligan <jmulligan@redhat.com>

node-proxy: fix a regression when processing the RedFish API

ce360a4a5f6 introduced a regression.

`Endpoint()` doesn't take a `EndpointMgr` object as parameter.
The call `e = Endpoint(self, _url, self.client)` obviously throws the
following error:

```
TypeError: __init__() takes 3 positional arguments but 4 were given
```

This commit fixes it.

Fixes: https://tracker.ceph.com/issues/68231
Signed-off-by: Guillaume Abrioux <gabrioux@ibm.com>

Merge pull request #57809 from kchheda3/wip-dont-print-passwords

rgw/notification: add logic to prevent logging password associated with topics

Reviewed-by: Yuval Lifshitz <ylifshit@ibm.com>

mgr/dashboard: adjust federate ssl code with mTLS

Signed-off-by: Aashish Sharma <aasharma@redhat.com>

rgw/rados: RGWRados::delete_objs_inline() uses AioThrottle

use concurrent deletes to speed up inline garbage collection

Fixes: https://tracker.ceph.com/issues/68134
Signed-off-by: Casey Bodley <cbodley@redhat.com>

cls/rgw: cls_rgw_obj_chain uses vector instead of list

Signed-off-by: Casey Bodley <cbodley@redhat.com>

earmarking: improve error handling when getxattr fails

Signed-off-by: Avan Thakkar <athakkar@redhat.com>

mgr/nfs: earmark resolver for subvolume

Signed-off-by: Avan Thakkar <athakkar@redhat.com>

Merge pull request #58952 from YiteGu/add-perfcounter-for-blk-discard

blk/kerneldevice: add perfcounter for block async discard

Reviewed-by: Igor Fedotov <igor.fedotov@croit.io>

mgr/dashboard: Add progress bar to rgw multisite automation wizard

Fixes: https://tracker.ceph.com/issues/67829
Fixes: https://tracker.ceph.com/issues/67830
Signed-off-by: Aashish Sharma <aasharma@redhat.com>

Merge pull request #59918 from rhcs-dashboard/fix-68176-main

mgr/dashboard: fix setting compression type while editing rgw zone

Reviewed-by: Nizamudeen A <nia@redhat.com>

Merge pull request #59925 from baum/NvmeofServiceSpec-service_id

pybind/mgr/orchestrator/module.py: NvmeofServiceSpec service_id

Merge pull request #59850 from aclamk/wip-aclamk-fix-67911-bdev-multi-label

os/bluestore: Fix BlueFS allocating bdev label reserved location.

Merge pull request #58509 from sseshasa/wip-hdd-osd-shard-params-for-mclock

common/options: Change HDD OSD shard configuration defaults for mClock

Reviewed-by: Mark Nelson <mark.a.nelson@gmail.com>
Reviewed-by: Ronen Friedman <rfriedma@redhat.com>

Merge pull request #59742 from guits/wip-guits-cv-cbt-zap-device

ceph-volume: add call to `ceph-bluestore-tool zap-device`

mgr/dashboard: carbonize user management-role form

Fixes: https://tracker.ceph.com/issues/68123
Signed-off-by: Puja Shahu <pshahu@redhat.com>
Signed-off-by: pujashahu <pujashahu@li-37e364cc-2d5a-11b2-a85c-fd7027b8f826.ibm.com>

Merge pull request #59944 from ronen-fr/wip-rf-standalone-query

qa/standalone/scrub: increase status updates frequency

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

Merge pull request #59762 from aclamk/wip-aclamk-cbt-combined

ceph-bluestore-tool: Fixes for multilple bdev label

Merge pull request #59820 from rhcs-dashboard/rgw-multisite-sync-policy-improvements

mgr/dashboard: multisite sync policy improvements

Reviewed-by: afreen23 <NOT@FOUND>
Reviewed-by: Nizamudeen A <nia@redhat.com>

librbd: add LIBRBD_SUPPORTS_GROUP_SNAP_GET_INFO define

Make it easier to test if rbd_group_snap_get_info() and by extension
also rbd_group_snap_list2() APIs are available at compile time.  This
wasn't done in commit e5ccce14c4b0 ("rbd: add group snap info command")
because backporting wasn't intended.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>

doc/releases: add Squid target release date

Add the target release date to doc/releases/releases.yml.

Signed-off-by: Zac Dover <zac.dover@proton.me>
Signed-off-by: Laura Flores <lflores@ibm.com>

Merge pull request #59387 from avanthakkar/earmark-smb

mgr/smb: earmark resolver for subvolume

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: John Mulligan <jmulligan@redhat.com>

pybind/mgr: drop py37 test from  tox.ini

Prior to this patch if you ran `tox` in src/pybind/mgr
it would include a test that runs the units tests using
python 3.7. These no longer pass and there is no longer
any reason to support python 3.7 on main.

Signed-off-by: Adam King <adking@redhat.com>

mgr/dashboard: multisite sync policy improvements

https://tracker.ceph.com/issues/68097

Changes for this PR includes:
1) Populating the destination zones select option with a set of options to choose from, for flow and pipe so that user can't enter any invalid zone name
2) Provided zone option as 'All Zones (*)' in pipe, if user want to select all zones for source and destination zones
3) We are hiding the UniqueId column on sync policy table as we do not want to show it as this column is introduced just to uniquely identify a row in the table and should not be displayed to users as it is part of the internal logic to work.

Signed-off-by: Naman Munet <nmunet@redhat.com>

Merge pull request #59891 from rhcs-dashboard/fix-68162-main

mgr/dashboard: fix handling NaN values in dashboard charts

Reviewed-by: Nizamudeen A <nia@redhat.com>

Merge pull request #59890 from rhcs-dashboard/fix-68161-main

mgr/dashboard: update period after migrating to multi-site

Reviewed-by: Nizamudeen A <nia@redhat.com>

mgr/dashboard: fix setting compression type while editing rgw zone

Fixes: https://tracker.ceph.com/issues/68176
Signed-off-by: Aashish Sharma <aasharma@redhat.com>

doc: update doc for subvolumes earmarking mentioning valid formats

Signed-off-by: Avan Thakkar <athakkar@redhat.com>