fixup! crimson/os/seastore/cache: add facilities to synchronize data and states between rewriting trasactions and others when committing

fixup! crimson/os/seastore/cache: add facilities to synchronize data and states between rewriting trasactions and others when committing

fixup! crimson/os/seastore/cache: add facilities to synchronize data and states between rewriting trasactions and others when committing

fixup! crimson/os/seastore/cache: rewrite transactions don't invalidate other transactions anymore

fixup! crimson/os/seastore/cache: add facilities to synchronize data and states between rewriting trasactions and others when committing

fixup! crimson/os/seastore/extent_pinboard: reset 2q_state when removing extents

fixup! crimson/os/seastore/cache: add facilities to synchronize data and states between rewriting trasactions and others when committing

crimson/os/seastore/extent_pinboard: reset 2q_state when removing
extents

Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>

fixup! crimson/os/seastore/cache: add facilities to synchronize data and states between rewriting trasactions and others when committing

fixup! crimson/os/seastore/cache: rewrite transactions don't invalidate other transactions anymore

fixup! crimson/os/seastore/btree_types: BtreeCursors don't hold local copies of lba/backref values

fixup! crimson/os/seastore/btree_types: BtreeCursors don't hold local copies of lba/backref values

crimson/os/seastore/transaction_manager: block client transactions if
they conflict with rewriting transactions until the rewriting
transactions finishes

Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>

crimson/os/seastore/cached_extent: treat extents under rewrite io as
stable too

Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>

crimson/os/seastore: disable linked tree node operations when committing
rewriting transactions

Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>

crimson/os/seastore/cache: rewrite transactions don't invalidate other
transactions anymore

Fixes: https://tracker.ceph.com/issues/73070
Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>

crimson/os/seastore/cache: drop unused last_commit

Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>

crimson/os/seastore/cache: since extent committer will also set
CachedExtent::prior_poffset, remove invalid asserts

Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>

crimson/os/seastore/cache: unlink mutated extents from the stable
extents' transaction views when committing or invalidating the
transaction

Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>

crimson/os/seastore/cache: add facilities to synchronize data and states
between rewriting trasactions and others when committing

Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>

crimson/os/seastore/seastore_types: define rewriting transactions

These are the transactions that only rewrite extents and mutation lba
nodes, e.g. TRIM_DIRTY and CLEANER transactions

Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>

crimson/os/seastore/async_cleaner: renew backref cursors when they are
generated by backref retrieval transactions and used by reclaim
transactions

Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>

crimson/os/seastore/lba_manager: make sure alloc_extents return viewable
mappings

Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>

crimson/os/seastore/async_cleaner: avoid its header dependence on
backref_manager.h

Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>

crimson/os/seastore/btree_types: BtreeCursors don't hold local copies of
lba/backref values

Since lba mapping values might change during the executions of
client transactions once we allow background transactions to be
submitted without invalidating client ones, we want to avoid other
components using lba/backref mappings from keep local copies to prevent
petential problem

Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>

crimson/os/seastore/lba_mapping: don't allow classes above
TransactionManager to retrieve lba mappings' paddrs.

Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>

Merge pull request #66340 from imran-imtiaz/dashboard

mgr/dashboard: add GET API endpoint for consistency groups

Merge pull request #66333 from shraddhaag/wip-shraddhaag-increase-reactors

qa/clusters/crimson: increase reactors count

Merge pull request #66336 from Matan-B/wip-matanb-crimson-snapmapper-osddriver

osd/SnapMapper: fix Crimson logs

Reviewed-by: Aishwarya Mathuria <amathuri@redhat.com>

Merge pull request #66332 from rhcs-dashboard/73854-CephFS-Authorize-modal-Update-issues

mgr/dashboard : fix - CephFS Authorize Modal Update issue

Reviewed-by: Dnyaneshwari Talwekar dtalweka@redhat.com

Merge pull request #66382 from bluikko/doc-mgmt-gateway-improvements-cephadm

doc/cephadm: Fix command plus improvements in services/mgmt-gateway.rst

Merge pull request #66006 from afreen23/carbonize-chnage-password

mgr/dashboard: Carbonize the Change Password Form

Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Dnyaneshwari Talwekar dtalweka@redhat.com

Merge pull request #66326 from afreen23/fixes-mixins

monitoring: Fixes for development

Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Anthony D Atri <anthony.datri@gmail.com>

mgr/dashboard : fix - CephFS Authorize Modal Update issue
fixes : https://tracker.ceph.com/issues/73854
Signed-off-by: Devika Babrekar <devika.babrekar@ibm.com>

doc/cephadm: Fix command plus improvements in service/mgmt-gateway.rst

Remove double backticks from a CLI command.

Use bash prompt consistently for CLI command blocks.

Don't capitalize word in middle of sentence.

Talk about "admin" instead of "user", similarly to the last text
paragraph in the doc.

Signed-off-by: Ville Ojamo <14869000+bluikko@users.noreply.github.com>

qa/clusters/crimson: increase reactors count

This commit increases the number of reactors in fixed-1 and
fixed-2 crimson clusters.

Signed-off-by: Shraddha Agrawal <shraddhaag@ibm.com>

mgr/dashboard: Carbonize the Change Password Form

Fixes https://tracker.ceph.com/issues/73193

-  using carbon based stylings, typography and components
-  used grid layout for form arrangement
-  breadcrumb is slightly off, which needs to be fixed by applying grid layout to the app shell

Signed-off-by: Afreen Misbah <afreen@ibm.com>

Merge pull request #66372 from tchaikov/wip-qa-encoder-exclude

qa/suites/rados/encoder: exclude ceph-osd-classic when installing LTS…

Reviewed-by: Matan Breizman <mbreizma@ibm.com>

qa/suites/rados/encoder: exclude ceph-osd-* when installing LTS releases

In a37b5b5, the ceph-osd-classic and ceph-osd-crimson packages were
added to qa/packages/packages.yaml. The "install" task uses this file as
the default package list for all branches, including LTS releases like
Reef.

However, a37b5b5 only exists in the main branch and won't be backported
to LTS branches. This causes installation failures in the rados/encoder
test suite, which verifies forward compatibility by installing LTS
releases and testing whether they can decode the latest corpus.

Exclude ceph-osd-classic and ceph-osd-crimson from LTS installations to
ensure the test suite can successfully install ceph-dencoder, which is
required for the interoperability tests.

Fixes: https://tracker.ceph.com/issues/73957
Signed-off-by: Kefu Chai <k.chai@proxmox.com>

Merge pull request #66293 from anthonyeleven/instore.dbnoonecanhearyouscream

doc: Improve start/hardware-recommendations.rst

Merge pull request #65995 from pcuzner/rocksdb_compaction_metric

rados/osd: enable compact_running perfcounter at PRIO=5

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Neha Ojha <nojha@ibm.com>

doc: Improve start/hardware-recommendations.rst

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>

mgr/dashboard: add GET API endpoint for consistency groups

Signed-off-by: Imran Imtiaz <imran.imtiaz@uk.ibm.com>
Fixes: https://tracker.ceph.com/issues/73942
Add a consistency group dashboard API endpoint to get the list of images
in the consistency groups that match the namespace of the group.

osd/SnapMapper: fix Crimson logs

Switch to crimson's debugging macro and fix the faulty
subsystem defined of ceph_subsys_

Might help with https://tracker.ceph.com/issues/73790

Signed-off-by: Matan Breizman <mbreizma@redhat.com>

Merge pull request #55638 from clwluvw/cmake-boost

cmake: skip boost dependency on ALIAS executable targets

Merge pull request #66228 from imran-imtiaz/dashboard

mgr/dashboard: add API endpoint to add images to consistency groups

Reviewed-by: Nizamudeen A <nia@redhat.com>

Merge pull request #65915 from edwinzrodriguez/ceph-zstd-update

zstd: Update zstd to 1.5.6 for cmake 4 compatability

cmake: skip boost dependency on ALIAS executable targets

The current add_executable override in Boost does not support alias
targets. Although Ceph currently has no alias targets that are
affected by this limitation, addressing this issue now will benefit
future developments and personal projects.
This change enhances the robustness of the override logic, ensuring
compatibility with alias targets moving forward.

Signed-off-by: Seena Fallah <seenafallah@gmail.com>

monitoring: Fixes for development

- fixes tox.ini using and undefined env - `grafonnet-check`( instead of `jsonnet-check`)
- adds steps for local development of mixins and building jsonnet
- added help command in Makefile
- added comments and descriptions for Makefile and tox.ini

Signed-off-by: Afreen Misbah <afreen@ibm.com>

Merge pull request #66268 from Matan-B/wip-matanb-old-clients-installs

qa/suites/thrash-old-clients/1-install: exclude ceph-osd-classic

Reviewed-by: Radosław Zarzyński <rzarzyns@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>

mgr/dashboard: add API endpoint to add images to consistency groups

Signed-off-by: Imran Imtiaz <imran.imtiaz@uk.ibm.com>
Fixes: https://tracker.ceph.com/issues/73840
Create a consistency group dashboard API endpoint that enables adding
RBD images to the group.

Merge pull request #62765 from bobham-bloomberg/unittest-ceph-assert

test/ceph_assert.cc: Disable core files

Merge pull request #66307 from shraddhaag/wip-shraddhaag-fix-slow-ops

qa/clusters/crimson: increase reactors in fixed-1 cluster

Reviewed-by: Matan Breizman <mbreizma@ibm.com>

Merge pull request #65971 from ceph/wip-20.2.0-documentation

doc: add Tentacle v20.2.0 release notes

Merge pull request #65374 from dang/wip-dang-standalone

RGW - Standalone - Enable building without librados

doc/releases: add cephadm notes

Signed-off-by: Laura Flores <lflores@ibm.com>

doc/releases: change final release date

Signed-off-by: Laura Flores <lflores@ibm.com>

doc/releases/tentacle: add missing rgw deprecation notice

Signed-off-by: Casey Bodley <cbodley@redhat.com>

doc/releases/tentacle: fix Crimson highlight

Signed-off-by: Matan Breizman <mbreizma@redhat.com>

doc/releases/tentacle: add Crimson highlight

Signed-off-by: Matan Breizman <mbreizma@redhat.com>

doc/releases: arrange sections in alphabetical order

Signed-off-by: Laura Flores <lflores@ibm.com>

doc/releases/tentacle.rst: more RBD items

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>

doc/releases/tentacle.rst: fix seastore typo

Signed-off-by: Matan Breizman <mbreizma@redhat.com>

doc/releases: remove extra word

Signed-off-by: Laura Flores <lflores@ibm.com>

doc/releases/tentacle.rst: Update Crimson section

Refer to Tentacle Crimson updates blog post

Signed-off-by: Matan Breizman <mbreizma@redhat.com>

doc/releases: remove note that is not specific to tentacle

Signed-off-by: Laura Flores <lflores@ibm.com>

doc/releases: move smb support update into highlights

Signed-off-by: Laura Flores <lflores@ibm.com>

doc/releases: give smb update a better category title

Signed-off-by: Laura Flores <lflores@ibm.com>

doc/releases: add Crimson section and clean up references

Signed-off-by: Laura Flores <lflores@ibm.com>

doc/releases: edit formatting and other small changes

Formatting with double backticks, indentation etc.

Fix some typos and add missing hyphenation.

Add review comment suggestions by anthonyeleven after OOB discussion.

Signed-off-by: Ville Ojamo <14869000+bluikko@users.noreply.github.com>

doc/releases: add one more item to RADOS

Signed-off-by: Laura Flores <lflores@ibm.com>

doc/releases: add to CephFS section

And a bit of RGW

Signed-off-by: Laura Flores <lflores@ibm.com>

doc/releases: add more to RBD section

Signed-off-by: Laura Flores <lflores@ibm.com>

doc/releases: clean up RGW formatting

Signed-off-by: Laura Flores <lflores@ibm.com>

doc/releases: take quincy out of timeline since it is EOL

Signed-off-by: Laura Flores <lflores@ibm.com>

doc/releases: add more to mgr section and fix rados formatting

Signed-off-by: Laura Flores <lflores@ibm.com>

doc: improve rados section for tentacle release notes

Signed-off-by: Laura Flores <lflores@ibm.com>

doc/tentacle: add more RGW release notes

Signed-off-by: Casey Bodley <cbodley@redhat.com>

doc: add Tentacle v20.2.0 release notes

Signed-off-by: Laura Flores <lflores@ibm.com>

qa/clusters/crimson: increase reactors in fixed-1 cluster

Issue: Various different tests were failing randomly due to slow
ops. There was no common ground between them, it was happening
across differnet object stores (seastore and bluestore) and
across different tests.

Cause: Since this is happening quite randomly, this is likely
happening due to low reactor count.

Solution: We are opting the solution to increase reactors used
for testing. I've increased them to 3 from the initial 2 value.

Fixes: https://tracker.ceph.com/issues/72778
Signed-off-by: Shraddha Agrawal <shraddha.agrawal000@gmail.com>

Merge pull request #66207 from steliaio/fix-rados-fsid-return-doc

include/rados/librados.h: fix documented rados_cluster_fsid return value

Reviewed-by: Casey Bodley <cbodley@redhat.com>

test/ceph_assert.cc: Disable core files

Without this, core files are produced which subsequently cause
failures in other tests, specifically smoke.sh and safe-to-destroy.sh.

Fixes: bfa83df6d33ee2238f1389ca4518592b5c4fb267
Signed-off-by: Bob Ham <bham12@bloomberg.net>
test/ceph_assert.cc: Update line numbers

Signed-off-by: Bob Ham <bham12@bloomberg.net>

Merge pull request #66105 from rhcs-dashboard/carbonize-sync-policy-form

mgr/dashboard: Carbonize multisite sync policy forms

Reviewed-by: Pedro Gonzalez Gomez <pegonzal@ibm.com>

qa/suites: exclude ceph-osd-classic

a37b5b5bde8c2e8d6890f16b31046119ed55f25d added ceph-osd-classic
package.
old-clients and upgrade tests should not try to install the new package
as it is not available in older releases.

Fixes: https://tracker.ceph.com/issues/73848
Signed-off-by: Matan Breizman <mbreizma@redhat.com>

Merge pull request #65999 from anoopcs9/smb-disable-posix-locking

mgr/smb: Disable posix locking in share definition

Reviewed-by: Adam King <adking@redhat.com>

Merge pull request #65931 from anoopcs9/update-smbd-ports-config

smb: Update the configuration logic for smbd ports

Reviewed-by: Adam King <adking@redhat.com>

Merge pull request #66179 from rhcs-dashboard/73766-remove-subalerts-detail

mgr/dashboard : Remove subalerts details for multiple subalerts

Reviewed-by: Afreen Misbah <afreen@ibm.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Ankush Behl <cloudbehl@gmail.com>

mgr/dashboard: Carbonize multisite sync policy forms

Fixes: https://tracker.ceph.com/issues/73164
Signed-off-by: Naman Munet <naman.munet@ibm.com>

Merge pull request #66149 from amathuria/wip-amat-update-seastar-nov25

seastar: bump up seastar submodule

Reviewed-by: Matan Breizman <mbreizma@redhat.com>

mgr/smb: Disable posix locking in share definition

The prerequisites for supporting durable handles[1] in Samba include
disabling the mapping of POSIX locks, as well as setting the `kernel
oplocks` and `kernel sharemodes` parameters to disabled. Currently
this configuration is hard‑coded, but in the future it could be made
conditional and combined with other settings to enable persistent
handles on continuously available shares.

[1] https://www.samba.org/samba/docs/current/man-html/smb.conf.5.html#DURABLEHANDLES

Signed-off-by: Anoop C S <anoopcs@cryptolab.net>

Merge pull request #65962 from NitzanMordhai/wip-nitzan-MOSDOpReply-pgid64-encode-decode-fix

messages: MOSDOpReply encode and decode errorcode32_t with PGID64 fea…

Merge pull request #66218 from imran-imtiaz/dashboard

mgr/dashboard: add API endpoint to create consistency groups

Reviewed-by: Nizamudeen A <nia@redhat.com>