mgr/dashboard: fix-add-node-issue

Fixes:https://tracker.ceph.com/issues/75500

Signed-off-by: Sagar Gopale <sagar.gopale@ibm.com>

Merge pull request #64975 from liu-chunmei/shard_osd_final

osd shard changes upon restart

Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #65912 from MattyWilliams22/wip-dont-delete-objects

test: Add option to not delete created objects

Merge pull request #67734 from rhcs-dashboard/fix-namespace-size

mgr/dashboard: Namespace size should accept GiB in NVMe/TCP

Reviewed-by: Puja Shahu <pshahu@redhat.com>
Reviewed-by: Afreen Misbah <afreen@ibm.com>

Merge pull request #67782 from rkachach/fix_issue_75492

mgr/nvmeof: Adding missing CLICommand field to nvmeof mgr module

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: John Mulligan <jmulligan@redhat.com>
Reviewed-by: Adam King <adking@redhat.com>

Merge pull request #66580 from kamoltat/wip-ksirivad-fix-72994

mon [stretch-mode]: Allow a max bucket weight diff threshold
Reviewed-by: Ronen Friedman <rfriedma@ibm.com>

Merge PR #67780 into main

* refs/pull/67780/head:
Revert "Merge PR #67630 into main"

Reviewed-by: Shraddha Agrawal <shraddhaag@ibm.com>

mgr/nvmeof: Adding missing CLICommand file to nvmeof mgr module

Fixes: https://tracker.ceph.com/issues/75492
Signed-off-by: Redouane Kachach <rkachach@ibm.com>

Revert "Merge PR #67630 into main"

This reverts commit 3a5e4524aa56de4c26400ccf994baa6ba8e16d9e, reversing
changes made to d334ff531c563bb7d0e37777f606322ec91b7453.

To everyone's surprise, skipping a workflow does not make it less
required. Well done Github!

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #67275 from ifed01/wip-ifed-fix-bluefs-expand-test

qa/standalone: fix/improve bluefs tests

Reviewed-by: Adam Kupczyk <akupczyk@ibm.com>

Merge pull request #67609 from ifed01/wip-ifed-bluefs-stats-reset

os/bluestore: add 'bluefs stats reset' admin socket command.

Reviewed-by: Adam Kupczyk <akupczyk@ibm.com>

Merge pull request #67770 from bluikko/wip-doc-cephadm-spelling

doc/cephadm: Fix spelling errors

Merge pull request #67718 from rhcs-dashboard/fix-subsystem-create-layout-issue

mgr/dashboard: Footer actions shift upward instead of staying pinned at modal bottom in NVMe/TCP subsystem create wizard

Reviewed-by: Afreen Misbah <afreen@ibm.com>
Reviewed-by: Devika Babrekar <devika.babrekar@ibm.com>

doc/cephadm: Fix spelling errors

Signed-off-by: Ville Ojamo <git2233+ceph@ojamo.eu>

Merge pull request #65405 from rhcs-dashboard/notification-store-events

mgr/dashboard: Add restore events in notification screen

Reviewed-by: Afreen Misbah <afreen@ibm.com>
Reviewed-by: Dnyaneshwari Talwekar <dtalweka@redhat.com>

Merge pull request #67760 from gbregman/main

mgr/dashboard: Add secure and verify-host-name to "listener add" on NVMeoF CLI

Merge pull request #67647 from rhcs-dashboard/fix-75317-main

mgr/dashboard: update onboarding screen as per design

Reviewed-by: Afreen Misbah <afreen@ibm.com>

Merge pull request #67713 from rhcs-dashboard/fix-nvmeof-initiator-add-visibility

mgr/dashboard: Initiator add shows success but host is not added/displayed in Subsystem Initiators table

Reviewed-by: Afreen Misbah <afreen@ibm.com>
Reviewed-by: pujaoshahu <pshahu@redhat.com>

mgr/dashboard: rename expand-cluster to add-storage

Signed-off-by: Aashish Sharma <aasharma@redhat.com>

mgr/dashboard: update onboarding screen as per design

Fixes: https://tracker.ceph.com/issues/75317
Signed-off-by: Aashish Sharma <aasharma@redhat.com>

qa/suites/crimson-rados: add fio test case for osd shard number changes upon restart for 3 osd

Signed-off-by: Chunmei Liu <chunmei.liu@ibm.com>

doc/dev/seastore.rst: add design implementation for osd shards change

Signed-off-by: chunmei liu <chunmei.liu@ibm.com>

crimson/common/options: add seastore_require_partition_count_match_reactor_count in crimson.yaml.in

Signed-off-by: chunmei liu <chunmei.liu@ibm.com>

crimson/osd/osd_admin: add osd command to dump store shards info

Signed-off-by: chunmei liu <chunmei.liu@ibm.com>

crimson/os/seastore: support other devices

Signed-off-by: Chunmei Liu <chunmei.liu@ibm.com>

test/crimson/seastore: using store_index = 0 for the tests

Signed-off-by: Chunmei Liu <chunmei.liu@ibm.com>

crimson/tools: fixing tools according to osd shards number change modification

Signed-off-by: Chunmei Liu <chunmei.liu@ibm.com>

crimson/os/seastore: make register_metrics works for
 multiple store shards on one reactor

Signed-off-by: chunmei liu <chunmei.liu@ibm.com>

crimson/osd: replace store call by with_store call in case need remote store calling.

Signed-off-by: chunmei liu <chunmei.liu@ibm.com>

crimson/osd/shard_services: get multiple store shards for per local state, and use store index to create pg mapping

Signed-off-by: chunmei liu <chunmei.liu@ibm.com>

crimson/osd/pg_map: add pg mapping policy for osd shards number is different with store shards number

Signed-off-by: chunmei liu <chunmei.liu@ibm.com>

crimson/os/futurized_store: support cross core store calling

Signed-off-by: chunmei liu <chunmei.liu@ibm.com>

crimson/os/alienstore: support multiple store shards on each reactor

Signed-off-by: Chunmei Liu <chunmei.liu@ibm.com>

crimson/os/cyanstore: create multiple store shards on each reactor

note: src/stop.sh should wait enought time before kill the crimson-osd
in case cyanstore can't write meta data to disk.

Signed-off-by: chunmei liu <chunmei.liu@ibm.com>

crimson/os/seastore: create multiple device shards and store shards on each reactor.

Signed-off-by: Chunmei Liu <chunmei.liu@ibm.com>

Merge pull request #67396 from Rotemrs/lua-background-vm-fix

rgw/lua: create fresh VM for each background script execution

mgr/dashboard: Add secure and verify-host-name to "listener add" on NVMeoF CLI.
Also add missing "manual" field in "listener list".

Fixes: https://tracker.ceph.com/issues/75447
Signed-off-by: Gil Bregman <gbregman@il.ibm.com>

Merge pull request #67638 from nbalacha/wip-nbalacha-75306

rgw/lua: fix a crash when D4N is enabled

Merge pull request #67660 from kshtsk/wip-keystone-2025.2

qa/tasks/keystone: upgrade keystone to 2025.2

Merge pull request #67712 from afreen23/landing-page-fixes

mgr/dashboard: Fix scrubbing state

Reviewed-by: Devika Babrekar <devika.babrekar@ibm.com>

Merge pull request #67714 from afreen23/overview-breaking

mgr/dashboard: Fix breaking overview page

Reviewed-by: Devika Babrekar <devika.babrekar@ibm.com>

Merge pull request #66245 from athanatos/wip-sjust-seastore-conflict

crimson/seatore: rework lba_manager to use LBACursor rather than LBAMapping

Reviewed-by: Matan Breizman <mbreizma@redhat.com>
Reviewed-by: Xuehan Xu <xuxuehan@qianxin.com>

Merge pull request #67739 from dang/wip-dang-posix-readme

Update the POSIXDriver readme to current state

doc: Update the POSIXDriver readme to current state

Signed-off-by: Daniel Gryniewicz <dang@redhat.com>

Merge pull request #67451 from Ericmzhang/wip-mon-colocate

mon: Health warning for colocated monitors

Merge pull request #67641 from Hezko/revive-nvme-module

introduce nvme module again

Merge pull request #65626 from samarahu/wip-d4n-remove-bucket

rgw/d4n: Implement bucket check_empty and remove methods

Reviewed-by: Pritha Srivastava <prsrivas@redhat.com>

qa: Add "auto_pool_create" to nvmeof_initiator

While deploying gateways with "ceph orch apply nvmeof",
--pool can be optional now. If not passed, a pool with
name ".nvmeof" would automatically be created.

In nvmeof task, "auto_pool_create: True" would skip --pool
in "ceph orch apply nvmeof".

Signed-off-by: Vallari Agrawal <vallari.agrawal@ibm.com>

mgr/nvmeof: add missing CLICommand to the module

Fixed AttributeError: type object 'NVMeoF' has no attribute 'CLICommand'

Signed-off-by: Avan Thakkar <athakkar@redhat.com>

Merge pull request #67659 from kamoltat/wip-ksirivad-fix-70320

qa: make test_progress atomically capture OSD marked in/out events
Reviewed-by: Shraddha Agrawal <shraddha.agrawal000@gmail.com>

Merge pull request #67736 from gbregman/main

mgr/dashboard: Remove the clear-alerts parameter from NVMeoF CLI

Merge pull request #67431 from adk3798/cephadm-test-iscsi-ignorelist-pg-degraded

qa/rbd/iscsi/cluster: ignore PG_DEGRADED warning

Reviewed-by: Redouane Kachach <rkachach@redhat.com>

Merge pull request #67428 from adk3798/test-cephadm-timeout-ignore-timeout

qa/cephadm: ignore CEPHADM_HOST_TIMEOUT_ERROR in timeout test

Reviewed-by: Redouane Kachach <rkachach@redhat.com>

Merge pull request #67393 from adk3798/cephadm-grafana-sample-fixup

cephadm/samples: don't specify localhost as grafana addr

Reviewed-by: John Mulligan <jmulligan@redhat.com>

mgr/dashboard: Remove the clear-alerts parameter from NVMeoF CLI

Fixes: https://tracker.ceph.com/issues/74969
Signed-off-by: Gil Bregman <gbregman@il.ibm.com>

mgr/dashboard: Initiator add shows success but host is not added/displayed in Subsystem Initiators table

Fixes: https://tracker.ceph.com/issues/75402
Signed-off-by: Sagar Gopale <sagar.gopale@ibm.com>

mgr/dashboard: Footer actions shift upward instead of staying pinned at modal bottom in NVMe/TCP subsystem create wizard

Fixes: https://tracker.ceph.com/issues/75409
Signed-off-by: Sagar Gopale <sagar.gopale@ibm.com>

mgr/dashboard: Add restore events in notification screen

Fixes: https://tracker.ceph.com/issues/72887
Signed-off-by: pujashahu <pshahu@redhat.com>
Signed-off-by: pujaoshahu <pshahu@redhat.com>

mgr/nvmeof: add nvmeof module introduction to pending release notes

Fixes: https://tracker.ceph.com/issues/74702
Signed-off-by: Tomer Haskalovitch <tomer.haska@ibm.com>
(cherry picked from commit 166fb04c1251bc2df6aa68cbd4e303005f8f08e7)

mgr/nvmeof: add unittests

Fixes: https://tracker.ceph.com/issues/74702
Signed-off-by: Tomer Haskalovitch <tomer.haska@ibm.com>
(cherry picked from commit eecbff76fa6401edaf2abbee9d86e08162f752eb)

mgr/nvmeof: use nvmeof module during orch nvmeof apply

Added a call to create_pool_if_not_exists during the execution of ceph orch apply nvmeof command.

Fixes: https://tracker.ceph.com/issues/74702
Signed-off-by: Tomer Haskalovitch <tomer.haska@ibm.com>
(cherry picked from commit f5734cf41b18add5e54efa13c4519359705dae57)

mgr/nvmeof: set nvmeof module to be enabled by default

Fixes: https://tracker.ceph.com/issues/74702
Signed-off-by: Tomer Haskalovitch <tomer.haska@ibm.com>
(cherry picked from commit eccffe57c5a0cf8a762351fe26e6f631108fb849)

mgr/nvmeof: intergrate module into build and debian pkg

Fixes: https://tracker.ceph.com/issues/74702
Signed-off-by: Tomer Haskalovitch <tomer.haska@ibm.com>
(cherry picked from commit 901ec98b4146b9e2f2d2b4ab257a2d1a5b903d9f)

mgr/nvmeof: introduce the new nvmeof module

Introduce a new NVMe-oF mgr module and which create the pool
used for storing NVMe-related metadata ceph orch nvmeof apply command.
This removes the need for users to manually create and configure the
metadata pool before using the NVMe-oF functionality, simplifying
setup and reducing the chance of misconfiguration.

Fixes: https://tracker.ceph.com/issues/74702
Signed-off-by: Tomer Haskalovitch <tomer.haska@ibm.com>
(cherry picked from commit 15fcbb5e3eac2153c51d16b96e32d86038eb0569)

rgw/lua: create fresh VM for each background script execution

Previously, the background thread reused the same Lua VM across
iterations, causing stale state to persist. This made operations
like 'pairs(RGW)' fail to iterate properly.

Now we create a fresh VM on each iteration, which:
- Fixes the iteration bug
- Simplifies the code (no need to update limits on existing VM)
- Ensures clean state for each script execution

Verified with unit tests:
- TableIterateBackground
- TableIterateBackgroundBreak
- TableIterateStepByStep

Fixes: https://tracker.ceph.com/issues/74839
Signed-off-by: Rotem Shapira <rotem.rs@gmail.com>

test/crimson/seastore/test_seastore: add clone removal test

Signed-off-by: Samuel Just <sjust@redhat.com>

test/crimson/.../test_object_data_handler: add multiple clone/overwrite test case

Signed-off-by: Samuel Just <sjust@redhat.com>

test/crimson/.../test_object_data_handler.cc: add support for clones

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../transaction_manager: add logging to remap_mappings

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../lba_manager: add formatter for remap_entry_t

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../object_data_handler: fix LOG_PREFIX for do_clone

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../lba_manager: convert remap_mappings to use cursors

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../lba_manager: convert reserve_region to use cursor

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../btree_lba_manager: simplify _update_mapping_ret, remove update_mapping_ret_bare_t

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../btree_lba_manager: convert _update_mapping to coroutine

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../btree_lba_manager: remove update_refcount, simplify _update_mapping return value

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../transaction_manager: convert remap_mappings to coroutine

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../btree_lba_manager: convert remap_mappings to coroutine

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../lba_manager: convert clone_mapping to use cursors

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../transaction_manager: convert clone_pin to coroutine

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../btree_lba_manager: convert clone_mapping to coroutine

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../btree_lba_manager: convert get_end_mapping to return LBACursorRef

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../btree_lba_manager: convert get_end_mapping to coroutine

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../transaction_manager: remove LBAMapping update_mapping variant

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../lba_manager: remove get_mapping interfaces

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../transaction_manager: convert get_pins to use get_cursors

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../transaction_manager: convert get_extents_if_live and helpers to use cursors

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../transaction_manager: convert get_extents_if_live to coroutine

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../lba_manager: convert alloc_extents_ret to use LBACursor

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../transaction_manager: convert alloc_data_extents to coroutine

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../btree_lba_manager: convert alloc_extents to coroutine

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../transaction_manager: convert rewrite_logical_extent to use get_cursor

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../lba_manager: switch alloc_extent_ret to LBACursorRef

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../btree_lba_manager: convert reserve_region to coroutine

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../transaction_manager: convert reserve_region to coroutine

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../btree_lba_manager: convert alloc_extent to coroutine

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../transaction_manager: convert rewrite_logical_extent to coroutine

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../transaction_manager: convert get_pin to use get_cursor

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../lba_manager: remove remove_mappings

Signed-off-by: Samuel Just <sjust@redhat.com>

crimson/.../transaction_manager: rework _remove in terms of LBACursor interfaces

Removes the need for _remove_direct_mapping and _remove_indirect_mapping.

Signed-off-by: Samuel Just <sjust@redhat.com>