Merge PR #64345 into wip-vshankar-testing-20250929.160013-debug

* refs/pull/64345/head:

Reviewed-by: Patrick Donnelly <pdonnell@ibm.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge PR #64709 into wip-vshankar-testing-20250929.160013-debug

* refs/pull/64709/head:

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>

Merge PR #65693 into wip-vshankar-testing-20250929.160013-debug

* refs/pull/65693/head:

Merge PR #59676 into main

* refs/pull/59676/head:

Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Kotresh Hiremath Ravishankar <khiremat@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge PR #65232 into main

* refs/pull/65232/head:

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Mark Nelson <mnelson@redhat.com>

Merge pull request #65410 from anthonyeleven/ec-overwrite

doc/rados/operations: Clarify overwrites in erasure-code.rst

Merge pull request #65501 from anthonyeleven/ceph-osd-df

doc: Enhance the ceph df and ceph osd commands

Merge PR #65483 into main

* refs/pull/65483/head:

Reviewed-by: Patrick Donnelly <pdonnell@ibm.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge PR #61173 into main

* refs/pull/61173/head:

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Milind Changire <mchangir@redhat.com>
Reviewed-by: Anthony D Atri <anthony.datri@gmail.com>

Merge pull request #64830 from AliMasarweh/wip-alimasa-conditional

RGW | fix conditional MultiWrite

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #65403 from MaxKellermann/Formatter__split

common/Formatter: move {JSON,Table,XML}Formatter to separate files

Reviewed-by: Adam Emerson <aemerson@redhat.com>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
Tested-by: anrao19

Merge pull request #64912 from cloudbehl/Cephadm-daemon-status-metric

prometheus: Add Cephadm orch ps output metric to prometheus

Reviewed-by: Afreen Misbah <afreen23.git@gmail.com>
Reviewed-by: Anmol Babu <anmolbudugutta@gmail.com>
Reviewed-by: Redouane Kachach <rkachach@ibm.com>

Merge pull request #64562 from adam-lj/ceph_test_rados_io_sequence_copy_from

test/osd: Extend ceph_test_rados_io_sequence to support copy operations

Merge pull request #65649 from nbalacha/wip-nbalacha-cleanup-2

rgw/bucket-logging: fix typos

Merge pull request #64467 from ceph/fix-mtu-alert

monitoring: fix MTU Mismatch alert rule and expr

Reviewed-by: Afreen Misbah <afreen@ibm.com>

Merge pull request #65669 from rhcs-dashboard/inline-edit-fixes

mgr/dashboard: fix duplicated editing of cell

Reviewed-by: Afreen Misbah <afreen@ibm.com>

monitoring: fix MTU Mismatch alert rule and expr

Fixes: https://tracker.ceph.com/issues/73290
Signed-off-by: Aashish Sharma <aasharma@redhat.com>

mgr/dashboard: fix duplicated editing of cell

form control is applied with unique identifier. In the table where the
issue is present, let's support adding the `unique_identifier`.

Fixes: https://tracker.ceph.com/issues/73250
Signed-off-by: Nizamudeen A <nia@redhat.com>

test/libcephfs: add test cases for Client::mksnap and Client::rmsnap

they exist as libceohfs APIs but aren't being called by FUSE/pybind clients,
make sure they work as intended.

Fixes: https://tracker.ceph.com/issues/71740
Signed-off-by: Dhairya Parmar <dparmar@redhat.com>

mgr/volumes: disable client_respect_subvolume_snapshot_visibility in CephfsConnectionPool::connect

To prevent any type of config change (via mons, args, envvar, tell command) on the ceph-mgr from breaking the volume plugin.

Fixes: https://tracker.ceph.com/issues/71740
Signed-off-by: Dhairya Parmar <dparmar@redhat.com>

doc/cephfs/fs-volumes: add documentation for controlling snapshot visibility

for subvolume based paths

Fixes: https://tracker.ceph.com/issues/71740
Signed-off-by: Dhairya Parmar <dparmar@redhat.com>

qa/tasks/cephfs: add test cases for subvolume config snapshot_visibility

Fixes: https://tracker.ceph.com/issues/71740
Signed-off-by: Dhairya Parmar <dparmar@redhat.com>

Merge pull request #65586 from dang/wip-dang-posix-cleanup

RGW - POSIXDriver - Cleanup vstart

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #65643 from dang/wip-dang-dedup

RGW - Fix dedup build

Reviewed by: Casey Bodley <cbodley@redhat.com>

Merge pull request #65593 from smanjara/wip-fix-period-pull

rgw/multisite: fix period pull command

Merge pull request #65631 from phlogistonjohn/jjm-fix-71992

mgr/smb: fix error handling for fundamental resource parsing

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Anoop C S <anoopcs@samba.org>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>

Merge pull request #65309 from joscollin/wip-72683-peer-add-deprecate

cephfs_mirror: deprecate peer_add command

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #65567 from rkachach/fix_issue_certs_migration

mgr/cephadm: cleaning up old migration logic and improving upgrade handling with certmgr

Reviewed-by: Adam King <adking@redhat.com>

Merge pull request #65599 from bachmanity1/cephadm-support-custom-distro

cephadm: support custom distros by falling back to `ID_LIKE`

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: John Mulligan <jmulligan@redhat.com>

Merge pull request #65469 from Kushal-deb/remove-unreachable-code-path

mgr/rgw: fix unreachable code path

Reviewed-by: Adam King <adking@redhat.com>

Merge pull request #64194 from ShwetaBhosale1/fix_issue_71707_allow_ingress_matrics_via_https

mgr/cephadm: Allow Ingress service to expose the metrics via HTTPS

Reviewed-by: Redouane Kachach <rkachach@redhat.com>

qa: ignore cluster warning (evicting unresponsive ...) with tasks/mgr-osd-full

fs/full/subvolume_ls.sh will restart ceph-mgr periodically and
that does not cleanup libcephfs handles.

Fixes: http://tracker.ceph.com/issues/73278
Signed-off-by: Venky Shankar <vshankar@redhat.com>

prometheus: Add Cephadm orch ps output metric to prometheus

Fixes: https://tracker.ceph.com/issues/72496
Signed-off-by: Ankush Behl <cloudbehl@gmail.com>

Merge pull request #65652 from rhcs-dashboard/storage-capacity-fix

mgr/dashboard: Blank entry for Storage Capacity in dashboard under Cluster > Expand Cluster > Review

Reviewed-by: Afreen Misbah <afreen@ibm.com>

doc: added a note for damaged hard links in scrub documentation

Fixes: https://tracker.ceph.com/issues/69345
Signed-off-by: Md Mahamudur Rahaman Sajib <mahamudur.sajib@croit.io>

qa: add a test to verify that a damage hard link id detected during scrub

Also update ignorelist with the expected cluster warning.

Fixes: https://tracker.ceph.com/issues/69345
Signed-off-by: Md Mahamudur Rahaman Sajib <mahamudur.sajib@croit.io>

mds: identify damaged hard links during scrub

For a remote link, try to open the dentry (this part of code
is copied from the mds path_traversal) which internally pushes
the dir_frag in the damage list if applicable.

Fixes: https://tracker.ceph.com/issues/69345
Signed-off-by: Md Mahamudur Rahaman Sajib <mahamudur.sajib@croit.io>

Merge pull request #65443 from dmick/pip-vcs

various: update pip+https URLs to new form.

mgr/cephadm: Fixed stats frontend to always enable health url

Fixes: https://tracker.ceph.com/issues/71707
Signed-off-by: Shweta Bhosale <Shweta.Bhosale1@ibm.com>

mgr/cephadm: Allow Ingress service to expose the metrics via HTTPS also add fields in spec to accept monitor ips/ monitor networks

Fixes: https://tracker.ceph.com/issues/71707
Signed-off-by: Shweta Bhosale <Shweta.Bhosale1@ibm.com>

mgr/cephadm: Adding genric cert/key name support for get certificates

Fixes: https://tracker.ceph.com/issues/71707
Signed-off-by: Shweta Bhosale <Shweta.Bhosale1@ibm.com>

pybind/mgr/volumes: add getter and setter APIs for snapdir_visibility

Fixes: https://tracker.ceph.com/issues/71740
Signed-off-by: Dhairya Parmar <dparmar@redhat.com>

client: check client config and snaprealm flag before snapdir lookup

this commit adds a new client config client_respect_subvolume_snapshot_visibility
which acts as knob to have a per-client control over the snapshot visibility and
checks it along with the snaprealm flag while looking up a subvolume inode.

Fixes: https://tracker.ceph.com/issues/71740
Signed-off-by: Dhairya Parmar <dparmar@redhat.com>

common,mds: transmit SNAPDIR_VISIBILITY flag via SnapRealmInfoNew

at the time of building snap trace

Fixes: https://tracker.ceph.com/issues/71740
Signed-off-by: Dhairya Parmar <dparmar@redhat.com>

RGW - Fix dedup build

Dedup is RadosStore specific, so move it to driver/rados, and only start
it if radosstore is being built.

Signed-off-by: Daniel Gryniewicz <dang@fprintf.net>

mds: rebuild snaprealm cache if last_modified or change_attr changed

For the server side snapdir visibility changes to be transported to the
client — SnapRealm cache needs to be rebuilt otherwise the same metadata
would be sent via the send_snap_update() in C_MDS_inode_update_finish() while
setting the `ceph.dir.subvolume.snaps.visible` vxattr.

The condition used to check for the `seq` and `last_destroyed` against their
cached values but for the vxattr change, it's a rather non-feasible
heavylifting to update the `seq` which involves a set of steps to prepare the
op, commit the op, journal the changes and update snap-server/client(s) just
for a mere flag update (and updating last_destroyed anyway doesn't make sense
for this case). So, compare last_modified and change_attr with their cached
values to check if the SnapRealm cache should be rebuilt. These values are
incremented in the Server::handle_client_setvxattr while toggling the
snapshot visibility xattr and this would enforce a cache rebuild.

Fixes: https://tracker.ceph.com/issues/71740
Signed-off-by: Dhairya Parmar <dparmar@redhat.com>

mds: add ceph.dir.subvolume.snaps.visible vxattr

using SNAPDIR_VISIBILITY flag added in sr_t

Fixes: https://tracker.ceph.com/issues/71740
Signed-off-by: Dhairya Parmar <dparmar@redhat.com>

mgr/cephadm: Remove Grafana self-signed certificate migration logic

Remove the code used to migrate Grafana self-signed certificates, as
it is no longer needed. The certmgr logic now handles generating new
certificates during the upgrade, eliminating the need for any migration
code or logic.

Signed-off-by: Redouane Kachach <rkachach@ibm.com>

mgr/cephadm: Remove SSL RGW migration logic

Remove the special-case code used for RGW service migration, as it is no
longer needed. The certmgr logic now handles populating the certstore
with the corresponding certificate and key entries by reading their values
directly from the spec. During RGW service redeployment as part of the
upgrade, certmgr will ensure the certstore is updated accordingly.

Signed-off-by: Redouane Kachach <rkachach@ibm.com>

mgr/cephadm: Fix RGW spec validation for deprecated rgw cert field

Starting from Tentacle, the rgw_frontend_ssl_certificate field has been
deprecated in favor of the new ssl_cert and ssl_key fields. Update the
validation logic to run after this field is automatically transformed into
the new fields, ensuring proper validation of RGW specs.

Signed-off-by: Redouane Kachach <rkachach@ibm.com>

mgr/cephadm: Include mgmt-gateway/oauth2-proxy in upgrade process

Add the new mgmt-gateway and oauth2-proxy services to the list of
services upgraded by cephadm, ensuring they are updated alongside the
rest of the cephadm-managed services.

Signed-off-by: Redouane Kachach <rkachach@ibm.com>

Merge pull request #65354 from sunyuechi/main

inline_memory: optimize mem_is_zero for riscv using RISC-V Vector (RVV) intrinsics

mgr/smb: fix error handling for fundamental resource parsing

When an smb resource is input to the smb mgr module in YAML or JSON the
fundamental parsing/deserialization is handled by resourcelib. This
module tries to be largely independent of smb mgr module and defines a
few basic exception types. When these exception types were raised the
`ceph` command line would print out a long traceback. Avoid printing
a traceback by catching these errors with a new contextmanager
(decorator) that is automatically called when using the smb ceph
mgr command api.

Fixes: https://tracker.ceph.com/issues/71992
Signed-off-by: John Mulligan <jmulligan@redhat.com>

Merge pull request #65551 from adk3798/cephadm-migration-logging

mgr/cephadm: fix migrations logging

Reviewed-by: Redouane Kachach <rkachach@ibm.com>

Implement further review feedback for CopyFrom changes to ceph_test_rados_io_sequence

Signed-off-by: Adam Lyon-Jones <adamlyon@uk.ibm.com>

Merge pull request #65424 from xxhdx1985126/wip-72902

crimson/os/seastore/transaction_manager: read_pin_by_type read the whole extent if it's not fully loaded

Reviewed-by: Matan Breizman <mbreizma@redhat.com>

Merge pull request #64755 from cloudbehl/grafana-rate-irate-fix

ceph-mixin: Update monitoring mixin

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: SuperQ <superq@gmail.com>

Merge pull request #65243 from myoungwon/wip-corouint-state-device

crimson/os/seastore/rbm: switch to coroutine in state_device

Reviewed-by: Matan Breizman <mbreizma@redhat.com>

Merge pull request #65503 from Hezko/nvmeof-cli-ns-add-nsid-param

mgr/dashboard: add nsid param to ns add command

Reviewed-by: Nizamudeen A <nia@redhat.com>

Merge pull request #65504 from Hezko/nvmeof-cli-fix-subsys-group-add

mgr/dashboard: --no-group-append default value to False, aligned with old cli

Reviewed-by: Nizamudeen A <nia@redhat.com>

Merge pull request #65646 from zmc/pr-checklist

.github/workflows/pr-checklist.yml: Update

Merge pull request #65396 from ceph/wip-uadk-main-fix

uadk: Build with ceph fork (for FORTIFY_SOURCE fix)

.github/workflows/pr-checklist.yml: Update

To pull in these changes:
https://github.com/ceph/ceph-pr-checklist-action/pull/5
https://github.com/ceph/ceph-pr-checklist-action/pull/6

Signed-off-by: Zack Cerza <zack@cerza.org>

Merge pull request #65634 from ljflores/wip-tracker-71182

qa: suppress OpenSSL valgrind leaks

Merge pull request #65268 from rhcs-dashboard/fix-multiple-user-deletion

mgr/dashboard: add multiple ceph users deletion

Reviewed-by: Afreen Misbah <afreen@ibm.com>

Merge pull request #65119 from rhcs-dashboard/72635-skip-secure-monitoring-stack

mgr/dashboard : Skip calls until secure_monitoring_stack is enabled

Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Redouane Kachach <rkachach@ibm.com>

Merge pull request #65600 from rhcs-dashboard/nfs-command

mgr/dashboard: FS - Attach Command showing undefined for MountData

Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Ankush Behl <cloudbehl@gmail.com>

Merge pull request #65561 from rhcs-dashboard/fix-72810-main

monitoring: fix "In" OSDs in Cluster-Advanced grafana panel. Also change units from decbytes to bytes wherever used in the panel

Merge pull request #65409 from rhcs-dashboard/pool-configuration-new

 mgr/dashboard: Handle pool creation in tiering local storage class creation

Reviewed-by: Pedro Gonzalez Gomez <pegonzal@ibm.com>

mgr/dashboard: Blank entry for Storage Capacity in dashboard under Cluster > Expand Cluster > Review

https://tracker.ceph.com/issues/73220

Signed-off-by: Naman Munet <naman.munet@ibm.com>

Merge pull request #65519 from Hezko/fix-force-param-in-ns-add-host

mgr/dashboard: fix None force param handling in ns add_host so it won't raise exceptions

Reviewed-by: Nizamudeen A <nia@redhat.com>

Merge pull request #65487 from rhcs-dashboard/72989-notification-form

mgr/dashboard: Form retains old data when switching from edit to create mode

Reviewed-by: Afreen Misbah <afreen@ibm.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>

rgw/bucket-logging: fix typos

Fixes typos in error messages.

Signed-off-by: N Balachandran <nithya.balachandran@ibm.com>

Merge pull request #65265 from UtkarshBhatthere/fix/cephfsmir/mgrclireq

pybind/mgr/mirroring: modifies the cli command type to read

Reviewed-by: Venky Shankar <vshankar@redhat.com>

qa: suppress OpenSSL valgrind leaks

These leaks started happening when OpenSSL v3.5.0
was released. We determined they are safe to suppress.

Fixes: https://tracker.ceph.com/issues/71182
Signed-off-by: Laura Flores <lflores@ibm.com>

Merge pull request #65576 from rhcs-dashboard/smb-bugfixes

mgr/dashboard: fix smb button and table column

Merge pull request #64933 from soumyakoduri/wip-skoduri-restore-progress

rgw/restore: Persistently store the restore state for cloud-s3 tier

Reviewed-by: Jiffin Tony Thottan <thottanjiffin@gmail.com>
Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>

Merge PR #65569 into main

* refs/pull/65569/head:
script/redmine-upkeep: do not try to update status if open subtasks exist

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>

Merge PR #65547 into main

* refs/pull/65547/head:
.github/workflows/redmine-upkeep: remove concurrency limit

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>

Merge PR #65555 into main

* refs/pull/65555/head:
script/redmine-upkeep: include each issue changed in summary
.github/workflows/redmine-upkeep: use smaller limit for testing push

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>

pybind/mgr/mirroring: modifies the cli command type to read

The command fs snapshot mirror ls is used to present state data to
client. This does not require Write semantics.

Signed-off-by: Utkarsh Bhatt <utkarsh.bhatt@canonical.com>

Merge pull request #65412 from rhcs-dashboard/fix-72893-main

mgr/progress: expose API from CLI

Merge pull request #65537 from rhcs-dashboard/total-capacity-fix

mgr/dashboard: fix total capacity value in dashboard

Merge pull request #64858 from rhcs-dashboard/edit-nfs-export

mgr/dashboard:[NFS] Missing Subvolume Groups and Subvolumes on Edit NFS Export.

Reviewed-by: Naman Munet <naman.munet@ibm.com>

Merge pull request #64559 from rhcs-dashboard/inline-table-edit

mgr/dashboard: support inline edit for datatable

Reviewed-by: Afreen Misbah <afreen@ibm.com>
Reviewed-by: Pedro Gonzalez Gomez <pegonzal@ibm.com>

Merge pull request #65441 from linuxbox2/wip-72915

rgw: fix policy enforcement for GetObjectAttributes

mgr/dashboard: Local storage class creation via dashboard doesn't handle creation of pool.

Fixes: https://tracker.ceph.com/issues/72569
Signed-off-by: Dnyaneshwari <dtalweka@redhat.com>
mgr/dashboard: handle creation of new pool

Commit includes:
1) Provide link to create a new pool
2) Refactored validation on ACL mapping, removed required validator as default
3) fixed runtime error on console due to ACL length due to which the details section was not opening
4) Used rxjs operators to make API calls and making form ready once all data is available, fixing the form patch issues
5) Refactored some part of code to improve the performance
6) Added zone and pool information in details section for local storage class

Fixes: https://tracker.ceph.com/issues/72569
Signed-off-by: Naman Munet <naman.munet@ibm.com>

Merge pull request #65633 from adk3798/cephadm-pin-cheroot

pybind/mgr: pin cheroot version in requirements-required.txt

Reviewed-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
Reviewed-by: John Mulligan <jmulligan@redhat.com>

Merge pull request #65198 from xxhdx1985126/wip-72701

crimson/os/seastore/cache: clear extents_index when the booting is done

Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #65234 from xxhdx1985126/wip-72706

crimson/osd/recovery_backend: interrupt all recovery_waiter unconditionally when cleaning up the recovery backend

Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #65283 from xxhdx1985126/wip-72763

crimson/osd/osd_operations/client_request: rely on the checks in PG::do_recover_missing() to determine whether to recover clone objects

Reviewed-by: Matan Breizman <mbreizma@redhat.com>

Merge pull request #65317 from xxhdx1985126/wip-72790

crimson/osd/pg_backend: tolerate enoent for both head and clone when doing rollback

Reviewed-by: Matan Breizman <mbreizma@redhat.com>

Merge pull request #65353 from xxhdx1985126/wip-72844

crimson/osd/pg: tolerate NULL PG::pglog_based_recovery_op when cancelling pglog based recovery

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Matan Breizman <mbreizma@redhat.com>

Merge pull request #65197 from myoungwon/wip-fix-allocator-alloc-handling

crimson/os/seastore/rbm: handle no-space case properly

Reviewed-by: Samuel Just <sjust@redhat.com>

pybind/mgr: pin cheroot version in requirements-required.txt

With python 3.10 (didn't seem to happen with python 3.12) the
pybind/mgr/cephadm/tests/test_node_proxy.py test times out.
This appears to be related to a new release of the cheroot
package and a github issues describing the same problem
we're seeing has been opened by another user
https://github.com/cherrypy/cheroot/issues/769

It is worth noting that the workaround described in that
issue does also work for us. If you add

```
import cheroot
cheroot.server.HTTPServer._serve_unservicable = lambda: None
```

after the existing imports in test_node_proxy.py the
test hanging issue also disappears. Also worth noting the
particular pin of

cheroot~=10.0

was chosen as it matches the existing pin being used
in pybind/mgr/dashboard/constraints.txt

Signed-off-by: Adam King <adking@redhat.com>

Merge pull request #65204 from ifed01/wip-ifed-fix-ec-contiguous

erasure-code: make bufferlist contiguous in ErasureCode::encode_prepare

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Alex Ainscow <aainscow@uk.ibm.com>

rgw/restore: Fixing teuthology restore tests

This includes
* fixing `rgw_cloudtier.py` qa script
* enabling `debug_rgw_restore` for cloud-transition suite
* adding few debug statements

Signed-off-by: Soumya Koduri <skoduri@redhat.com>

rgw/restore: Mark the restore entry status as `None` first time

While adding the restore entry to the FIFO, mark its status as `None`
so that restore thread knows that the entry is being processed for
the first time. Incase the restore is still in progress and the entry
needs to be re-added to the queue, its status then will be marked
`InProgress`.

Signed-off-by: Soumya Koduri <skoduri@redhat.com>

qa/rgw: Include rgw_restore_processor_period in s3tests

Signed-off-by: Soumya Koduri <skoduri@redhat.com>

rgw/restore: Persistently store the restore state for cloud-s3 tier

In order to resume IN_PROGRESS restore operations post RGW service
restarts, store the entries of the objects being restored from `cloud-s3`
tier persistently. This is already being done for `cloud-s3-glacier`
tier and now the same will be applied to `cloud-s3` tier too.

With this change, when `restore-object` is performed on any object,
it will be marked RESTORE_ALREADY_IN_PROGRESS and added to a restore FIFO queue.
This queue is later processed by Restore worker thread which will try to
fetch the objects from Cloud or Glacier/Tape S3 services. Hence all the
restore operations are now handled asynchronously (for both `cloud-s3`,
`cloud-s3-glacier` tiers).

Signed-off-by: Soumya Koduri <skoduri@redhat.com>