test: add test to validate attrs for snapdir after snap operations

Fixes: http://tracker.ceph.com/issues/54501
Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit f1f6da1cad28b39f92899a4e08ed6c7366308482)

client: update {m,c}time and change attr for snapdir from last modification time of a snap realm

For MDS that do not encode the "new" SnapReamInfo strucutre, fallback to
using SnapRealmInfo.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit af4739bdc256a098eaf214fd4ef9d0cf59232a2f)

mds: update last modification time and change attr for a snap realm node

Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit cdf4ae4ef23e83e58af045d686b653cd1de9eafd)

mds: include last modification time and change attr of a snap realm node in snap trace reply

To handle older clients, introduce a cephfs feature bit. The MDS encodes a "new"
SNapRealmInfo structure for clients supporting this feature (which includes the
last modification timestamp and a version/change_attr for the snap realm). For
clients not advertising this feature, the MDS uses the existing SnapRealmInfo
structure for snapshot traces.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit 7a4c509f7289ff4b400eb8cae462f882de3cab3b)

mds: use change_attr from closest ancestor when initializing a new snaprealm

Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit f3c0d3bd8c7ab768af15e947deb56f1ddb230cbc)

mds: initialize last_modified to current timestamp for root inode snaprealm

Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit 77f7b21718933c23788d26cc824b8e6205b5bb55)

mds: track last modification time and change attr for a snap realm node (srnode)

Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit a119f2324669cd203f5598e937bc8fa62df587dc)

Merge pull request #55800 from zdover23/wip-doc-2024-02-28-backport-55782-to-quincy

quincy: doc/rados: add "change public network" procedure

doc/rados: add "change public network" procedure

Add a procedure to /doc/rados/operations/add-or-rm-mons.rst that
explains how to change the public_network in a Ceph cluster deployed
with cephadm. This procedure was developed by Eugen Block, and can be
seen in its original form here:
https://heiterbiswolkig.blogs.nde.ag/2024/02/22/cephadm-change-public-network/

Co-authored-by: Eugen Block <eblock@nde.ag>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 0b6739a4aa2dd931d97b8af9b3a352969f8767c2)

Merge pull request #55755 from zdover23/wip-doc-2024-02-26-backport-55683-to-quincy

quincy: doc/man/8/mount.ceph.rst: add more mount options

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>

doc/man/8/mount.ceph.rst: add more mount options

Fixes: https://tracker.ceph.com/issues/62837
Signed-off-by: Xiubo Li <xiubli@redhat.com>
(cherry picked from commit d5639cc670d248da7c84e6f2eaf73ce40bd93db4)

Merge pull request #55750 from zdover23/wip-doc-2024-02-26-backport-55739-to-quincy

quincy: doc/glossary: Add "OMAP" to glossary

doc/glossary: Add "OMAP" to glossary

Add an entry for "OMAP" to the glossary. This commit represents only the
first improvement to the documentation of OMAP in the Ceph docs suite.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 1d8baa1d4c3583f4a8dc0f46d81f198a3d027e4d)

Merge pull request #55738 from zdover23/wip-doc-2024-02-25-backport-55731-to-quincy

quincy: doc/dev: fix spelling in crimson.rst

doc/dev: fix spelling in crimson.rst

Repair a confusing sentence in doc/dev/crimson.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit dfdb5e124a19e0c5ce1e7ba47e574e0504e7091f)

Merge pull request #55649 from zdover23/wip-doc-2024-02-20-backport-55637-to-quincy

quincy: doc/cephfs: edit add-remove-mds

Reviewed-by: Cole Mitchell <cole.mitchell.ceph@gmail.com>

Merge pull request #55681 from zdover23/wip-doc-2024-02-21-backport-55670-to-quincy

quincy: doc/rados: fix broken links

Merge pull request #55679 from zdover23/wip-doc-2024-02-21-backport-55677-to-quincy

quincy: doc/rados/configuration/osd-config-ref: fix typo

doc/rados: fix broken links

Fix broken links in doc/rados/operations/add-or-rm-mons.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 2e2519367099461415248353d7c7725c0567511d)

doc/rados/configuration/osd-config-ref: fix typo

Signed-off-by: Pierre Riteau <pierre@stackhpc.com>
(cherry picked from commit d25b6b9dd2cee81d33f2ad2f0718c6ccdeadbe2b)

Merge pull request #55672 from zdover23/wip-doc-2024-02-21-backport-55667-to-quincy

quincy: doc/radosgw: edit multisite.rst

doc/radosgw: edit multisite.rst

Edit "Varieties of Multi-Site Configuration" in
doc/radosgw/multisite.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 8af910f877d1c7b873c2a13cec5d4ea1a4de4a79)

doc/cephfs: edit add-remove-mds

Disambiguate a note in doc/cephfs/add-remove-mds.rst to help readers
distinguish between cases in which they might want to use an automated
tool such as cephadm to deploy MDSes and cases in which they might want
to manually deploy MDSes.

See: https://github.com/ceph/ceph/pull/45639

Tracker: https://tracker.ceph.com/issues/54551

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 39ad6264aa1c97b04974e04046033887325ed2b2)

Merge pull request #55636 from zdover23/wip-doc-2024-02-19-backport-55633-to-quincy

quincy: doc/man: edit "manipulating the omap key"

doc/man: edit "manipulating the omap key"

Edit the section "Manipulating the Object Map Key" in
doc/man/8/ceph-objectstore-tool.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 44ec668d43951c2710271fb3ca1799c4c4ded940)

Merge pull request #55631 from zdover23/wip-doc-2024-02-18-backport-55626-to-quincy

quincy: doc/rados: add PG definition

doc/rados: add PG definition

Add a definition of Placement Groups to
doc/rados/operations/placement-groups.rst.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 39c809b33fe27064277292b721639cbb144fac6a)

Merge pull request #55614 from zdover23/wip-doc-2024-02-16-backport-55539-to-quincy

quincy: doc/glossary: improve OSD definitions

Merge pull request #55612 from zdover23/wip-doc-2024-02-16-backport-55585-to-quincy

quincy: doc/rados: add link to pg blog post

doc/glossary: improve OSD definitions

Remove expletive construction from three OSD-id-related terms.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit dec3d3730712bbc0994f5cbd1989761d64f93019)

doc/rados: add link to pg blog post

Add a link in the "Placement Groups" section that links to Sage Weil's
April 5, 2019 blog post "New in Nautilus: PG merging and autotuning".

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 9344893e0857be8c6ae134f6d4d5e9057e2cb99e)

Merge pull request #55604 from zdover23/wip-doc-2024-02-16-backport-55566-to-quincy

quincy: doc/cephadm: correct nfs config pool name

Merge pull request #55558 from zdover23/wip-doc-2024-02-13-backport-55546-to-quincy

quincy: doc/glossary: Add link to CRUSH paper

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc/cephadm: correct nfs config pool name

s/nfs-ganesha/.nfs/ in doc/cephadm/services/nfs, in accordance with
information given to me by John Mulligan over Slack.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 574421aeec3bdd502c64e87102846e5181b18415)

Merge pull request #55520 from zdover23/wip-doc-2024-02-10-ceph-exporter-quincy-cephadm-guidance

quincy: doc/cephadm: add note about ceph-exporter (Quincy)

Reviewed-by: Adam King <adking@redhat.com>

doc/glossary: Add link to CRUSH paper

Add a link in the CRUSH definition to the original CRUSH paper.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit aa1e6352d0c2c77c299a16f93e16e83903fb9d54)

doc/cephadm: add note about ceph-exporter (Quincy)

Explain how to deal with the error message "Non-zero exit code 22" when
using cephadm to install a Ceph cluster.

Co-authored-by: Nizamudeen A <nia@redhat.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>

Merge pull request #55526 from zdover23/wip-doc-2024-02-11-quincy-radosgw-52299-revert

quincy: doc/radosgw: Revert "doc/rgw/lua: add info uploading a ...

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: Yuval Lifshitz <ylifshit@redhat.com>

doc/radosgw: Revert "doc/rgw/lua: add info uploading a ...

script in cephadm deployment"

This reverts commit b0c78748c05faed9c6032f490169741ad7fd6cf7.

See https://github.com/ceph/ceph/pull/55524#issuecomment-1937022350.
See https://tracker.ceph.com/issues/64327

Signed-off-by: Zac Dover <zac.dover@proton.me>

Merge pull request #55518 from zdover23/wip-doc-2024-02-10-ceph-exporter-quincy-removal

doc/mgr: remove ceph-exporter (Quincy)

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #55512 from zdover23/wip-doc-2024-02-09-backport-55465-to-quincy

quincy: doc: add description of metric fields for cephfs-top

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #55506 from zdover23/wip-doc-2024-02-09-backport-55490-to-quincy

quincy: doc:start.rst fix typo in hw-recs

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc/mgr: remove ceph-exporter (Quincy)

Remove mention of ceph-exporter in the Quincy branch. ceph-exporter was
in one release of Quincy, but was later removed because it was broken.
This PR is made in response to Eugen Block's having brought this matter
to my attention.

Signed-off-by: Zac Dover <zac.dover@proton.me>

doc: add description of metric fields for cephfs-top

Fixes: https://tracker.ceph.com/issues/63991
Signed-off-by: Neeraj Pratap Singh <neesingh@redhat.com>
(cherry picked from commit 956f644f86c0790c17976b98df112747d66837df)

doc:start.rst fix typo in hw-recs

s/power less/power loss/

Signed-off-by: Eduardo Roldan <trazor@gmail.com>
(cherry picked from commit b80c12d080275e3c221a1e305c345fbc1caa3c8e)

Merge pull request #53779 from rhcs-dashboard/wip-63068-quincy

quincy: mgr/dashboard: allow tls 1.2 with a config option

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: hasonhai <NOT@FOUND>

Merge pull request #55485 from zdover23/wip-doc-2024-02-08-backport-55475-to-quincy

quincy: doc/radosgw: add confval directives

doc/radosgw: add confval directives

Add confval directives to the documentation of "quota cache" options.
This addresses a request made by Antony D'Atri in https://github.com/ceph/ceph/pull/55075/files#r1444006246.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 6504732e1b5b34756a119bc1547d22c07bd6458a)

Merge pull request #55483 from zdover23/wip-doc-2024-02-08-backport-55476-to-quincy

quincy: doc/cephadm - edit t11ing.

doc/cephadm - edit t11ing.

Edit "Running Repeated Debugging Sessions" in
doc/cephadm/troubleshooting.rst. Improve grammar. Fix a misspelling.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit f5b8afe981650f5072294303b0e488b91fc65fe8)

Merge pull request #55461 from zdover23/wip-doc-2024-02-06-backport-55447-to-quincy

quincy: doc/rados: update PG guidance

doc/rados: update PG guidance

Update the "Creating a Pool" section of doc/rados/operations/pools.rst
so that the documentation no longer insists that the user change the
values of "osd_pool_default_pg_num" and "osd_pool_default_pgp_num".

See also: https://github.com/ceph/ceph/pull/55419

Tracker: https://tracker.ceph.com/issues/64259

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 5ad241442d2c141ba508faba61f39d70f3f09679)

Merge pull request #55439 from zdover23/wip-doc-2024-02-04-backport-55419-to-quincy

quincy: doc/rados: update config for autoscaler

doc/rados: update config for autoscaler

Update doc/rados/configuration/pool-pg-config-ref.rst to account for the
behavior of autoscaler.

Previously, this file was last meaningfully altered in 2013, prior to
the invention of autoscaler. A recent confusion was brought to my
attention on the Ceph Slack whereby a user attempted to alter the
default values of a Quincy cluster, as suggested in this documentation.
That alteration caused Ceph to throw the error "Error ERANGE: 'pgp_num'
must be greater than 0 and lower or equal than 'pg_num', which in this
case is one" and a related "rgw_init_ioctx ERROR" reading in part
"Numerical result out of range". The user removed the
"osd_pool_default_pgp_num" configuration line from ceph.conf and the
cluster worked as expected. I presume that this is because the removal
of this configuration line allowed autoscaler to work as intended.

Fixes: https://tracker.ceph.com/issues/64259
Co-authored-by: David Orman <ormandj@corenode.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 4dc12092be584da44baca14e31ca33231164235f)

Merge pull request #55433 from zdover23/wip-doc-2024-02-03-backport-55403-to-quincy

quincy: doc/rgw: fix Attributes index in CreateTopic example

doc/rgw: fix Attributes index in CreateTopic example

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit ecbd8376675c39893c55ceb7fa8653458d3fc6ed)

Merge pull request #55317 from ajarr/wip-64180-quincy

quincy: rbd-nbd: fix resize of images mapped using netlink

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>

Merge pull request #55257 from idryomov/wip-63341-quincy

quincy: librbd: improve rbd_diff_iterate2() performance in fast-diff mode

Reviewed-by: Mykola Golub <mgolub@suse.com>

Merge pull request #54880 from batrick/wip-63797-quincy

quincy: pybind/mgr/devicehealth: replace SMART data if exists for same DATETIME

Reviewed-by: Milind Changire <mchangir@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #55400 from zdover23/wip-doc-2024-01-31-backport-55396-to-quincy

quincy: doc/architecture: improve some paragraphs

doc/architecture: improve some paragraphs

Improve paragraphs under the heading "The Ceph Storage Cluster". Remove
a sentence that was pleonastic in its context in the paragraph.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 2f0542d66901295cf875893de0ac15304578d917)

Merge pull request #54706 from k0ste/wip-63313-quincy

quincy: ceph-volume: fix a bug in _check_generic_reject_reasons

Merge pull request #54630 from guits/wip-63598-quincy

quincy: ceph-volume: fixes fallback to stat in is_device and is_partition

Merge pull request #55385 from zdover23/wip-doc-2024-01-31-backport-55372-to-quincy

quincy: doc/architecture.rst - fix typo

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc/architecture.rst - fix typo

s/requies/requires

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 6c0417fbcbe6b9760b3836e5166d6bd929578096)

Merge pull request #55248 from rhcs-dashboard/wip-63653-quincy

quincy: mgr/dashboard: get rgw port from ssl_endpoint

Reviewed-by: Avan Thakkar <athakkar@redhat.com>

Merge pull request #55344 from zdover23/wip-doc-2024-01-29-backport-55341-to-quincy

quincy: doc/architecture.rst: improve rados definition

doc/architecture.rst: improve rados definition

Improve the definition of RADOS, and link to information about RADOS.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 763f6b7a22e846962f388d58fd7e699cbf16ffe7)

Merge pull request #55339 from zdover23/wip-doc-2024-01-28-backport-55333-to-quincy

quincy: doc/radosgw: fix verb disagreement - index.html

doc/radosgw: fix verb disagreement - index.html

Fix a tricky verb disagreement and rewrite a few sentences for what I
hope is greater clarity.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit 9f271093f4331381dc024cb4309f9f486d366818)

Merge pull request #55322 from zdover23/wip-doc-2024-01-26-backport-55307-to-quincy

quincy: doc/radosgw: edit "Usage" admin.rst

doc/radosgw: edit "Usage" admin.rst

Edit "Usage" in doc/radosgw/admin.rst.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit d8df6f61e817a34c2c3282224cff117ae43e3f98)

rbd-nbd: log errors during netlink_resize() using derr

When using rbd CLI to map the images to NBD devices via netlink,
any errors that arose during image resizing in netlink_resize()
were not logged. Switching the error logging from using cerr to
derr helps log the errors from netlink_resize().

Signed-off-by: Ramana Raja <rraja@redhat.com>
(cherry picked from commit 1712b95c784c5ce381fbf4b09e8219ea40bd99a8)

rbd_nbd: fix resize of images mapped using netlink

Include device identifier or cookie in the message sent to the kernel
to resize images mapped to NBD devices using netlink. Otherwise,
netlink_resize() fails and the size of the device isn't updated.

Fixes: https://tracker.ceph.com/issues/64139
Signed-off-by: Ramana Raja <rraja@redhat.com>
(cherry picked from commit 1eebb7ba7903c6db0ab37a0457b263a1b2b00ff5)

Merge pull request #53459 from rhcs-dashboard/wip-62603-quincy

quincy: mgr/dashboard: remove unnecessary failing hosts e2e

Reviewed-by: Nizamudeen A <nia@redhat.com>

Merge pull request #53809 from rhcs-dashboard/wip-63090-quincy

quincy: mgr/dashboard: rbd image hide usage bar when disk usage is not provided

Reviewed-by: Nizamudeen A <nia@redhat.com>

Merge pull request #55283 from zdover23/wip-doc-2024-01-24-backport-55278-to-quincy

quincy: doc: specify correct fs type for mkfs

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>

Merge pull request #54411 from mihalicyn/wip-63477-quincy

quincy: MClientRequest: properly handle ceph_mds_request_head_legacy for ext_num_retry, ext_num_fwd, owner_uid, owner_gid

Reviewed-by: Milind Changire <mchangir@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #54244 from vshankar/wip-63284-quincy

quincy: client: always refresh mds feature bits on session open

Reviewed-by: Milind Changire <mchangir@redhat.com>

Merge pull request #53363 from k0ste/wip-57111-quincy

quincy: mds: replacing bootstrap session only if handle client session message

Reviewed-by: Milind Changire <mchangir@redhat.com>

Merge pull request #53358 from k0ste/wip-61992-quincy

quincy: mds/MDSRank: Add set_history_slow_op_size_and_threshold for op_tracker

Reviewed-by: Milind Changire <mchangir@redhat.com>

Merge pull request #52976 from batrick/wip-62423-quincy

quincy: mds: dump locks when printing mutation ops

Reviewed-by: Milind Changire <mchangir@redhat.com>

Merge pull request #52820 from rishabh-d-dave/wip-62336-quincy

quincy: mds: use variable g_ceph_context directly in MDSAuthCaps

Reviewed-by: Milind Changire <mchangir@redhat.com>

Merge pull request #52271 from dparmar18/wip-61840-quincy

quincy: do not evict clients if OSDs are laggy

Reviewed-by: Xiubo Li <xiubli@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Milind Changire <mchangir@redhat.com>

doc: specify correct fs type for mkfs

The default value is ext2, which is not supported (anymore?).

Signed-off-by: Vladislav Glagolev <vladislav.glagolev@devexpress.com>
(cherry picked from commit 886af37744847246b3e70f54b8577ed4f9815c20)

Merge pull request #55272 from zdover23/wip-doc-2024-01-23-backport-55269-to-quincy

quincy: doc/radosgw: edit "read/write global rate limit" admin.rst

doc/radosgw: edit "read/write global rate limit" admin.rst

Edit "Reading/Writing Global Rate Limit Configuration" in
doc/radosgw/admin.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit c67a5e5d4bad17e7ae799dd62a66d1e23ec18942)

Merge pull request #55243 from zdover23/wip-doc-2024-01-19-backport-55170-to-quincy

quincy: doc/radosgw: edit admin.rst "set bucket rate limit"

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #55264 from zdover23/wip-doc-2024-01-22-backport-54993-to-quincy

quincy: doc/rados/operations: document `ceph balancer status detail`

doc/rados/operations: document `ceph balancer status detail`

Document change in https://github.com/ceph/ceph/pull/54801

Signed-off-by: Laura Flores <lflores@ibm.com>
(cherry picked from commit 159751b68085fbe0fe10a881ff8bedecda11142f)

Merge pull request #55261 from zdover23/wip-doc-2024-01-21-backport-55190-to-quincy

quincy: doc/radosgw: edit "Enable/Disable Bucket Rate Limit"

doc/radosgw: edit "Enable/Disable Bucket Rate Limit"

Edit "Enable/Disable Bucket Rate Limit" in doc/radosgw/admin.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
(cherry picked from commit a1fca50dfdcb30e58ebcc4ef60ef921b977efc81)

PendingReleaseNotes: add rbd_diff_iterate2 note

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 40e8813e9c705838eee42c98de717b20851aed72)

Conflicts:
PendingReleaseNotes [ moved to >=17.2.8 section ]

librbd: try to preserve object map for diff-iterate in fast-diff mode

As an optimization, try to ensure that the object map for the end
version is preloaded through the acquisition of exclusive lock and
as a consequence remains around until exclusive lock is released.
If it's not around, DiffRequest would (re)load it on each call.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 89b0d9e7b40a5f962094428e613315d3697d261f)

Conflicts:
src/librbd/api/DiffIterate.cc [ ImageArea support not in
  quincy ]

librbd/object_map: potentially use in-memory object map in DiffRequest

If the object map for the end version is around (already loaded in
memory, either due to the end version being a snapshot or due to
exclusive lock being held), use it to run diff-iterate against the
beginning of time.  Since it's the only object map needed in that
case, such calls would be satisfied locally.

Fixes: https://tracker.ceph.com/issues/63341
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 0c4bb58c900efa2356ea8526d3432b2922787afa)

librbd/object_map: decouple object map processing in DiffRequest

In preparation for potentially using in-memory object map, decouple
object map processing from loading object maps and place the logic in
prepare_for_object_map() and process_object_map().

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit dabb677ba5923f347c5b4b81b6a86214699a52bf)

common/bit_vector: fix iterator vs reference constness confusion

T (ConstIterator or Iterator) is confused with const T here:
IteratorImpl dereference operator is wrongly overloaded on const
and returns Reference instead of ConstReference for ConstIterator.
This then fails inside bufferlist bowels because Reference is
incompatible with bufferlist::const_iterator.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 45d534553abaca81e26574fd5a7b17b9219c0dd0)

librbd/object_map: make object map in handle_load_object_map() local

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 232ad1a5fb6248d7b3fbfaec5944a90a71a95806)

librbd/object_map: don't resize object map in handle_load_object_map()

Currently it's done in two cases:

- if the loaded object map is larger than expected based on byte size,
  it's truncated to expected number of objects
- in case of deep-copy, if the loaded object map is smaller than diff
  state, it's expanded to get "track the largest of all versions in the
  set" semantics

Both of these cases can be easily dealt with without modifying the
object map.  Being able to process a const object map is needed for
working on in-memory object map which is external to DiffRequest.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 275a299cd48d2ddac36608d6633a6b79c8927351)

common/bit_vector: fix IteratorImpl post-increment operator

It's totally broken: instead of returning the current position and
moving to the next position, it returns the next position and doesn't
move anywhere.  Luckily it hasn't been used until now.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 2ab5b52f71c88cb55f8ed82f1dfd0115fdd6e022)