rgw/cloud-transition: Fix issues with MCG endpoint

Few s3 endpoints (like Noobaa MCG or AWS) may return BucketAlreadyOwned
or BucketAlreadyExists error if the target path (configured for
cloud transition) already exists. Do not fail transition in those cases.

Also fixed below issues -
* with racing lc threads, when one lc thread is trying to check and create the
target bucket, others may go ahead with the object transition assuming target path
exists.
* initialize few fields to avoid setting wrong content_len during transition

Signed-off-by: Soumya Koduri <skoduri@redhat.com>

Merge pull request #48773 from myoungwon/wip-fix-out-date-delta

crimson/os/seastore: add deallocation map during replay to filter out out-dated delta

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>

Merge pull request #48837 from badone/wip-ceph-debug-docker-ubuntu-src.list

scripts: Add Ubuntu source repo entry to ceph-debug-docker

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #48989 from zdover23/wip-doc-2022-11-22-glossary-node

doc/glossary: Define "Ceph Node"

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #48990 from zdover23/wip-doc-2022-11-22-glossary-cluster-map-oxford-comma

doc/glossary: add oxford comma to "Cluster Map"

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc/glossary: add oxford comma to "Cluster Map"

Add an Oxford comma to a list under the "Cluster Map" headword in the
glossary, so that it doesn't read like "I'd like to thank my parents,
Ayn Rand and God."

Signed-off-by: Zac Dover <zac.dover@gmail.com>

doc/glossary: Define "Ceph Node"

Add a definition of "Ceph Node" to the glossary.

Signed-off-by: Zac Dover <zac.dover@gmail.com>

Merge pull request #48983 from zdover23/wip-doc-2022-11-21-rados-ops-add-or-rm-mons-prompts-2-of-2

doc/rados: add prompts to add-or-rm-prompts.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #48810 from stefan-chivu/max-path-len-increase

dokan: Configurable maximum path length

Reviewed-by: Lucian Petrut <lpetrut@cloudbasesolutions.com>

doc/rados: add prompts to add-or-rm-prompts.rst

Add unselectable prompts to add-or-rm-prompts.rst. This is part 2 of 2.

Signed-off-by: Zac Dover <zac.dover@gmail.com>

Merge pull request #48664 from joscollin/wip-cephfs-top-drop-x-coord-map

cephfs-top: drop x_coord_map

Reviewed-by: Neeraj Pratap Singh <neesingh@redhat.com>

Merge pull request #48850 from joscollin/wip-fix-clear-screen-no-fs

cephfs-top: run_display: clear the screen and block commands when no fs

Reviewed-by: Neeraj Pratap Singh <neesingh@redhat.com>

Merge pull request #48956 from zdover23/wip-doc-2022-11-19-src-pybind-cephfs-cephfs-grammar

src/pybind/cephfs: fix grammar

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Kotresh HR <khiremat@redhat.com>

test/dokan: Added dokan max path test

Signed-off-by: Stefan Chivu <schivu@cloudbasesolutions.com>

ceph-dokan: Made max path length configurable

Added ceph-dokan CLI optarg for configuring the value of
the maximum path length. By default, it will be set to 256 and
it will have a maximum value of 32767.

Signed-off-by: Stefan Chivu <schivu@cloudbasesolutions.com>

cephfs-top: drop x_coord_map

As we started using curses pads in PR#48090, we don't need x_coord_map anymore.
In this patch, the metrics are positioned in cephfs-top based on padding (ITEMS_PAD).

Signed-off-by: Jos Collin <jcollin@redhat.com>

Merge pull request #48910 from joscollin/wip-fix-header-show-filters

cephfs-top: display filters in the header

Reviewed-by: Neeraj Pratap Singh <neesingh@redhat.com>

Merge pull request #48978 from zdover23/wip-doc-2022-11-21-rados-ops-add-or-rm-mons-prompts-1-of-2

doc/rados: add prompts to add-or-rm-prompts.rst

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>

crimson/os/seastore/cbj: add deallocation map during replay to filter out out-dated delta

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

doc/rados: add prompts to add-or-rm-prompts.rst

Add unselectable prompts to add-or-rm-prompts.rst. This commit covers
the first 300 lines of the file. This is part 1 of 2.

Signed-off-by: Zac Dover <zac.dover@gmail.com>

Merge pull request #48975 from zdover23/wip-doc-2022-11-21-glossary-SDS

doc/glossary: Add "SDS"

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc/glossary: Add "SDS"

Add "SDS" to the glossary.

Signed-off-by: Zac Dover <zac.dover@gmail.com>

Merge pull request #48949 from ktdreyer/doc-windows-drive-letter

doc: display Windows RBD drive letter

Reviewed-by: Lucian Petrut <lpetrut@cloudbasesolutions.com>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>

Merge pull request #48968 from zdover23/wip-doc-2022-11-20-rbd-immutable-object-cache-daemon-grammar

doc/rbd: improve grammar in "immutable object..."

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>

doc/rbd: improve grammar in "immutable object..."

Improve the grammar in the "Immutable Object Cache Daemon" section.

Signed-off-by: Zac Dover <zac.dover@gmail.com>

Merge pull request #48962 from zdover23/wip-doc-2022-11-20-radosgw-object-gateway-grammar

doc/radosw: improve radosgw text

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>

Merge pull request #48963 from zdover23/wip-doc-2022-11-20-glossary-ceph-block-storage

doc/glossary: beef up "Ceph Block Storage"

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>

doc/glossary: beef up "Ceph Block Storage"

Beef up the "Ceph Block Storage" entry.

Signed-off-by: Zac Dover <zac.dover@gmail.com>

doc/radosw: improve radosgw text

Punch up the paragraph about the Ceph Object Gateway daemon (radosgw).

Signed-off-by: Zac Dover <zac.dover@gmail.com>

Merge pull request #48959 from zdover23/wip-doc-2022-11-20-glossary-radosgw

doc/glossary: define "RGW"

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>

doc/glossary: define "RGW"

Add definition under the headword "RGW".

Signed-off-by: Zac Dover <zac.dover@gmail.com>

src/pybind/cephfs: fix grammar

Fix the grammar in the explanation of the lstat() API call.

Signed-off-by: Zac Dover <zac.dover@gmail.com>

Merge pull request #48942 from zdover23/wip-doc-2022-11-18-src-pybind-typo

src/pybind: fix typo in cephfs.pyx

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #48939 from zdover23/wip-doc-2022-11-18-glossary-rados

doc/glossary: add "RADOS" definition

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc/glossary: add "RADOS" definition

Define "RADOS" in the glossary. We will return in the next month to beef
this entry up.

Signed-off-by: Zac Dover <zac.dover@gmail.com>

Merge pull request #48941 from zdover23/wip-doc-2022-11-18-releases-quincy

doc/releases: fix prompts in quincy.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc: display Windows RBD drive letter

Give the Powershell command that identifies the Windows drive letter
when partitioning a new RBD image.

Signed-off-by: Ken Dreyer <kdreyer@redhat.com>

Merge pull request #48938 from ljflores/wip-curl-error

qa/workunits/rados: specify redirect in curl command

Merge pull request #48940 from kelubo/main

doc: Delete a duplicate row.

Merge pull request #48944 from zdover23/wip-doc-2022-11-19-man-mount-ceph

doc/man: disambiguate "user" in a command

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc/man: disambiguate "user" in a command

Explain that "user" means "RADOS client name" and "RADOS user", per a
complaint solicited through the "Report Documentation Bugs" system.

Signed-off-by: Zac Dover <zac.dover@gmail.com>

src/pybind: fix typo in cephfs.pyx

s/informaion/information/

Signed-off-by: Zac Dover <zac.dover@gmail.com>

doc/releases: fix prompts in quincy.rst

Fix prompts in quincy.rst so that they're unselectable. (I also
corrected one sentence.)

Signed-off-by: Zac Dover <zac.dover@gmail.com>

doc: Delete a duplicate row

Signed-off-by: wangfei <wf.ab@126.com>

cephfs-top: display filters in the header

This would help the user to identify what are the filters currently applied
to the cephfs-top screens at a glance.

Signed-off-by: Jos Collin <jcollin@redhat.com>

qa/workunits/rados: specify redirect in curl command

This workunit currently grabs files in html form, since
there is a redirect that occurs. If we specify `-L` in the
curl command, it handles redirects and graps the files
appropriately.

Fixes: https://tracker.ceph.com/issues/58046
Signed-off-by: Laura Flores <lflores@redhat.com>

Merge pull request #48851 from s0nea/ceph_hosts-fix

ceph-mixing: fix ceph_hosts variable

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>

cephfs-top: run_display: clear the screen and block commands when no fs

Signed-off-by: Jos Collin <jcollin@redhat.com>

Merge pull request #48919 from jaehshim/main

crimson/os/seastore/extent_placement_manager.h: fix a typo

Reviewed-by: Kefu Chai <tchaikov@gmail.com>

Merge pull request #46525 from SoftIron/wip-async-poll

msg: add new async event driver based on poll()

Merge pull request #48924 from zdover23/wip-doc-2022-11-17-dev-dot-users-manual

doc/dev: link to Dot User's Manual

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>

doc/dev: link to Dot User's Manual

Add a link to the Dot User's Manual for Graphviz diagrams.

Signed-off-by: Zac Dover <zac.dover@gmail.com>

Merge pull request #48913 from jdurgin/wip-octopus-eol

doc/releases: mark octopus eol

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #48921 from zdover23/wip-doc-2022-11-17-dev-object-store-graphviz

doc/dev: fix graphviz diagram

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>

doc/dev: fix graphviz diagram

Fix the formatting of the "Object Store Architecture Overview" graphviz
diagram.

Signed-off-by: Zac Dover <zac.dover@gmail.com>

Merge pull request #48920 from zdover23/wip-doc-2022-11-17-dev-balancer-hld-expansion

doc/dev: expand "HLD" to "high-level design"

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>

doc/dev: expand "HLD" to "high-level design"

Expand "HLD" to "high-level design" in prim-balancer-design.rst.

Signed-off-by: Zac Dover <zac.dover@gmail.com>

Merge pull request #44565 from ljflores/wip-primary-balancer-documentation

[DNM] doc/dev: explain the primary balancer scope and design

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

crimson/os/seastore/extent_placement_manager.h: fix a typo

Signed-off-by: Jaehoon Shim <mattjs@snu.ac.kr>

Merge pull request #48916 from zdover23/wip-doc-2022-11-17-glossary-cephfs

doc/glossary: rewrite "Ceph File System"

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>

doc/glossary: rewrite "Ceph File System"

Improve the definition of "Ceph File System".

Signed-off-by: Zac Dover <zac.dover@gmail.com>

doc/releases: mark octopus eol

Signed-off-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #48900 from zdover23/wip-doc-2022-11-16-glossary-ceph-object-gateway

doc/glossary: define "Ceph Object Gateway"

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc/glossary: define "Ceph Object Gateway"

Define "Ceph Object Gateway" and link to more information.

Signed-off-by: Zac Dover <zac.dover@gmail.com>

Merge pull request #48569 from rhcs-dashboard/angular-13

mgr/dashboard: upgrade to angular 13, bootstrap 5 and jest 28

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: nSedrickm <NOT@FOUND>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>

Merge pull request #48889 from zdover23/wip-doc-2022-11-15-glossary-ceph-point-release

doc/glossary: improve "Ceph Point Release" entry

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>

doc/glossary: improve "Ceph Point Release" entry

Improve the English in the "Ceph Point Release" entry in the glossary.

Signed-off-by: Zac Dover <zac.dover@gmail.com>

Merge pull request #48886 from zdover23/wip-doc-2022-11-15-rados-operations-cache-tiering-cleanup-pr-48861

doc/rados: reword part of cache-tiering.rst

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>

doc/rados: reword part of cache-tiering.rst

Reword part of cache-tiering.rst to make the English language added in
https://github.com/ceph/ceph/pull/48861 more elegant.

Signed-off-by: Zac Dover <zac.dover@gmail.com>

Merge pull request #48881 from zdover23/wip-doc-2022-11-15-rados-configuration-front-matter

doc/rados: fix grammar in configuration/index.rst

Reviewed-by: Zac Dover <zac.dover@gmail.com>

Merge pull request #48861 from liangmingyuanneo/wip-cachetier-doc

doc/osd: Fixes the introduction for writeback mode of cache tier.

Reviewed-by: Zac Dover <zac.dover@gmail.com>

doc/rados: fix grammar in configuration/index.rst

Reword the front matter in doc/rados/configuration/index.rst.

Signed-off-by: Zac Dover <zac.dover@gmail.com>

mgr/dashboard: tslint to eslint migration

Fixes: https://tracker.ceph.com/issues/48258
Signed-off-by: Nizamudeen A <nia@redhat.com>

mgr/dashboard: rgw encryption modal and host component cleanup

along with some additional cleanups

Signed-off-by: Nizamudeen A <nia@redhat.com>

mgr/dashboard: update jest to 28

Fixes: https://tracker.ceph.com/issues/57972
Signed-off-by: Nizamudeen A <nia@redhat.com>

mgr/dashboard: migrate to bootstrap 5

Fixes: https://tracker.ceph.com/issues/57867
Signed-off-by: Nizamudeen A <nia@redhat.com>

Merge pull request #48870 from zdover23/wip-doc-2022-11-14-glossary-mds

doc/glossary: add "mds" term

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc/glossary: add "mds" term

Improve "MDS" glossary term. Link to MDS information.

Signed-off-by: Zac Dover <zac.dover@gmail.com>

mgr/dashboard: update angular 13

https://blog.angular.io/angular-v13-is-now-available-cce66f7bc296

Fixes: https://tracker.ceph.com/issues/57866
Signed-off-by: Nizamudeen A <nia@redhat.com>

Merge pull request #48866 from zdover23/wip-doc-2022-11-14-rados-pools-followup

doc/rados: improve pools.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc/rados: improve pools.rst

Implement Anthony D'Atri's suggestions made in
https://github.com/ceph/ceph/pull/48855.

Signed-off-by: Zac Dover <zac.dover@gmail.com>

Merge pull request #48862 from zdover23/wip-doc-2022-11-13-radosgw-ceph-object-gateway-definition

doc/radosgw: improve "Ceph Object Gateway" text

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>

doc/radosgw: improve "Ceph Object Gateway" text

Reduce ambiguity in the definition of "Ceph Object Gateway".

Signed-off-by: Zac Dover <zac.dover@gmail.com>

doc/osd: Fixes the introduction for writeback mode of cache tier.

Now, the statement of writeback is incorrect, it says the clients
write data to cache tier firstly, then flush to base tier. But
is not in fact, that will make users confused. Reads too.

Signed-off-by: Mingyuan Liang <liangmingyuan@baidu.com>

Merge pull request #48852 from zdover23/wip-doc-2022-11-12-glossary-pools

doc/glossary: update "pool/pools"

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #48853 from zdover23/wip-doc-2022-11-12-rados-pools

doc/rados: update "Pools" material

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>

doc/rados: update "Pools" material

Remove mentions of default pools (which no longer exist) and improve the
syntax of the Pools front matter.

Signed-off-by: Zac Dover <zac.dover@gmail.com>

doc/glossary: update "pool/pools"

Update the "pool" and "pools" entries and link to the part of the
documentation related to pools.

Signed-off-by: Zac Dover <zac.dover@gmail.com>

ceph-mixing: fix ceph_hosts variable

Do only use `instance` to query for hostnames in single-cluster-mode.
Consider the cluster matcher only in multi-cluster-mode. In this case
the query will look like:
`"label_values({cluster=~\"$cluster\"}, instance)"`.

Fixes: https://tracker.ceph.com/issues/57987
Signed-off-by: Tatjana Dehler <tdehler@suse.com>

Merge pull request #48840 from zdover23/wip-doc-2022-11-11-glossary-remove-test-framework

doc/glossary: remove "Ceph Test Framework"

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc/glossary: remove "Ceph Test Framework"

Remove "Ceph Test Framework" because it doesn't actually refer to
anything.

Signed-off-by: Zac Dover <zac.dover@gmail.com>

scripts: Add Ubuntu source repo entry to ceph-debug-docker

Under Ubuntu it's desirable to install the src package(s) when debugging
a coredump so add an entry for the ceph repo to facilitate that.

Signed-off-by: Brad Hubbard <bhubbard@redhat.com>

Merge pull request #48832 from zdover23/wip-doc-2022-11-11-glossary-ceph-OSD-Daemon-Daemons-redirect

doc/glossary: redirect entries to "Ceph OSD"

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc/glossary: redirect entries to "Ceph OSD"

Redirect "Ceph OSD Daemon" and "Ceph OSD Daemons" to the entry for "Ceph
OSD", which is already defined.

Signed-off-by: Zac Dover <zac.dover@gmail.com>

Merge pull request #48298 from alram/alram/osd-meta-created_at

osd: add created_at meta

Merge pull request #48044 from nkshirsagar/main

mon: bail from handle_command() if _generate_command_map() fails

Merge pull request #46036 from ifed01/wip-ifed-new-statfs-update

os/bluestore: get rid off statfs update on each txc

Merge pull request #48826 from jecluis/wip-rgw-fix-lua-ifdef

rgw/rados: drop unnecessary ifdef

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #48694 from gaord/FIX_BUG_57954

mgr/rook:NFSRados constructor expects type of rados as a parameter instead of MgrModule.

Reviewed-by: Travis Nielsen <tnielsen@redhat.com>

rgw/rados: drop unnecessary ifdef

Signed-off-by: Joao Eduardo Luis <joao@suse.com>