doc added msgr on-wire-compression

Signed-off-by: Maya Gilad <ms.maya.gilad@gmail.com>

Merge pull request #43571 from tchaikov/wip-bl-prepare-iovs

common/bl: bl::prepare_iovs() related cleanups

Reviewed-by: Xuehan Xu <xxhdx1985126@gmail.com>

common/bl: mark bl::prepare_iovs() const

Signed-off-by: Kefu Chai <tchaikov@gmail.com>

common/bl: simplify bl::prepare_iovs()

* consolidate the code to initialize a vector<iov>
* use an iterator to track the current vector<iovec>. less
  repeating this way.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>

common/bl: define iov_vec_t using a dedicated struct

more readable this way

Signed-off-by: Kefu Chai <tchaikov@gmail.com>

common/bl: move bl::prepare_iovs() to .cc file

to reduce the compilation time by having a smaller header file.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>

Merge pull request #43478 from anthonyeleven/anthonyeleven/fix-52830

common/options: document rgw_lc_debug_interval configuration option

Merge pull request #43537 from xxhdx1985126/wip-seastore-iov-max

crimson/os/seastore: deal with scenarios in which bufferlist of do_writev has more than IOV_MAX buffers

Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #43507 from cbodley/wip-rgw-log-spam

rgw: hide some unnecessary log spam

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>

Merge pull request #43488 from cbodley/wip-52873

radosgw-admin: 'reshard list' doesn't log ENOENT errors

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>

Merge pull request #43428 from cfsnyder/wip-52818-random-rgw-req-id

rgw/rgw_rados: make RGW request IDs non-deterministic

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
Reviewed-by: Adam C. Emerson <aemerson@redhat.com>

Merge pull request #42981 from mkogan1/rgw-d3n-fix-lru-exp

rgw: d3n: fix d3n cached objects on disk lru eviction entering infini…

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #42208 from BryceCao/wip-add-return-when-access-key-exist-in-subuser-create

rgw : add return when access key exist in subuser create

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #40144 from hualongfeng/osd_compression_bypass

rgw: osd compression bypass after rgw compression

Reviewed-by: Casey Bodley <cbodley@redhat.com>

common/options: document rgw_lc_debug_interval configuration option

Signed-off-by: Anthony D'Atri <anthony.datri@gmail.com>

Merge pull request #43533 from tchaikov/wip-cmake-less-chatty

cmake: only pass --verbose when VERBOSE env variable is set

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

rgw: silence error message for nonexistent realm

in a normal vstart cluster without a realm or period, every command
prints this error message:

0 RGWPeriod::init failed to init realm  id  : (2) No such file or directory

Signed-off-by: Casey Bodley <cbodley@redhat.com>

Merge PR #43558 into master

* refs/pull/43558/head:
doc/governance.rst: update clt membership

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>

Merge PR #43430 into master

* refs/pull/43430/head:
qa: skip c-v install on pacific start

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge PR #43426 into master

* refs/pull/43426/head:
qa/cephfs: update xfstests_dev for centos stream

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge PR #43425 into master

* refs/pull/43425/head:
qa: import CommandFailedError from exceptions not run

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>

Merge PR #43420 into master

* refs/pull/43420/head:
qa: skip internal metadata directory when scanning ceph debugfs directory

Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge PR #43382 into master

* refs/pull/43382/head:
mds: skip journaling blocklisted clients when in `replay` state

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #43120 from dang/wip-dang-user-load-attrs

RGW Zipper - load user attributes with user

Reviewed-by: Soumya Koduri <skoduri@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #31909 from rosinL/wip-fix-dpdk-cond-wait

msg/async/dpdk: exit condition waiting when DPDKStack is destructed

Reviewed-by: Kefu Chai <kchai@redhat.com>

crimson/os/seastore: deal with scenarios in which bufferlist of do_writev has more than IOV_MAX buffers

Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>

msg/async/dpdk: exit condition waiting when DPDKStack is destructed

exit() will call pthread_cond_destroy attempting to destroy dpdk::eal::cond
upon which other threads are currently blocked results in undefine
behavior. Link different libc version test, libc-2.17 can exit,
libc-2.27 will deadlock, the call stack is as follows:

Thread 3 (Thread 0xffff7e5749f0 (LWP 62213)):
 #0  0x0000ffff7f3c422c in futex_wait_cancelable (private=<optimized out>, expected=0,
    futex_word=0xaaaadc0e30f4 <dpdk::eal::cond+44>) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
 #1  __pthread_cond_wait_common (abstime=0x0, mutex=0xaaaadc0e30f8 <dpdk::eal::lock>, cond=0xaaaadc0e30c8 <dpdk::eal::cond>)
    at pthread_cond_wait.c:502
 #2  __pthread_cond_wait (cond=0xaaaadc0e30c8 <dpdk::eal::cond>, mutex=0xaaaadc0e30f8 <dpdk::eal::lock>)
    at pthread_cond_wait.c:655
 #3  0x0000ffff7f1f1f80 in std::condition_variable::wait(std::unique_lock<std::mutex>&) ()
   from /usr/lib/aarch64-linux-gnu/libstdc++.so.6
 #4  0x0000aaaad37f5078 in dpdk::eal::<lambda()>::operator()(void) const (__closure=<optimized out>, __closure=<optimized out>)
    at ./src/msg/async/dpdk/dpdk_rte.cc:136
 #5  0x0000ffff7f1f7ed4 in ?? () from /usr/lib/aarch64-linux-gnu/libstdc++.so.6
 #6  0x0000ffff7f3be088 in start_thread (arg=0xffffe73e197f) at pthread_create.c:463
 #7  0x0000ffff7efc74ec in thread_start () at ../sysdeps/unix/sysv/linux/aarch64/clone.S:78

Thread 1 (Thread 0xffff7ee3b010 (LWP 62200)):
 #0  0x0000ffff7f3c3c38 in futex_wait (private=<optimized out>, expected=12, futex_word=0xaaaadc0e30ec <dpdk::eal::cond+36>)
    at ../sysdeps/unix/sysv/linux/futex-internal.h:61
 #1  futex_wait_simple (private=<optimized out>, expected=12, futex_word=0xaaaadc0e30ec <dpdk::eal::cond+36>)
    at ../sysdeps/nptl/futex-internal.h:135
 #2  __pthread_cond_destroy (cond=0xaaaadc0e30c8 <dpdk::eal::cond>) at pthread_cond_destroy.c:54
 #3  0x0000ffff7ef2be34 in __run_exit_handlers (status=-6, listp=0xffff7f04a5a0 <__exit_funcs>, run_list_atexit=255,
    run_list_atexit@entry=true, run_dtors=run_dtors@entry=true) at exit.c:108
 #4  0x0000ffff7ef2bf6c in __GI_exit (status=<optimized out>) at exit.c:139
 #5  0x0000ffff7ef176e4 in __libc_start_main (main=0x0, argc=0, argv=0x0, init=<optimized out>, fini=<optimized out>,
    rtld_fini=<optimized out>, stack_end=<optimized out>) at ../csu/libc-start.c:344
 #6  0x0000aaaad2939db0 in _start () at ./src/include/buffer.h:642

Fixes: https://tracker.ceph.com/issues/42890
Signed-off-by: Chunsong Feng <fengchunsong@huawei.com>
Signed-off-by: luo rixin <luorixin@huawei.com>

Merge pull request #43555 from tchaikov/wip-dashboard-tsconfig

mgr/dashboard: s/hosts.clickHostTab/hosts.clickTab/

Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>

mgr/dashboard: s/hosts.clickHostTab/hosts.clickTab/

this change is a follow-up fix of
3276147049511a9a8d45d84c95154a4ec014cd83

otherwise we have following test failure:

[lint:tsc     ] cypress/integration/orchestrator/01-hosts.e2e-spec.ts(29,13): error TS2339: Property 'clickHostTab' does not exist on type 'HostsPageHelper'.

also change "host" to "hostname" to be more consistent

Fixes: https://tracker.ceph.com/issues/52645
Signed-off-by: Kefu Chai <tchaikov@gmail.com>

common: add prepare_iovs to bufferlist

Enable bufferlist that have more than IOV_MAX buffers to build a vector of iov.

Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>

crimson/common: extract parallel_for_each into errorator-loop.h

otherwise, crimson::errorator<AllowedErrors...>::parallel_for_each would be
referencing incomplete crimson::parallel_for_each_state type

Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>

rgw: osd compression bypass after rgw compression

In particular, when rgw is itself doing compression,
rgw should send a incompressible hint to OSD.
Because the OSD has little effect on the data
compressed in the condition. So there bypassing the
osd compression is to avoid repeated compression
calculation.

Signed-off-by: Feng Hualong <hualong.feng@intel.com>

Merge pull request #43554 from athanatos/sjust/wip-block-segment-manager-sync

crimson/os/seastore/segment_manager/block: open with dsync

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>
Reviewed-by: Xuehan Xu <xxhdx1985126@gmail.com>
Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>

doc/governance.rst: update clt membership

This now matches the mailing list which Sage audited.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>

Merge PR #43333 into master

* refs/pull/43333/head:
.github/CODEOWNERS: tag rook devs on rook related PRs

Reviewed-by: Sébastien Han <seb@redhat.com>
Reviewed-by: Sebastian Wagner <sewagner@redhat.com>

crimson/os/seastore/segment_manager/block: open with dsync

67efc4 appears to be simply incorrect, I don't see any calls
to flush(), so we do need to open with dsync until we
implement a smarter flushing scheme.

Also, refactor open_device to remove mode param -- we always
pass the same value.

Reverts: 67efc48332cebb69497c5676be6ed2a6e5365e03
Signed-off-by: Samuel Just <sjust@redhat.com>

Merge pull request #43477 from anthonyeleven/anthonyeleven/fix-23027

ceph: document rgw_multipart_min_part_size

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #42997 from josephsawaya/wip-mgr-rook-orch-ls

mgr/rook: orch ls displays info about OSDs

Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>

Merge pull request #43332 from sebastian-philipp/sphinx-rgw-spec

doc/cephadm: use sphinx autoclass to document RGWSpec

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #43239 from trociny/wip-48959

osd: handle inconsistent hash info during backfill and deep scrub gracefully

Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #43498 from dheart-joe/bluestore_fix

os/bluestore: _do_write_small fix head_pad

Reviewed-by: Igor Fedotov <ifedotov@suse.com>

Merge pull request #42099 from aclamk/wip-bluefs-fine-grain-locking-2

os/bluestore: BlueFS fine grain locking

Reviewed-by: Sage Weil <sage@newdream.net>

Merge pull request #43374 from ljflores/wip-remove-pool-name

mgr/telemetry: remove pool name from telemetry perf report

Reviewed-by: Yaarit Hatuka <yaarithatuka@gmail.com>

Merge pull request #43463 from Zhiwei-Dai/wip-enhance-qa-python3-compatibility

qa/tasks: replace iterkeys() with keys() for Python 3

Reviewed-by: Kefu Chai <tchaikov@gmail.com>

Merge pull request #43405 from ljflores/wip-perfcounter-priorities

os/bluestore: update perf counter priorities

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>

Merge pull request #43422 from ronen-fr/wip-rf-exact-time-sec

common/ceph_time: fix wrong seconds output in exact_timespan_str()

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
Reviewed-by: Kefu Chai <tchaikov@gmail.com>

Merge pull request #43515 from fengchunsong/dpdk-dev

msgs/async/dpdk: fix dpdk build error

Reviewed-by: Kefu Chai <tchaikov@gmail.com>

Merge pull request #43531 from tchaikov/wip-pick-addr

common/pick_address: refactor pick_addresses()

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

Merge pull request #43073 from strenuous-life/wip-cephadm-osd-rm-status

mgr/cephadm: the display of 'orch osd rm status' is incorrect

Reviewed-by: Sebastian Wagner <sewagner@redhat.com>

Merge pull request #43214 from batrick/i52654

pybind/mgr/cephadm: set allow_standby_replay during CephFS upgrade

Reviewed-by: Sage Weil <sage@newdream.net>
Reviewed-by: Sebastian Wagner <sewagner@redhat.com>

Merge pull request #43253 from guits/fix_orch_ls_osd

cephadm: fix osd size reported in 'orch ls'

Reviewed-by: Sebastian Wagner <sewagner@redhat.com>

Merge pull request #43339 from adk3798/volume-chunk

mgr/cephadm: use json-pretty for ceph-volume calls

Reviewed-by: Sage Weil <sage@newdream.net>

Merge PR #43517 into master

* refs/pull/43517/head:
doc / cephfs: health message codes should be permalinks

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #43538 from rzarzynski/wip-crimson-net-actual-bind-failure

crimson/osd: print the actual reason on bind failure.

Reviewed-by: Kefu Chai <tchaikov@gmail.com>

Merge pull request #42557 from ceph/feature-50336-cluster-creation-wizard

mgr/dashboard: Cluster Creation/Expansion Wizard

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: sebastian-philipp <NOT@FOUND>
Reviewed-by: Volker Theile <vtheile@suse.com>

Merge pull request #43453 from rhcs-dashboard/e2e-host-fix-teuth

mgr/dashboard: Fix orchestrator/01-hosts.e2e-spec.ts failure

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

src/msg/dpdk: reserve funcs capacity to avoid reallocation

When a new vector is added larger than then current vector capacity,
it reallocates space. lamda function accesses the previous adress will
cause a segment fault. Therefore, reserve sufficient funcs space to
avoid reallocation.

Fixes: https://tracker.ceph.com/issues/52907
Signed-off-by: Chunsong Feng <fengchunsong@huawei.com>

msgs/async/dpdk: fix dpdk build error

Signed-off-by: Chunsong Feng <fengchunsong@huawei.com>

crimson/osd: print the actual reason on bind failure.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

Merge pull request #43308 from TRYTOBE8TME/wip-rgw-post-object-upload

src/rgw: HTTP POST object upload

cmake: only pass --verbose when VERBOSE env variable is set

so that the setuptools is less chatty by default when building python
bindings.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>

common/pick_address: refactor pick_addresses()

* consolidate the logic handling CEPH_PICK_ADDRESS_PREFER_IPV4 using
  std::sort(). this might be overkill. but it helps to explain
  what CEPH_PICK_ADDRESS_PREFER_IPV4 is for, and helps to dedup
  the code to order the addresses.
* let fill_in_one_address() return an optional<entity_addrvec_t>.
  more readable this way
* early return if the required address is not found, instead of
  checking variables like ipv4_r
* rename fill_in_one_address() to get_one_address() to reflect
  the change of the function's return value's type

Signed-off-by: Kefu Chai <tchaikov@gmail.com>

doc / cephfs: health message codes should be permalinks

... so that such links can be included in alert warnings.

Additionally, document some other health warnings. Credit to @pcuzner
to point out that not all health warnings have been documented.

Signed-off-by: Venky Shankar <vshankar@redhat.com>

common/pick_address: use string_view when appropriate

we don't need a string when string_view is good enough.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>

Merge pull request #43526 from adk3798/disable-agent-default

mgr/cephadm: disable agent by default

Reviewed-by: Michael Fritch <mfritch@suse.com>

Merge PR #43049 into master

* refs/pull/43049/head:
mgr/rook: apply mds using placement spec and osd_pool_default_size
mgr/rook: factor out replica/failureDomain calc

Reviewed-by: Juan Miguel Olmo <jolmomar@redhat.com>

mgr/cephadm: disable agent by default

to avoid issues while it is stabilized

Signed-off-by: Adam King <adking@redhat.com>

Merge pull request #43490 from Daniel-Pivonka/cephadm-doc-adopt-sshuser

doc/cephadm: document setting ssh-user during adopt

Reviewed-by: Adam King <adking@redhat.com>

doc/cephadm: document setting ssh-user during adopt

Signed-off-by: Daniel Pivonka <dpivonka@redhat.com>

os/bluestore: update priorities and nicks of bluestore perf counters

These perf counters do not show up in telemetry unless they are set to a "useful" priority or higher. Fetching these counters in telemetry may help to diagnose problems with RocksDB / BlueFS prefetching / insufficient cache sizes.

Signed-off-by: Laura Flores <lflores@redhat.com>

Merge pull request #43377 from rhcs-dashboard/fix-clients-connection-query

 mgr/dashboard: replace "Ceph-cluster" Client connections with active-standby MGRs

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
Reviewed-by: neha-ojha <NOT@FOUND>
Reviewed-by: Nizamudeen A <nia@redhat.com>

mgr/dashboard: Cluster expansion e2e cleanups

Fixes: https://tracker.ceph.com/issues/52645
Signed-off-by: Nizamudeen A <nia@redhat.com>

mgr/dashboard: introduce gather facts in host list

Fixes: https://tracker.ceph.com/issues/52017
Signed-off-by: Avan Thakkar <athakkar@redhat.com>

mgr/dashboard: Cluster Creation Add Services Section

Add Services section in cluster creation wizard
Create Cluster OSD Section Followups

1. The device preview disappearing when going to next step and coming back to the previous step
2. Even when clearing the device preview, the Storage Capacity count and the drive group spec doesn't get cleared.
3. Expanding the cluster without selecting any devices gives a 400
   error.
4. Renamed "Delete Host" to "Remove Host"
5. Generalizing most of the sub component code

Fixes: https://tracker.ceph.com/issues/52499
Fixes: https://tracker.ceph.com/issues/51991
Signed-off-by: Nizamudeen A <nia@redhat.com>
Signed-off-by: Aashish Sharma <aasharma@redhat.com>

mgr/dashboard: Cluster Creation Create OSDs Section

Create OSDs section in cluster creation wizard

Fixes: https://tracker.ceph.com/issues/51991
Fixes: https://tracker.ceph.com/issues/52298
Signed-off-by: Nizamudeen A <nia@redhat.com>
Signed-off-by: Aashish Sharma <aasharma@redhat.com>

mgr/dashboard: Review Section for the Create Cluster Workflow

Fixes: https://tracker.ceph.com/issues/50566
Signed-off-by: Avan Thakkar <athakkar@redhat.com>

mgr/dashboard: Cluster Creation Add Host Section and e2es

Add host section of the cluster creation workflow.

1. Fix bug in the modal where going forward one step on the wizard and coming back opens up the add host modal.
2. Rename Create Cluster to Expand Cluster as per the discussions
3. A skip confirmation modal to warn the user when he tries to skip the
   cluster creation
4. Adapted all the tests
5. Did some UI improvements like fixing and aligning the styles,
   colors..
- Used routed modal for host Additon form
- Renamed the Create to Add in Host Form

Fixes: https://tracker.ceph.com/issues/51517
Fixes: https://tracker.ceph.com/issues/51640
Fixes: https://tracker.ceph.com/issues/50336
Fixes: https://tracker.ceph.com/issues/50565
Signed-off-by: Avan Thakkar <athakkar@redhat.com>
Signed-off-by: Aashish Sharma <aasharma@redhat.com>
Signed-off-by: Nizamudeen A <nia@redhat.com>

mgr/dashboard: Create Cluster Workflow welcome screen and e2e tests

A module option called CLUSTER_STATUS has two option. INSTALLED
AND POST_INSTALLED. When CLUSTER_STATUS is INSTALLED it will allow to show the
create-cluster-wizard after login the initial time.  After the cluster
creation is succesfull this option is set to POST_INSTALLED
Also has the e2e codes for the Review Section

Fixes: https://tracker.ceph.com/issues/50336
Signed-off-by: Avan Thakkar <athakkar@redhat.com>
Signed-off-by: Nizamudeen A <nia@redhat.com>

src/test: HTTP POST object upload

This solves the tracker: https://tracker.ceph.com/issues/51724
Basically it is using 'generate_presigned_post()' boto3 API.
This is verified under AMQP endpoint.

Signed-off-by: Kalpesh Pandya <kapandya@redhat.com>

Merge pull request #43500 from rzarzynski/wip-crimson-interruptible-condalias

crimson: osd operations respect interruptor's InterruptCondition.

Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #43501 from rzarzynski/wip-crimson-parse-env

crimson: respect the CEPH_ARGS environment variable.

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #43274 from pcuzner/add-mib

monitoring:Adding the Ceph MIB

Reviewed-by: Sebastian Wagner <sewagner@redhat.com>

Merge pull request #43509 from ceph/revert-43462-wip-test-erasure-code-for-aarch64

Revert "qa: support isal ec test for aarch64"

Reviewed-by: Greg Farnum <gfarnum@redhat.com>

Revert "qa: support isal ec test for aarch64"

This commit has been causing scheduled jobs to request e.g. aarch64
smithi machines, which don't exist. The dispatcher then tries to find them forever, requiring the dispatcher to be killed and restarted. The queue
will sit idle until someone notices the problem.

Signed-off-by: Zack Cerza <zack@redhat.com>

rgw: raise log level of http client headers

these messages are especially spammy because the http client's dout
prefix includes the entire request path:

2021-10-12T04:53:39.281+0000 7f66a0ff9700 10 http_client[POST/http://example.com/admin/log?type=data&notify2&source-zone=3a571642-9f5e-46d8-8186-9eca8cc79ac6&rgwx-zonegroup=8f3b29b1-ffc6-4c90-9d0c-9bd258028cd8]receive_http_header
2021-10-12T04:53:39.281+0000 7f66a0ff9700 10 http_client[POST/http://example.com/admin/log?type=data&notify2&source-zone=3a571642-9f5e-46d8-8186-9eca8cc79ac6&rgwx-zonegroup=8f3b29b1-ffc6-4c90-9d0c-9bd258028cd8]received header:HTTP/1.1 501 Not Implemented
2021-10-12T04:53:39.281+0000 7f66a0ff9700 10 http_client[POST/http://example.com/admin/log?type=data&notify2&source-zone=3a571642-9f5e-46d8-8186-9eca8cc79ac6&rgwx-zonegroup=8f3b29b1-ffc6-4c90-9d0c-9bd258028cd8]receive_http_header
2021-10-12T04:53:39.281+0000 7f66a0ff9700 10 http_client[POST/http://example.com/admin/log?type=data&notify2&source-zone=3a571642-9f5e-46d8-8186-9eca8cc79ac6&rgwx-zonegroup=8f3b29b1-ffc6-4c90-9d0c-9bd258028cd8]received header:Content-Length: 108
2021-10-12T04:53:39.281+0000 7f66a0ff9700 10 http_client[POST/http://example.com/admin/log?type=data&notify2&source-zone=3a571642-9f5e-46d8-8186-9eca8cc79ac6&rgwx-zonegroup=8f3b29b1-ffc6-4c90-9d0c-9bd258028cd8]receive_http_header
2021-10-12T04:53:39.281+0000 7f66a0ff9700 10 http_client[POST/http://example.com/admin/log?type=data&notify2&source-zone=3a571642-9f5e-46d8-8186-9eca8cc79ac6&rgwx-zonegroup=8f3b29b1-ffc6-4c90-9d0c-9bd258028cd8]received header:x-amz-request-id: tx00000000000000027e9ba-00616514d3-70a3-east
2021-10-12T04:53:39.281+0000 7f66a0ff9700 10 http_client[POST/http://example.com/admin/log?type=data&notify2&source-zone=3a571642-9f5e-46d8-8186-9eca8cc79ac6&rgwx-zonegroup=8f3b29b1-ffc6-4c90-9d0c-9bd258028cd8]receive_http_header
2021-10-12T04:53:39.281+0000 7f66a0ff9700 10 http_client[POST/http://example.com/admin/log?type=data&notify2&source-zone=3a571642-9f5e-46d8-8186-9eca8cc79ac6&rgwx-zonegroup=8f3b29b1-ffc6-4c90-9d0c-9bd258028cd8]received header:Accept-Ranges: bytes
2021-10-12T04:53:39.281+0000 7f66a0ff9700 10 http_client[POST/http://example.com/admin/log?type=data&notify2&source-zone=3a571642-9f5e-46d8-8186-9eca8cc79ac6&rgwx-zonegroup=8f3b29b1-ffc6-4c90-9d0c-9bd258028cd8]receive_http_header
2021-10-12T04:53:39.281+0000 7f66a0ff9700 10 http_client[POST/http://example.com/admin/log?type=data&notify2&source-zone=3a571642-9f5e-46d8-8186-9eca8cc79ac6&rgwx-zonegroup=8f3b29b1-ffc6-4c90-9d0c-9bd258028cd8]received header:Content-Type: application/json
2021-10-12T04:53:39.281+0000 7f66a0ff9700 10 http_client[POST/http://example.com/admin/log?type=data&notify2&source-zone=3a571642-9f5e-46d8-8186-9eca8cc79ac6&rgwx-zonegroup=8f3b29b1-ffc6-4c90-9d0c-9bd258028cd8]receive_http_header
2021-10-12T04:53:39.281+0000 7f66a0ff9700 10 http_client[POST/http://example.com/admin/log?type=data&notify2&source-zone=3a571642-9f5e-46d8-8186-9eca8cc79ac6&rgwx-zonegroup=8f3b29b1-ffc6-4c90-9d0c-9bd258028cd8]received header:Date: Tue, 12 Oct 2021 04:53:39 GMT
2021-10-12T04:53:39.281+0000 7f66a0ff9700 10 http_client[POST/http://example.com/admin/log?type=data&notify2&source-zone=3a571642-9f5e-46d8-8186-9eca8cc79ac6&rgwx-zonegroup=8f3b29b1-ffc6-4c90-9d0c-9bd258028cd8]receive_http_header

raise to 30 so they're only enabled for super-verbose logging

Signed-off-by: Casey Bodley <cbodley@redhat.com>

rgw: raise log level of realm/zonegroup/zone output on startup

this output shows up in all radosgw-admin commands, and isn't relevant
to most of them

Signed-off-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #43492 from xxhdx1985126/wip-52894

crimson/os/seastore: set ExtentPlacementManager::allocated_to before rolling segments

Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>

mgr/dashboard: Fix orchestrator/01-hosts.e2e-spec.ts failure

The test is failing on deleting a host because the agent daemon is
present in that host. Its not possible to simply delete a host. We need
to drain it first and then delete it.

Fixes: https://tracker.ceph.com/issues/52764
Signed-off-by: Nizamudeen A <nia@redhat.com>

crimson: respect the CEPH_ARGS environment variable.

Rook uses `CEPH_ARGS` to convey the `mon_host` configurable. Lack of
support for it was the root cause of inability to reach out to monitors.

See: https://gist.github.com/rzarzynski/95746aa73a48e811749a3b0aaeb31680#gistcomment-3924233.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

crimson/osd: rectify a coding style issue in PglogBasedRecovery::do_recovery().

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

crimson: osd operations respect interruptor's InterruptCondition.

For the sake of DRY.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

os/bluestore: _do_write_small fix head_pad

Signed-off-by: dheart <dheart_joe@163.com>

cephadm: expose gather-facts api method

Fixes: https://tracker.ceph.com/issues/51209
This PR intends to expose host metadata(gather-facts) api method

Signed-off-by: Avan Thakkar <athakkar@redhat.com>
Signed-off-by: Aashish Sharma <aasharma@redhat.com>

Merge pull request #42052 from TRYTOBE8TME/wip-rgw-dpp-3

rgw: DPP addition 4

Reviewed-by: Ali Maredia <amaredia@redhat.com>

Merge pull request #43181 from xxhdx1985126/wip-extent-placement-manager-multi-device-3

crimson/os/seastore: add multi-device support

Reviewed-by: Samuel Just <sjust@redhat.com>

crimson/os/seastore: set ExtentPlacementManager::allocated_to before rolling segments

There are circumstances in which a transaction that are supposed to roll the current segment
is invalidated after it finished writing and before it rolls the segment. If we don't set
ExtentPlacementManager::allocated_to in this situation, another transaction can try to write
to the old "allocated_to" position, which would cause an invalid write error

Fixes: https://tracker.ceph.com/issues/52894
Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>

Merge pull request #43449 from rzarzynski/wip-crimson-interruptible-peeringevent

crimson/osd: implement interruptions in PeeringEvent.

Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>
Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #43483 from cyx1231st/wip-seastore-record-header-fullness

crimson/os/seastore: measure inline/ool record header fullness

Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>
Reviewed-by: Samuel Just <sjust@redhat.com>

radosgw-admin: 'reshard list' doesn't log ENOENT errors

ENOENT errors are expected, especially in fresh clusters, before we've
written any entries to the reshard list shards. avoid logging these
non-fatal ERROR messages:

> -1 ERROR: failed to list reshard log entries, oid=reshard.0000000000 marker= (2) No such file or directory

Fixes: https://tracker.ceph.com/issues/52873
Signed-off-by: Casey Bodley <cbodley@redhat.com>

mgr/rook: apply mds using placement spec and osd_pool_default_size

This commit changes the apply_mds command in the rook orchestrator
to support some placement specs and also sets the replica size according
to the osd_pool_default_size ceph option.

This commit also adds `orch apply mds` to the QA to test if the command
runs.

Signed-off-by: Joseph Sawaya <jsawaya@redhat.com>