Merge pull request #46301 from rkachach/fix_issue_55685

mgr/cephadm: adding support to copy ceph conf to per fsid config location

Reviewed-by: Adam King <adking@redhat.com>

Merge pull request #46054 from rkachach/fix_issue_55466

mgr/cephadm: fix unit.stop for ceph daemons

Reviewed-by: Adam King <adking@redhat.com>

Merge pull request #46129 from rkachach/fix_issue_ssh

mgr/cephadm: Adding an early ssh connectivity check during bootsrap

Reviewed-by: Adam King <adking@redhat.com>

Merge pull request #45951 from rhcs-dashboard/feature-set-login-banner

mgr/dashboard: customizable log-in page text/banner

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>

Merge pull request #46067 from sumedhak27/fix/user-policy/response-correction

rgw_rest_user_policy: Fix GetUserPolicy & ListUserPolicies responses

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
Reviewed-by: Pritha Srivastava <prsrivas@redhat.com>

Merge pull request #46008 from soumyakoduri/wip-skoduri-cloudtier-tests

rgw/qa: enable s3-tests related to cloud-transition feature

Reviewed-by: casey Bodley <cbodley@redhat.com>
Reviewed-by: Maredia, Ali <amaredia@redhat.com>

Merge pull request #46334 from athanatos/sjust/wip-55706

crimson: clarify use of tm_make_config_t

Reviewed-by: Myoungwon Oh <myoungwon.oh@samsung.com>
Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>

rgw/qa: Run tests on multiple cloudtier config

Run cloudtier tests with parameter 'retain_head_object'
set to true and false.

However having multiple cloudtier storage classes in the same task
is increasing the transition time and resulting in spurious failures.
Hence until there is a consistent way of running the tests, without
having to depend on lc_debug_interval, disabled one of the config for
now.

Signed-off-by: Soumya Koduri <skoduri@redhat.com>

crimson: clarify use of tm_make_config_t

Fixes: https://tracker.ceph.com/issues/55706
Introduced: 9fe59429fc2ef17e2bec329109713eb63ffc74c9
Signed-off-by: Samuel Just <sjust@redhat.com>

Merge pull request #46329 from ceph/1629

doc: 16.2.9 Release notes

Merge pull request #44233 from myoungwon/wip-add-rbm-inline-outline-alloc

seastore: add CircularBoundedJournal

Reviewed-by: Samuel Just <sjust@redhat.com>

seastore/cbjournal: add a log if crc is mismatched

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore/cbjournal: add assert(initialized), revmoving open_device_read_header()

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore/cbjournal: rename init to initialized

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore/cbjournal: move written_to from the header to CBJournal

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore/cbjournal: remove header_checksum field and add calculating header checkksum

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore: use config value and avoid passing a hint

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore: rename journal_type to journal_type_t

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

test/cbjournal: do rb_device.reset() unconditionally

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

test/seastore: use tm_make_config_t to get default_placement_hint

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

test/seastore: return journal type with less lines

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore: add a log line after set_disable_trim is called

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore: add the comment to explain disable_trim

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore: add space between ) and {

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore: add a comment (blk_paddr_t is absolute)

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore: do assert if paddr type is not SEGMENT in add_relative

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore: rollback a change (paddr_t -> auto)

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore/cbjournal: fix comment to explain the condition in detail

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore/cbjournal: make open_device_read_header not to be called if init is true

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore/cbjournal: rename open_for_write to open_device_read_header

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore/cbjournal: add comment to explain initialized

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore/cbjournal: remove unused field

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore/cbjournal: add writev to submit writes with aligned buffers

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore/cbjournal: use journal_tail instead of applied_to to track journal tail

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore/cbjournal: remove start and end fields in cbjournal header

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore/cbjournal: remove error field

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore/cbjournal: change comment for block_size

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

test/cbjournal: fix wrong device id

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore/cbjournal: remove used_size in header

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore/cbjournal: rename csum to header_checksum and remove csum_type

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore/cbjournal: use cur_segment_seq to track the sequence of written records

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore: use config_t instead of parameter in make_transaction_manager

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore: make journal_seq_t.cmp compatible with blk_paddr_t

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore: add disable_trim parameter to segment_cleaner for cbjournal testing

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore: add add_record_relative to blk_paddr to handle adjust_addrs_from_base correctly

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore: fix maybe_relarive_to in paddr_t to handle the both addrs transparently

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore: add maybe_relative_to in blk_paddr_t

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore: replace set_*_off with add_offset to handle transparently

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore: fix add_relative to work corretly in case of blk addr

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore/cbjournal: remove last_committed_record_base

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore: add more explanation regarding how CBJournal works

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore: recover header's variable correctly without storing it

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore: read records until find invalid entry and recover variables

To do not loss last_committed_record and written_to at shutdown,
this commit update the most recent value correctly during replay.

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore: rename *_super to *_header and use it as helper functions

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore: move value initialization to the default constructor

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore: use const in mkfs()

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore: enable cbjournal when running unittest_transaction_manager

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

test: add unit tests for CircularBoundedJournal

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seatore: add CircularBoundedJournal

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

Merge pull request #46151 from cbodley/wip-rgw-derr-config-store

rgw: remove cerr config_store from rgw_common.cc

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>

Merge pull request #46148 from smanjara/wip-smanjara-metadata-sync-fix

rgw multisite: complete fix for metadata sync issue

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #46141 from sumedhak27/rgw_rest_bucket/support_max-size_attr

rgw_rest_bucket: Support max-size attr for SetBucketQuota REST API

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>

Merge pull request #46232 from cbodley/wip-qa-rgw-sse

qa/rgw: use 'with-sse-s3' override for s3tests

Reviewed-by: Ali Maredia <amaredia@redhat.com>

Merge pull request #46152 from cbodley/wip-55548

radosgw-admin: don't crash on --placement-id without --storage-class

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>

doc: 16.2.9 Release notes

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #46056 from ceph/wip-yuriw-release-16.2.8-master

doc: 16.2.8 Release Notes

Merge pull request #46167 from dang/wip-dang-nosuchtagset

RGW - Fix NoSuchTagSet error

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #44013 from adk3798/use-old-addr

mgr/cephadm: re-use old ip when re-adding hosts if necessary

Reviewed-by: Redouane Kachach <rkachach@redhat.com>

Merge pull request #46088 from pcuzner/cephadm_mpath_support

cephadm: Add support for mpath devices to gather-facts

Reviewed-by: Adam King <adking@redhat.com>

Merge pull request #46315 from zdover23/wip-doc-2022-05-18-intro-3-to-three

doc/start: s/3/three/ in intro.rst

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #46306 from rkachach/fix_issue_55638

mgr/cephadm: stripping out / from the end of the url

Reviewed-by: Adam King <adking@redhat.com>

Merge pull request #46291 from adk3798/move-active-mgr

mgr/cephadm: force fail over when we want to remove active mgr

Reviewed-by: Redouane Kachach <rkachach@redhat.com>

Merge pull request #46303 from rkachach/fix_issue_55641

mgr/cephadm: do not use sudo for root user

Reviewed-by: Adam King <adking@redhat.com>

doc/start: s/3/three/ in intro.rst

I'm changing "3" to "three" for two reasons:

1. It's correct.
2. This allows me to test backports into Octopus, Pacific, and Quincy.
   I am particularly interested to see what happens when I attempt
   the backport into Octopus, because backports into Octopus have
   failed. This will provide me with another unit of data.

Signed-off-by: Zac Dover <zac.dover@gmail.com>

mgr/cephadm: adding support to copy ceph conf to per fsid config location
Fixes: https://tracker.ceph.com/issues/55685
Signed-off-by: Redouane Kachach <rkachach@redhat.com>

Merge pull request #46163 from rkachach/fix_issue_55556

mgr/cephadm: fixing ipv6 handling during bootstrap

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: John Mulligan <jmulligan@redhat.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>

Merge pull request #46202 from rkachach/fix_issue_51257

mgr/cephadm: fixing ipv6/128 and ipv4/32 subnets handling

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: John Mulligan <jmulligan@redhat.com>

Merge pull request #46207 from rkachach/fix_issue_55555

mgr/cephadm: fixing yaml parsing during bootstrap

Reviewed-by: Adam King <adking@redhat.com>

Merge pull request #46218 from votdev/issue_55595_prometheus_external_url

cephadm: prometheus: The generatorURL in alerts is only using hostname

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
Reviewed-by: Redouane Kachach <rkachach@redhat.com>

Merge pull request #46222 from adk3798/dont-use-non-cluster-cached-conns

mgr/cephadm: don't use cached conns for hosts not in cluster

Reviewed-by: Michael Fritch <mfritch@suse.com>
Reviewed-by: Redouane Kachach <rkachach@redhat.com>

Merge pull request #46245 from adk3798/revert-call-changes

cephadm: Revert "mgr/cephadm: fixing call method timeout handling"

Reviewed-by: Michael Fritch <mfritch@suse.com>
Reviewed-by: Redouane Kachach <rkachach@redhat.com>

Merge pull request #46264 from adk3798/adopt-custom-name-osd

cephadm: fix adoption of osds from custom name clusters

Reviewed-by: Redouane Kachach <rkachach@redhat.com>

Merge pull request #46305 from zdover23/wip-doc-2022-05-17-basic-workflow-integration-tests

doc/dev: refine basic-workflow.rst integ. test

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc/dev: refine basic-workflow.rst integ. test

This is one in a set of PRs meant to keep the Basic
Workflow in the Developer guide current. It refines
the English in the "Integration Tests AKA ceph-qa-suite"
section of "Basic Workflow".

Several other small updates like this are expected. I
intend to avoid refining half of the page in one commit,
as I did last month when I refined the first half of the
basic workflow.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@gmail.com>

mgr/cephadm: stripping out / from the end of the url
Fixes: https://tracker.ceph.com/issues/55638
Signed-off-by: Redouane Kachach <rkachach@redhat.com>

rgw/qa: Add separate task for cloudtier tests

Signed-off-by: Soumya Koduri <skoduri@redhat.com>

rgw/qa: enable s3-tests related to cloud-transition feature

Added a new test-suite to configure cloudtier storage class and run related s3-tests.

Signed-off-by: Soumya Koduri <skoduri@redhat.com>

Merge pull request #46298 from cyx1231st/wip-seastore-add-metrics

crimson/os/seastore: add and fix metrics to reveal internal activities

Reviewed-by: Xuehan Xu <xxhdx1985126@gmail.com>

Merge pull request #46176 from athanatos/sjust/wip-55563

vstart: default CEPH_ASOK_DIR to asok/

Reviewed-by: Milind Changire <mchangir@redhat.com>

doc: updated release date

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>

mgr/cephadm: do not use sudo for root user
Fixes: https://tracker.ceph.com/issues/55641
Signed-off-by: Redouane Kachach <rkachach@redhat.com>

Merge pull request #45313 from rhcs-dashboard/unselect-datatable-row

mgr/dashboard: unselect rows in datatables

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
Reviewed-by: Yuri Weinstein <yweins@redhat.com>

crimson/os/seastore: adjust logs to FixedKVBtree

* Fix the subsys name.
* Change FixedKVBtree logs to trace level -- seems too verbose when the
  global level is debug.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>

crimson/os/seastore: add metrics for extent rewrite version

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>

crimson/os/seastore: improve and fix tree metrics

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>

crimson/os/seastore/segment_cleaner: add metrics about journal sizes

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>

crimson/os/seastore/segment_cleaner: add metrics about why IO is blocking

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>

Merge pull request #46292 from anthonyeleven/anthonyeleven/clarify-min-alloc-size2

doc/rados/configuration: clarify VMware note in bluestore-config-ref.rst

Reviewed-by: Zac Dover <zac.dover@gmail.com>

doc/rados/configuration: clarify VMware note in bluestore-config-ref.rst

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>

mgr/cephadm: force fail over when we want to remove active mgr

Fixes: https://tracker.ceph.com/issues/55679
Signed-off-by: Adam King <adking@redhat.com>