crimson: generalize journal_seq_t to tolerate different paddr_t types

Introduced: bdc1c1490ff11269c7808e762893fcbdea3a0503
Fixes: https://tracker.ceph.com/issues/55706
Signed-off-by: Samuel Just <sjust@redhat.com>

Merge pull request #46329 from ceph/1629

doc: 16.2.9 Release notes

Merge pull request #44233 from myoungwon/wip-add-rbm-inline-outline-alloc

seastore: add CircularBoundedJournal

Reviewed-by: Samuel Just <sjust@redhat.com>

seastore/cbjournal: add a log if crc is mismatched

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore/cbjournal: add assert(initialized), revmoving open_device_read_header()

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore/cbjournal: rename init to initialized

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore/cbjournal: move written_to from the header to CBJournal

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore/cbjournal: remove header_checksum field and add calculating header checkksum

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore: use config value and avoid passing a hint

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore: rename journal_type to journal_type_t

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

test/cbjournal: do rb_device.reset() unconditionally

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

test/seastore: use tm_make_config_t to get default_placement_hint

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

test/seastore: return journal type with less lines

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore: add a log line after set_disable_trim is called

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore: add the comment to explain disable_trim

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore: add space between ) and {

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore: add a comment (blk_paddr_t is absolute)

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore: do assert if paddr type is not SEGMENT in add_relative

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore: rollback a change (paddr_t -> auto)

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore/cbjournal: fix comment to explain the condition in detail

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore/cbjournal: make open_device_read_header not to be called if init is true

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore/cbjournal: rename open_for_write to open_device_read_header

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore/cbjournal: add comment to explain initialized

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore/cbjournal: remove unused field

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore/cbjournal: add writev to submit writes with aligned buffers

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore/cbjournal: use journal_tail instead of applied_to to track journal tail

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore/cbjournal: remove start and end fields in cbjournal header

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore/cbjournal: remove error field

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore/cbjournal: change comment for block_size

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

test/cbjournal: fix wrong device id

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore/cbjournal: remove used_size in header

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore/cbjournal: rename csum to header_checksum and remove csum_type

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore/cbjournal: use cur_segment_seq to track the sequence of written records

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore: use config_t instead of parameter in make_transaction_manager

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore: make journal_seq_t.cmp compatible with blk_paddr_t

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore: add disable_trim parameter to segment_cleaner for cbjournal testing

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore: add add_record_relative to blk_paddr to handle adjust_addrs_from_base correctly

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore: fix maybe_relarive_to in paddr_t to handle the both addrs transparently

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore: add maybe_relative_to in blk_paddr_t

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore: replace set_*_off with add_offset to handle transparently

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore: fix add_relative to work corretly in case of blk addr

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore/cbjournal: remove last_committed_record_base

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore: add more explanation regarding how CBJournal works

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore: recover header's variable correctly without storing it

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore: read records until find invalid entry and recover variables

To do not loss last_committed_record and written_to at shutdown,
this commit update the most recent value correctly during replay.

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore: rename *_super to *_header and use it as helper functions

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore: move value initialization to the default constructor

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore: use const in mkfs()

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore: enable cbjournal when running unittest_transaction_manager

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

test: add unit tests for CircularBoundedJournal

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seatore: add CircularBoundedJournal

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

Merge pull request #46151 from cbodley/wip-rgw-derr-config-store

rgw: remove cerr config_store from rgw_common.cc

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>

Merge pull request #46148 from smanjara/wip-smanjara-metadata-sync-fix

rgw multisite: complete fix for metadata sync issue

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #46141 from sumedhak27/rgw_rest_bucket/support_max-size_attr

rgw_rest_bucket: Support max-size attr for SetBucketQuota REST API

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>

Merge pull request #46232 from cbodley/wip-qa-rgw-sse

qa/rgw: use 'with-sse-s3' override for s3tests

Reviewed-by: Ali Maredia <amaredia@redhat.com>

Merge pull request #46152 from cbodley/wip-55548

radosgw-admin: don't crash on --placement-id without --storage-class

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>

doc: 16.2.9 Release notes

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #46056 from ceph/wip-yuriw-release-16.2.8-master

doc: 16.2.8 Release Notes

Merge pull request #46167 from dang/wip-dang-nosuchtagset

RGW - Fix NoSuchTagSet error

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #44013 from adk3798/use-old-addr

mgr/cephadm: re-use old ip when re-adding hosts if necessary

Reviewed-by: Redouane Kachach <rkachach@redhat.com>

Merge pull request #46088 from pcuzner/cephadm_mpath_support

cephadm: Add support for mpath devices to gather-facts

Reviewed-by: Adam King <adking@redhat.com>

Merge pull request #46315 from zdover23/wip-doc-2022-05-18-intro-3-to-three

doc/start: s/3/three/ in intro.rst

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #46306 from rkachach/fix_issue_55638

mgr/cephadm: stripping out / from the end of the url

Reviewed-by: Adam King <adking@redhat.com>

Merge pull request #46291 from adk3798/move-active-mgr

mgr/cephadm: force fail over when we want to remove active mgr

Reviewed-by: Redouane Kachach <rkachach@redhat.com>

Merge pull request #46303 from rkachach/fix_issue_55641

mgr/cephadm: do not use sudo for root user

Reviewed-by: Adam King <adking@redhat.com>

doc/start: s/3/three/ in intro.rst

I'm changing "3" to "three" for two reasons:

1. It's correct.
2. This allows me to test backports into Octopus, Pacific, and Quincy.
   I am particularly interested to see what happens when I attempt
   the backport into Octopus, because backports into Octopus have
   failed. This will provide me with another unit of data.

Signed-off-by: Zac Dover <zac.dover@gmail.com>

Merge pull request #46163 from rkachach/fix_issue_55556

mgr/cephadm: fixing ipv6 handling during bootstrap

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: John Mulligan <jmulligan@redhat.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>

Merge pull request #46202 from rkachach/fix_issue_51257

mgr/cephadm: fixing ipv6/128 and ipv4/32 subnets handling

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: John Mulligan <jmulligan@redhat.com>

Merge pull request #46207 from rkachach/fix_issue_55555

mgr/cephadm: fixing yaml parsing during bootstrap

Reviewed-by: Adam King <adking@redhat.com>

Merge pull request #46218 from votdev/issue_55595_prometheus_external_url

cephadm: prometheus: The generatorURL in alerts is only using hostname

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
Reviewed-by: Redouane Kachach <rkachach@redhat.com>

Merge pull request #46222 from adk3798/dont-use-non-cluster-cached-conns

mgr/cephadm: don't use cached conns for hosts not in cluster

Reviewed-by: Michael Fritch <mfritch@suse.com>
Reviewed-by: Redouane Kachach <rkachach@redhat.com>

Merge pull request #46245 from adk3798/revert-call-changes

cephadm: Revert "mgr/cephadm: fixing call method timeout handling"

Reviewed-by: Michael Fritch <mfritch@suse.com>
Reviewed-by: Redouane Kachach <rkachach@redhat.com>

Merge pull request #46264 from adk3798/adopt-custom-name-osd

cephadm: fix adoption of osds from custom name clusters

Reviewed-by: Redouane Kachach <rkachach@redhat.com>

Merge pull request #46305 from zdover23/wip-doc-2022-05-17-basic-workflow-integration-tests

doc/dev: refine basic-workflow.rst integ. test

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc/dev: refine basic-workflow.rst integ. test

This is one in a set of PRs meant to keep the Basic
Workflow in the Developer guide current. It refines
the English in the "Integration Tests AKA ceph-qa-suite"
section of "Basic Workflow".

Several other small updates like this are expected. I
intend to avoid refining half of the page in one commit,
as I did last month when I refined the first half of the
basic workflow.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@gmail.com>

mgr/cephadm: stripping out / from the end of the url
Fixes: https://tracker.ceph.com/issues/55638
Signed-off-by: Redouane Kachach <rkachach@redhat.com>

Merge pull request #46298 from cyx1231st/wip-seastore-add-metrics

crimson/os/seastore: add and fix metrics to reveal internal activities

Reviewed-by: Xuehan Xu <xxhdx1985126@gmail.com>

Merge pull request #46176 from athanatos/sjust/wip-55563

vstart: default CEPH_ASOK_DIR to asok/

Reviewed-by: Milind Changire <mchangir@redhat.com>

doc: updated release date

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>

mgr/cephadm: do not use sudo for root user
Fixes: https://tracker.ceph.com/issues/55641
Signed-off-by: Redouane Kachach <rkachach@redhat.com>

Merge pull request #45313 from rhcs-dashboard/unselect-datatable-row

mgr/dashboard: unselect rows in datatables

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
Reviewed-by: Yuri Weinstein <yweins@redhat.com>

crimson/os/seastore: adjust logs to FixedKVBtree

* Fix the subsys name.
* Change FixedKVBtree logs to trace level -- seems too verbose when the
  global level is debug.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>

crimson/os/seastore: add metrics for extent rewrite version

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>

crimson/os/seastore: improve and fix tree metrics

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>

crimson/os/seastore/segment_cleaner: add metrics about journal sizes

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>

crimson/os/seastore/segment_cleaner: add metrics about why IO is blocking

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>

Merge pull request #46292 from anthonyeleven/anthonyeleven/clarify-min-alloc-size2

doc/rados/configuration: clarify VMware note in bluestore-config-ref.rst

Reviewed-by: Zac Dover <zac.dover@gmail.com>

doc/rados/configuration: clarify VMware note in bluestore-config-ref.rst

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>

mgr/cephadm: force fail over when we want to remove active mgr

Fixes: https://tracker.ceph.com/issues/55679
Signed-off-by: Adam King <adking@redhat.com>

Merge pull request #46265 from ivancich/wip-misplaced-dout_subsys-def

rgw: remove potentially conficting definition of dout_subsys

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>

docs: updated Change Log PRs

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>

Merge pull request #46158 from cyx1231st/wip-seastore-cleaner

crimson/os/seastore/segment_cleaner: misc cleanups and improvements

Reviewed-by: Samuel Just <sjust@redhat.com>

mgr/dashboard: unselect rows in datatables

Fixes: https://tracker.ceph.com/issues/53244
Signed-off-by: Sarthak0702 <sarthak.0702@gmail.com>

Merge pull request #45662 from zenomri/wip-cond-tracing

rgw: support conditional tracing using lua script

Reviewed-by: Casey Bodley <cbodley@redhat.com>, Yuval Lifshitz <ylifshit@redhat.com>

Merge pull request #46274 from xxhdx1985126/wip-admin-sock

crimson/admin: deal with seastar's new metric types/logics

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Reviewed-by: Kefu Chai <tchaikov@gmail.com>

crimson/admin: deal with seastar's new metric types/logics

Fixes: https://tracker.ceph.com/issues/55666
Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>

Merge pull request #45962 from ronen-fr/wip-rf-sbe-test2

test/osd: test environment for the scrubber "backend"

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Matan Breizman <mbreizma@redhat.com>

Merge pull request #46270 from anthonyeleven/anthonyeleven/clarify-min-alloc-size

mgr/cephadm: unit test for re-adding host and receiving loopback address

Signed-off-by: Adam King <adking@redhat.com>

mgr/cephadm: re-use old ip when re-adding hosts if necessary

When a host is re-added without an explicit ip we can default to the old
ip we had stored for the host rather than either keeping the loopback
address or throwing an exception. We only want to actually error when
the only options left are error or use a resolved loopback address

Fixes: https://tracker.ceph.com/issues/53438
Signed-off-by: Adam King <adking@redhat.com>