seastore/cbjournal: change comment for block_size

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

test/cbjournal: fix wrong device id

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore/cbjournal: remove used_size in header

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore/cbjournal: rename csum to header_checksum and remove csum_type

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore/cbjournal: use cur_segment_seq to track the sequence of written records

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore: use config_t instead of parameter in make_transaction_manager

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore: make journal_seq_t.cmp compatible with blk_paddr_t

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore: add disable_trim parameter to segment_cleaner for cbjournal testing

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore: add add_record_relative to blk_paddr to handle adjust_addrs_from_base correctly

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore: fix maybe_relarive_to in paddr_t to handle the both addrs transparently

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore: add maybe_relative_to in blk_paddr_t

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore: replace set_*_off with add_offset to handle transparently

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore: fix add_relative to work corretly in case of blk addr

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore/cbjournal: remove last_committed_record_base

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore: add more explanation regarding how CBJournal works

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore: recover header's variable correctly without storing it

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore: read records until find invalid entry and recover variables

To do not loss last_committed_record and written_to at shutdown,
this commit update the most recent value correctly during replay.

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore: rename *_super to *_header and use it as helper functions

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore: move value initialization to the default constructor

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore: use const in mkfs()

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seastore: enable cbjournal when running unittest_transaction_manager

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

test: add unit tests for CircularBoundedJournal

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

seatore: add CircularBoundedJournal

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>

Merge pull request #46151 from cbodley/wip-rgw-derr-config-store

rgw: remove cerr config_store from rgw_common.cc

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>

Merge pull request #46148 from smanjara/wip-smanjara-metadata-sync-fix

rgw multisite: complete fix for metadata sync issue

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #46141 from sumedhak27/rgw_rest_bucket/support_max-size_attr

rgw_rest_bucket: Support max-size attr for SetBucketQuota REST API

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>

Merge pull request #46232 from cbodley/wip-qa-rgw-sse

qa/rgw: use 'with-sse-s3' override for s3tests

Reviewed-by: Ali Maredia <amaredia@redhat.com>

Merge pull request #46152 from cbodley/wip-55548

radosgw-admin: don't crash on --placement-id without --storage-class

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>

Merge pull request #46056 from ceph/wip-yuriw-release-16.2.8-master

doc: 16.2.8 Release Notes

Merge pull request #46167 from dang/wip-dang-nosuchtagset

RGW - Fix NoSuchTagSet error

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #44013 from adk3798/use-old-addr

mgr/cephadm: re-use old ip when re-adding hosts if necessary

Reviewed-by: Redouane Kachach <rkachach@redhat.com>

Merge pull request #46088 from pcuzner/cephadm_mpath_support

cephadm: Add support for mpath devices to gather-facts

Reviewed-by: Adam King <adking@redhat.com>

Merge pull request #46315 from zdover23/wip-doc-2022-05-18-intro-3-to-three

doc/start: s/3/three/ in intro.rst

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #46306 from rkachach/fix_issue_55638

mgr/cephadm: stripping out / from the end of the url

Reviewed-by: Adam King <adking@redhat.com>

Merge pull request #46291 from adk3798/move-active-mgr

mgr/cephadm: force fail over when we want to remove active mgr

Reviewed-by: Redouane Kachach <rkachach@redhat.com>

Merge pull request #46303 from rkachach/fix_issue_55641

mgr/cephadm: do not use sudo for root user

Reviewed-by: Adam King <adking@redhat.com>

doc/start: s/3/three/ in intro.rst

I'm changing "3" to "three" for two reasons:

1. It's correct.
2. This allows me to test backports into Octopus, Pacific, and Quincy.
   I am particularly interested to see what happens when I attempt
   the backport into Octopus, because backports into Octopus have
   failed. This will provide me with another unit of data.

Signed-off-by: Zac Dover <zac.dover@gmail.com>

Merge pull request #46163 from rkachach/fix_issue_55556

mgr/cephadm: fixing ipv6 handling during bootstrap

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: John Mulligan <jmulligan@redhat.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>

Merge pull request #46202 from rkachach/fix_issue_51257

mgr/cephadm: fixing ipv6/128 and ipv4/32 subnets handling

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: John Mulligan <jmulligan@redhat.com>

Merge pull request #46207 from rkachach/fix_issue_55555

mgr/cephadm: fixing yaml parsing during bootstrap

Reviewed-by: Adam King <adking@redhat.com>

Merge pull request #46218 from votdev/issue_55595_prometheus_external_url

cephadm: prometheus: The generatorURL in alerts is only using hostname

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
Reviewed-by: Redouane Kachach <rkachach@redhat.com>

Merge pull request #46222 from adk3798/dont-use-non-cluster-cached-conns

mgr/cephadm: don't use cached conns for hosts not in cluster

Reviewed-by: Michael Fritch <mfritch@suse.com>
Reviewed-by: Redouane Kachach <rkachach@redhat.com>

Merge pull request #46245 from adk3798/revert-call-changes

cephadm: Revert "mgr/cephadm: fixing call method timeout handling"

Reviewed-by: Michael Fritch <mfritch@suse.com>
Reviewed-by: Redouane Kachach <rkachach@redhat.com>

Merge pull request #46264 from adk3798/adopt-custom-name-osd

cephadm: fix adoption of osds from custom name clusters

Reviewed-by: Redouane Kachach <rkachach@redhat.com>

Merge pull request #46305 from zdover23/wip-doc-2022-05-17-basic-workflow-integration-tests

doc/dev: refine basic-workflow.rst integ. test

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>

doc/dev: refine basic-workflow.rst integ. test

This is one in a set of PRs meant to keep the Basic
Workflow in the Developer guide current. It refines
the English in the "Integration Tests AKA ceph-qa-suite"
section of "Basic Workflow".

Several other small updates like this are expected. I
intend to avoid refining half of the page in one commit,
as I did last month when I refined the first half of the
basic workflow.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@gmail.com>

mgr/cephadm: stripping out / from the end of the url
Fixes: https://tracker.ceph.com/issues/55638
Signed-off-by: Redouane Kachach <rkachach@redhat.com>

Merge pull request #46298 from cyx1231st/wip-seastore-add-metrics

crimson/os/seastore: add and fix metrics to reveal internal activities

Reviewed-by: Xuehan Xu <xxhdx1985126@gmail.com>

Merge pull request #46176 from athanatos/sjust/wip-55563

vstart: default CEPH_ASOK_DIR to asok/

Reviewed-by: Milind Changire <mchangir@redhat.com>

doc: updated release date

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>

mgr/cephadm: do not use sudo for root user
Fixes: https://tracker.ceph.com/issues/55641
Signed-off-by: Redouane Kachach <rkachach@redhat.com>

Merge pull request #45313 from rhcs-dashboard/unselect-datatable-row

mgr/dashboard: unselect rows in datatables

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
Reviewed-by: Yuri Weinstein <yweins@redhat.com>

crimson/os/seastore: adjust logs to FixedKVBtree

* Fix the subsys name.
* Change FixedKVBtree logs to trace level -- seems too verbose when the
  global level is debug.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>

crimson/os/seastore: add metrics for extent rewrite version

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>

crimson/os/seastore: improve and fix tree metrics

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>

crimson/os/seastore/segment_cleaner: add metrics about journal sizes

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>

crimson/os/seastore/segment_cleaner: add metrics about why IO is blocking

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>

Merge pull request #46292 from anthonyeleven/anthonyeleven/clarify-min-alloc-size2

doc/rados/configuration: clarify VMware note in bluestore-config-ref.rst

Reviewed-by: Zac Dover <zac.dover@gmail.com>

doc/rados/configuration: clarify VMware note in bluestore-config-ref.rst

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>

mgr/cephadm: force fail over when we want to remove active mgr

Fixes: https://tracker.ceph.com/issues/55679
Signed-off-by: Adam King <adking@redhat.com>

Merge pull request #46265 from ivancich/wip-misplaced-dout_subsys-def

rgw: remove potentially conficting definition of dout_subsys

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>

docs: updated Change Log PRs

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>

Merge pull request #46158 from cyx1231st/wip-seastore-cleaner

crimson/os/seastore/segment_cleaner: misc cleanups and improvements

Reviewed-by: Samuel Just <sjust@redhat.com>

mgr/dashboard: unselect rows in datatables

Fixes: https://tracker.ceph.com/issues/53244
Signed-off-by: Sarthak0702 <sarthak.0702@gmail.com>

Merge pull request #45662 from zenomri/wip-cond-tracing

rgw: support conditional tracing using lua script

Reviewed-by: Casey Bodley <cbodley@redhat.com>, Yuval Lifshitz <ylifshit@redhat.com>

Merge pull request #46274 from xxhdx1985126/wip-admin-sock

crimson/admin: deal with seastar's new metric types/logics

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Reviewed-by: Kefu Chai <tchaikov@gmail.com>

crimson/admin: deal with seastar's new metric types/logics

Fixes: https://tracker.ceph.com/issues/55666
Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>

Merge pull request #45962 from ronen-fr/wip-rf-sbe-test2

test/osd: test environment for the scrubber "backend"

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Matan Breizman <mbreizma@redhat.com>

Merge pull request #46270 from anthonyeleven/anthonyeleven/clarify-min-alloc-size

mgr/cephadm: unit test for re-adding host and receiving loopback address

Signed-off-by: Adam King <adking@redhat.com>

mgr/cephadm: re-use old ip when re-adding hosts if necessary

When a host is re-added without an explicit ip we can default to the old
ip we had stored for the host rather than either keeping the loopback
address or throwing an exception. We only want to actually error when
the only options left are error or use a resolved loopback address

Fixes: https://tracker.ceph.com/issues/53438
Signed-off-by: Adam King <adking@redhat.com>

doc/rados/configuration: Enhance BlueStore min_alloc_size section

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>

Merge pull request #45947 from optimistyzy/418_add_nvme_tcp_support

blk/spdk:  add support to use NVMe device provided by NVMe-oF target

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: Kefu Chai <tchaikov@gmail.com>

Merge pull request #46226 from ronen-fr/wip-rf-cln-typesh

osd: cleanup object_stat_sum_t initialization

Reviewed-by: Matan Breizman <mbreizma@redhat.com>

blk/spdk: Add the support to use nvme device provided by NVMe-of Target

This patch is used to add the support to use the nvmedevice provided
by NVMe-oF target.

Signed-off-by: Ziye Yang <ziye.yang@intel.com>

Merge pull request #45886 from lxbsz/wip-55283

qa: add filesystem/file sync stuck test support

Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #45955 from lxbsz/wip-55240

mds: trigger to flush the mdlog in handle_find_ino()

Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #46063 from vshankar/wip-55170

mds: fetch all dirfrag entries when no dentry keys are requested

Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #46153 from lxbsz/wip-54411-1

client: force send global open_files/metadata metrics

Reviewed-by: Venky Shankar <vshankar@redhat.com>

rgw: remove potentially conficting definition of dout_subsys

dout_subsys should strictly be defined in .cc files. There was a
definition of dout_subsys in rgw_log.h, which is included in a variety
of .cc files due to transitive includes. When a subsystem wants a
conflicting definition, a compiler warning is then generated due to
the redefinition of dout_subsys.

The definition is removed from rgw_log.h and follow-on fixes are made.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>

Merge pull request #46258 from xxhdx1985126/wip-backref-minor-bug-fixes

crimson/os/seastore/cache: backref buffer minor bug fix

Reviewed-by: Samuel Just <sjust@redhat.com>

cephadm: fix adoption of osds from custom name clusters

Fixes: https://tracker.ceph.com/issues/55654
Signed-off-by: Adam King <adking@redhat.com>

Merge pull request #46154 from zdover23/wip-doc-2022-04-14-dev-guide-basic-workflow

doc/dev: update basic-workflow.rst

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #45581 from MrFreezeex/jsonnet-multiline-cleanup

ceph-mixin: rewrite promql queries to multiline

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>

doc: add note for cephfs upgrade in notable changes

Signed-off-by: Venky Shankar <vshankar@redhat.com>

doc: 16.2.8 Release Notes

See testing summary - https://tracker.ceph.com/issues/55356

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>

Merge pull request #46142 from tchaikov/wip-cmake-fuse

cmake: mark FUSE REQUIRED if WITH_FUSE

Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #46237 from vshankar/wip-add-multids-stray-check-for-upgrade

doc: add note about checking pending stray directory entries before initiating upgrade

Reviewed-by: Venky Shankar <vshankar@redhat.com>

crimson/os/seastore/cache: backref buffer minor bug fix

Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>

doc: add note about checking pending stray directory entries before initiating upgrade

Signed-off-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #46236 from vshankar/wip-manual-upgrade-add-check

doc: add setting/unsetting `mon_mds_skip_sanity` config for manual ceph-mds upgrade

Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #46206 from votdev/issue_55578_prom_am_silence

mgr/dashboard: Creating and editing Prometheus AlertManager silences is buggy

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>

crimson/os/seastore: fix metrics with TRIM_BACKREF transaction

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>

crimson/os/seastore/segment_cleaner: measure the initial reclaim ratio

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>

crimson/os/seastore/segment_cleaner: distinguish journal/ool when count open/close/release

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>

crimson/os/seastore/segment_cleaner: distinguish in-journal and type-journal segments

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>

crimson/os/seastore/segment_cleaner: exclude utilizations from empty/open segments

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>

crimson/os/seastore/segment_cleaner: refine metrics

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>

crimson/os/seastore/segment_cleaner: fix an issue that caused forever-GC

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>

crimson/os/seastore/segment_cleaner: improve space calculations

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>