add -f flag for btrfs mkfs

Merge pull request #7174 from xiexingguo/xxg-wip-14332

librbd: fix potential memory leak

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #7165 from xiexingguo/xxg-wip-14316

cls_rbd: add guards for error cases

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #7069 from wonzhq/recovery-cache-hint

osd: add cache hint when pushing raw clone during recovery

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #7117 from efirs/ef_light_pg_get_put

osd: avoid debug std::string initialization in PG::get/put

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #7139 from tchaikov/wip-check-for-overlapped-rule

crush/CrushTester: check for overlapped rules

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #7156 from xiexingguo/xxg-wip-14299

librados: fix several flaws introduced by the enumeration_objects API

Reviewed-by: John Spray <jspray@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #6505 from aiicore/reduce_strings

osd: reduce string use in coll_t::calc_str()

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Evgeniy Firsov <evgeniy.firsov@sandisk.com>

Merge pull request #7054 from songbaisen/master

osd: optimize the session_handle_reset function

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #7055 from xiexingguo/xxg-wip-14185

osd: several small cleanups

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #7085 from tchaikov/wip-11692

config: complains when a setting is not tracked

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #7097 from tchaikov/bloat-leveldb-new

tools: ceph_monstore_tool: add inflate-pgmap command

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #7109 from Aran85/wip-mon-laggy-interval

mon/OSDMonitor: osdmap laggy set a maximum limit for interval

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #7151 from ceph/wip-14256

osdc: Fix race condition with tick_event and shutdown

Reviewed-by: John Spray <jspray@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #7157 from songbaisen/song3

crush: clean up whitespace removal

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #6944 from linuxbox2/wip-civetwarn

rgw: warn on suspicious civetweb frontend parameters

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>

Merge pull request #6332 from dx9/wip-12406-test_librdb_fsx

test/librbd/fsx: Use c++11 std::mt19937 generator instead of random_r()

Improve portability - random_r() is GNU-specific.

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>

Merge pull request #7029 from H3C/wip-yrf-rgw-fix1

rgw: let radosgw-admin bucket stats return a standard josn

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>

Merge pull request #7068 from ukernel/wip-14146

mds: expose state of recovery to status ASOK command

Merge pull request #7155 from jdurgin/wip-rbd-defaults-test

pybind/test_rbd: fix test_create_defaults

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #7171 from tchaikov/wip-enable-git-version

cmake: Add ENABLE_GIT_VERSION to avoid rebuilding

Merge pull request #5882 from aiicore/add_thread_names

common: add thread names

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #7053 from xiaoxichen/fix_preboot

osd: check health state before pre_booting

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #7059 from xiexingguo/xxg-wip-14187

osd: misc FileStore fixes

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #7083 from cxwshawn/wip-pg_stat-fix

mon: PGMonitor: acting primary diff with cur_stat, should not set pg to stale

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #7092 from kylinstorage/cleanup_PGLog

osd: PGLog: clean up read_log

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #7096 from H3C/wip-yrf-message-leak

msg/simple: pipe: memory leak when signature check failed

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #7107 from xiexingguo/xxg-wip-14227

osd: small fixes to memstore

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #7125 from mslovy/wip-fix-bluestore-onode-attr-leak

osd: bluestore: fix bluestore onode_t attr leak

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #7130 from liewegas/wip-bluestore

osd: bluestore: more fixes

Merge pull request #7168 from tchaikov/wip-fix-bluestore-test

osd: bluestore: fix bluestore_wal_transaction_t encoding test

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #7189 from dachary/wip-mailmap

mailmap updates

Reviewed-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>

Reduce string use in coll_t::calc_str()

1. Reduce string use.
2. Speedup dec and hex to char conversion.

Signed-off-by: Igor Podoski <igor.podoski@ts.fujitsu.com>

Merge pull request #7021 from tchaikov/wip-rados-manpage

man: document listwatchers cmd in "rados" manpage

Reviewed-by: Loic Dachary <ldachary@redhat.com>

mailmap: Dongmao Zhang affiliation

Signed-off-by: Loic Dachary <loic@dachary.org>

mailmap: sort files

Signed-off-by: Loic Dachary <loic@dachary.org>

Merge pull request #7173 from thesues/master

Change organization for Dongmao Zhang

Reviewed-by: Loic Dachary <ldachary@redhat.com>

Merge pull request #7132 from jcsp/wip-14144-jcsp

mds: fix standby replay thread creation

RBD: remove redundant parent check

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>

RBD: fix unhandle result code during list/list_children

Fixes: #14333
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>

RBD: fix potential memory leak

Fixes: #14332
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>

Merge pull request #7072 from dllgzcl/wip-zcl-ceph-s

mon/PGMap: show rd/wr iops separately in status reports

Reviewed-by: Kefu Chai <kchai@redhat.com>

Change organization for Dongmao Zhang

Signed-off-by: Dongmao Zhang <deanraccoon@gmail.com>

Crush:Remove all the before and after space in better way.

Fixes: #14302
Signed-off-by: songbaisen song.baisen@zte.com.cn

cmake: Add ENABLE_GIT_VERSION to avoid rebuilding

it is a pain to see something like
"expected plugin ./ec_plugins/libec_jerasure.so version
 v10.0.1-1239-g73c5763 but it claims to be v10.0.1-1241-gdb83f12
 instead" from time to time. so this is a cmake port of b227426.
the option ENABLE_GIT_VERSION is ON by default. if it is set OFF,
ceph_ver.h will not be recreated.

Signed-off-by: Kefu Chai <kchai@redhat.com>

os/bluestore: fix bluestore_wal_transaction_t encoding test

bluestore_wal_transaction_t::seq is encoded/dumped but it is not
initialized in its ctor. so set it to 0 in its ctor.

Signed-off-by: Kefu Chai <kchai@redhat.com>

Merge pull request #7126 from tchaikov/wip-detect-bzip2-lz4

cmake: detect bzip2 and lz4

Merge pull request #7166 from kylinstorage/wip-rbdnbd-misc

rbd-nbd: add copyright

RBD: fix unmatched output format

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>

RBD: fix result code overwritten during header&footer write

Fixes: #14317
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>

RBD: exit if we are unable to read object map footer

Fixes: #14316
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>

os/bluestore: fix allocation vs reservation for bluefs extents

- drop the MIN cruft
- unreserve what we didn't get

Signed-off-by: Sage Weil <sage@redhat.com>

os/bluestore: bluestore_debug_prefill = <fill ratio>

Prefill the objectstore by fragmenting the freespace.  Max free allocations
are bluestore_debug_prefragment_max bytes (default 1M).  Prefill defaults
to 0, of course.  One would normally just set this to .8 to get something
resembling an aged disk.

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #7161 from liewegas/wip-port

test/mon/osd-erasure-code-profile: pick new mon port

Reviewed-by: Loic Dachary <ldachary@redhat.com>

os/bluestore: pad trailing zeros for WAL write past eof

If we're past EOF, we need to zero the rest of the block.

Signed-off-by: Sage Weil <sage@redhat.com>

os/kstore: make fiemap behave past EOF

Signed-off-by: Sage Weil <sage@redhat.com>

os/bluestore: make fiemap return valid result beyond EOF

Signed-off-by: Sage Weil <sage@redhat.com>

vstart.sh: debug bluestore = 30

Signed-off-by: Sage Weil <sage@redhat.com>

test/osd/RadosModel: fix sparse read result check

The object may have trailing zeros.

Signed-off-by: Sage Weil <sage@redhat.com>

os/kstore: implement minimal fiemap

Signed-off-by: Sage Weil <sage@redhat.com>

os/bluestore: remove #warning cruft

These are on my todo list elsewhere.

Signed-off-by: Sage Weil <sage@redhat.com>

os/fs: make aio EAGAIN backoff exponential

Signed-off-by: Sage Weil <sage@redhat.com>

os/bluestore/BlockDevice: reduce aio queue size

Signed-off-by: Sage Weil <sage@redhat.com>

os/bluestore: clean up _do_read debug output

Signed-off-by: Sage Weil <sage@redhat.com>

os/bluestore/BlueFS: fix _compact_log seq jump

Signed-off-by: Sage Weil <sage@redhat.com>

os/bluestore/BlockDevice: make pread() safe

Signed-off-by: Sage Weil <sage@redhat.com>

os/bluestore: fix fiemap

Signed-off-by: Sage Weil <sage@redhat.com>

os/bluestore: drop unused TransContext mutex and cond

Signed-off-by: Sage Weil <sage@redhat.com>

os/bluestore/BlockDevice: quieter default log level

Signed-off-by: Sage Weil <sage@redhat.com>

os/bluestore/BlockDevice: make flush a no-op if there was no IO

fdatasync(2) does a cache flush on the device, which we want to avoid if
we didn't actually write anything.

Signed-off-by: Sage Weil <sage@redhat.com>

os/bluestore: fix fiemap on object with no data

Signed-off-by: Sage Weil <sage@redhat.com>

os/bluestore/BlockDevice: initiate bufferd writes at aio_write time

Signed-off-by: Sage Weil <sage@redhat.com>

os/bluestore/BlueFS: buffered writes

Signed-off-by: Sage Weil <sage@redhat.com>

os/bluestore/BlueFS: no lock on read

Signed-off-by: Sage Weil <sage@redhat.com>

os/bluestore/BlueFS: do not wait for IO on flush

Wait on fsync and _flush_log only.

Signed-off-by: Sage Weil <sage@redhat.com>

os/bluestore/BlueFS: read_random

Signed-off-by: Sage Weil <sage@redhat.com>

os/bluestore/BlockDevice: read_buffered

Signed-off-by: Sage Weil <sage@redhat.com>

os/bluestore/BlueFS: keep bool random in FileReader

Signed-off-by: Sage Weil <sage@redhat.com>

os/bluestore: reserve first block for label when bluefs = false

Signed-off-by: Sage Weil <sage@redhat.com>

os/bluestore: fix bdev label error message

Signed-off-by: Sage Weil <sage@redhat.com>

os/bluestore: send all old bluefs IOContexts for reap by bdev

Doing it in the aio thread ensures that there isn't a use-after-free.
Note that this is only bluefs written files.

Signed-off-by: Sage Weil <sage@redhat.com>

os/bluestore: fix valgrind warning on fsid read

Signed-off-by: Sage Weil <sage@redhat.com>

os/keyvaluestore: fix valgrind warning on fsid read

Signed-off-by: Sage Weil <sage@redhat.com>

os/filestore: fix valgrind warning on fsid read

Signed-off-by: Sage Weil <sage@redhat.com>

test/mon/osd-erasure-code-profile: pick new mon port

7108 is used by mark-down.sh

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #6911 from stiopaa1/const_variable_length

tests: add const for ec test

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #6989 from stiopaa1/message_inline

msg: remove unneeded inline

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #7160 from yehudasa/wip-rgw-warn

rgw: fix compilation warning

Reviewed-by: Sage Weil <sage@redhat.com>

rgw: fix compilation warning

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

Objecter: fix typo and wrong tracing messages

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>

Objecter: fix potential null pointer access

Fixes: #14301
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>

Objecter: exit if we detect read error

Fixes: #14300
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>

Objecter: abort enumeration when we encouter pool dne

Otherwise we may risk of executing the callback twice, which is fatal.

Fixes: #14299
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>

pybind/test_rbd: fix test_create_defaults

Adjust for default order only being applied via ceph conf since
16d50459c4996cd3b188bc5da100d1ce069f05cd

Fixes: #14279
Signed-off-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #7149 from fullerdj/wip-14280

cls_rbd: enable object map checksums for object_map_save

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #7154 from liewegas/wip-make-check

unittest_ipaddr: fix segv

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

unittest_ipaddr: fix segv

Since b6d0fc9e0e515e50894c08217d688a8c94db7570 we need ifa_name to
be defined.

Signed-off-by: Sage Weil <sage@redhat.com>

Add copyright for rbd-nbd

Signed-off-by: Li Wang <li.wang@kylin-cloud.com>

Merge pull request #6002 from Sandy4999/wip-12890

rgw: add a method to purge all associate keys when removing a subuser

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>

Merge pull request #6080 from clever215/wkm-master-139

rgw: modify documents and help infos' descriptions to the usage of option date when executing command "log show"

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>