doc/changelog: add v10.2.3

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>

Merge pull request #11234 from theanalyst/jewel-release-notes

doc/release-notes: v10.2.3 jewel

Merge pull request #11216 from liewegas/wip-bluestore-compress-map

os/bluestore: prevent extent merging across shard boundaries

Reviewed-by: Somnath Roy <somnath.roy@sandisk.com>

doc/release-notes: more fixes to 10.2.3

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>

Merge pull request #10445 from rjfd/wip-15259

journal: increase concurrency/parallelism of journal recorder

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

doc/release-notes: v10.2.3 jewel

Adding release notes for the next jewel release

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>

doc: add v10.2.3 to releases table

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>

Merge pull request #11226 from zealoussnow/wip-0926

doc: missing "make vstart" in quick_guide.rst

Merge pull request #11228 from stiopaa1/osd_pg_removeUnneededCount1

osd/PG.cc: remove unneeded use of count

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #11229 from liewegas/wip-compressor

cmake: remove more autotools hacks

Reviewed-by: Ali Maredia <amaredia@redhat.com>

ceph-rest-api: drop autotools detection

Signed-off-by: Sage Weil <sage@redhat.com>

vstart.sh: drop autotools detection

Signed-off-by: Sage Weil <sage@redhat.com>

detect-build-env-vars.sh: drop autotools detection

Signed-off-by: Sage Weil <sage@redhat.com>

ceph: remove autotools detection

Signed-off-by: Sage Weil <sage@redhat.com>

doc: remove old .libs reference

Signed-off-by: Sage Weil <sage@redhat.com>

unittest_compression_*: remove lib dir hackery

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #10143 from majianpeng/bluefs-fix

os/bluestore/BlueFS: don't inc l_bluefs_files_written_wal if overwrite.

Merge pull request #11138 from jcsp/wip-17236

mds: handle blacklisting during journal recovery

Reviewed-by: Greg Farnum <gfarnum@redhat.com>

doc: missing "make vstart" in quick_guide.rst

Signed-off-by: Leo Zhang <nguzcf@gmail.com>

Merge pull request #11220 from stiopaa1/mds_mdsdaemon_CMDSTickclass

mds/MDSDaemon: move C_MDS_Tick class to .cc file

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #11224 from wjwithagen/patch-13

osd-fast-mark-down.sh: fix typo in variable assignments

Merge pull request #11212 from liewegas/wip-bluestore-spanning-leak

os/bluestore: drop unreferenced spanning blobs

Merge pull request #11223 from somnathr/wip-bluestore-leak-fix

os/bluestore: fix spanning blob leak from ~ExtentMap

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #11219 from xiexingguo/xxg-wip-fsck-0924

os/bluestore: fix fsck() won't catch stray shard sometimes

Reviewed-by: Sage Weil <sage@redhat.com>

rbd-mirror: test: Fixed timeout problem in rbd_mirror_stress.sh

Signed-off-by: Ricardo Dias <rdias@suse.com>

rbd: Fix race between journal flush and append events

Signed-off-by: Ricardo Dias <rdias@suse.com>

journal: make librados call async in ObjectRecorder

Signed-off-by: Ricardo Dias <rdias@suse.com>

osd-fast-mark-down.sh: fix typo in variable assignments

Assignments to variables do not want a '$' in front of them.

Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>

journal: increase concurrency of journal recorder

Signed-off-by: Ricardo Dias <rdias@suse.com>

BlueStore: Fixed a memory leak

If a Blob is spanning is not getting deleted as spanning_blob_map
is holding one ref.Explicitly decreasing Blob ref from ExtentMap
destructor and erasing from spanning_blob_map is fixing the leak.

Signed-off-by: Somnath Roy <somnath.roy@sandisk.com>

Merge pull request #11196 from tchaikov/wip-lttng-the-right-way

lttng: build the tracepoint provider lib from .c files in repo

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

osd/PG.cc: remove unneeded use of count

Signed-off-by: Michal Jarzabek <stiopa@gmail.com>

mds/MDSDaemon: move C_MDS_Tick class to .cc file

Signed-off-by: Michal Jarzabek <stiopa@gmail.com>

Merge pull request #11090 from dillaman/wip-16974

rbd-mirror: force-promoted image will remain R/O until rbd-mirror daemon restarted

Reviewed-by: Mykola Golub <mgolub@mirantis.com>

os/bluestore: fix dout of BlueStore::fiemap()

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>

os/bluestore: add a counter to trace checksum latency

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>

os/bluestore: remove a never reachable assert

As this assert is deprecated by the
  "else if (it->key() >= tail)"
checking lying ahead.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>

os/bluestore: promote output to derr on catching bad/stray objects

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>

os/bluestore: fix fsck() won't catch stray shard sometimes

which is introduced by https://github.com/ceph/ceph/pull/11210/commits/dcfbc72fcbb48f4ced0c1a2d46a77f43bff38c9f

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>

Merge pull request #11197 from yuyuyu101/wip-bluestore-misc

os/bluestore: misc cleanups

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #11215 from stiopaa1/mon_paxos_moveContextClassesToCC

mon/Paxos: move classes to .cc file

Reviewed-by: Sage Weil <sage@redhat.com>

ceph_test_objectstore: add a test

Signed-off-by: Sage Weil <sage@redhat.com>

os/bluestore: prevent extent merging across shard boundaries

We cannot have a single extent span a shard boundary.  If we reach
a shard boundary, stop merging extents.

Note that it might be better to move the shard boundary, but it is
awkward to force that to happen at this point.

Signed-off-by: Sage Weil <sage@redhat.com>

mon/Paxos: move classes to .cc file

Signed-off-by: Michal Jarzabek <stiopa@gmail.com>

Merge pull request #11170 from ukernel/wip-17253

client: fix segment fault in Client::_invalidate_kernel_dcache().

Reviewed-by: John Spray <john.spray@redhat.com>

Merge pull request #11142 from hzhang-wx/master

cls_rbd: clean up status from rbd-mirror if image removed

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #10939 from oritwas/wip-rgw-acl-underscore

rgw: fix regression with handling double underscore

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>

Merge pull request #11159 from linuxbox2/rgw-setattr-920

rgw_file: fix set_attrs operation

Reviewed-by: Casey Bodley <cbodley@redhat.com>

os/bluestore: drop unreferenced spanning blobs

Otherwise we can "leak" these and keep them around indefinitely.

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #11172 from batrick/ceph-conf-metavar

doc: add $pid metavar conf doc

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #11200 from yuyuyu101/wip-upper-thread

msg/async: avoid set out of range ms_async_op_threads option

Reviewed-by: Mark Nelson <mnelson@redhat.com>

Merge pull request #9170 from Yan-waller/yj-wip-fixrgwnew

rgw/admin: fix some return values and indents
Reviewed-by: Orit Wasserman <owasserm@redhat.com>

Merge pull request #11210 from xiexingguo/xxg-wip-bluestore-0923

os/bluestore: more cleanups and fixes

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #10463 from gongchuang/gc-wip-test

Client: fixup param type and return value

Reviewed-by: John Spray <john.spray@redhat.com>

journal: send update notification when tag allocated

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

librbd: new journal listener event for force promotion

Fixes: http://tracker.ceph.com/issues/16974
Signed-off-by: Jason Dillaman <dillaman@redhat.com>

librbd: helper class for quiescing in-flight async ops

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

librbd: unify journal event callbacks into single interface

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

journal: expose ability to retrieve partial tag list

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

qa/workunits/rbd: fix remove mirrored image race conditions

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

qa/workunits/rbd: new mirroring forced promotion test

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #11153 from dillaman/wip-17317

test/rbd: fix possible mock journal race conditions

Reviewed-by: Mykola Golub <mgolub@mirantis.com>

Merge pull request #11054 from rzarzynski/wip-rgw-postobj-nodynalloc

rgw: eradicate dynamic memory allocation in RGWPostObj.
Reviewed-by: Orit Wasserman <owasserm@redhat.com>

os/bluestore: fix potential access violation during shard-key scan

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>

os/bluestore: kill unused variables "ekey"

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>

Merge pull request #11208 from tchaikov/wip-17380

osd: should not look up an empty pg

Reviewed-by: Loic Dachary <ldachary@redhat.com>

Merge pull request #10949 from avnerbh/avnerbh-preforker-fix

preforker: prevent call to 'write' on an fd that was already closed

Reviewed-by: Kefu Chai <kchai@redhat.com>

test: re-enable test_pg_scrub() test in ceph-helper.sh

this reverts d053705. i disabled this test in hope to bisect the
offending tests that fail the mysterious jenkins failure, which was
fixed by 6f3ce3a.

Signed-off-by: Kefu Chai <kchai@redhat.com>

osd: should not look up an empty pg

this fixes the scrub timeouts we spotted in jenkins run and qa run.
it's a regression introduced by c2b7cdb

Fixes: http://tracker.ceph.com/issues/17380
Signed-off-by: Loic Dachary <loic@dachary.org>
Signed-off-by: Kefu Chai <kchai@redhat.com>

os/bluestore: drop csum_enabled parameter from blob::get_chunk_size()

The only two callers from bluestore now always set csum_enabled to true,
so there is no need to keep this parameter any more.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>

os/bluestore: simplify BlueStore::_setup_block_symlink_or_file()

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>

Merge pull request #11205 from liewegas/wip-async-debug

msg/async: less verbose debug messages at debug_ms=1

Reviewed-by: Haomai Wang <haomai@xsky.com>

rgw_file: fix set_attrs operation

The effective part of this change is to always set a value
for RGW_ATTR_UNIX_KEY1 (because it is expected later).

Secondarily, do not pass the address of the to-set attributes
buffer::list as remove attrs--this is confusing.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>

Merge pull request #11181 from linuxbox2/rgw-legacy-time

rgw_file:  pre-assign times

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #11048 from jimifm/wip-FDCache-master

os/filestore/FDCache: fix bug when filestore_fd_cache_shards = 0

Reviewed-by: Sage Weil <sage@redhat.com>

msg/async: no need for ..."started." suffix

Signed-off-by: Sage Weil <sage@redhat.com>

msg/async: less noisy about EventCenter owner

Signed-off-by: Sage Weil <sage@redhat.com>

msg/async: make rx line look like normal debug

The DispatchQueue prints the traditional ==== line.

Signed-off-by: Sage Weil <sage@redhat.com>

msg/async: make send debug line look like SimpleMessenger's

Signed-off-by: Sage Weil <sage@redhat.com>

msg/async/AsyncConnection: less noisy about connection top

Signed-off-by: Sage Weil <sage@redhat.com>

msg/async/EventCenter: less noisy debug on events

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #11190 from tchaikov/wip-memstore-clone-fixture

tests: use a fixture for memstore clone testing

Reviewed-by: Casey Bodley <cbodley@redhat.com>

msg/async: avoid set out of range ms_async_op_threads option

Signed-off-by: Haomai Wang <haomai@xsky.com>

Merge pull request #10587 from b-ranto/wip-logrotate-root

logrotate: Run as root/ceph

Reviewed-by: Nathan Cutler <ncutler@suse.com>

Merge pull request #7338 from ceph/cls-lua

Lua object class support

Reviewed-by: Haomai Wang <haomai@xsky.com>
Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
Reviewed-by: Ken Dreyer (Red Hat) <kdreyer@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #10135 from david-z/wip-enhance-ceph-disk-bluestore

ceph-disk: support creating block.db and block.wal with customized size for bluestore

Reviewed-by: Loic Dachary <ldachary@redhat.com>

Merge pull request #10371 from Yan-waller/yj-wip-msgsimple-0720

msg/simple: close the failed socket fds

https://github.com/ceph/ceph/pull/11052

Merge pull request #11052 from yuyuyu101/wip-shutdown-deadlock

OSD: avoid FileStore finisher deadlock in osd_lock when shutdown OSD

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #11082 from aiicore/nearfull_flag_fix

mon: OSDMonitor: Missing nearfull flag set

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #11089 from dachary/wip-16477-ceph-helper

cli: retry when the mon is not configured

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #11199 from yuyuyu101/wip-17378

msg/async: remove fd output in log prefix

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #11195 from xiexingguo/xxg-wip-csum-improve

os/bluestore: a few fixes about  the global csum setting

Reviewed-by: Sage Weil <sage@redhat.com>

msg/async: remove fd output in log prefix

it's tricky to prevent fd racing in logs, otherwise we need to provide with
lock to totally avoid this. But I don't think it deserve lock

Signed-off-by: Haomai Wang <haomai@xsky.com>

Merge pull request #11182 from ceph/wip-docs-rm-ink

remove old references to inktank premium support

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #11194 from wjwithagen/wip-wjw-rocksdb-include

src/kv/CMakeLists.txt: force rocksdb/include to first include directory

Reviewed-by: Kefu Chai <kchai@redhat.com>

os/bluestore: fix race condition of global csum setting

The global csum_type option can be changed dynamically and
can be fixed by upgrading into std::atomic.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>

os/bluestore: drop the global bluestore_csum option

We don't need this option as it can be properly covered
by the bluestore_csum_type option.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>

os/bluestore: use blob internal settings for csum checking

This is because:
1. It is more accurate, as the global csum settings may change dynamically.
2. bluestore_blob_t::verify_csum() can handle both csum-on and csum-off correctly.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>

Merge pull request #11151 from ceph/wip-bluestore-error-injection

os/bluestore: add error injection

Merge pull request #11184 from liewegas/wip-down-out

mon: wait 10m (not 5m) before marking down OSDs out

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Gregory Farnum <gfarnum@redhat.com>
Reviewed-by: Dan Mick <dmick@redhat.com>