doc: cleanup outdated radosgw description

radosgw support is on by default, as built-in Civetweb, set up Apache
is no necessary any more.

Signed-off-by: Jiaying Ren <jiaying.ren@umcloud.com>

unittest_bluestore_types: init g_ceph_context

The methods we're testing use it for dout.

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #11238 from theanalyst/changelog-v10.2.3

doc/changelog: add v10.2.3

Merge pull request #10814 from liewegas/wip-bluestore-precondition

os/bluestore: precondition rocksdb/bluefs during mkfs

Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>

doc/changelog: add v10.2.3

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>

os/bluestore: precondition rocksdb on mkfs

Write N bytes of garbage to the kv store on startup.  With rocksdb,
this ensures that our log files are preallocated.

This option needs to match up with the rocksdb tunables so that it
is enough data to start recycling log files.  For now, start with
128MB.

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #11234 from theanalyst/jewel-release-notes

doc/release-notes: v10.2.3 jewel

Merge pull request #11216 from liewegas/wip-bluestore-compress-map

os/bluestore: prevent extent merging across shard boundaries

Reviewed-by: Somnath Roy <somnath.roy@sandisk.com>

doc/release-notes: more fixes to 10.2.3

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>

Merge pull request #10445 from rjfd/wip-15259

journal: increase concurrency/parallelism of journal recorder

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

doc/release-notes: v10.2.3 jewel

Adding release notes for the next jewel release

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>

doc: add v10.2.3 to releases table

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>

Merge pull request #11226 from zealoussnow/wip-0926

doc: missing "make vstart" in quick_guide.rst

Merge pull request #11228 from stiopaa1/osd_pg_removeUnneededCount1

osd/PG.cc: remove unneeded use of count

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #11229 from liewegas/wip-compressor

cmake: remove more autotools hacks

Reviewed-by: Ali Maredia <amaredia@redhat.com>

ceph-rest-api: drop autotools detection

Signed-off-by: Sage Weil <sage@redhat.com>

vstart.sh: drop autotools detection

Signed-off-by: Sage Weil <sage@redhat.com>

detect-build-env-vars.sh: drop autotools detection

Signed-off-by: Sage Weil <sage@redhat.com>

ceph: remove autotools detection

Signed-off-by: Sage Weil <sage@redhat.com>

doc: remove old .libs reference

Signed-off-by: Sage Weil <sage@redhat.com>

unittest_compression_*: remove lib dir hackery

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #10143 from majianpeng/bluefs-fix

os/bluestore/BlueFS: don't inc l_bluefs_files_written_wal if overwrite.

Merge pull request #11138 from jcsp/wip-17236

mds: handle blacklisting during journal recovery

Reviewed-by: Greg Farnum <gfarnum@redhat.com>

doc: missing "make vstart" in quick_guide.rst

Signed-off-by: Leo Zhang <nguzcf@gmail.com>

Merge pull request #11220 from stiopaa1/mds_mdsdaemon_CMDSTickclass

mds/MDSDaemon: move C_MDS_Tick class to .cc file

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #11224 from wjwithagen/patch-13

osd-fast-mark-down.sh: fix typo in variable assignments

Merge pull request #11212 from liewegas/wip-bluestore-spanning-leak

os/bluestore: drop unreferenced spanning blobs

Merge pull request #11223 from somnathr/wip-bluestore-leak-fix

os/bluestore: fix spanning blob leak from ~ExtentMap

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #11219 from xiexingguo/xxg-wip-fsck-0924

os/bluestore: fix fsck() won't catch stray shard sometimes

Reviewed-by: Sage Weil <sage@redhat.com>

rbd-mirror: test: Fixed timeout problem in rbd_mirror_stress.sh

Signed-off-by: Ricardo Dias <rdias@suse.com>

rbd: Fix race between journal flush and append events

Signed-off-by: Ricardo Dias <rdias@suse.com>

journal: make librados call async in ObjectRecorder

Signed-off-by: Ricardo Dias <rdias@suse.com>

osd-fast-mark-down.sh: fix typo in variable assignments

Assignments to variables do not want a '$' in front of them.

Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>

journal: increase concurrency of journal recorder

Signed-off-by: Ricardo Dias <rdias@suse.com>

BlueStore: Fixed a memory leak

If a Blob is spanning is not getting deleted as spanning_blob_map
is holding one ref.Explicitly decreasing Blob ref from ExtentMap
destructor and erasing from spanning_blob_map is fixing the leak.

Signed-off-by: Somnath Roy <somnath.roy@sandisk.com>

Merge pull request #11196 from tchaikov/wip-lttng-the-right-way

lttng: build the tracepoint provider lib from .c files in repo

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

osd/PG.cc: remove unneeded use of count

Signed-off-by: Michal Jarzabek <stiopa@gmail.com>

mds/MDSDaemon: move C_MDS_Tick class to .cc file

Signed-off-by: Michal Jarzabek <stiopa@gmail.com>

Merge pull request #11090 from dillaman/wip-16974

rbd-mirror: force-promoted image will remain R/O until rbd-mirror daemon restarted

Reviewed-by: Mykola Golub <mgolub@mirantis.com>

os/bluestore: fix dout of BlueStore::fiemap()

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>

os/bluestore: add a counter to trace checksum latency

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>

os/bluestore: remove a never reachable assert

As this assert is deprecated by the
  "else if (it->key() >= tail)"
checking lying ahead.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>

os/bluestore: promote output to derr on catching bad/stray objects

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>

os/bluestore: fix fsck() won't catch stray shard sometimes

which is introduced by https://github.com/ceph/ceph/pull/11210/commits/dcfbc72fcbb48f4ced0c1a2d46a77f43bff38c9f

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>

Merge pull request #11197 from yuyuyu101/wip-bluestore-misc

os/bluestore: misc cleanups

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #11215 from stiopaa1/mon_paxos_moveContextClassesToCC

mon/Paxos: move classes to .cc file

Reviewed-by: Sage Weil <sage@redhat.com>

ceph_test_objectstore: add a test

Signed-off-by: Sage Weil <sage@redhat.com>

os/bluestore: prevent extent merging across shard boundaries

We cannot have a single extent span a shard boundary.  If we reach
a shard boundary, stop merging extents.

Note that it might be better to move the shard boundary, but it is
awkward to force that to happen at this point.

Signed-off-by: Sage Weil <sage@redhat.com>

mon/Paxos: move classes to .cc file

Signed-off-by: Michal Jarzabek <stiopa@gmail.com>

Merge pull request #11170 from ukernel/wip-17253

client: fix segment fault in Client::_invalidate_kernel_dcache().

Reviewed-by: John Spray <john.spray@redhat.com>

Merge pull request #11142 from hzhang-wx/master

cls_rbd: clean up status from rbd-mirror if image removed

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #10939 from oritwas/wip-rgw-acl-underscore

rgw: fix regression with handling double underscore

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>

Merge pull request #11159 from linuxbox2/rgw-setattr-920

rgw_file: fix set_attrs operation

Reviewed-by: Casey Bodley <cbodley@redhat.com>

os/bluestore: drop unreferenced spanning blobs

Otherwise we can "leak" these and keep them around indefinitely.

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #11172 from batrick/ceph-conf-metavar

doc: add $pid metavar conf doc

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #11200 from yuyuyu101/wip-upper-thread

msg/async: avoid set out of range ms_async_op_threads option

Reviewed-by: Mark Nelson <mnelson@redhat.com>

Merge pull request #9170 from Yan-waller/yj-wip-fixrgwnew

rgw/admin: fix some return values and indents
Reviewed-by: Orit Wasserman <owasserm@redhat.com>

Merge pull request #11210 from xiexingguo/xxg-wip-bluestore-0923

os/bluestore: more cleanups and fixes

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #10463 from gongchuang/gc-wip-test

Client: fixup param type and return value

Reviewed-by: John Spray <john.spray@redhat.com>

journal: send update notification when tag allocated

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

librbd: new journal listener event for force promotion

Fixes: http://tracker.ceph.com/issues/16974
Signed-off-by: Jason Dillaman <dillaman@redhat.com>

librbd: helper class for quiescing in-flight async ops

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

librbd: unify journal event callbacks into single interface

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

journal: expose ability to retrieve partial tag list

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

qa/workunits/rbd: fix remove mirrored image race conditions

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

qa/workunits/rbd: new mirroring forced promotion test

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #11153 from dillaman/wip-17317

test/rbd: fix possible mock journal race conditions

Reviewed-by: Mykola Golub <mgolub@mirantis.com>

Merge pull request #11054 from rzarzynski/wip-rgw-postobj-nodynalloc

rgw: eradicate dynamic memory allocation in RGWPostObj.
Reviewed-by: Orit Wasserman <owasserm@redhat.com>

os/bluestore: fix potential access violation during shard-key scan

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>

os/bluestore: kill unused variables "ekey"

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>

Merge pull request #11208 from tchaikov/wip-17380

osd: should not look up an empty pg

Reviewed-by: Loic Dachary <ldachary@redhat.com>

Merge pull request #10949 from avnerbh/avnerbh-preforker-fix

preforker: prevent call to 'write' on an fd that was already closed

Reviewed-by: Kefu Chai <kchai@redhat.com>

test: re-enable test_pg_scrub() test in ceph-helper.sh

this reverts d053705. i disabled this test in hope to bisect the
offending tests that fail the mysterious jenkins failure, which was
fixed by 6f3ce3a.

Signed-off-by: Kefu Chai <kchai@redhat.com>

osd: should not look up an empty pg

this fixes the scrub timeouts we spotted in jenkins run and qa run.
it's a regression introduced by c2b7cdb

Fixes: http://tracker.ceph.com/issues/17380
Signed-off-by: Loic Dachary <loic@dachary.org>
Signed-off-by: Kefu Chai <kchai@redhat.com>

os/bluestore: drop csum_enabled parameter from blob::get_chunk_size()

The only two callers from bluestore now always set csum_enabled to true,
so there is no need to keep this parameter any more.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>

os/bluestore: simplify BlueStore::_setup_block_symlink_or_file()

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>

Merge pull request #11205 from liewegas/wip-async-debug

msg/async: less verbose debug messages at debug_ms=1

Reviewed-by: Haomai Wang <haomai@xsky.com>

rgw_file: fix set_attrs operation

The effective part of this change is to always set a value
for RGW_ATTR_UNIX_KEY1 (because it is expected later).

Secondarily, do not pass the address of the to-set attributes
buffer::list as remove attrs--this is confusing.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>

Merge pull request #11181 from linuxbox2/rgw-legacy-time

rgw_file:  pre-assign times

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #11048 from jimifm/wip-FDCache-master

os/filestore/FDCache: fix bug when filestore_fd_cache_shards = 0

Reviewed-by: Sage Weil <sage@redhat.com>

msg/async: no need for ..."started." suffix

Signed-off-by: Sage Weil <sage@redhat.com>

msg/async: less noisy about EventCenter owner

Signed-off-by: Sage Weil <sage@redhat.com>

msg/async: make rx line look like normal debug

The DispatchQueue prints the traditional ==== line.

Signed-off-by: Sage Weil <sage@redhat.com>

msg/async: make send debug line look like SimpleMessenger's

Signed-off-by: Sage Weil <sage@redhat.com>

msg/async/AsyncConnection: less noisy about connection top

Signed-off-by: Sage Weil <sage@redhat.com>

msg/async/EventCenter: less noisy debug on events

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #11190 from tchaikov/wip-memstore-clone-fixture

tests: use a fixture for memstore clone testing

Reviewed-by: Casey Bodley <cbodley@redhat.com>

msg/async: avoid set out of range ms_async_op_threads option

Signed-off-by: Haomai Wang <haomai@xsky.com>

Merge pull request #10587 from b-ranto/wip-logrotate-root

logrotate: Run as root/ceph

Reviewed-by: Nathan Cutler <ncutler@suse.com>

Merge pull request #7338 from ceph/cls-lua

Lua object class support

Reviewed-by: Haomai Wang <haomai@xsky.com>
Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
Reviewed-by: Ken Dreyer (Red Hat) <kdreyer@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #10135 from david-z/wip-enhance-ceph-disk-bluestore

ceph-disk: support creating block.db and block.wal with customized size for bluestore

Reviewed-by: Loic Dachary <ldachary@redhat.com>

Merge pull request #10371 from Yan-waller/yj-wip-msgsimple-0720

msg/simple: close the failed socket fds

https://github.com/ceph/ceph/pull/11052

Merge pull request #11052 from yuyuyu101/wip-shutdown-deadlock

OSD: avoid FileStore finisher deadlock in osd_lock when shutdown OSD

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #11082 from aiicore/nearfull_flag_fix

mon: OSDMonitor: Missing nearfull flag set

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #11089 from dachary/wip-16477-ceph-helper

cli: retry when the mon is not configured

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #11199 from yuyuyu101/wip-17378

msg/async: remove fd output in log prefix

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #11195 from xiexingguo/xxg-wip-csum-improve

os/bluestore: a few fixes about  the global csum setting

Reviewed-by: Sage Weil <sage@redhat.com>

msg/async: remove fd output in log prefix

it's tricky to prevent fd racing in logs, otherwise we need to provide with
lock to totally avoid this. But I don't think it deserve lock

Signed-off-by: Haomai Wang <haomai@xsky.com>

Merge pull request #11182 from ceph/wip-docs-rm-ink

remove old references to inktank premium support

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #11194 from wjwithagen/wip-wjw-rocksdb-include

src/kv/CMakeLists.txt: force rocksdb/include to first include directory

Reviewed-by: Kefu Chai <kchai@redhat.com>