tests: fix test case using new api

Signed-off-by: Xinze Chi <xinze@xsky.com>

os: write file journal optimezation

Currently, there is single write thread for file journal, so it would be bottleneck.
It is important to keep logic of the journal write thread simple. According to the
implementation of transaction encoding, it is almost impossible that the write
bufferlist would be align. So write journal would call rebuild_aligned almost every time.
Because of the memory fragmentation, the bufferlist crc and rebuild would be bottleneck.

My implementation would move the complex logic out of journal write thread.

Signed-off-by: Xinze Chi <xinze@xsky.com>
Reviewed-by: Haomai Wang <haomai@xsky.com>

Merge pull request #6358 from dx9/wip-12406-cmake-arch-detection

cmake: Use uname instead of arch.

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #6310 from dx9/wip-12406-test-libcephfs-flock

test/libcephfs/flock: add sys/file.h include for flock operations

Reviewed-by: Greg Farnum <gfarnum@redhat.com>

Merge pull request #6377 from xiexingguo/wip-xxg-13597

FileStore: potential memory leak if _fgetattrs fails

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #6414 from dzafman/wip-13625

messages/MOSDOp: Cast in assert to eliminate warnings

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #6418 from tchaikov/wip-fix-ceph-monstore-update-crush

tools: ceph-monstore-update-crush: add "--test" when testing crushmap

Reviewed-by: Loic Dachary <ldachary@redhat.com>

tools: ceph-monstore-update-crush: add "--test" to crushtool

in addition to testing the references to unknown name/type, we should
perform necessary test the crushmap when looking for a good crushmap

Signed-off-by: Kefu Chai <kchai@redhat.com>

Merge pull request #5875 from Aran85/parsemetadatakey

rgw:modify the conditional statement in parse_metadata_key method.

Merge pull request #6409 from dachary/wip-mailmap

mailmap: Xie Xingguo affiliation

Reviewed-by: Loic Dachary <ldachary@redhat.com>

Merge pull request #5879 from H3C/wip-rgw-bugfix1

rgw/rgw_admin: Checking the legality of the parameters

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>

messages/MOSDOp: Cast in assert to eliminate warnings

Fixes: #13625
Caused by 0bf2a79e

Signed-off-by: David Zafman <dzafman@redhat.com>

Merge pull request #5262 from jmunhoz/wip-12352

rgw: remove extra check in RGWGetObj::execute

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>

mailmap: Xie Xingguo affiliation

Signed-off-by: Loic Dachary <ldachary@redhat.com>

Merge pull request #6320 from JiYou/mything

Fix examples/librados/Makefile error.

Reviewed-by: Loic Dachary <ldachary@redhat.com>

Merge pull request #6381 from xiexingguo/xxg-wip-fs-cleanup

FileStore: remove unused local variable 'handle'

Reviewed-by: Loic Dachary <ldachary@redhat.com>

Merge pull request #6384 from ktdreyer/wip-doc-download-gpg-key

doc: download GPG key from download.ceph.com

Reviewed-by: Loic Dachary <ldachary@redhat.com>

Merge pull request #6246 from liewegas/wip-13477

crush: validate bucket id before indexing buckets array

Reviewed-by: Loic Dachary <ldachary@redhat.com>

crush/mapper: ensure take bucket value is valid

Ensure that the take argument is a valid bucket ID before indexing the
buckets array.

Signed-off-by: Sage Weil <sage@redhat.com>

crush/mapper: ensure bucket id is valid before indexing buckets array

We were indexing the buckets array without verifying the index was within
the [0,max_buckets) range.  This could happen because a multistep rule
does not have enough buckets and has CRUSH_ITEM_NONE
for an intermediate result, which would feed in CRUSH_ITEM_NONE and
make us crash.

Fixes: #13477
Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #6239 from zhouyuan/swift_testing_access

vstart.sh: grant full access to Swift testing account

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>

Merge pull request #6303 from dx9/wip-12406-use-freopen

test_rgw_admin:  Use freopen for output redirection.

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>

Merge pull request #6387 from dachary/wip-test-ports

tests: port uniqueness reminder

Reviewed-by: Vicente Cheng <freeze.bilsted@gmail.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

tests: port uniqueness reminder

When copy/pasting a tests, it is easy to forget (or not know) that the
port used must be unique to allow for multiple tests to run in
parallel (make -j8). Add a reminder next to each port.

Signed-off-by: Loic Dachary <ldachary@redhat.com>

Merge pull request #6379 from tchaikov/wip-13554

rocksdb: remove rdb source files from dist tarball

Reviewed-by: Loic Dachary <ldachary@redhat.com>

Merge pull request #6258 from swamireddy/wip-v910-mailmap

mailmap updates

Reviewed-by: Loic Dachary <ldachary@redhat.com>

FileStore: remove unused local variable 'handle'

Remove unused local variable 'handle' in FileStore::collection_empty
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>

FileStore: potential memory leak if _fgetattrs fails

Memory leak happens if _fgetattrs encounters some error and simply returns.
Fixes: #13597
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>

doc: download GPG key from download.ceph.com

Fixes: #13603
Signed-off-by: Ken Dreyer <kdreyer@redhat.com>

doc/release-notes: v0.94.5

Signed-off-by: Sage Weil <sage@redhat.com>

release-notes: draft v0.94.5 release notes

Signed-off-by: Loic Dachary <ldachary@redhat.com>

rocksdb: remove rdb source files from dist tarball

rdb is based on NodeJS, and we don't build rdb to use rocksdb as
a keyvaluestore backend.

Fixes: #13554
Signed-off-by: Kefu Chai <kchai@redhat.com>

vstart.sh: grant full access to Swift testing account

This makes Swift testing more convinent.

Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>

Merge pull request #6375 from david-z/wip-fix-kv-stripe-size-conf

KeyValueStore: fix the name's typo of keyvaluestore_default_strip_size

Reviewed-by: Kefu Chai <kchai@redhat.com>

KeyValueStore: fix the name's typo of keyvaluestore_default_strip_size

Signed-off-by: Zhi Zhang <zhangz.david@outlook.com>

Merge pull request #6224 from vmcloud/wip-13443

ceph-fuse: fix log restart timing after fork

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #6305 from majianpeng/optimize-get-object-context

osd: optimize ReplicatedPG::get_object_context() SnapContext setup

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #6244 from majianpeng/filestore-xattr

os/FileStore: avoid removexattr call on chain_setxattr when value is known to be small

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #6299 from H3C/wip-yrf-malloc

osd/tools: avoid unnecessary new and delete ObjectStore::Transaction calls

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #6306 from H3C/wip-mon-auth

mon: should not set isvalid = true when cephx_verify_authorizer return false

Reviewed-by: Kefu Chai <kchai@redhat.com>

Revert "Speed optimizations. Merged 3 writes into 1."

This reverts commit 91497e46331b4755b9ff23b7ba11e631d64413ac.

Oops, this is injecting \0 in the log output.

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #6307 from aclamk/wip-faster-log

log/Log.cc: speed optimizations. Merged 3 writes into 1.

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #6326 from liewegas/wip-cache-pin-unpin

osd: add pin/unpin support to cache tier

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #6240 from xiexingguo/xxg-wip-13471

osd:  primary and up_primary when building a new past_interval

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #5954 from rohanmars/wip-rhel59-fixes

rhel 5.9 librados compile fix, moved blkid to RBD check/compilation

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #6210 from dx9/wip-12406-alpine-string-macro

assert: __STRING macro is not defined by musl libc.

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #6243 from free-luowei/master

Init crush_location in Objecter from config file.

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #6252 from dx9/wip-12406-mallinfo

common/MemoryModel: Added explicit feature check for mallinfo().

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #6277 from branch-predictor/bp-pgload-rm-interim-set

osd: drop the interim set from load_pgs()

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #6333 from xiexingguo/xxg-wip-13552

LFNIndex: remove redundant local variable 'obj'.

Merge pull request #6360 from xiexingguo/xxg-wip-13575

ReplicatedPG: remove unused local variables

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #6342 from dachary/wip-ceph-disk

tests: ceph-disk workunit uses configobj

ReplicatedPG: remove unused local variables

remove some unused local variables.
Fixes: #13575
Signed-off-by: xie.xingguo@zte.com.cn

tests: ceph-disk workunit uses configobj

Instead of using augtool to modify the configuration file, use
configobj. It is also used by the install teuthology task. The .ini
lens (puppet lens really) is unable to read ini files created by
configobj.

Signed-off-by: Loic Dachary <ldachary@redhat.com>

tests: ceph-disk workunit uses the ceph task

The ceph-disk workunit deploy keys that are not deployed by default by
the ceph teuthology task.

The OSD created by the ceph task are removed from the default
bucket (via osd rm) so they do not interfere with the tests.

Signed-off-by: Loic Dachary <ldachary@redhat.com>

Merge pull request #6355 from ritz303/wip-doc-12784

doc: Updated the OS recommendations for newer Ceph releases

Reviewed-by: Sage Weil <sage@redhat.com>

cmake: Use uname instead of arch. arch is deprecated in linux-utils and coreutils does not install it by default.

Signed-off-by: John Coyle <dx9err@gmail.com>

doc: Removed the NOTE section about non-LTS supported distributions

Fixes: 12784
Signed-off-by: ritz303 <ritz_303@yahoo.com>

Merge pull request #6346 from guangyy/rgw-core

rgw: support core file limit for radosgw daemon

Reviewed-by: Sage Weil <sage@redhat.com>

doc: Updated the OS recommendations for newer Ceph releases

Fixes: 12784
Signed-off-by: ritz303 <ritz_303@yahoo.com>

Merge pull request #6343 from dx9/wip-12406-xattr

os/chain_xattr: On linux use linux/limits.h for XATTR_NAME_MAX.

Reviewed-by: Kefu Chai <kchai@redhat.com>

rgw: support core file limit for radosgw daemon

When calling daemon function, the default is to disable the core dump
by setting the core file limit as 0, we provide a configuration in
ceph.conf to explicity configure the core file size.

Signed-off-by: Guang Yang <yguang@yahoo-inc.com>

mailmap: Jason Dillaman name normalization

Signed-off-by: M Ranga Swami Reddy <swamireddy@gmail.com>

mailmap: Joao Eduardo Luis name normalization

Signed-off-by: M Ranga Swami Reddy <swamireddy@gmail.com>

mailmap: Min Chen name normalization

Signed-off-by: M Ranga Swami Reddy <swamireddy@gmail.com>

mailmap: James Page name normalization

Signed-off-by: M Ranga Swami Reddy <swamireddy@gmail.com>

mailmap: Ken Dreyer name normalization

Signed-off-by: M Ranga Swami Reddy <swamireddy@gmail.com>

mailmap: tobe affiliation

Signed-off-by: M Ranga Swami Reddy <swamireddy@gmail.com>

mailmap: Ruben Kerkhof affiliation

Signed-off-by: M Ranga Swami Reddy <swamireddy@gmail.com>

mailmap: Brian Andrus affiliation

Signed-off-by: M Ranga Swami Reddy <swamireddy@gmail.com>

mailmap: Kadu Ribeiro affiliation

Signed-off-by: M Ranga Swami Reddy <swamireddy@gmail.com>

mailmap: Jeff Epstein affiliation

Signed-off-by: M Ranga Swami Reddy <swamireddy@gmail.com>

mailmap: Jeff Weber affiliation

Signed-off-by: M Ranga Swami Reddy <swamireddy@gmail.com>

mailmap: ritz303 affiliation

Signed-off-by: M Ranga Swami Reddy <swamireddy@gmail.com>

mailmap: chenji affiliation

Signed-off-by: M Ranga Swami Reddy <swamireddy@gmail.com>

mailmap: Burkhard Linke affiliation

Signed-off-by: M Ranga Swami Reddy <swamireddy@gmail.com>

mailmap: Sylvain Baubeau affiliation

Signed-off-by: M Ranga Swami Reddy <swamireddy@gmail.com>

mailmap: Siddharth Sharma affiliation

Signed-off-by: M Ranga Swami Reddy <swamireddy@gmail.com>

mailmap: Milan Broz affiliation

Signed-off-by: M Ranga Swami Reddy <swamireddy@gmail.com>

mailmap: Matt Benjamin affiliation

Signed-off-by: M Ranga Swami Reddy <swamireddy@gmail.com>
Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>

mailmap: Casey Bodley affiliation

Signed-off-by: M Ranga Swami Reddy <swamireddy@gmail.com>

mailmap: Ali Maredia affiliation

Signed-off-by: M Ranga Swami Reddy <swamireddy@gmail.com>

mailmap: Brad Hubbard affiliation

Signed-off-by: M Ranga Swami Reddy <swamireddy@gmail.com>

mailmap: Juan A. Suarez Romero affiliation

Signed-off-by: M Ranga Swami Reddy <swamireddy@gmail.com>

mailmap: Xiaowei Chen name normalization

Signed-off-by: M Ranga Swami Reddy <swamireddy@gmail.com>

mailmap: Wei Qian affiliation

Signed-off-by: M Ranga Swami Reddy <swamireddy@gmail.com>

mailmap: Li Peng affiliation

Signed-off-by: M Ranga Swami Reddy <swamireddy@gmail.com>

mailmap: Robin H. Johnson affiliation

Signed-off-by: M Ranga Swami Reddy <swamireddy@gmail.com>
Reviewed-by: Robin Johnson <robin.johnson@dreamhost.com>

mailmap: Ren Huanwen affiliation

Signed-off-by: M Ranga Swami Reddy <swamireddy@gmail.com>

mailmap: Yehua Chen name normalization

Signed-off-by: M Ranga Swami Reddy <swamireddy@gmail.com>:

mailmap: Xinze Chi name normalization

Signed-off-by: M Ranga Swami Reddy <swamireddy@gmail.com>

mailmap: Xie Xiexingguo affiliation

Signed-off-by: M Ranga Swami Reddy <swamireddy@gmail.com>

mailmap: Xie Rui name normalization

Signed-off-by: M Ranga Swami Reddy <swamireddy@gmail.com>

mailmap: Sangdi Xu name normalization

Signed-off-by: M Ranga Swami Reddy <swamireddy@gmail.com>
Reviewed-by: Xusangdi <xu.sangdi@h3c.com>

mailmap: Radoslaw Zarzynski name normalization

Signed-off-by: M Ranga Swami Reddy <swamireddy@gmail.com>

mailmap: Haomai Wang name normalization

Signed-off-by: M Ranga Swami Reddy <swamireddy@gmail.com>
Reviewed-by: Haomai Wang <haomaiwang@gmail.com>

os/chain_xattr: On linux use linux/limits.h for XATTR_NAME_MAX.

Signed-off-by: John Coyle <dx9err@gmail.com>

LFNIndex: remove redundant local variable 'obj'.

local variable 'obj' in LFNIndex::list_subdirs() never used and shall be removed.
Fixes: #13552
Signed-off-by: xie.xingguo@zte.com.cn

rgw: add explicit success/error paths in RGWGetObj::execute()

Fixes: #12352
Signed-off-by: Javier M. Mellid <jmunhoz@igalia.com>

mailmap: Dennis Schafroth affiliation

Signed-off-by: M Ranga Swami Reddy <swamireddy@gmail.com>