vstart.sh: grant full access to Swift testing account

This makes Swift testing more convinent.

Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>

Merge pull request #6224 from vmcloud/wip-13443

ceph-fuse: fix log restart timing after fork

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #6305 from majianpeng/optimize-get-object-context

osd: optimize ReplicatedPG::get_object_context() SnapContext setup

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #6244 from majianpeng/filestore-xattr

os/FileStore: avoid removexattr call on chain_setxattr when value is known to be small

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #6299 from H3C/wip-yrf-malloc

osd/tools: avoid unnecessary new and delete ObjectStore::Transaction calls

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #6306 from H3C/wip-mon-auth

mon: should not set isvalid = true when cephx_verify_authorizer return false

Reviewed-by: Kefu Chai <kchai@redhat.com>

Revert "Speed optimizations. Merged 3 writes into 1."

This reverts commit 91497e46331b4755b9ff23b7ba11e631d64413ac.

Oops, this is injecting \0 in the log output.

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #6307 from aclamk/wip-faster-log

log/Log.cc: speed optimizations. Merged 3 writes into 1.

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #6326 from liewegas/wip-cache-pin-unpin

osd: add pin/unpin support to cache tier

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #6240 from xiexingguo/xxg-wip-13471

osd:  primary and up_primary when building a new past_interval

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #5954 from rohanmars/wip-rhel59-fixes

rhel 5.9 librados compile fix, moved blkid to RBD check/compilation

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #6210 from dx9/wip-12406-alpine-string-macro

assert: __STRING macro is not defined by musl libc.

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #6243 from free-luowei/master

Init crush_location in Objecter from config file.

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #6252 from dx9/wip-12406-mallinfo

common/MemoryModel: Added explicit feature check for mallinfo().

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #6277 from branch-predictor/bp-pgload-rm-interim-set

osd: drop the interim set from load_pgs()

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #6333 from xiexingguo/xxg-wip-13552

LFNIndex: remove redundant local variable 'obj'.

Merge pull request #6360 from xiexingguo/xxg-wip-13575

ReplicatedPG: remove unused local variables

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #6342 from dachary/wip-ceph-disk

tests: ceph-disk workunit uses configobj

ReplicatedPG: remove unused local variables

remove some unused local variables.
Fixes: #13575
Signed-off-by: xie.xingguo@zte.com.cn

tests: ceph-disk workunit uses configobj

Instead of using augtool to modify the configuration file, use
configobj. It is also used by the install teuthology task. The .ini
lens (puppet lens really) is unable to read ini files created by
configobj.

Signed-off-by: Loic Dachary <ldachary@redhat.com>

tests: ceph-disk workunit uses the ceph task

The ceph-disk workunit deploy keys that are not deployed by default by
the ceph teuthology task.

The OSD created by the ceph task are removed from the default
bucket (via osd rm) so they do not interfere with the tests.

Signed-off-by: Loic Dachary <ldachary@redhat.com>

Merge pull request #6355 from ritz303/wip-doc-12784

doc: Updated the OS recommendations for newer Ceph releases

Reviewed-by: Sage Weil <sage@redhat.com>

doc: Removed the NOTE section about non-LTS supported distributions

Fixes: 12784
Signed-off-by: ritz303 <ritz_303@yahoo.com>

Merge pull request #6346 from guangyy/rgw-core

rgw: support core file limit for radosgw daemon

Reviewed-by: Sage Weil <sage@redhat.com>

doc: Updated the OS recommendations for newer Ceph releases

Fixes: 12784
Signed-off-by: ritz303 <ritz_303@yahoo.com>

Merge pull request #6343 from dx9/wip-12406-xattr

os/chain_xattr: On linux use linux/limits.h for XATTR_NAME_MAX.

Reviewed-by: Kefu Chai <kchai@redhat.com>

rgw: support core file limit for radosgw daemon

When calling daemon function, the default is to disable the core dump
by setting the core file limit as 0, we provide a configuration in
ceph.conf to explicity configure the core file size.

Signed-off-by: Guang Yang <yguang@yahoo-inc.com>

os/chain_xattr: On linux use linux/limits.h for XATTR_NAME_MAX.

Signed-off-by: John Coyle <dx9err@gmail.com>

LFNIndex: remove redundant local variable 'obj'.

local variable 'obj' in LFNIndex::list_subdirs() never used and shall be removed.
Fixes: #13552
Signed-off-by: xie.xingguo@zte.com.cn

Merge pull request #6285 from dx9/wip-12406-envz

drop envz.h includes

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #6301 from dx9/wip-12406-ditch-loff_t-for-off_t

libcephfs: Improve portability by replacing loff_t type usage with off_t

Reviewed-by: Greg Farnum <gfarnum@redhat.com>

Merge pull request #6196 from guangyy/wip-12754

osd: auto repair EC pool

Reviewed-by: David Zafman <dzafman@redhat.com>

tracing: add tracepoints for cache pin/unpin

Signed-off-by: Zhiqiang Wang <zhiqiang.wang@intel.com>

osd: return ENOENT when object doesn't exist for cache pin/unpin

Signed-off-by: Zhiqiang Wang <zhiqiang.wang@intel.com>

test/tier: add test for cache_pin

Signed-off-by: Zhiqiang Wang <zhiqiang.wang@intel.com>

test/tier: test flush/evict on pinned object

Should return -EINVAL.

Signed-off-by: Zhiqiang Wang <zhiqiang.wang@intel.com>

osd/ReplicatedPG: reject flush/evict ops on pinned objects

Return with -EINVAL.

Signed-off-by: Zhiqiang Wang <zhiqiang.wang@intel.com>

librados: add RADOS C interfaces for pin/unpin object

Signed-off-by: Zhiqiang Wang <zhiqiang.wang@intel.com>

osd: only allow pin/unpin op on the cache tier

Reject the op when the pin/unpin op is not on the cache tier.

Signed-off-by: Zhiqiang Wang <zhiqiang.wang@intel.com>

osd: add num_objects_pinned in object_stat_sum_t

To track the number of objects pinned in a PG.

Signed-off-by: Zhiqiang Wang <zhiqiang.wang@intel.com>

osd/ReplicatePG: skip flush/evict pinned objects

Signed-off-by: Zhiqiang Wang <zhiqiang.wang@intel.com>

osd: force promotion when pin an object in cache tier

Signed-off-by: Zhiqiang Wang <zhiqiang.wang@intel.com>

osd: add support of pin/unpin objects in cache tier

Signed-off-by: Zhiqiang Wang <zhiqiang.wang@intel.com>

rados: add the support of pin/unpin object in cache tier

Adding two new APIs in librados: cache_pin_object and cache_unpin_object

Signed-off-by: Zhiqiang Wang <zhiqiang.wang@intel.com>

Merge pull request #6174 from liewegas/wip-13345

fix MOSDOp encoding

Reviewed-by: Kefu Chai <kchai@redhat.com>

doc/release-notes: drop 0.94.4 plaintext

Signed-off-by: Sage Weil <sage@redhat.com>

doc/releases: fix 0.94.4 link

Signed-off-by: Sage Weil <sage@redhat.com>

doc/release-notes: final v0.94.4 notes

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #6238 from dachary/wip-release-notes

release-notes: draft v0.94.4 release notes

Merge pull request #6297 from ritz303/wip-doc-13502

doc: Renamed the "Create a Ceph User" section and added verbage about…

Reviewed-by: jowilkin@redhat.com

Merge pull request #6311 from liewegas/wip-rocksdb

rocksdb: build with PORTABLE=1

Reviewed-by: Loic Dachary <ldachary@redhat.com>

os/Makefile: build rocksdb with PORTABLE=1

Signed-off-by: Sage Weil <sage@redhat.com>

mon: should not set isvalid = true when cephx_verify_authorizer return false

Fixes: #13525
Signed-off-by: Ruifeng Yang <yangruifeng.09209@h3c.com>

Speed optimizations. Merged 3 writes into 1.
Got rid of std::string construction.
More unification on syslog,stderr,fd.

Signed-off-by: Adam Kupczyk <akupczyk@mirantis.com>

Merge pull request #6282 from dx9/wip-12406-client-flock

client: sys/file.h includes for flock operations

Reviewed-by: John Spray <john.spray@redhat.com>

osd: remove the useless code.

For get_object_context with can_create is true, we already check
obc->ssc. So don't need other handle

Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>

osd: optimize get_object_context.

If soid didn't exist and soid is head or snapdir. In
get_snapset_context we can remove the useless objects_get_attr(SS_ATTR).
It mainly for create a new object.

Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>

drop envz.h includes

Signed-off-by: John Coyle <dx9err@gmail.com>

Merge pull request #6216 from dx9/wip-12406-alpine-prefixed-typeof

compat: use prefixed typeof extension

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #6279 from branch-predictor/bp-reorder-pglog-fields

osd/PGLog.h: reorder bool fields in PGLog struct

Reviewed-by: Sage Weil <sage@redhat.com>

client: sys/file.h includes for flock operations

Signed-off-by: John Coyle <dx9err@gmail.com>

Merge pull request #6288 from dx9/wip-12406-file-offset-check

libcephfs: only check file offset on glibc platforms

Reviewed-by: John Spray <john.spray@redhat.com>

Merge pull request #6294 from dx9/wip-12406-rgw_main-compat

rgw/rgw_main: Added compat header for TEMP_FAILURE_RETRY

Reviewed-by: Sage Weil <sage@redhat.com>

common/MemoryModel: Alpine is a linux variant but does not implement mallinfo(). Added explicit feature check.

Signed-off-by: John Coyle <dx9err@gmail.com>

compat: use prefixed typeof to support stricter environments

Signed-off-by: John Coyle <dx9err@gmail.com>

assert: __STRING is not defined by musl libc. Define __STRING when it is missing.

Signed-off-by: John Coyle <dx9err@gmail.com>

libcephfs: Improve portability by replacing loff_t type usage with off_t. 64-bit behavior on glibc is enforced with __USE_FILE_OFFSET64 compiler error.

Signed-off-by: John Coyle <dx9err@gmail.com>

Merge pull request #5219 from ceph/wip-12315-libs-compat-conditional

ceph.spec.in: fix libs-compat / devel-compat conditional

Reviewed-by: Nathan Cutler <ncutler@suse.com>

Merge pull request #5917 from caibo2014/fix-tool-makefile

tools:remove duplicate references

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #6290 from ceph/wip-rocksdb

rocksdb: use native rocksdb makefile (and our autotools)

Reviewed-by: Loic Dachary <ldachary@redhat.com>

rocksdb: 4.1

Signed-off-by: Sage Weil <sage@redhat.com>

rocksdb: build rocksdb with its own Makefile

This lets us track upstream without mantaining our own autotools fork.

Move back to rocksdb vanilla 3.11.2 (without our autotools patches).

Signed-off-by: Sage Weil <sage@redhat.com>

Makefile: link libos.a statically (no .la)

Signed-off-by: Sage Weil <sage@redhat.com>

Makefile: link mon statically (not .la)

Signed-off-by: Sage Weil <sage@redhat.com>

Makefile: make libosd.a static (not .la)

We don't dynamically link the osd.

Signed-off-by: Sage Weil <sage@redhat.com>

librados_test_stub: add missing headers

Signed-off-by: Sage Weil <sage@redhat.com>

osd/tools: new and delete ObjectStore::Transaction in a function is not necessary

Signed-off-by: Ruifeng Yang <yangruifeng.09209@h3c.com>

Merge pull request #6272 from zhouyuan/fix_cache_tier_doc

doc: fix outdated content in cache tier

Reviewed-by: Loic Dachary <ldachary@redhat.com>

doc: Renamed the "Create a Ceph User" section and added verbage about the "ceph" user

Fixes: #13502
Signed-off-by: ritz303 <ritz_303@yahoo.com>

osd: off-by-one when check deep scrubbing

Signed-off-by: Guang Yang <yguang@yahoo-inc.com>

test: add integration test for the auto repair feature

Signed-off-by: Guang Yang <yguang@yahoo-inc.com>

pg: add auto-repair for EC pool

Fixes: #12754
Signed-off-by: Guang Yang <yguang@yahoo-inc.com>

pg: only queue for recovery if there is any objects to repair after scrubbing

Signed-off-by: Guang Yang <yguang@yahoo-inc.com>

rgw/rgw_main: Added compat header for TEMP_FAILURE_RETRY

Signed-off-by: John Coyle dx9err@gmail.com

Merge remote-tracking branch 'gh/infernalis'

Merge pull request #6249 from dillaman/wip-13274-infernalis

LTTng-UST tracing should be dynamically enabled

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

libcephfs: only check file offset on glibc platforms

Signed-off-by: John Coyle dx9err@gmail.com

Merge pull request #6284 from dillaman/wip-13483-infernalis

qa: remove legacy OS support from rbd/qemu-iotests

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

qa: remove legacy OS support from rbd/qemu-iotests

RHEL7 derivatives were failing test 002 since they were using
legacy test cases for now unsupported OSes.

Fixes: #13483
Signed-off-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #6273 from jdurgin/wip-13496

librbd: fix rebuild_object_map() when no object map exists

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #5335 from zhouyuan/radosgw_admin_secret_key_alias

radosgw-admin: Create --secret-key alias for --secret

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>

Merge pull request #6281 from dachary/wip-releases

doc/release-notes: v9.1.0

doc/release-notes: v9.1.0

Signed-off-by: Loic Dachary <ldachary@redhat.com>

Merge pull request #6275 from dx9/wip-12406-prefixed-ints

client: drop prefix from ints

osd/PGLog.h: reorder bool fields in PGLog struct

Move bool fields to the bottom (end) of the struct so they are next to
each other. On x86/x64, this change saves 16 bytes per single PGLog struct
due to less bytes wasted for field alignment.

Signed-off-by: Piotr Dałek <piotr.dalek@ts.fujitsu.com>

osd: drop the interim set from load_pgs()

During execution of load_pgs(), all PGs are added to interim set and then
processed again from the beginning. Discard this extra loop and entire
interim set, saving a bit of memory and CPU time (by better utilization
of L1/L2 caches).

Signed-off-by: Piotr Dałek <piotr.dalek@ts.fujitsu.com>

librbd: fix rebuild_object_map() when no object map exists

Enabling the object map feature and then attempting to rebuild it
results in an assert failure, since the number of objects was
accidentally passed to ObjectMap::aio_resize() instead of the size of
the image.

Fixes: #13496
Signed-off-by: Josh Durgin <jdurgin@redhat.com>

ceph_context: remove unsafe cast for singletons

It was previously assumed that a CephContext singleton would
inherit from CephContext::AssociatedSingletonObject, but it was
not enforced.  This could result in unknown behavior when the
singleton is destroyed due to the implied virtual destructor.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

client: drop prefix from int types

Signed-off-by: John Coyle dx9err@gmail.com

doc: fix outdated content in cache tier

same as d5a56c497a844da8401661f24e68bb325be551e7

Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>