NVMEDevice: add flush perf counter calculate

Signed-off-by: Haomai Wang <haomai@xsky.com>

RocksDB: add block cache size option to RocksDB

Signed-off-by: Haomai Wang <haomai@xsky.com>

NVMEDevice: let perf counter do early

Signed-off-by: Haomai Wang <haomai@xsky.com>

NVMEDevice: make flush wait for all write completed

Signed-off-by: Haomai Wang <haomai@xsky.com>

NVMEDevice: delay nvme aio thread start in case of logger is null

Signed-off-by: Haomai Wang <haomai@xsky.com>

NVMEDevice: let aio_write submit request FIFO

Signed-off-by: Haomai Wang <haomai@xsky.com>

NVMEDevice: impl read_buffered method

Signed-off-by: Haomai Wang <haomai@xsky.com>

NVMEDevice: adjust indent

Signed-off-by: Haomai Wang <haomai@xsky.com>

BlockDevice: Move KernelDevice reap ioc to BlockDevice

Signed-off-by: Haomai Wang <haomai@xsky.com>

NVMEDevice: add log message to reminder potential failed reason

Signed-off-by: Haomai Wang <haomai@xsky.com>

NVMEDevice: use stringify instead of std::to_string

Signed-off-by: Haomai Wang <haomai@xsky.com>

NVMEDevice: disable flush command now

Signed-off-by: Haomai Wang <haomai@xsky.com>

NVMEDevice: add perf counter

Signed-off-by: Haomai Wang <haomai@xsky.com>

NVMEDevice: adjust request/task memory pool size

Signed-off-by: Haomai Wang <haomai@xsky.com>

NVMEDevice: don't try to acquire lock always

Signed-off-by: Haomai Wang <haomai@xsky.com>

NVMEDevice: make aio thread pause when idle

Signed-off-by: Haomai Wang <haomai@xsky.com>

NVMEDevice: add retry support

Signed-off-by: Haomai Wang <haomai@xsky.com>

NVMEDevice: add flush support

Signed-off-by: Haomai Wang <haomai@xsky.com>

NVMEDevice: fix multi ops in one IOContext bug

Signed-off-by: Haomai Wang <haomai@xsky.com>

NVMEDevice: Fix typo

Signed-off-by: Haomai Wang <haomai@xsky.com>

KernelDevice: Remove redundancy lines

Signed-off-by: Haomai Wang <haomai@xsky.com>

NVMEDevice: make controller global shared

Signed-off-by: Haomai Wang <haomai@xsky.com>

NVMEDevice: reorder signal in case of signaled thread modify IOContext

Signed-off-by: Haomai Wang <haomai@xsky.com>

BlueFS: Use num_pending instead of pending_aios

Signed-off-by: Haomai Wang <haomai@xsky.com>

BlockDevice: initialize backend_priv

Signed-off-by: Haomai Wang <haomai@xsky.com>

NVMEDevice: make read/write all async

Signed-off-by: Haomai Wang <haomai@xsky.com>

NVMEDevice: Fix static method

Signed-off-by: Haomai Wang <haomai@xsky.com>

NVMEDevice: SPDK only permit submit/poll within one thread

Signed-off-by: Haomai Wang <haomai@xsky.com>

NVMEDevice: fix unknown serial number problem

Signed-off-by: Haomai Wang <haomai@xsky.com>

NVMEDevice: wrap C header file

Signed-off-by: Haomai Wang <haomai@xsky.com>

Makefile: let spdk/dpdk libraries linked in upper layer

Signed-off-by: Haomai Wang <haomai@xsky.com>

NVMEDevice: add spdk/pci.h

Signed-off-by: Haomai Wang <haomai@xsky.com>

NVMEDevice: nvme.h use _Static_assert which from c11

Signed-off-by: Haomai Wang <haomai@xsky.com>

NVMEDevice: let IOContext can use NVMEDevice pointer

Signed-off-by: Haomai Wang <haomai@xsky.com>

NVMEDevice: remove unused variables

Signed-off-by: Haomai Wang <haomai@xsky.com>

configure.ac: fix spdk external header location

Signed-off-by: Haomai Wang <haomai@xsky.com>

BlueFS: fix comparison warning

Signed-off-by: Haomai Wang <haomai@xsky.com>

BlockDevice: Add override to explicit

Signed-off-by: Haomai Wang <haomai@xsky.com>

BlockDevice: Fix compile error

Signed-off-by: Haomai Wang <haomai@xsky.com>

NVMEDevice: fix compile error

Signed-off-by: Haomai Wang <haomai@xsky.com>

NVMEDevice: use device name instead of path

Signed-off-by: Haomai Wang <haomai@xsky.com>

makefile: add SPDK detect and NVMEDevice to Makefile

Signed-off-by: Haomai Wang <haomai@xsky.com>

BlueStore: Add BlockDevice ability to create different backend

Signed-off-by: Haomai Wang <haomai@xsky.com>

BlueStore: abostract BlockDevice based KernelDevice and NVMEDevice

Signed-off-by: Haomai Wang <haomai@xsky.com>

bluestore: rename BlockDevice to KernelDevice matching NVMEDevice

Signed-off-by: Haomai Wang <haomai@xsky.com>

bluestore: add NVMEDevice backend

Signed-off-by: Haomai Wang <haomai@xsky.com>

Merge pull request #7266 from sahithi-rv/master

common/str_map: cleanup: replaced get_str_map() function overloading by using default parameters for delimiters

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #7344 from songbaisen/song8

crush: add safety assert

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #7363 from cxwshawn/mon-sync-fix

mon: add mon_config_key prefix when sync full

Fixes: #14577
Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #7383 from liewegas/wip-bluestore

osd: bluestore: some new c++11-isms, a couple reverts

Merge pull request #7014 from efirs/ef_replace_coll_t_by_const_coll_t_ref

osd: reduce CPU usage by replacing coll_t by const coll_t&

Reviewed-by: Haomai Wang <haomai@xsky.com>
Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #7333 from xdonghai/xdh1

osd: FileStore: modify the format of colon

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #7392 from tianshan/wip-14536

rados: fix race condition in load-gen complete callback

Reviewed-by: Piotr Dałek <piotr.dalek@ts.fujitsu.com>

Merge pull request #7395 from xiexingguo/xxg-wip-fuse

os/fusestore: add error handling

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #7396 from tchaikov/wip-14537

mon: compact full epochs also

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #7402 from liewegas/wip-rados-bench

rados: make rados bench metadata backward compatible

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #7418 from renhwsky/renhw-wip-monmapmonitor-cleanup

mon: some cleanup in MonmapMonitor.cc

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Joao Eduardo Luis <joao@suse.de>

Merge pull request #7420 from mikulely/fix-osd-mon-exit-issue

osd, mon: fix exit issue

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #7430 from xiexingguo/xxg-wip-kstore

osd: kstore: fix decode logic and add flush

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #7432 from branch-predictor/bp-fix-read-bench

rados: fix wrong op/object sizes in rand/seq bench

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #7436 from liewegas/wip-bash

tests: qa/workunits/objectstore/test_fuse.sh: no bashism

Merge pull request #7404 from sahithi-rv/Mutex

rbd_fuse: replaced pthread_mutex*() functions with ceph Mutex wrapper

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

tools/rados/rados.cc: fix race condition in load-gen complete callback

Fixes: #14536
Signed-off-by: Tianshan Qu <tianshan@xsky.com>

Merge pull request #6131 from rzarzynski/wip-admincreds-in-s3-keystone

rgw: support admin credentials in S3-related Keystone authentication.

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: support admin credentials in S3-related Keystone authentication.

Fixes: #13302
Backport: infernalis, hammer
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

Merge pull request #7298 from racpatel/wip-doc-rac2

doc :- fixing image in section ERASURE CODING

Reviewed-by: Loic Dachary <ldachary@redhat.com>

ceph_osd.cc: fix unreachable flush call

The calling chain for generic_server_usage():

  generic_server_usage()
    ->generic_usage(true)
    ->exit(1)
  cout.flush()

any statements after generic_server_usage() would not be reached,so we
need to flush cout in generic_usage().

Signed-off-by: Jiaying Ren <jiaying.ren@umcloud.com>

cmake: musl libc does not implement backtrace. Added feature check and fallback to libexecinfo.

Signed-off-by: John Coyle <dx9err@gmail.com>

Merge pull request #7264 from ceph/wip-doc-RGW

doc: rgw: port changes from downstream to upstream

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #7244 from mikulely/fix-authtool-doc

doc: remove redundant space in ceph-authtool/monmaptool doc

doc: Updated the RPM section for RHEL and CentOS

Fixes: #10245
Signed-off-by: Aron Gunn <ritz_303@yahoo.com>

Merge pull request #7027 from mathslinux/fix-s3-csharp-doc

doc: fix S3 C# example

Merge pull request #7000 from zhouyuan/fix_cache_tier_doc

doc: fix misleading configuration guide on cache tiering

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #6930 from wido/rgw-key-docs

doc: use 'ceph auth get-or-create' for creating RGW keyring

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #7384 from wido/mirroring

doc: script and guidelines for mirroring Ceph

Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>

Merge pull request #7435 from xiexingguo/xxg-wip-14561

osd: BlueStore: fix null pointer access

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #7271 from somnathr/wip-transaction-delete

osd: avoid heap allocations for ObjectStore::Transaction

http://pulpito.ceph.com/sage-2016-01-28_12:50:51-rados-wip-sage-testing3---basic-mira/

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #6440 from stiopaa1/scrubbingInfo

mon: warn if pg(s) not scrubbed

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: David Zafman <dzafman@redhat.com>

Merge pull request #7075 from shun-s/shun-fix

global: do not start two daemons with a single pid-file

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #7111 from chenji-kael/master

osd: FileStore: print file name before osd assert if read file failed

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #7268 from ifed01/wip-14400

common: snappy decompressor may assert when handling segmented input bufferlist

Reviewed-by: Haomai Wang <haomai@xsky.com>

Merge pull request #7276 from caibo2014/fix-messager-null

mon/MonClient: avoid null pointer error when configured incorrectly

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #7330 from ifed01/wip-pool-stat-cleanup

librados: remove duplicate definitions for rados pool_stat_t and cluster_stat_t

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #7340 from ceph/wip-portable-time

common: ake ceph_time clocks work under BSD

Reviewed-by: Erwan Velu <erwan@redhat.com>

Merge pull request #7341 from songbaisen/song7

mon: consider the pool size when setting pool crush rule

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #7355 from yuanjingkai/master

os/fs: fix io_getevents argument

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #7348 from xiexingguo/xxg-wip-14484

osd: BlueStore: fix space leak

http://pulpito.ceph.com/sage-2016-01-27_18:39:48-rados-wip-sage-testing---basic-smithi/

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #7368 from somnathr/wip-jemalloc-build

build: allow jemalloc enabled build with rocksdb-static

http://pulpito.ceph.com/sage-2016-01-27_18:39:48-rados-wip-sage-testing---basic-smithi/

Reviewed-by: Sage Weil <sage@redhat.com>

BlueStore: fix null pointer access

Fixes: #14561
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>

qa/workunits/objectstore/test_fuse.sh: no bashism

Signed-off-by: Sage Weil <sage@redhat.com>

include/str_map.h removed unnecessary function overloading of
get_str_map()

Signed-off-by: Sahithi R V <sahithi.rv1@gmail.com>
tests successful

Signed-off-by: Sahithi R V <sahithi.rv1@gmail.com>

BlueStore: fix typo

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>

rbd_fuse:replaced pthread_mutex*() functions with ceph Mutex wrapper

Signed-off-by: Sahithi R V <tansy.rv@gmail.com>

kstore: flush before we really start a clone

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>

kstore: flush before we really start a truncate

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>

BlueStore: add fast check against empty list

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>

kstore: add fast check against empty list

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>

tools/rados: fix wrong op/object sizes in rand/seq bench

Metadata contain correct information about last bench write run, yet
these are ignored in subsequent bench rand/seq runs, resulting in
wrong perf numbers and failures when not using --no-verify.

Signed-off-by: Piotr Dałek <piotr.dalek@ts.fujitsu.com>

kstore: simplify open_collection logic a bit

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>

kstore: fix unmatched type of decode

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>