rbd-nbd: Fix aio_callback error handling

Change aio_callback return code handling for NBD_CMD_READ command.

Tracker:
http://tracker.ceph.com/issues/15604

Signed-off-by: Chang-Yi Lee <cy.l@inwinstack.com>

Fix RBD-NBD aio_callback error handling

Tracker-Id: #15604

Signed-off-by: Chang-Yi Lee <cy.l@inwinstack.com>

Fix RBD-NBD aio_callback error handling

Tracker-Id: #15604

Signed-off-by: Chang-Yi Lee <cy.l@inwinstack.com>

Merge pull request #8683 from Ved-vampir/zlib_fix

compressor: fix of error code control in zlib decompress

Reviewed-by: Haomai Wang <haomai@xsky.com>

Merge pull request #8489 from SUSE/wip-15419

systemd: make Ceph daemons dependent upon time-sync.target

Reviewed-by: Tim Serong <tserong@suse.com>
Reviewed-by: James Page <james.page@ubuntu.com>
Reviewed-by: Ken Dreyer <kdreyer@redhat.com>

Merge pull request #8721 from ibravo/patch-2

doc: update quick-ceph-deploy.rst

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #8713 from HeyoQiang/master

osd/PG: remove unused variable have

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>

PG:clear an unused variable: have

Signed-off-by: Yongqiang He <he.yongqiang@h3c.com>

Merge pull request #8723 from cooboos/wrong_spell

doc: correct wrong spell 'mnay' to 'many'

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>

Merge pull request #6764 from kylinstorage/fix-check_become_tier

mon: fix OSDMonitor::_check_become_tier

Reviewed-by: Xinze Chi <xinze@xsky.com>

Merge pull request #8103 from adamemerson/wip-sign-of-the-time-debug

common: signed coarse time

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #8407 from dx9/wip-os-release

common/util: add support for distro info from /etc/os-release file

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #8437 from jjhuo/single_delete

os/kv, os/bluestore: Enable SingleDelete with RocksDB and Bluestore

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #8451 from tchaikov/wip-signal-hanlder-typo

global/signal_handler: fix typo

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #8503 from yuyuyu101/wip-spdk-improve

os/bluestore/NVMEDevice: performance improvements

Merge pull request #8702 from kmroz/wip-fix-run-dir-chown

global-init: fixup chown of the run directory along with log and asok files

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #8728 from liewegas/wip-notify

osd/osd_types: render notify op properly

Reviewed-by: Kefu Chai <kchai@redhat.com>

os/bluestore/BlueStore: cleanup overlay using single delete

Overlay entries are also only written once, eligible to use single delete.

Signed-off-by: Jianjian Huo <jianjian.huo@ssi.samsung.com>

os/bluestore/BlueStore: cleanup the wal entries using single delete

By use of single delete, RocksDB should be able to remove deleted wal
entries with only one compaction in theory, when wal entries land on level0.
This should reduce bluestore wal entries incurred WAF.

Signed-off-by: Jianjian Huo <jianjian.huo@ssi.samsung.com>

kv/RocksDBStore: implement rm_single_delete

Use SingleDelete to delete keys which were never overwritten.

Signed-off-by: Jianjian Huo <jianjian.huo@ssi.samsung.com>

kv/KeyValueDB: add a new interface for single delete.

This is useful for log-insert-merge tree based key value store, such as
RocksDB, to avoid more LSM compactions for already deleted key value pairs.

Signed-off-by: Jianjian Huo <jianjian.huo@ssi.samsung.com>

Merge pull request #8474 from xiaoxichen/wip-pycephfs-namespace

pycephfs: using namespace for data isolation

Reviewed-by: John Spray <john.spray@redhat.com>

ceph.spec.in: recommend ntp-daemon on SUSE

SUSE has settled on "ntp-daemon" as the generic package name. The "ntp" and
"chrony" etc. packages have "Provides: ntp-daemon" in their respective spec
files.

References: http://tracker.ceph.com/issues/15419
Signed-off-by: Nathan Cutler <ncutler@suse.com>

deb: make ceph-base and radosgw recommend time-daemon

References: http://tracker.ceph.com/issues/15419

Signed-off-by: Nathan Cutler <ncutler@suse.com>

Merge pull request #8715 from runsisi/wip-fix-cmake

cmake: use LINK_PRIVATE instead of PRIVATE for CMake version == 2.8.11

Reviewed-by: Ali Maredia <amaredia@redhat.com>

Merge pull request #8730 from ibravo/patch-3

doc: Updated ceph-deploy osd to choose underlying file system

Merge pull request #8745 from ErwanAliasr1/evelu-deps

install-deps: Adding gcc for debian based systems

Reviewed-by: Sage Weil <sage@redhat.com>

admin-socket: use chown instead of fchown

fchown() returns success, but does not change asok file
ownership. chown() does.

Signed-off-by: Karol Mroz <kmroz@suse.com>

install-deps: Adding gcc for debian based systems

When running install-deps on a minimalistic system, we reach that situation :

dpkg-checkbuilddeps --admindir=/tmp/install-deps.5526 debian/control
    sh: 1: gcc: not found
    dpkg-checkbuilddeps: warning: Couldn't determine gcc system type, falling back to default (native compilation)
    dpkg-checkbuilddeps: error: cannot open /tmp/install-deps.5526/status: No such file or directory

This means that we shall install gcc before calling dpkg-checkbuilddeps.

Signed-off-by: Erwan Velu <erwan@redhat.com>

Merge pull request #8743 from ceph/revert-8502-song20

Revert "crushtool: do not allow to compile crushmap with repeat rules…

Reviewed-by: Sage Weil <sage@redhat.com>

Revert "crushtool: do not allow to compile crushmap with repeat ruleset."

compressor: fix of error code control in zlib decompress

Signed-off-by: Alyona Kiseleva <akiselyova@mirantis.com>

Merge pull request #8725 from liewegas/wip-make-check

test/encoding/readable.sh: fix make check for autotool

Reviewed-by: Kefu Chai <kchai@redhat.com>

test/encoding/readable.sh: fix make check for autotools

Use ./ if ceph-dencoder is in the local directory.

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #8719 from SUSE/wip-fix-multidump

multi-dump.sh: fix usage function

Reviewed-by: Kefu Chai <kchai@redhat.com>

Doc: Updated ceph-deploy osd to choose underlying file system

Included paragraph about --fs-type and --bluestore

Signed-off-by: Ignacio Bravo ibravo@hotmail.com

Doc: Update quick-ceph-deploy.rst

Signed-off-by: Ignacio Bravo ibravo@hotmail.com

osd/osd_types: render notify OSDOp properly

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #8640 from xiexingguo/xxg-wip-osdsideeffect

osd/ReplicatedPG: allow CMPXATTR ops to trigger side effects too

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #8694 from wuxingyi/fixincomplete

osd/PG: PG is only likely to go active when min_size turns smaller.

Reviewed-by: Sage Weil <sage@redhat.com>

osd: honour result code passed in; tidy-up changesReviewed-by: Sage Weil <sage@redhat.com>

osd: honour result code passed in; tidy-up changes

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #8675 from roidayan/xio-build_deb_with_xio

xio: add MNop.h to dist tarball

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #8678 from jack-changtao/pgbackend

osd/PGBackend: if min > max, PGBackend::objects_list_partial will list all objects of that pg

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #8680 from ceph/rm-distribute

tools: remove installation for distribute. It is no longer maintained

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #8681 from xiexingguo/xxg-wip-crushfix

crush: fix mishandled result of get_bucket() method

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #8707 from liewegas/wip-kv-merge

kv: add merge operator support, fix test

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #8688 from xiexingguo/xxg-wip-crushtooltip

tools/crushtool: add straw2 support for help message

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #8671 from majianpeng/rados-objectsize-smaller-blocksize

tools/rados: fix "Floating point exception" if  objectsize smaller than  blocksize when do write-bench.

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #8502 from songbaisen/song20

crushtool: do not allow to compile crushmap with repeat ruleset.

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #8724 from aderumier/master

sysvinit: fix ceph init script

Reviewed-by: Sage Weil <sage@redhat.com>

fix ceph init script

commit 65963739cd6815b8008282c8f64cd64365662e60 have introduce a bug

test variables need to be quoted, or -n always return true, even if variables don't exist

doc: correct wrong spell 'mnay' to 'many'

Signed-off-by: wangsongbo <wangsongbo@unitedstack.com>

multi-dump.sh: fix usage function

The usage() function was not producing any output.

Signed-off-by: Nathan Cutler <ncutler@suse.com>

systemd: make Ceph daemon units "want" time-sync.target

Fixes: http://tracker.ceph.com/issues/15419
Signed-off-by: Nathan Cutler <ncutler@suse.com>

global-init: fixup inconsistent use of ceph ctx and conf

Signed-off-by: Karol Mroz <kmroz@suse.com>

global-init: chown pid files

Signed-off-by: Karol Mroz <kmroz@suse.com>

global-init: chown run dir

Also performs log file chown() operations if permission drop has been
deferred. Documents that admin socket chown() happen in the common init
path.

Signed-off-by: Karol Mroz <kmroz@suse.com>

common-init: chown admin socket after service thread started

Signed-off-by: Karol Mroz <kmroz@suse.com>

global-init: check init flags and set accordingly

If init flags have changed between the time ceph context was
instantiated and now, update them. This can happen, for example, if
between manual global_pre_init() and global_init() calls, a daemon adds
modifies it's init flags.

Signed-off-by: Karol Mroz <kmroz@suse.com>

global-init: add a path chown wrapper function

Signed-off-by: Karol Mroz <kmroz@suse.com>

ceph-context: add function to set init flags

Signed-off-by: Karol Mroz <kmroz@suse.com>

cmake: use LINK_PRIVATE instead of PRIVATE for CMake version == 2.8.11

with version 2.8.11, i.e., the minimum version required by the building
system, we will hit a compile error as follows:
  /usr/bin/ld: cannot find -lPRIVATE
  collect2: error: ld returned 1 exit status
  make[2]: *** [lib/librbd.so.1.0.0] Error 1
  make[1]: *** [src/librbd/CMakeFiles/librbd.dir/all] Error 2

Signed-off-by: runsisi <runsisi@zte.com.cn>

Merge pull request #7942 from xiexingguo/xxg-wip-fixdirtyinc

mon: OSDMonitor: improve pool creation logic

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Xiaoxi Chen <xiaoxchen@ebay.com>

Merge pull request #7997 from songbaisen/song11

osdc: Reverse the probing vector in better way.

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #8384 from songbaisen/song18

crush: when take place the crush map should consider the rule is in …

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #8591 from xiexingguo/xxg-wip-15492

test: generate temp pool name in a safer way

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #8577 from runsisi/wip-fix-op-lock

osdc/Objecter: small cleanup for osd op completion lock

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #8596 from xiexingguo/xxg-wip-blue

os/filestore: add sanity check for stat() syscall

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #8710 from ceph/wip-rename-tests

Signed-off-by: Tamil Muthamizhan <tmuthami@redhat.com>

Signed-off-by: Tamil Muthamizhan <tmuthami@redhat.com>
  renamed the workunit and test to reflect reality and for better clarity

Merge pull request #8395 from renhwsky/renhw-wip-monmap

mon/monmap:  conditional optimization in build_from_host_list

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>

Merge pull request #8449 from javacruft/ceph-osd-prestart

ceph-osd-prestart.sh: drop --setuser/--setgroup

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #8458 from jjhuo/clean_blue_configs

common/config_opts: remove invalid config options of bluestore

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #8463 from majianpeng/bluestore-zero-truncate

os/bluestore/BlueStore: Don't forget assign nid when offset > size in _do_zero

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #8706 from liewegas/wip-jewel

doc/release-notes: is, not will be, basis for LTS

Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>

kv/RocksDBStore: implement merge operator

Signed-off-by: Allen Samuels <allen.samuels@sandisk.com>

kv/KeyValueDB: add merge operator interface and test

Signed-off-by: Allen Samuels <allen.samuels@sandisk.com>
Signed-off-by: Sage Weil <sage@redhat.com>

ceph_test_keyvaluedb: clean up test dir

Just like ceph_test_objectstore

Signed-off-by: Sage Weil <sage@redhat.com>

doc/release-notes: is, not will be, basis for LTS

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #8705 from liewegas/wip-jewel

doc/release-notes: revise terminology

Reviewed-by: Greg Farnum <gfarnum@redhat.com>

doc/release-notes: revise terminology

Avoid loaded 'production ready' term in favor of just 'stable'.

Signed-off-by: Sage Weil <sage@redhat.com>

rgw: fix memory leak in func 'RGWCreateBucket_ObjStore_S3::get_params' (#8670)

Signed-off-by: weiqiaomiao <wei.qiaomiao@zte.com.cn>
Reviewed-by: Casey Bodley <cbodley@redhat.com>

ceph_test_keyvaluedb: fixup unit test for keyvaluedb

Fixes: http://tracker.ceph.com/issues/15435
Signed-off-by: Allen Samuels <allen.samuels@sandisk.com>

Merge pull request #8527 from roidayan/wip-vstart_clean_prints

vstart: clean prints

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #8549 from tchaikov/wip-kill-filestore-warning

pybind, FileStore: silence gcc warnings

Reviewed-by: Haomai Wang <haomai@xsky.com>

Merge pull request #8551 from scienceluo/patch-1

doc: Fixes Different font of the title

Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
Reviewed-by: Yatin Kumbhare <yatinkumbhare@gmail.com>

bufferlist.cc fix typo in outputReviewed-by: Sage Weil <sage@redhat.com>

bufferlist.cc fix typo in output

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #8581 from emenguy/pgnum_pools_documentation

doc: adding pg_num to pools documentation

Reviewed-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>

Merge pull request #8595 from qhjindev/fix-LFNIndex

os: fix typo in LFNIndex.h

Merge pull request #8623 from rmechler/wip-15504

pybind: removed unneccesary parentheses from if statements

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #8631 from stiopaa1/buffer_fwd

image_watcher/Notifier: remove header file

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #8644 from tchaikov/wip-doc-os-recommendations

doc/start/os-recommendations.rst: add Jewel requires

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #8650 from scienceluo/wip-lkx-fixesdoc

doc: Fixes "branch -b" and "Qemu"

Reviewed-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>

Merge pull request #8674 from yatinkumbhare/doc-fix2

doc: fix broken link to monitor quorum

Reviewed-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>

Merge pull request #8630 from roidayan/xio-log_prefix

xio: add log prefix for log prints outside the XioMessenger class

Reviewed-by: Haomai Wang <haomai@xsky.com>

Merge pull request #8701 from cernceph/wip-bsweight

ceph-osd-prestart.sh: compute correct defaultweight for bluestore

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #8691 from flyd1005/master

cleanup: Fix typos, change prefered to preferred

Reviewed-by: Sage Weil <sage@redhat.com>

compute correct defaultweight for bluestore

The default crush weight should be the size of the block device, not
the tiny 10M xfs partition.

Backport: jewel
Signed-off-by: Dan van der Ster <daniel.vanderster@cern.ch>

os/bluestore/BlueFS: Record the correctly perfcouter

os/bluestore/BlueFS: record the correctly perfcounter

Reviewed-by: Sage Weil <sage@redhat.com>

os/bluestore/BlueFS: Record the correctly perfcouter.

After "log_writer->append(bl)", the length of bl become zero.
So tune the order.

Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>