rpm: Add rpm scripts for ceph-rbd-mirror

We are currently missing the systemd scripts for the new ceph-rbd-mirror
daemons. This patch introduces them.

Signed-off-by: Boris Ranto <branto@redhat.com>

rpm: Start all the targets in %post

We need to have the sub-targets active for the ceph.target to be able
to propagate its calls to the services. If the sub-target is inactive,
the main target won't propagate the stop/restart calls.

Signed-off-by: Boris Ranto <branto@redhat.com>

rpm: implement scriptlets for the post-split daemon packages

This patch gives each of the ceph-{mds,mon,osd,radosgw} packages its own
%post, %preun, and %postun scriptlets dealing with the package's unit files.

The scriptlets of ceph-base are adapted to handle the ceph.target unit file
only.

The scriptlets of ceph-mon handle ceph-create-keys services in addition to ceph-mon.

The scriptlets of ceph-osd handle ceph-disk services in addition to ceph-osd.

Fixes: http://tracker.ceph.com/issues/14941
Signed-off-by: Nathan Cutler <ncutler@suse.com>
Signed-off-by: Boris Ranto <branto@redhat.com>

systemd: enable all the ceph .target services by default

Some distros, like Fedora and openSUSE, have a policy that all services are
disabled by default.

This patch changes that default for the ceph.target and
ceph-{mds,mon,osd,radosgw}.target services.

Signed-off-by: Nathan Cutler <ncutler@suse.com>
Signed-off-by: Boris Ranto <branto@redhat.com>

Signed-off-by: Tamil Muthamizhan <tmuthami@redhat.com>
removed ceph-deploy folder, as its been already replaced with ceph-tests.

Merge pull request #8746 from yehudasa/wip-15598

Fixes: http://tracker.ceph.com/issues/15598
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #8762 from ceph/wip-15595

rgw: fix bad free in RGWCreateBucket_ObjStore_S3

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: fix bad free in RGWCreateBucket_ObjStore_S3

get_params() will accept -ERR_LENGTH_REQUIRED from
rgw_rest_read_all_input(), in which case 'data' will not be allocated
and we attempt to free() an uninitialized pointer

Fixes: http://tracker.ceph.com/issues/15595
Signed-off-by: Casey Bodley <cbodley@redhat.com>

msg/async: add numevents statistics for external_eventsReviewed-by: Haomai Wang <haomai@xsky.com>

msg/async: add numevents statistics for external_events

Reviewed-by: Haomai Wang <haomai@xsky.com>

Merge pull request #8683 from Ved-vampir/zlib_fix

compressor: fix of error code control in zlib decompress

Reviewed-by: Haomai Wang <haomai@xsky.com>

Merge pull request #8489 from SUSE/wip-15419

systemd: make Ceph daemons dependent upon time-sync.target

Reviewed-by: Tim Serong <tserong@suse.com>
Reviewed-by: James Page <james.page@ubuntu.com>
Reviewed-by: Ken Dreyer <kdreyer@redhat.com>

Merge pull request #8721 from ibravo/patch-2

doc: update quick-ceph-deploy.rst

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #8713 from HeyoQiang/master

osd/PG: remove unused variable have

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>

PG:clear an unused variable: have

Signed-off-by: Yongqiang He <he.yongqiang@h3c.com>

Merge pull request #8723 from cooboos/wrong_spell

doc: correct wrong spell 'mnay' to 'many'

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>

Merge pull request #6764 from kylinstorage/fix-check_become_tier

mon: fix OSDMonitor::_check_become_tier

Reviewed-by: Xinze Chi <xinze@xsky.com>

Merge pull request #8103 from adamemerson/wip-sign-of-the-time-debug

common: signed coarse time

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #8407 from dx9/wip-os-release

common/util: add support for distro info from /etc/os-release file

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #8437 from jjhuo/single_delete

os/kv, os/bluestore: Enable SingleDelete with RocksDB and Bluestore

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #8451 from tchaikov/wip-signal-hanlder-typo

global/signal_handler: fix typo

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #8503 from yuyuyu101/wip-spdk-improve

os/bluestore/NVMEDevice: performance improvements

Merge pull request #8702 from kmroz/wip-fix-run-dir-chown

global-init: fixup chown of the run directory along with log and asok files

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #8728 from liewegas/wip-notify

osd/osd_types: render notify op properly

Reviewed-by: Kefu Chai <kchai@redhat.com>

os/bluestore/BlueStore: cleanup overlay using single delete

Overlay entries are also only written once, eligible to use single delete.

Signed-off-by: Jianjian Huo <jianjian.huo@ssi.samsung.com>

os/bluestore/BlueStore: cleanup the wal entries using single delete

By use of single delete, RocksDB should be able to remove deleted wal
entries with only one compaction in theory, when wal entries land on level0.
This should reduce bluestore wal entries incurred WAF.

Signed-off-by: Jianjian Huo <jianjian.huo@ssi.samsung.com>

kv/RocksDBStore: implement rm_single_delete

Use SingleDelete to delete keys which were never overwritten.

Signed-off-by: Jianjian Huo <jianjian.huo@ssi.samsung.com>

kv/KeyValueDB: add a new interface for single delete.

This is useful for log-insert-merge tree based key value store, such as
RocksDB, to avoid more LSM compactions for already deleted key value pairs.

Signed-off-by: Jianjian Huo <jianjian.huo@ssi.samsung.com>

Merge pull request #8474 from xiaoxichen/wip-pycephfs-namespace

pycephfs: using namespace for data isolation

Reviewed-by: John Spray <john.spray@redhat.com>

rgw: fix suffix in RGWZoneParams::fix_pool_names()

Fixes: http://tracker.ceph.com/issues/15598
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

ceph.spec.in: recommend ntp-daemon on SUSE

SUSE has settled on "ntp-daemon" as the generic package name. The "ntp" and
"chrony" etc. packages have "Provides: ntp-daemon" in their respective spec
files.

References: http://tracker.ceph.com/issues/15419
Signed-off-by: Nathan Cutler <ncutler@suse.com>

deb: make ceph-base and radosgw recommend time-daemon

References: http://tracker.ceph.com/issues/15419

Signed-off-by: Nathan Cutler <ncutler@suse.com>

Merge pull request #8715 from runsisi/wip-fix-cmake

cmake: use LINK_PRIVATE instead of PRIVATE for CMake version == 2.8.11

Reviewed-by: Ali Maredia <amaredia@redhat.com>

Merge pull request #8730 from ibravo/patch-3

doc: Updated ceph-deploy osd to choose underlying file system

Merge pull request #8745 from ErwanAliasr1/evelu-deps

install-deps: Adding gcc for debian based systems

Reviewed-by: Sage Weil <sage@redhat.com>

admin-socket: use chown instead of fchown

fchown() returns success, but does not change asok file
ownership. chown() does.

Signed-off-by: Karol Mroz <kmroz@suse.com>

install-deps: Adding gcc for debian based systems

When running install-deps on a minimalistic system, we reach that situation :

dpkg-checkbuilddeps --admindir=/tmp/install-deps.5526 debian/control
    sh: 1: gcc: not found
    dpkg-checkbuilddeps: warning: Couldn't determine gcc system type, falling back to default (native compilation)
    dpkg-checkbuilddeps: error: cannot open /tmp/install-deps.5526/status: No such file or directory

This means that we shall install gcc before calling dpkg-checkbuilddeps.

Signed-off-by: Erwan Velu <erwan@redhat.com>

Merge pull request #8743 from ceph/revert-8502-song20

Revert "crushtool: do not allow to compile crushmap with repeat rules…

Reviewed-by: Sage Weil <sage@redhat.com>

Revert "crushtool: do not allow to compile crushmap with repeat ruleset."

compressor: fix of error code control in zlib decompress

Signed-off-by: Alyona Kiseleva <akiselyova@mirantis.com>

Merge pull request #8725 from liewegas/wip-make-check

test/encoding/readable.sh: fix make check for autotool

Reviewed-by: Kefu Chai <kchai@redhat.com>

test/encoding/readable.sh: fix make check for autotools

Use ./ if ceph-dencoder is in the local directory.

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #8719 from SUSE/wip-fix-multidump

multi-dump.sh: fix usage function

Reviewed-by: Kefu Chai <kchai@redhat.com>

Doc: Updated ceph-deploy osd to choose underlying file system

Included paragraph about --fs-type and --bluestore

Signed-off-by: Ignacio Bravo ibravo@hotmail.com

Doc: Update quick-ceph-deploy.rst

Signed-off-by: Ignacio Bravo ibravo@hotmail.com

osd/osd_types: render notify OSDOp properly

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #8640 from xiexingguo/xxg-wip-osdsideeffect

osd/ReplicatedPG: allow CMPXATTR ops to trigger side effects too

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #8694 from wuxingyi/fixincomplete

osd/PG: PG is only likely to go active when min_size turns smaller.

Reviewed-by: Sage Weil <sage@redhat.com>

osd: honour result code passed in; tidy-up changesReviewed-by: Sage Weil <sage@redhat.com>

osd: honour result code passed in; tidy-up changes

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #8675 from roidayan/xio-build_deb_with_xio

xio: add MNop.h to dist tarball

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #8678 from jack-changtao/pgbackend

osd/PGBackend: if min > max, PGBackend::objects_list_partial will list all objects of that pg

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #8680 from ceph/rm-distribute

tools: remove installation for distribute. It is no longer maintained

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #8681 from xiexingguo/xxg-wip-crushfix

crush: fix mishandled result of get_bucket() method

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #8707 from liewegas/wip-kv-merge

kv: add merge operator support, fix test

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #8688 from xiexingguo/xxg-wip-crushtooltip

tools/crushtool: add straw2 support for help message

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #8671 from majianpeng/rados-objectsize-smaller-blocksize

tools/rados: fix "Floating point exception" if  objectsize smaller than  blocksize when do write-bench.

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #8502 from songbaisen/song20

crushtool: do not allow to compile crushmap with repeat ruleset.

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #8724 from aderumier/master

sysvinit: fix ceph init script

Reviewed-by: Sage Weil <sage@redhat.com>

fix ceph init script

commit 65963739cd6815b8008282c8f64cd64365662e60 have introduce a bug

test variables need to be quoted, or -n always return true, even if variables don't exist

doc: correct wrong spell 'mnay' to 'many'

Signed-off-by: wangsongbo <wangsongbo@unitedstack.com>

multi-dump.sh: fix usage function

The usage() function was not producing any output.

Signed-off-by: Nathan Cutler <ncutler@suse.com>

systemd: make Ceph daemon units "want" time-sync.target

Fixes: http://tracker.ceph.com/issues/15419
Signed-off-by: Nathan Cutler <ncutler@suse.com>

global-init: fixup inconsistent use of ceph ctx and conf

Signed-off-by: Karol Mroz <kmroz@suse.com>

global-init: chown pid files

Signed-off-by: Karol Mroz <kmroz@suse.com>

global-init: chown run dir

Also performs log file chown() operations if permission drop has been
deferred. Documents that admin socket chown() happen in the common init
path.

Signed-off-by: Karol Mroz <kmroz@suse.com>

common-init: chown admin socket after service thread started

Signed-off-by: Karol Mroz <kmroz@suse.com>

global-init: check init flags and set accordingly

If init flags have changed between the time ceph context was
instantiated and now, update them. This can happen, for example, if
between manual global_pre_init() and global_init() calls, a daemon adds
modifies it's init flags.

Signed-off-by: Karol Mroz <kmroz@suse.com>

global-init: add a path chown wrapper function

Signed-off-by: Karol Mroz <kmroz@suse.com>

ceph-context: add function to set init flags

Signed-off-by: Karol Mroz <kmroz@suse.com>

msg/async: delete the confused comments.

Signed-off-by: Yan Jun <yan.jun8@zte.com.cn>

msg/async: add numevents statistics for external_events

Maybe we need to add the statistics for external_events.

Signed-off-by: Yan Jun <yan.jun8@zte.com.cn>

cmake: use LINK_PRIVATE instead of PRIVATE for CMake version == 2.8.11

with version 2.8.11, i.e., the minimum version required by the building
system, we will hit a compile error as follows:
  /usr/bin/ld: cannot find -lPRIVATE
  collect2: error: ld returned 1 exit status
  make[2]: *** [lib/librbd.so.1.0.0] Error 1
  make[1]: *** [src/librbd/CMakeFiles/librbd.dir/all] Error 2

Signed-off-by: runsisi <runsisi@zte.com.cn>

Merge pull request #7942 from xiexingguo/xxg-wip-fixdirtyinc

mon: OSDMonitor: improve pool creation logic

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Xiaoxi Chen <xiaoxchen@ebay.com>

Merge pull request #7997 from songbaisen/song11

osdc: Reverse the probing vector in better way.

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #8384 from songbaisen/song18

crush: when take place the crush map should consider the rule is in …

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #8591 from xiexingguo/xxg-wip-15492

test: generate temp pool name in a safer way

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #8577 from runsisi/wip-fix-op-lock

osdc/Objecter: small cleanup for osd op completion lock

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #8596 from xiexingguo/xxg-wip-blue

os/filestore: add sanity check for stat() syscall

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #8710 from ceph/wip-rename-tests

Signed-off-by: Tamil Muthamizhan <tmuthami@redhat.com>

Signed-off-by: Tamil Muthamizhan <tmuthami@redhat.com>
  renamed the workunit and test to reflect reality and for better clarity

Merge pull request #8395 from renhwsky/renhw-wip-monmap

mon/monmap:  conditional optimization in build_from_host_list

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>

Merge pull request #8449 from javacruft/ceph-osd-prestart

ceph-osd-prestart.sh: drop --setuser/--setgroup

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #8458 from jjhuo/clean_blue_configs

common/config_opts: remove invalid config options of bluestore

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #8463 from majianpeng/bluestore-zero-truncate

os/bluestore/BlueStore: Don't forget assign nid when offset > size in _do_zero

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #8706 from liewegas/wip-jewel

doc/release-notes: is, not will be, basis for LTS

Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>

kv/RocksDBStore: implement merge operator

Signed-off-by: Allen Samuels <allen.samuels@sandisk.com>

kv/KeyValueDB: add merge operator interface and test

Signed-off-by: Allen Samuels <allen.samuels@sandisk.com>
Signed-off-by: Sage Weil <sage@redhat.com>

ceph_test_keyvaluedb: clean up test dir

Just like ceph_test_objectstore

Signed-off-by: Sage Weil <sage@redhat.com>

doc/release-notes: is, not will be, basis for LTS

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #8705 from liewegas/wip-jewel

doc/release-notes: revise terminology

Reviewed-by: Greg Farnum <gfarnum@redhat.com>

doc/release-notes: revise terminology

Avoid loaded 'production ready' term in favor of just 'stable'.

Signed-off-by: Sage Weil <sage@redhat.com>

rgw: fix memory leak in func 'RGWCreateBucket_ObjStore_S3::get_params' (#8670)

Signed-off-by: weiqiaomiao <wei.qiaomiao@zte.com.cn>
Reviewed-by: Casey Bodley <cbodley@redhat.com>

ceph_test_keyvaluedb: fixup unit test for keyvaluedb

Fixes: http://tracker.ceph.com/issues/15435
Signed-off-by: Allen Samuels <allen.samuels@sandisk.com>

Merge pull request #8527 from roidayan/wip-vstart_clean_prints

vstart: clean prints

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #8549 from tchaikov/wip-kill-filestore-warning

pybind, FileStore: silence gcc warnings

Reviewed-by: Haomai Wang <haomai@xsky.com>

Merge pull request #8551 from scienceluo/patch-1

doc: Fixes Different font of the title

Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
Reviewed-by: Yatin Kumbhare <yatinkumbhare@gmail.com>

bufferlist.cc fix typo in outputReviewed-by: Sage Weil <sage@redhat.com>

bufferlist.cc fix typo in output

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #8581 from emenguy/pgnum_pools_documentation

doc: adding pg_num to pools documentation

Reviewed-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>

Merge pull request #8595 from qhjindev/fix-LFNIndex

os: fix typo in LFNIndex.h

Merge pull request #8623 from rmechler/wip-15504

pybind: removed unneccesary parentheses from if statements

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #8631 from stiopaa1/buffer_fwd

image_watcher/Notifier: remove header file

Reviewed-by: Sage Weil <sage@redhat.com>