rpm: force creation of Python 3 __pycache__ on SUSE

Signed-off-by: Nathan Cutler <ncutler@suse.com>
Signed-off-by: Dominique Leuenberger <dimstar@opensuse.org>

Revert "ceph.spec.in: don't try to package __pycache__ for SUSE"

This reverts commit be39d6dc71af13eb3ee0d4482012a2091d121f66.

Signed-off-by: Nathan Cutler <ncutler@suse.com>

Merge pull request #10547 from wjwithagen/wip-wjw-test-util

test/common/test_util.cc: FreeBSD does not have distro information

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #9869 from yuyuyu101/wip-kqueue

msg/async/kqueue: avoid remove nonexist kqueue event

Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>

Merge pull request #10879 from dmick/wip-jerasure-aarch64

jerasure: include generic objects in neon jerasure lib (like sse3/4)

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #9943 from ceph/wip-ceph-disk-systemd

ceph-disk: do not activate device that is not ready

Reviewed-by: Loic Dachary <ldachary@redhat.com>

Merge pull request #10828 from michelmno/perf_local_flags

cmake: use PERF_LOCAL_FLAGS only if defined

Reviewed-by: Nathan Cutler <ncutler@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #9757 from SUSE/wip-16353

rpm: drop obsolete libs-compat and python-ceph-compat metapackages

Reviewed-by: Ken Dreyer <kdreyer@redhat.com>

Merge pull request #10730 from SUSE/wip-release-notes-draft

release-notes.rst: draft 0.94.8 release notes

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #10805 from SUSE/wip-dont-package-__pycache__

ceph.spec.in: don't try to package __pycache__ for SUSE

Reviewed-by: Nathan Cutler <ncutler@suse.com>
Reviewed-by: Dirk Mueller <dmueller@suse.com>
Reviewed-by: Ken Dreyer <kdreyer@redhat.com>

jerasure: include generic objects in neon jerasure lib (like sse3/4)

Signed-off-by: Dan Mick <dan.mick@redhat.com>

Merge pull request #10577 from wjwithagen/wip-wjw-test-rados-striper

Rados-stripper: Flexible string matching for not found attributes

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #10770 from dillaman/wip-16773

librbd: interlock image refresh and exclusive lock operations

Reviewed-by: Mykola Golub <mgolub@mirantis.com>

Merge pull request #10831 from cbodley/wip-17051

rgw: delete region map after upgrade to zonegroup map
Reviewed-by: Orit Wasserman <owasserm@redhat.com>

Merge pull request #10824 from dachary/wip-17100-ceph-disk

tests: populate /dev/disk/by-partuuid for scsi_debug

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #10836 from weiqiaomiao/wqm-wip-period-update

rgw: fix period update --commit return error

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #10829 from liewegas/wip-readme-make-dist

README.md: replace package build instructions with tarball instructions
Reviewed-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #10576 from wjwithagen/wip-wjw-noise-lockdep

lockdep: verbose even if no logging is set

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

rados-striper.sh: Use expect_failure and conditional stringmatching

 - Linux and FreeBSD do not have the same error strings

Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>

Merge pull request #10840 from david-z/wip-fix-manpage

doc: fix wrong osdkeepalive name in mount.ceph manpage

Reviewed-by: Kefu Chai <kchai@redhat.com>

doc: fix wrong osdkeepalive name in mount.ceph manpage

Signed-off-by: Zhi Zhang <zhangz.david@outlook.com>

ceph.spec.in: don't try to package __pycache__ for SUSE

When building on openSUSE Tumbleweed, nothing seems to create
the various __pycache__ directories (so the build fails because
those files don't exist), and in any case they should be
created automatically at runtime, so shouldn't need to be
packaged.  However, the Fedora packaging guidelines suggest
including __pycache__, so I've used a %suse_version guard here.

Fixes: http://tracker.ceph.com/issues/17106
Signed-off-by: Tim Serong <tserong@suse.com>

tests: populate /dev/disk/by-partuuid for scsi_debug

The scsi_debug SCSI devices do not have a symlink in /dev/disk/by-partuuid
because they are filtered out by 60-persistent-storage.rules. That was
worked around by 60-ceph-partuuid-workaround-rules which has been
removed by 9f76b9ff31525eac01f04450d72559ec99927496.

Add create rules targetting this specific case, only for tests since the
problem does not show in real use cases.

Fixes: http://tracker.ceph.com/issues/17100
Signed-off-by: Loic Dachary <loic@dachary.org>

cmake: use PERF_LOCAL_FLAGS only if defined

in src/test/CMakeLists.txt
to avoid build error for ppc64/ppc64le archi

Fixes: http://tracker.ceph.com/issues/17104
Signed-off-by: Michel Normand <normand@linux.vnet.ibm.com>

Merge pull request #10811 from jimifm/master

osd/ReplicatedPG: remove unused param "op" from generate_subop()

Reviewed-by: Kefu Chai <kchai@redhat.com>

rgw: fix period update --commit return error

period commit return error when the current period has a zonegroup which doesn't have a master zone

Fixes: http://tracker.ceph.com/issues/17110
Signed-off-by: weiqiaomiao <wei.qiaomiao@zte.com.cn>

Merge pull request #10830 from SUSE/wip-fix-singleton-example

doc: fix singleton example in Developer Guide

Reviewed-by: Loic Dachary <ldachary@redhat.com>

rgw: delete region map after upgrade to zonegroup map

convert_regionmap() reads the region map and uses it to initialize the
zonegroup map.  but it doesn't remove the region_map afterwards, so
radosgw (and some radosgw-admin commands) will keep doing this on
startup, overwriting any changes made to the period/zonegroup map

Fixes: http://tracker.ceph.com/issues/17051
Signed-off-by: Casey Bodley <cbodley@redhat.com>

doc: fix singleton example in Developer Guide

Signed-off-by: Nathan Cutler <ncutler@suse.com>

Merge pull request #10817 from stiopaa1/os_memstore_movePageSetObject

os/Memstore: move PageSetObject class to .cc file

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #10803 from stiopaa1/os_memstore_moveOmapIteratorImplClassToCC

os/MemStore: move OmapIteratorImpl to cc file

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #10799 from stiopaa1/os_fusestore_removeUnneededHeader

os/FuseStore: remove unneeded header file

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #10801 from stiopaa1/os_memstore_addOverride

os/Memstore.h: add override to virtual functions

Reviewed-by: Sage Weil <sage@redhat.com>

README.md: replace package build instructions with tarball instructions

Signed-off-by: Sage Weil <sage@redhat.com>

test/common/test_util.cc: FreeBSD does not have distro information

Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>

librbd: remove unused refresh request logic

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

librbd: interlock image refresh and lock operations

Fixes: http://tracker.ceph.com/issues/16773
Signed-off-by: Jason Dillaman <dillaman@redhat.com>

librbd: image state machine now has hooks for lock requests

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

librbd: integrate asynchronous image rewatch state machine

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

librbd: helper state machine for asynchronous watch recovery

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

librbd: exclusive lock now supports reacquiring a lost lock

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

librbd: store exclusive lock cookie instead of recalculating

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

librbd: helper state machine to update lock cookie

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

cls_lock: support updating the lock cookie without releasing the lock

Fixes: http://tracker.ceph.com/issues/17015
Signed-off-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #10743 from cbodley/wip-rgw-meta-sync-assert

rgw multisite: fix for assertion in RGWMetaSyncCR

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>

Merge pull request #10032 from cbodley/wip-rgw-cr-deadlock

rgw: add deadlock detection to RGWCoroutinesManager::run()

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>

Merge pull request #10821 from atheism/arm-read-improve

arch/arm.c: remove unnecessary variable read for simplicity

Reviewed-by: Kefu Chai <kchai@redhat.com>

rpm: do not unnecessarily spawn shells for scriptlets

Signed-off-by: Nathan Cutler <ncutler@suse.com>

ceph.spec.in: drop trouble-making divider comments

We have some %post scriptlets that fire up a shell just to execute a single
command like this:

%postun -n librados2
/sbin/ldconfig

Normally, it would be possible to optimize these as:

%postun -n librados2 -p /sbin/ldconfig

Except that, due to an RPM bug, there must not be *any* content (not even comments)
between the %postun and the next section.

See https://bugzilla.redhat.com/show_bug.cgi?id=1003962#c0 for details.

Signed-off-by: Nathan Cutler <ncutler@suse.com>

rpm: drop obsolete libs-compat metapackage

Fixes: http://tracker.ceph.com/issues/16353
Signed-off-by: Nathan Cutler <ncutler@suse.com>

Merge pull request #10819 from cbodley/wip-yasm-spam

yasm-wrapper: dont echo the yasm command line

Reviewed-by: Kefu Chai <kchai@redhat.com>

arch/arm.c: remove unnecessary variable read for simplicity

Signed-off-by: Weibing Zhang <zhangweibing@unitedstack.com>

yasm-wrapper: dont echo the yasm command line

commented out the echos because they're noisy. if anyone needs to debug
the wrapper in the future, they can uncomment

Signed-off-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #10572 from xiexingguo/xxg-wip-osd-2016-08-04

osd: miscellaneous fixes

Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #10610 from xiexingguo/xxg-wip-pg-2016-08-06

osd: misc fixes and cleanups

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Haomai Wang <haomai@xsky.com>

Merge pull request #10688 from athanatos/wip-16998

Wip 16998

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #10584 from tchaikov/wip-16933

mon/PGMonitor: calc the %USED of pool using used/(used+avail)

Reviewed-by: Samuel Just <sjust@redhat.com>

os/Memstore: move PageSetObject class to .cc file

Signed-off-by: Michal Jarzabek <stiopa@gmail.com>

Merge pull request #10608 from SUSE/wip-16949

rpm: add udev BuildRequires to provide /usr/lib/udev directory

Reviewed-by: Boris Ranto <branto@redhat.com>

Merge pull request #10783 from xiexingguo/xxg-wip-fix-comment-typo

common/config_opts: fix comment(radio -> ratio)

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #10795 from liewegas/wip-bluestore-statfs

os/bluestore: include bluefs space in statfs result

Reviewed-by: Varada Kari <varada.kari@sandisk.com>

Merge pull request #10800 from ceph/wip-postfile-rsa

ceph-post-file replace DSA with RSA ssh key

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #10809 from SUSE/wip-17091

ceph-osd-prestart.sh: check existence of OSD data directory

Reviewed-by: David Disseldorp <ddiss@suse.de>
Reviewed-by: Boris Ranto <branto@redhat.com>
Reviewed-by: Ken Dreyer <kdreyer@redhat.com>

ceph-post-file: Ignore keys offered by ssh-agent

In my case, I had multiple private keys in ssh-agent which resulted in
the sftp connection failing despite explicitly specifying the private
key to use

Signed-off-by: David Galloway <dgallowa@redhat.com>

ceph-post-file: migrate to RSA SSH keys

DSA keys are being deprecated: http://www.openssh.com/legacy.html

drop.ceph.com will continue to allow the old DSA key but eventually,
users submitting logs using ceph-post-file will run into issues when
OpenSSH completely drops support for the algorithm.

Fixes: http://tracker.ceph.com/issues/14267
Signed-off-by: David Galloway <dgallowa@redhat.com>

osd/ReplicatedPG:wipe off param op from generate_subop()

Signed-off-by: jimifm <hong.zhangoole@gmail.com>

ceph-osd-prestart.sh: check existence of OSD data directory

Fixes: http://tracker.ceph.com/issues/17091
Signed-off-by: Nathan Cutler <ncutler@suse.com>

Merge pull request #10806 from tchaikov/wip-17087

test/librados: rados_connect() should succeed

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

test/librados: rados_connect() should succeed

the "rados_osd_op_timeout" setting does not apply to the initial connection.
this regression was introduced by 6c67073

Fixes: http://tracker.ceph.com/issues/17087
Signed-off-by: Kefu Chai <kchai@redhat.com>

mon/OSDMonitor: add output field name of average/overload_utilization

In 4f5d588bed6c000ba7acfd5c94a4e706ddd14f0d I forget to add the
names of average_utilization and overload_utilization to the output
string.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>

msg: kill unused macros

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>

common/config_opts: fix comment(radio -> ratio)

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>

os/bluestore: include bluefs space in statfs result

We were counting all (free) space allocated to bluefs as used.  Instead,
query bluefs to find out what is used and what is free.

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #10771 from xiexingguo/xxg-wip-fix-bluerockenv

os/bluestore: misc fixes

Reviewed-by: Sage Weil <sage@redhat.com>

os/MemStore: move OmapIteratorImpl to cc file

Signed-off-by: Michal Jarzabek <stiopa@gmail.com>

Merge pull request #10435 from ceph/wip-debian-rbdmap-service

debian: replace SysV rbdmap with systemd service

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #10725 from tchaikov/wip-17023

osd: subscribe for old osdmaps when pause flag is set

Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #10739 from xiexingguo/xxg-wip-osdmon-2016-08-15

osd/OSDMonitor: misc. cleanups

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #10753 from tchaikov/wip-16982

osd: bail out if transaction size overflows

Reviewed-by: Samuel Just <sjust@redhat.com>

os/Memstore.h: add override to virtual functions

Signed-off-by: Michal Jarzabek <stiopa@gmail.com>

Merge pull request #10751 from ceph/wip-kefu-testing

rgw: do not try to encode or decode time_t and fix compiling warnings

Reviewed-by: Dan Mick <dmick@redhat.com>

os/FuseStore: remove unneeded header file

Signed-off-by: Michal Jarzabek <stiopa@gmail.com>

Merge pull request #10766 from liewegas/wip-bluestore-trivial

os/bluestore/BlueFS: disable buffered io

Merge pull request #10773 from xiexingguo/xxg-wip-bluestore-2016-08-18

os/bluestore: fix decoding hash of bnode

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #10780 from liewegas/wip-bluestore-finishers

os/bluestore: add multiple finishers to bluestore

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #10592 from michelmno/forpull

LTTng-UST disabled for openSUSE

Reviewed-by: Nathan Cutler <ncutler@suse.com>

Merge pull request #10788 from ceph/wip-cmake

debian and cmake cleanups

Reviewed-by: Oleh Prypin <oleh@pryp.in>

Merge pull request #10762 from dillaman/wip-16654

librbd: cache was not switching to writeback after first flush

Reviewed-by: Mykola Golub <mgolub@mirantis.com>

Merge pull request #10741 from minshenglin/remove_non_exists_options

doc: remove the description of deleted options

Reviewed-by: Nathan Cutler <ncutler@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

os/filestore/FileJournal: bail out if transaction is too large

if a transaction is too large to fit in the FileJournal's ring buffer,
we will wait. but if its size is larger than the max_size, it's likely
due to a bug or an invalid setting. in that case, we'd better fail
earlier.

Fixes: http://tracker.ceph.com/issues/16982
Signed-off-by: Kefu Chai <kchai@redhat.com>

osd: bail out if transaction size overflows

with a large MOSDMap message, the transaction size could be greater than
UINT_MAX. so fail early with error messages.

Fixes: http://tracker.ceph.com/issues/16982
Signed-off-by: Kefu Chai <kchai@redhat.com>

os/bluestore: fix assert

This assert is used to guarantee that we don't access violation
but currently has no effect.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>

os/bluestore: use hex if we are running out of space

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>

os/bluestore: use bluefs_max_prefetch for log file prefetch

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>

os/bluestore: fix race condition during get_fs_usage()

file_map should be accessed under the protection
of the global lock.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>

Merge pull request #10591 from xiexingguo/xxg-wip-osdmon-2016-08-05

mon: misc cleanups

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #10516 from wjwithagen/wip-wjw-freebsd-pidfile

src/global/pidfile.cc: Assign elements in structures individually

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #10451 from songbaisen/c0

tools: fix the core dump when get the crushmap do not exist

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #9694 from renhwztetecs/renhw-wip-librados-iotest

test: add the necessary judgment

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

debian: drop python-argparse dependency

and bump up the dependency of python version to 2.7.
py2.6 support was only necessary for older (now unsupported) distro
versions.

Signed-off-by: Kefu Chai <kchai@redhat.com>