cmake,make-dist: use sha256 instead of md5 for checksum

the boost's download page offers the SHA256 hash, so it'd be easier to
verify the hash this way.

Signed-off-by: Kefu Chai <kchai@redhat.com>

cmake: use CMP0028 NEW

it's intended behavior to use imported or alias target for dependencies
with name with "::" in it.

Signed-off-by: Kefu Chai <kchai@redhat.com>

common: silence GCC warnings

Preforker.h:111:8: warning: ignoring return value of ‘ssize_t
safe_write(int, const void*, size_t)’, declared with attribute
warn_unused_result [-Wunused-result]
        (void)safe_write(fd[1], &r, sizeof(r));
        ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

and

compat.cc:36:28: warning: comparison between signed and unsigned integer
expressions [-Wsign-compare]
     if (off + sizeof(data) > len)
         ~~~~~~~~~~~~~~~~~~~^~~~~

Fixes: http://tracker.ceph.com/issues/23774
Signed-off-by: Kefu Chai <kchai@redhat.com>

Merge pull request #21485 from tchaikov/wip-tox

test/dashboard: hardcode .coverage path to workaround tox bugs

Reviewed-by: Ricardo Dias <rdias@suse.com>

test/dashboard: hardcode .coverage path to workaround tox bugs

rhel/centos 7.3 comes with tox 1.4.2, which has a bunch of issues related
to environment variable substitution. for instance, see
- https://github.com/tox-dev/tox/issues/515
so, instead of having different coverage files for py3 and py2.7, it
would be simpler to just use the same path for coverage. this approach
works because pytest-cov plugin erases the coverage data file at the
beginning of test[1].

---
[1] https://pypi.org/project/pytest-cov/#coverage-data-file .

Signed-off-by: Kefu Chai <kchai@redhat.com>

Merge pull request #21474 from jecluis/mimic-mon-pending-releasenotes

PendingReleaseNotes: mention some monitor changes

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #21428 from ivancich/wip-fix-existing-mclock-cost

osd: remove cost from mclock op queues; cost not handled well in dmclock

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #21464 from LenzGr/fix-cmakelist

cmake: fix typo in status message

Reviewed-by: Volker Theile <vtheile@suse.com>
Reviewed-by: Ricardo Dias <rdias@suse.com>

Merge pull request #21418 from jecluis/wip-fix-mon-fs-caps

mon/AuthMonitor: don't validate `fs authorize` caps with `valid_caps()`

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #21450 from dzafman/wip-jq-compat

test: Use jq in a compatible way and for easier diff analysis

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #21483 from yuriw/wip-yuriw-crontab

qa/tests - one more typo fixed :(

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

qa/tests - one more typo fixed :(

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>

Merge pull request #21482 from yuriw/wip-yuriw-crontab

qa/tests - Fixed typo in crontab entry

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

qa/tests - Fixed typo in crontab entry

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>

Merge pull request #21454 from yuriw/wip-yuriw-crontab

qa/tests - added for the suites with subset be able to use 'testing' …

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #21478 from idryomov/wip-krbd-os-recommend

doc/start/os-recommendations.rst: bump krbd kernels

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

doc/start/os-recommendations.rst: bump krbd kernels

Drop 4.4 -- even though it is an "Extended LTS" release, it predates
the OSD client rewrite and should no longer be recommended.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>

Merge pull request #21409 from ErwanAliasr1/evelu-readonly

ceph-volume: Using --readonly for {vg|pv|lv}s commands

Reviewed-by: Andrew Schoen <aschoen@redhat.com>

PendingReleaseNotes: mention some monitor changes

Signed-off-by: Joao Eduardo Luis <joao@suse.de>

mon/AuthMonitor: don't validate fs caps on authorize

The monitor will have no idea how to validate fs caps during `fs
authorize`. Instead, validate solely the built osd and mds caps.

Signed-off-by: Joao Eduardo Luis <joao@suse.de>

Merge pull request #21468 from tchaikov/wip=cmake-make-check-dashboard

cmake: let "tests" depend on "mgr-dashboard-frontend-build"

Reviewed-by: John Spray <john.spray@redhat.com>

Merge pull request #21470 from tylerqi/master

doc: Fix a grammar error in rbd-snapshot.rst

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>

doc: Fix a grammar error in rbd-snapshot.rst

Signed-off-by: Zeqing Tyler Qi <aqize@126.com>

Merge pull request #20945 from liewegas/wip-pg-ls

mon/PGMap: remove or narrow columns 'pg ls' output

Reviewed-by: John Spray <jspray@redhat.com>

Merge pull request #21113 from kungf/scrub_interval_overflow

utime： fix __32u sec time overflow

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #21145 from ceph/wip-ifed-store-test-improve

test/ceph_test_objectstore: make settings update and restore less error prone

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #21371 from jcsp/wip-mon-optracker-cleanup

mon: cleanups to optracker code

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Joao Eduardo Luis <joao@suse.de>

Merge pull request #21377 from ifed01/wip-ifed-learn-alloc-fragm

os/bluestore: add perf counter for allocator fragmentation.

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #21141 from shun-s/fix-rbd-close-race-with-rewatch

librbd: fix rbd close race with rewatch

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #21343 from Songweibin/wip-trash-ls

rbd: 'trash ls -l' will display column titles if existed non-USER trash image only

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

cmake: let "tests" depend on "mgr-dashboard-frontend-build"

Signed-off-by: Kefu Chai <kchai@redhat.com>

cmake: fix typo in status message

Replaced " we are x84_64" with  " we are x86_64" in `src/CMakeLists.txt`

Signed-off-by: Lenz Grimmer <lgrimmer@suse.com>

qa/tests - added for the suites with subset be able to use 'testing' distro

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>

Merge pull request #21449 from rjfd/wip-dashboard-fix-frontend-build

cmake: fix frontend cmake build

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #21360 from rjfd/wip-dashboard-rbd

mgr/dashboard: RBD management (backend)

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #21445 from rjfd/wip-dashboard-fix-run-tox

mgr/dashboard: run-tox: pass CEPH_BUILD_DIR value into tox script

Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

osd: remove cost from mclock op queues; cost not handled well in dmclock library

The current version of the dmclock library does not handle operation
cost well. Therefore cost should not be passed into the library when
enqueuing operations; instead 0 should be passed in.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>

test: Use jq in a compatible way and for easier diff analysis

Signed-off-by: David Zafman <dzafman@redhat.com>

mgr/dashboard: fix frontend cmake build

Signed-off-by: Ricardo Dias <rdias@suse.com>

Merge pull request #20929 from JianyuLi/joa-bluestore-spdk

os/bluestore: free the spdk qpair resource correctly in destructor of SharedDriverQueueData

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #21419 from ceph/wip-da-SCA-20180329

common,osd,rgw: Fixes for issues found during SCA

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #21429 from wjwithagen/wjw-kStore-statfs

KStore: statfs needs extra includes on FreeBSD

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #21431 from Songweibin/wip-ec-cleanups

osd: miscellaneous cleanups

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Sage Weil <sage@redhat.com>

mgr/dashboard: run-tox: pass CEPH_BUILD_DIR value into tox script

Signed-off-by: Ricardo Dias <rdias@suse.com>

Merge pull request #21170 from dragonylffly/wip-revise-organizationmap

.organizationmap: add Xin Yuan and Yichao Li's affiliation

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #21433 from tchaikov/wip-qa-env_librados_test

qa: disable -Werror when compiling env_librados_test

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #21402 from tspmelo/wip-module-cleanup

mgr/dashboard: Angular modules cleanup

Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Volker Theile vtheile@suse.com

Merge pull request #21398 from ivancich/wip-revert-dmclock-feature-bit-plus

osd: Revert use of dmclock message feature bit since not yet finalized

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #21403 from dillaman/wip-rbd-mirror-dead-instances

test/rbd-mirror: improve coverage for dead instance handling

Reviewed-by: Mykola Golub <mgolub@suse.com>

Merge PR #21322 into master

* refs/pull/21322/head:
osdc: cleanup code.
osdc: Remove useless condition.

Reviewed-by: Gregory Farnum <gfarnum@redhat.com>

Merge PR #21341 into master

* refs/pull/21341/head:
client: Fix the gid_count check

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge PR #21370 into master

* refs/pull/21370/head:
client: Take reference for operator= function parameter

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Zheng Yan <zyan@redhat.com>

Merge PR #21391 into master

* refs/pull/21391/head:
qa: fix log typo

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge PR #21396 into master

* refs/pull/21396/head:
ceph-fuse: exit with failure on failed mount
common: ignore errors during preforker exit
client: do not overload system errnos

Reviewed-by: Zheng Yan <zyan@redhat.com>

Merge pull request #20398 from wjwithagen/wip-posix_fallocate

common: posix_fallocate on ZFS returns EINVAL

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #20752 from jcsp/wip-dashboard-build-tweak

mgr/dashboard: build tweaks

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Patrick Nawracay <pnawracay@suse.com>
Reviewed-by: Ricardo Dias <rdias@suse.com>

Merge pull request #21108 from xiexingguo/wip-kill-subset-of

interval_set: kill subset_of()

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #21369 from majianpeng/test-objectstore_bench-usage

test/objectstore_bench: Don't forget judging whether call usage.

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #20100 from mogeb/iostat-plugin

mgr/iostat: implement 'ceph iostat' as a mgr plugin

Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #21373 from ovh/bp-hb-divbyzero

osd: fix crash caused by divide by zero in heartbeat code

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #21395 from liewegas/wip-log-channels

mon/LogMonitor: separate out summary by channel

Reviewed-by: John Spray <john.spray@redhat.com>

Merge pull request #19935 from myoungwon/wip-manifest-ref-count

osd: refcount for manifest object (redirect, chunked)

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #19117 from jan--f/jan-object-counts-decimal

include/types: format decimal numbers with decimal factor

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #21427 from liewegas/wip-balancer-roots

mgr/balancer: improve error message

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>

Merge pull request #21401 from liewegas/wip-mgr-help

ceph-mgr: exit after usage

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>

Merge pull request #21430 from tchaikov/wip-osdmap-prune

mon/OSDMonitor: txsize should be greater or eq to prune_interval - 1

Reviewed-by: Joao Eduardo Luis <joao@suse.de>

qa: disable -Werror when compiling env_librados_test

to silence warnings like

utilities/env_librados.cc:175:33: warning: unused parameter ‘offset’ [-Wunused-parameter]
   Status InvalidateCache(size_t offset, size_t length) {
                                 ^~~~~~

Signed-off-by: Kefu Chai <kchai@redhat.com>

mon/OSDMonitor: txsize should be greater or eq to prune_interval - 1

so we can prune 1 or more intervals in a single iteration. and in each
interval, we prune (prune_interval - 1) versions of osdmap.

Signed-off-by: Kefu Chai <kchai@redhat.com>

osd/OSD: drop unused header

Signed-off-by: songweibin <song.weibin@zte.com.cn>

osd/ECBackend: kill redundant assert

Signed-off-by: songweibin <song.weibin@zte.com.cn>

osd/ECBackend: s/union_of/union_insert/

Signed-off-by: songweibin <song.weibin@zte.com.cn>

osd/ECTransaction: drop duplicated **#include <vector>**

Signed-off-by: songweibin <song.weibin@zte.com.cn>

osd/ECTransaction: kill redudant asserts

Signed-off-by: songweibin <song.weibin@zte.com.cn>

osd/ECBackend: kill extra member **want**

Signed-off-by: songweibin <song.weibin@zte.com.cn>

Merge pull request #21404 from tchaikov/wip-cmake-boost

cmake: changes of BuildBoost.cmake to ready seastar

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #21410 from badone/wip-test_large_omap_detection-scrub-pgs-instead-of-osds

qa/workunits/rados/test_large_omap_detection: Scrub pgs instead of OSDs

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

KStore: statfs needs extra includes on FreeBSD

Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>

mgr/balancer: identify roots that osds overlap in

This error message isn't very informative; tell the user which osds
appear in mulitple roots, and which roots those are!

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #20853 from theanalyst/rgw/recalc-stats

rgw: add an option to recalculate user stats

Reviewed-by: Orit Wasserman <owasserm@redhat.com>

test_rgw_admin_log.cc: lenght() returns unsigned

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>

src/rgw: fix some format qualifiers

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>

mon/OSDMonitor.cc: fix format qualifiers

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>

common/TrackedOp.cc: fix format qualifiers for uint

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>

common/str_map.cc: do boundry checks before access

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>

CephBroker.cc: fix format qualifier for unsigned int

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>

krbd.cc: fix parameter to variadic function

Fix for:

[src/krbd.cc:549]: (portability) Passing NULL after the last typed
 argument to a variadic function leads to undefined behaviour.

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>

lz4/LZ4Compressor.h: remove always true check

Fix for:

[src/compressor/lz4/LZ4Compressor.h:105]: (style) Condition
 'r!=(int)compressed_pairs[i].first' is always true

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>

osd/OSD.h: fix format qualifier to use PRIu32

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>

test/fio/fio_ceph_objectstore.cc: fix uninitialized variables

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>

rgw/rgw_website.h: fix uninitialized variable

Co-authored-by: Casey Bodley <cbodley@redhat.com>
Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>

msg/async/EventKqueue.cc: fix memory leak due to realloc error

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>

Merge pull request #21421 from liewegas/wip-doc-balancer

doc/mgr/balancer: document

Reviewed-by: Dan van der Ster <daniel.vanderster@cern.ch>

Merge pull request #21425 from cbodley/wip-rgw-fix-set_threaded

rgw: fix sync status conflict with cloud sync

rgw: fix conflict with cloud sync

Signed-off-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #20027 from Leeshine/wip-rgw-sync-bucket-shards

rgw: improve sync status: display behind bucket shards

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #21123 from theanalyst/wip-civetweb-1.1

rgw: civetweb fixes for v1.1 upgrade

doc/mgr/balancer: document

Not sure how we missed this for luminous!

Signed-off-by: Sage Weil <sage@redhat.com>

cls/refcount: add chunk_refcount_client()

Signed-off-by: Myoungwon Oh <omwmw@sk.com>

src/test: add a unit test for manifest refcount

Signed-off-by: Myoungwon Oh <omwmw@sk.com>

osd: decrease refcount when object is deleted (has manifest) if the object is referenced

Signed-off-by: Myoungwon Oh <omwmw@sk.com>