]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
6 years agoosd/: move pg/osd state machinery into osd_types for use in crimson
Samuel Just [Thu, 30 May 2019 00:31:46 +0000 (17:31 -0700)]
osd/: move pg/osd state machinery into osd_types for use in crimson

Signed-off-by: Samuel Just <sjust@redhat.com>
6 years agoPGLog: add cyan_store machinery for reading the log
Samuel Just [Thu, 30 May 2019 00:31:44 +0000 (17:31 -0700)]
PGLog: add cyan_store machinery for reading the log

Signed-off-by: Samuel Just <sjust@redhat.com>
6 years agoPeeringState: permit init_from_disk_state to return a value
Samuel Just [Thu, 30 May 2019 00:31:42 +0000 (17:31 -0700)]
PeeringState: permit init_from_disk_state to return a value

This way it can return a future.

Signed-off-by: Samuel Just <sjust@redhat.com>
6 years agoPGPeeringEvent: move MLogRec constructor definition to .cc and add unique_ptr
Samuel Just [Thu, 30 May 2019 00:31:40 +0000 (17:31 -0700)]
PGPeeringEvent: move MLogRec constructor definition to .cc and add unique_ptr

Signed-off-by: Samuel Just <sjust@redhat.com>
6 years agosrc/osd/: add appropriate OSDMapRef defs for seastar to OSDMap,osd_types
Samuel Just [Thu, 30 May 2019 00:31:38 +0000 (17:31 -0700)]
src/osd/: add appropriate OSDMapRef defs for seastar to OSDMap,osd_types

Signed-off-by: Samuel Just <sjust@redhat.com>
6 years agoPeeringState: modernize accept_buffered_messages
Samuel Just [Thu, 30 May 2019 02:02:51 +0000 (19:02 -0700)]
PeeringState: modernize accept_buffered_messages

Signed-off-by: Samuel Just <sjust@redhat.com>
6 years agoosd/: Move PeeringCtx out of PeeringState to permit forward declaration
Samuel Just [Thu, 30 May 2019 00:31:35 +0000 (17:31 -0700)]
osd/: Move PeeringCtx out of PeeringState to permit forward declaration

Signed-off-by: Samuel Just <sjust@redhat.com>
6 years agocrimson/os: Move CollectionRef out of CyanStore
Samuel Just [Thu, 30 May 2019 00:31:31 +0000 (17:31 -0700)]
crimson/os: Move CollectionRef out of CyanStore

This way, we don't need cyan_store.h to get CollectionRef

Signed-off-by: Samuel Just <sjust@redhat.com>
6 years agoMerge PR #27957 into master
Sage Weil [Thu, 30 May 2019 17:26:17 +0000 (12:26 -0500)]
Merge PR #27957 into master

* refs/pull/27957/head:
json: JSONDecoder::err inherits from std::runtime_error
rgw: RGWXMLDecoder::err inherits from std::runtime_error

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
6 years agoMerge pull request #28317 from tchaikov/wip-crimson-net-remove-redundant-move
Kefu Chai [Thu, 30 May 2019 17:16:26 +0000 (01:16 +0800)]
Merge pull request #28317 from tchaikov/wip-crimson-net-remove-redundant-move

crimson/net: remove redundant std::move()

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
6 years agoMerge pull request #28289 from tchaikov/wip-kill-gcc-9-warnings
Kefu Chai [Thu, 30 May 2019 15:56:41 +0000 (23:56 +0800)]
Merge pull request #28289 from tchaikov/wip-kill-gcc-9-warnings

common,os: address string truncated warnings from GCC-9

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
6 years agoMerge pull request #28055 from SUSE/wip-fix-39662
Kefu Chai [Thu, 30 May 2019 15:56:02 +0000 (23:56 +0800)]
Merge pull request #28055 from SUSE/wip-fix-39662

mgr/PyModuleRegistry: log error if we can't find any modules to load

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
6 years agocrimson/net: remove redundant std::move() 28317/head
Kefu Chai [Thu, 30 May 2019 05:52:40 +0000 (13:52 +0800)]
crimson/net: remove redundant std::move()

see https://en.cppreference.com/w/cpp/language/copy_elision

it also silences warning like:

src/crimson/net/ProtocolV2.cc:146:26: warning: redundant move in return
statement [-Wredundant-move]
  146 |       return std::move(bl);
      |                          ^

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge pull request #27806 from ashitakasam/add-osd-alarm
Kefu Chai [Thu, 30 May 2019 13:28:54 +0000 (21:28 +0800)]
Merge pull request #27806 from ashitakasam/add-osd-alarm

osd: Better error message when OSD count is less than osd_pool_default_size

Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agoMerge pull request #28278 from tchaikov/wip-buffer-remove-advance-size_t
Kefu Chai [Thu, 30 May 2019 13:26:27 +0000 (21:26 +0800)]
Merge pull request #28278 from tchaikov/wip-buffer-remove-advance-size_t

buffer.h: remove list::iterator_impl::advance(size_t)

Reviewed-by: James Page <james.page@ubuntu.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
6 years agoMerge pull request #28251 from xiexingguo/wip-balancer-new-osd-weight
Kefu Chai [Thu, 30 May 2019 13:23:44 +0000 (21:23 +0800)]
Merge pull request #28251 from xiexingguo/wip-balancer-new-osd-weight

mgr/balancer: fix initial weight-set value for newly created osds

Reviewed-by: Sage Weil <sage@redhat.com>
6 years agoMerge pull request #28107 from ifed01/wip-ifed-add-devices
Kefu Chai [Thu, 30 May 2019 13:20:15 +0000 (21:20 +0800)]
Merge pull request #28107 from ifed01/wip-ifed-add-devices

os/bluestore: show device name in "osd metadata output"

Reviewed-by: Sage Weil <sage@redhat.com>
6 years agoMerge pull request #28277 from javacruft/32bit-compat-fixes
Kefu Chai [Thu, 30 May 2019 13:18:43 +0000 (21:18 +0800)]
Merge pull request #28277 from javacruft/32bit-compat-fixes

common: avoid use of size_t in options

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge pull request #28250 from tchaikov/wip-silence-warnings
Jason Dillaman [Thu, 30 May 2019 11:42:05 +0000 (07:42 -0400)]
Merge pull request #28250 from tchaikov/wip-silence-warnings

mon,test: silence warnings from GCC and test

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
6 years agoMerge pull request #25729 from the78mole/wip-32-bit-arm-fixes
Kefu Chai [Thu, 30 May 2019 04:50:45 +0000 (12:50 +0800)]
Merge pull request #25729 from the78mole/wip-32-bit-arm-fixes

cmake: boost fixes for ARM 32 bit

Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge pull request #28255 from tchaikov/wip-convenience
Kefu Chai [Thu, 30 May 2019 03:24:00 +0000 (11:24 +0800)]
Merge pull request #28255 from tchaikov/wip-convenience

common: no need to include ceph_assert.h

Reviewed-by: Sage Weil <sage@redhat.com>
6 years agoMerge pull request #28270 from NTmatter/patch-2
Kefu Chai [Thu, 30 May 2019 03:22:18 +0000 (11:22 +0800)]
Merge pull request #28270 from NTmatter/patch-2

blobhash.h: remove extra [[fallthrough]]

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge PR #27799 into master
Sage Weil [Wed, 29 May 2019 20:27:52 +0000 (15:27 -0500)]
Merge PR #27799 into master

* refs/pull/27799/head:
common/utime: don't pass %z to utime if there is a 'Z'
test: test json encode/decode of utime_t
mgr/ssh: parse new datetime
mgr/devicehealth: parse new datetime
mgr/crash: parse both old and new timestamp formats
mgr/telemetry: use cluster-provided timestamp unmolested
mon/MonMap: dump timestamps in UTC
qa/tasks/ceph: tolerate 'T' or ' ' as date and time separator
PendingReleaseNotes: note about change to ISO 8601 throughout
test/cli: update regexs for timestamps
log/LogClock: render timestamp in ISO 8601 format
common/ceph_time: stringify in ISO 8601 format
unittest_utime: add tests
common/utime: make parse() handle (our) ISO 8601 output
include/utime: make default string rendering ISO 8601 conformant
include/utime: remove unused s[n]printf methods
include/utime: make gmtime() output conformant ISO 8601

Reviewed-by: Kanika Murarka <kmurarka@redhat.com>
Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
6 years agocommon/utime: don't pass %z to utime if there is a 'Z' 27799/head
Sage Weil [Fri, 24 May 2019 22:09:53 +0000 (17:09 -0500)]
common/utime: don't pass %z to utime if there is a 'Z'

This fails on centos 7 for some reason.

If it's UTC, we don't need to parse the tz portion, so avoid the issue by
leaving the %z out of the fmt string.

Signed-off-by: Sage Weil <sage@redhat.com>
6 years agotest: test json encode/decode of utime_t
Casey Bodley [Mon, 6 May 2019 16:58:43 +0000 (12:58 -0400)]
test: test json encode/decode of utime_t

Signed-off-by: Casey Bodley <cbodley@redhat.com>
6 years agomgr/ssh: parse new datetime
Sage Weil [Tue, 30 Apr 2019 14:15:39 +0000 (09:15 -0500)]
mgr/ssh: parse new datetime

Signed-off-by: Sage Weil <sage@redhat.com>
6 years agomgr/devicehealth: parse new datetime
Sage Weil [Tue, 30 Apr 2019 14:14:34 +0000 (09:14 -0500)]
mgr/devicehealth: parse new datetime

Signed-off-by: Sage Weil <sage@redhat.com>
6 years agomgr/crash: parse both old and new timestamp formats
Sage Weil [Tue, 30 Apr 2019 14:06:21 +0000 (09:06 -0500)]
mgr/crash: parse both old and new timestamp formats

Signed-off-by: Sage Weil <sage@redhat.com>
6 years agomgr/telemetry: use cluster-provided timestamp unmolested
Sage Weil [Mon, 29 Apr 2019 19:32:44 +0000 (14:32 -0500)]
mgr/telemetry: use cluster-provided timestamp unmolested

The cluster stamp is now ISO 8601; just use that.

(The isoformat() puts a : in +hh:mm the timezone offset, which is slightly
different than what Ceph does; just pass Ceph's value through for
consistency.)

Signed-off-by: Sage Weil <sage@redhat.com>
6 years agomon/MonMap: dump timestamps in UTC
Sage Weil [Mon, 29 Apr 2019 19:26:00 +0000 (14:26 -0500)]
mon/MonMap: dump timestamps in UTC

Signed-off-by: Sage Weil <sage@redhat.com>
6 years agoqa/tasks/ceph: tolerate 'T' or ' ' as date and time separator
Sage Weil [Mon, 29 Apr 2019 14:07:58 +0000 (09:07 -0500)]
qa/tasks/ceph: tolerate 'T' or ' ' as date and time separator

Signed-off-by: Sage Weil <sage@redhat.com>
6 years agoPendingReleaseNotes: note about change to ISO 8601 throughout
Sage Weil [Fri, 26 Apr 2019 18:55:16 +0000 (13:55 -0500)]
PendingReleaseNotes: note about change to ISO 8601 throughout

Signed-off-by: Sage Weil <sage@redhat.com>
6 years agotest/cli: update regexs for timestamps
Sage Weil [Fri, 26 Apr 2019 18:49:00 +0000 (13:49 -0500)]
test/cli: update regexs for timestamps

Signed-off-by: Sage Weil <sage@redhat.com>
6 years agolog/LogClock: render timestamp in ISO 8601 format
Sage Weil [Thu, 25 Apr 2019 22:36:26 +0000 (17:36 -0500)]
log/LogClock: render timestamp in ISO 8601 format

Signed-off-by: Sage Weil <sage@redhat.com>
6 years agocommon/ceph_time: stringify in ISO 8601 format
Sage Weil [Thu, 25 Apr 2019 22:17:45 +0000 (17:17 -0500)]
common/ceph_time: stringify in ISO 8601 format

Signed-off-by: Sage Weil <sage@redhat.com>
6 years agounittest_utime: add tests
Sage Weil [Thu, 25 Apr 2019 22:22:58 +0000 (17:22 -0500)]
unittest_utime: add tests

Signed-off-by: Sage Weil <sage@redhat.com>
6 years agocommon/utime: make parse() handle (our) ISO 8601 output
Sage Weil [Thu, 25 Apr 2019 22:15:09 +0000 (17:15 -0500)]
common/utime: make parse() handle (our) ISO 8601 output

- optional subsecond values
- optional timezone offset

Signed-off-by: Sage Weil <sage@redhat.com>
6 years agoinclude/utime: make default string rendering ISO 8601 conformant
Sage Weil [Thu, 25 Apr 2019 22:12:50 +0000 (17:12 -0500)]
include/utime: make default string rendering ISO 8601 conformant

- use T separator
- include TZ offset

Signed-off-by: Sage Weil <sage@redhat.com>
6 years agoinclude/utime: remove unused s[n]printf methods
Sage Weil [Thu, 25 Apr 2019 21:27:07 +0000 (16:27 -0500)]
include/utime: remove unused s[n]printf methods

Signed-off-by: Sage Weil <sage@redhat.com>
6 years agoinclude/utime: make gmtime() output conformant ISO 8601
Sage Weil [Thu, 25 Apr 2019 17:41:19 +0000 (12:41 -0500)]
include/utime: make gmtime() output conformant ISO 8601

Use 'T' separated instead of ' '.

Signed-off-by: Sage Weil <sage@redhat.com>
6 years agoMerge pull request #28271 from yuriw/wip-yuriw-crontab-master
Yuri Weinstein [Wed, 29 May 2019 16:33:19 +0000 (09:33 -0700)]
Merge pull request #28271 from yuriw/wip-yuriw-crontab-master

qa/tests: removed filters for client-upgrade-* suites

6 years agoMerge pull request #28170 from marxin/disable-lto-in-spec-file
Nathan Cutler [Wed, 29 May 2019 16:21:34 +0000 (18:21 +0200)]
Merge pull request #28170 from marxin/disable-lto-in-spec-file

rpm: Disable LTO in spec when being used.

Reviewed-by: Boris Ranto <branto@redhat.com>
Reviewed-by: Tim Serong <tserong@suse.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
6 years agobuffer.h: remove list::iterator_impl::advance(size_t) 28278/head
Kefu Chai [Wed, 29 May 2019 08:50:58 +0000 (16:50 +0800)]
buffer.h: remove list::iterator_impl::advance(size_t)

quote from Radoslaw's comment

> In general we could remove it as the `buffer` library tends to
> disrespects `size_t` – `list::_len` and `ptr::_len` are both
`unsigned`.
> There are some exceptions like `size_t buffer::ptr::get_offset()`
(used
> altogether with `::advance` in `denc.h`) but they deserve rework as
> well.

and in this very case, we simply cast `size_t` to `unsigned`. so we
could silently trim a 64bits integer to 32bit on 64bits architecture.

so for better portability, we can just remove it. also, this function is
inlined, so the ABI is not changed.

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agomgr/dashboard: Fix NFS clients squash/access_type default values (#28235)
Lenz Grimmer [Wed, 29 May 2019 15:40:31 +0000 (17:40 +0200)]
mgr/dashboard: Fix NFS clients squash/access_type default values (#28235)

mgr/dashboard: Fix NFS clients squash/access_type default values

Reviewed-by: Ricardo Marques <rimarques@suse.com>
6 years agoblobhash.h: Remove extra fallthrough annotation 28270/head
Thomas Johnson [Tue, 28 May 2019 19:34:56 +0000 (21:34 +0200)]
blobhash.h: Remove extra fallthrough annotation

Remove the [[fallthrough]] annotation at the end of the switch statement
for Clang compatibility.

Fixes: https://tracker.ceph.com/issues/40052
Signed-off-by: Thomas Johnson <NTmatter@gmail.com>
6 years agoMerge pull request #28211 from tspmelo/wip-service-root
Lenz Grimmer [Wed, 29 May 2019 15:32:42 +0000 (17:32 +0200)]
Merge pull request #28211 from tspmelo/wip-service-root

mgr/dashboard: Change the provider of services to root

6 years agoMerge pull request #28118 from tspmelo/wip-on-push
Lenz Grimmer [Wed, 29 May 2019 15:29:43 +0000 (17:29 +0200)]
Merge pull request #28118 from tspmelo/wip-on-push

mgr/dashboard: Reduce the number of renders on the tables

6 years agomgr/dashboard: Add multi root support in CRUSH map (#28047)
Lenz Grimmer [Wed, 29 May 2019 15:28:04 +0000 (17:28 +0200)]
mgr/dashboard: Add multi root support in CRUSH map (#28047)

mgr/dashboard: Add multi root support in CRUSH map

Reviewed-by: Kiefer Chang <kiefer.chang@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
6 years agoMerge pull request #28179 from trociny/wip-39980
Jason Dillaman [Wed, 29 May 2019 14:58:52 +0000 (10:58 -0400)]
Merge pull request #28179 from trociny/wip-39980

rbd-mirror: don't overwrite status error returned by replay

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
6 years agoMerge pull request #28240 from trociny/wip-journal-overflow
Jason Dillaman [Wed, 29 May 2019 14:58:12 +0000 (10:58 -0400)]
Merge pull request #28240 from trociny/wip-journal-overflow

journal: optimize object overflow detection

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
6 years agoMerge pull request #28275 from tchaikov/wip-cmake-asan
Casey Bodley [Wed, 29 May 2019 14:44:13 +0000 (10:44 -0400)]
Merge pull request #28275 from tchaikov/wip-cmake-asan

ceph.in: do not preload libasan if it is found

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
6 years agoMerge pull request #28269 from NTmatter/patch-1
Kefu Chai [Wed, 29 May 2019 14:23:10 +0000 (22:23 +0800)]
Merge pull request #28269 from NTmatter/patch-1

install-deps.sh: fix typo for krb5 on FreeBSD

Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge pull request #27978 from votdev/add_snmp_oids_to_prometheus_alerts
Lenz Grimmer [Wed, 29 May 2019 13:58:23 +0000 (15:58 +0200)]
Merge pull request #27978 from votdev/add_snmp_oids_to_prometheus_alerts

monitoring: SNMP OID per every Prometheus alert rule

Reviewed-by: Boris Ranto <branto@redhat.com>
Reviewed-by: Jan Fajerski <jfajerski@suse.com>
6 years agoMerge pull request #28225 from sebastian-philipp/script-run-mypy-sort-groups
Sebastian Wagner [Wed, 29 May 2019 13:21:17 +0000 (15:21 +0200)]
Merge pull request #28225 from sebastian-philipp/script-run-mypy-sort-groups

script/run_mypy: Sort groups

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Patrick Nawracay <pnawracay@suse.com>
6 years agorpm: Disable LTO in spec when being used 28170/head
Martin Liska [Mon, 20 May 2019 09:37:52 +0000 (11:37 +0200)]
rpm: Disable LTO in spec when being used

Fixes: http://tracker.ceph.com/issues/39974
Works around: https://tracker.ceph.com/issues/40060

Signed-off-by: Martin Liška <Martin.Liska@suse.com>
6 years agoMerge pull request #28002 from smithfarm/wip-39323-ext
Nathan Cutler [Wed, 29 May 2019 11:39:32 +0000 (13:39 +0200)]
Merge pull request #28002 from smithfarm/wip-39323-ext

pybind/tox: handle possible WITH_PYTHON3 values other than "3"

Reviewed-by: Stephan Müller <smueller@suse.com>
6 years agocmake: boost fixes for ARM 32 bit 25729/head
Daniel Glaser [Sat, 29 Dec 2018 18:59:59 +0000 (18:59 +0000)]
cmake: boost fixes for ARM 32 bit

see https://github.com/boostorg/context/pull/94

we should drop this change once ceph uses boost 1.70 or up

Signed-off-by: Daniel Glaser <me@the78mole.de>
6 years agomgr/dashboard: Change the provider of services to root 28211/head
Tiago Melo [Wed, 22 May 2019 08:58:36 +0000 (08:58 +0000)]
mgr/dashboard: Change the provider of services to root

It looks like that even if we provide a service only in 1 module, there are
still situations where angular will create multiple instances of that service.

By setting root as its providers, this no longer happens.

Fixes: http://tracker.ceph.com/issues/39996
Signed-off-by: Tiago Melo <tmelo@suse.com>
6 years agoos/filestore: always always add `\0' after strncpy() 28289/head
Kefu Chai [Wed, 29 May 2019 09:48:21 +0000 (17:48 +0800)]
os/filestore: always always add `\0' after strncpy()

see also f35fa1c58cf24275458cb83097c57bdfd1184cf8

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agocommon/blkdev.c: check retval of snprintf()
Kefu Chai [Wed, 29 May 2019 09:45:35 +0000 (17:45 +0800)]
common/blkdev.c: check retval of snprintf()

as snprintf()'ed string could be truncated, to properly use this
function, we need to check its return value.

to silence warning like

../src/common/blkdev.cc: In member function ‘int64_t
BlkDev::get_string_property(blkdev_prop_t, char*, size_t) const’:
../src/common/blkdev.cc:165:15: warning: ‘%s’ directive output may be
truncated writing up to 4095 bytes into a region of size between 4085
and 4089 [-Wformat-truncation=]
  165 |     "%s/block/%s/%s", sysfsdir(), dev, propstr);
      |               ^~
In file included from /usr/include/stdio.h:873,
                 from /usr/include/c++/9/cstdio:42,
                 from /usr/include/c++/9/ext/string_conversions.h:43,
                 from /usr/include/c++/9/bits/basic_string.h:6493,
                 from /usr/include/c++/9/string:55,
                 from /usr/include/c++/9/bits/locale_classes.h:40,
                 from /usr/include/c++/9/bits/ios_base.h:41,
                 from /usr/include/c++/9/ios:42,
                 from /usr/include/c++/9/ostream:38,
                 from /usr/include/c++/9/iterator:64,
                 from
/opt/ceph/include/boost/iterator/iterator_traits.hpp:10,
                 from
/opt/ceph/include/boost/range/iterator_range_core.hpp:26,
                 from
/opt/ceph/include/boost/algorithm/string/replace.hpp:16,
                 from ../src/common/blkdev.cc:31:
/usr/include/x86_64-linux-gnu/bits/stdio2.h:67:35: note:
‘__builtin___snprintf_chk’ output 9 or more bytes (assuming 4108) into a
destination of size 4096
   67 |   return __builtin___snprintf_chk (__s, __n, __USE_FORTIFY_LEVEL
- 1,
      |
~~~~~~~~~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
   68 |        __bos (__s), __fmt, __va_arg_pack ());
      |        ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agomgr/dashboard: Use serial RGW Admin OPS API calls (#28223) 28307/head
Lenz Grimmer [Wed, 29 May 2019 09:23:42 +0000 (11:23 +0200)]
mgr/dashboard: Use serial RGW Admin OPS API calls (#28223)

mgr/dashboard: Use serial RGW Admin OPS API calls

Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
6 years agoMerge pull request #28174 from votdev/issue_39964
Lenz Grimmer [Wed, 29 May 2019 08:31:09 +0000 (10:31 +0200)]
Merge pull request #28174 from votdev/issue_39964

mgr/dashboard: Fix RGW user/bucket quota issues

Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
6 years agoMerge pull request #28168 from votdev/fix_create_key_title
Lenz Grimmer [Wed, 29 May 2019 08:28:07 +0000 (10:28 +0200)]
Merge pull request #28168 from votdev/fix_create_key_title

mgr/dashboard: Display correct dialog title

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
6 years agomgr/dashboard: PG scrub configuration (#27072)
Lenz Grimmer [Wed, 29 May 2019 08:24:22 +0000 (10:24 +0200)]
mgr/dashboard: PG scrub configuration (#27072)

mgr/dashboard: PG scrub configuration

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Patrick Nawracay <pnawracay@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
6 years agocommon: avoid use of size_t in options 28277/head
James Page [Wed, 29 May 2019 04:54:37 +0000 (05:54 +0100)]
common: avoid use of size_t in options

On 32 bit architectures size_t is not a 64 bit type
which causes comparison/assignment mismatch failures
during compilation - specifically in the handling of
legacy configuration values with boost::variant
records where size_t is not supported.

Signed-off-by: James Page <james.page@ubuntu.com>
6 years agoceph.in: do not preload libasan if it is not found 28275/head
Kefu Chai [Wed, 29 May 2019 01:45:57 +0000 (09:45 +0800)]
ceph.in: do not preload libasan if it is not found

before this change, `asan_lib_path` could be `None` when we check it to
see if it ends with `NOTFOUND`. this happens if WITH_SEASTAR=OFF or
WITH_ASAN=OFF, as in that case, find_package(Sanitizers) is not called,
hence `ASAN_LIBRARY` won't be set.

in this change, libasan is only preloaded if

- (WITH_SEASTAR=ON and CMAKE_BUILD_TYPE=Debug and ASAN_LIBRARY is found)
  or
- (WITH_ASAN)

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agoqa/tests: removed filters for client-upgrade-* suites 28271/head
Yuri Weinstein [Tue, 28 May 2019 20:33:12 +0000 (13:33 -0700)]
qa/tests: removed filters for client-upgrade-* suites

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
6 years agoinstall-deps.sh: Typo for krb5 on FreeBSD 28269/head
Thomas Johnson [Tue, 28 May 2019 18:05:16 +0000 (20:05 +0200)]
install-deps.sh: Typo for krb5 on FreeBSD

The FreeBSD dependency install specifies devel/kbr5 instead of devel/krb5

Fixes: https://tracker.ceph.com/issues/40050
Signed-off-by: Thomas Johnson <NTmatter@gmail.com>
6 years agoMerge PR #28058 into master
Sage Weil [Tue, 28 May 2019 18:01:56 +0000 (13:01 -0500)]
Merge PR #28058 into master

* refs/pull/28058/head:
mgr/zabbix: Fix raw_bytes_used key name

Reviewed-by: Sage Weil <sage@redhat.com>
6 years agoMerge pull request #26967 from qwren/qat-accel-doc
Casey Bodley [Tue, 28 May 2019 17:08:32 +0000 (13:08 -0400)]
Merge pull request #26967 from qwren/qat-accel-doc

doc: QAT Acceleration for Encryption and Compression

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
6 years agoMerge pull request #28099 from tchaikov/wip-blobhash
Kefu Chai [Tue, 28 May 2019 15:28:50 +0000 (23:28 +0800)]
Merge pull request #28099 from tchaikov/wip-blobhash

blobhash: do not use cast for unaligned access

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
6 years agoMerge pull request #28247 from tchaikov/wip-disable-asan-if-notfound
Kefu Chai [Tue, 28 May 2019 15:14:31 +0000 (23:14 +0800)]
Merge pull request #28247 from tchaikov/wip-disable-asan-if-notfound

ceph.in: disable ASAN if libasan is not found

Reviewed-by: Casey Bodley <cbodley@redhat.com>
6 years agomgr/dashboard: Display correct dialog title 28168/head
Volker Theile [Mon, 20 May 2019 08:22:44 +0000 (10:22 +0200)]
mgr/dashboard: Display correct dialog title

The dialog to create a new S3 key shows the title 'Show S3 key' instead of 'Create S3 key'.

Fixes: https://tracker.ceph.com/issues/40047
Signed-off-by: Volker Theile <vtheile@suse.com>
6 years agomgr/dashboard: Consider user permissions 27072/head
Tatjana Dehler [Wed, 3 Apr 2019 14:24:11 +0000 (16:24 +0200)]
mgr/dashboard: Consider user permissions

Consider user permissions when showing advanced table actions and hide
all buttons requiring missing permissions from the user.
Also consider user permissions when showing submit buttons.

Signed-off-by: Tatjana Dehler <tdehler@suse.com>
6 years agomgr/dashboard: Add PG scrub configuration form
Tatjana Dehler [Fri, 1 Mar 2019 15:11:53 +0000 (16:11 +0100)]
mgr/dashboard: Add PG scrub configuration form

The commit adapts two different parts:

1. It adds all frontend related changes around the PG scrub
   configuration form
2. It also adds an API test case to check the existence of
   all hard-coded config options in the frontend

Fixes: https://tracker.ceph.com/issues/38211
Signed-off-by: Tatjana Dehler <tdehler@suse.com>
6 years agomgr/dashboard: Add config option component
Tatjana Dehler [Wed, 6 Mar 2019 15:42:28 +0000 (16:42 +0100)]
mgr/dashboard: Add config option component

This commit adds an initial config option component in order to move
the HTML template and the config option types related code to an own
centralized place to be re-usable by other components

Signed-off-by: Tatjana Dehler <tdehler@suse.com>
6 years agomgr/dashboard: Add config filter and delete routes
Tatjana Dehler [Wed, 13 Mar 2019 13:51:43 +0000 (14:51 +0100)]
mgr/dashboard: Add config filter and delete routes

Add a filter route to the configurations endpoint to get a subset of
config options in one request.
Add a delete route to the configurations endpoint to delete a
specific config option value.

The commit contains the frontend and backend related changes.

It also adds the missing '/' to `ConfigurationService.bulkCreate` and
unit test.

Signed-off-by: Tatjana Dehler <tdehler@suse.com>
6 years agomgr/dashboard: Optimize iSCSI target edition (#27272)
Lenz Grimmer [Tue, 28 May 2019 13:35:50 +0000 (15:35 +0200)]
mgr/dashboard: Optimize iSCSI target edition (#27272)

mgr/dashboard: Optimize iSCSI target edition

Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
6 years agoblobhash: do not use cast for unaligned access 28099/head
Kefu Chai [Wed, 15 May 2019 04:46:10 +0000 (12:46 +0800)]
blobhash: do not use cast for unaligned access

* remove the uncorrect comment. as std::hash<> does not apply to a
  customized type. see https://en.cppreference.com/w/cpp/utility/hash
* do not use cast for accessing an uint32_t by dereferencing (void *)
  or (char *) pointer. because the alignment requirement of `uint32_t`
  is stricter than that of `void*` or `char *`. we need to do an
  explicit memcpy() for accessing the uint32_t pointed by the pointer.
  see also https://www.kernel.org/doc/Documentation/unaligned-memory-access.txt
* instead of using a loop for mixing the last few bytes. use a switch-
  case. so GCC-9 won't complain with
```
../src/include/blobhash.h:38:10: warning: iteration 4 invokes undefined
behavior [-Waggressive-loop-optimizations]
   38 |       sh += 8;
      |       ~~~^~~~
../src/include/blobhash.h:36:12: note: within this loop
   36 |     while (len) {
      |            ^~~
```
  at seeing `sh += 8;`
* instead of mixing the last bits repeatly by derefencing `p` using
  `uint32_t`, while move it forwards with step size of `1`, mix
  the bits byte-wise.
* include <cstdint>. this header file is supposed to be self-contained.
* use `std::uint32_t` instead of using `uint32_t`. we cannot assume
  somebody is `using namespace std` or `using std::uint32_t` for us.
* mark the operator() `const noexcept`. see
  https://isocpp.github.io/CppCoreGuidelines/CppCoreGuidelines#c89-make-a-hash-noexcept
  for the rationale behind this

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge pull request #27569 from batrick/gcc-9-wrn
Kefu Chai [Tue, 28 May 2019 11:21:46 +0000 (19:21 +0800)]
Merge pull request #27569 from batrick/gcc-9-wrn

CMakeLists: add std::move warnings in gcc9

Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agomgr/dashboard: Add clients tab to NFS details (#28193)
Lenz Grimmer [Tue, 28 May 2019 10:51:26 +0000 (12:51 +0200)]
mgr/dashboard: Add clients tab to NFS details (#28193)

mgr/dashboard: Add clients tab to NFS details

Reviewed-by: Ricardo Marques <rimarques@suse.com>
6 years agoscript/run_mypy: Sort groups 28225/head
Sebastian Wagner [Thu, 23 May 2019 13:48:15 +0000 (15:48 +0200)]
script/run_mypy: Sort groups

Workaround for https://github.com/python/mypy/issues/2144

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
6 years agomgr/zabbix: Fix raw_bytes_used key name 28058/head
Dmitriy Rabotjagov [Fri, 10 May 2019 12:18:58 +0000 (15:18 +0300)]
mgr/zabbix: Fix raw_bytes_used key name

This patch fixes raw_bytes_used key which was renamed to stored_raw.
Also added key percent_used and fixed zabbix template to be fully
compatible with zabbix 3.0

Fixes: https://tracker.ceph.com/issues/39644
Signed-off-by: Dmitriy Rabotjagov <noonedeadpunk@ya.ru>
6 years agomgr/dashboard: Unify remaining action labels (#28162)
Lenz Grimmer [Tue, 28 May 2019 09:28:12 +0000 (11:28 +0200)]
mgr/dashboard: Unify remaining action labels (#28162)

mgr/dashboard: Unify remaining action labels

Reviewed-by: Ricardo Marques <rimarques@suse.com>
6 years agomonitoring: SNMP OID per every Prometheus alert rule 27978/head
Volker Theile [Mon, 6 May 2019 14:26:37 +0000 (16:26 +0200)]
monitoring: SNMP OID per every Prometheus alert rule

Use the Ceph enterprise OID 50495 (https://www.iana.org/assignments/enterprise-numbers/enterprise-numbers) and create OIDs for every Prometheus alert rule according to the schema at https://github.com/SUSE/prometheus-webhook-snmp/blob/master/README.md.

Example OID:
1.3.6.1.4.1.50495.15.1.2.2.1

All alert rule OIDs are located below the object identifier 15 (15 for p which is the first character of prometheus). Check out the MIB at https://github.com/SUSE/prometheus-webhook-snmp/blob/master/PROMETHEUS-ALERT-CEPH-MIB.txt for more details.

Signed-off-by: Volker Theile <vtheile@suse.com>
6 years agoMerge pull request #27436 from simon-rock/simon_work
Yan, Zheng [Tue, 28 May 2019 07:30:31 +0000 (15:30 +0800)]
Merge pull request #27436 from simon-rock/simon_work

mds: avoid sending too many osd requests at once after mds restarts

6 years agoMerge pull request #28224 from jan--f/pool-ls-detail-ec-profile
Kefu Chai [Tue, 28 May 2019 03:28:00 +0000 (05:28 +0200)]
Merge pull request #28224 from jan--f/pool-ls-detail-ec-profile

osd_types: add ec profile to plain text osd pool ls detail output

Reviewed-by: Sage Weil <sage@redhat.com>
6 years agoMerge pull request #28159 from batrick/i39599
Kefu Chai [Tue, 28 May 2019 03:26:27 +0000 (05:26 +0200)]
Merge pull request #28159 from batrick/i39599

common: fix parse_env nullptr deref

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge pull request #28057 from wido/zabbix-pg-state
Kefu Chai [Tue, 28 May 2019 03:24:09 +0000 (05:24 +0200)]
Merge pull request #28057 from wido/zabbix-pg-state

mgr/zabbix: Fix typo in key name for PGs in backfill_wait state

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
6 years agoMerge pull request #28025 from markhpc/wip-bs-aio-preadv
Kefu Chai [Tue, 28 May 2019 03:22:24 +0000 (05:22 +0200)]
Merge pull request #28025 from markhpc/wip-bs-aio-preadv

os/bluestore: Unify on preadv for io_uring and future refactor.

Reviewed-by: Sage Weil <sage@redhat.com>
6 years agoMerge pull request #28010 from ifed01/wip-ifed-dump-large-onode
Kefu Chai [Tue, 28 May 2019 03:16:21 +0000 (05:16 +0200)]
Merge pull request #28010 from ifed01/wip-ifed-dump-large-onode

os/bluestore: dump onode that has too many spanning blobs

Reviewed-by: Sage Weil <sage@redhat.com>
6 years agoMerge pull request #26341 from sebastian-philipp/dashboard-merge-orchclient
Kefu Chai [Tue, 28 May 2019 03:11:13 +0000 (05:11 +0200)]
Merge pull request #26341 from sebastian-philipp/dashboard-merge-orchclient

mgr/dashboard: Fix iSCSI + Rook issues

Reviewed-by: Ricardo Marques <rimarques@suse.com>
6 years agomds: avoid sending too many osd requests at once after mds restarts 27436/head
simon gao [Tue, 28 May 2019 02:36:32 +0000 (22:36 -0400)]
mds: avoid sending too many osd requests at once after mds restarts
Fixes: http://tracker.ceph.com/issues/40028
Signed-off-by: simon gao <simon29rock@gmail.com>
6 years agomgr/dashboard: Fixing RGW user user/bucket quota info 28174/head
Volker Theile [Mon, 27 May 2019 09:39:29 +0000 (11:39 +0200)]
mgr/dashboard: Fixing RGW user user/bucket quota info

Display '-' if user/bucket quota is disabled instead of displaying the current set values.

Signed-off-by: Volker Theile <vtheile@suse.com>
6 years agomgr/dashboard: Fix RGW user/bucket quota issues
Volker Theile [Mon, 20 May 2019 09:03:23 +0000 (11:03 +0200)]
mgr/dashboard: Fix RGW user/bucket quota issues

* RGW user/bucket "max. size" should be hidden when "user/bucket quota" is not enabled
* Only execute validators if necessary

Fixes: https://tracker.ceph.com/issues/39964
Signed-off-by: Volker Theile <vtheile@suse.com>
6 years agomgr/dashboard: Use serial RGW Admin OPS API calls 28223/head
Volker Theile [Thu, 23 May 2019 10:00:38 +0000 (12:00 +0200)]
mgr/dashboard: Use serial RGW Admin OPS API calls

This PR takes care that changes done to a RGW user are submitted (via RGW Admin OPS API) in serial and NOT in parallel.

Fixes: https://tracker.ceph.com/issues/40015
Signed-off-by: Volker Theile <vtheile@suse.com>
6 years agomgr/dashboard: Subscribe to changes when RequiredIf is used (#28231)
Lenz Grimmer [Mon, 27 May 2019 13:09:41 +0000 (15:09 +0200)]
mgr/dashboard: Subscribe to changes when RequiredIf is used (#28231)

mgr/dashboard: Subscribe to changes when RequiredIf is used

Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
6 years agocommon: no need to include ceph_assert.h 28255/head
Kefu Chai [Mon, 27 May 2019 11:55:59 +0000 (19:55 +0800)]
common: no need to include ceph_assert.h

src/common/convenience.h is a header-only library, and it does not use
dout or ceph_assert() utilities. so there is no need to include
`ceph_assert.h`.

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge pull request #28078 from sebastian-philipp/kubejacker-fix-mgr-plugins
Sebastian Wagner [Mon, 27 May 2019 08:14:45 +0000 (10:14 +0200)]
Merge pull request #28078 from sebastian-philipp/kubejacker-fix-mgr-plugins

scripts/kubejacker: Fix mgr_plugins target for centos

Reviewed-by: Tim Serong <tserong@suse.com>
6 years agomgr/balancer: create compat weight-set earlier 28251/head
xie xingguo [Mon, 27 May 2019 06:46:48 +0000 (14:46 +0800)]
mgr/balancer: create compat weight-set earlier

So if we do:

ceph balancer mode crush-compat
ceph balancer on
ceph config set global osd_crush_update_weight_set false

and then add some new osd in, those osds will truly start
with a zeroed weight-set weight.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>