]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
5 years agoscript/run-cbt.sh: check option correctly 30287/head
Kefu Chai [Tue, 10 Sep 2019 09:40:30 +0000 (17:40 +0800)]
script/run-cbt.sh: check option correctly

* s/source_dir/source-dir/: as the option is named "--source-dir", not
  "--source_dir"
* cd $build_dir, before launching/stopping vstart. as vstart.sh is
  supposed to run from the build directory

Signed-off-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #30273 from neha-ojha/wip-documenting-ceph
Nathan Cutler [Mon, 9 Sep 2019 22:52:00 +0000 (00:52 +0200)]
Merge pull request #30273 from neha-ojha/wip-documenting-ceph

doc/start/documenting-ceph.rst: make better doc recommendations

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
5 years agodoc/start/documenting-ceph.rst: make better doc recommendations 30273/head
Neha Ojha [Mon, 9 Sep 2019 22:12:37 +0000 (15:12 -0700)]
doc/start/documenting-ceph.rst: make better doc recommendations

I do not think "Editors" is relevant anymore.

Signed-off-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge PR #30187 into master
Patrick Donnelly [Mon, 9 Sep 2019 18:33:40 +0000 (11:33 -0700)]
Merge PR #30187 into master

* refs/pull/30187/head:
script/backport-resolve-issue: better error message

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge pull request #30226 from neha-ojha/wip-41385-2
Neha Ojha [Mon, 9 Sep 2019 16:48:45 +0000 (09:48 -0700)]
Merge pull request #30226 from neha-ojha/wip-41385-2

osd/MissingLoc.cc: do not rely on missing_loc_sources only

Reviewed-by: David Zafman <dzafman@redhat.com>
Reviewed By: Xie Xingguo <xie.xingguo@zte.com.cn>

5 years agoMerge PR #30196 into master
Sage Weil [Mon, 9 Sep 2019 16:19:32 +0000 (11:19 -0500)]
Merge PR #30196 into master

* refs/pull/30196/head:
qa/tasks/ceph: restart: stop osd, mark down, then start

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
5 years agoMerge pull request #30268 from cbodley/wip-41719
Casey Bodley [Mon, 9 Sep 2019 16:18:39 +0000 (12:18 -0400)]
Merge pull request #30268 from cbodley/wip-41719

cls/rgw: fix bilog trim tests in ceph_test_cls_rgw

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
5 years agoMerge PR #30220 into master
Sage Weil [Mon, 9 Sep 2019 16:09:04 +0000 (11:09 -0500)]
Merge PR #30220 into master

* refs/pull/30220/head:
test: Allow fractional milliseconds to make test possible

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agocls/rgw: fix bilog trim tests in ceph_test_cls_rgw 30268/head
Casey Bodley [Mon, 9 Sep 2019 13:42:42 +0000 (09:42 -0400)]
cls/rgw: fix bilog trim tests in ceph_test_cls_rgw

the bucket index prepare step no longer writes a bilog entry, so the
tests were expecting more entries

Fixes: https://tracker.ceph.com/issues/41719
Signed-off-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #29127 from bk201/wip-40337
Kefu Chai [Mon, 9 Sep 2019 14:01:58 +0000 (22:01 +0800)]
Merge pull request #29127 from bk201/wip-40337

mgr/dashboard: orchestrator integration initial works

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
5 years agoMerge pull request #30115 from alfredodeza/wip-rm41378-2
Alfredo Deza [Mon, 9 Sep 2019 13:32:03 +0000 (09:32 -0400)]
Merge pull request #30115 from alfredodeza/wip-rm41378-2

ceph-volume: pre-install python-apt and its variants before test runs

Reviewed-by: Jan Fajerski <jfajerski@suse.com>
5 years agoMerge pull request #30142 from votdev/issue_41648
Kefu Chai [Mon, 9 Sep 2019 12:32:30 +0000 (20:32 +0800)]
Merge pull request #30142 from votdev/issue_41648

mgr/dashboard: Handle always-on Ceph Manager modules correctly

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #30079 from uweigand/issue-41605-fixes
Kefu Chai [Mon, 9 Sep 2019 12:29:39 +0000 (20:29 +0800)]
Merge pull request #30079 from uweigand/issue-41605-fixes

Fix big-endian handling

Reviewed-by: Sage Weil <sage@redhat.com>
5 years agoMerge pull request #30087 from egggHang/ec_benchmark
Kefu Chai [Mon, 9 Sep 2019 12:24:20 +0000 (20:24 +0800)]
Merge pull request #30087 from egggHang/ec_benchmark

test/erasure-code: add exception handling to k & m

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #29892 from Yan-waller/wip-yanj-fixreed_sol_r6_op
Kefu Chai [Mon, 9 Sep 2019 12:22:08 +0000 (20:22 +0800)]
Merge pull request #29892 from Yan-waller/wip-yanj-fixreed_sol_r6_op

osd: fix the missing default value m=2 of reed_sol_r6_op in profile

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #30125 from majianpeng/msg-protocolv1-reduece-swap
Kefu Chai [Mon, 9 Sep 2019 12:11:46 +0000 (20:11 +0800)]
Merge pull request #30125 from majianpeng/msg-protocolv1-reduece-swap

msg/async/ProtocolV1: avoid unnecessary bufferlist::swap.

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
5 years agoPendingReleaseNotes: note about changes in `ceph osd erasure-code-profile set` 29892/head
Yan Jun [Wed, 4 Sep 2019 12:46:43 +0000 (20:46 +0800)]
PendingReleaseNotes: note about changes in `ceph osd erasure-code-profile set`

Signed-off-by: Yan Jun <yan.jun8@zte.com.cn>
5 years agoosd: add sanity check for invalid m/w of liber8tion
Yan Jun [Tue, 3 Sep 2019 14:16:04 +0000 (22:16 +0800)]
osd: add sanity check for invalid m/w of liber8tion

Signed-off-by: Yan Jun <yan.jun8@zte.com.cn>
5 years agoec/jerasure: save the default m=2 of reed_sol_r6_op in profile
Yan Jun [Mon, 26 Aug 2019 10:34:50 +0000 (18:34 +0800)]
ec/jerasure: save the default m=2 of reed_sol_r6_op in profile

save the default value of m to profile so that it could be dumped
in command 'ceph osd erasure-code-profile get xxx', which is more
useful and friendly to user.

Signed-off-by: Yan Jun <yan.jun8@zte.com.cn>
5 years agoMerge pull request #30109 from rzarzynski/wip-bug-25098-bluefs_layout_t
Kefu Chai [Mon, 9 Sep 2019 11:53:53 +0000 (19:53 +0800)]
Merge pull request #30109 from rzarzynski/wip-bug-25098-bluefs_layout_t

os/bluestore: verify disk layout of BlueFS

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
Reviewed-by: Sage Weil <sage@redhat.com>
5 years agoMerge pull request #30197 from bk201/wip-41675
Kefu Chai [Mon, 9 Sep 2019 11:19:44 +0000 (19:19 +0800)]
Merge pull request #30197 from bk201/wip-41675

mgr/orchestrator: fix refs property of progresses

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
5 years agomgr/dashboard: Handle always-on Ceph Manager modules correctly 30142/head
Volker Theile [Thu, 5 Sep 2019 14:06:57 +0000 (16:06 +0200)]
mgr/dashboard: Handle always-on Ceph Manager modules correctly

Currently always-on modules are not marked as enabled in the WebUI and can be disabled. This PR will fix that.
Note, this PR will NOT implement code that will prevent a developer from trying to disable an always-on module through the REST API. The Mgr Python extension will throw an adequate exception.

This PR will also do:
* Remove old code fragments from a previous Mgr Module management UI that is obsolete now.
* Cleanup code in BaseMgrModule code.

Fixes: https://tracker.ceph.com/issues/41648
Signed-off-by: Volker Theile <vtheile@suse.com>
5 years agoMerge pull request #30199 from IlsooByun/cmake_ptyhon_var
Kefu Chai [Sun, 8 Sep 2019 16:02:20 +0000 (00:02 +0800)]
Merge pull request #30199 from IlsooByun/cmake_ptyhon_var

build/ops: fix build fail related to PYTHON_EXECUTABLE variable

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge PR #29986 into master
Sage Weil [Sat, 7 Sep 2019 20:09:25 +0000 (15:09 -0500)]
Merge PR #29986 into master

* refs/pull/29986/head:
mgr/pg_autoscaler: use 'stored' for pool_logical_used

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge PR #30139 into master
Sage Weil [Sat, 7 Sep 2019 20:08:57 +0000 (15:08 -0500)]
Merge PR #30139 into master

* refs/pull/30139/head:
mgr/DaemonServer: skip adjusting pgp_num when merging is in-progress

Reviewed-by: Sage Weil <sage@redhat.com>
5 years agoMerge pull request #30061 from xiexingguo/wip-sparse-read
Xie Xingguo [Sat, 7 Sep 2019 02:34:09 +0000 (10:34 +0800)]
Merge pull request #30061 from xiexingguo/wip-sparse-read

os, osd: readv

Reviewed-by: Sage Weil <sage@redhat.com>
5 years agoMerge pull request #30059 from xiexingguo/wip-clean-vs-repair
Xie Xingguo [Sat, 7 Sep 2019 02:31:28 +0000 (10:31 +0800)]
Merge pull request #30059 from xiexingguo/wip-clean-vs-repair

osd/PG: fix _finish_recovery vs repair race

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #30190 from tchaikov/wip-python-rpm-macro
Kefu Chai [Sat, 7 Sep 2019 00:57:11 +0000 (08:57 +0800)]
Merge pull request #30190 from tchaikov/wip-python-rpm-macro

install-deps.sh: install `python*-devel` for python*rpm-macros

Reviewed-by: Boris Ranto <branto@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoosd/MissingLoc.cc: do not rely on missing_loc_sources only 30226/head
Neha Ojha [Fri, 6 Sep 2019 03:35:51 +0000 (20:35 -0700)]
osd/MissingLoc.cc: do not rely on missing_loc_sources only

In 624ade487ea4aeaf988cc1767e0b293f76addd5b, we relied on missing_loc_sources
to check for strays and remove an OSD from missing_loc. However, it is
possible that missing_loc_sources is empty while there are still OSDs
present in missing_loc. Since the aim is to just remove a stray OSD from
missing_loc, we do not need to rely on missing_loc_sources. We still
clean missing_loc_sources if any stray is present in it.

Signed-off-by: Neha Ojha <nojha@redhat.com>
5 years agotest: Allow fractional milliseconds to make test possible 30220/head
David Zafman [Fri, 6 Sep 2019 18:20:10 +0000 (11:20 -0700)]
test: Allow fractional milliseconds to make test possible

Fixes: https://tracker.ceph.com/issues/41689
Signed-off-by: David Zafman <dzafman@redhat.com>
5 years agoinstall-deps.sh: install `python*-devel` for python*rpm-macros 30190/head
Kefu Chai [Thu, 5 Sep 2019 15:17:06 +0000 (23:17 +0800)]
install-deps.sh: install `python*-devel` for python*rpm-macros

in 087ea813, we installed '*rpm-macros' for the macros, so we can have
access to the latest python packaging related macros for preparing the
build dependencies.

but we could run into https://bugs.centos.org/view.php?id=16379, if
we already have an old version of python-devel installed. as the newer
version of python-rpm-macros conflicts with it.

it was a chicken-and-egg problem, as we don't know the exact name of
*rpm-macros packages. that's why we chose to install all of them. but
we have to upgrade the existing python-devel package to resolve the
conflict. but the since there is no python3-devel in RHEL7/CentOS7,
what they have is python36-devel. so we have to hardwire the
`%{python3_pkgversion}` to "36" even before we have access to this
macro, and upgrade the python36-devel package beforehand. but this
renders installing the rpm-macro package less useful -- we intend to
use the macro offered by the package to figure out "36".

as a workaround, we pretend that we know the "main" version of python3
in current RHEL/CentOS. and always install python36-devel for
python-rpm-macros. as the former requires the latter.

once all python3*-devel on all builders are upgraded, we will be safe
to install '*rpm-macros' again without installing python36-devel first.
by then, we could revert this change, or continue installing
python36-devel until the distro bumps up the "main" python version to 3.7

Fixes: https://tracker.ceph.com/issues/41603
Signed-off-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #22574 from aclamk/bs-allocator-ageing-test
Kefu Chai [Fri, 6 Sep 2019 17:53:07 +0000 (01:53 +0800)]
Merge pull request #22574 from aclamk/bs-allocator-ageing-test

bluestore/allocator: Ageing test for bluestore allocators.

Reviewed-by: Sage Weil <sage@redhat.com>
5 years agoMerge pull request #30028 from tchaikov/wip-rpath
Kefu Chai [Fri, 6 Sep 2019 17:40:53 +0000 (01:40 +0800)]
Merge pull request #30028 from tchaikov/wip-rpath

cmake: selectively rewrite install rpath

Reviewed-by: Sridhar Seshasayee <sseshasa@redhat.com>
5 years agoMerge pull request #30015 from neha-ojha/wip-41429
Kefu Chai [Fri, 6 Sep 2019 17:27:14 +0000 (01:27 +0800)]
Merge pull request #30015 from neha-ojha/wip-41429

mon/Monitor.cc: fix condition that checks for unrecognized auth mode

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Joao Eduardo Luis <joao@suse.com>
Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #30023 from tchaikov/wip-get-req
Kefu Chai [Fri, 6 Sep 2019 17:10:06 +0000 (01:10 +0800)]
Merge pull request #30023 from tchaikov/wip-get-req

mon,osd: use get_req<> instead of static_cast<>(get_req())

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
5 years agoMerge pull request #30210 from ctrlaltdel/doc-typo
Casey Bodley [Fri, 6 Sep 2019 16:04:38 +0000 (12:04 -0400)]
Merge pull request #30210 from ctrlaltdel/doc-typo

doc: Fix a typo in balancer documentation

Reviewed-by: Lenz Grimmer <LGrimmer@suse.com>
5 years agoMerge pull request #29520 from pcuzner/add-events-mgr-module
Sebastian Wagner [Fri, 6 Sep 2019 15:09:21 +0000 (17:09 +0200)]
Merge pull request #29520 from pcuzner/add-events-mgr-module

mgr/k8sevents: Add mgr module for kubernetes event integration

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
Reviewed-by: Travis Nielsen <tnielsen@redhat.com>
5 years agodoc: Fix a typo in balancer documentation 30210/head
Francois Deppierraz [Fri, 6 Sep 2019 13:12:21 +0000 (15:12 +0200)]
doc: Fix a typo in balancer documentation

Signed-off-by: Francois Deppierraz <francois@ctrlaltdel.ch>
5 years agoMerge PR #29786 into master
Sage Weil [Fri, 6 Sep 2019 12:05:48 +0000 (07:05 -0500)]
Merge PR #29786 into master

* refs/pull/29786/head:
allow for multiple "build" dirs to exist

Reviewed-by: Sage Weil <sage@redhat.com>
5 years agobuild/ops: fix build fail related to PYTHON_EXECUTABLE variable 30199/head
Ilsoo Byun [Fri, 6 Sep 2019 04:50:31 +0000 (13:50 +0900)]
build/ops: fix build fail related to PYTHON_EXECUTABLE variable

Fixes: https://tracker.ceph.com/issues/41676
Signed-off-by: Ilsoo Byun <ilsoobyun@linecorp.com>
5 years agoallow for multiple "build" dirs to exist 29786/head
Yuval Lifshitz [Wed, 21 Aug 2019 06:27:42 +0000 (09:27 +0300)]
allow for multiple "build" dirs to exist

Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
5 years agoMerge pull request #29985 from xiexingguo/wip-41514-plus
Xie Xingguo [Fri, 6 Sep 2019 05:51:48 +0000 (13:51 +0800)]
Merge pull request #29985 from xiexingguo/wip-41514-plus

osd/PrimaryLogPG: cancel in-flight manifest ops on interval changing; fix race with scrub

Reviewed-by: Myoungwon Oh <ommw@sk.com>
5 years agomsg/async/ProtocolV1: avoid unnecessary bufferlist::swap. 30125/head
Jianpeng Ma [Fri, 6 Sep 2019 03:21:12 +0000 (11:21 +0800)]
msg/async/ProtocolV1: avoid unnecessary bufferlist::swap.

Currently, for MOSDOpRely it don't prepare in func send_message.
So no need do swap for empty bufferlist.

Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
5 years agomgr/orchestrator: fix refs property of progresses 30197/head
Kiefer Chang [Thu, 5 Sep 2019 08:05:30 +0000 (16:05 +0800)]
mgr/orchestrator: fix refs property of progresses

refs for events should be a list of tuples.

Fixes: https://tracker.ceph.com/issues/41675
Signed-off-by: Kiefer Chang <kiefer.chang@suse.com>
5 years agoMerge pull request #30184 from tchaikov/wip-make-check
Kefu Chai [Fri, 6 Sep 2019 03:01:20 +0000 (11:01 +0800)]
Merge pull request #30184 from tchaikov/wip-make-check

run-make-check.sh: extract run-make.sh

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
5 years agoMerge pull request #30085 from xiexingguo/wip-41601
Xie Xingguo [Fri, 6 Sep 2019 03:01:02 +0000 (11:01 +0800)]
Merge pull request #30085 from xiexingguo/wip-41601

osd/PrimaryLogPG: update oi.size on write op implicitly truncating object up

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
5 years agoMerge PR #29842 into master
Sage Weil [Fri, 6 Sep 2019 02:27:09 +0000 (21:27 -0500)]
Merge PR #29842 into master

* refs/pull/29842/head:
kv/KeyValueDB: fix estimate_prefix_size()

Reviewed-by: Sage Weil <sage@redhat.com>
5 years agoMerge PR #29855 into master
Sage Weil [Fri, 6 Sep 2019 02:26:29 +0000 (21:26 -0500)]
Merge PR #29855 into master

* refs/pull/29855/head:
pybind/mgr: remove type conversions for ceph native options
mgr: return get_ceph_option result as typed Py object (not string)

Reviewed-by: Tim Serong <tserong@suse.com>
5 years agoqa/tasks/ceph: restart: stop osd, mark down, then start 30196/head
Sage Weil [Fri, 6 Sep 2019 02:24:38 +0000 (21:24 -0500)]
qa/tasks/ceph: restart: stop osd, mark down, then start

If we stop, start, and then mark down, we may (likely) end up marking
the *new* instance down, which is noisy (generates a cluster warning
message) and inefficient.

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoMerge pull request #30013 from ivancich/wip-beanjoy-update-attrib-tags
J. Eric Ivancich [Thu, 5 Sep 2019 17:37:14 +0000 (13:37 -0400)]
Merge pull request #30013 from ivancich/wip-beanjoy-update-attrib-tags

rgw: fix refcount tags to match and update object's idtag

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
5 years agoMerge pull request #30062 from david-z/wip-fix-test-assert
Kefu Chai [Thu, 5 Sep 2019 15:57:44 +0000 (23:57 +0800)]
Merge pull request #30062 from david-z/wip-fix-test-assert

test: remove useless ASSERT_XXX macros for rgw test

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #29673 from rafaelquint/imagetrash
Lenz Grimmer [Thu, 5 Sep 2019 15:40:52 +0000 (15:40 +0000)]
Merge pull request #29673 from rafaelquint/imagetrash

mgr/dashboard: RBD Image Purge Trash, Move to Trash and Restore

Reviewed-by: Tiago Melo <tmelo@suse.com>
5 years agoMerge pull request #28755 from dzafman/wip-network
David Zafman [Thu, 5 Sep 2019 14:54:43 +0000 (07:54 -0700)]
Merge pull request #28755 from dzafman/wip-network

feature: Health warnings on long network ping times, add "dump_osd_network" to get a report

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
5 years agoscript/backport-resolve-issue: better error message 30187/head
Nathan Cutler [Thu, 5 Sep 2019 14:14:28 +0000 (16:14 +0200)]
script/backport-resolve-issue: better error message

When a point release is published, sometimes the new target version is not yet
in Redmine. Issue a better error message in this case.

Signed-off-by: Nathan Cutler <ncutler@suse.com>
5 years agorun-make-check.sh: extract run-make.sh 30184/head
Kefu Chai [Thu, 5 Sep 2019 09:58:44 +0000 (17:58 +0800)]
run-make-check.sh: extract run-make.sh

so we can reuse run-make.sh for building the artifact used by other
tests than "make check", for instance, dashboard's E2E test and
crimson's performance test.

Signed-off-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #29402 from Devp00l/wip-40828
Laura Paduano [Thu, 5 Sep 2019 11:03:12 +0000 (13:03 +0200)]
Merge pull request #29402 from Devp00l/wip-40828

mgr/dashboard: Use onCancel on any modal event

Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
5 years agoMerge pull request #30064 from bk201/wip-41368
Laura Paduano [Thu, 5 Sep 2019 10:47:43 +0000 (12:47 +0200)]
Merge pull request #30064 from bk201/wip-41368

mgr/dashboard: fix cdEncode decorator is not working on class

Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
5 years agoMerge pull request #30145 from theanalyst/doc/releases/14.2.3
Nathan Cutler [Thu, 5 Sep 2019 10:24:41 +0000 (12:24 +0200)]
Merge pull request #30145 from theanalyst/doc/releases/14.2.3

doc: releases: 14.2.3 dashboard note

https://github.com/ceph/ceph/pull/24179

5 years agomgr/dashboard: Empty datatable rendered before data has been f… (#30103)
Lenz Grimmer [Thu, 5 Sep 2019 10:22:41 +0000 (10:22 +0000)]
mgr/dashboard: Empty datatable rendered before data has been f… (#30103)

mgr/dashboard: Empty datatable rendered before data has been fetched

Reviewed-by: Patrick Seidensal <pnawracay@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
5 years agoos/bluestore: verify disk layout of BlueFS. 30109/head
Radoslaw Zarzynski [Thu, 29 Aug 2019 10:17:34 +0000 (12:17 +0200)]
os/bluestore: verify disk layout of BlueFS.

Fixes: http://tracker.ceph.com/issues/25098
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
5 years agoos/bluestore: bluefs_layout_t tracks WAL presence.
Radoslaw Zarzynski [Wed, 4 Sep 2019 06:24:04 +0000 (08:24 +0200)]
os/bluestore: bluefs_layout_t tracks WAL presence.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
5 years agoimmutable_object_cache: Endian fix for HeaderHelper 30079/head
Ulrich Weigand [Mon, 2 Sep 2019 19:29:26 +0000 (21:29 +0200)]
immutable_object_cache: Endian fix for HeaderHelper

struct HeaderHelper is used to overlay buffer list data, which
was generated via encode, and therefore holds integer data in
fixed little-endian format.

Thus, HeaderHelper needs to use ceph_le32 instead of uint32_t
when accessing the len field.

Fixes (partially): https://tracker.ceph.com/issues/41605

Signed-off-by: Ulrich Weigand <ulrich.weigand@de.ibm.com>
5 years agoosd: Endian fix for PGTempMap handling
Ulrich Weigand [Mon, 2 Sep 2019 19:28:44 +0000 (21:28 +0200)]
osd: Endian fix for PGTempMap handling

struct PGTempMap in osd/OSDMap.h tracks a number of int32_t pointers
pointing into a buffer list. But that list was generated via encode,
which means int members are bytes-swapped. Fixed by using ceph_le32
pointers instead.

Fixes (partially): https://tracker.ceph.com/issues/41605

Signed-off-by: Ulrich Weigand <ulrich.weigand@de.ibm.com>
5 years agolibrbd: Endian fix for handling old image format resize requests
Ulrich Weigand [Mon, 2 Sep 2019 19:28:18 +0000 (21:28 +0200)]
librbd: Endian fix for handling old image format resize requests

ResizeRequest<I>::send_update_header contains a comment
    // NOTE: format 1 image headers are not stored in fixed endian
format

This statement appears incorrect; Linux kernel code handling the old
format headers does assume they are in fixed little-endian format.

Fixed by performing a byte-swap as everywhere else; this actually
fixes test suite failures on big-endian systems.

Fixes (partially): https://tracker.ceph.com/issues/41605

Signed-off-by: Ulrich Weigand <ulrich.weigand@de.ibm.com>
5 years agorgw,test: Add missing init_le calls
Ulrich Weigand [Mon, 2 Sep 2019 19:27:56 +0000 (21:27 +0200)]
rgw,test: Add missing init_le calls

Add calls to init_le16/32/64 to properly byte-swap values on
big-endian systems when assigning to ceph_le16/32/64 variables.

Fixes (partially): https://tracker.ceph.com/issues/41605

Signed-off-by: Ulrich Weigand <ulrich.weigand@de.ibm.com>
5 years agolibrados,test: Fix incorrect use of __le16/32/64
Ulrich Weigand [Mon, 2 Sep 2019 19:27:22 +0000 (21:27 +0200)]
librados,test: Fix incorrect use of __le16/32/64

Use ceph_le16/32/64 instead of __le16/32/64 (which are no-op outside
of kernel code).

Fixes (partially): https://tracker.ceph.com/issues/41605

Signed-off-by: Ulrich Weigand <ulrich.weigand@de.ibm.com>
5 years agotransaction: Fix incorrect use of __le16/32/64
Ulrich Weigand [Mon, 2 Sep 2019 19:26:53 +0000 (21:26 +0200)]
transaction: Fix incorrect use of __le16/32/64

Use ceph_le16/32/64 instead of __le16/32/64 (which are no-op outside
of kernel code).

Note that this updates only those uses of __le16/32/64 which are
part of data structures that are serialized to disk/network
(i.e. Transaction::Op and Transaction::TransactionData).

Also note that code in this file performs combined operations on
little-endian values (in particular ++, +=, and |=) which are not
supported on the ceph_le16/32/64 class, and are therefore replaced
by more primitive operations.

Fixes (partially): https://tracker.ceph.com/issues/41605

Signed-off-by: Ulrich Weigand <ulrich.weigand@de.ibm.com>
5 years agobluestore: Fix incorrect use of __le16/32/64
Ulrich Weigand [Mon, 2 Sep 2019 19:26:16 +0000 (21:26 +0200)]
bluestore: Fix incorrect use of __le16/32/64

Use ceph_le16/32/64 instead of __le16/32/64 (which are no-op outside
of kernel code).

Fixes (partially): https://tracker.ceph.com/issues/41605

Signed-off-by: Ulrich Weigand <ulrich.weigand@de.ibm.com>
5 years agoasync,crimson: Add missing init_le calls
Ulrich Weigand [Mon, 2 Sep 2019 19:25:54 +0000 (21:25 +0200)]
async,crimson: Add missing init_le calls

Add calls to init_le16/32/64 to properly byte-swap values on
big-endian systems when assigning to ceph_le16/32/64 variables.

Fixes (partially): https://tracker.ceph.com/issues/41605

Signed-off-by: Ulrich Weigand <ulrich.weigand@de.ibm.com>
5 years agomsg: Fix incorrect use of __le16/32/64
Ulrich Weigand [Mon, 2 Sep 2019 19:25:12 +0000 (21:25 +0200)]
msg: Fix incorrect use of __le16/32/64

Use ceph_le16/32/64 instead of __le16/32/64 (which are no-op outside
of kernel code).

Fixes (partially): https://tracker.ceph.com/issues/41605

Signed-off-by: Ulrich Weigand <ulrich.weigand@de.ibm.com>
5 years agomessages: Fix incorrect use of __le16/32/64
Ulrich Weigand [Mon, 2 Sep 2019 19:24:35 +0000 (21:24 +0200)]
messages: Fix incorrect use of __le16/32/64

Use ceph_le16/32/64 instead of __le16/32/64 (which are no-op outside
of kernel code).

Fixes (partially): https://tracker.ceph.com/issues/41605

Signed-off-by: Ulrich Weigand <ulrich.weigand@de.ibm.com>
5 years agomds: Fix incorrect use of __le16/32/64
Ulrich Weigand [Mon, 2 Sep 2019 19:24:13 +0000 (21:24 +0200)]
mds: Fix incorrect use of __le16/32/64

Use ceph_le16/32/64 instead of __le16/32/64 (which are no-op outside
of kernel code).

Fixes (partially): https://tracker.ceph.com/issues/41605

Signed-off-by: Ulrich Weigand <ulrich.weigand@de.ibm.com>
5 years agocephx: Fix incorrect use of __le16/32/64
Ulrich Weigand [Mon, 2 Sep 2019 19:23:47 +0000 (21:23 +0200)]
cephx: Fix incorrect use of __le16/32/64

Use ceph_le16/32/64 instead of __le16/32/64 (which are no-op outside
of kernel code).

Note that I've also changes cephx_calc_client_server_challenge to
use ceph_le64 instead of manually byte-swapping by mswab.  (This
is a no-op, but it seems more consistent to use the ceph_le types
throughout.)

Fixes (partially): https://tracker.ceph.com/issues/41605

Signed-off-by: Ulrich Weigand <ulrich.weigand@de.ibm.com>
5 years agochecksum: Fix incorrect use of __le16/32/64
Ulrich Weigand [Mon, 2 Sep 2019 19:23:13 +0000 (21:23 +0200)]
checksum: Fix incorrect use of __le16/32/64

Use ceph_le16/32/64 instead of __le16/32/64 (which are no-op outside
of kernel code).

Note that I've changed the Alg::calc routines to return the
init_value_t type instead of value_t, to avoid having to
introduce explicit byte-swapping calls to init_le16/32/64 in
many places.  (This way, the byte-swapping happens implicitly
at the very end, wher the init_value_t value is assigned via
a value_t pointer.)

Fixes (partially): https://tracker.ceph.com/issues/41605

Signed-off-by: Ulrich Weigand <ulrich.weigand@de.ibm.com>
5 years agoinclude: Fix new-style encoding routines on big-endian
Ulrich Weigand [Mon, 2 Sep 2019 19:22:42 +0000 (21:22 +0200)]
include: Fix new-style encoding routines on big-endian

The new-style encoding routines (denc.h) are broken on big-endian
systems.  While there is a lot of infrastucture in place to
recognize data types that need to be byte-swapped during encoding
and decoding on big-endian systems, nothing is actually ever swapped.

Fixed by using ceph_le16/32/64 instead of __le16/32/64 (which are
no-ops outside of kernel code).

Fixes (partially): https://tracker.ceph.com/issues/41605

Signed-off-by: Ulrich Weigand <ulrich.weigand@de.ibm.com>
5 years agoinclude: Simplify usage of init_le16/32/64 routines
Ulrich Weigand [Mon, 2 Sep 2019 19:22:09 +0000 (21:22 +0200)]
include: Simplify usage of init_le16/32/64 routines

These routines currently just return plain __u16/32/64.  This patch
changes them to return ceph_le16/32/64 types instead.  This has a
number of benefits, in particular it allows the routines to now be
used to directly initialize variables of ceph_le16/32/64 type, as
one would expect from the names of those routines.

This doesn't make much of a difference in the current code base,
but it simplifies future patches to fix endian issues.

Fixes (partially): https://tracker.ceph.com/issues/41605

Signed-off-by: Ulrich Weigand <ulrich.weigand@de.ibm.com>
5 years agoinclude: Endian fix for shared kernel/user headers
Ulrich Weigand [Mon, 2 Sep 2019 19:21:17 +0000 (21:21 +0200)]
include: Endian fix for shared kernel/user headers

Endian swapping is done differently in kernel space vs. user space,
but a few header files are shared between those two user cases.

Current code attempts to handle this by re-defining __le16/32/64
before pulling those headers into user space, but this is not
consistenly done: when ceph_fs.h is included via types.h, the
redefinition happens, but when ceph_fs.h is directly included,
the redefinition does not happen.

Fix this by performing the same redefinition directly *in* those
shared headers, when included by user space.

Note that the redefines where also in effect for rbd_types.h,
which is *not* shared with the kernel, so in the file I'm simply
replacing __le16/32/64 with ceph_le16/32/64 in-line.

Also note that it is now no longer possible to include any of
the three files using the redefined macros in C code (as they
make use of C++ features).  However, this currently happens in
exactly one file, src/mds/locks.c, which only uses a few CEPH_CAP_...
constants from the header. To fix this, I've simply duplicated
those definitions, which are unchangeable ABI constants anyway.

Fixes (partially): https://tracker.ceph.com/issues/41605

Signed-off-by: Ulrich Weigand <ulrich.weigand@de.ibm.com>
5 years agotest: remove useless ASSERT_XXX macros for rgw test 30062/head
Zhi Zhang [Thu, 5 Sep 2019 07:16:59 +0000 (15:16 +0800)]
test: remove useless ASSERT_XXX macros for rgw test

Signed-off-by: Zhi Zhang <zhangz.david@outlook.com>
5 years agoMerge pull request #29981 from falcon78921/wip-ceph-conf-usage
Kefu Chai [Thu, 5 Sep 2019 03:46:27 +0000 (11:46 +0800)]
Merge pull request #29981 from falcon78921/wip-ceph-conf-usage

ceph-conf: added --show-config-value to usage

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agomgr/k8sevents: Initial ceph -> k8s events integration 29520/head
Paul Cuzner [Wed, 24 Jul 2019 03:23:21 +0000 (15:23 +1200)]
mgr/k8sevents: Initial ceph -> k8s events integration

Adds a mgr module to provide integration between
Ceph and the kubernetes events API within the rook-ceph
namespace. It provides several commands to view event
status including;

ceph k8sevents list .... show all k8s related events
ceph k8sevents ceph .... show events generated from this
                         module
ceph k8sevents status .. show status of the tracker threads
                         and counts of tracked events

Events sent to kubernetes are sourced from the
a) clog: ceph healtchecks and admin commands
b) explicit checks: hosts, pools and OSD states are checked
   every 'n' seconds

Signed-off-by: Paul Cuzner <pcuzner@redhat.com>
5 years agoceph-conf: added --show-config-value to ceph-conf usage 29981/head
James McClune [Thu, 29 Aug 2019 00:30:49 +0000 (20:30 -0400)]
ceph-conf: added --show-config-value to ceph-conf usage

--show-config-value is another way to lookup ceph.conf
values. Users may want to utilize --show-config-value instead of
--lookup because --show-config-value also shows global defaults.

Signed-off-by: James McClune <jmcclune@mcclunetechnologies.net>
5 years agodoc: Document network performance monitoring 28755/head
David Zafman [Wed, 4 Sep 2019 18:38:09 +0000 (18:38 +0000)]
doc: Document network performance monitoring

Signed-off-by: David Zafman <dzafman@redhat.com>
5 years agoMerge pull request #29847 from iotcg/mon_doc
Gregory Farnum [Wed, 4 Sep 2019 21:43:51 +0000 (14:43 -0700)]
Merge pull request #29847 from iotcg/mon_doc

doc: set ceph_perf_msgr_server arguments

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
5 years agoMerge pull request #30136 from yuvalif/build_docs_on_fedora30
Yuval Lifshitz [Wed, 4 Sep 2019 19:40:46 +0000 (22:40 +0300)]
Merge pull request #30136 from yuvalif/build_docs_on_fedora30

build-doc: allow building docs on fedora 30

5 years agoMerge pull request #26755 from cbodley/wip-rgw-bilog-complete
J. Eric Ivancich [Wed, 4 Sep 2019 17:19:01 +0000 (13:19 -0400)]
Merge pull request #26755 from cbodley/wip-rgw-bilog-complete

rgw multisite: avoid writing bilog entries on PREPARE and CANCEL

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
5 years agoosd doc mon mgr: To milliseconds for config value, user input and threshold out
David Zafman [Wed, 4 Sep 2019 17:13:32 +0000 (17:13 +0000)]
osd doc mon mgr: To milliseconds for config value, user input and threshold out

Signed-off-by: David Zafman <dzafman@redhat.com>
5 years agoMerge pull request #29692 from mkogan1/wip-rgw-37615
J. Eric Ivancich [Wed, 4 Sep 2019 17:12:55 +0000 (13:12 -0400)]
Merge pull request #29692 from mkogan1/wip-rgw-37615

rgw: fix cls_bucket_list_unordered() partial results

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
5 years agomgr/dashboard: Refactoring 29402/head
Stephan Müller [Tue, 30 Jul 2019 15:56:38 +0000 (17:56 +0200)]
mgr/dashboard: Refactoring

I came across a yoda case and a test case that didn't use 'done' while
using an async call.

Fixes: https://tracker.ceph.com/issues/40828
Signed-off-by: Stephan Müller <smueller@suse.com>
5 years agomgr/dashboard: Use onCancel on any modal event
Stephan Müller [Tue, 30 Jul 2019 15:55:53 +0000 (17:55 +0200)]
mgr/dashboard: Use onCancel on any modal event

The problem was, that if 'onCancel' was provided, it wasn't used in all
modal exit cases. Only for the close buttons (the X and the labeled
one), but not if you clicked outside the modal or hit escape.

'onCancel' is currently only used inside the user management form, where
the problem caused, that the submit button was not longer click able if
the modal was hidden through clicking outside of it or hitting escape.

Fixes: https://tracker.ceph.com/issues/40828
Signed-off-by: Stephan Müller <smueller@suse.com>
5 years agomgr/dashboard: Add tests for confirmation modal
Stephan Müller [Tue, 30 Jul 2019 15:55:04 +0000 (17:55 +0200)]
mgr/dashboard: Add tests for confirmation modal

Fixes: https://tracker.ceph.com/issues/40828
Signed-off-by: Stephan Müller <smueller@suse.com>
5 years agodoc: releases: 14.2.3 dashboard note 30145/head
Abhishek Lekshmanan [Wed, 4 Sep 2019 14:02:17 +0000 (16:02 +0200)]
doc: releases: 14.2.3 dashboard note

The comment unfortunately got buried in a resolved blog

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
5 years agoMerge pull request #29973 from theanalyst/doc/releases/14.2.3
Abhishek L [Wed, 4 Sep 2019 13:50:18 +0000 (15:50 +0200)]
Merge pull request #29973 from theanalyst/doc/releases/14.2.3

doc: release notes for v14.2.3 nautilus

Reviewed-By: Nathan Cutler <nculter@suse.com>
Reviewed-By: Neha Ojha <nojha@redhat.com>
Reviewed-By: Josh Durgin <jdurgin@redhat.com>
Reviewed-By: Lenz Grimmer <lgrimmer@suse.com>
5 years agodoc: add a final set of notable changes to 14.2.3 29973/head
Abhishek Lekshmanan [Wed, 4 Sep 2019 13:00:41 +0000 (15:00 +0200)]
doc: add a final set of notable changes to 14.2.3

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
5 years agobuild-doc: allow building docs on fedora 30 30136/head
Yuval Lifshitz [Wed, 4 Sep 2019 10:47:00 +0000 (13:47 +0300)]
build-doc: allow building docs on fedora 30

Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
5 years agomgr/DaemonServer: skip adjusting pgp_num when merging is in-progress 30139/head
xie xingguo [Tue, 3 Sep 2019 04:02:42 +0000 (12:02 +0800)]
mgr/DaemonServer: skip adjusting pgp_num when merging is in-progress

otherwise there is a possibility we might change the up set of the
merge participants and hence have to back off the merge process.
Also this will cause some other (racy) corner cases that are hard
to take care of.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
5 years agoMerge pull request #29882 from cyx1231st/wip-seastar-msgr-test-lossless-crimson
Kefu Chai [Wed, 4 Sep 2019 11:51:55 +0000 (19:51 +0800)]
Merge pull request #29882 from cyx1231st/wip-seastar-msgr-test-lossless-crimson

crimson/net: bug fixes from v2 failover tests

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #30075 from rhcs-dashboard/fix-41600-master
Lenz Grimmer [Wed, 4 Sep 2019 11:11:16 +0000 (11:11 +0000)]
Merge pull request #30075 from rhcs-dashboard/fix-41600-master

mgr/dashboard: change warn_explicit to warn

Reviewed-by: Sebastian Wagner <swagner@suse.com>
5 years agoMerge pull request #29929 from tspmelo/wip-ng-analytics
Lenz Grimmer [Wed, 4 Sep 2019 10:05:27 +0000 (10:05 +0000)]
Merge pull request #29929 from tspmelo/wip-ng-analytics

mgr/dashboard: Prevent angular of getting stuck during installation

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Kiefer Chang <kiefer.chang@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
5 years agoMerge pull request #29557 from Devp00l/wip-41166
Volker Theile [Wed, 4 Sep 2019 09:47:13 +0000 (11:47 +0200)]
Merge pull request #29557 from Devp00l/wip-41166

mgr/dashboard: Fix CephFS chart

Reviewed-by: Ni-Feng Chang <kiefer.chang@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
Reviewed-by: Patrick Seidensal <pseidensal@suse.com>
5 years agobluestore/allocator: Aging test for bluestore allocators. 22574/head
Adam Kupczyk [Fri, 15 Jun 2018 09:33:59 +0000 (11:33 +0200)]
bluestore/allocator: Aging test for bluestore allocators.

Tests performance and fragmentation for data accumulation
and storage capacity extension scenario.

Signed-off-by: Adam Kupczyk <akupczyk@redhat.com>