]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
5 years agomonitoring: add details to Prometheus' alerts 32803/head
Patrick Seidensal [Thu, 23 Jan 2020 11:52:24 +0000 (12:52 +0100)]
monitoring: add details to Prometheus' alerts

Fixes: https://tracker.ceph.com/issues/43764
Signed-off-by: Patrick Seidensal <pseidensal@suse.com>
5 years agoMerge pull request #31356 from xxcs/xxcs06
Casey Bodley [Wed, 22 Jan 2020 15:28:13 +0000 (10:28 -0500)]
Merge pull request #31356 from xxcs/xxcs06

rgw: Incorrectly calling ceph::buffer::list::decode_base64 in bucket policy

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
5 years agoMerge pull request #31355 from zhangsw/fix-rgw-reshard-max-entries
Casey Bodley [Wed, 22 Jan 2020 15:27:43 +0000 (10:27 -0500)]
Merge pull request #31355 from zhangsw/fix-rgw-reshard-max-entries

rgw: reshard list may return more than specified max_entries.

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #31344 from zhangsw/fix-rgw-reshard-lock-failed
Casey Bodley [Wed, 22 Jan 2020 15:27:18 +0000 (10:27 -0500)]
Merge pull request #31344 from zhangsw/fix-rgw-reshard-lock-failed

rgw: return error if lock log shard fails

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #31239 from joke-lee/rgw-modify-zone-placement
Casey Bodley [Wed, 22 Jan 2020 15:26:51 +0000 (10:26 -0500)]
Merge pull request #31239 from joke-lee/rgw-modify-zone-placement

rgw: radosgw-admin zone placement rm and radosgw-admin zonegroup placement rm support --storage-class

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #31591 from liuchang0812/current-version-in-rgw-user-info
Casey Bodley [Wed, 22 Jan 2020 15:26:26 +0000 (10:26 -0500)]
Merge pull request #31591 from liuchang0812/current-version-in-rgw-user-info

rgw: fix RGWUserInfo decode current version

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
5 years agoMerge PR #30636 into master
Sage Weil [Wed, 22 Jan 2020 14:30:20 +0000 (08:30 -0600)]
Merge PR #30636 into master

* refs/pull/30636/head:
common: Fix multiple logical errors in get_device_id.

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge PR #32732 into master
Sage Weil [Wed, 22 Jan 2020 14:30:02 +0000 (08:30 -0600)]
Merge PR #32732 into master

* refs/pull/32732/head:
msg/async: use dedicated method for clearing conn's priv up.
msg/async: mark down local_connection before draining the stack.

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge PR #32726 into master
Sage Weil [Wed, 22 Jan 2020 14:23:36 +0000 (08:23 -0600)]
Merge PR #32726 into master

* refs/pull/32726/head:
mon/ConfigMonitor: clean out bad config records
mon/ConfigMonitor: make 'config get' on fsid work
common/options: remove NO_MON_UPDATE from mon_dns_srv_name
mon/ConfigMonitor: do not 'config get' on NO_MON_UPDATE options
mon/ConfigMonitor: do not set NO_MON_UPDATE values

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
5 years agoMerge pull request #32699 from tspmelo/wip-npm-audit-fix
Laura Paduano [Wed, 22 Jan 2020 13:44:25 +0000 (14:44 +0100)]
Merge pull request #32699 from tspmelo/wip-npm-audit-fix

mgr/dashboard: Fix npm vulnerabilities

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
5 years agoMerge pull request #32653 from votdev/issue_43603_clone_role
Laura Paduano [Wed, 22 Jan 2020 13:28:09 +0000 (14:28 +0100)]
Merge pull request #32653 from votdev/issue_43603_clone_role

mgr/dashboard: Clone an existing user role

Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
5 years agoMerge pull request #32648 from p-se/wip-pse-cd-api-err-msg
Laura Paduano [Wed, 22 Jan 2020 13:24:26 +0000 (14:24 +0100)]
Merge pull request #32648 from p-se/wip-pse-cd-api-err-msg

mgr/dashboard: monitoring: improve generic "Could not reach external API" message

Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
5 years agoMerge PR #32765 into master
Sage Weil [Wed, 22 Jan 2020 13:15:24 +0000 (07:15 -0600)]
Merge PR #32765 into master

* refs/pull/32765/head:
unittest_lockdep: avoid any threads for death test

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #32728 from rishabh-d-dave/doc-teuth-broken-links
Kefu Chai [Wed, 22 Jan 2020 07:56:44 +0000 (15:56 +0800)]
Merge pull request #32728 from rishabh-d-dave/doc-teuth-broken-links

doc: fix links in developer_guide

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #32703 from s0nea/wip-dashboard-pwd-expiration-field
Laura Paduano [Wed, 22 Jan 2020 07:25:45 +0000 (08:25 +0100)]
Merge pull request #32703 from s0nea/wip-dashboard-pwd-expiration-field

mgr/dashboard: fix visibility of pwdExpirationDate field

Reviewed-by: Volker Theile <vtheile@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
5 years agoMerge pull request #32683 from liewegas/wip-variable-pg-log
Kefu Chai [Wed, 22 Jan 2020 05:04:57 +0000 (13:04 +0800)]
Merge pull request #32683 from liewegas/wip-variable-pg-log

osd: trim pg logs based on a per-osd budget

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
5 years agoMerge pull request #32770 from tchaikov/wip-gtest-skip
Kefu Chai [Wed, 22 Jan 2020 04:57:49 +0000 (12:57 +0800)]
Merge pull request #32770 from tchaikov/wip-gtest-skip

test/librados: use GTEST_SKIP() to skip test

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge PR #31719 into master
Patrick Donnelly [Wed, 22 Jan 2020 04:01:37 +0000 (20:01 -0800)]
Merge PR #31719 into master

* refs/pull/31719/head:
mds: Reorganize class members in Server header

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge PR #31232 into master
Patrick Donnelly [Wed, 22 Jan 2020 04:00:43 +0000 (20:00 -0800)]
Merge PR #31232 into master

* refs/pull/31232/head:
test: test case for openfiletable MAX_ITEMS_PER_OBJ value verification
mds/OpenFileTable: match MAX_ITEMS_PER_OBJ to osd_deep_scrub_large_omap_object_key_threshold

Reviewed-by: Zheng Yan <zyan@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge PR #31817 into master
Patrick Donnelly [Wed, 22 Jan 2020 03:57:26 +0000 (19:57 -0800)]
Merge PR #31817 into master

* refs/pull/31817/head:
mds: send delegated_inos in openc response
mds: make take_ino just return 0 if it can't find one
mds: add infrastructure for delegating inos from the prealloc set
mds: fix dump of prealloc and used inos
mds: don't warn when inodes are not allocated out sequentially
mds: fix decoding version for EMetaBlob
mds: remove MDRequestImpl::did_ino_allocation()
mds: add a comment explaining what session_info_t is
doc: fix awkward phrasing in caching.txt

Reviewed-by: Zheng Yan <zyan@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge PR #32326 into master
Patrick Donnelly [Wed, 22 Jan 2020 03:55:39 +0000 (19:55 -0800)]
Merge PR #32326 into master

* refs/pull/32326/head:
mds: Reorganize class members in SnapClient header

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge PR #32706 into master
Patrick Donnelly [Wed, 22 Jan 2020 03:54:54 +0000 (19:54 -0800)]
Merge PR #32706 into master

* refs/pull/32706/head:
mount.ceph: remove arbitrary limit on size of name= option

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
5 years agotest/librados: use GTEST_SKIP() to skip test 32770/head
Kefu Chai [Wed, 22 Jan 2020 02:49:00 +0000 (10:49 +0800)]
test/librados: use GTEST_SKIP() to skip test

the output would look like

```
[  SKIPPED ] SkipTest.DoesSkip (0 ms)
```

easier for tester/developer to review the test result.

Signed-off-by: Kefu Chai <kchai@redhat.com>
5 years agoosd/PeeringState: maximize log entries sent during backfill 32683/head
Sage Weil [Thu, 16 Jan 2020 22:11:07 +0000 (16:11 -0600)]
osd/PeeringState: maximize log entries sent during backfill

Send as much log as we can during backfill so that dup op detection works
as well as it can.

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoosd/PeeringState: always use target pg log length
Sage Weil [Thu, 16 Jan 2020 22:10:33 +0000 (16:10 -0600)]
osd/PeeringState: always use target pg log length

Previously, the min and max log length was the same, so we didn't adjust
our log length based on whether we were degraded.  Preserve that behavior
by removing the degraded check entirely.  This keeps memory usage
consistent when recovery happens.

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoosd: trim pg logs based on a per-osd budget
Sage Weil [Thu, 16 Jan 2020 17:22:34 +0000 (11:22 -0600)]
osd: trim pg logs based on a per-osd budget

Set the default budget based on the current defaults: 3000 per osd, and a
rule of thumb target of 100 PGs per OSD.  Set the per-PG trim target
by dividing the overall value by the number of PGs on the OSD.

Increase the max pg log length alone, so if the OSD has <100 PGs,
those PGs will get more entries.  Reduce the minimum to be smaller than
the max.  Use the min/max config options to bracket what is allocated to
a single PG.

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agocrimson/osd: drop unused member variable
Kefu Chai [Mon, 20 Jan 2020 10:27:22 +0000 (18:27 +0800)]
crimson/osd: drop unused member variable

Signed-off-by: Kefu Chai <kchai@redhat.com>
5 years agocrimson/osd: track number of pgs in shard_services
Kefu Chai [Mon, 20 Jan 2020 10:26:10 +0000 (18:26 +0800)]
crimson/osd: track number of pgs in shard_services

pg will be using it for evaluating the number pg log entries to keep for
each PG

Signed-off-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge PR #32522 into master
Patrick Donnelly [Tue, 21 Jan 2020 23:15:12 +0000 (15:15 -0800)]
Merge PR #32522 into master

* refs/pull/32522/head:
doc/cephfs: improve wording in mount-prerequisites.rst
doc: migrate best practices recommendations to relevant docs
doc/cephfs: rename doc/cephfs/kernel.rst & doc/cephfs/fuse.rst

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge PR #32763 into master
Patrick Donnelly [Tue, 21 Jan 2020 23:08:49 +0000 (15:08 -0800)]
Merge PR #32763 into master

* refs/pull/32763/head:
qa: build v5.4 kernel

Reviewed-by: Jeff Layton <jlayton@redhat.com>
5 years agoMerge PR #32762 into master
Patrick Donnelly [Tue, 21 Jan 2020 21:32:38 +0000 (13:32 -0800)]
Merge PR #32762 into master

* refs/pull/32762/head:
doc/cephfs/client-auth: description and example are inconsistent

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge PR #32739 into master
Patrick Donnelly [Tue, 21 Jan 2020 21:28:34 +0000 (13:28 -0800)]
Merge PR #32739 into master

* refs/pull/32739/head:
qa: log warning on scrub error

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agounittest_lockdep: avoid any threads for death test 32765/head
Sage Weil [Tue, 21 Jan 2020 21:17:19 +0000 (15:17 -0600)]
unittest_lockdep: avoid any threads for death test

Heed the warning:

[WARNING] /home/sage/src/ceph/src/googletest/googletest/src/gtest-death-test.cc:1122:: Death tests use fork(), which is unsafe particularly in a threaded context. For this test, Google Test detected 4 threads. See https://github.com/google/googletest/blob/master/googletest/docs/advanced.md#death-tests-and-threads for more explanation and suggested solutions, especially if this is the last message you see before your test times out.

Fixes: https://tracker.ceph.com/issues/43403
Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoqa: build v5.4 kernel 32763/head
Patrick Donnelly [Tue, 21 Jan 2020 18:56:18 +0000 (10:56 -0800)]
qa: build v5.4 kernel

CentOS8 userspace cannot build v4.17 kernel anymore. See also [1].

[1] https://lkml.org/lkml/2019/4/23/517

Fixes: https://tracker.ceph.com/issues/43719
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge pull request #32761 from alimaredia/wip-rgw-verify-os-version-8.0
Ali Maredia [Tue, 21 Jan 2020 20:19:58 +0000 (15:19 -0500)]
Merge pull request #32761 from alimaredia/wip-rgw-verify-os-version-8.0

qa: pin rgw/verify to 8.0

5 years agodoc/cephfs/client-auth: description and example are inconsistent 32762/head
Ilya Dryomov [Tue, 21 Jan 2020 18:41:47 +0000 (19:41 +0100)]
doc/cephfs/client-auth: description and example are inconsistent

According to the path restriction example, the filesystem name
should be cephfs_a, not cephfs.  Converge on cephfs_a to avoid it
being confused with with the pool tag, which is always cephfs.

This was introduced in 160c4bfeb811 ("mon/AuthMonitor: Use new osd
auth caps for ceph fs authorize").

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
5 years agoqa: pin rgw/verify to 8.0 32761/head
Ali Maredia [Tue, 21 Jan 2020 18:02:42 +0000 (13:02 -0500)]
qa: pin rgw/verify to 8.0

Signed-off-by: Ali Maredia <amaredia@redhat.com>
5 years agomgr/dashboard: Update nodejs to v10.18.1 32699/head
Tiago Melo [Mon, 20 Jan 2020 17:59:55 +0000 (16:59 -0100)]
mgr/dashboard: Update nodejs to v10.18.1

This will fix some problems that showed up after updating some npm packages.

Signed-off-by: Tiago Melo <tmelo@suse.com>
5 years agomgr/dashboard: Fix npm vulnerabilities
Tiago Melo [Wed, 18 Dec 2019 15:45:07 +0000 (14:45 -0100)]
mgr/dashboard: Fix npm vulnerabilities

Add npm-force-resolutions to help fix npm vulnerabilities.

When you need to force a package to be updated,
add it to the resolutions lists in package.json and run "npm run fix:audit".

This will update package-lock.json and all next "npm ci" will contain the
specified version of the package.

Signed-off-by: Tiago Melo <tmelo@suse.com>
5 years agoMerge PR #32748 into master
Patrick Donnelly [Tue, 21 Jan 2020 16:54:58 +0000 (08:54 -0800)]
Merge PR #32748 into master

* refs/pull/32748/head:
doc: minor fix in mount.ceph

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge pull request #32751 from tchaikov/wip-readme-cmake
Kefu Chai [Tue, 21 Jan 2020 16:17:47 +0000 (00:17 +0800)]
Merge pull request #32751 from tchaikov/wip-readme-cmake

README.md: remove stale cmake prerequisite

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-By: Casey Bodley <cbodley@redhat.com>
5 years agoREADME.md: remove stale cmake prerequisite 32751/head
Kefu Chai [Tue, 21 Jan 2020 15:56:12 +0000 (23:56 +0800)]
README.md: remove stale cmake prerequisite

it's stale. as we now require 3.10 after dropping the support of xenial.

and it's incomplete, we have a ton of build dependencies apart from
cmake.

Signed-off-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #32655 from jan--f/c-v-mock-has_bluestore_label
Jan Fajerski [Tue, 21 Jan 2020 15:34:42 +0000 (16:34 +0100)]
Merge pull request #32655 from jan--f/c-v-mock-has_bluestore_label

ceph-volume: fix device unittest, mock has_bluestore_label

5 years agoMerge PR #32738 into master
Sage Weil [Tue, 21 Jan 2020 15:18:49 +0000 (09:18 -0600)]
Merge PR #32738 into master

* refs/pull/32738/head:
qa/standalone/misc/ok-to-stop: improve test
qa/standalone/ceph-helpers: add wait_for_peered

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
5 years agoMerge pull request #32740 from cbodley/wip-rgw-doc-s3-extension-url
Casey Bodley [Tue, 21 Jan 2020 14:38:56 +0000 (09:38 -0500)]
Merge pull request #32740 from cbodley/wip-rgw-doc-s3-extension-url

doc/rgw: fix broken link to boto s3 extensions document

Reviewed-by: Yuval Lifshitz <yuvalif@yahoo.com>
5 years agoMerge pull request #32742 from tchaikov/wip-crimson-thread-pool
Kefu Chai [Tue, 21 Jan 2020 14:32:12 +0000 (22:32 +0800)]
Merge pull request #32742 from tchaikov/wip-crimson-thread-pool

crimson/thread: generalize Task so it works w/ func returns void

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
5 years agoceph-volume: fix device unittest, mock has_bluestore_label, lint 32655/head
Jan Fajerski [Wed, 15 Jan 2020 14:55:45 +0000 (15:55 +0100)]
ceph-volume: fix device unittest, mock has_bluestore_label, lint

This also adds a test case for has_bluestore_label.

Fixes: https://tracker.ceph.com/issues/43611
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
5 years agodoc: minor fix in mount.ceph 32748/head
Rishabh Dave [Tue, 21 Jan 2020 14:10:22 +0000 (19:40 +0530)]
doc: minor fix in mount.ceph

Also, fix the indentation since we are already here.

Fixes: https://tracker.ceph.com/issues/43743
Signed-off-by: Rishabh Dave <ridave@redhat.com>
5 years agomgr/dashboard: Clone an existing user role 32653/head
Volker Theile [Wed, 15 Jan 2020 09:07:58 +0000 (10:07 +0100)]
mgr/dashboard: Clone an existing user role

Fixes: https://tracker.ceph.com/issues/43603
Signed-off-by: Volker Theile <vtheile@suse.com>
5 years agocrimson/thread: generalize Task so it works w/ func returns void 32742/head
Kefu Chai [Tue, 21 Jan 2020 04:58:16 +0000 (12:58 +0800)]
crimson/thread: generalize Task so it works w/ func returns void

Signed-off-by: Kefu Chai <kchai@redhat.com>
5 years agomgr/dashboard: fix visibility of pwdExpirationDate field 32703/head
Tatjana Dehler [Fri, 17 Jan 2020 14:54:05 +0000 (15:54 +0100)]
mgr/dashboard: fix visibility of pwdExpirationDate field

Show the 'pwdExpirationDate' form field only if SSO is not enabled.
Also show a helper message if 'pwdExpirationSpan' is '0' to let
the admin know that the password will only expire once.

Fixes: https://tracker.ceph.com/issues/43523
Signed-off-by: Tatjana Dehler <tdehler@suse.com>
5 years agomgr/dashboard: Fix modals for Identifying Device and Editing O… (#32589)
Lenz Grimmer [Tue, 21 Jan 2020 11:29:02 +0000 (11:29 +0000)]
mgr/dashboard: Fix modals for Identifying Device and Editing O… (#32589)

mgr/dashboard: Fix modals for Identifying Device and Editing OSD

Reviewed-by: Kiefer Chang <kiefer.chang@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
5 years agomgr/dashboard: Introduce layout components (#32594)
Lenz Grimmer [Tue, 21 Jan 2020 11:26:40 +0000 (11:26 +0000)]
mgr/dashboard: Introduce layout components (#32594)

mgr/dashboard: Introduce layout components

Reviewed-by: Sebastian Krah <skrah@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
5 years agodoc/cephfs: improve wording in mount-prerequisites.rst 32522/head
Rishabh Dave [Wed, 15 Jan 2020 11:35:36 +0000 (17:05 +0530)]
doc/cephfs: improve wording in mount-prerequisites.rst

Signed-off-by: Rishabh Dave <ridave@redhat.com>
5 years agodoc: migrate best practices recommendations to relevant docs
Rishabh Dave [Tue, 7 Jan 2020 10:59:51 +0000 (16:29 +0530)]
doc: migrate best practices recommendations to relevant docs

Also, move the common part from "Mount using FUSE" doc and "Mount using
kernel" doc to "Mount CephFS" page to avoid repetitions.

Fixes: https://tracker.ceph.com/issues/43154
Signed-off-by: Rishabh Dave <ridave@redhat.com>
5 years agoMerge PR #32725 into master
Sage Weil [Tue, 21 Jan 2020 04:20:25 +0000 (22:20 -0600)]
Merge PR #32725 into master

* refs/pull/32725/head:
qa/tasks/ceph_manager: fix revive_osd path
qa/tasks/ceph_manager: fix shell osd for ceph-objectstore-tool commands

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
5 years agoMerge PR #32737 into master
Sage Weil [Tue, 21 Jan 2020 04:20:10 +0000 (22:20 -0600)]
Merge PR #32737 into master

* refs/pull/32737/head:
qa/tasks/ceph_manager: fix post-osd-kill pg peered check

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
5 years agoMerge PR #32631 into master
Patrick Donnelly [Tue, 21 Jan 2020 01:40:05 +0000 (17:40 -0800)]
Merge PR #32631 into master

* refs/pull/32631/head:
doc: add mds map to list of monitor assets

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge PR #32642 into master
Patrick Donnelly [Tue, 21 Jan 2020 01:29:57 +0000 (17:29 -0800)]
Merge PR #32642 into master

* refs/pull/32642/head:
qa: save MDS epoch barrier
qa: prefer rank_asok

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge PR #32667 into master
Patrick Donnelly [Tue, 21 Jan 2020 01:24:46 +0000 (17:24 -0800)]
Merge PR #32667 into master

* refs/pull/32667/head:
mds: track high water mark for purges
qa: use correct variable for exception debug
mds: mark purge queue protected members private

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoqa: save MDS epoch barrier 32642/head
Patrick Donnelly [Wed, 15 Jan 2020 00:10:53 +0000 (16:10 -0800)]
qa: save MDS epoch barrier

Rather than verify the latest OSDMap is the same as the rank's
osdmap_epoch_barrier, just use the rank's version. The OSDMap may change
out-of-band with the test startup and thus the epoch's would diverge.
The file system and rank is fresh for each test so there's no reason to
care if the MDS barrier is one epoch behind the latest.

Fixes: https://tracker.ceph.com/issues/43554
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoqa: prefer rank_asok
Patrick Donnelly [Wed, 15 Jan 2020 00:10:34 +0000 (16:10 -0800)]
qa: prefer rank_asok

This is a trivial refactor.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge pull request #32629 from tchaikov/wip-cephfs.pyx
Kefu Chai [Tue, 21 Jan 2020 01:11:56 +0000 (09:11 +0800)]
Merge pull request #32629 from tchaikov/wip-cephfs.pyx

libcephfs: add missing declaration of ceph_getaddrs()

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agomds: track high water mark for purges 32667/head
Patrick Donnelly [Wed, 15 Jan 2020 23:59:01 +0000 (15:59 -0800)]
mds: track high water mark for purges

This makes the corresponding test not racy.

Fixes: https://tracker.ceph.com/issues/16881
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoqa: use correct variable for exception debug
Patrick Donnelly [Wed, 15 Jan 2020 23:56:24 +0000 (15:56 -0800)]
qa: use correct variable for exception debug

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agomds: mark purge queue protected members private
Patrick Donnelly [Wed, 15 Jan 2020 23:52:50 +0000 (15:52 -0800)]
mds: mark purge queue protected members private

Nothing inherits from PQ.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agomount.ceph: remove arbitrary limit on size of name= option 32706/head
Jeff Layton [Fri, 17 Jan 2020 12:48:12 +0000 (07:48 -0500)]
mount.ceph: remove arbitrary limit on size of name= option

Aaron was getting back -ERANGE errors when trying to mount using
a long name= option. The issue is that the destination buffer for the
"key=" string is not big enough to hold long names.

When I overhauled the mount.ceph code recently, I made this buffer much
smaller than before figuring that it didn't need to be any larger than
the length of "secret=<base64 encoded key>".

In the case where the secret is set in the keyring though, this buffer
needs to be able to hold a string like "key=client.<cephx name>". The
cephx name can be of arbitrary length, however.

Rework the code to just safe_cat the strings directly into the options
buffer, eliminating an extra copy and the need for an arbitrary limit.
This also allows us to remove get_secret_option() from the the common
code as well.

Fixes: https://tracker.ceph.com/issues/43649
Reported-by: Aaron <aarongmldt@gmail.com>
Signed-off-by: Jeff Layton <jlayton@redhat.com>
5 years agodoc/rgw: fix broken link to boto s3 extensions document 32740/head
Casey Bodley [Mon, 20 Jan 2020 21:46:51 +0000 (16:46 -0500)]
doc/rgw: fix broken link to boto s3 extensions document

Signed-off-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #32652 from rhcs-dashboard/fix-43607-master
Laura Paduano [Mon, 20 Jan 2020 20:37:05 +0000 (21:37 +0100)]
Merge pull request #32652 from rhcs-dashboard/fix-43607-master

mgr/dashboard: fix improper URL checking

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Ricardo Dias <rdias@suse.com>
5 years agoqa/standalone/misc/ok-to-stop: improve test 32738/head
Sage Weil [Mon, 20 Jan 2020 19:24:12 +0000 (13:24 -0600)]
qa/standalone/misc/ok-to-stop: improve test

Make sure PGs peer (simply flushing state to mon isn't enough).

Fixes: https://tracker.ceph.com/issues/43721
Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoqa: log warning on scrub error 32739/head
Patrick Donnelly [Mon, 20 Jan 2020 19:23:09 +0000 (11:23 -0800)]
qa: log warning on scrub error

Instead of printing the (useless) traceback, just print a warning about
ignoring the failure. The traceback makes it harder to search for the
real problem in the teuthology log.

Fixes: https://tracker.ceph.com/issues/43718
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoqa/standalone/ceph-helpers: add wait_for_peered
Sage Weil [Mon, 20 Jan 2020 19:23:56 +0000 (13:23 -0600)]
qa/standalone/ceph-helpers: add wait_for_peered

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoMerge PR #32524 into master
Patrick Donnelly [Mon, 20 Jan 2020 19:13:06 +0000 (11:13 -0800)]
Merge PR #32524 into master

* refs/pull/32524/head:
qa/xfstests_dev: change deps for xfstests-dev on ubuntu
qa/cephfs: change deps for xfstests-dev on centos8
vstart_runnner: add sh method to LocalRemote

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agomon/ConfigMonitor: clean out bad config records 32726/head
Sage Weil [Mon, 20 Jan 2020 19:11:05 +0000 (13:11 -0600)]
mon/ConfigMonitor: clean out bad config records

If we encounter an invalid config key in the database, clean it out instead
of ignoring it forever.

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agomon/ConfigMonitor: make 'config get' on fsid work
Sage Weil [Sun, 19 Jan 2020 21:21:13 +0000 (15:21 -0600)]
mon/ConfigMonitor: make 'config get' on fsid work

This duplicates 'ceph fsid' command, but allow this for consistency.

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agocommon/options: remove NO_MON_UPDATE from mon_dns_srv_name
Sage Weil [Sun, 19 Jan 2020 21:20:00 +0000 (15:20 -0600)]
common/options: remove NO_MON_UPDATE from mon_dns_srv_name

It's nice to store this in the mon config so that it is part of a
generated minimal conf.

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agomon/ConfigMonitor: do not 'config get' on NO_MON_UPDATE options
Sage Weil [Sun, 19 Jan 2020 21:17:46 +0000 (15:17 -0600)]
mon/ConfigMonitor: do not 'config get' on NO_MON_UPDATE options

We shouldn't be storing these, so don't fetch them either.

Fixes: https://tracker.ceph.com/issues/42820
Signed-off-by: Sage Weil <sage@redhat.com>
5 years agomon/ConfigMonitor: do not set NO_MON_UPDATE values
Sage Weil [Sun, 19 Jan 2020 21:06:45 +0000 (15:06 -0600)]
mon/ConfigMonitor: do not set NO_MON_UPDATE values

These options are special.  Since we can't get the values from the mon,
we also shouldn't store them there.  Most of them are not options that
can be changed anyway.

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoMerge PR #32637 into master
Patrick Donnelly [Mon, 20 Jan 2020 19:11:56 +0000 (11:11 -0800)]
Merge PR #32637 into master

* refs/pull/32637/head:
client: Add is_dir check before changing directory

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>
5 years agoMerge PR #32676 into master
Patrick Donnelly [Mon, 20 Jan 2020 19:10:49 +0000 (11:10 -0800)]
Merge PR #32676 into master

* refs/pull/32676/head:
mds: don't respond getattr with -EROFS when mds is readonly

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge PR #32639 into master
Patrick Donnelly [Mon, 20 Jan 2020 19:08:47 +0000 (11:08 -0800)]
Merge PR #32639 into master

* refs/pull/32639/head:
qa: rename kcephfs distro overrides

Reviewed-by: Rishabh Dave <ridave@redhat.com>
5 years agoMerge PR #32696 into master
Patrick Donnelly [Mon, 20 Jan 2020 19:07:55 +0000 (11:07 -0800)]
Merge PR #32696 into master

* refs/pull/32696/head:
mgr/volumes: fail removing subvolume with snapshots

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge PR #32645 into master
Patrick Donnelly [Mon, 20 Jan 2020 18:43:26 +0000 (10:43 -0800)]
Merge PR #32645 into master

* refs/pull/32645/head:
mgr/volumes: remove stale subvolume module

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge PR #32659 into master
Patrick Donnelly [Mon, 20 Jan 2020 18:41:23 +0000 (10:41 -0800)]
Merge PR #32659 into master

* refs/pull/32659/head:
mds: do not include metric_spec in MClientSession from MDS

Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Sidharth Anupkrishnan <sanupkri@redhat.com>
5 years agoMerge PR #32709 into master
Sage Weil [Mon, 20 Jan 2020 17:47:28 +0000 (11:47 -0600)]
Merge PR #32709 into master

* refs/pull/32709/head:
mds/FSMap: fix adjust_standby_fscid

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge pull request #32727 from liewegas/fix-rgw-os
Ali Maredia [Mon, 20 Jan 2020 17:35:41 +0000 (12:35 -0500)]
Merge pull request #32727 from liewegas/fix-rgw-os

qa/suite/rgw/verify: valgrind on centos again!

5 years agoqa/tasks/ceph_manager: fix revive_osd path 32725/head
Sage Weil [Mon, 20 Jan 2020 17:23:13 +0000 (11:23 -0600)]
qa/tasks/ceph_manager: fix revive_osd path

This was broken since it was introduced in b02e2f6cf2feb2711d4c867bf08c914b85715bb6
a year and a half ago...

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoMerge PR #32668 into master
Patrick Donnelly [Mon, 20 Jan 2020 17:15:32 +0000 (09:15 -0800)]
Merge PR #32668 into master

* refs/pull/32668/head:
qa: ignore slow ops for ffsb workunit

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge pull request #32723 from yuvalif/wip-yuval-notif-add-opaque-data
Casey Bodley [Mon, 20 Jan 2020 16:33:50 +0000 (11:33 -0500)]
Merge pull request #32723 from yuvalif/wip-yuval-notif-add-opaque-data

rgw/notification: add opaque data

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
5 years agoqa/tasks/ceph_manager: fix post-osd-kill pg peered check 32737/head
Sage Weil [Mon, 20 Jan 2020 15:45:00 +0000 (09:45 -0600)]
qa/tasks/ceph_manager: fix post-osd-kill pg peered check

This was asserting that all PGs are active or peered, but that assertion
could fail if the concurrent workload created a new pool.

Switch to a loop that checks several times for the condition to be true.

Fixes: https://tracker.ceph.com/issues/43656
Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoMerge pull request #32565 from rhcs-dashboard/43534-decouple-backend-unit-tests
Lenz Grimmer [Mon, 20 Jan 2020 14:54:42 +0000 (14:54 +0000)]
Merge pull request #32565 from rhcs-dashboard/43534-decouple-backend-unit-tests

mgr/dashboard: decouple backend unit tests from build.

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
5 years agoMerge PR #32592 into master
Sage Weil [Mon, 20 Jan 2020 14:41:12 +0000 (08:41 -0600)]
Merge PR #32592 into master

* refs/pull/32592/head:
mgr/pg_autoscaler: calculate pool_pg_target using pool size

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agomgr/dashboard: Update npm package caniuse-lite (#32633)
Lenz Grimmer [Mon, 20 Jan 2020 14:25:48 +0000 (14:25 +0000)]
mgr/dashboard: Update npm package caniuse-lite (#32633)

mgr/dashboard: Update npm package caniuse-lite

Reviewed-by: Tiago Melo <tmelo@suse.com>
5 years agoMerge pull request #32702 from rzarzynski/wip-bug-43646
Kefu Chai [Mon, 20 Jan 2020 12:33:48 +0000 (20:33 +0800)]
Merge pull request #32702 from rzarzynski/wip-bug-43646

common/bl: fix the dangling last_p issue.

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agomsg/async: use dedicated method for clearing conn's priv up. 32732/head
Radoslaw Zarzynski [Mon, 20 Jan 2020 11:18:29 +0000 (12:18 +0100)]
msg/async: use dedicated method for clearing conn's priv up.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
5 years agomsg/async: mark down local_connection before draining the stack.
Radoslaw Zarzynski [Fri, 17 Jan 2020 19:58:00 +0000 (20:58 +0100)]
msg/async: mark down local_connection before draining the stack.

`AsyncMessenger` has `local_connection` – an instance of
`AsyncConnection` used to send messages to itself (loop back).
Connections are handled by `EventCenter` in its dedicated
thread. When shutting down a messenger, it must be ensured
there is no task left in the `EventCenter`'s queue. Otherwise
a use-after-free can happen. That's the reason why `shutdown()`
of `AsyncMessenger` does `mark_down_all()` on connections
**before** draining the stack. The latter actually injects a task
into all `EventCenter` instances and waits for its completion
(synchronization barrier).

However, that's not the case for `local_connection`. Without
the patch it's marked down by the messenger's destructor
far **after** the synchronization barrier. This behavior is
dangerous when an implementation of `mark_down()` creates
a new task to be executed inside the boundaries of corresponding
`EventCenter` instance.

The fix unifies handling of `local_connection` with other
connections in the aspect of the shutdown phase.

Fixes: https://tracker.ceph.com/issues/43667
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
5 years agoMerge pull request #32325 from Kriechi/fix-42982
Jan Fajerski [Mon, 20 Jan 2020 09:42:36 +0000 (10:42 +0100)]
Merge pull request #32325 from Kriechi/fix-42982

monitoring: fix prometheus alert for full pools

5 years agomgr/dashboard: Cleanup router config 32594/head
Volker Theile [Fri, 17 Jan 2020 12:03:34 +0000 (13:03 +0100)]
mgr/dashboard: Cleanup router config

Now that a parent component takes care about the rendering of the workbench, then this componenta can also take care about the authentication check.

Signed-off-by: Volker Theile <vtheile@suse.com>
5 years agomgr/dashboard: Introduce layout components
Volker Theile [Mon, 13 Jan 2020 09:06:25 +0000 (10:06 +0100)]
mgr/dashboard: Introduce layout components

This PR will simplify the code of the app component in that way that it introduces layout components. Depending on the route a specific layout is choosen. Currently there are two layouts:

- Workbench
- Blank

The blank layout, which does not show any navigation controls, is used for the error, login and logout pages. The workbench layout shows the navigation controls and is mainly used for all pages that are used to configure Ceph.

The 403 and 404 pages have a 'Back' button that will redirect to /login. The Angular router will redirect to /dashboard if logged in.

Fixes: https://tracker.ceph.com/issues/43565
Signed-off-by: Volker Theile <vtheile@suse.com>
5 years agodoc: fix links in developer_guide 32728/head
Rishabh Dave [Mon, 20 Jan 2020 06:03:48 +0000 (11:33 +0530)]
doc: fix links in developer_guide

Fixes: https://tracker.ceph.com/issues/43663
Signed-off-by: Rishabh Dave <ridave@redhat.com>