]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
6 years agodoc/rados/configuration: refresh osdmap section 26373/head
Ilya Dryomov [Thu, 24 Jan 2019 20:07:09 +0000 (21:07 +0100)]
doc/rados/configuration: refresh osdmap section

"osd map cache size" and "osd map message max" were reduced in commit
855955e58e63 ("osd: reduce size of osdmap cache, messages").

"osd map cache bl size" and "osd map cache bl inc size" were removed
six years ago.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit ae88c63d0441b1dffcc1dc469f4693dc909650bf)

6 years agoMerge pull request #26288 from neha-ojha/wip-wl-slow-mimic
Yuri Weinstein [Mon, 11 Feb 2019 21:09:08 +0000 (13:09 -0800)]
Merge pull request #26288 from neha-ojha/wip-wl-slow-mimic

mimic: qa/tasks/thrashosds-health.yaml: whitelist "slow request"

Reviewed-by: Yuri Weinstein <yweinste@redhat.com>
6 years agoMerge pull request #26291 from pdvian/wip-38187-mimic
Yuri Weinstein [Mon, 11 Feb 2019 21:08:25 +0000 (13:08 -0800)]
Merge pull request #26291 from pdvian/wip-38187-mimic

mimic: deep fsck fails on inspecting very large onodes

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Igor Fedotov <ifedotov@suse.com>
6 years agoMerge pull request #26324 from smithfarm/wip-38111-mimic
Yuri Weinstein [Mon, 11 Feb 2019 21:07:27 +0000 (13:07 -0800)]
Merge pull request #26324 from smithfarm/wip-38111-mimic

mimic: osd: force-backfill sets forced_recovery instead of forced_backfill in 13.2.1

Reviewed-by: David Zafman <dzafman@redhat.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
6 years agoMerge pull request #26329 from dzafman/wip-37393
David Zafman [Fri, 8 Feb 2019 16:50:18 +0000 (08:50 -0800)]
Merge pull request #26329 from dzafman/wip-37393

mimic: osd-backfill-stats.sh fails in rados/standalone/osd.yaml

Fixes: http://tracker.ceph.com/issues/37393
Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agoMerge pull request #26333 from alfredodeza/mimic-rm38229
Andrew Schoen [Fri, 8 Feb 2019 15:58:50 +0000 (09:58 -0600)]
Merge pull request #26333 from alfredodeza/mimic-rm38229

mimic: doc: pin the version for "breathe" to 4.1.11

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
6 years agodoc: pin the version for `breathe` to 4.1.11 26333/head
Alfredo Deza [Fri, 8 Feb 2019 12:48:57 +0000 (07:48 -0500)]
doc: pin the version for `breathe` to 4.1.11

It has the compatibility needed for Sphinx version 1.6.3

Signed-off-by: Alfredo Deza <adeza@redhat.com>
6 years agotest: osd-backfill-stats.sh Fix check of multi backfill OSDs, skip remapped test 26329/head
David Zafman [Thu, 7 Feb 2019 23:48:48 +0000 (15:48 -0800)]
test: osd-backfill-stats.sh Fix check of multi backfill OSDs, skip remapped test

Signed-off-by: David Zafman <dzafman@redhat.com>
(cherry picked from commit 6d59fdd9710b79685325e8c445948745e7ec0002)

6 years agotest: Fix test to detect a test setup failure
David Zafman [Tue, 14 Aug 2018 22:59:29 +0000 (15:59 -0700)]
test: Fix test to detect a test setup failure

Signed-off-by: David Zafman <dzafman@redhat.com>
(cherry picked from commit c1b2bd7f16fe4ffb63baa48e8a154f275bd20126)

6 years agotest: osd-backfill-stats.sh: Fix subtests to get primary which can change
David Zafman [Thu, 13 Sep 2018 20:15:09 +0000 (13:15 -0700)]
test: osd-backfill-stats.sh: Fix subtests to get primary which can change

Fixes: http://tracker.ceph.com/issues/35982
Signed-off-by: David Zafman <dzafman@redhat.com>
(cherry picked from commit ef6940fbb6c084b7f9abe893a18faef75d3a5680)

6 years agoqa/standalone/osd/osd-backfill-stats: fixes
Sage Weil [Fri, 31 Aug 2018 15:52:04 +0000 (10:52 -0500)]
qa/standalone/osd/osd-backfill-stats: fixes

Grep from the primary's log, not every osd's log.

For the backfill_remapped task in particular, after the pg_temp change it
just so happens that the primary changes across the pool size change and
thus two different primaries do (some) backfill.  Fix that test to pass
the correct primary.

Other tests are unaffected as they do not (happen to) trigger a primary
change and already satisfied the (removed) check that only one OSD does
backfill.

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit f47921f29397257f77c946eef7ba4346bf6481a4)

6 years agoMerge pull request #26294 from jan--f/25390-mimic
Andrew Schoen [Thu, 7 Feb 2019 21:30:31 +0000 (15:30 -0600)]
Merge pull request #26294 from jan--f/25390-mimic

[mimic] ceph-volume: revert partition as disk

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
6 years agoosd/PG: fix misused FORCE_RECOVERY[BACKFILL] flags 26324/head
xie xingguo [Tue, 4 Sep 2018 07:34:24 +0000 (15:34 +0800)]
osd/PG: fix misused FORCE_RECOVERY[BACKFILL] flags

__set_force_backfill__ should set PG_STATE_FORCED_BACKFILL
instead of PG_STATE_FORCED_RECOVERY.

Fixes: http://tracker.ceph.com/issues/27985
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
(cherry picked from commit 60ef742a84d5201b2a6e6c1780741da0b31c49a8)

6 years agoMerge pull request #25856 from ashishkumsingh/wip-37821-mimic
Yuri Weinstein [Wed, 6 Feb 2019 21:37:31 +0000 (13:37 -0800)]
Merge pull request #25856 from ashishkumsingh/wip-37821-mimic

mimic: qa/rados/upgrade: align thrashing with upgrade suite, don't import/export pgs

Reviewed-by: Nathan Cutler <ncutler@suse.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agoMerge pull request #26074 from wido/mimic-mgr-perf
Yuri Weinstein [Wed, 6 Feb 2019 21:36:50 +0000 (13:36 -0800)]
Merge pull request #26074 from wido/mimic-mgr-perf

mimic: mgr: add get_latest_counter() to C++ -> Python interface.

Reviewed-by: Jan Fajerski <jfajerski@suse.com>
6 years agoMerge pull request #25957 from pdvian/wip-37900-mimic
Yuri Weinstein [Wed, 6 Feb 2019 17:28:50 +0000 (09:28 -0800)]
Merge pull request #25957 from pdvian/wip-37900-mimic

mimic: [journal] max journal order is incorrectly set at 64

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
6 years agoMerge pull request #25987 from ashishkumsingh/wip-37925-mimic
Yuri Weinstein [Wed, 6 Feb 2019 17:28:17 +0000 (09:28 -0800)]
Merge pull request #25987 from ashishkumsingh/wip-37925-mimic

mimic: common: fix for broken rbdmap parameter parsing

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
6 years agoceph-volume: add inventory call to functional tests 26294/head
Jan Fajerski [Fri, 7 Dec 2018 08:59:34 +0000 (09:59 +0100)]
ceph-volume: add inventory call to functional tests

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit a183a28c5e423c5658a37f7a1d3add9d64c6d683)

6 years agoceph-volume: add partition support to Device
Jan Fajerski [Tue, 4 Dec 2018 16:00:59 +0000 (17:00 +0100)]
ceph-volume: add partition support to Device

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit 05ac680cb37fd15fdeadaea86780bf1b4f2d566a)

6 years agoRevert "ceph-volume tests.util ensure partitions are listed as top-level keys"
Jan Fajerski [Tue, 4 Dec 2018 07:33:53 +0000 (08:33 +0100)]
Revert "ceph-volume tests.util ensure partitions are listed as top-level keys"

This reverts commit 6dc01772245e557b73551111f7c48cc60aec0893.

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit 3c1c32cbc2736d72295f1bd7921c4a3cd2f4727e)

6 years agoRevert "ceph-volume util.disk include partitions as top level devices in get_devices"
Jan Fajerski [Tue, 4 Dec 2018 07:29:39 +0000 (08:29 +0100)]
Revert "ceph-volume util.disk include partitions as top level devices in get_devices"

This reverts commit 7f3c3598491e556ec1b93ea0a54f52144202fab6.
Fixes: http://tracker.ceph.com/issues/37506
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit 50bc44f1c2327ad38504950fe62820a44ead9b14)

6 years agoMerge pull request #25385 from ifed01/wip-ifed-osd-mkfs-fix
Yuri Weinstein [Wed, 6 Feb 2019 04:09:48 +0000 (20:09 -0800)]
Merge pull request #25385 from ifed01/wip-ifed-osd-mkfs-fix

mimic: osd/OSD: OSD::mkfs asserts when reusing disk with existing superblock.

Reviewed-by: Sage Weil <sage@redhat.com>
6 years agoMerge pull request #26201 from smithfarm/wip-37688-mimic
Yuri Weinstein [Wed, 6 Feb 2019 04:09:20 +0000 (20:09 -0800)]
Merge pull request #26201 from smithfarm/wip-37688-mimic

mimic: tests: Command failed on smithi191 with status 1: 'sudo yum -y install ceph-radosgw'

Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge pull request #26206 from neha-ojha/wip-37902-mimic
Yuri Weinstein [Wed, 6 Feb 2019 04:08:40 +0000 (20:08 -0800)]
Merge pull request #26206 from neha-ojha/wip-37902-mimic

mimic: osd/mon: fix upgrades for pg log hard limit

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
6 years agodoc: pglog_hardlimit flag recommendations 26206/head
Neha Ojha [Wed, 30 Jan 2019 17:50:21 +0000 (17:50 +0000)]
doc: pglog_hardlimit flag recommendations

Signed-off-by: Neha Ojha <nojha@redhat.com>
6 years agoos/bluestore: cap reads issued during deep fsck 26291/head
Igor Fedotov [Mon, 28 Jan 2019 15:17:52 +0000 (18:17 +0300)]
os/bluestore: cap reads issued during deep fsck

Fixes: https://tracker.ceph.com/issues/38065
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
(cherry picked from commit ced308000aef6050ca1fdbdfe3b4b63a887a1706)

6 years agoos/bluestore: do not buffer read data on deep fsck.
Igor Fedotov [Mon, 28 Jan 2019 14:49:32 +0000 (17:49 +0300)]
os/bluestore: do not buffer read data on deep fsck.

Signed-off-by: Igor Fedotov <ifedotov@suse.com>
(cherry picked from commit a4e55dd352a28c48029a0f74cb253673e1aca109)

6 years agoMerge pull request #25348 from ifed01/wip-ifed-fix-expand-mimic
Yuri Weinstein [Tue, 5 Feb 2019 21:16:59 +0000 (13:16 -0800)]
Merge pull request #25348 from ifed01/wip-ifed-fix-expand-mimic

mimic: core: os/bluestore_tool: fix bluefs expand

Reviewed-by: Nathan Cutler <ncutler@suse.com>
6 years agoMerge pull request #25525 from smithfarm/wip-36751-mimic
Yuri Weinstein [Tue, 5 Feb 2019 21:16:20 +0000 (13:16 -0800)]
Merge pull request #25525 from smithfarm/wip-36751-mimic

mimic: cmake: do not pass -B{symbolic,symbolic-functions} to linker on FreeBSD

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
6 years agoMerge pull request #25531 from smithfarm/wip-37642-mimic
Yuri Weinstein [Tue, 5 Feb 2019 21:15:16 +0000 (13:15 -0800)]
Merge pull request #25531 from smithfarm/wip-37642-mimic

mimic: ceph-create-keys: fix octal notation for Python 3 without losing compatibility with Python 2

Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agoqa/tasks/thrashosds-health.yaml: whitelist "slow request" 26288/head
Neha Ojha [Tue, 5 Feb 2019 19:28:58 +0000 (19:28 +0000)]
qa/tasks/thrashosds-health.yaml: whitelist "slow request"

https://github.com/ceph/ceph/pull/25824 brought back slow requests in luminous
OSD logs. This is resulting in the upgrade/luminous-x/stress-split* suites in
mimic to show these warnings.

Signed-off-by: Neha Ojha <nojha@redhat.com>
6 years agoMerge pull request #25857 from ashishkumsingh/wip-37822-mimic
Yuri Weinstein [Tue, 5 Feb 2019 15:22:40 +0000 (07:22 -0800)]
Merge pull request #25857 from ashishkumsingh/wip-37822-mimic

mimic: mds: log evicted clients to clog/dbg

Reviewed-by:  Venky Shankar <vshankar@redhat.com>

6 years agoMerge pull request #25885 from pdvian/wip-37818-mimic
Yuri Weinstein [Tue, 5 Feb 2019 15:21:54 +0000 (07:21 -0800)]
Merge pull request #25885 from pdvian/wip-37818-mimic

mimic: mds: remove wrong assertion in Locker::snapflush_nudge

Reviewed-by: Yan, Zheng <zyan@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>

6 years agoMerge pull request #26010 from smithfarm/wip-37819-mimic
Yuri Weinstein [Tue, 5 Feb 2019 15:21:03 +0000 (07:21 -0800)]
Merge pull request #26010 from smithfarm/wip-37819-mimic

mimic: mds: create separate config for heartbeat timeout

Reviewed-by:  Venky Shankar <vshankar@redhat.com>
Reviewed-by: Yan, Zheng <zyan@redhat.com>
6 years agoMerge pull request #26055 from smithfarm/wip-37898-mimic
Yuri Weinstein [Tue, 5 Feb 2019 15:20:29 +0000 (07:20 -0800)]
Merge pull request #26055 from smithfarm/wip-37898-mimic

mimic: mds: purge queue recovery hangs during boot if PQ journal is damaged

Reviewed-by:  Venky Shankar <vshankar@redhat.com>

6 years agoMerge pull request #26214 from pdvian/wip-38101-mimic
Yuri Weinstein [Tue, 5 Feb 2019 15:20:02 +0000 (07:20 -0800)]
Merge pull request #26214 from pdvian/wip-38101-mimic

mimic: mds: trim cache after journal flush

Reviewed-by:  Venky Shankar <vshankar@redhat.com>

6 years agoMerge pull request #26009 from sebastian-philipp/dashboard-mirror_mode
Yuri Weinstein [Mon, 4 Feb 2019 20:49:18 +0000 (12:49 -0800)]
Merge pull request #26009 from sebastian-philipp/dashboard-mirror_mode

mimic: mgr/dashboard: Set mirror_mode to None

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by:  Volker Theile <vtheile@suse.com>

6 years agoMerge pull request #26208 from vumrao/wip-vumrao-38107
Yuri Weinstein [Mon, 4 Feb 2019 20:47:00 +0000 (12:47 -0800)]
Merge pull request #26208 from vumrao/wip-vumrao-38107

mimic: mgr/DaemonServer: log pgmap usage to cluster log

Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agomds: allow boot on read-only 26055/head
Patrick Donnelly [Sun, 23 Dec 2018 22:22:49 +0000 (14:22 -0800)]
mds: allow boot on read-only

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit c7ce967b778a0b86b335f6801301e484aaf6ebc3)

Conflicts:
src/mds/MDSRank.cc
- no ceph_assert in mimic

6 years agomds: setup readonly mode for PurgeQueue
Patrick Donnelly [Tue, 18 Dec 2018 23:11:02 +0000 (15:11 -0800)]
mds: setup readonly mode for PurgeQueue

If the PQ faces an error, it should go read-only along with the MDS rank.

Fixes: http://tracker.ceph.com/issues/37543
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit 4cccc4dffb0915ef9e7d3b446e9a32f277646562)

Conflicts:
src/mds/PurgeQueue.cc
- Mutex::Locker instead of std::lock_guard
- no ceph_assert in mimic

6 years agomds: add missing locks for PurgeQueue methods
Patrick Donnelly [Tue, 18 Dec 2018 23:08:11 +0000 (15:08 -0800)]
mds: add missing locks for PurgeQueue methods

These could race with the asynchronous workings of the PQ.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit c7350ac23c73867b52cd9b7bb23b6c618eebe44d)

Conflicts:
src/mds/PurgeQueue.cc
- use Mutex::Locker instead of std::lock_guard
- no "ceph_assert" in mimic

6 years agomds: delete on_error context on des
Patrick Donnelly [Tue, 18 Dec 2018 22:00:29 +0000 (14:00 -0800)]
mds: delete on_error context on des

Otherwise it leaks.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit 33279822eabb64380f5968cc645735a8f99a3ac1)

6 years agomds: trim cache after journal flush 26214/head
Patrick Donnelly [Tue, 22 Jan 2019 20:12:55 +0000 (12:12 -0800)]
mds: trim cache after journal flush

Dropping cache should trim the cache only after journal flush otherwise dirty
inodes will remain pinned in cache.

Fixes: http://tracker.ceph.com/issues/38010
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit d7f6c1583b4162fade434e376176f3068472f53f)

6 years agomgr/DaemonServer: log pgmap usage to cluster log 26208/head
Neha Ojha [Thu, 24 Jan 2019 03:25:12 +0000 (19:25 -0800)]
mgr/DaemonServer: log pgmap usage to cluster log

- change default of mon_cluster_log_file_level to debug
- log to clog->debug()

Fixes: https://tracker.ceph.com/issues/37886
Signed-off-by: Neha Ojha <nojha@redhat.com>
(cherry picked from commit f64a69e5054fb319e9f717bbcb7ddd8541e01c6f)

 Conflicts:
src/common/options.cc
        dropped master .add_service, .add_see_also

6 years agoMerge pull request #25306 from trociny/wip-37437-mimic
Yuri Weinstein [Wed, 30 Jan 2019 17:07:36 +0000 (09:07 -0800)]
Merge pull request #25306 from trociny/wip-37437-mimic

mimic: crushtool: add --reclassify operation to convert legacy crush maps to use device classes

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
6 years agoMerge pull request #25313 from pdvian/wip-36639-mimic
Yuri Weinstein [Wed, 30 Jan 2019 17:06:04 +0000 (09:06 -0800)]
Merge pull request #25313 from pdvian/wip-36639-mimic

mimic: os/bluestore: rename does not old ref to replacement onode at old name

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Jianpeng Ma <jianpeng.ma@intel.com>
6 years agoMerge pull request #25526 from smithfarm/wip-36753-mimic
Yuri Weinstein [Wed, 30 Jan 2019 17:04:26 +0000 (09:04 -0800)]
Merge pull request #25526 from smithfarm/wip-36753-mimic

mimic: mon: log last command skips latest entry

Reviewed-by: Sage Weil <sage@redhat.com>
6 years agoMerge pull request #25603 from smithfarm/wip-37686-mimic
Yuri Weinstein [Wed, 30 Jan 2019 17:03:47 +0000 (09:03 -0800)]
Merge pull request #25603 from smithfarm/wip-37686-mimic

mimic: core: list-inconsistent-obj output truncated, causing osd-scrub-repair.sh failure

Reviewed-by: David Zafman <dzafman@redhat.com>
6 years agoMerge pull request #25694 from joscollin/wip-37624-mimic
Yuri Weinstein [Wed, 30 Jan 2019 17:03:10 +0000 (09:03 -0800)]
Merge pull request #25694 from joscollin/wip-37624-mimic

mimic: pybind/mgr/status: fix ceph fs status in py3 environments.

Reviewed-by:  Venky Shankar <vshankar@redhat.com>

6 years agoMerge pull request #25708 from joscollin/wip-37755-mimic
Yuri Weinstein [Wed, 30 Jan 2019 17:02:01 +0000 (09:02 -0800)]
Merge pull request #25708 from joscollin/wip-37755-mimic

mimic: osd/PrimaryLogPG: fix the extent length error of the sync read

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
6 years agoMerge pull request #25822 from batrick/i36209
Yuri Weinstein [Wed, 30 Jan 2019 17:01:19 +0000 (09:01 -0800)]
Merge pull request #25822 from batrick/i36209

mimic: mds: runs out of file descriptors after several respawns

Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agoMerge pull request #25852 from ashishkumsingh/wip-37832-mimic
Yuri Weinstein [Wed, 30 Jan 2019 17:00:26 +0000 (09:00 -0800)]
Merge pull request #25852 from ashishkumsingh/wip-37832-mimic

mimic: objecter: avoid race when reset down osd's session

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
6 years agoMerge pull request #26128 from xiexingguo/wip-mimic-upmap-fixes
Yuri Weinstein [Wed, 30 Jan 2019 16:57:45 +0000 (08:57 -0800)]
Merge pull request #26128 from xiexingguo/wip-mimic-upmap-fixes

mimic: osd: backport recent upmap fixes

Reviewed-by:  Venky Shankar <vshankar@redhat.com>

6 years agoMerge pull request #26147 from ashishkumsingh/wip-38045-mimic
Yuri Weinstein [Wed, 30 Jan 2019 16:56:34 +0000 (08:56 -0800)]
Merge pull request #26147 from ashishkumsingh/wip-38045-mimic

mimic: tests: qa/overrides/short_pg_log.yaml: reduce osd_{min,max}_pg_log_entries

Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agoMerge pull request #25413 from tombarron/mimic
Yuri Weinstein [Wed, 30 Jan 2019 16:52:27 +0000 (08:52 -0800)]
Merge pull request #25413 from tombarron/mimic

mimic: ceph-volume-client: allow setting mode of CephFS volumes

Reviewed-by:  Venky Shankar <vshankar@redhat.com>

6 years agoMerge pull request #25515 from smithfarm/wip-36578-mimic
Yuri Weinstein [Wed, 30 Jan 2019 16:52:01 +0000 (08:52 -0800)]
Merge pull request #25515 from smithfarm/wip-36578-mimic

mimic: qa: teuthology may hang on diagnostic commands for fuse mount

Reviewed-by:  Venky Shankar <vshankar@redhat.com>

6 years agoMerge pull request #25517 from smithfarm/wip-37424-mimic
Yuri Weinstein [Wed, 30 Jan 2019 16:51:35 +0000 (08:51 -0800)]
Merge pull request #25517 from smithfarm/wip-37424-mimic

mimic: qa: wrong setting for msgr failures

Reviewed-by:  Venky Shankar <vshankar@redhat.com>

6 years agoMerge pull request #25519 from smithfarm/wip-37603-mimic
Yuri Weinstein [Wed, 30 Jan 2019 16:51:07 +0000 (08:51 -0800)]
Merge pull request #25519 from smithfarm/wip-37603-mimic

mimic: mds: severe internal fragment when decoding xattr_map from log event

Reviewed-by:  Venky Shankar <vshankar@redhat.com>
Reviewed-by: Yan, Zheng <zyan@redhat.com>
6 years agoMerge pull request #25521 from smithfarm/wip-37607-mimic
Yuri Weinstein [Wed, 30 Jan 2019 16:50:08 +0000 (08:50 -0800)]
Merge pull request #25521 from smithfarm/wip-37607-mimic

mimic: mds: directories pinned keep being replicated back and forth between exporting mds and importing mds

Reviewed-by: Yan, Zheng <zyan@redhat.com>
Reviewed-by:  Venky Shankar <vshankar@redhat.com>

6 years agoMerge pull request #25523 from smithfarm/wip-37605-mimic
Yuri Weinstein [Wed, 30 Jan 2019 16:49:38 +0000 (08:49 -0800)]
Merge pull request #25523 from smithfarm/wip-37605-mimic

mimic: mds: PurgeQueue write error handler does not handle EBLACKLISTED

Reviewed-by:  Venky Shankar <vshankar@redhat.com>
Reviewed-by: Yan, Zheng <zyan@redhat.com>
6 years agoMerge pull request #25557 from smithfarm/wip-37611-mimic
Yuri Weinstein [Wed, 30 Jan 2019 16:49:09 +0000 (08:49 -0800)]
Merge pull request #25557 from smithfarm/wip-37611-mimic

mimic: qa: pjd test appears to require more than 3h timeout for some configurations

Reviewed-by:  Venky Shankar <vshankar@redhat.com>

6 years agoMerge pull request #25559 from smithfarm/wip-37626-mimic
Yuri Weinstein [Wed, 30 Jan 2019 16:48:41 +0000 (08:48 -0800)]
Merge pull request #25559 from smithfarm/wip-37626-mimic

mimic: mds: fix incorrect l_pq_executing_ops statistics when meet an invalid item in purge queue

Reviewed-by: Yan, Zheng <zyan@redhat.com>
Reviewed-by:  Venky Shankar <vshankar@redhat.com>

6 years agoMerge pull request #25561 from smithfarm/wip-37628-mimic
Yuri Weinstein [Wed, 30 Jan 2019 16:47:23 +0000 (08:47 -0800)]
Merge pull request #25561 from smithfarm/wip-37628-mimic

mimic: mds: do not call Journaler::_trim twice

Reviewed-by:  Venky Shankar <vshankar@redhat.com>
Reviewed-by: Yan, Zheng <zyan@redhat.com>
6 years agoMerge pull request #25642 from vshankar/wip-37609
Yuri Weinstein [Wed, 30 Jan 2019 16:46:48 +0000 (08:46 -0800)]
Merge pull request #25642 from vshankar/wip-37609

mimic: mds: disallow dumping huge caches to formatter

Reviewed-by:  Venky Shankar <vshankar@redhat.com>

6 years agoMerge pull request #25676 from joscollin/wip-37699-mimic
Yuri Weinstein [Wed, 30 Jan 2019 16:46:18 +0000 (08:46 -0800)]
Merge pull request #25676 from joscollin/wip-37699-mimic

mimic: mds: fix bug filelock stuck at LOCK_XSYN leading client can't read data

Reviewed-by:  Venky Shankar <vshankar@redhat.com>

6 years agoMerge pull request #25678 from joscollin/wip-37695-mimic
Yuri Weinstein [Wed, 30 Jan 2019 16:45:35 +0000 (08:45 -0800)]
Merge pull request #25678 from joscollin/wip-37695-mimic

mimic: client: fix failure in quota size limitation when using samba

Reviewed-by:  Venky Shankar <vshankar@redhat.com>

6 years agoMerge pull request #25680 from joscollin/wip-37634-mimic
Yuri Weinstein [Wed, 30 Jan 2019 16:45:09 +0000 (08:45 -0800)]
Merge pull request #25680 from joscollin/wip-37634-mimic

mimic: mds: fix races of updating wanted caps

Reviewed-by:  Venky Shankar <vshankar@redhat.com>
Reviewed-by: Yan, Zheng <zyan@redhat.com>
6 years agoMerge pull request #25681 from joscollin/wip-37632-mimic
Yuri Weinstein [Wed, 30 Jan 2019 16:43:22 +0000 (08:43 -0800)]
Merge pull request #25681 from joscollin/wip-37632-mimic

mimic: mds: remove duplicated l_mdc_num_strays perfcounter set

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Yan, Zheng <zyan@redhat.com>
6 years agoMerge pull request #25683 from joscollin/wip-37630-mimic
Yuri Weinstein [Wed, 30 Jan 2019 16:41:52 +0000 (08:41 -0800)]
Merge pull request #25683 from joscollin/wip-37630-mimic

mimic: client: do not move f->pos untill success write

Reviewed-by: Yan, Zheng <zyan@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
6 years agoMerge pull request #25685 from joscollin/wip-37738-mimic
Yuri Weinstein [Wed, 30 Jan 2019 16:41:15 +0000 (08:41 -0800)]
Merge pull request #25685 from joscollin/wip-37738-mimic

mimic: MDSMonitor: allow beacons from stopping MDS that was laggy

Reviewed-by: Yan, Zheng <zyan@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
6 years agoMerge pull request #25803 from ashishkumsingh/wip-37757-mimic
Yuri Weinstein [Wed, 30 Jan 2019 16:40:24 +0000 (08:40 -0800)]
Merge pull request #25803 from ashishkumsingh/wip-37757-mimic

mimic: mds: clean up log messages for standby-replay

Reviewed-by: Venky Shankar <vshankar@redhat.com>
6 years agoMerge pull request #25903 from pdvian/wip-37828-mimic
Yuri Weinstein [Wed, 30 Jan 2019 16:39:57 +0000 (08:39 -0800)]
Merge pull request #25903 from pdvian/wip-37828-mimic

mimic: client: fix fuse client hang because its pipe to mds is not ok

Reviewed-by: Venky Shankar <vshankar@redhat.com>
6 years agoMerge pull request #25980 from pdvian/wip-37907-mimic
Yuri Weinstein [Wed, 30 Jan 2019 16:39:32 +0000 (08:39 -0800)]
Merge pull request #25980 from pdvian/wip-37907-mimic

mimic: mds: wait shorter intervals if beacon not sent

Reviewed-by: Venky Shankar <vshankar@redhat.com>
6 years agoMerge pull request #26047 from pdvian/wip-37923-mimic
Yuri Weinstein [Wed, 30 Jan 2019 16:39:01 +0000 (08:39 -0800)]
Merge pull request #26047 from pdvian/wip-37923-mimic

mimic: qa: test_damage performs truncate test on same object repeatedly

Reviewed-by: Venky Shankar <vshankar@redhat.com>
6 years agoMerge pull request #26051 from ukernel/mimic-37594
Yuri Weinstein [Wed, 30 Jan 2019 16:37:52 +0000 (08:37 -0800)]
Merge pull request #26051 from ukernel/mimic-37594

mimic: mds: handle state change race

Reviewed-by: Venky Shankar <vshankar@redhat.com>
6 years agoMerge pull request #26066 from pdvian/wip-37986-mimic
Yuri Weinstein [Wed, 30 Jan 2019 16:36:51 +0000 (08:36 -0800)]
Merge pull request #26066 from pdvian/wip-37986-mimic

mimic: core: Objecter::calc_op_budget: Fix invalid access to extent union member

Reviewed-by: Venky Shankar <vshankar@redhat.com>
6 years agoMerge pull request #26069 from pdvian/wip-37988-mimic
Yuri Weinstein [Wed, 30 Jan 2019 16:36:20 +0000 (08:36 -0800)]
Merge pull request #26069 from pdvian/wip-37988-mimic

mimic: MDSMonitor: missing osdmon writeable check

Reviewed-by: Venky Shankar <vshankar@redhat.com>
6 years agoMerge pull request #26072 from smithfarm/wip-37952-mimic
Yuri Weinstein [Wed, 30 Jan 2019 16:35:52 +0000 (08:35 -0800)]
Merge pull request #26072 from smithfarm/wip-37952-mimic

mimic: qa: test_damage needs to silence MDS_READ_ONLY

Reviewed-by: Venky Shankar <vshankar@redhat.com>
6 years agoMerge pull request #26180 from pdvian/wip-37894-mimic
Nathan Cutler [Wed, 30 Jan 2019 13:22:39 +0000 (14:22 +0100)]
Merge pull request #26180 from pdvian/wip-37894-mimic

mimic: doc: updated Ceph documentation links

Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agoqa: downgrade librados2,librbd1 for thrash-old-clients tests 26201/head
Kefu Chai [Mon, 10 Dec 2018 10:35:45 +0000 (18:35 +0800)]
qa: downgrade librados2,librbd1 for thrash-old-clients tests

librados2 and librbd1 are installed as a dependency of qemu-kvm.
qemu-kvm is installed by ceph-cm-ansible, see [1].

in thrash-old-clients, jewel packages are installed, but yum does
not allow downgrade unless it's required explicitly. in this change,
we downgrade librbd1 and librados2 to address this issue.

currently, the ceph packages shipped by CentOS/RHEL 7 are still an old
version of jewel. so this issue only kicks in when we try to install
hammer.

this change should address failures like

Command failed on smithi136 with status 1: '\n sudo yum -y install
rbd-fuse\n '

found in rados/thrash-old-clients tests.

---
[1]
https://github.com/ceph/ceph-cm-ansible/commit/3db1cbdc226ecdea532bcc7cd6e710b5ad2bb0d6#diff-f2b05d775fedff6c5c6689f564b32f1c

Fixes: http://tracker.ceph.com/issues/37618
Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit 1d973c1e900d87824298ec82e8e08a1775dca7b1)

Conflicts:
qa/suites/rados/thrash-old-clients/1-install/hammer.yaml

6 years agoqa/suites/upgrade/luminous-x/stress-split: set flag pglog_hardlimit
Neha Ojha [Mon, 28 Jan 2019 23:13:12 +0000 (23:13 +0000)]
qa/suites/upgrade/luminous-x/stress-split: set flag pglog_hardlimit

We should be able to set this flag after latest luminous is installed.

Signed-off-by: Neha Ojha <nojha@redhat.com>
6 years agoMerge pull request #25511 from smithfarm/wip-37465-mimic
Yuri Weinstein [Tue, 29 Jan 2019 16:57:50 +0000 (08:57 -0800)]
Merge pull request #25511 from smithfarm/wip-37465-mimic

mimic: rgw: master zone deletion without a zonegroup rm would break rgw rados init

Reviewed-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
6 years agoMerge pull request #25578 from pdvian/wip-37556-mimic
Yuri Weinstein [Tue, 29 Jan 2019 16:57:13 +0000 (08:57 -0800)]
Merge pull request #25578 from pdvian/wip-37556-mimic

mimic: multisite: es sync null versioned object failed because of olh info

Reviewed-by: Casey Bodley <cbodley@redhat.com>
6 years agoMerge pull request #25624 from pdvian/wip-37560-mimic
Yuri Weinstein [Tue, 29 Jan 2019 16:56:40 +0000 (08:56 -0800)]
Merge pull request #25624 from pdvian/wip-37560-mimic

mimic: rgw: rgwgc: process coredump in some special case

Reviewed-by: Casey Bodley <cbodley@redhat.com>
6 years agoMerge pull request #25954 from pdvian/wip-37890-mimic
Yuri Weinstein [Tue, 29 Jan 2019 16:56:08 +0000 (08:56 -0800)]
Merge pull request #25954 from pdvian/wip-37890-mimic

mimic: rbd: fix delay time calculation for trash move

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
6 years agoMerge pull request #26049 from pdvian/wip-37920-mimic
Yuri Weinstein [Tue, 29 Jan 2019 16:55:31 +0000 (08:55 -0800)]
Merge pull request #26049 from pdvian/wip-37920-mimic

mimic: test/rbd_mirror: wait for release leader lock fully complete

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Mykola Golub <mgolub@mirantis.com>
6 years agoMerge pull request #26137 from ashishkumsingh/wip-38032-mimic
Yuri Weinstein [Tue, 29 Jan 2019 16:54:37 +0000 (08:54 -0800)]
Merge pull request #26137 from ashishkumsingh/wip-38032-mimic

mimic: librbd: properly filter out trashed non-user images on purge

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
6 years agoosd/OSD: OSD::mkfs asserts when reusing disk with existing superblock. 25385/head
Igor Fedotov [Tue, 27 Nov 2018 11:39:09 +0000 (14:39 +0300)]
osd/OSD: OSD::mkfs asserts when reusing disk with existing superblock.

Fixes: http://tracker.ceph.com/issues/37404
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
(cherry picked from commit 328ab2d9f0a27aa38d153469f8ed11e21a6c3ae8)

6 years agoqa/suites/upgrade/mimic-p2p: restructure parallel and add stress-split
Neha Ojha [Mon, 28 Jan 2019 23:02:47 +0000 (23:02 +0000)]
qa/suites/upgrade/mimic-p2p: restructure parallel and add stress-split

Signed-off-by: Neha Ojha <nojha@redhat.com>
6 years agodoc: updated Ceph documentation links 26180/head
James McClune [Fri, 4 Jan 2019 21:32:21 +0000 (16:32 -0500)]
doc: updated Ceph documentation links

Fixes include:

- Updating Doxygen link for reference (http://docs.ceph.com/docs/master/dev/documenting/)
- Adding :ref: label for User Management page (http://docs.ceph.com/docs/master/rados/operations/user-management/)
- Update User Management link for reference (http://docs.ceph.com/docs/master/rbd/rbd-snapshot/)

Fixes: https://tracker.ceph.com/issues/37793
Signed-off-by: James McClune <jmcclune@mcclunetechnologies.net>
(cherry picked from commit 7ff2f215a3d051c4ef226bfdc81184d89520e152)

6 years agoqa/suites/upgrade/luminous-x: add pg log settings
Neha Ojha [Fri, 21 Dec 2018 21:43:21 +0000 (13:43 -0800)]
qa/suites/upgrade/luminous-x: add pg log settings

Signed-off-by: Neha Ojha <nojha@redhat.com>
(cherry picked from commit 24c3e2d669a293f12be5374e994946d587900e13)

6 years agoinclude/rados.h: hide CEPH_OSDMAP_PGLOG_HARDLIMIT from ceph -s
Neha Ojha [Thu, 10 Jan 2019 02:12:17 +0000 (18:12 -0800)]
include/rados.h: hide CEPH_OSDMAP_PGLOG_HARDLIMIT from ceph -s

Signed-off-by: Neha Ojha <nojha@redhat.com>
(cherry picked from commit dfc292923548fe1e1b5329555dd46949feb96b99)

6 years agomon/OSDMonitor.cc: make a note about reusing jewel feature bit
Neha Ojha [Mon, 7 Jan 2019 23:26:27 +0000 (15:26 -0800)]
mon/OSDMonitor.cc: make a note about reusing jewel feature bit

For OSD_PGLOG_HARDLIMIT, we have reused a jewel feature bit that was retired
in luminous. Therefore, we need to check the release version for
>= CEPH_RELEASE_LUMINOUS, before using it.

Signed-off-by: Neha Ojha <nojha@redhat.com>
(cherry picked from commit 6abcc20dca0ee5a08a3fe7c560750f904fe3fa65)

6 years agomon: add and use OSD_PGLOG_HARDLIMIT feature bit
Neha Ojha [Thu, 20 Dec 2018 17:27:34 +0000 (09:27 -0800)]
mon: add and use OSD_PGLOG_HARDLIMIT feature bit

Signed-off-by: Neha Ojha <nojha@redhat.com>
(cherry picked from commit 6b0a3ded5baabb19809618de16cdf67c925a8e5a)

6 years agoosd/mon: fix upgrades for pg log hard limit
Neha Ojha [Tue, 18 Dec 2018 00:20:10 +0000 (16:20 -0800)]
osd/mon: fix upgrades for pg log hard limit

Signed-off-by: Neha Ojha <nojha@redhat.com>
(cherry picked from commit 6ceeab6e204286148a69eb147fbc4045beddef49)

Conflicts:
src/mon/MonCommands.h: trivial resolution

6 years agoosd: bring back old calc_trim_to and rename new method
Neha Ojha [Fri, 14 Dec 2018 23:59:24 +0000 (15:59 -0800)]
osd: bring back old calc_trim_to and rename new method

Signed-off-by: Neha Ojha <nojha@redhat.com>
(cherry picked from commit 0536aef761fefda9a86d5bc72a12ca8cab931ccb)

6 years agoMerge pull request #25699 from xiexingguo/wip-37744
Yuri Weinstein [Fri, 25 Jan 2019 16:14:30 +0000 (08:14 -0800)]
Merge pull request #25699 from xiexingguo/wip-37744

mimic: osd/OSDMap: cancel mapping if target osd is out

Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agoMerge pull request #25292 from smithfarm/wip-37417-mimic
Yuri Weinstein [Fri, 25 Jan 2019 16:13:30 +0000 (08:13 -0800)]
Merge pull request #25292 from smithfarm/wip-37417-mimic

mimic: mgr: various python3 fixes

Reviewed-by: Noah Watkins <noahwatkins@gmail.com>
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
6 years agoMerge pull request #25299 from smithfarm/wip-37428-mimic
Yuri Weinstein [Fri, 25 Jan 2019 16:12:47 +0000 (08:12 -0800)]
Merge pull request #25299 from smithfarm/wip-37428-mimic

mimic: msg/async: crashes when authenticator provided by verify_authorizer not implemented

Reviewed-by: Sage Weil <sage@redhat.com>
6 years agoMerge pull request #25718 from ashishkumsingh/wip-37552-mimic
Yuri Weinstein [Fri, 25 Jan 2019 16:11:54 +0000 (08:11 -0800)]
Merge pull request #25718 from ashishkumsingh/wip-37552-mimic

mimic: osdc/Objecter: update op_target_t::paused in _calc_target

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>