]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
6 years agoMerge PR #27628 into master
Sage Weil [Tue, 23 Apr 2019 18:08:29 +0000 (13:08 -0500)]
Merge PR #27628 into master

* refs/pull/27628/head:
common: optimize check_utf8

Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge PR #27702 into master
Sage Weil [Tue, 23 Apr 2019 18:06:52 +0000 (13:06 -0500)]
Merge PR #27702 into master

* refs/pull/27702/head:
osd/PG: fix last_complete re-calculation on splitting

Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agoMerge PR #27691 into master
Sage Weil [Tue, 23 Apr 2019 18:06:15 +0000 (13:06 -0500)]
Merge PR #27691 into master

* refs/pull/27691/head:
os/bluestore: fix out-of-bound access in bmap allocator.
os/bluestore: reproduce out-of-bound access for bmap allocator

Reviewed-by: Sage Weil <sage@redhat.com>
6 years agoMerge PR #27707 into master
Sage Weil [Tue, 23 Apr 2019 18:05:44 +0000 (13:05 -0500)]
Merge PR #27707 into master

* refs/pull/27707/head:
common/util: handle long lines in /proc/cpuinfo

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
6 years agoMerge PR #27537 into master
Patrick Donnelly [Tue, 23 Apr 2019 17:53:52 +0000 (10:53 -0700)]
Merge PR #27537 into master

* refs/pull/27537/head:
mds: better output of 'ceph health detail'

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoMerge PR #27511 into master
Patrick Donnelly [Tue, 23 Apr 2019 17:52:41 +0000 (10:52 -0700)]
Merge PR #27511 into master

* refs/pull/27511/head:
mds: fix SnapRealm::resolve_snapname for long name

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoMerge PR #27077 into master
Patrick Donnelly [Tue, 23 Apr 2019 17:50:49 +0000 (10:50 -0700)]
Merge PR #27077 into master

* refs/pull/27077/head:
test: check listattr for snapshot btime entry
test: extend LibCephFS.Xattrs test
client: remove unused vxattr length helpers
client: fix _listxattr() vxattr buffer length calculation
test: add libcephfs snap.btime xattr test
client: add ceph.snap.btime vxattr
mds: carry snapshot creation time with InodeStat

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
6 years agoMerge pull request #27725 from theanalyst/perf-counter-names
Casey Bodley [Tue, 23 Apr 2019 16:48:55 +0000 (12:48 -0400)]
Merge pull request #27725 from theanalyst/perf-counter-names

rgw: sync counters: drop spaces from counter names

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
6 years agorgw: sync counters: drop spaces from counter names 27725/head
Abhishek Lekshmanan [Tue, 23 Apr 2019 15:27:08 +0000 (17:27 +0200)]
rgw: sync counters: drop spaces from counter names

Since this might break modules like prometheus and general json processing tools
aren't too happy with spaces.

Fixes: https://tracker.ceph.com/issues/39434
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
6 years agoMerge pull request #27703 from tchaikov/wip-rbd-replay-denc
Jason Dillaman [Tue, 23 Apr 2019 14:07:26 +0000 (10:07 -0400)]
Merge pull request #27703 from tchaikov/wip-rbd-replay-denc

rbd_replay: call the member decode() explicitly

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
6 years agomgr/dashboard: Clean up TableComponent tests and code (#26784)
Lenz Grimmer [Tue, 23 Apr 2019 13:54:23 +0000 (15:54 +0200)]
mgr/dashboard: Clean up TableComponent tests and code (#26784)

mgr/dashboard: Clean up TableComponent tests and code

Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
6 years agorbd_replay: call the member decode() explicitly 27703/head
Kefu Chai [Mon, 22 Apr 2019 11:26:54 +0000 (19:26 +0800)]
rbd_replay: call the member decode() explicitly

otherwise, the one defined using WRITE_RAW_ENCODER is called instead.
so in this change, rename the the member function which happens to have
the same signature with

decode(type &v, ::ceph::bufferlist::const_iterator& p)

where `type` is `__u8`.

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge pull request #27521 from trociny/wip-rbd-remove-clone_v2-parent
Jason Dillaman [Tue, 23 Apr 2019 12:11:38 +0000 (08:11 -0400)]
Merge pull request #27521 from trociny/wip-rbd-remove-clone_v2-parent

librbd: optionally move parent image to trash on remove

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
6 years agoMerge pull request #27484 from majianpeng/rbd-nbd
Jason Dillaman [Tue, 23 Apr 2019 12:11:07 +0000 (08:11 -0400)]
Merge pull request #27484 from majianpeng/rbd-nbd

rbd-nbd: sscanf return 0 mean not-match

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
6 years agoMerge pull request #27697 from cbodley/wip-rgw-bucket-list-unordered
Casey Bodley [Tue, 23 Apr 2019 12:07:13 +0000 (08:07 -0400)]
Merge pull request #27697 from cbodley/wip-rgw-bucket-list-unordered

 rgw: cls_bucket_list_unordered lists a single shard

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
6 years agoMerge pull request #27713 from tchaikov/wip-24842
Kefu Chai [Tue, 23 Apr 2019 11:14:55 +0000 (19:14 +0800)]
Merge pull request #27713 from tchaikov/wip-24842

doc/rbd/rbd-cloudstack: update disk offering URL to new docs

Reviewed-by: Wido den Hollander <wido@42on.com>
6 years agodoc/rbd/rbd-cloudstack: update disk offering URL to new docs 27713/head
Kefu Chai [Tue, 23 Apr 2019 05:26:45 +0000 (13:26 +0800)]
doc/rbd/rbd-cloudstack: update disk offering URL to new docs

point hyperlinks to latest

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agoosd/PG: fix last_complete re-calculation on splitting 27702/head
xie xingguo [Sat, 20 Apr 2019 08:34:12 +0000 (16:34 +0800)]
osd/PG: fix last_complete re-calculation on splitting

We add hard-limit for pg_logs now, which means we might keep trimming
old log entries irrespective of pg's current missing_set. This as a
result can cause the last_complete pointer moving far ahead of the real
on-disk version (the oldest need of missing_set, for instance) the
corresponding pg should have on splitting:

```
2019-04-19 06:41:52.559247 7efd4725c700 10 osd.2 271 Splitting pg[5.6( v 270'943 lc 0'0 (238'300,270'943] local-lis/les=250/251 n=943 ec=223/223 lis/c 250/223 les/251/224/0 250/271/229) [5,2] r=1 lpr=271 pi=[223,271)/4 crt=270'943 unknown NOTIFY m=518 mbc={}] into 5.16
2019-04-19 06:41:52.561413 7efd4725c700 10 osd.2 pg_epoch: 271 pg[5.6( v 270'943 lc 238'300 (238'300,270'943] local-lis/les=250/251 n=943 ec=223/223 lis/c 250/223 c/f 251/224/0 250/271/229) [5,2] r=1 lpr=271 pi=[223,271)/4 crt=270'943 lcod 0'0 unknown NOTIFY m=261 mbc={}] release_backoffs [MIN,MAX)
```

For the above example, parent's last_complete cursor changed from **0'0** to
**238'300** directly due to the effort of trying to catch up the oldest
log entry changing when splitting was done. However, back into v12.2.9 primary
would still reference shard's last_complete field when trying to figure out all
possible locations of a currently missing object (see PG::MissingLoc::add_source_info):

```c++
  if (oinfo.last_complete < need) {
    if (omissing.is_missing(soid)) {
      ldout(pg->cct, 10) << "search_for_missing " << soid << " " << need
                         << " also missing on osd." << fromosd << dendl;
      continue;
    }
  }
```

Hence a wrongly calculated last_complete could then make primary mis-consider
that a specific shard might have the authoritative object it currently
looking for:

```
2019-04-19 06:41:52.904163 7fd4cfb5a700 10 osd.5 pg_epoch: 271 pg[5.6( v 270'943 lc 238'300 (238'300,270'943] local-lis/les=250/251 n=471 ec=223/223 lis/c 250/223 les/
c/f 251/224/0 250/271/229) [5,2] r=0 lpr=271 pi=[223,271)/4 crt=270'943 lcod 226'77 mlcod 0'0 peering m=16 mbc={}] proc_replica_log for osd.2: 5.6( v 270'943 lc 238'30
0 (238'300,270'943] local-lis/les=250/251 n=471 ec=223/223 lis/c 250/223 les/c/f 251/224/0 250/271/229) log((249'563,270'943], crt=270'943) missing(261 may_include_del
etes = 1)
2019-04-19 06:41:52.904645 7fd4cfb5a700 20 osd.5 pg_epoch: 271 pg[5.6( v 270'943 lc 238'300 (238'300,270'943] local-lis/les=250/251 n=471 ec=223/223 lis/c 250/223 les/
c/f 251/224/0 250/271/229) [5,2] r=0 lpr=271 pi=[223,271)/4 crt=270'943 lcod 226'77 mlcod 0'0 peering m=16 mbc={}]  after missing 5:624c3a7a:::benchmark_data_smithi190
_39968_object1382:head need 226'110 have 0'0
2019-04-19 06:41:53.567820 7fd4d035b700 10 osd.5 pg_epoch: 272 pg[5.6( v 270'943 lc 0'0 (238'300,270'943] local-lis/les=271/272 n=471 ec=223/223 lis/c 250/223 les/c/f
251/224/0 250/271/229) [5,2] r=0 lpr=271 pi=[223,271)/4 crt=270'943 lcod 226'77 mlcod 0'0 unknown m=16 u=13 mbc={255={(1+0)=220,(2+0)=28}}] search_for_missing 5:624c3a
7a:::benchmark_data_smithi190_39968_object1382:head 226'110 is on osd.2
```

note that ```5:624c3a7a:::benchmark_data_smithi190_39968_object1382:head 226'110```
was actually missing on both primary and shard osd.2 whereas primary insisted that
object should exist on shard osd.2!

https://github.com/ceph/ceph/pull/26175 posted an indirect fix
for the above problem by ignoring last_complete when checking the missing set,
but it should generally make more sense to fill in the last_complete field correctly
whenever possible.
Hence coming this additional fix.

Fixes: http://tracker.ceph.com/issues/26958
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
6 years agoMerge PR #27708 into master
Sage Weil [Mon, 22 Apr 2019 22:07:27 +0000 (17:07 -0500)]
Merge PR #27708 into master

* refs/pull/27708/head:
doc/governance: add cbodey

Reviewed-by: Casey Bodley <cbodley@redhat.com>
6 years agoMerge PR #27693 into master
Sage Weil [Mon, 22 Apr 2019 22:06:42 +0000 (17:06 -0500)]
Merge PR #27693 into master

* refs/pull/27693/head:
mgr/telemetry: default to reports every 24h; lower minimum
mgr/telemetry: exclude hostname field in crash reports

Reviewed-by: Dan Mick <dmick@redhat.com>
6 years agodoc/governance: add cbodey 27708/head
Sage Weil [Mon, 22 Apr 2019 20:37:11 +0000 (15:37 -0500)]
doc/governance: add cbodey

Signed-off-by: Sage Weil <sage@redhat.com>
6 years agocommon/util: handle long lines in /proc/cpuinfo 27707/head
Sage Weil [Mon, 22 Apr 2019 17:51:41 +0000 (12:51 -0500)]
common/util: handle long lines in /proc/cpuinfo

Fixes: http://tracker.ceph.com/issues/38296
Signed-off-by: Sage Weil <sage@redhat.com>
6 years agorgw: cls_bucket_list_unordered lists a single shard 27697/head
Casey Bodley [Fri, 19 Apr 2019 22:38:47 +0000 (18:38 -0400)]
rgw: cls_bucket_list_unordered lists a single shard

CLSRGWIssueBucketList sends the request to every shard, but this loop
intended to list only the current_shard

Fixes: http://tracker.ceph.com/issues/39393
Signed-off-by: Casey Bodley <cbodley@redhat.com>
6 years agocls/rgw: expose cls_rgw_bucket_list_op for single shard
Casey Bodley [Fri, 19 Apr 2019 22:37:35 +0000 (18:37 -0400)]
cls/rgw: expose cls_rgw_bucket_list_op for single shard

Signed-off-by: Casey Bodley <cbodley@redhat.com>
6 years agoMerge pull request #27694 from dillaman/wip-39386
Mykola Golub [Mon, 22 Apr 2019 15:13:02 +0000 (18:13 +0300)]
Merge pull request #27694 from dillaman/wip-39386

qa/suites/rbd: added writearound cache test permutations

Reviewed-by: Mykola Golub <mgolub@suse.com>
6 years agoMerge pull request #27682 from dillaman/wip-39031
Mykola Golub [Mon, 22 Apr 2019 15:12:30 +0000 (18:12 +0300)]
Merge pull request #27682 from dillaman/wip-39031

librbd: async open/close should free ImageCtx before issuing callback

Reviewed-by: Mykola Golub <mgolub@suse.com>
6 years agoMerge pull request #24744 from liewegas/wip-stale-prs
Sage Weil [Mon, 22 Apr 2019 14:58:24 +0000 (09:58 -0500)]
Merge pull request #24744 from liewegas/wip-stale-prs

.github/stale.yml: warn at 60, close at 90; adjust message

6 years agomgr/telemetry: default to reports every 24h; lower minimum 27693/head
Sage Weil [Fri, 19 Apr 2019 17:24:48 +0000 (12:24 -0500)]
mgr/telemetry: default to reports every 24h; lower minimum

Allow more frequent telemetry reports.

Signed-off-by: Sage Weil <sage@redhat.com>
6 years agomgr/telemetry: exclude hostname field in crash reports
Sage Weil [Fri, 19 Apr 2019 17:09:36 +0000 (12:09 -0500)]
mgr/telemetry: exclude hostname field in crash reports

On some systems the hostname is a fully-qualified domain name and
(even when not a fqdn) may inadvertantly allow the cluster to be
identified.

Signed-off-by: Sage Weil <sage@redhat.com>
6 years agoMerge PR #27605 into master
Sage Weil [Mon, 22 Apr 2019 12:04:11 +0000 (07:04 -0500)]
Merge PR #27605 into master

* refs/pull/27605/head:
mon/OSDMonitor: osd add-no{up,down,in,out} - remove state checker

Reviewed-by: Sage Weil <sage@redhat.com>
6 years agoMerge pull request #27695 from dillaman/wip-39072 23653/head
Mykola Golub [Mon, 22 Apr 2019 05:22:20 +0000 (08:22 +0300)]
Merge pull request #27695 from dillaman/wip-39072

test/librbd: drop 'ceph_test_librbd_api' target

Reviewed-by: Mykola Golub <mgolub@suse.com>
6 years agoMerge PR #27288 into master
Sage Weil [Mon, 22 Apr 2019 02:28:02 +0000 (21:28 -0500)]
Merge PR #27288 into master

* refs/pull/27288/head:
osd/PG: discover missing objects when an OSD peers and PG is degraded

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agoMerge PR #27571 into master
Sage Weil [Mon, 22 Apr 2019 02:26:04 +0000 (21:26 -0500)]
Merge PR #27571 into master

* refs/pull/27571/head:
mgr/telemetry: add report_timestamp to sent reports

Reviewed-by: Sage Weil <sage@redhat.com>
6 years agoMerge PR #27572 into master
Sage Weil [Mon, 22 Apr 2019 02:20:37 +0000 (21:20 -0500)]
Merge PR #27572 into master

* refs/pull/27572/head:
denc: fix build error by calling global snprintf

Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge PR #27622 into master
Sage Weil [Mon, 22 Apr 2019 02:20:12 +0000 (21:20 -0500)]
Merge PR #27622 into master

* refs/pull/27622/head:
mon: fix INCOMPAT_OCTOPUS feature number
mon/Elector: format mon_release correctly

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agoMerge pull request #27577 from dillaman/wip-rbd-suite-distros
Mykola Golub [Sun, 21 Apr 2019 17:19:15 +0000 (20:19 +0300)]
Merge pull request #27577 from dillaman/wip-rbd-suite-distros

qa/suites/rbd: add random distro selection to librbd tests

Reviewed-by: Mykola Golub <mgolub@suse.com>
6 years agoMerge pull request #27690 from tchaikov/wip-crimson-one-safeguard-is-better-than-two
Kefu Chai [Sun, 21 Apr 2019 03:17:27 +0000 (11:17 +0800)]
Merge pull request #27690 from tchaikov/wip-crimson-one-safeguard-is-better-than-two

crimson: pass `Connection*` to Dispatch::ms_dispatch()

Reviewed-by: Samuel Just <sjust@redhat.com>
6 years agoMerge PR #27595 into master
Sage Weil [Sat, 20 Apr 2019 13:52:01 +0000 (08:52 -0500)]
Merge PR #27595 into master

* refs/pull/27595/head:
osd: add 'ceph osd stop <osd.nnn>' command

Reviewed-by: Sage Weil <sage@redhat.com>
6 years agoMerge PR #27619 into master
Sage Weil [Sat, 20 Apr 2019 13:48:30 +0000 (08:48 -0500)]
Merge PR #27619 into master

* refs/pull/27619/head:
mgr/BaseMgrModule: run MonCommandCompletion on the finisher
mgr/BaseMgrModule: fix leak

Reviewed-by: Mykola Golub <mgolub@suse.com>
Reviewed-by: Tim Serong <tserong@suse.com>
6 years agoMerge PR #27651 into master
Sage Weil [Sat, 20 Apr 2019 13:48:14 +0000 (08:48 -0500)]
Merge PR #27651 into master

* refs/pull/27651/head:
test/osd/safe-to-destroy.sh: fix typo

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge PR #27663 into master
Sage Weil [Sat, 20 Apr 2019 13:47:48 +0000 (08:47 -0500)]
Merge PR #27663 into master

* refs/pull/27663/head:
osd/OSDMap: Replace get_out_osds with get_out_existing_osds

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Sage Weil <sage@redhat.com>
6 years agoMerge pull request #27631 from dmick/wip-telemetry-crasharray
Kefu Chai [Sat, 20 Apr 2019 06:18:28 +0000 (14:18 +0800)]
Merge pull request #27631 from dmick/wip-telemetry-crasharray

mgr/telemetry: change crash dict to a list

Reviewed-by: Sage Weil <sage@redhat.com>
6 years agoMerge pull request #27599 from gregsfortytwo/wip-stale-prs
Kefu Chai [Sat, 20 Apr 2019 06:16:33 +0000 (14:16 +0800)]
Merge pull request #27599 from gregsfortytwo/wip-stale-prs

Miscellaneous lost fixes

Reviewed-by: Ricardo Dias <rdias@suse.com>
6 years agoMerge pull request #27615 from ifed01/wip-ifed-verbose-bluefs-replay
Kefu Chai [Sat, 20 Apr 2019 06:12:20 +0000 (14:12 +0800)]
Merge pull request #27615 from ifed01/wip-ifed-verbose-bluefs-replay

os/bluestore: be more verbose doing bluefs log replay.

Reviewed-by: Sage Weil <sage@redhat.com>
6 years agoMerge pull request #27509 from Aran85/fix-pg-dout
Kefu Chai [Sat, 20 Apr 2019 06:10:39 +0000 (14:10 +0800)]
Merge pull request #27509 from Aran85/fix-pg-dout

osd/PG: the warning seems more serious than what it wanna transmit

Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agoMerge pull request #27592 from tchaikov/wip-ref
Kefu Chai [Sat, 20 Apr 2019 06:09:51 +0000 (14:09 +0800)]
Merge pull request #27592 from tchaikov/wip-ref

message,mgr: drop MessageFactory and friends and use ref_t<> in mgr

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoMerge pull request #27633 from xiexingguo/wip-39340
Kefu Chai [Sat, 20 Apr 2019 06:05:24 +0000 (14:05 +0800)]
Merge pull request #27633 from xiexingguo/wip-39340

osd/osd_types: pool_stat_t::dump - fix 'num_store_stats' field

Reviewed-by: Sage Weil <sage@redhat.com>
6 years agoMerge pull request #27658 from gregsfortytwo/wip-39367-crc-peer
Kefu Chai [Sat, 20 Apr 2019 06:04:33 +0000 (14:04 +0800)]
Merge pull request #27658 from gregsfortytwo/wip-39367-crc-peer

msg: output peer address when detecting bad CRCs

Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agocrimson: pass `Connection*` to Dispatch::ms_dispatch() 27690/head
Kefu Chai [Fri, 19 Apr 2019 08:50:25 +0000 (16:50 +0800)]
crimson: pass `Connection*` to Dispatch::ms_dispatch()

currently, we use a `with_gate()` in `ProtocolV2::read_message()` for
ensuring that `this` (or `Connection` holding this protocol instance)
will outlive the continuation of `dispatcher.ms_dispatch()` which
references `this->dispatcher`. but we also pass a strong reference of
connection to dispatcher. in short, we have *two* safeguards for the
same purpose.

in this change, one of these safeguards is removed -- to pass the raw
pointer of `Connection` to `Dispatch::ms_dispatch()`. the reason why
the `with_gate()` is kept is that, if we have removed `with_gate()` in
Protocol, we need to

1. let `Dispatcher::ms_dispatch()` return `void`, as it should not block
any succeeding calls.
2. add a `with_gate()` in `Dispatcher::ms_dispatch()` to ensure that
`this` is alive during the lifecycle of the continuation(s) in
`Dispatcher::ms_dispatch()`.

Signed-off-by: Yingxin Cheng <yingxincheng@gmail.com>
Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge pull request #27657 from anthonyeleven/patch-1
Xie Xingguo [Sat, 20 Apr 2019 00:50:29 +0000 (08:50 +0800)]
Merge pull request #27657 from anthonyeleven/patch-1

doc: operations: improve reweight-by-utilization

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
6 years agodoc: operations: reweight-by-utilization typo 27657/head
Anthony D'Atri [Fri, 19 Apr 2019 22:15:12 +0000 (15:15 -0700)]
doc: operations: reweight-by-utilization typo

Add a missing backquote delimiter.

Signed-off-by: Anthony D'Atri <anthony.datri@gmail.com>
6 years agotest/librbd: drop 'ceph_test_librbd_api' target 27695/head
Jason Dillaman [Fri, 19 Apr 2019 18:15:49 +0000 (14:15 -0400)]
test/librbd: drop 'ceph_test_librbd_api' target

This was used for API backwards compatibility testing, but now that
the C++ API will not remain stable, it serves no purpose.

Fixes: http://tracker.ceph.com/issues/39072
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
6 years agoqa/suites/rbd: added writearound cache test permutations 27694/head
Jason Dillaman [Fri, 19 Apr 2019 18:11:43 +0000 (14:11 -0400)]
qa/suites/rbd: added writearound cache test permutations

Also tweaked the existing writeback cache test permutations to
specify the use of the writeback cache policy.

Fixes: http://tracker.ceph.com/issues/39386
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
6 years agomgr/BaseMgrModule: run MonCommandCompletion on the finisher 27619/head
Sage Weil [Thu, 18 Apr 2019 18:10:15 +0000 (13:10 -0500)]
mgr/BaseMgrModule: run MonCommandCompletion on the finisher

The completion takes the ActivePyModules::lock, but the caller may be
holding an internal lock for Objecter and/or MonClient.  Avoid deadlock
by putting the completion on our finisher.

Signed-off-by: Sage Weil <sage@redhat.com>
6 years agomgr/BaseMgrModule: fix leak
Sage Weil [Thu, 18 Apr 2019 18:28:05 +0000 (13:28 -0500)]
mgr/BaseMgrModule: fix leak

Signed-off-by: Sage Weil <sage@redhat.com>
6 years agoos/bluestore: fix out-of-bound access in bmap allocator. 27691/head
Igor Fedotov [Fri, 19 Apr 2019 12:43:07 +0000 (15:43 +0300)]
os/bluestore: fix out-of-bound access in bmap allocator.

Fixes: https://tracker.ceph.com/issues/39334
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
6 years agoos/bluestore: reproduce out-of-bound access for bmap allocator
Igor Fedotov [Fri, 19 Apr 2019 12:04:48 +0000 (15:04 +0300)]
os/bluestore: reproduce out-of-bound access for bmap allocator

Reproduces: https://tracker.ceph.com/issues/39334

Signed-off-by: Igor Fedotov <ifedotov@suse.com>
6 years agolibrbd: optionally move parent image to trash on remove 27521/head
Mykola Golub [Mon, 15 Apr 2019 10:35:53 +0000 (11:35 +0100)]
librbd: optionally move parent image to trash on remove

and auto-delete when the last clone is detached

Signed-off-by: Mykola Golub <mgolub@suse.com>
6 years agolibrbd: reuse async trash remove state machine
Mykola Golub [Mon, 15 Apr 2019 10:34:07 +0000 (11:34 +0100)]
librbd: reuse async trash remove state machine

Signed-off-by: Mykola Golub <mgolub@suse.com>
6 years agolibrbd: async trash remove state machine
Mykola Golub [Mon, 15 Apr 2019 10:32:15 +0000 (11:32 +0100)]
librbd: async trash remove state machine

Signed-off-by: Mykola Golub <mgolub@suse.com>
6 years agorbd-nbd: sscanf return 0 mean not-match. 27484/head
Jianpeng Ma [Fri, 19 Apr 2019 05:00:04 +0000 (13:00 +0800)]
rbd-nbd: sscanf return 0 mean not-match.

When exec:  rbd-nbd map rbd/image --device /dev/image
The error message is:
rbd-nbd: failed to open device: /dev/image.

In fact, it should print:
rbd-nbd: invalid device path: /dev/image (expected /dev/nbd{num})

Meantime change help which make more understand.

Fixes: http://tracker.ceph.com/issues/39269
Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
6 years agoMerge PR #27685 into master
Patrick Donnelly [Thu, 18 Apr 2019 22:36:17 +0000 (15:36 -0700)]
Merge PR #27685 into master

* refs/pull/27685/head:
doc: fix boot transition in mds state diagram

Reviewed-by: Sage Weil <sage@redhat.com>
6 years agoMerge pull request #27686 from dzafman/wip-39383
David Zafman [Thu, 18 Apr 2019 21:52:30 +0000 (14:52 -0700)]
Merge pull request #27686 from dzafman/wip-39383

osd: Increase log level of messages which unnecessarily fill up logs

Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agoosd: Increase log level of messages which unnecessarily fill up logs 27686/head
David Zafman [Thu, 18 Apr 2019 21:03:17 +0000 (14:03 -0700)]
osd: Increase log level of messages which unnecessarily fill up logs

Caused by: 834d3c19a774f1cc93903447d91d182776e12d18

Fixes: https://tracker.ceph.com/issues/39383
Signed-off-by: David Zafman <dzafman@redhat.com>
6 years agoMerge pull request #27037 from alimaredia/wip-rgw-dpp-rest-s3-swift
Casey Bodley [Thu, 18 Apr 2019 19:57:23 +0000 (15:57 -0400)]
Merge pull request #27037 from alimaredia/wip-rgw-dpp-rest-s3-swift

rgw: log refactoring for rgw_rest_s3/swift ops

Reviewed-by: Casey Bodley <cbodley@redhat.com>
6 years agodoc: fix boot transition in mds state diagram 27685/head
Patrick Donnelly [Thu, 18 Apr 2019 19:48:37 +0000 (12:48 -0700)]
doc: fix boot transition in mds state diagram

MDSMonitor assigns a booting MDS immediately to standby. From there, the
standby may be promoted to standby-replay or some state leading to active.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoMerge PR #27375 into master
Sage Weil [Thu, 18 Apr 2019 19:09:51 +0000 (14:09 -0500)]
Merge PR #27375 into master

* refs/pull/27375/head:
rgw: pass mostly_omap flag when opening/creating pools
rgw/rgw_rados: pass mostly_omap flag when opening/creating pools
rgw: move rgw_init_ioctx() to rgw_tools.cc

Reviewed-by: Casey Bodley <cbodley@redhat.com>
6 years agoMerge pull request #27576 from cbodley/wip-39287
Casey Bodley [Thu, 18 Apr 2019 18:02:13 +0000 (14:02 -0400)]
Merge pull request #27576 from cbodley/wip-39287

rgw: RGWPeriodPusher uses zone system key for inter-zonegroup messages

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
6 years agorbd: fixed memory leak in 'rbd mirror pool' multi-image actions 27682/head
Jason Dillaman [Thu, 18 Apr 2019 17:20:17 +0000 (13:20 -0400)]
rbd: fixed memory leak in 'rbd mirror pool' multi-image actions

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
6 years agolibrbd: async open/close should free ImageCtx before issuing callback
Jason Dillaman [Thu, 18 Apr 2019 17:17:56 +0000 (13:17 -0400)]
librbd: async open/close should free ImageCtx before issuing callback

The destructor for ImageCtx attempts to access librados::IoCtx objects
that might have been destroyed immediately after the async open (failure)
and close actions completed.

Fixes: http://tracker.ceph.com/issues/39031
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
6 years agoMerge pull request #27518 from jtlayton/vstart
jtlayton [Thu, 18 Apr 2019 17:16:02 +0000 (13:16 -0400)]
Merge pull request #27518 from jtlayton/vstart

vstart: add new option to pass list of block devices to bluestore

6 years agomgr/dashboard: Clean up TableComponent tests and code 26784/head
Patrick Nawracay [Wed, 6 Mar 2019 08:29:35 +0000 (09:29 +0100)]
mgr/dashboard: Clean up TableComponent tests and code

Signed-off-by: Patrick Nawracay <pnawracay@suse.com>
6 years agoMerge pull request #27567 from cbodley/wip-39283
Casey Bodley [Thu, 18 Apr 2019 13:31:41 +0000 (09:31 -0400)]
Merge pull request #27567 from cbodley/wip-39283

rgw: multisite log trimming only checks peers that sync from us

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
6 years agoqa/tasks/rbd_fio: fixed missing delimiter between 'cd' and 'configure' 27577/head
Jason Dillaman [Thu, 18 Apr 2019 12:55:19 +0000 (08:55 -0400)]
qa/tasks/rbd_fio: fixed missing delimiter between 'cd' and 'configure'

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
6 years agoqa/suites/rbd: add random distro selection to librbd tests
Jason Dillaman [Sat, 13 Apr 2019 16:53:35 +0000 (12:53 -0400)]
qa/suites/rbd: add random distro selection to librbd tests

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
6 years agoMerge pull request #27275 from Devp00l/issue-39037
Lenz Grimmer [Thu, 18 Apr 2019 08:58:43 +0000 (10:58 +0200)]
Merge pull request #27275 from Devp00l/issue-39037

mgr/dashboard: Localization for date picker module

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
6 years agoosd: add 'ceph osd stop <osd.nnn>' command 27595/head
xie xingguo [Mon, 15 Apr 2019 12:36:36 +0000 (20:36 +0800)]
osd: add 'ceph osd stop <osd.nnn>' command

stop command can be used to force stopping a specified osd daemon, e.g.,
you don't have to pre-figure out where it located.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
6 years agoosd/OSDMap: Replace get_out_osds with get_out_existing_osds 27663/head
Brad Hubbard [Wed, 17 Apr 2019 06:13:27 +0000 (16:13 +1000)]
osd/OSDMap: Replace get_out_osds with get_out_existing_osds

Fixes: http://tracker.ceph.com/issues/39154
Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
6 years agoMerge PR #27235 into master
Patrick Donnelly [Thu, 18 Apr 2019 00:06:22 +0000 (17:06 -0700)]
Merge PR #27235 into master

* refs/pull/27235/head:
cephfs-shell: support non-octal mode
cephfs-shell: fix rm command
cephfs-shell: fix lls command
cephfs-shell: fix lcd command
cephfs-shell: fix umask command
cephfs-shell: fix cat command
cephfs-shell: fix chmod command
cephfs-shell: fix chdir command
cephfs-shell: fix mv command
cephfs-shell: fix rmdir command
cephfs-shell: fix ls command
cephfs-shell: fix get command
cephfs-shell: fix put command
cephfs-shell: fix mkdir command
cephfs-shell: helper functions and infra changes

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agomsg/Message: add SafeMessage which forbids put/get 27592/head
Kefu Chai [Tue, 16 Apr 2019 02:46:36 +0000 (10:46 +0800)]
msg/Message: add SafeMessage which forbids put/get

This is an opt-in wrapper around Message inheritance to prevent
undesired get/put calls on the object. Instead, you must/should use a
smart ptr to adjust the reference count.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agomgr/MgrClient: use ref_t<M>
Kefu Chai [Mon, 15 Apr 2019 06:55:24 +0000 (14:55 +0800)]
mgr/MgrClient: use ref_t<M>

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agomgr/{Mgr,MgrStandby}: use ref_t<M>
Kefu Chai [Mon, 15 Apr 2019 06:39:11 +0000 (14:39 +0800)]
mgr/{Mgr,MgrStandby}: use ref_t<M>

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agomgr/DaemonState: pass const by reference
Kefu Chai [Mon, 15 Apr 2019 06:02:33 +0000 (14:02 +0800)]
mgr/DaemonState: pass const by reference

DaemonPerfCounters::update() does not change the `MMgrReport` message,
neither does it expect a nullptr. so pass by const reference.

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agomgr/DaemonServer: use ref_t<M>
Kefu Chai [Mon, 15 Apr 2019 06:01:00 +0000 (14:01 +0800)]
mgr/DaemonServer: use ref_t<M>

to avoid explicit use of RefCountedObj interface. and let
intrusive_ptr<> to take care of the life cycle of messages.

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agomsg/Message: remove Message::const_ref
Kefu Chai [Mon, 15 Apr 2019 02:26:40 +0000 (10:26 +0800)]
msg/Message: remove Message::const_ref

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agocommon: use ref_t<M>
Kefu Chai [Tue, 16 Apr 2019 04:13:48 +0000 (12:13 +0800)]
common: use ref_t<M>

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agomsg/Message: drop MessageFactory and friends
Kefu Chai [Sun, 14 Apr 2019 15:33:50 +0000 (23:33 +0800)]
msg/Message: drop MessageFactory and friends

we'd better decouple the helpers from the definition of Message types,
to keep the definition Messages simple and concise.

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agomessages/MOSDPeeringOp: do not include PGPeeringEvent.h
Kefu Chai [Sun, 14 Apr 2019 15:32:41 +0000 (23:32 +0800)]
messages/MOSDPeeringOp: do not include PGPeeringEvent.h

forward delcaration would suffice

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agomessages: do not use MessageSubType anymore
Kefu Chai [Sun, 14 Apr 2019 15:31:24 +0000 (23:31 +0800)]
messages: do not use MessageSubType anymore

so we can drop it in future commit

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agomessages: #include necessary header
Kefu Chai [Sun, 14 Apr 2019 15:28:28 +0000 (23:28 +0800)]
messages: #include necessary header

for instance, MLogRec is defined in PGPeeringEvent.h, we should not rely
other header(s) to do this for us. so just #include PGPeeringEvent.h for
its definition.

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agomds/MDSCache: init empty string_view with {}
Kefu Chai [Sun, 14 Apr 2019 07:49:00 +0000 (15:49 +0800)]
mds/MDSCache: init empty string_view with {}

nullptr is not a valid null-terminated character sequence

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agosrc/: use make_message<Foo> instead of Foo::create()
Kefu Chai [Sun, 14 Apr 2019 07:01:57 +0000 (15:01 +0800)]
src/: use make_message<Foo> instead of Foo::create()

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agomsg/Message: remove msgref_cast()
Kefu Chai [Sun, 14 Apr 2019 06:19:58 +0000 (14:19 +0800)]
msg/Message: remove msgref_cast()

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agomsg/Message: add aliases for static_pointer_cast
Kefu Chai [Sun, 14 Apr 2019 06:03:28 +0000 (14:03 +0800)]
msg/Message: add aliases for static_pointer_cast

strictly speaking, they are not "alias" of boost::static_pointer_cast,
but to avoid an extra conversion, instead of using
boost::static_pointer_cast<>, i am using std::static_cast<> directly for
creating boost::intrusive_ptr<> instance.

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agoclient,mds: use ref_cast<Foo> instead of Foo::msgref_cast
Kefu Chai [Sun, 14 Apr 2019 04:34:24 +0000 (12:34 +0800)]
client,mds: use ref_cast<Foo> instead of Foo::msgref_cast

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agosrc/: use ref_t<Message> instead of Message::ref
Kefu Chai [Sun, 14 Apr 2019 05:18:00 +0000 (13:18 +0800)]
src/: use ref_t<Message> instead of Message::ref

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agosrc/: use cref_t<Message> instead of Message::const_ref
Kefu Chai [Sun, 14 Apr 2019 04:33:57 +0000 (12:33 +0800)]
src/: use cref_t<Message> instead of Message::const_ref

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agocommon/RefCountedObj: move private members
Patrick Donnelly [Wed, 6 Feb 2019 19:44:04 +0000 (11:44 -0800)]
common/RefCountedObj: move private members

To follow code-style guidelines.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agocommon/RefCountedObj: use type of nref
Patrick Donnelly [Wed, 6 Feb 2019 17:42:27 +0000 (09:42 -0800)]
common/RefCountedObj: use type of nref

"int" may narrow the ref count (although very unlikely!).

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agomsg: add aliases of ref_t and cref_t
Kefu Chai [Sun, 14 Apr 2019 05:18:27 +0000 (13:18 +0800)]
msg: add aliases of ref_t and cref_t

Signed-off-by: Kefu Chai <kchai@redhat.com>