]>
git.apps.os.sepia.ceph.com Git - ceph.git/log
Andrew Schoen [Wed, 14 Nov 2018 16:35:32 +0000 (10:35 -0600)]
ceph-volume: update tests after removing the LVPath arg validator
Signed-off-by: Andrew Schoen <aschoen@redhat.com>
Resolves: rm#27062
(cherry picked from commit
0cb95ace88a731f7c30adf3f2286691fa3b2c49c )
Andrew Schoen [Tue, 13 Nov 2018 19:02:39 +0000 (13:02 -0600)]
ceph-volume: return lvs as vg/lv from ValidDevice if as_string is True
All code in prepare and activate expect lvs to be in that format.
Eventually we can refactor all that to use the Device class as well.
Signed-off-by: Andrew Schoen <aschoen@redhat.com>
Resolves: rm#27062
(cherry picked from commit
fdf7f3c575299b6be0ac40fb6eee5106cea010c9 )
Andrew Schoen [Tue, 13 Nov 2018 18:40:45 +0000 (12:40 -0600)]
ceph-volume: adds lv_name property to Device class
Signed-off-by: Andrew Schoen <aschoen@redhat.com>
Resolves: rm#27062
(cherry picked from commit
cc0317efac5a3a25edcdb48af2a63a969c2ac43a )
Andrew Schoen [Tue, 13 Nov 2018 18:28:23 +0000 (12:28 -0600)]
ceph-volume: combine the LVPath arg validator with ValidDevice
This combines the two arg validators and makes both batch and
prepare/active both use ValidDevice.
This will also allow us to use lvs with a full path, like
/dev/vg/lv instead of always enforcing vg/lv.
Signed-off-by: Andrew Schoen <aschoen@redhat.com>
Resolves: rm#27062
(cherry picked from commit
d6a5a7606c3a0c1f1624c5784abb02bb1a4e1620 )
Andrew Schoen [Tue, 13 Nov 2018 18:27:19 +0000 (12:27 -0600)]
ceph-volume: adds has_gpt_headers property to Device class
Signed-off-by: Andrew Schoen <aschoen@redhat.com>
Resolves: rm#27062
(cherry picked from commit
568a0ce5be0161541772ceacb9b81652f51659f5 )
Andrew Schoen [Tue, 13 Nov 2018 15:35:21 +0000 (09:35 -0600)]
ceph-volume: add PTTYPE to blkid parser
Signed-off-by: Andrew Schoen <aschoen@redhat.com>
Resolves: rm#27062
(cherry picked from commit
3d86d2dda9fae87e143e5212d5f354a22f02909d )
Andrew Schoen [Tue, 13 Nov 2018 16:11:59 +0000 (10:11 -0600)]
Merge pull request #25066 from alfredodeza/mimic-rm36768
mimic ceph-volume: patch Device when testing
Reviewed-by: Andrew Schoen <aschoen@redhat.com>
Yuri Weinstein [Mon, 12 Nov 2018 20:25:21 +0000 (12:25 -0800)]
Merge pull request #24467 from vshankar/wip-26991
mimic: mds: curate priority of perf counters sent to mgr
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Alfredo Deza [Mon, 12 Nov 2018 17:57:26 +0000 (12:57 -0500)]
ceph-volume tests patch Device() by splitting parametrized method
This was causing failures on systems where there is no LVM or where the
device names don't match. Patching is always recommended to avoid
conflicts with the system testing
Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit
82d96f876484c9668e2fc4726057691ba2c50f06 )
Alfredo Deza [Mon, 12 Nov 2018 17:56:42 +0000 (12:56 -0500)]
ceph-volume tests inventory should patch before using .get_devices()
Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit
7ee7a59910c9837659419c235f669a53cc9f613c )
Yuri Weinstein [Mon, 12 Nov 2018 17:13:24 +0000 (09:13 -0800)]
Merge pull request #24931 from jonsger/mimic-backport-pr#24700
mimic: rgw: support server-side encryption when SSL is terminated in a proxy
Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Alfredo Deza [Mon, 12 Nov 2018 13:37:18 +0000 (08:37 -0500)]
Merge pull request #25013 from alfredodeza/mimic-ceph-volume-inventory
mimic ceph-volume: add inventory command
Reviewed-by: Jan Fajerski <jfajerski@suse.com>
Andrew Schoen [Fri, 9 Nov 2018 22:09:38 +0000 (16:09 -0600)]
Merge pull request #25011 from alfredodeza/mimic-rm36470
mimic ceph-volume enable --no-systemd flag for simple sub-command
Reviewed-by: Andrew Schoen <aschoen@redhat.com>
Jan Fajerski [Wed, 31 Oct 2018 13:59:05 +0000 (14:59 +0100)]
ceph-volume: add inventory command
The inventory command provides information about a nodes disk inventory.
Existing logical volumes on a disk or one of its partitions are scanned
and reported.
The output can be formatted as plain text or json.
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit
57adfc6bb8abd9fc84b1378d5f69a16994d19e11 )
Alfredo Deza [Fri, 9 Nov 2018 20:16:28 +0000 (15:16 -0500)]
Merge pull request #24980 from alfredodeza/mimic-bz1644265
mimic ceph-volume util.encryption robust blkid+lsblk detection of lockbox
Reviewed-by: Andrew Schoen <aschoen@redhat.com>
Alfredo Deza [Thu, 8 Nov 2018 19:14:17 +0000 (14:14 -0500)]
ceph-volume tests ensure activate behavior with systemd disabling
Signed-off-by: Alfredo Deza <alfredo@deza.pe>
(cherry picked from commit
3e80118ccaccaa61e92b01f4f389d6056401d8a7 )
Alfredo Deza [Thu, 8 Nov 2018 19:13:52 +0000 (14:13 -0500)]
ceph-volume simple.activate factor out systemd interactions for easier testing
Signed-off-by: Alfredo Deza <alfredo@deza.pe>
(cherry picked from commit
18ddd962116b5359af770088535f502797ac79c4 )
Alfredo Deza [Thu, 8 Nov 2018 14:14:24 +0000 (09:14 -0500)]
ceph-volume simple.trigger replace systemd with from_trigger keyword argument
Signed-off-by: Alfredo Deza <alfredo@deza.pe>
(cherry picked from commit
9526587403b76fa5397ae80b63328e3a59765c2e )
Alfredo Deza [Thu, 8 Nov 2018 14:13:31 +0000 (09:13 -0500)]
ceph-volume simple.activate allow a --no-systemd flag to skip systemctl actions
Signed-off-by: Alfredo Deza <alfredo@deza.pe>
(cherry picked from commit
4d9ad0d3d4bedd5efa95653fbb86607f0b469174 )
Alfredo Deza [Fri, 2 Nov 2018 19:03:45 +0000 (15:03 -0400)]
ceph-volume util.encryption robust blkid+lsblk detection of lockbox
Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit
fc3e6ea3d9200e0fe2a3aa2576fcd45db223c277 )
Alfredo Deza [Wed, 7 Nov 2018 11:47:51 +0000 (06:47 -0500)]
Merge pull request #24959 from alfredodeza/mimic-rm36672
mimic ceph-volume tests install ceph-ansible's requirements.txt dependencies
Reviewed-by: Andrew Schoen <aschoen@redhat.com>
Alfredo Deza [Thu, 1 Nov 2018 12:48:28 +0000 (08:48 -0400)]
ceph-volume tests install ceph-ansible's requirements.txt dependencies
Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit
52ddb69813c5849506db5f850a3f2532ff1124b5 )
Andrew Schoen [Tue, 6 Nov 2018 21:24:20 +0000 (15:24 -0600)]
Merge pull request #24957 from alfredodeza/mimic-rm36704
mimic: ceph-volume tests.systemd update imports for systemd module
Reviewed-by: Andrew Schoen <aschoen@redhat.com>
Alfredo Deza [Tue, 6 Nov 2018 14:45:08 +0000 (09:45 -0500)]
ceph-volume tests.systemd update imports for systemd module
Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit
a63a6c86a03738bf50fa71a490951343a83afff6 )
Alfredo Deza [Tue, 6 Nov 2018 14:44:39 +0000 (09:44 -0500)]
ceph-volume systemd import main so console_scripts work for executable
Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit
280e2baab27cc061d2d5e456f098cd3405f36873 )
Andrew Schoen [Tue, 6 Nov 2018 21:06:30 +0000 (15:06 -0600)]
Merge pull request #24826 from alfredodeza/mimic-rm36246
mimic ceph-volume util.encryption don't push stderr to terminal
Reviewed-by: Andrew Schoen <aschoen@redhat.com>
Andrew Schoen [Tue, 6 Nov 2018 20:33:44 +0000 (14:33 -0600)]
Merge pull request #24852 from ceph/mimic-rm36648
mimic ceph-volume systemd import main so console_scripts work for executable
Reviewed-by: Andrew Schoen <aschoen@redhat.com>
Alfredo Deza [Tue, 30 Oct 2018 19:50:28 +0000 (15:50 -0400)]
ceph-volume systemd import main so console_scripts work for executable
Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit
0bcda52566279404b88184b2ce7b2200d581b0b7 )
Andrew Schoen [Tue, 6 Nov 2018 19:51:01 +0000 (13:51 -0600)]
Merge pull request #24838 from alfredodeza/mimic-no-scripts
mimic ceph-volume: use console_scripts
Reviewed-by: Andrew Schoen <aschoen@redhat.com>
Venky Shankar [Mon, 30 Jul 2018 05:47:02 +0000 (01:47 -0400)]
mds: include session uptime when diplaying session list
Fixes: https://tracker.ceph.com/issues/35938
Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit
b23a204cdde2bc5f34304cca3f1bac3496cf7a41 )
Venky Shankar [Tue, 24 Jul 2018 03:47:02 +0000 (23:47 -0400)]
mds: track average uptime of sessions
Average session age math improvements by Patrick.
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit
d2627b98d0c1477d664d00384ef033d323b26957 )
Conflicts:
src/mds/SessionMap.h
Patrick Donnelly [Fri, 17 Aug 2018 22:03:56 +0000 (15:03 -0700)]
mds: use monotonic waits in Beacon
This guarantees that the sender thread cannot be disrupted by system clock
changes. This commit also simplifies the sender thread by manually managing the
thread and avoiding unnecessary context creation.
Fixes: http://tracker.ceph.com/issues/32090
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit
a5fc29b95281c6ca58c9177c665c379846beb4b3 )
Conflicts:
src/mds/Beacon.cc
Patrick Donnelly [Fri, 17 Aug 2018 04:28:12 +0000 (21:28 -0700)]
mds: use monotonic clock in beacon
Also update other parts of MDS which interact.
Fixes: http://tracker.ceph.com/issues/35837
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit
e77a2f5da71f1ba62b69b8d0fb9f34abe426da79 )
Conflicts:
src/mds/Beacon.cc
src/mds/MDCache.h
src/mds/MDSRank.cc
src/mds/MDSRank.h
src/mds/Server.cc
Patrick Donnelly [Fri, 17 Aug 2018 04:26:41 +0000 (21:26 -0700)]
mds: simplify beacon init
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit
b7448f8fe0e4d12dd1070de4c3380e21d9da310a )
Conflicts:
src/mds/Beacon.cc
Venky Shankar [Fri, 22 Jun 2018 05:43:37 +0000 (01:43 -0400)]
mds: reorganize and curate perf log counters
Categorize perf counters into high (PRIO_{CRITICAL/INTERESTING}),
medium (PRIO_USEFUL) and low priority (PRIO_DEBUGONLY). High and
medium priority stats are transmitted to ceph mgr and included in
prometheus output.
Signed-off-by: Venky Shankar <vshankar@redhat.com>
Fixes: http://tracker.ceph.com/issues/26991
(cherry picked from commit
48a33f6f06802fee998f60a2ec35d9041a7c51a6 )
Conflicts:
src/mds/Server.cc
Venky Shankar [Wed, 4 Jul 2018 09:44:57 +0000 (05:44 -0400)]
mds: show session load average in dump session
Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit
682dc08cbd521342b4abc45fd85edb2dd7bc5682 )
Venky Shankar [Tue, 3 Jul 2018 12:06:39 +0000 (08:06 -0400)]
mds: allow request load average decay rate configurable via admin socket
Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit
3809d96a5b53721b88602d662c4c1cd00dd727a0 )
Conflicts:
src/mds/MDSDaemon.cc
src/mds/MDSRank.h
Venky Shankar [Tue, 3 Jul 2018 12:04:56 +0000 (08:04 -0400)]
mds: decay counter for tracking request load average
Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit
816d8aaea01aef81467e3df7a4b3ab3eff86d27a )
Conflicts:
src/mds/SessionMap.cc
src/common/options.cc
Venky Shankar [Wed, 27 Jun 2018 08:05:49 +0000 (04:05 -0400)]
mds: add perf counters to track current open/stale sessions
Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit
315aa47a07429ba0a47fbd40078f0e8fd16b9ffd )
Casey Bodley [Mon, 22 Oct 2018 18:16:59 +0000 (14:16 -0400)]
rgw: aws:SecureTransport uses rgw_transport_is_secure()
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit
e515d92 )
Signed-off-by: Jonathan Brielmaier <jbrielmaier@suse.de>
Casey Bodley [Mon, 22 Oct 2018 18:14:44 +0000 (14:14 -0400)]
rgw: SSE operations check rgw_transport_is_secure()
Fixes: http://tracker.ceph.com/issues/27221
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit
8f94643 )
Signed-off-by: Jonathan Brielmaier <jbrielmaier@suse.de>
Casey Bodley [Mon, 22 Oct 2018 18:13:21 +0000 (14:13 -0400)]
rgw: add helper function rgw_transport_is_secure()
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit
73d355f )
Signed-off-by: Jonathan Brielmaier <jbrielmaier@suse.de>
Conflicts:
src/rgw/rgw_common.cc: state below inserted function
Casey Bodley [Mon, 22 Oct 2018 15:04:55 +0000 (11:04 -0400)]
common: add config option rgw_trust_forwarded_https
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit
d3dd5a9 )
Signed-off-by: Jonathan Brielmaier <jbrielmaier@suse.de>
Yuri Weinstein [Sun, 4 Nov 2018 14:31:25 +0000 (06:31 -0800)]
Merge pull request #24873 from trociny/wip-36643-mimic
mimic: osdc: reduce ObjectCacher's memory fragments
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Yuri Weinstein [Fri, 2 Nov 2018 14:51:43 +0000 (07:51 -0700)]
Merge pull request #24860 from jonsger/mimic-backport-pr#23242
mimic: rgw: set default objecter_inflight_ops = 24576
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Yuri Weinstein [Thu, 1 Nov 2018 19:40:23 +0000 (12:40 -0700)]
Merge pull request #24811 from dillaman/wip-36569-mimic
mimic: qa/tasks/qemu: use unique clone directory to avoid race with workunit
Reviewed-by: Nathan Cutler <ncutler@suse.com>
Yuri Weinstein [Thu, 1 Nov 2018 16:59:04 +0000 (09:59 -0700)]
Merge pull request #24443 from smithfarm/wip-26850-mimic
mimic: ceph_volume_client: py3 compatible
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Yan, Zheng [Thu, 27 Sep 2018 05:10:55 +0000 (13:10 +0800)]
osdc: reduce ObjectCacher's memory fragments
Fixes: http://tracker.ceph.com/issues/36192
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
(cherry picked from commit
5d4f82117ed20f7a40259c3f5471e7a96a4c456f )
Conflicts:
src/osdc/ObjectCacher.cc: trivial
Matt Benjamin [Wed, 25 Jul 2018 20:06:33 +0000 (16:06 -0400)]
rgw: set default objecter_inflight_ops = 24576
Fixes: http://tracker.ceph.com/issues/25109
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
(cherry picked from commit
102c5bd )
Signed-off-by: Jonathan Brielmaier <jbrielmaier@suse.de>
Yuri Weinstein [Tue, 30 Oct 2018 19:46:11 +0000 (12:46 -0700)]
Merge pull request #24745 from smithfarm/wip-36592-mimic
mimic: segv in BlueStore::OldExtent::create
Reviewed-by: Sage Weil <sage@redhat.com>
Yuri Weinstein [Tue, 30 Oct 2018 19:45:17 +0000 (12:45 -0700)]
Merge pull request #24488 from tspmelo/wip-24907-mimic
mimic: mgr/dashboard: Add support for URI encode
Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Ricardo Dias <rdias@suse.com>
Mehdi Abaakouk [Fri, 26 Oct 2018 09:59:55 +0000 (11:59 +0200)]
ceph-volume: use console_scripts
Using "#!/usr/bin/env python" is not recommended as it's not portable.
setuptools provides an console_scripts entry_point that generates
scripts that always have the good sheban whatever the target operating
system and python version/distribution.
http://tracker.ceph.com/issues/36601
Signed-off-by: Mehdi Abaakouk <sileht@sileht.net>
(cherry picked from commit
6a2ed6c285b74f463f223d3501def8ef4e6283b1 )
Yuri Weinstein [Tue, 30 Oct 2018 17:07:49 +0000 (10:07 -0700)]
Merge pull request #24435 from smithfarm/wip-32092-mimic
mimic: mds: migrate strays part by part when shutdown mds
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Yan, Zheng <zyan@redhat.com>
Yuri Weinstein [Tue, 30 Oct 2018 16:49:19 +0000 (09:49 -0700)]
Merge pull request #24485 from ukernel/mimic-36346
mimic: Revert "mimic: cephfs-journal-tool: enable purge_queue journal's event commands"
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Yuri Weinstein [Tue, 30 Oct 2018 16:48:40 +0000 (09:48 -0700)]
Merge pull request #24572 from pdvian/wip-36280-mimic
mimic: qa: tolerate failed rank while waiting for state
Reviewed-by: Yan, Zheng <zyan@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Yuri Weinstein [Tue, 30 Oct 2018 16:48:08 +0000 (09:48 -0700)]
Merge pull request #24583 from smithfarm/wip-24933-mimic
mimic: cephfs-journal-tool: wrong layout info used
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Yan, Zheng <zyan@redhat.com>
Yuri Weinstein [Tue, 30 Oct 2018 16:47:34 +0000 (09:47 -0700)]
Merge pull request #24661 from vshankar/wip-35975
mimic: mds: evict cap revoke non-responding clients
Reviewed-by: Yan, Zheng <zyan@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Yuri Weinstein [Tue, 30 Oct 2018 16:46:31 +0000 (09:46 -0700)]
Merge pull request #24684 from smithfarm/wip-36501-mimic
mimic: qa: increase rm timeout for workunit cleanup
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Yan, Zheng <zyan@redhat.com>
Alfredo Deza [Wed, 3 Oct 2018 12:31:20 +0000 (08:31 -0400)]
ceph-volume util.encryption don't push stderr to terminal when cryptsetup fails to find device
Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit
40f919850fddd14659243c47860224981439906a )
Jason Dillaman [Mon, 22 Oct 2018 14:44:40 +0000 (10:44 -0400)]
qa/tasks/qemu: use unique clone directory to avoid race with workunit
If there is a workunit task associated with the same client, the two
tasks will attempt to clone the suite repo to the same directory.
Worse, if it's parallel tasks, the two clones will clobber each
other.
Fixes: http://tracker.ceph.com/issues/36542
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit
5d56014c61b107dcb5d05c2221c2e844324f304c )
Yuri Weinstein [Mon, 29 Oct 2018 20:21:12 +0000 (16:21 -0400)]
Merge pull request #24708 from smithfarm/wip-26839-mimic
mimic: librados application's symbol could conflict with the libceph-common
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Yuri Weinstein [Mon, 29 Oct 2018 20:20:22 +0000 (16:20 -0400)]
Merge pull request #24710 from smithfarm/wip-35977-mimic
mimic: multisite: incremental data sync makes unnecessary call to RGWReadRemoteDataLogShardInfoCR
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Yuri Weinstein [Mon, 29 Oct 2018 20:19:06 +0000 (16:19 -0400)]
Merge pull request #24734 from b-ranto/wip-mimic-http
mimic: mgr/dashboard: Add http support to dashboard
Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
Yuri Weinstein [Mon, 29 Oct 2018 20:17:17 +0000 (16:17 -0400)]
Merge pull request #23916 from liewegas/wip-pod-hostname-mimic
mimic: common: get real hostname from container/pod environment
Reviewed-by: Kefu Chai <kchai@redhat.com>
Yuri Weinstein [Mon, 29 Oct 2018 20:16:09 +0000 (16:16 -0400)]
Merge pull request #24260 from tchaikov/mimic-35969
mimic: rpm: use updated gperftools
Reviewed-by: Nathan Cutler <ncutler@suse.com>
Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
Yuri Weinstein [Mon, 29 Oct 2018 20:14:51 +0000 (16:14 -0400)]
Merge pull request #24431 from smithfarm/wip-35936-mimic
mimic: OSDMapMapping does not handle active.size() > pool size
Reviewed-by: Sage Weil <sage@redhat.com>
Yuri Weinstein [Mon, 29 Oct 2018 20:14:13 +0000 (16:14 -0400)]
Merge pull request #24478 from tspmelo/wip-27851-mimic
mimic: mgr/dashboard: Remove fieldsets when using CdTable
Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
Yuri Weinstein [Mon, 29 Oct 2018 20:12:47 +0000 (16:12 -0400)]
Merge pull request #24622 from dillaman/wip-36430-mimic
mimic: qa/workunits: replace 'realpath' with 'readlink -f' in fsstress.sh
Reviewed-by: Yuri Weinstein <yweins@redhat.com>
Yuri Weinstein [Mon, 29 Oct 2018 20:11:38 +0000 (16:11 -0400)]
Merge pull request #24551 from pdvian/wip-36276-mimic
mimic: test/rbd_mirror: race in WaitingOnLeaderReleaseLeader
Reviewed-by: Mykola Golub <mgolub@mirantis.com>
Yuri Weinstein [Mon, 29 Oct 2018 20:09:47 +0000 (16:09 -0400)]
Merge pull request #24647 from liewegas/wip-pr-23273-mimic
mimic: os/bluestore: handle spurious read errors
Reviewed-by: Igor Fedotov <ifedotov@suse.com>
Yuri Weinstein [Mon, 29 Oct 2018 20:07:53 +0000 (16:07 -0400)]
Merge pull request #24711 from smithfarm/wip-36238-mimic
mimic: [test] periodic seg faults within unittest_librbd
Reviewed-by: Mykola Golub <mgolub@mirantis.com>
Andrew Schoen [Mon, 29 Oct 2018 15:44:30 +0000 (10:44 -0500)]
Merge pull request #24782 from alfredodeza/mimic-evelu-ceph-volume-choose_disk
mimic Additional work on ceph-volume to add some choose_disk capabilities
Reviewed-by: Andrew Schoen <aschoen@redhat.com>
Yan, Zheng [Mon, 29 Oct 2018 02:11:35 +0000 (10:11 +0800)]
doc: v13.2.3 release notes for wrong mds backport
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
Erwan Velu [Wed, 10 Oct 2018 18:26:01 +0000 (20:26 +0200)]
ceph_volume: Checking device validity at init time
When initializing the Device structure, it have to run is_valid() to
ensure the data structures (_is_valid & rejected_reasons) to be
populated accordingly to the device state.
Signed-off-by: Erwan Velu <erwan@redhat.com>
(cherry picked from commit
ef0ceef7c717ef615dc214299cb4a6b32c1edbe6 )
Erwan Velu [Tue, 9 Oct 2018 20:51:39 +0000 (22:51 +0200)]
ceph_volume: Rejecting locked devices
If we cannot open a block device in O_RDWR in exclusive mode, it means
someone is actually using it like a raw database or similar.
In that case, the device should be considered as unusable as OSDs will
not be in a position to use it.
Signed-off-by: Erwan Velu <erwan@redhat.com>
(cherry picked from commit
d5de9583ee6c4d9ccaab2b1146606a0ee316cc27 )
Erwan Velu [Tue, 9 Oct 2018 20:28:19 +0000 (22:28 +0200)]
ceph_volume: Reporting nr_requests
We are already reporting the rotational & scheduler of a disk device.
Reporting the nr_requests could be useful to get how many concurrent IOs
the device supports/reports.
That could help detecting badly detected/configured devices.
Signed-off-by: Erwan Velu <erwan@redhat.com>
(cherry picked from commit
e0ea3d475a85844afdcdf92cf638b8128c8e2d9e )
Erwan Velu [Tue, 9 Oct 2018 20:26:28 +0000 (22:26 +0200)]
ceph_volume: Reporting firmware revision
We are already reporting model & vendor of a given disk, let's also
report the revision of the firmware. That is useful to filter-out some
known broken revisions.
Signed-off-by: Erwan Velu <erwan@redhat.com>
(cherry picked from commit
59720794079bef0ba7f8bc2d9dfc8aaddd210005 )
Erwan Velu [Tue, 9 Oct 2018 20:02:31 +0000 (22:02 +0200)]
ceph_volume: Rejecting Read-only devices
If a devices is said to be read-only, there is no chance we can actually
use it. So let's report it as unusable.
Signed-off-by: Erwan Velu <erwan@redhat.com>
(cherry picked from commit
f1a94350064263f27f67d2c715c5ca5922481a01 )
Erwan Velu [Tue, 9 Oct 2018 19:04:02 +0000 (21:04 +0200)]
ceph_volume: Adding Device.is_valid()
A block device can be filtered-out/ignored because it have features that
doesn't match Ceph's expectations.
As of today, the current code was rejected removable devices but it was
pretty hidden from the user, and implicit in the get_devices() function.
This patch is creating a new is_valid() function to perform all the
rejection tests and returns if this device can be used in the Ceph
context or not.
If is_valid() is returning False, the 'rejected_reasons' list reports all
the reasons why that devices got rejected.
Signed-off-by: Erwan Velu <erwan@redhat.com>
(cherry picked from commit
d8fdf0b7532cdffcae56511c377679e51841caec )
Andrew Schoen [Fri, 26 Oct 2018 20:00:08 +0000 (15:00 -0500)]
Merge pull request #24449 from alfredodeza/mimic-rm24795
mimic ceph-volume lvm.prepare update help to indicate partitions are needed, not devices
Reviewed-by: Andrew Schoen <aschoen@redhat.com>
Alfredo Deza [Fri, 26 Oct 2018 13:46:57 +0000 (09:46 -0400)]
Merge pull request #24760 from ceph/backport-mimic-24587
mimic: ceph-volume: adds a --prepare flag to `lvm batch`
Reviewed-by: Alfredo Deza <adeza@redhat.com>
Alfredo Deza [Wed, 3 Oct 2018 12:11:58 +0000 (08:11 -0400)]
ceph-volume lvm.prepare update help to indicate partitions are needed, not devices
Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit
d31dd95b95445825f5e6669dd4ecb3118b09fdcf )
Andrew Schoen [Thu, 25 Oct 2018 12:51:41 +0000 (07:51 -0500)]
ceph-volume: update man page for batch --prepare
Signed-off-by: Andrew Schoen <aschoen@redhat.com>
(cherry picked from commit
faa3aed4ad4df2dbdd853235e364d6e3b9b176b6 )
Andrew Schoen [Mon, 15 Oct 2018 15:38:43 +0000 (10:38 -0500)]
ceph-volume: docs for --prepare flag of lvm batch
Signed-off-by: Andrew Schoen <aschoen@redhat.com>
(cherry picked from commit
b4825e1bd7b75a0a53ee5678230b262286293d75 )
Andrew Schoen [Mon, 15 Oct 2018 15:35:12 +0000 (10:35 -0500)]
ceph-volume: when --prepare is added to batch the OSDs are only prepared
Signed-off-by: Andrew Schoen <aschoen@redhat.com>
(cherry picked from commit
abd238dc1f33252a43adc8b86efb3d3b4a076964 )
Andrew Schoen [Mon, 15 Oct 2018 14:33:30 +0000 (09:33 -0500)]
ceph-volume: adds a --prepare flag to ceph-volume lvm batch
This flag will only prepare the OSDs, not activate them. This is useful
in our containerized ceph solution.
Signed-off-by: Andrew Schoen <aschoen@redhat.com>
(cherry picked from commit
4368ca7d48f4ce35f67854e8b0ca2be9babc5371 )
Andrew Schoen [Thu, 25 Oct 2018 16:10:47 +0000 (11:10 -0500)]
Merge pull request #24753 from alfredodeza/mimic-rm36386
mimic ceph-volume remove version reporting from help menu
Reviewed-by: Andrew Schoen <aschoen@redhat.com>
Alfredo Deza [Wed, 10 Oct 2018 19:35:31 +0000 (15:35 -0400)]
ceph-volume remove version reporting from help menu
Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit
20db7bf585f6433c6705396264005a4227cbf2e3 )
Alfredo Deza [Thu, 25 Oct 2018 12:04:34 +0000 (08:04 -0400)]
Merge pull request #24740 from alfredodeza/mimic-rm36492
mimic ceph-volume: do not send (lvm) stderr/stdout to the terminal, use the logfile
Reviewed-by: Andrew Schoen <aschoen@redhat.com>
Alfredo Deza [Wed, 24 Oct 2018 14:55:06 +0000 (10:55 -0400)]
ceph-volume tests.api update monkeypatching to use **kw
Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit
6d6bcda75f846bc7c44c7b16b3687a65fed7cafc )
Alfredo Deza [Wed, 24 Oct 2018 14:54:48 +0000 (10:54 -0400)]
ceph-volume tests allow **kw when monkeypatching
Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit
04e51c956eadcbd38f39ec3dd4b78009d2cd4a70 )
Alfredo Deza [Wed, 24 Oct 2018 14:54:18 +0000 (10:54 -0400)]
ceph-volume api.lvm: do not spit out errors on the terminal from LVM
Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit
581eed36ea0e7b5c5e41f8b83350403bcf73a31a )
Alfredo Deza [Wed, 24 Oct 2018 21:22:50 +0000 (17:22 -0400)]
Merge pull request #24588 from ceph/backport-mimic-24404
mimic: ceph-volume: make `lvm batch` idempotent
Reviewed-by: Alfredo Deza <adeza@redhat.com>
Sage Weil [Mon, 22 Oct 2018 19:38:48 +0000 (14:38 -0500)]
os/bluestore: fix race between SharedBlobSet::lookup and SharedBlob::put
A B
SharedBlobSet::lookup()
takes lock
nref is not 0
SharedBlob::put()
--nref
returns SharedBlobRef,
++nref
takes cache lock
SharedBlobSet::remove
takes lock
removes
deletes SharedBlob
-> A ends up with a ref to deleted SharedBlob
Fix by verifying that nref is still zero in SharedBlobSet::remove(),
while we are holding the SharedBlobSet::lock. The lock ensures that we
have increased the ref for the lookup before entering remove, so we can
verify that nref is still zero before removing it. If not, we have
raced, and put() bails out and does nothing.
Fixes: http://tracker.ceph.com/issues/36526
Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit
020bd7b5f38a82d9eef5e25e6f4a4dd12b066915 )
Conflicts:
src/os/bluestore/BlueStore.h
Jason Dillaman [Wed, 26 Sep 2018 18:39:25 +0000 (14:39 -0400)]
librbd: object copy state machine might dereference a deleted object
Fixes: http://tracker.ceph.com/issues/36220
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit
1a9c3be2ceffcb981910de429a7da0fbec43e643 )
Nathan Cutler [Tue, 23 Oct 2018 06:26:55 +0000 (08:26 +0200)]
Merge pull request #24441 from joscollin/wip-36313-mimic
mimic: doc: fix broken fstab url in cephfs/fuse
Reviewed-by: Nathan Cutler <ncutler@suse.com>
Brad Hubbard [Tue, 16 Oct 2018 01:57:05 +0000 (11:57 +1000)]
rpm: Use updated gperftools-libs at runtime
Due to ABI breakage in libtcmalloc.so.4 we need to specify the minimum
version to be used at runtime to be greater than or equal to the version
used at build time.
Fixes: http://tracker.ceph.com/issues/36508
Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
(cherry picked from commit
24636267f957ff9518396ac1b8212f2402286d82 )
Kefu Chai [Mon, 17 Sep 2018 06:09:17 +0000 (14:09 +0800)]
rpm: use updated gperftools
make sure we only build with the higher version of gperftools on
distros where both 2.4 and 2.6.1 are packaged. see
https://git.centos.org/summary/rpms!gperftools.git . at the time of
writing, gperftools 2.6.1 is packaged for CentOS/RHEL 7, if gperftools
(>= 2.4) is required by Ceph, and user already has this version
installed, when new Ceph packages are installed, the updated gperftools
2.6.1 version won't be installed as a dependency. when launching
Ceph compiled with tcmalloc enabled, we will have
symbol lookup error: ceph-osd: undefined symbol: _ZdaPvm
so, by bumping up the required version of gperftools, the updated
gperftools will be installed.
see https://software.opensuse.org/package/gperftools, openSUSE/SLE offer
2.5. so they are safe at this moment.
Fixes: http://tracker.ceph.com/issues/35969
Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit
e69e50a859acebe0bf854c12a71bfe745e0c1cf6 )
Casey Bodley [Wed, 15 Aug 2018 20:09:43 +0000 (16:09 -0400)]
rgw: remove unused query for remote datalog info
Fixes: http://tracker.ceph.com/issues/26952
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit
a543df729a6ca415648678e2ae2ed46eceaba086 )
Conflicts:
src/rgw/rgw_data_sync.cc
- trivial whitespace
Casey Bodley [Wed, 15 Aug 2018 20:07:32 +0000 (16:07 -0400)]
rgw: remove unused datalog trim detection logic
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit
0d47743e0f6b9f51848056885831910d0ea5b282 )