]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
6 years agoMerge pull request #24912 from smithfarm/wip-36539-mimic
Yuri Weinstein [Tue, 20 Nov 2018 17:10:15 +0000 (09:10 -0800)]
Merge pull request #24912 from smithfarm/wip-36539-mimic

mimic: use-after-free from RGWRadosGetOmapKeysCR::~RGWRadosGetOmapKeysCR

Reviewed-by: Casey Bodley <cbodley@redhat.com>
6 years agoMerge pull request #25079 from jonsger/wip-36734-mimic
Yuri Weinstein [Tue, 20 Nov 2018 17:09:48 +0000 (09:09 -0800)]
Merge pull request #25079 from jonsger/wip-36734-mimic

mimic: rgw: beast frontend fails to parse ipv6 endpoints

Reviewed-by: Casey Bodley <cbodley@redhat.com>
6 years agoMerge pull request #25085 from smithfarm/wip-37153-mimic
Yuri Weinstein [Tue, 20 Nov 2018 17:09:21 +0000 (09:09 -0800)]
Merge pull request #25085 from smithfarm/wip-37153-mimic

mimic: tests: ceph-admin-commands.sh workunit does not log what it's doing

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
6 years agoMerge pull request #25087 from jonsger/wip-36756-mimic
Yuri Weinstein [Tue, 20 Nov 2018 17:08:41 +0000 (09:08 -0800)]
Merge pull request #25087 from jonsger/wip-36756-mimic

mimic: rgw-admin: reshard add can add a non existant bucket

Reviewed-by: Casey Bodley <cbodley@redhat.com>
6 years agoMerge pull request #25133 from alfredodeza/mimic-c-v-dont-duplicated-rejected-reasons
Alfredo Deza [Fri, 16 Nov 2018 18:02:42 +0000 (13:02 -0500)]
Merge pull request #25133 from alfredodeza/mimic-c-v-dont-duplicated-rejected-reasons

mimic ceph-volume: rename Device property valid to available

Reviewed-by: Jan Fajerski <jfajerski@suse.com>
6 years agoc-v device test: rename valid to available 25133/head
Jan Fajerski [Fri, 16 Nov 2018 08:27:34 +0000 (09:27 +0100)]
c-v device test: rename valid to available

Update test to reflect 8a80990471108b0920d1d8aa1239733ae2b20e9c

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit 047dc1c157e44642fa83873f02674b146e6d9028)

6 years agoinventory test: rename valid to available
Jan Fajerski [Fri, 16 Nov 2018 08:24:37 +0000 (09:24 +0100)]
inventory test: rename valid to available

Fixes test to reflect 8a80990471108b0920d1d8aa1239733ae2b20e9c

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit d895f97bb021c765f3c4d2d091b23bd0eef19f71)

6 years agoceph-volume: rename Device property valid to available
Jan Fajerski [Fri, 16 Nov 2018 08:22:06 +0000 (09:22 +0100)]
ceph-volume: rename Device property valid to available

This flag is used in the inventory reporting and available is deemed more
appropriate. Furthermore this fixes a bug where rejected_reasons
accumulated duplicate entries.

Fixes: http://tracker.ceph.com/issues/36701
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit 8a80990471108b0920d1d8aa1239733ae2b20e9c)

6 years agoMerge pull request #25130 from alfredodeza/mimic-c-v-inventory-doc
Alfredo Deza [Fri, 16 Nov 2018 15:22:24 +0000 (10:22 -0500)]
Merge pull request #25130 from alfredodeza/mimic-c-v-inventory-doc

mimic doc: add ceph-volume inventory sections

Reviewed-by: Jan Fajerski <jfajerski@suse.com>
6 years agodoc: add ceph-volume inventory sections 25130/head
Jan Fajerski [Wed, 14 Nov 2018 13:09:37 +0000 (14:09 +0100)]
doc: add ceph-volume inventory sections

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit dfc0e1d9a69f6f9ffb1d3e0b0ec33a75827c36e0)

6 years agoMerge pull request #25116 from alfredodeza/mimic-rm26953
Andrew Schoen [Thu, 15 Nov 2018 17:23:54 +0000 (11:23 -0600)]
Merge pull request #25116 from alfredodeza/mimic-rm26953

mimic ceph-volume: allow to specify --cluster-fsid instead of reading from ceph.conf

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
6 years agoceph-volume tests.lvm verify get_cluster_fsid can read from args or ceph.conf 25116/head
Alfredo Deza [Wed, 3 Oct 2018 19:21:03 +0000 (15:21 -0400)]
ceph-volume tests.lvm verify get_cluster_fsid can read from args or ceph.conf

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 02ea6dc0663cdaf764fdb1a1a5b31a736b854e6e)

6 years agoceph-volume lvm.prepare consume the value from --cluster-fsid if available
Alfredo Deza [Wed, 3 Oct 2018 17:32:05 +0000 (13:32 -0400)]
ceph-volume lvm.prepare consume the value from --cluster-fsid if available

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit a92883e60f3f2206a11b43762b3afcb84b05f07e)

6 years agoceph-volume lvm.common add the --cluster-fsid flag
Alfredo Deza [Wed, 3 Oct 2018 17:31:43 +0000 (13:31 -0400)]
ceph-volume lvm.common add the --cluster-fsid flag

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 15546ae6991c244197537d81092875b12613e20b)

6 years agoMerge pull request #25103 from alfredodeza/mimic-rm-27062
Alfredo Deza [Wed, 14 Nov 2018 23:16:45 +0000 (18:16 -0500)]
Merge pull request #25103 from alfredodeza/mimic-rm-27062

mimic ceph-volume: reject devices that have existing GPT headers

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
6 years agoMerge pull request #25100 from alfredodeza/mimic-bz1644828
Andrew Schoen [Wed, 14 Nov 2018 20:17:35 +0000 (14:17 -0600)]
Merge pull request #25100 from alfredodeza/mimic-bz1644828

mimic ceph-volume: remove LVs when using zap --destroy

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
6 years agoceph-volume: update tests after removing the LVPath arg validator 25103/head
Andrew Schoen [Wed, 14 Nov 2018 16:35:32 +0000 (10:35 -0600)]
ceph-volume: update tests after removing the LVPath arg validator

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
Resolves: rm#27062
(cherry picked from commit 0cb95ace88a731f7c30adf3f2286691fa3b2c49c)

6 years agoceph-volume: return lvs as vg/lv from ValidDevice if as_string is True
Andrew Schoen [Tue, 13 Nov 2018 19:02:39 +0000 (13:02 -0600)]
ceph-volume: return lvs as vg/lv from ValidDevice if as_string is True

All code in prepare and activate expect lvs to be in that format.
Eventually we can refactor all that to use the Device class as well.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
Resolves: rm#27062
(cherry picked from commit fdf7f3c575299b6be0ac40fb6eee5106cea010c9)

6 years agoceph-volume: adds lv_name property to Device class
Andrew Schoen [Tue, 13 Nov 2018 18:40:45 +0000 (12:40 -0600)]
ceph-volume: adds lv_name property to Device class

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
Resolves: rm#27062
(cherry picked from commit cc0317efac5a3a25edcdb48af2a63a969c2ac43a)

6 years agoceph-volume: combine the LVPath arg validator with ValidDevice
Andrew Schoen [Tue, 13 Nov 2018 18:28:23 +0000 (12:28 -0600)]
ceph-volume: combine the LVPath arg validator with ValidDevice

This combines the two arg validators and makes both batch and
prepare/active both use ValidDevice.

This will also allow us to use lvs with a full path, like
/dev/vg/lv instead of always enforcing vg/lv.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
Resolves: rm#27062
(cherry picked from commit d6a5a7606c3a0c1f1624c5784abb02bb1a4e1620)

6 years agoceph-volume: adds has_gpt_headers property to Device class
Andrew Schoen [Tue, 13 Nov 2018 18:27:19 +0000 (12:27 -0600)]
ceph-volume: adds has_gpt_headers property to Device class

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
Resolves: rm#27062
(cherry picked from commit 568a0ce5be0161541772ceacb9b81652f51659f5)

6 years agoceph-volume: add PTTYPE to blkid parser
Andrew Schoen [Tue, 13 Nov 2018 15:35:21 +0000 (09:35 -0600)]
ceph-volume: add PTTYPE to blkid parser

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
Resolves: rm#27062
(cherry picked from commit 3d86d2dda9fae87e143e5212d5f354a22f02909d)

6 years agoceph-volume tests update tests to handle new SystemExit exceptions in main 25100/head
Alfredo Deza [Tue, 13 Nov 2018 22:06:03 +0000 (17:06 -0500)]
ceph-volume tests update tests to handle new SystemExit exceptions in main

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 27d0a915d4a7f56aafc603a949b4e4c36772d236)

6 years agoceph-volume tests.api verify that Volume object can be removed
Alfredo Deza [Tue, 13 Nov 2018 22:05:31 +0000 (17:05 -0500)]
ceph-volume tests.api verify that Volume object can be removed

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 9527cffbe335043f7c5a60162138dfe093ae51da)

6 years agoceph-volume api.lvm allow passing a Volume object to remove_lv
Alfredo Deza [Tue, 13 Nov 2018 21:56:02 +0000 (16:56 -0500)]
ceph-volume api.lvm allow passing a Volume object to remove_lv

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit e7daa71604f4d08ace1125bb63dcfe909796d3ab)

6 years agoceph-volume tests.functional.lvm test full removal of LVs
Alfredo Deza [Tue, 13 Nov 2018 21:05:32 +0000 (16:05 -0500)]
ceph-volume tests.functional.lvm test full removal of LVs

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 4656bf0e333a50e0fca5fd0612cdda98ab5d70f9)

6 years agoceph-volume main raise sys.exit to prevent garbage in help
Alfredo Deza [Tue, 13 Nov 2018 13:32:16 +0000 (08:32 -0500)]
ceph-volume main raise sys.exit to prevent garbage in help

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit f695d1716e9fc6252dd713eb8fb08c28b1284611)

6 years agoceph-volume lvm.zap remove vgs|lvs when --destroy is used
Alfredo Deza [Tue, 13 Nov 2018 13:30:23 +0000 (08:30 -0500)]
ceph-volume lvm.zap remove vgs|lvs when --destroy is used

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 677cbbb059185fe2808746b36bd3f988ff2af41c)

6 years agorgw: reshard add: fail correctly on a non existant bucket 25087/head
Abhishek Lekshmanan [Mon, 15 Oct 2018 20:00:33 +0000 (22:00 +0200)]
rgw: reshard add: fail correctly on a non existant bucket

Currently the method that validates the reshard params does not fail correctly
in case of a non existant bucket causing reshard add to print an error message
but add the non existant bucket to the queue anyway. This will later be a cause
of EBUSY errors as this entry on the logshard  can never be processed.

Fixes: http://tracker.ceph.com/issues/36449
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
(cherry picked from commit c564b348a24edf2804a8f5f0d034f388be1c5c5f)
Signed-off-by: Jonathan Brielmaier <jbrielmaier@suse.de>
6 years agotests: make ceph-admin-commands.sh log what it does 25085/head
Nathan Cutler [Tue, 13 Nov 2018 18:46:24 +0000 (19:46 +0100)]
tests: make ceph-admin-commands.sh log what it does

Fixes: http://tracker.ceph.com/issues/37089
Signed-off-by: Nathan Cutler <ncutler@suse.com>
(cherry picked from commit 0185abfeb448ea569439ec9e06f3625f4fa6cc86)

6 years agoMerge pull request #25066 from alfredodeza/mimic-rm36768
Andrew Schoen [Tue, 13 Nov 2018 16:11:59 +0000 (10:11 -0600)]
Merge pull request #25066 from alfredodeza/mimic-rm36768

mimic ceph-volume: patch Device when testing

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
6 years agorgw: beast frontend parses ipv6 addrs 25079/head
Casey Bodley [Thu, 1 Nov 2018 20:17:11 +0000 (16:17 -0400)]
rgw: beast frontend parses ipv6 addrs

Fixes: http://tracker.ceph.com/issues/36662
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit a3b4124fd258887ff4cb3f65967f593658a41f4f)
Signed-off-by: Jonathan Brielmaier <jbrielmaier@suse.de>
6 years agorgw: beast frontend uses default port 443 for ssl_endpoint
Casey Bodley [Wed, 31 Oct 2018 18:19:48 +0000 (14:19 -0400)]
rgw: beast frontend uses default port 443 for ssl_endpoint

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 9836ee2643c38afcd0221488d607dffa359e9bd4)
Signed-off-by: Jonathan Brielmaier <jbrielmaier@suse.de>
6 years agoMerge pull request #24467 from vshankar/wip-26991
Yuri Weinstein [Mon, 12 Nov 2018 20:25:21 +0000 (12:25 -0800)]
Merge pull request #24467 from vshankar/wip-26991

mimic: mds: curate priority of perf counters sent to mgr

Reviewed-by:  Venky Shankar <vshankar@redhat.com>

6 years agoceph-volume tests patch Device() by splitting parametrized method 25066/head
Alfredo Deza [Mon, 12 Nov 2018 17:57:26 +0000 (12:57 -0500)]
ceph-volume tests patch Device() by splitting parametrized method

This was causing failures on systems where there is no LVM or where the
device names don't match. Patching is always recommended to avoid
conflicts with the system testing

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 82d96f876484c9668e2fc4726057691ba2c50f06)

6 years agoceph-volume tests inventory should patch before using .get_devices()
Alfredo Deza [Mon, 12 Nov 2018 17:56:42 +0000 (12:56 -0500)]
ceph-volume tests inventory should patch before using .get_devices()

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 7ee7a59910c9837659419c235f669a53cc9f613c)

6 years agoMerge pull request #24931 from jonsger/mimic-backport-pr#24700
Yuri Weinstein [Mon, 12 Nov 2018 17:13:24 +0000 (09:13 -0800)]
Merge pull request #24931 from jonsger/mimic-backport-pr#24700

mimic: rgw: support server-side encryption when SSL is terminated in a proxy

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
6 years agoMerge pull request #25013 from alfredodeza/mimic-ceph-volume-inventory
Alfredo Deza [Mon, 12 Nov 2018 13:37:18 +0000 (08:37 -0500)]
Merge pull request #25013 from alfredodeza/mimic-ceph-volume-inventory

mimic ceph-volume: add inventory command

Reviewed-by: Jan Fajerski <jfajerski@suse.com>
6 years agoMerge pull request #25011 from alfredodeza/mimic-rm36470
Andrew Schoen [Fri, 9 Nov 2018 22:09:38 +0000 (16:09 -0600)]
Merge pull request #25011 from alfredodeza/mimic-rm36470

mimic ceph-volume enable  --no-systemd flag for simple sub-command

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
6 years agoceph-volume: add inventory command 25013/head
Jan Fajerski [Wed, 31 Oct 2018 13:59:05 +0000 (14:59 +0100)]
ceph-volume: add inventory command

The inventory command provides information about a nodes disk inventory.
Existing logical volumes on a disk or one of its partitions are scanned
and reported.
The output can be formatted as plain text or json.

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit 57adfc6bb8abd9fc84b1378d5f69a16994d19e11)

6 years agoMerge pull request #24980 from alfredodeza/mimic-bz1644265
Alfredo Deza [Fri, 9 Nov 2018 20:16:28 +0000 (15:16 -0500)]
Merge pull request #24980 from alfredodeza/mimic-bz1644265

mimic ceph-volume util.encryption robust blkid+lsblk detection of lockbox

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
6 years agoceph-volume tests ensure activate behavior with systemd disabling 25011/head
Alfredo Deza [Thu, 8 Nov 2018 19:14:17 +0000 (14:14 -0500)]
ceph-volume tests ensure activate behavior with systemd disabling

Signed-off-by: Alfredo Deza <alfredo@deza.pe>
(cherry picked from commit 3e80118ccaccaa61e92b01f4f389d6056401d8a7)

6 years agoceph-volume simple.activate factor out systemd interactions for easier testing
Alfredo Deza [Thu, 8 Nov 2018 19:13:52 +0000 (14:13 -0500)]
ceph-volume simple.activate factor out systemd interactions for easier testing

Signed-off-by: Alfredo Deza <alfredo@deza.pe>
(cherry picked from commit 18ddd962116b5359af770088535f502797ac79c4)

6 years agoceph-volume simple.trigger replace systemd with from_trigger keyword argument
Alfredo Deza [Thu, 8 Nov 2018 14:14:24 +0000 (09:14 -0500)]
ceph-volume simple.trigger replace systemd with from_trigger keyword argument

Signed-off-by: Alfredo Deza <alfredo@deza.pe>
(cherry picked from commit 9526587403b76fa5397ae80b63328e3a59765c2e)

6 years agoceph-volume simple.activate allow a --no-systemd flag to skip systemctl actions
Alfredo Deza [Thu, 8 Nov 2018 14:13:31 +0000 (09:13 -0500)]
ceph-volume simple.activate allow a --no-systemd flag to skip systemctl actions

Signed-off-by: Alfredo Deza <alfredo@deza.pe>
(cherry picked from commit 4d9ad0d3d4bedd5efa95653fbb86607f0b469174)

6 years agoceph-volume util.encryption robust blkid+lsblk detection of lockbox 24980/head
Alfredo Deza [Fri, 2 Nov 2018 19:03:45 +0000 (15:03 -0400)]
ceph-volume util.encryption robust blkid+lsblk detection of lockbox

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit fc3e6ea3d9200e0fe2a3aa2576fcd45db223c277)

6 years agoMerge pull request #24959 from alfredodeza/mimic-rm36672 25004/head
Alfredo Deza [Wed, 7 Nov 2018 11:47:51 +0000 (06:47 -0500)]
Merge pull request #24959 from alfredodeza/mimic-rm36672

mimic ceph-volume tests install ceph-ansible's requirements.txt dependencies

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
6 years agoceph-volume tests install ceph-ansible's requirements.txt dependencies 24959/head
Alfredo Deza [Thu, 1 Nov 2018 12:48:28 +0000 (08:48 -0400)]
ceph-volume tests install ceph-ansible's requirements.txt dependencies

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 52ddb69813c5849506db5f850a3f2532ff1124b5)

6 years agoMerge pull request #24957 from alfredodeza/mimic-rm36704
Andrew Schoen [Tue, 6 Nov 2018 21:24:20 +0000 (15:24 -0600)]
Merge pull request #24957 from alfredodeza/mimic-rm36704

mimic: ceph-volume tests.systemd update imports for systemd module

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
6 years agoceph-volume tests.systemd update imports for systemd module 24957/head
Alfredo Deza [Tue, 6 Nov 2018 14:45:08 +0000 (09:45 -0500)]
ceph-volume tests.systemd update imports for systemd module

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit a63a6c86a03738bf50fa71a490951343a83afff6)

6 years agoceph-volume systemd import main so console_scripts work for executable
Alfredo Deza [Tue, 6 Nov 2018 14:44:39 +0000 (09:44 -0500)]
ceph-volume systemd import main so console_scripts work for executable

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 280e2baab27cc061d2d5e456f098cd3405f36873)

6 years agoMerge pull request #24826 from alfredodeza/mimic-rm36246
Andrew Schoen [Tue, 6 Nov 2018 21:06:30 +0000 (15:06 -0600)]
Merge pull request #24826 from alfredodeza/mimic-rm36246

mimic ceph-volume util.encryption don't push stderr to terminal

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
6 years agoMerge pull request #24852 from ceph/mimic-rm36648
Andrew Schoen [Tue, 6 Nov 2018 20:33:44 +0000 (14:33 -0600)]
Merge pull request #24852 from ceph/mimic-rm36648

mimic ceph-volume systemd import main so console_scripts work for executable

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
6 years agoceph-volume systemd import main so console_scripts work for executable 24852/head
Alfredo Deza [Tue, 30 Oct 2018 19:50:28 +0000 (15:50 -0400)]
ceph-volume systemd import main so console_scripts work for executable

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 0bcda52566279404b88184b2ce7b2200d581b0b7)

6 years agoMerge pull request #24838 from alfredodeza/mimic-no-scripts
Andrew Schoen [Tue, 6 Nov 2018 19:51:01 +0000 (13:51 -0600)]
Merge pull request #24838 from alfredodeza/mimic-no-scripts

mimic ceph-volume: use console_scripts

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
6 years agomds: include session uptime when diplaying session list 24467/head
Venky Shankar [Mon, 30 Jul 2018 05:47:02 +0000 (01:47 -0400)]
mds: include session uptime when diplaying session list

Fixes: https://tracker.ceph.com/issues/35938
Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit b23a204cdde2bc5f34304cca3f1bac3496cf7a41)

6 years agomds: track average uptime of sessions
Venky Shankar [Tue, 24 Jul 2018 03:47:02 +0000 (23:47 -0400)]
mds: track average uptime of sessions

Average session age math improvements by Patrick.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit d2627b98d0c1477d664d00384ef033d323b26957)

 Conflicts:
src/mds/SessionMap.h

6 years agomds: use monotonic waits in Beacon
Patrick Donnelly [Fri, 17 Aug 2018 22:03:56 +0000 (15:03 -0700)]
mds: use monotonic waits in Beacon

This guarantees that the sender thread cannot be disrupted by system clock
changes. This commit also simplifies the sender thread by manually managing the
thread and avoiding unnecessary context creation.

Fixes: http://tracker.ceph.com/issues/32090
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit a5fc29b95281c6ca58c9177c665c379846beb4b3)

 Conflicts:
src/mds/Beacon.cc

6 years agomds: use monotonic clock in beacon
Patrick Donnelly [Fri, 17 Aug 2018 04:28:12 +0000 (21:28 -0700)]
mds: use monotonic clock in beacon

Also update other parts of MDS which interact.

Fixes: http://tracker.ceph.com/issues/35837
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit e77a2f5da71f1ba62b69b8d0fb9f34abe426da79)

 Conflicts:
src/mds/Beacon.cc
src/mds/MDCache.h
src/mds/MDSRank.cc
src/mds/MDSRank.h
src/mds/Server.cc

6 years agomds: simplify beacon init
Patrick Donnelly [Fri, 17 Aug 2018 04:26:41 +0000 (21:26 -0700)]
mds: simplify beacon init

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit b7448f8fe0e4d12dd1070de4c3380e21d9da310a)

 Conflicts:
src/mds/Beacon.cc

6 years agomds: reorganize and curate perf log counters
Venky Shankar [Fri, 22 Jun 2018 05:43:37 +0000 (01:43 -0400)]
mds: reorganize and curate perf log counters

Categorize perf counters into high (PRIO_{CRITICAL/INTERESTING}),
medium (PRIO_USEFUL) and low priority (PRIO_DEBUGONLY). High and
medium priority stats are transmitted to ceph mgr and included in
prometheus output.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
Fixes: http://tracker.ceph.com/issues/26991
(cherry picked from commit 48a33f6f06802fee998f60a2ec35d9041a7c51a6)

 Conflicts:
src/mds/Server.cc

6 years agomds: show session load average in dump session
Venky Shankar [Wed, 4 Jul 2018 09:44:57 +0000 (05:44 -0400)]
mds: show session load average in dump session

Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit 682dc08cbd521342b4abc45fd85edb2dd7bc5682)

6 years agomds: allow request load average decay rate configurable via admin socket
Venky Shankar [Tue, 3 Jul 2018 12:06:39 +0000 (08:06 -0400)]
mds: allow request load average decay rate configurable via admin socket

Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit 3809d96a5b53721b88602d662c4c1cd00dd727a0)

 Conflicts:
src/mds/MDSDaemon.cc
src/mds/MDSRank.h

6 years agomds: decay counter for tracking request load average
Venky Shankar [Tue, 3 Jul 2018 12:04:56 +0000 (08:04 -0400)]
mds: decay counter for tracking request load average

Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit 816d8aaea01aef81467e3df7a4b3ab3eff86d27a)

 Conflicts:
src/mds/SessionMap.cc
src/common/options.cc

6 years agomds: add perf counters to track current open/stale sessions
Venky Shankar [Wed, 27 Jun 2018 08:05:49 +0000 (04:05 -0400)]
mds: add perf counters to track current open/stale sessions

Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit 315aa47a07429ba0a47fbd40078f0e8fd16b9ffd)

6 years agorgw: aws:SecureTransport uses rgw_transport_is_secure() 24931/head
Casey Bodley [Mon, 22 Oct 2018 18:16:59 +0000 (14:16 -0400)]
rgw: aws:SecureTransport uses rgw_transport_is_secure()

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit e515d92)
Signed-off-by: Jonathan Brielmaier <jbrielmaier@suse.de>
6 years agorgw: SSE operations check rgw_transport_is_secure()
Casey Bodley [Mon, 22 Oct 2018 18:14:44 +0000 (14:14 -0400)]
rgw: SSE operations check rgw_transport_is_secure()

Fixes: http://tracker.ceph.com/issues/27221
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 8f94643)
Signed-off-by: Jonathan Brielmaier <jbrielmaier@suse.de>
6 years agorgw: add helper function rgw_transport_is_secure()
Casey Bodley [Mon, 22 Oct 2018 18:13:21 +0000 (14:13 -0400)]
rgw: add helper function rgw_transport_is_secure()

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 73d355f)
Signed-off-by: Jonathan Brielmaier <jbrielmaier@suse.de>
Conflicts:
src/rgw/rgw_common.cc: state below inserted function

6 years agocommon: add config option rgw_trust_forwarded_https
Casey Bodley [Mon, 22 Oct 2018 15:04:55 +0000 (11:04 -0400)]
common: add config option rgw_trust_forwarded_https

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit d3dd5a9)
Signed-off-by: Jonathan Brielmaier <jbrielmaier@suse.de>
6 years agoMerge pull request #24873 from trociny/wip-36643-mimic
Yuri Weinstein [Sun, 4 Nov 2018 14:31:25 +0000 (06:31 -0800)]
Merge pull request #24873 from trociny/wip-36643-mimic

mimic: osdc: reduce ObjectCacher's memory fragments

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agorgw: RGWRadosGetOmapKeysCR takes result by shared_ptr 24912/head
Casey Bodley [Fri, 17 Aug 2018 17:15:49 +0000 (13:15 -0400)]
rgw: RGWRadosGetOmapKeysCR takes result by shared_ptr

Fixes: http://tracker.ceph.com/issues/21154
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit fd77ff74ae47bf09553186a5a5e79ec13a9de16d)

Conflicts:
src/rgw/rgw_data_sync.cc
- in mimic, the entire "process bucket shards that previously failed"
  code block is enclosed in an if statement - in master, this is not
  the case

6 years agorgw: use get_omap_keys2
Sage Weil [Fri, 20 Jan 2017 16:52:27 +0000 (11:52 -0500)]
rgw: use get_omap_keys2

Making looping less fragile.

Signed-off-by: Sage Weil <sage@redhat.com>
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit e320830a7123f915ea30370cb7fc4248e42796d7)

Conflicts:
src/rgw/rgw_data_sync.cc
- trivial resolution

6 years agorgw: fix vector index out of range in RGWReadDataSyncRecoveringShardsCR
Casey Bodley [Fri, 19 Oct 2018 16:54:44 +0000 (12:54 -0400)]
rgw: fix vector index out of range in RGWReadDataSyncRecoveringShardsCR

Fixes: http://tracker.ceph.com/issues/36537
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 077ceb17d9d86f394a2805c9be123b2533e77d40)

6 years agorgw: add RGWAioCompletionNotifierWith<T>
Casey Bodley [Fri, 17 Aug 2018 17:40:25 +0000 (13:40 -0400)]
rgw: add RGWAioCompletionNotifierWith<T>

Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit de4376f0405c8c172651bbd27f370b63d03614a8)

6 years agoMerge pull request #24860 from jonsger/mimic-backport-pr#23242
Yuri Weinstein [Fri, 2 Nov 2018 14:51:43 +0000 (07:51 -0700)]
Merge pull request #24860 from jonsger/mimic-backport-pr#23242

mimic: rgw: set default objecter_inflight_ops = 24576

Reviewed-by: Casey Bodley <cbodley@redhat.com>
6 years agoMerge pull request #24811 from dillaman/wip-36569-mimic
Yuri Weinstein [Thu, 1 Nov 2018 19:40:23 +0000 (12:40 -0700)]
Merge pull request #24811 from dillaman/wip-36569-mimic

mimic: qa/tasks/qemu: use unique clone directory to avoid race with workunit

Reviewed-by: Nathan Cutler <ncutler@suse.com>
6 years agoMerge pull request #24443 from smithfarm/wip-26850-mimic
Yuri Weinstein [Thu, 1 Nov 2018 16:59:04 +0000 (09:59 -0700)]
Merge pull request #24443 from smithfarm/wip-26850-mimic

mimic: ceph_volume_client: py3 compatible

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoosdc: reduce ObjectCacher's memory fragments 24873/head
Yan, Zheng [Thu, 27 Sep 2018 05:10:55 +0000 (13:10 +0800)]
osdc: reduce ObjectCacher's memory fragments

Fixes: http://tracker.ceph.com/issues/36192
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
(cherry picked from commit 5d4f82117ed20f7a40259c3f5471e7a96a4c456f)

Conflicts:
src/osdc/ObjectCacher.cc: trivial

6 years agorgw: set default objecter_inflight_ops = 24576 24860/head
Matt Benjamin [Wed, 25 Jul 2018 20:06:33 +0000 (16:06 -0400)]
rgw: set default objecter_inflight_ops = 24576

Fixes: http://tracker.ceph.com/issues/25109
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
(cherry picked from commit 102c5bd)
Signed-off-by: Jonathan Brielmaier <jbrielmaier@suse.de>
6 years agoMerge pull request #24745 from smithfarm/wip-36592-mimic
Yuri Weinstein [Tue, 30 Oct 2018 19:46:11 +0000 (12:46 -0700)]
Merge pull request #24745 from smithfarm/wip-36592-mimic

mimic: segv in BlueStore::OldExtent::create

Reviewed-by: Sage Weil <sage@redhat.com>
6 years agoMerge pull request #24488 from tspmelo/wip-24907-mimic
Yuri Weinstein [Tue, 30 Oct 2018 19:45:17 +0000 (12:45 -0700)]
Merge pull request #24488 from tspmelo/wip-24907-mimic

mimic: mgr/dashboard: Add support for URI encode

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Ricardo Dias <rdias@suse.com>
6 years agoceph-volume: use console_scripts 24838/head
Mehdi Abaakouk [Fri, 26 Oct 2018 09:59:55 +0000 (11:59 +0200)]
ceph-volume: use console_scripts

Using "#!/usr/bin/env python" is not recommended as it's not portable.

setuptools provides an console_scripts entry_point that generates
scripts that always have the good sheban whatever the target operating
system and python version/distribution.

http://tracker.ceph.com/issues/36601

Signed-off-by: Mehdi Abaakouk <sileht@sileht.net>
(cherry picked from commit 6a2ed6c285b74f463f223d3501def8ef4e6283b1)

6 years agoMerge pull request #24435 from smithfarm/wip-32092-mimic
Yuri Weinstein [Tue, 30 Oct 2018 17:07:49 +0000 (10:07 -0700)]
Merge pull request #24435 from smithfarm/wip-32092-mimic

mimic: mds: migrate strays part by part when shutdown mds

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Yan, Zheng <zyan@redhat.com>
6 years agoMerge pull request #24485 from ukernel/mimic-36346
Yuri Weinstein [Tue, 30 Oct 2018 16:49:19 +0000 (09:49 -0700)]
Merge pull request #24485 from ukernel/mimic-36346

mimic: Revert "mimic: cephfs-journal-tool: enable purge_queue journal's event commands"

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoMerge pull request #24572 from pdvian/wip-36280-mimic
Yuri Weinstein [Tue, 30 Oct 2018 16:48:40 +0000 (09:48 -0700)]
Merge pull request #24572 from pdvian/wip-36280-mimic

mimic: qa: tolerate failed rank while waiting for state

Reviewed-by: Yan, Zheng <zyan@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoMerge pull request #24583 from smithfarm/wip-24933-mimic
Yuri Weinstein [Tue, 30 Oct 2018 16:48:08 +0000 (09:48 -0700)]
Merge pull request #24583 from smithfarm/wip-24933-mimic

mimic: cephfs-journal-tool: wrong layout info used

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Yan, Zheng <zyan@redhat.com>
6 years agoMerge pull request #24661 from vshankar/wip-35975
Yuri Weinstein [Tue, 30 Oct 2018 16:47:34 +0000 (09:47 -0700)]
Merge pull request #24661 from vshankar/wip-35975

mimic: mds: evict cap revoke non-responding clients

Reviewed-by: Yan, Zheng <zyan@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoMerge pull request #24684 from smithfarm/wip-36501-mimic
Yuri Weinstein [Tue, 30 Oct 2018 16:46:31 +0000 (09:46 -0700)]
Merge pull request #24684 from smithfarm/wip-36501-mimic

mimic: qa: increase rm timeout for workunit cleanup

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Yan, Zheng <zyan@redhat.com>
6 years agoceph-volume util.encryption don't push stderr to terminal when cryptsetup fails to... 24826/head
Alfredo Deza [Wed, 3 Oct 2018 12:31:20 +0000 (08:31 -0400)]
ceph-volume util.encryption don't push stderr to terminal when cryptsetup fails to find device

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit 40f919850fddd14659243c47860224981439906a)

6 years agoqa/tasks/qemu: use unique clone directory to avoid race with workunit 24811/head
Jason Dillaman [Mon, 22 Oct 2018 14:44:40 +0000 (10:44 -0400)]
qa/tasks/qemu: use unique clone directory to avoid race with workunit

If there is a workunit task associated with the same client, the two
tasks will attempt to clone the suite repo to the same directory.
Worse, if it's parallel tasks, the two clones will clobber each
other.

Fixes: http://tracker.ceph.com/issues/36542
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit 5d56014c61b107dcb5d05c2221c2e844324f304c)

6 years agoMerge pull request #24708 from smithfarm/wip-26839-mimic
Yuri Weinstein [Mon, 29 Oct 2018 20:21:12 +0000 (16:21 -0400)]
Merge pull request #24708 from smithfarm/wip-26839-mimic

mimic: librados application's symbol could conflict with the libceph-common

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge pull request #24710 from smithfarm/wip-35977-mimic
Yuri Weinstein [Mon, 29 Oct 2018 20:20:22 +0000 (16:20 -0400)]
Merge pull request #24710 from smithfarm/wip-35977-mimic

mimic: multisite: incremental data sync makes unnecessary call to RGWReadRemoteDataLogShardInfoCR

Reviewed-by: Casey Bodley <cbodley@redhat.com>
6 years agoMerge pull request #24734 from b-ranto/wip-mimic-http
Yuri Weinstein [Mon, 29 Oct 2018 20:19:06 +0000 (16:19 -0400)]
Merge pull request #24734 from b-ranto/wip-mimic-http

mimic: mgr/dashboard: Add http support to dashboard

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by:  Volker Theile <vtheile@suse.com>

6 years agoMerge pull request #23916 from liewegas/wip-pod-hostname-mimic
Yuri Weinstein [Mon, 29 Oct 2018 20:17:17 +0000 (16:17 -0400)]
Merge pull request #23916 from liewegas/wip-pod-hostname-mimic

mimic: common: get real hostname from container/pod environment

Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge pull request #24260 from tchaikov/mimic-35969
Yuri Weinstein [Mon, 29 Oct 2018 20:16:09 +0000 (16:16 -0400)]
Merge pull request #24260 from tchaikov/mimic-35969

mimic: rpm: use updated gperftools

Reviewed-by: Nathan Cutler <ncutler@suse.com>
Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
6 years agoMerge pull request #24431 from smithfarm/wip-35936-mimic
Yuri Weinstein [Mon, 29 Oct 2018 20:14:51 +0000 (16:14 -0400)]
Merge pull request #24431 from smithfarm/wip-35936-mimic

mimic: OSDMapMapping does not handle active.size() > pool size

Reviewed-by: Sage Weil <sage@redhat.com>
6 years agoMerge pull request #24478 from tspmelo/wip-27851-mimic
Yuri Weinstein [Mon, 29 Oct 2018 20:14:13 +0000 (16:14 -0400)]
Merge pull request #24478 from tspmelo/wip-27851-mimic

mimic: mgr/dashboard: Remove fieldsets when using CdTable

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
6 years agoMerge pull request #24622 from dillaman/wip-36430-mimic
Yuri Weinstein [Mon, 29 Oct 2018 20:12:47 +0000 (16:12 -0400)]
Merge pull request #24622 from dillaman/wip-36430-mimic

mimic: qa/workunits: replace 'realpath' with 'readlink -f' in fsstress.sh

Reviewed-by: Yuri Weinstein <yweins@redhat.com>
6 years agoMerge pull request #24551 from pdvian/wip-36276-mimic
Yuri Weinstein [Mon, 29 Oct 2018 20:11:38 +0000 (16:11 -0400)]
Merge pull request #24551 from pdvian/wip-36276-mimic

mimic: test/rbd_mirror: race in WaitingOnLeaderReleaseLeader

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
6 years agoMerge pull request #24647 from liewegas/wip-pr-23273-mimic
Yuri Weinstein [Mon, 29 Oct 2018 20:09:47 +0000 (16:09 -0400)]
Merge pull request #24647 from liewegas/wip-pr-23273-mimic

mimic: os/bluestore: handle spurious read errors

Reviewed-by: Igor Fedotov <ifedotov@suse.com>