]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
5 years agoceph-volume: don't try to test lvm zap on simple tests 29660/head
Jan Fajerski [Wed, 14 Aug 2019 12:36:58 +0000 (14:36 +0200)]
ceph-volume: don't try to test lvm zap on simple tests

Fixes: https://tracker.ceph.com/issues/41245
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit 081109859a06f1b2ff6652dce07da4ddf6fb258e)

5 years agoMerge pull request #29702 from jan--f/wip-41308-nautilus
Alfredo Deza [Fri, 16 Aug 2019 11:45:06 +0000 (07:45 -0400)]
Merge pull request #29702 from jan--f/wip-41308-nautilus

nautilus: ceph-volume: [filestore,bluestore] single type strategies fail after tracking devices as sets

Reviewed-by: Alfredo Deza <adeza@redhat.com>
5 years agoMerge pull request #29689 from jan--f/wip-41299-nautilus
Alfredo Deza [Fri, 16 Aug 2019 11:43:52 +0000 (07:43 -0400)]
Merge pull request #29689 from jan--f/wip-41299-nautilus

nautilus: batch functional idempotency test fails since message is now on stderr

Reviewed-by: Alfredo Deza <adeza@redhat.com>
5 years agoMerge pull request #29455 from pdvian/wip-40672-nautilus
Nathan Cutler [Fri, 16 Aug 2019 09:15:20 +0000 (11:15 +0200)]
Merge pull request #29455 from pdvian/wip-40672-nautilus

nautilus: doc: fix rgw ldap username token

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoceph-volume: fix batch functional tests, idempotent test must check stderr 29689/head
Jan Fajerski [Thu, 15 Aug 2019 11:28:42 +0000 (13:28 +0200)]
ceph-volume: fix batch functional tests, idempotent test must check stderr

Fixes: https://tracker.ceph.com/issues/41295
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit 88807110f3014e7a2a39c37ae5c64bb3ab107d80)

5 years agoceph-volume: don't keep device lists as sets 29702/head
Jan Fajerski [Thu, 15 Aug 2019 10:20:00 +0000 (12:20 +0200)]
ceph-volume: don't keep device lists as sets

This was introduced by #27754. The explicit device lists were cast to
sets but other parts of the code where not updated accordingly. To avoid
touching all code places, only cast to sets for disjoint test and keep
lists otherwise.

Fixes: https://tracker.ceph.com/issues/41292
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit 0534cf188a671096d5ddb9d48cdae3dccc6c0b18)

5 years agoMerge pull request #29690 from jan--f/wip-41082-nautilus
Jan Fajerski [Fri, 16 Aug 2019 08:28:08 +0000 (10:28 +0200)]
Merge pull request #29690 from jan--f/wip-41082-nautilus

nautilus: ceph-volume: batch gets confused when the same device is passed in two device lists

5 years agoMerge pull request #29645 from yuriw/wip-yuriw-upgrade-rbd-nautilus
Yuri Weinstein [Thu, 15 Aug 2019 20:04:32 +0000 (13:04 -0700)]
Merge pull request #29645 from yuriw/wip-yuriw-upgrade-rbd-nautilus

qa/tests: added rbd_fsx tests to the tests mix

5 years agoMerge pull request #29065 from s0nea/wip-40786-nautilus
Yuri Weinstein [Thu, 15 Aug 2019 20:00:17 +0000 (13:00 -0700)]
Merge pull request #29065 from s0nea/wip-40786-nautilus

nautilus: mgr/dashboard: SSL certificate upload command throws deprecation warning

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Ricardo Dias <rdias@suse.com>
5 years agoMerge pull request #29372 from pdvian/wip-40537-nautilus
Yuri Weinstein [Thu, 15 Aug 2019 19:59:32 +0000 (12:59 -0700)]
Merge pull request #29372 from pdvian/wip-40537-nautilus

nautilus: osd/PG: do not queue scrub if PG is not active when unblock

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #29373 from pdvian/wip-40542-nautilus
Yuri Weinstein [Thu, 15 Aug 2019 19:58:55 +0000 (12:58 -0700)]
Merge pull request #29373 from pdvian/wip-40542-nautilus

nautilus: mon: take the mon lock in handle_conf_change

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #29562 from liewegas/wip-41037-nautilus
Yuri Weinstein [Thu, 15 Aug 2019 19:58:18 +0000 (12:58 -0700)]
Merge pull request #29562 from liewegas/wip-41037-nautilus

nautilus: common/config: respect POD_MEMORY_REQUEST *and* POD_MEMORY_LIMIT env vars

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #29694 from jan--f/c-v-no-dashboard-test-nautilus
Jan Fajerski [Thu, 15 Aug 2019 17:10:34 +0000 (19:10 +0200)]
Merge pull request #29694 from jan--f/c-v-no-dashboard-test-nautilus

nautilus: ceph-volume: run functional tests without dashboard

5 years agoMerge pull request #29484 from pdvian/wip-40737-nautilus
Nathan Cutler [Thu, 15 Aug 2019 15:45:47 +0000 (17:45 +0200)]
Merge pull request #29484 from pdvian/wip-40737-nautilus

nautilus: doc/rgw: document use of 'realm pull' instead of 'period pull'

Reviewed-by: Nathan Cutler <ncutler@suse.com>
5 years agoMerge pull request #29444 from ricardoasmarques/fix-ceph-iscsi-required-version-nautilus
Nathan Cutler [Thu, 15 Aug 2019 15:32:29 +0000 (17:32 +0200)]
Merge pull request #29444 from ricardoasmarques/fix-ceph-iscsi-required-version-nautilus

nautilus: doc: Update 'ceph-iscsi' min version

Reviewed-by: Nathan Cutler <ncutler@suse.com>
5 years agoceph-volume: when testing disable the dashboard 29694/head
Andrew Schoen [Mon, 29 Jul 2019 20:25:19 +0000 (15:25 -0500)]
ceph-volume: when testing disable the dashboard

ceph-ansible has started enabling the dashboard by
default as of https://github.com/ceph/ceph-ansible/pull/4268

Disabling the dashboard gets us around needing to run
the grafana_server role which is required for the dashboard
and not needed for ceph-volume functional tests.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
(cherry picked from commit 7b7ff0d530c5f28e933602505b66efc4df24e62e)

5 years agoMerge pull request #29306 from smithfarm/wip-40498-nautilus
Nathan Cutler [Thu, 15 Aug 2019 15:22:36 +0000 (17:22 +0200)]
Merge pull request #29306 from smithfarm/wip-40498-nautilus

nautilus: doc: Object Gateway multisite document read-only argument error

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoceph-volume: batch ensure device lists are disjoint 29690/head
Jan Fajerski [Thu, 11 Apr 2019 14:58:32 +0000 (16:58 +0200)]
ceph-volume: batch ensure device lists are disjoint

Fixes: https://tracker.ceph.com/issues/41018
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit 8fcdb4d628f3a55e4783f0a3df7ac7c0a36eaa43)

5 years agoMerge pull request #29442 from pdvian/wip-40659-nautilus
Yuri Weinstein [Wed, 14 Aug 2019 23:08:39 +0000 (16:08 -0700)]
Merge pull request #29442 from pdvian/wip-40659-nautilus

nautilus: mgr/dashboard: Interlock `fast-diff` and `object-map`

5 years agoMerge pull request #29617 from pdvian/wip-40942-nautilus
Neha Ojha [Wed, 14 Aug 2019 17:39:07 +0000 (10:39 -0700)]
Merge pull request #29617 from pdvian/wip-40942-nautilus

nautilus: mon/OSDMonitor.cc: better error message about min_size

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoqa/tests: added rbd_fsx tests to the tests mix 29645/head
Yuri Weinstein [Tue, 13 Aug 2019 20:16:23 +0000 (13:16 -0700)]
qa/tests: added rbd_fsx tests to the tests mix

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
5 years agoMerge pull request #29600 from jan--f/wip-41203-nautilus
Alfredo Deza [Tue, 13 Aug 2019 13:33:29 +0000 (09:33 -0400)]
Merge pull request #29600 from jan--f/wip-41203-nautilus

nautilus: ceph-volume prints log messages to stdout

Reviewed-by: Alfredo Deza <adeza@redhat.com>
5 years agomon/OSDMonitor.cc: better error message about min_size 29617/head
Neha Ojha [Tue, 23 Jul 2019 00:50:31 +0000 (17:50 -0700)]
mon/OSDMonitor.cc: better error message about min_size

Signed-off-by: Neha Ojha <nojha@redhat.com>
(cherry picked from commit ce25ac0a9196f90acef82915f122c5a06277993a)

5 years agoMerge pull request #29440 from neha-ojha/wip-40940-nautilus 29589/head
Yuri Weinstein [Mon, 12 Aug 2019 22:30:37 +0000 (15:30 -0700)]
Merge pull request #29440 from neha-ojha/wip-40940-nautilus

nautilus: rocksdb: Updated to v6.1.2

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Mark Nelson <mnelson@redhat.com>
5 years agoMerge pull request #29439 from neha-ojha/wip-40969-nautilus
Yuri Weinstein [Mon, 12 Aug 2019 22:29:25 +0000 (15:29 -0700)]
Merge pull request #29439 from neha-ojha/wip-40969-nautilus

nautilus: rocksdb: rocksdb_rmrange related improvements

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
5 years agoMerge pull request #28833 from s0nea/wip-40616-nautilus
Yuri Weinstein [Mon, 12 Aug 2019 21:05:42 +0000 (14:05 -0700)]
Merge pull request #28833 from s0nea/wip-40616-nautilus

nautilus: mgr/dashboard: notify the user about unset 'mon_allow_pool_delete' flag beforehand

Reviewed-by:  Tiago Melo <tmelo@suse.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
5 years agoMerge pull request #28889 from bk201/wip-40661-nautilus
Yuri Weinstein [Mon, 12 Aug 2019 21:04:28 +0000 (14:04 -0700)]
Merge pull request #28889 from bk201/wip-40661-nautilus

nautilus: mgr/dashboard: cephfs multimds graphs stack together

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
5 years agoMerge pull request #28912 from bk201/wip-40685-nautilus
Yuri Weinstein [Mon, 12 Aug 2019 21:04:04 +0000 (14:04 -0700)]
Merge pull request #28912 from bk201/wip-40685-nautilus

nautilus: mgr/dashboard: Dentries value of MDS daemon in Filesystems page is inconsistent with ceph fs status output

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
5 years agoMerge pull request #28938 from Exotelis/i18n-nautilus
Yuri Weinstein [Mon, 12 Aug 2019 21:03:23 +0000 (14:03 -0700)]
Merge pull request #28938 from Exotelis/i18n-nautilus

nautilus: mgr/dashboard: Add, update and remove translations

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by:  Tiago Melo <tmelo@suse.com>

5 years agoMerge pull request #28968 from Devp00l/wip-40699-nautilus
Yuri Weinstein [Mon, 12 Aug 2019 21:00:09 +0000 (14:00 -0700)]
Merge pull request #28968 from Devp00l/wip-40699-nautilus

nautilus: mgr/dashboard: Silence Alertmanager alerts

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by:  Tiago Melo <tmelo@suse.com>

5 years agoMerge pull request #28974 from ricardoasmarques/wip-40723-nautilus
Yuri Weinstein [Mon, 12 Aug 2019 20:59:26 +0000 (13:59 -0700)]
Merge pull request #28974 from ricardoasmarques/wip-40723-nautilus

nautilus: mgr/dashboard: Upgrade to ceph-iscsi config v10

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
5 years agoMerge pull request #28992 from smithfarm/wip-40691-nautilus
Yuri Weinstein [Mon, 12 Aug 2019 20:58:54 +0000 (13:58 -0700)]
Merge pull request #28992 from smithfarm/wip-40691-nautilus

nautilus: build/ops: Module 'dashboard' has failed: No module named routes

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
5 years agoMerge pull request #29044 from s0nea/wip-40656-nautilus
Yuri Weinstein [Mon, 12 Aug 2019 20:58:21 +0000 (13:58 -0700)]
Merge pull request #29044 from s0nea/wip-40656-nautilus

nautilus: mgr/dashboard: Changing rgw-api-host does not get effective without disable/enable dashboard mgr module

Reviewed-by: Ricardo Marques <rimarques@suse.com>
5 years agoMerge pull request #29045 from s0nea/wip-40657-nautilus
Yuri Weinstein [Mon, 12 Aug 2019 20:56:48 +0000 (13:56 -0700)]
Merge pull request #29045 from s0nea/wip-40657-nautilus

nautilus: mgr/dashboard: Display logged in information for each iSCSI client

Reviewed-by: Ricardo Marques <rimarques@suse.com>
5 years agoMerge pull request #29061 from s0nea/wip-40279-nautilus
Yuri Weinstein [Mon, 12 Aug 2019 20:55:57 +0000 (13:55 -0700)]
Merge pull request #29061 from s0nea/wip-40279-nautilus

nautilus: mgr/dashboard: Optimize the calculation of portal IPs

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoceph-volume: never log to stdout, use stderr instead 29600/head
Jan Fajerski [Thu, 8 Aug 2019 08:42:37 +0000 (10:42 +0200)]
ceph-volume: never log to stdout, use stderr instead

We should never print log messages to stdout, as this should be reserved
for output of ceph-volume.

Fixes: https://tracker.ceph.com/issues/41158
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit b8d6dcbe9f803c96c0af68da54f1262e9b6a9e77)

5 years agoceph-volume: terminal: encode unicode when writing to stdout
Kefu Chai [Sun, 24 Mar 2019 09:11:31 +0000 (17:11 +0800)]
ceph-volume: terminal: encode unicode when writing to stdout

python determins the encoding of stdout and stderr based on the LC_CTYPE
and PYTHONIOENCODING env variable, by default, python3's sys.stdout uses
'utf-8' as its encoding, so it will be able to write unicode string even
the stdout is not attached to a tty device. but when it comes to
python2, it will default to ascii if neither of these variabls is set.
so, if we are writing unicode using `_Write` in an environment where
LC_CTYPE and/or PYTHONIOENCODING are using non UTF-8 encoding, it chokes
by raising `UnicodeEncodeError` exception.

in this change, we add a wrapper around `_Write._writer` so it is able
to write unicode string in such a non-unicode-friendly environment.

for more info related the encoding of stdout and stderr, see
https://docs.python.org/3/using/cmdline.html#envvar-PYTHONIOENCODING .

Signed-off-by: Alfredo Deza <adeza@redhat.com>
Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit 77912c0c71874a23785d3bdd109ad61e4f4c0e28)

5 years agoMerge pull request #29491 from tspmelo/wip-41075-nautilus
Yuri Weinstein [Fri, 9 Aug 2019 16:01:03 +0000 (09:01 -0700)]
Merge pull request #29491 from tspmelo/wip-41075-nautilus

nautilus: mgr/dashboard: Fix e2e failures caused by webdriver version

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
5 years agocommon/config: respect POD_MEMORY_REQUEST *and* POD_MEMORY_LIMIT env vars 29562/head
Sage Weil [Tue, 6 Aug 2019 16:12:43 +0000 (11:12 -0500)]
common/config: respect POD_MEMORY_REQUEST *and* POD_MEMORY_LIMIT env vars

If a kubernetes pod spec specifies a limit of X, then the pod gets both
the limits.memory and requests.memory resource fields set, and rook passes
those as POD_MEMORY_LIMIT and POD_MEMORY_REQUEST environment variables.

This is a problem if only the limit is set, because we will end up
setting our osd_memory_target (and, in the future, other *_memory_targets)
to the hard limit, and the daemon will inevitably reach that threshold
and get killed.

Fix this by also looking at the POD_MEMORY_LIMIT value, and applying the
ratio (default: .8) to it, and setting our actual target to the min of
that and the POD_MEMORY_REQUEST.

Also, set the "default" target to ratio*limit, so that it will apply in
general when no request is specified.

When both request and limit are 10M, we then see

        "osd_memory_target": {
            "default": "800000000000",
            "env": "800000000000",
            "final": "800000000000"
        },

In a more "normal" situation where limit is 10M and request is 5M, we get

        "osd_memory_target": {
            "default": "800000000000",
            "env": "500000000000",
            "final": "500000000000"
        },

If only limit is specified (to 10M), we get

        "osd_memory_target": {
            "default": "800000000000",
            "final": "800000000000"
        },

Fixes: https://tracker.ceph.com/issues/41037
Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 25f28e610fe674f24eaa0a66c9ccc91b03fdcc92)

5 years agocommon: add comment about pod memory requests/limits
Patrick Donnelly [Thu, 25 Jul 2019 19:12:35 +0000 (12:12 -0700)]
common: add comment about pod memory requests/limits

Written in private correspondence by Travis Nielson.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit 94bcc45561c78f40e2fcd95aef9543029ddcc7ad)

5 years agocommon/config: let diff show non-build defaults
Sage Weil [Tue, 6 Aug 2019 15:53:06 +0000 (10:53 -0500)]
common/config: let diff show non-build defaults

Notably, this includes things from set_val_default(), which may be set
at runtime.

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 77b634ad08e9df9953a5f5c46c1da56d87fbc98e)

5 years agocommon/config: do no include multiple 'default' values
Sage Weil [Tue, 6 Aug 2019 15:47:04 +0000 (10:47 -0500)]
common/config: do no include multiple 'default' values

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 712409cac4a5d71718f21872a6982e529adc068b)

5 years agoMerge PR #29490 into nautilus
Patrick Donnelly [Wed, 7 Aug 2019 20:02:11 +0000 (13:02 -0700)]
Merge PR #29490 into nautilus

* refs/pull/29490/head:
mgr/volumes: set uid/gid of FS client's mount as 0/0
mgr/volumes: add `ceph fs subvolumegroup getpath` command

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge PR #29513 into nautilus
Sage Weil [Wed, 7 Aug 2019 18:25:12 +0000 (13:25 -0500)]
Merge PR #29513 into nautilus

* refs/pull/29513/head:
qa/tasks/ceph_deploy: assume systemd and simplify shutdown wonkiness
qa/tasks/ceph_deploy: do not rely on ceph-create-keys

Reviewed-by: Vasu Kulkarni <vasu@redhat.com>
Reviewed-by: Yuri Weinstein <yweins@redhat.com>
5 years agoMerge pull request #29506 from jan--f/wip-41137-nautilus
Jan Fajerski [Wed, 7 Aug 2019 06:08:12 +0000 (08:08 +0200)]
Merge pull request #29506 from jan--f/wip-41137-nautilus

nautilus: ceph-volume prints errors to stdout with --format json

5 years agoqa/tasks/ceph_deploy: assume systemd and simplify shutdown wonkiness 29513/head
Sage Weil [Fri, 12 Jul 2019 19:06:10 +0000 (14:06 -0500)]
qa/tasks/ceph_deploy: assume systemd and simplify shutdown wonkiness

The 'service' command was succeeding but not actually stopping ceph.  But
we can safely assume systemd now so get rid of the weirdness here.

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 97a45c9c2e8b6f6af51bf387636c9e4eaa228380)

5 years agoqa/tasks/ceph_deploy: do not rely on ceph-create-keys
Sage Weil [Thu, 11 Jul 2019 16:15:55 +0000 (11:15 -0500)]
qa/tasks/ceph_deploy: do not rely on ceph-create-keys

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit daeaabf1871a2d3482f97f0def5f9c48da7811e9)

5 years agoceph-volume: print most logging messages to stderr 29506/head
Jan Fajerski [Mon, 4 Mar 2019 10:28:13 +0000 (11:28 +0100)]
ceph-volume: print most logging messages to stderr

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
Fixes: http://tracker.ceph.com/issues/38548
(cherry picked from commit 1f8f1e95dee88b4bab2d6931e720ed83584d2887)

5 years agoMerge pull request #29416 from jan--f/wip-41021-nautilus
Jan Fajerski [Tue, 6 Aug 2019 11:36:19 +0000 (13:36 +0200)]
Merge pull request #29416 from jan--f/wip-41021-nautilus

nautilus: simple: when 'type' file is not present activate fails

5 years agoMerge pull request #28583 from ukernel/nautilus-40326
Yuri Weinstein [Mon, 5 Aug 2019 16:04:53 +0000 (09:04 -0700)]
Merge pull request #28583 from ukernel/nautilus-40326

nautilus:  mds: change how mds revoke stale caps

Reviewed-by: Venky Shankar <vshankar@redhat.com>
5 years agoMerge pull request #28609 from batrick/i40324
Yuri Weinstein [Mon, 5 Aug 2019 16:04:04 +0000 (09:04 -0700)]
Merge pull request #28609 from batrick/i40324

nautilus: cephfs: ceph_volume_client: d_name needs to be converted to string before using

Reviewed-by: Venky Shankar <vshankar@redhat.com>
5 years agoMerge pull request #29156 from smithfarm/wip-40839-nautilus
Yuri Weinstein [Mon, 5 Aug 2019 16:03:30 +0000 (09:03 -0700)]
Merge pull request #29156 from smithfarm/wip-40839-nautilus

nautilus: cephfs-shell: TypeError in poutput

Reviewed-by: Venky Shankar <vshankar@redhat.com>
5 years agoMerge pull request #29157 from smithfarm/wip-40842-nautilus
Yuri Weinstein [Mon, 5 Aug 2019 16:03:01 +0000 (09:03 -0700)]
Merge pull request #29157 from smithfarm/wip-40842-nautilus

nautilus: cephfs: ceph-fuse: mount does not support the fallocate()

Reviewed-by: Venky Shankar <vshankar@redhat.com>
5 years agoMerge pull request #29158 from smithfarm/wip-40843-nautilus
Yuri Weinstein [Mon, 5 Aug 2019 16:02:33 +0000 (09:02 -0700)]
Merge pull request #29158 from smithfarm/wip-40843-nautilus

nautilus: cephfs-shell: name 'files' is not defined error in do_rm()

Reviewed-by: Venky Shankar <vshankar@redhat.com>
5 years agoMerge pull request #29186 from xiaoxichen/wip-40874-nautilus
Yuri Weinstein [Mon, 5 Aug 2019 16:01:57 +0000 (09:01 -0700)]
Merge pull request #29186 from xiaoxichen/wip-40874-nautilus

nautilus: cephfs: client: bump ll_ref from int32 to uint64_t

Reviewed-by: Venky Shankar <vshankar@redhat.com>
5 years agoMerge pull request #29209 from smithfarm/wip-40316-nautilus
Yuri Weinstein [Mon, 5 Aug 2019 16:01:33 +0000 (09:01 -0700)]
Merge pull request #29209 from smithfarm/wip-40316-nautilus

nautilus: tests: test_volume_client: print python version correctly

Reviewed-by: Venky Shankar <vshankar@redhat.com>
5 years agoMerge pull request #29231 from smithfarm/wip-40438-nautilus
Yuri Weinstein [Mon, 5 Aug 2019 16:00:52 +0000 (09:00 -0700)]
Merge pull request #29231 from smithfarm/wip-40438-nautilus

nautilus: cephfs: getattr on snap inode stuck

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Yan, Zheng <zyan@redhat.com>
5 years agoMerge pull request #29233 from smithfarm/wip-40440-nautilus
Yuri Weinstein [Mon, 5 Aug 2019 16:00:15 +0000 (09:00 -0700)]
Merge pull request #29233 from smithfarm/wip-40440-nautilus

nautilus: cephfs: mds: cannot switch mds state from standby-replay to active

Reviewed-by: Venky Shankar <vshankar@redhat.com>
5 years agoMerge pull request #29275 from liewegas/wip-cephfs-meta-pool-priority-nautilus
Yuri Weinstein [Mon, 5 Aug 2019 15:59:53 +0000 (08:59 -0700)]
Merge pull request #29275 from liewegas/wip-cephfs-meta-pool-priority-nautilus

nautilus: mon: set recovery priority etc on cephfs metadata pool

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #29343 from pdvian/wip-40443-nautilus
Yuri Weinstein [Mon, 5 Aug 2019 15:59:13 +0000 (08:59 -0700)]
Merge pull request #29343 from pdvian/wip-40443-nautilus

nautilus: cephfs: client: set snapdir's link count to 1

Reviewed-by: Venky Shankar <vshankar@redhat.com>
5 years agoMerge pull request #29344 from pdvian/wip-40445-nautilus
Yuri Weinstein [Mon, 5 Aug 2019 15:57:53 +0000 (08:57 -0700)]
Merge pull request #29344 from pdvian/wip-40445-nautilus

nautilus: cephfs: mds: cleanup unneeded client_snap_caps when splitting snap inode

Reviewed-by: Venky Shankar <vshankar@redhat.com>
5 years agomgr/dashboard: Fix e2e failures caused by webdriver version 29491/head
Tiago Melo [Mon, 5 Aug 2019 13:56:22 +0000 (13:56 +0000)]
mgr/dashboard: Fix e2e failures caused by webdriver version

Current version of webdriver-manager was not able to install a webdriver version
compatible with Chrome 76.

This fix could not be cherry-picked because master has diverged with nautilus.

Fixes: https://tracker.ceph.com/issues/41075
Signed-off-by: Tiago Melo <tmelo@suse.com>
5 years agomgr/volumes: set uid/gid of FS client's mount as 0/0 29490/head
Ramana Raja [Fri, 26 Jul 2019 14:05:28 +0000 (19:35 +0530)]
mgr/volumes: set uid/gid of FS client's mount as 0/0

... to allow creating subvolumes/subvolume groups within a filesystem.

Fixes: http://tracker.ceph.com/issues/40927
Signed-off-by: Ramana Raja <rraja@redhat.com>
(cherry picked from commit 033d9e743a97534518b817bd10bd27cfbb711a8a)

5 years agomgr/volumes: add `ceph fs subvolumegroup getpath` command
Ramana Raja [Wed, 17 Jul 2019 12:01:22 +0000 (17:31 +0530)]
mgr/volumes: add `ceph fs subvolumegroup getpath` command

... to return the path of a FS subvolume group.

Fixes: http://tracker.ceph.com/issues/40617
Signed-off-by: Ramana Raja <rraja@redhat.com>
(cherry picked from commit 4ac6c2acc2b8d08dd00cf1463a62246bb8128ff4)

5 years agodoc/rgw: document use of 'realm pull' instead of 'period pull' 29484/head
Casey Bodley [Thu, 9 May 2019 19:57:36 +0000 (15:57 -0400)]
doc/rgw: document use of 'realm pull' instead of 'period pull'

'radosgw-admin period pull' fetches a period configuration, but does not
update the realm's current_period to use it. the 'realm pull' command
does both, and the difference is especially important in the failover
case

Fixes: http://tracker.ceph.com/issues/39655
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit f0059614b8e7055e4f1d6dfdefe362e2e81815ef)

5 years agoMerge pull request #29060 from sebastian-philipp/nautilus-orchestrator_cache
Yuri Weinstein [Fri, 2 Aug 2019 22:33:37 +0000 (15:33 -0700)]
Merge pull request #29060 from sebastian-philipp/nautilus-orchestrator_cache

nautilus: mgr/orchestrator: Cache and DeepSea iSCSI + NFS

Reviewed-by: Tim Serong <tserong@suse.com>
5 years agoMerge pull request #28187 from pdvian/wip-39516-nautilus
Yuri Weinstein [Fri, 2 Aug 2019 20:18:19 +0000 (13:18 -0700)]
Merge pull request #28187 from pdvian/wip-39516-nautilus

nautilus: tests: osd-backfill-space.sh test failed in TEST_backfill_multi_partial()

Reviewed-by: David Zafman <dzafman@redhat.com>
5 years agoMerge pull request #28573 from smithfarm/wip-40281-nautilus
Yuri Weinstein [Fri, 2 Aug 2019 20:17:44 +0000 (13:17 -0700)]
Merge pull request #28573 from smithfarm/wip-40281-nautilus

nautilus: bluestore: 50-100% iops lost due to bluefs_preextend_wal_files = false

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
Reviewed-by: Sage Weil <sage@redhat.com>
5 years agoMerge pull request #29007 from smithfarm/wip-40750-nautilus
Yuri Weinstein [Fri, 2 Aug 2019 20:17:05 +0000 (13:17 -0700)]
Merge pull request #29007 from smithfarm/wip-40750-nautilus

nautilus: build/ops: rpm: drop SuSEfirewall2

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Tim Serong <tserong@suse.com>
5 years agoMerge pull request #29102 from tspmelo/wip-40733-nautilus
Yuri Weinstein [Fri, 2 Aug 2019 20:15:28 +0000 (13:15 -0700)]
Merge pull request #29102 from tspmelo/wip-40733-nautilus

nautilus: mgr/dashboard: Fix npm vulnerabilities

Reviewed-by: Nathan Cutler <ncutler@suse.com>
5 years agoMerge pull request #29162 from smithfarm/wip-40837-nautilus
Yuri Weinstein [Fri, 2 Aug 2019 20:14:48 +0000 (13:14 -0700)]
Merge pull request #29162 from smithfarm/wip-40837-nautilus

nautilus: bluestore: Set concurrent max_background_compactions in rocksdb to 2

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #29204 from smithfarm/wip-40319-nautilus
Yuri Weinstein [Fri, 2 Aug 2019 20:11:53 +0000 (13:11 -0700)]
Merge pull request #29204 from smithfarm/wip-40319-nautilus

nautilus: tests: make: *** [hello_world_cpp] Error 127 in rados

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #29391 from pdvian/wip-40625-nautilus
Yuri Weinstein [Fri, 2 Aug 2019 20:10:59 +0000 (13:10 -0700)]
Merge pull request #29391 from pdvian/wip-40625-nautilus

nautilus: osd/OSD: auto mark heartbeat sessions as stale and tear them down

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
5 years agoMerge pull request #29464 from jan--f/wip-41058-nautilus
Alfredo Deza [Fri, 2 Aug 2019 13:45:33 +0000 (09:45 -0400)]
Merge pull request #29464 from jan--f/wip-41058-nautilus

nautilus: ceph-volume does not recognize wal/db partitions created by ceph-disk

Reviewed-by: Alfredo Deza <adeza@redhat.com>
5 years agoceph-volume: fall back to PARTTYPE if PARTLABEL is empty 29464/head
Jan Fajerski [Tue, 30 Jul 2019 15:32:06 +0000 (17:32 +0200)]
ceph-volume: fall back to PARTTYPE if PARTLABEL is empty

In some cases ceph-disk does not populate PARTLABEL for wal and db
partitions. This commit adds the assumption that the empty string is a
valid label and falls back to identifying those disks by PARTTYPE.

Fixes: https://tracker.ceph.com/issues/40917
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit 82d2ae7ffdf62ca93c7848fb62e506db4cda893c)

5 years agoceph-volume: adjust tests for empty PARTLABEL fields
Jan Fajerski [Tue, 30 Jul 2019 15:29:09 +0000 (17:29 +0200)]
ceph-volume: adjust tests for empty PARTLABEL fields

It seems like ceph-disk sometimes creates OSDs where the wal and db
partitions have no PARTLABEL set. This commit alters tests so that the
empty string is considered a valid label.

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit bb29110c3c6e081568231131c70522dee6d12bb5)

5 years agoceph-volume: refactor ceph-disk_member unittests
Jan Fajerski [Tue, 30 Jul 2019 11:29:22 +0000 (13:29 +0200)]
ceph-volume: refactor ceph-disk_member unittests

This adds a parameterized fixture as input to the tests. Should make
writing new tests easier since only fixture parameters need to be added.
In the future we should be able to reuse the fixtures to build other
fixtures and reuse the parametrization.

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit f42287c3416ad09c112e64756f5051c5c13aa344)

5 years agoMerge pull request #29453 from neha-ojha/wip-41052-nautilus
Neha Ojha [Fri, 2 Aug 2019 00:20:26 +0000 (17:20 -0700)]
Merge pull request #29453 from neha-ojha/wip-41052-nautilus

nautilus: qa/tasks/cbt.py: change port to work with client_endpoints

Reviewed-by: Yuri Weinstein <yweins@redhat.com>
5 years agodocs: fix rgw ldap username token 29455/head
Thomas Kriechbaumer [Sun, 5 May 2019 15:40:40 +0000 (17:40 +0200)]
docs: fix rgw ldap username token

Signed-off-by: Thomas Kriechbaumer <thomas@kriechbaumer.name>
(cherry picked from commit 009f404983558ac084aa6772954ac918db19d890)

5 years agoqa/tasks/cbt.py: change port to work with client_endpoints 29453/head
Neha Ojha [Fri, 7 Jun 2019 00:21:38 +0000 (17:21 -0700)]
qa/tasks/cbt.py: change port to work with client_endpoints

hack to work with https://github.com/ceph/cbt/pull/160/

Signed-off-by: Neha Ojha <nojha@redhat.com>
(cherry picked from commit ee02416c654581d77d5f976da89b4a33dd1172e3)

5 years agoMerge pull request #28740 from smithfarm/wip-40546-nautilus
Yuri Weinstein [Thu, 1 Aug 2019 22:09:57 +0000 (15:09 -0700)]
Merge pull request #28740 from smithfarm/wip-40546-nautilus

nautilus: common: Keyrings created by ceph auth get are not suitable for ceph auth import

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #28810 from ifed01/wip-ifed-db-stats-nau
Yuri Weinstein [Thu, 1 Aug 2019 22:09:13 +0000 (15:09 -0700)]
Merge pull request #28810 from ifed01/wip-ifed-db-stats-nau

nautilus: tools: ceph-kvstore-tool: print db stats

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #29252 from smithfarm/wip-40180-nautilus
Yuri Weinstein [Thu, 1 Aug 2019 22:08:17 +0000 (15:08 -0700)]
Merge pull request #29252 from smithfarm/wip-40180-nautilus

nautilus: tests: qa/standalone/scrub/osd-scrub-snaps.sh sometimes fails

Reviewed-by: David Zafman <dzafman@redhat.com>
5 years agoMerge pull request #29309 from smithfarm/wip-40216-nautilus
Yuri Weinstein [Thu, 1 Aug 2019 20:51:39 +0000 (13:51 -0700)]
Merge pull request #29309 from smithfarm/wip-40216-nautilus

nautilus: rgw_file:  fix invalidation of top-level directories

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
5 years agodoc: Update 'ceph-iscsi' min version 29444/head
Ricardo Marques [Tue, 23 Jul 2019 09:38:24 +0000 (10:38 +0100)]
doc: Update 'ceph-iscsi' min version

Signed-off-by: Ricardo Marques <rimarques@suse.com>
(cherry picked from commit b434c2910acfdceda7fd005bcc6285ba98f008d2)

5 years agodoc/mgr/dashboard: update SSL configuration instructions 29065/head
Ricardo Dias [Tue, 9 Apr 2019 12:46:34 +0000 (13:46 +0100)]
doc/mgr/dashboard: update SSL configuration instructions

Signed-off-by: Ricardo Dias <rdias@suse.com>
(cherry picked from commit 69895dd51650423849504d34c4e3b7b211cc0473)

5 years agomgr/dashboard: added CLI commands to set SSL certificate and key
Ricardo Dias [Tue, 9 Apr 2019 12:42:57 +0000 (13:42 +0100)]
mgr/dashboard: added CLI commands to set SSL certificate and key

Fixes: https://tracker.ceph.com/issues/39123
Signed-off-by: Ricardo Dias <rdias@suse.com>
(cherry picked from commit 7648d294bfe06f335d1c77bad2d662fc0ab0914b)

5 years agomgr/dashboard: Add backwards compatibility to interlock of `fast-diff` and `object... 29442/head
Patrick Nawracay [Tue, 18 Jun 2019 12:00:15 +0000 (14:00 +0200)]
mgr/dashboard: Add backwards compatibility to interlock of `fast-diff` and `object-map`

Fixes: http://tracker.ceph.com/issues/39451
Signed-off-by: Patrick Nawracay <pnawracay@suse.com>
(cherry picked from commit d0fe5ce52a2611b2d8171a9f8a593b0349ab9dbc)

5 years agomgr/dashboard: Interlock `fast-diff` and `object-map`
Patrick Nawracay [Tue, 18 Jun 2019 11:57:46 +0000 (13:57 +0200)]
mgr/dashboard: Interlock `fast-diff` and `object-map`

Fixes: http://tracker.ceph.com/issues/39451
Signed-off-by: Patrick Nawracay <pnawracay@suse.com>
(cherry picked from commit dfeba0b1399f13bca9f9c2fe2a77812a33f1e2bd)

5 years agorocksdb: Updated to v6.1.2 29440/head
Mark Nelson [Wed, 10 Jul 2019 10:58:14 +0000 (06:58 -0400)]
rocksdb: Updated to v6.1.2

Signed-off-by: Mark Nelson <mnelson@redhat.com>
(cherry picked from commit 5143607e2738f4ccfb02b9be50e4c67d52205390)

5 years agorocksdb: enable rocksdb_rmrange=true by default 29439/head
Sage Weil [Thu, 25 Jul 2019 15:10:02 +0000 (10:10 -0500)]
rocksdb: enable rocksdb_rmrange=true by default

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 07cc88431a28d831d9d7ffd8b982e7eebdc3841d)

5 years agokv: make delete range optional on number of keys
Zengran Zhang [Tue, 2 Apr 2019 14:03:45 +0000 (22:03 +0800)]
kv: make delete range optional on number of keys

Actually, we may only wanna let the objects with real big number of omap to
use delete range. if not, we find too many tombstones will have side-effects
on performance of kv.

refer: https://github.com/facebook/rocksdb/wiki/DeleteRange-Implementation

Signed-off-by: Zengran Zhang <zhangzengran@sangfor.com.cn>
(cherry picked from commit b039e63c6816ed371c6db975b4cbc7a3d170bb1f)

5 years agoMerge pull request #29254 from smithfarm/wip-40465-nautilus
Yuri Weinstein [Wed, 31 Jul 2019 23:15:41 +0000 (16:15 -0700)]
Merge pull request #29254 from smithfarm/wip-40465-nautilus

nautilus: core: osd beacon sometimes has empty pg list

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #28528 from pdvian/wip-39743-nautilus
Yuri Weinstein [Wed, 31 Jul 2019 23:13:17 +0000 (16:13 -0700)]
Merge pull request #28528 from pdvian/wip-39743-nautilus

nautilus: mon: paxos: introduce new reset_pending_committing_finishers for safety

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #28575 from smithfarm/wip-40381-nautilus
Yuri Weinstein [Wed, 31 Jul 2019 23:12:27 +0000 (16:12 -0700)]
Merge pull request #28575 from smithfarm/wip-40381-nautilus

nautilus: rbd: tests: add "rbd diff" coverage to suite

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
5 years agoMerge pull request #28576 from smithfarm/wip-40382-nautilus
Yuri Weinstein [Wed, 31 Jul 2019 23:11:49 +0000 (16:11 -0700)]
Merge pull request #28576 from smithfarm/wip-40382-nautilus

nautilus: tests: expected MON_CLOCK_SKEW but got none

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #28870 from pdvian/wip-40235-nautilus
Yuri Weinstein [Wed, 31 Jul 2019 23:10:58 +0000 (16:10 -0700)]
Merge pull request #28870 from pdvian/wip-40235-nautilus

nautilus: rbd/action: fix error getting positional argument

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
5 years agoMerge pull request #29193 from pdvian/wip-40272-nautilus
Yuri Weinstein [Wed, 31 Jul 2019 23:10:07 +0000 (16:10 -0700)]
Merge pull request #29193 from pdvian/wip-40272-nautilus

nautilus: rbd-mirror: link against the specified alloc library

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
5 years agoMerge pull request #29244 from pdvian/wip-40274-nautilus
Yuri Weinstein [Wed, 31 Jul 2019 23:09:22 +0000 (16:09 -0700)]
Merge pull request #29244 from pdvian/wip-40274-nautilus

nautilus: core: librados: move buffer free functions to inline namespace

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
5 years agoMerge pull request #29246 from pdvian/wip-40276-nautilus
Yuri Weinstein [Wed, 31 Jul 2019 23:08:49 +0000 (16:08 -0700)]
Merge pull request #29246 from pdvian/wip-40276-nautilus

nautilus: rbd: librbd: do not unblock IO prior to growing object map during resize

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Mykola Golub <mgolub@mirantis.com>