]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
5 years agoMerge pull request #33209 from jan--f/wip-deactivate-nautilus
Jan Fajerski [Tue, 11 Feb 2020 16:14:12 +0000 (17:14 +0100)]
Merge pull request #33209 from jan--f/wip-deactivate-nautilus

nautilus: ceph-volume: lvm deactivate command

5 years agoMerge pull request #32915 from smithfarm/wip-43628-nautilus
Yuri Weinstein [Tue, 11 Feb 2020 16:03:05 +0000 (08:03 -0800)]
Merge pull request #32915 from smithfarm/wip-43628-nautilus

nautilus: client: disallow changing fuse_default_permissions option at runtime

Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>
5 years agoMerge pull request #32914 from smithfarm/wip-43624-nautilus
Yuri Weinstein [Tue, 11 Feb 2020 16:02:21 +0000 (08:02 -0800)]
Merge pull request #32914 from smithfarm/wip-43624-nautilus

nautilus: mds: note client features when rejecting client

Reviewed-by: Ramana Raja <rraja@redhat.com>
5 years agoMerge pull request #32913 from smithfarm/wip-43573-nautilus
Yuri Weinstein [Tue, 11 Feb 2020 16:01:45 +0000 (08:01 -0800)]
Merge pull request #32913 from smithfarm/wip-43573-nautilus

nautilus: cephfs-journal-tool: fix crash and usage

Reviewed-by: Ramana Raja <rraja@redhat.com>
5 years agoMerge pull request #32909 from smithfarm/wip-43343-nautilus
Yuri Weinstein [Tue, 11 Feb 2020 16:00:25 +0000 (08:00 -0800)]
Merge pull request #32909 from smithfarm/wip-43343-nautilus

nautilus: mds: fix revoking caps after after stale->resume circle

Reviewed-by: Ramana Raja <rraja@redhat.com>
5 years agoMerge pull request #32602 from batrick/i43558
Yuri Weinstein [Tue, 11 Feb 2020 15:59:47 +0000 (07:59 -0800)]
Merge pull request #32602 from batrick/i43558

nautilus: mds: reject forward scrubs when cluster has multiple active MDS (more than one rank)

Reviewed-by: Ramana Raja <rraja@redhat.com>
5 years agoMerge pull request #32600 from batrick/i43506
Yuri Weinstein [Tue, 11 Feb 2020 15:59:19 +0000 (07:59 -0800)]
Merge pull request #32600 from batrick/i43506

nautilus: MDSMonitor: warn if a new file system is being created with an EC default data pool

Reviewed-by: Ramana Raja <rraja@redhat.com>
5 years agoMerge pull request #30843 from smithfarm/wip-41853-nautilus
Yuri Weinstein [Tue, 11 Feb 2020 15:58:33 +0000 (07:58 -0800)]
Merge pull request #30843 from smithfarm/wip-41853-nautilus

nautilus: mds: reject sessionless messages

Reviewed-by: Ramana Raja <rraja@redhat.com>
5 years agolvm: add deactivate subcommand 33209/head
Jan Fajerski [Wed, 11 Dec 2019 13:54:16 +0000 (14:54 +0100)]
lvm: add deactivate subcommand

This new subcommand unmounts and OSDs tmpfs mount and closes crypt
devices if there are any.

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit 9797f6b83d727933b1a0daab239f3034675a1d0e)

5 years agoutil/system: add unmount_tmpfs helper
Jan Fajerski [Thu, 12 Dec 2019 08:28:27 +0000 (09:28 +0100)]
util/system: add unmount_tmpfs helper

Thsi unmounts a path if and only if it's a tmpfs mount.

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit 705ed1110138b1e7c77768f97d5acda4a76d868f)

5 years agoapi/lvm: add get_lv_by_osd_id method
Jan Fajerski [Wed, 11 Dec 2019 12:17:19 +0000 (13:17 +0100)]
api/lvm: add get_lv_by_osd_id method

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit 2558b55b0ecbcc83acccbf8412c19f01e8dafb3e)

5 years agoapi/lvm: add deactivate method to Volume class
Jan Fajerski [Wed, 11 Dec 2019 12:17:02 +0000 (13:17 +0100)]
api/lvm: add deactivate method to Volume class

Simply calls lvchange -an to deactivate a logical volume.

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit 8087600d4853554794b709291a08d97befd07ed1)

5 years agoMerge pull request #32868 from shyukri/wip-42945-nautilus
Jan Fajerski [Tue, 11 Feb 2020 13:23:27 +0000 (14:23 +0100)]
Merge pull request #32868 from shyukri/wip-42945-nautilus

nautilus: ceph-volume: allow raw block devices everywhere

5 years agodoc: update ceph-volume lvm prepare 32868/head
Jan Fajerski [Tue, 5 Nov 2019 12:39:27 +0000 (13:39 +0100)]
doc: update ceph-volume lvm prepare

Add option to pass raw physical devices everywhere, restructure a little
(bluestore section before filestore) and reword a few things.

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit f2018d76eb8936aed8643328f0d5f111c87514e4)

5 years agoceph-volume: make lvm report fields into constants
Jan Fajerski [Tue, 5 Nov 2019 07:31:44 +0000 (08:31 +0100)]
ceph-volume: make lvm report fields into constants

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit 01a603f6e952d2c5931b89699a86503e281fb376)

5 years agoceph-volume: api/lvm create or reuse a vg
Jan Fajerski [Tue, 22 Oct 2019 12:32:11 +0000 (14:32 +0200)]
ceph-volume: api/lvm create or reuse a vg

This changes create_lv so one can pass the desired device and either a
VG with a name starting with ceph is re-used or a new one is created.
This commit also adds two new lvm primitives, making use of lvm's select
feature. The goal is to eventually avoid keeping a full list of lv's (or
vg's) around and query the lvm system as needed.

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit bb4de1a3fc238eaf9f717dc59c6bdf338ef6d657)

5 years agoMerge pull request #33202 from jan--f/wip-43853-nautilus
Jan Fajerski [Tue, 11 Feb 2020 12:08:01 +0000 (13:08 +0100)]
Merge pull request #33202 from jan--f/wip-43853-nautilus

nautilus: ceph-volume/batch: fail on filtered devices when non-interactive

5 years agoMerge pull request #33200 from jan--f/wip-42898-nautilus
Jan Fajerski [Tue, 11 Feb 2020 12:03:59 +0000 (13:03 +0100)]
Merge pull request #33200 from jan--f/wip-42898-nautilus

nautilus: ceph-volume: make get_devices fs location independent

5 years agoMerge pull request #32870 from shyukri/wip-43117-nautilus
Jan Fajerski [Tue, 11 Feb 2020 11:34:53 +0000 (12:34 +0100)]
Merge pull request #32870 from shyukri/wip-43117-nautilus

nautilus: ceph-volume: import mock.mock instead of unittest.mock (py2)

5 years agoMerge pull request #32877 from shyukri/wip-43570-nautilus
Jan Fajerski [Tue, 11 Feb 2020 11:32:01 +0000 (12:32 +0100)]
Merge pull request #32877 from shyukri/wip-43570-nautilus

nautilus: ceph-volume: Dereference symlink in lvm list

5 years agoMerge pull request #32873 from shyukri/wip-43201-nautilus
Jan Fajerski [Tue, 11 Feb 2020 11:31:08 +0000 (12:31 +0100)]
Merge pull request #32873 from shyukri/wip-43201-nautilus

nautilus: ceph-volume: fix the integer overflow

5 years agoMerge pull request #32874 from shyukri/wip-43321-nautilus
Jan Fajerski [Tue, 11 Feb 2020 11:19:50 +0000 (12:19 +0100)]
Merge pull request #32874 from shyukri/wip-43321-nautilus

nautilus: ceph-volume: use correct extents if using db-devices and >1 osds_per_device

5 years agoMerge pull request #32864 from shyukri/wip-43462-nautilus
Jan Fajerski [Tue, 11 Feb 2020 11:09:23 +0000 (12:09 +0100)]
Merge pull request #32864 from shyukri/wip-43462-nautilus

nautilus: ceph-volume/lvm/activate.py: clarify error message: fsid refers to osd_fsid

5 years agoMerge pull request #32860 from shyukri/wip-43281-nautilus
Jan Fajerski [Tue, 11 Feb 2020 11:08:22 +0000 (12:08 +0100)]
Merge pull request #32860 from shyukri/wip-43281-nautilus

nautilus: ceph-volume: util: look for executable in $PATH

5 years agoMerge pull request #31616 from jan--f/wip-42800-nautilus
Jan Fajerski [Tue, 11 Feb 2020 11:07:20 +0000 (12:07 +0100)]
Merge pull request #31616 from jan--f/wip-42800-nautilus

nautilus: ceph-volume: assume msgrV1 for all branches containing mimic

5 years agoceph-volume/batch: fail on filtered devices when non-interactive 33202/head
Jan Fajerski [Tue, 3 Dec 2019 12:44:00 +0000 (13:44 +0100)]
ceph-volume/batch: fail on filtered devices when non-interactive

When batch is called non-interactively and a user explicitly specifies,
say a db-device, this will be filtered when unavailable. This can cause
the resulting OSD to be very different from the users intention
(standalone vs external db when the db-device was filtered). If devices
get filtered in non-interactive mode, ceph-volume should fail.

Fixes: https://tracker.ceph.com/issues/43105
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit 2e985053deec6c4cf60c0b85aec3df16cd77ceeb)

5 years agoceph-volume: refactor tests for refactored get_devices 33200/head
Jan Fajerski [Mon, 11 Nov 2019 13:35:43 +0000 (14:35 +0100)]
ceph-volume: refactor tests for refactored get_devices

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit 4749f4c59dc4edb1fd689e18e8d9f358f95cb945)

Conflicts:
src/ceph-volume/ceph_volume/tests/conftest.py
        resolved by importing PropertyMock

5 years agoceph-volume: refactor get_devices, don't use os.path.realpath
Jan Fajerski [Fri, 8 Nov 2019 15:36:30 +0000 (16:36 +0100)]
ceph-volume: refactor get_devices, don't use os.path.realpath

Fixes: https://tracker.ceph.com/issues/42777
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit b35e8c485f73b5b65e0be29444eb06172d6df3e3)

5 years agoMerge pull request #32558 from shyukri/wip-43275-nautilus
Jan Fajerski [Tue, 11 Feb 2020 10:40:48 +0000 (11:40 +0100)]
Merge pull request #32558 from shyukri/wip-43275-nautilus

nautilus: ceph-volume/test: patch VolumeGroups

5 years agoMerge pull request #32556 from shyukri/wip-43022-nautilus
Jan Fajerski [Tue, 11 Feb 2020 10:39:40 +0000 (11:39 +0100)]
Merge pull request #32556 from shyukri/wip-43022-nautilus

nautilus: ceph-volume: minor clean-up of "simple scan" subcommand help

5 years agoMerge pull request #32998 from neha-ojha/wip-min-alloc-nautilus
Yuri Weinstein [Mon, 10 Feb 2020 21:46:00 +0000 (13:46 -0800)]
Merge pull request #32998 from neha-ojha/wip-min-alloc-nautilus

nautilus: common/options: bluestore 4k min_alloc_size for SSD

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Igor Fedotov <ifedotov@suse.com>
5 years agoMerge pull request #32846 from smithfarm/wip-43256-nautilus
Yuri Weinstein [Mon, 10 Feb 2020 21:37:08 +0000 (13:37 -0800)]
Merge pull request #32846 from smithfarm/wip-43256-nautilus

nautilus: common/config: update values when they are removed via mon

Reviewed-by: Sage Weil <sage@redhat.com>
5 years agoMerge pull request #32997 from neha-ojha/wip-32939-nautilus
Yuri Weinstein [Mon, 10 Feb 2020 20:46:12 +0000 (12:46 -0800)]
Merge pull request #32997 from neha-ojha/wip-32939-nautilus

nautilus: mon/MgrMonitor.cc: add always_on_modules to the output of "ceph mgr module ls"

Reviewed-by: David Zafman <dzafman@redhat.com>
5 years agoMerge pull request #32901 from smithfarm/wip-43631-nautilus
Yuri Weinstein [Mon, 10 Feb 2020 20:44:42 +0000 (12:44 -0800)]
Merge pull request #32901 from smithfarm/wip-43631-nautilus

nautilus: common/util: use ifstream to read from /proc files

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #32858 from smithfarm/wip-43473-nautilus
Yuri Weinstein [Mon, 10 Feb 2020 20:43:33 +0000 (12:43 -0800)]
Merge pull request #32858 from smithfarm/wip-43473-nautilus

nautilus: common: fix deadlocky inflight op visiting in OpTracker.

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #32845 from smithfarm/wip-43245-nautilus
Yuri Weinstein [Mon, 10 Feb 2020 20:41:21 +0000 (12:41 -0800)]
Merge pull request #32845 from smithfarm/wip-43245-nautilus

nautilus: os/bluestore/BlueStore.cc: set priorities for compression stats

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
5 years agoMerge pull request #32774 from dzafman/wip-43726-nautilus
Yuri Weinstein [Mon, 10 Feb 2020 20:38:35 +0000 (12:38 -0800)]
Merge pull request #32774 from dzafman/wip-43726-nautilus

nautilus: test: Fix wait_for_state() to wait for a PG to get into a state

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoceph-volume: Dereference symlink in lvm list 32877/head
Benoît Knecht [Thu, 2 Jan 2020 07:07:21 +0000 (08:07 +0100)]
ceph-volume: Dereference symlink in lvm list

This allows for a symlink to be passed to

```
ceph-volume lvm list <path>
```

which makes it possible to use `/dev/disk/by-path/*` devices, for
instance.

Fixes: https://tracker.ceph.com/issues/43497
Signed-off-by: Benoît Knecht <bknecht@protonmail.ch>
(cherry picked from commit 09fa3df8a39d361f2af11bded8aab9e0da334d51)

5 years agoceph-volume: use correct extents when using db-devices and >1 osds_per_device 32874/head
Fabian Niepelt [Wed, 11 Dec 2019 13:19:14 +0000 (14:19 +0100)]
ceph-volume: use correct extents when using db-devices and >1 osds_per_device

Actual data size depending on osds_per_device needs to be calculated here. Otherwise, if osds_per_device is greater than 1, ceph-volume will allocate 100% of the device to the first osd and then fail to create the LV for the second because the volume group is already full.

Fixes: https://tracker.ceph.com/issues/39442
Signed-off-by: Fabian Niepelt <f.niepelt@mittwald.de>
(cherry picked from commit ecde6cd619605003706f545b0b5ad4e2e8932f28)

 Conflicts:
src/ceph-volume/ceph_volume/devices/lvm/strategies/bluestore.py

I've removed `data_uuid` since it's not in nautilus already

5 years agoceph-volume: fix the type mismatch, covert the tries and interval to int from string. 32873/head
taodd [Sun, 8 Dec 2019 02:10:59 +0000 (10:10 +0800)]
ceph-volume: fix the type mismatch, covert the tries and interval to int from string.
Fixes: https://tracker.ceph.com/issues/43186
Signed-off-by: dongdong tao <dongdong.tao@canonical.com>
(cherry picked from commit 81ff4be4d13ce034d7a8b921113138a942e3051a)

5 years agoceph-volume: import mock.mock instead of unittest.mock (py2) 32870/head
Jan Fajerski [Fri, 22 Nov 2019 15:57:11 +0000 (16:57 +0100)]
ceph-volume: import mock.mock instead of unittest.mock (py2)

Fixes: bb4de1a3fc238eaf9f717dc59c6bdf338ef6d657
Fixes: https://tracker.ceph.com/issues/42970
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit c1bd09f2591d983f1988e3dadcf3c65c59afb15d)

Conflicts:
src/ceph-volume/ceph_volume/tests/api/test_lvm.py

5 years agolvm/activate.py: clarify error message: fsid refers to osd_fsid 32864/head
Yaniv Kaul [Thu, 19 Dec 2019 14:54:58 +0000 (16:54 +0200)]
lvm/activate.py: clarify error message: fsid refers to osd_fsid

Users complained[1] the error message isn't clear, and they thought
it referred to the cluster fsid instead of the osd_fsid.
Made it clearer.

[1] rook/rook#4547

Fixes: https://tracker.ceph.com/issues/43442
Signed-off-by: Yaniv Kaul <ykaul@redhat.com>
(cherry picked from commit ff3ba9200a6b5856fbdf4372fe292a7b94dd2539)

5 years agoceph-volume: util: look for executable in $PATH 32860/head
Shyukri Shyukriev [Thu, 21 Nov 2019 14:04:02 +0000 (15:04 +0100)]
ceph-volume: util: look for executable in $PATH

Fixes: https://tracker.ceph.com/issues/36728
Fallback to predefined paths for backward compatibility.
Alter test involved for partial match in warning

Signed-off-by: Shyukri Shyukriev <shshyukriev@suse.com>
(cherry picked from commit a8577085dc52b0f214d9568c29a9605d1a826a45)

5 years agoMerge pull request #30689 from smithfarm/wip-42120-nautilus
Yuri Weinstein [Sat, 8 Feb 2020 00:27:15 +0000 (16:27 -0800)]
Merge pull request #30689 from smithfarm/wip-42120-nautilus

nautilus: core: osd/OSDMap: health alert for non-power-of-two pg_num

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #32857 from smithfarm/wip-43471-nautilus
Yuri Weinstein [Fri, 7 Feb 2020 22:31:36 +0000 (14:31 -0800)]
Merge pull request #32857 from smithfarm/wip-43471-nautilus

nautilus: osd/PeeringState.cc: don't let num_objects become negative

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #32848 from smithfarm/wip-43346-nautilus
Yuri Weinstein [Fri, 7 Feb 2020 22:31:01 +0000 (14:31 -0800)]
Merge pull request #32848 from smithfarm/wip-43346-nautilus

nautilus: qa/suites/rados/thrash: force normal pg log length with cache tiering

Reviewed-by: Sage Weil <sage@redhat.com>
5 years agoMerge pull request #32847 from smithfarm/wip-43319-nautilus
Yuri Weinstein [Fri, 7 Feb 2020 22:30:26 +0000 (14:30 -0800)]
Merge pull request #32847 from smithfarm/wip-43319-nautilus

nautilus: osd/PeeringState.cc: skip peer_purged when discovering all missing

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #32843 from smithfarm/wip-43099-nautilus
Yuri Weinstein [Fri, 7 Feb 2020 22:29:48 +0000 (14:29 -0800)]
Merge pull request #32843 from smithfarm/wip-43099-nautilus

nautilus: osd/OSD: enhance osd numa affinity compatibility

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
5 years agoMerge pull request #32773 from dzafman/wip-43246-nautilus
Yuri Weinstein [Fri, 7 Feb 2020 22:29:08 +0000 (14:29 -0800)]
Merge pull request #32773 from dzafman/wip-43246-nautilus

nautilus: osd: Use physical ratio for nearfull (doesn't include backfill resserve)

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge branch 'nautilus' into wip-42120-nautilus 30689/head
David Zafman [Fri, 7 Feb 2020 22:27:18 +0000 (14:27 -0800)]
Merge branch 'nautilus' into wip-42120-nautilus

5 years agoMerge pull request #32716 from smithfarm/wip-43650-nautilus
Yuri Weinstein [Fri, 7 Feb 2020 22:11:40 +0000 (14:11 -0800)]
Merge pull request #32716 from smithfarm/wip-43650-nautilus

nautilus: osd: Diagnostic logging for upmap cleaning

Reviewed-by: David Zafman <dzafman@redhat.com>
5 years agoMerge pull request #32715 from smithfarm/wip-43620-nautilus
Yuri Weinstein [Fri, 7 Feb 2020 22:09:27 +0000 (14:09 -0800)]
Merge pull request #32715 from smithfarm/wip-43620-nautilus

nautilus: kv: fix shutdown vs async compaction

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
5 years agoMerge pull request #32259 from smithfarm/wip-43243-nautilus
Yuri Weinstein [Fri, 7 Feb 2020 22:08:44 +0000 (14:08 -0800)]
Merge pull request #32259 from smithfarm/wip-43243-nautilus

nautilus: selinux: Allow ceph to read udev db

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Boris Ranto <branto@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #32769 from liewegas/fix-42566-nautilus
Yuri Weinstein [Fri, 7 Feb 2020 22:03:28 +0000 (14:03 -0800)]
Merge pull request #32769 from liewegas/fix-42566-nautilus

nautilus: mgr/MgrClient: fix open condition

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
5 years agoMerge pull request #32930 from rhcs-dashboard/wip-43845-nautilus
Lenz Grimmer [Thu, 6 Feb 2020 10:33:33 +0000 (10:33 +0000)]
Merge pull request #32930 from rhcs-dashboard/wip-43845-nautilus

nautilus: mgr/dashboard: disable 'Add Capability' button in rgw user edit

Reviewed-by: Laura Paduano <lpaduano@suse.com>
5 years agoMerge pull request #32827 from rhcs-dashboard/wip-43811-nautilus
Lenz Grimmer [Thu, 6 Feb 2020 10:21:49 +0000 (10:21 +0000)]
Merge pull request #32827 from rhcs-dashboard/wip-43811-nautilus

nautilus: mgr/dashboard: check if user has config-opt permissions

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
5 years agoMerge pull request #31808 from bk201/wip-42956-nautilus
Lenz Grimmer [Thu, 6 Feb 2020 10:20:36 +0000 (10:20 +0000)]
Merge pull request #31808 from bk201/wip-42956-nautilus

nautilus: mgr/dashboard: check embedded Grafana dashboard references

Reviewed-by: Laura Paduano <lpaduano@suse.com>
5 years agoMerge pull request #31792 from rhcs-dashboard/wip-42936-nautilus
Lenz Grimmer [Thu, 6 Feb 2020 10:19:33 +0000 (10:19 +0000)]
Merge pull request #31792 from rhcs-dashboard/wip-42936-nautilus

nautilus: mgr/dashboard: Dashboard can't handle self-signed cert on Grafana API

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
5 years agoMerge pull request #31190 from rhcs-dashboard/wip-42294-nautilus
Lenz Grimmer [Thu, 6 Feb 2020 10:17:22 +0000 (10:17 +0000)]
Merge pull request #31190 from rhcs-dashboard/wip-42294-nautilus

nautilus: mgr/dashboard: add debug mode, and accept expected exception when SSL handshaking

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
5 years agoMerge pull request #32304 from ricardoasmarques/wip-43333-nautilus
Lenz Grimmer [Thu, 6 Feb 2020 10:15:34 +0000 (10:15 +0000)]
Merge pull request #32304 from ricardoasmarques/wip-43333-nautilus

nautilus: mgr/dashboard: iSCSI targets not available if any gateway is down (and more...)

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
5 years agoMerge pull request #32888 from shyukri/wip-42033-nautilus
Lenz Grimmer [Thu, 6 Feb 2020 10:13:27 +0000 (10:13 +0000)]
Merge pull request #32888 from shyukri/wip-42033-nautilus

nautilus: mgr/dashboard: Using wrong identifiers in RGW user/bucket datatables

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
5 years agoqa: force creation of fs with EC default data pool 32600/head
Patrick Donnelly [Fri, 20 Dec 2019 20:57:31 +0000 (12:57 -0800)]
qa: force creation of fs with EC default data pool

In the future, we should add the EC data pool as a supplementary data
pool but that requires a mount to setup which is awkward in the code
here. When cephfs-shell is more widely available, this will be easier.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit 6e448f9aa0e71f1e820f4bd1b53e067268e4b67a)

5 years agoqa: add tests for adding EC data pools
Patrick Donnelly [Fri, 13 Dec 2019 00:43:14 +0000 (16:43 -0800)]
qa: add tests for adding EC data pools

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit bf0cf8e08bfa49d2e84f079db2bd3b521ce5deec)

Conflicts:
qa/tasks/cephfs/filesystem.py

5 years agomon/MDSMonitor: warn when creating fs with default EC data pool
Patrick Donnelly [Thu, 7 Nov 2019 22:12:03 +0000 (14:12 -0800)]
mon/MDSMonitor: warn when creating fs with default EC data pool

Rationale can be found in [1]. Point is that EC pools incur a
significant performance penalty when dealing with small files and xattr
updates. This is because _every_ inode has a corresponding data pool
object with backtrace information stored in its xattr.

[1] doc/cephfs/createfs.rst

Fixes: https://tracker.ceph.com/issues/42450
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit 3e0aee5ed68b7b4018fb03d5160f3f19da0f6458)

5 years agoqa: add tests for CephFS admin commands
Patrick Donnelly [Wed, 30 Oct 2019 17:21:22 +0000 (10:21 -0700)]
qa: add tests for CephFS admin commands

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit 9dc07d80967287051eab3245e58d029157d3e1da)

5 years agomds: skip tell command scrub on multimds 32602/head
Patrick Donnelly [Mon, 20 Jan 2020 16:23:29 +0000 (08:23 -0800)]
mds: skip tell command scrub on multimds

The master version of this PR deals with the unified asok/tell
interface. Nautilus- are separated.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agomds: throttle scrub start for multiple active MDS
Milind Changire [Fri, 10 Jan 2020 06:31:34 +0000 (12:01 +0530)]
mds: throttle scrub start for multiple active MDS

* add check to "scrub start" command handler to dishonor request if
  multiple MDS are "active" for a recursive scrub request
* add check to MDSRank::handle_mds_map() to see if scrubbing is in
  progress and max_mds is greater than 1, if so then scrubbing is
  aborted. This is supposed to take care of the condition when scrubbing
  has been started with max_mds == 1 and then bumped to a higher value

Fixes: https://tracker.ceph.com/issues/43483
Signed-off-by: Milind Changire <mchangir@redhat.com>
(cherry picked from commit f50b87bcb4737befcccf6310aaf522200361e731)

Conflicts:
src/mds/MDSRank.cc
src/mds/ScrubStack.h

5 years agomgr/dashboard: disable 'Add Capability' button when all the capabilities are added 32930/head
Alfonso Martínez [Wed, 22 Jan 2020 15:05:12 +0000 (16:05 +0100)]
mgr/dashboard: disable 'Add Capability' button when all the capabilities are added

Fixes: https://tracker.ceph.com/issues/43564
Signed-off-by: Alfonso Martínez <almartin@redhat.com>
(cherry picked from commit 4ef0e2c1ba2c7c2b12556f5ee7a593ae4ba99144)

Conflicts:
  src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-user-form/rgw-user-form.component.html

- Change applied manually in conflicting file.

5 years agomgr/dashboard: check if user has config-opt permissions before retrieving settings. 32827/head
Alfonso Martínez [Tue, 21 Jan 2020 12:49:02 +0000 (13:49 +0100)]
mgr/dashboard: check if user has config-opt permissions before retrieving settings.

Fixes: https://tracker.ceph.com/issues/43595
Signed-off-by: Alfonso Martínez <almartin@redhat.com>
(cherry picked from commit ea1c8c7ef7f494208aec1c59d12fec2da759784a)

 Conflicts:
src/pybind/mgr/dashboard/frontend/src/app/core/navigation/navigation/navigation.component.ts
src/pybind/mgr/dashboard/frontend/src/app/shared/components/notifications-sidebar/notifications-sidebar.component.spec.ts
src/pybind/mgr/dashboard/frontend/src/app/shared/components/notifications-sidebar/notifications-sidebar.component.ts

5 years agomgr/dashboard: Using wrong identifiers in RGW user/bucket datatables 32888/head
Volker Theile [Fri, 20 Sep 2019 13:46:50 +0000 (15:46 +0200)]
mgr/dashboard: Using wrong identifiers in RGW user/bucket datatables

Fixes: https://tracker.ceph.com/issues/41940
Signed-off-by: Volker Theile <vtheile@suse.com>
(cherry picked from commit 1271bf73fb862b567739ea3f493c7f571794b4e4)

5 years agomgr/dashboard: Unable to remove an iSCSI gateway that is already in use 32304/head
Ricardo Marques [Thu, 30 Jan 2020 13:19:48 +0000 (13:19 +0000)]
mgr/dashboard: Unable to remove an iSCSI gateway that is already in use

Fixes: https://tracker.ceph.com/issues/43900
Signed-off-by: Ricardo Marques <rimarques@suse.com>
(cherry picked from commit bcb05d0cae89deeb6c5e6a0cf282d84fed7811c3)

5 years agoMerge branch 'nautilus-saved' into nautilus
Josh Durgin [Fri, 31 Jan 2020 22:40:34 +0000 (17:40 -0500)]
Merge branch 'nautilus-saved' into nautilus

Resetting branch after 14.2.7 hotfix release

5 years ago14.2.7 v14.2.7
Jenkins Build Slave User [Fri, 31 Jan 2020 17:07:52 +0000 (17:07 +0000)]
14.2.7

5 years agorgw: drop the partial message check while reading messages
Abhishek Lekshmanan [Fri, 24 Jan 2020 14:41:51 +0000 (15:41 +0100)]
rgw: drop the partial message check while reading messages

Avoid leaking connections that had partially-consumed
client data on unexpected disconnect.

Signed-off-by: Or Friedmann <orfriedma@redhat.com>
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
5 years agoMerge pull request #32979 from leseb/bkp-32828
Sébastien Han [Thu, 30 Jan 2020 21:54:39 +0000 (22:54 +0100)]
Merge pull request #32979 from leseb/bkp-32828

nautilus: ceph-volume: add db and wal support to raw mode

5 years agocommon/options: bluestore 64k min_alloc_size for HDD 32998/head
Sage Weil [Thu, 23 Jan 2020 17:23:38 +0000 (11:23 -0600)]
common/options: bluestore 64k min_alloc_size for HDD

Until we understand the performance regression and allocator behavior,
go back to 64k.  This will continue to have a high space overhead for
small objects and EC, but will preserve the current performance levels
for all workloads.

This partially reverts 0ec75c99ddb103c664f66c04450003ed4c407708

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 66797ef19949503e77d52b567962c218ff0d8a77)

5 years agocommon/options: Set bluestore min_alloc size to 4K
Mark Nelson [Wed, 2 Oct 2019 17:18:38 +0000 (12:18 -0500)]
common/options: Set bluestore min_alloc size to 4K

Signed-off-by: Mark Nelson <mnelson@redhat.com>
(cherry picked from commit 0ec75c99ddb103c664f66c04450003ed4c407708)

5 years agoMerge pull request #32221 from smithfarm/wip-43168-nautilus
Casey Bodley [Thu, 30 Jan 2020 21:29:44 +0000 (16:29 -0500)]
Merge pull request #32221 from smithfarm/wip-43168-nautilus

nautilus: rgw/pubsub: fix records/event json format to match documentation

Reviewed-by: Yuval Lifshitz <yuvalif@yahoo.com>
5 years agomon/MgrMonitor.cc: add always_on_modules to the output of "ceph mgr module ls" 32997/head
Neha [Tue, 28 Jan 2020 18:24:55 +0000 (18:24 +0000)]
mon/MgrMonitor.cc: add always_on_modules to the output of "ceph mgr module ls"

Makes it easier to know what the always_on_modules for each release are, without
having to look at the code.

Signed-off-by: Neha Ojha <nojha@redhat.com>
(cherry picked from commit 8aa3c65b56add413d3fba1cb1d0cf84a10bfcf3c)

5 years agoceph-volume: add db and wal support to raw mode 32979/head
Sébastien Han [Fri, 24 Jan 2020 15:29:54 +0000 (16:29 +0100)]
ceph-volume: add db and wal support to raw mode

Using the raw mode, the OSD preparation can now be called with extra
arguments to specify a block device for either rocksdb db or wal.

The code expects the device to be available and no validation will be
performed. Also, the entire block device will be consumed.

The goal is run this on Kubernetes with Rook and OSD are running on PVC.
Users will request PVC from a certain size, the request will be
acknowledged and a block will be created, then attached to the machine.
Later on consumed by Rook's preparation job.

Signed-off-by: Sébastien Han <seb@redhat.com>
(cherry picked from commit c8f23c7182e2681f2bc756776a890995aca1efd2)

5 years agoceph-volume: fix raw list
Sébastien Han [Fri, 24 Jan 2020 16:25:42 +0000 (17:25 +0100)]
ceph-volume: fix raw list

There is no json anymore, just plain output.

Signed-off-by: Sébastien Han <seb@redhat.com>
(cherry picked from commit e99eb8cc95c5f50ec13170f202226c3581e3f5e2)

5 years agoceph-volume: remove unnecessary comment
Sébastien Han [Fri, 24 Jan 2020 15:28:17 +0000 (16:28 +0100)]
ceph-volume: remove unnecessary comment

This comment is not relevant since we will never bring systemd support
to the raw mode.

Signed-off-by: Sébastien Han <seb@redhat.com>
(cherry picked from commit af3f5fded95e4dcc0dfa2a0b2eec5fb2c4252b6c)

5 years agoceph-volume: remove osd-id and osd-fsid flag
Sébastien Han [Fri, 24 Jan 2020 15:27:10 +0000 (16:27 +0100)]
ceph-volume: remove osd-id and osd-fsid flag

These are not used since we only rely on the device path so removing
them to avid confusion.

Signed-off-by: Sébastien Han <seb@redhat.com>
(cherry picked from commit 525957be98a0a6ff742f6bae4450f291591f516f)

5 years agoceph-volume: remove "create" call from raw mode
Sébastien Han [Fri, 24 Jan 2020 15:23:10 +0000 (16:23 +0100)]
ceph-volume: remove "create" call from raw mode

This mode is intented to work when the cluster is running on Kubernetes
and OSDs are running on PVC.
So we always have a "prepare" pod and an "activate" pod.

Signed-off-by: Sébastien Han <seb@redhat.com>
(cherry picked from commit c7a2ecc59394a9eb323a19ff233a2e3dfe04a018)

5 years agoMerge pull request #32835 from smithfarm/wip-43812-nautilus
Yuri Weinstein [Wed, 29 Jan 2020 20:33:54 +0000 (12:33 -0800)]
Merge pull request #32835 from smithfarm/wip-43812-nautilus

nautilus: rgw: support radosgw-admin zone/zonegroup placement get command

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #32834 from smithfarm/wip-43789-nautilus
Yuri Weinstein [Wed, 29 Jan 2020 20:33:30 +0000 (12:33 -0800)]
Merge pull request #32834 from smithfarm/wip-43789-nautilus

nautilus: rgw: fix opslog operation field as per Amazon s3

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #32833 from smithfarm/wip-43786-nautilus
Yuri Weinstein [Wed, 29 Jan 2020 20:33:02 +0000 (12:33 -0800)]
Merge pull request #32833 from smithfarm/wip-43786-nautilus

nautilus: rgw: the http response code of delete bucket should not be 204-no-content

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #32832 from smithfarm/wip-43782-nautilus
Yuri Weinstein [Wed, 29 Jan 2020 20:32:36 +0000 (12:32 -0800)]
Merge pull request #32832 from smithfarm/wip-43782-nautilus

nautilus: rgw: Incorrectly calling ceph::buffer::list::decode_base64 in bucket policy

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #32504 from smithfarm/wip-43477-nautilus
Yuri Weinstein [Wed, 29 Jan 2020 20:31:07 +0000 (12:31 -0800)]
Merge pull request #32504 from smithfarm/wip-43477-nautilus

nautilus: rgw: Select the std::bitset to resolv ambiguity

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
Reviewed-by: Adam Emerson <aemerson@redhat.com>
5 years agoMerge pull request #32437 from pritha-srivastava/wip-42385-nautilus
Yuri Weinstein [Wed, 29 Jan 2020 20:30:14 +0000 (12:30 -0800)]
Merge pull request #32437 from pritha-srivastava/wip-42385-nautilus

nautilus: rgw: Adding 'iam' namespace for Role and User Policy related REST APIs.

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #32239 from smithfarm/wip-43300-nautilus
Yuri Weinstein [Wed, 29 Jan 2020 20:29:34 +0000 (12:29 -0800)]
Merge pull request #32239 from smithfarm/wip-43300-nautilus

nautilus: rgw: fix bugs in listobjectsv1

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #32825 from smithfarm/wip-43779-nautilus
Yuri Weinstein [Wed, 29 Jan 2020 20:25:09 +0000 (12:25 -0800)]
Merge pull request #32825 from smithfarm/wip-43779-nautilus

nautilus: rgw: return error if lock log shard fails

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #32824 from smithfarm/wip-43728-nautilus
Yuri Weinstein [Wed, 29 Jan 2020 20:24:27 +0000 (12:24 -0800)]
Merge pull request #32824 from smithfarm/wip-43728-nautilus

nautilus: rgw: move forward marker even in case of many rgw.none indexes

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #32822 from smithfarm/wip-43576-nautilus
Yuri Weinstein [Wed, 29 Jan 2020 20:24:03 +0000 (12:24 -0800)]
Merge pull request #32822 from smithfarm/wip-43576-nautilus

nautilus: rgw: fix a bug that bucket instance obj can't be removed after resharding completed

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #32821 from smithfarm/wip-43574-nautilus
Yuri Weinstein [Wed, 29 Jan 2020 20:23:36 +0000 (12:23 -0800)]
Merge pull request #32821 from smithfarm/wip-43574-nautilus

nautilus: rgw: fix data consistency error casued by rgw sent timeout

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #32820 from smithfarm/wip-43571-nautilus
Yuri Weinstein [Wed, 29 Jan 2020 20:23:10 +0000 (12:23 -0800)]
Merge pull request #32820 from smithfarm/wip-43571-nautilus

nautilus: rgw: build_linked_oids_for_bucket and build_buckets_instance_index should return negative value if it fails

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #32819 from smithfarm/wip-43373-nautilus
Yuri Weinstein [Wed, 29 Jan 2020 20:22:43 +0000 (12:22 -0800)]
Merge pull request #32819 from smithfarm/wip-43373-nautilus

nautilus: rgw: data sync markers include timestamp from datalog entry

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #32818 from smithfarm/wip-43372-nautilus
Yuri Weinstein [Wed, 29 Jan 2020 20:22:15 +0000 (12:22 -0800)]
Merge pull request #32818 from smithfarm/wip-43372-nautilus

nautilus: rgw: radosgw-admin: sync status displays id of shard furthest behind

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #32759 from smithfarm/wip-43203-nautilus
Yuri Weinstein [Wed, 29 Jan 2020 20:21:48 +0000 (12:21 -0800)]
Merge pull request #32759 from smithfarm/wip-43203-nautilus

nautilus: rgw: adding mfa code validation when bucket versioning status is changed

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #32489 from bzed/clang-build-fix
Yuri Weinstein [Wed, 29 Jan 2020 20:18:35 +0000 (12:18 -0800)]
Merge pull request #32489 from bzed/clang-build-fix

nautilus: rgw/rgw_rest_conn.h: fix build with clang

Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
Reviewed-by: Kefu Chai <kchai@redhat.com>