]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
5 years agoqa/tasks: Fix raises that doesn't re-raise
Jos Collin [Fri, 6 Sep 2019 06:17:47 +0000 (11:47 +0530)]
qa/tasks: Fix raises that doesn't re-raise

* Fixed raises that doesn't re-raise
* Dropped some commands with --force remove commands, as it is unnecessary.

Signed-off-by: Jos Collin <jcollin@redhat.com>
(cherry picked from commit 992d8b6a74400133405db69f1da94c98cf47fed6)

5 years agotest: use distinct subvolume/group/snapshot names
Venky Shankar [Tue, 5 Nov 2019 08:37:41 +0000 (03:37 -0500)]
test: use distinct subvolume/group/snapshot names

Fixes: http://tracker.ceph.com/issues/42646
Signed-off-by: Venky Shankar <vshankar@redhat.com>
(cherry picked from commit b9cff8af8e8f423c8e2b58de2b4da48842223cf3)

5 years agopybind/cephfs: add method that stats symlinks without following
Rishabh Dave [Sat, 13 Jul 2019 05:59:17 +0000 (11:29 +0530)]
pybind/cephfs: add method that stats symlinks without following

Add a new Python binding equivalent to lstat so that information about
the symlink itself can be also obtained, along with other type of files.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
(cherry picked from commit 8cce7dad8f8f23f19023d9b68b072ec8026ae04d)

5 years agoMerge pull request #33116 from batrick/i43137
Ramana Raja [Wed, 12 Feb 2020 10:08:08 +0000 (15:38 +0530)]
Merge pull request #33116 from batrick/i43137

nautilus: pybind/mgr/volumes: idle connection drop is not working

Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
5 years agoMerge pull request #33220 from yuriw/wip-yuriw-clients-upgrades-nautilus
Yuri Weinstein [Tue, 11 Feb 2020 21:41:31 +0000 (13:41 -0800)]
Merge pull request #33220 from yuriw/wip-yuriw-clients-upgrades-nautilus

qa/tests: added client-upgrade-nautilus suite to be used on octopus …

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoqa/tests: added client-upgrade-nautilus suite to be used on octopus release 33220/head
Yuri Weinstein [Tue, 11 Feb 2020 19:45:06 +0000 (11:45 -0800)]
qa/tests: added client-upgrade-nautilus suite to be used on octopus release

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
5 years agoMerge pull request #32863 from shyukri/wip-43341-nautilus
Jan Fajerski [Tue, 11 Feb 2020 19:39:08 +0000 (20:39 +0100)]
Merge pull request #32863 from shyukri/wip-43341-nautilus

nautilus: ceph-volume: lvm/deactivate: add unit tests, remove --all

5 years agoMerge pull request #33217 from jan--f/wip-32242-notrack-nautilus
Jan Fajerski [Tue, 11 Feb 2020 18:11:58 +0000 (19:11 +0100)]
Merge pull request #33217 from jan--f/wip-32242-notrack-nautilus

nautilus: ceph-volume: add methods to pass filters to pvs, vgs and lvs commands

5 years agoceph-volume: add methods to pass filters to pvs, vgs and lvs commands 33217/head
Rishabh Dave [Thu, 21 Nov 2019 14:33:32 +0000 (20:03 +0530)]
ceph-volume: add methods to pass filters to pvs, vgs and lvs commands

Filters can be passed to these commands by using option '-S'.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
(cherry picked from commit a4f2fcefb80df524c472782e8c1d18b3c2d1c1fc)

5 years agoMerge pull request #32912 from smithfarm/wip-43509-nautilus
Yuri Weinstein [Tue, 11 Feb 2020 16:41:52 +0000 (08:41 -0800)]
Merge pull request #32912 from smithfarm/wip-43509-nautilus

nautilus: mon: print FSMap regardless of file system count

Reviewed-by: Ramana Raja <rraja@redhat.com>
5 years agolvm/deactivate: add unit tests, remove --all 32863/head
Jan Fajerski [Mon, 16 Dec 2019 15:57:58 +0000 (16:57 +0100)]
lvm/deactivate: add unit tests, remove --all

Remove the --all flag until its actually implemented.

Fixes: https://tracker.ceph.com/issues/43330
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit c13901f963d515fd34bd0ff9df67bcf214507b70)

Conflicts:
src/ceph-volume/ceph_volume/devices/lvm/deactivate.py

5 years agoMerge pull request #33209 from jan--f/wip-deactivate-nautilus
Jan Fajerski [Tue, 11 Feb 2020 16:14:12 +0000 (17:14 +0100)]
Merge pull request #33209 from jan--f/wip-deactivate-nautilus

nautilus: ceph-volume: lvm deactivate command

5 years agoMerge pull request #32915 from smithfarm/wip-43628-nautilus
Yuri Weinstein [Tue, 11 Feb 2020 16:03:05 +0000 (08:03 -0800)]
Merge pull request #32915 from smithfarm/wip-43628-nautilus

nautilus: client: disallow changing fuse_default_permissions option at runtime

Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>
5 years agoMerge pull request #32914 from smithfarm/wip-43624-nautilus
Yuri Weinstein [Tue, 11 Feb 2020 16:02:21 +0000 (08:02 -0800)]
Merge pull request #32914 from smithfarm/wip-43624-nautilus

nautilus: mds: note client features when rejecting client

Reviewed-by: Ramana Raja <rraja@redhat.com>
5 years agoMerge pull request #32913 from smithfarm/wip-43573-nautilus
Yuri Weinstein [Tue, 11 Feb 2020 16:01:45 +0000 (08:01 -0800)]
Merge pull request #32913 from smithfarm/wip-43573-nautilus

nautilus: cephfs-journal-tool: fix crash and usage

Reviewed-by: Ramana Raja <rraja@redhat.com>
5 years agoMerge pull request #32909 from smithfarm/wip-43343-nautilus
Yuri Weinstein [Tue, 11 Feb 2020 16:00:25 +0000 (08:00 -0800)]
Merge pull request #32909 from smithfarm/wip-43343-nautilus

nautilus: mds: fix revoking caps after after stale->resume circle

Reviewed-by: Ramana Raja <rraja@redhat.com>
5 years agoMerge pull request #32602 from batrick/i43558
Yuri Weinstein [Tue, 11 Feb 2020 15:59:47 +0000 (07:59 -0800)]
Merge pull request #32602 from batrick/i43558

nautilus: mds: reject forward scrubs when cluster has multiple active MDS (more than one rank)

Reviewed-by: Ramana Raja <rraja@redhat.com>
5 years agoMerge pull request #32600 from batrick/i43506
Yuri Weinstein [Tue, 11 Feb 2020 15:59:19 +0000 (07:59 -0800)]
Merge pull request #32600 from batrick/i43506

nautilus: MDSMonitor: warn if a new file system is being created with an EC default data pool

Reviewed-by: Ramana Raja <rraja@redhat.com>
5 years agoMerge pull request #30843 from smithfarm/wip-41853-nautilus
Yuri Weinstein [Tue, 11 Feb 2020 15:58:33 +0000 (07:58 -0800)]
Merge pull request #30843 from smithfarm/wip-41853-nautilus

nautilus: mds: reject sessionless messages

Reviewed-by: Ramana Raja <rraja@redhat.com>
5 years agolvm: add deactivate subcommand 33209/head
Jan Fajerski [Wed, 11 Dec 2019 13:54:16 +0000 (14:54 +0100)]
lvm: add deactivate subcommand

This new subcommand unmounts and OSDs tmpfs mount and closes crypt
devices if there are any.

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit 9797f6b83d727933b1a0daab239f3034675a1d0e)

5 years agoutil/system: add unmount_tmpfs helper
Jan Fajerski [Thu, 12 Dec 2019 08:28:27 +0000 (09:28 +0100)]
util/system: add unmount_tmpfs helper

Thsi unmounts a path if and only if it's a tmpfs mount.

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit 705ed1110138b1e7c77768f97d5acda4a76d868f)

5 years agoapi/lvm: add get_lv_by_osd_id method
Jan Fajerski [Wed, 11 Dec 2019 12:17:19 +0000 (13:17 +0100)]
api/lvm: add get_lv_by_osd_id method

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit 2558b55b0ecbcc83acccbf8412c19f01e8dafb3e)

5 years agoapi/lvm: add deactivate method to Volume class
Jan Fajerski [Wed, 11 Dec 2019 12:17:02 +0000 (13:17 +0100)]
api/lvm: add deactivate method to Volume class

Simply calls lvchange -an to deactivate a logical volume.

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit 8087600d4853554794b709291a08d97befd07ed1)

5 years agoMerge pull request #32868 from shyukri/wip-42945-nautilus
Jan Fajerski [Tue, 11 Feb 2020 13:23:27 +0000 (14:23 +0100)]
Merge pull request #32868 from shyukri/wip-42945-nautilus

nautilus: ceph-volume: allow raw block devices everywhere

5 years agodoc: update ceph-volume lvm prepare 32868/head
Jan Fajerski [Tue, 5 Nov 2019 12:39:27 +0000 (13:39 +0100)]
doc: update ceph-volume lvm prepare

Add option to pass raw physical devices everywhere, restructure a little
(bluestore section before filestore) and reword a few things.

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit f2018d76eb8936aed8643328f0d5f111c87514e4)

5 years agoceph-volume: make lvm report fields into constants
Jan Fajerski [Tue, 5 Nov 2019 07:31:44 +0000 (08:31 +0100)]
ceph-volume: make lvm report fields into constants

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit 01a603f6e952d2c5931b89699a86503e281fb376)

5 years agoceph-volume: api/lvm create or reuse a vg
Jan Fajerski [Tue, 22 Oct 2019 12:32:11 +0000 (14:32 +0200)]
ceph-volume: api/lvm create or reuse a vg

This changes create_lv so one can pass the desired device and either a
VG with a name starting with ceph is re-used or a new one is created.
This commit also adds two new lvm primitives, making use of lvm's select
feature. The goal is to eventually avoid keeping a full list of lv's (or
vg's) around and query the lvm system as needed.

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit bb4de1a3fc238eaf9f717dc59c6bdf338ef6d657)

5 years agoMerge pull request #33202 from jan--f/wip-43853-nautilus
Jan Fajerski [Tue, 11 Feb 2020 12:08:01 +0000 (13:08 +0100)]
Merge pull request #33202 from jan--f/wip-43853-nautilus

nautilus: ceph-volume/batch: fail on filtered devices when non-interactive

5 years agoMerge pull request #33200 from jan--f/wip-42898-nautilus
Jan Fajerski [Tue, 11 Feb 2020 12:03:59 +0000 (13:03 +0100)]
Merge pull request #33200 from jan--f/wip-42898-nautilus

nautilus: ceph-volume: make get_devices fs location independent

5 years agoMerge pull request #32870 from shyukri/wip-43117-nautilus
Jan Fajerski [Tue, 11 Feb 2020 11:34:53 +0000 (12:34 +0100)]
Merge pull request #32870 from shyukri/wip-43117-nautilus

nautilus: ceph-volume: import mock.mock instead of unittest.mock (py2)

5 years agoMerge pull request #32877 from shyukri/wip-43570-nautilus
Jan Fajerski [Tue, 11 Feb 2020 11:32:01 +0000 (12:32 +0100)]
Merge pull request #32877 from shyukri/wip-43570-nautilus

nautilus: ceph-volume: Dereference symlink in lvm list

5 years agoMerge pull request #32873 from shyukri/wip-43201-nautilus
Jan Fajerski [Tue, 11 Feb 2020 11:31:08 +0000 (12:31 +0100)]
Merge pull request #32873 from shyukri/wip-43201-nautilus

nautilus: ceph-volume: fix the integer overflow

5 years agoMerge pull request #32874 from shyukri/wip-43321-nautilus
Jan Fajerski [Tue, 11 Feb 2020 11:19:50 +0000 (12:19 +0100)]
Merge pull request #32874 from shyukri/wip-43321-nautilus

nautilus: ceph-volume: use correct extents if using db-devices and >1 osds_per_device

5 years agoMerge pull request #32864 from shyukri/wip-43462-nautilus
Jan Fajerski [Tue, 11 Feb 2020 11:09:23 +0000 (12:09 +0100)]
Merge pull request #32864 from shyukri/wip-43462-nautilus

nautilus: ceph-volume/lvm/activate.py: clarify error message: fsid refers to osd_fsid

5 years agoMerge pull request #32860 from shyukri/wip-43281-nautilus
Jan Fajerski [Tue, 11 Feb 2020 11:08:22 +0000 (12:08 +0100)]
Merge pull request #32860 from shyukri/wip-43281-nautilus

nautilus: ceph-volume: util: look for executable in $PATH

5 years agoMerge pull request #31616 from jan--f/wip-42800-nautilus
Jan Fajerski [Tue, 11 Feb 2020 11:07:20 +0000 (12:07 +0100)]
Merge pull request #31616 from jan--f/wip-42800-nautilus

nautilus: ceph-volume: assume msgrV1 for all branches containing mimic

5 years agoceph-volume/batch: fail on filtered devices when non-interactive 33202/head
Jan Fajerski [Tue, 3 Dec 2019 12:44:00 +0000 (13:44 +0100)]
ceph-volume/batch: fail on filtered devices when non-interactive

When batch is called non-interactively and a user explicitly specifies,
say a db-device, this will be filtered when unavailable. This can cause
the resulting OSD to be very different from the users intention
(standalone vs external db when the db-device was filtered). If devices
get filtered in non-interactive mode, ceph-volume should fail.

Fixes: https://tracker.ceph.com/issues/43105
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit 2e985053deec6c4cf60c0b85aec3df16cd77ceeb)

5 years agoceph-volume: refactor tests for refactored get_devices 33200/head
Jan Fajerski [Mon, 11 Nov 2019 13:35:43 +0000 (14:35 +0100)]
ceph-volume: refactor tests for refactored get_devices

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit 4749f4c59dc4edb1fd689e18e8d9f358f95cb945)

Conflicts:
src/ceph-volume/ceph_volume/tests/conftest.py
        resolved by importing PropertyMock

5 years agoceph-volume: refactor get_devices, don't use os.path.realpath
Jan Fajerski [Fri, 8 Nov 2019 15:36:30 +0000 (16:36 +0100)]
ceph-volume: refactor get_devices, don't use os.path.realpath

Fixes: https://tracker.ceph.com/issues/42777
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit b35e8c485f73b5b65e0be29444eb06172d6df3e3)

5 years agoMerge pull request #32558 from shyukri/wip-43275-nautilus
Jan Fajerski [Tue, 11 Feb 2020 10:40:48 +0000 (11:40 +0100)]
Merge pull request #32558 from shyukri/wip-43275-nautilus

nautilus: ceph-volume/test: patch VolumeGroups

5 years agoMerge pull request #32556 from shyukri/wip-43022-nautilus
Jan Fajerski [Tue, 11 Feb 2020 10:39:40 +0000 (11:39 +0100)]
Merge pull request #32556 from shyukri/wip-43022-nautilus

nautilus: ceph-volume: minor clean-up of "simple scan" subcommand help

5 years agoMerge pull request #32998 from neha-ojha/wip-min-alloc-nautilus
Yuri Weinstein [Mon, 10 Feb 2020 21:46:00 +0000 (13:46 -0800)]
Merge pull request #32998 from neha-ojha/wip-min-alloc-nautilus

nautilus: common/options: bluestore 4k min_alloc_size for SSD

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Igor Fedotov <ifedotov@suse.com>
5 years agoMerge pull request #32846 from smithfarm/wip-43256-nautilus
Yuri Weinstein [Mon, 10 Feb 2020 21:37:08 +0000 (13:37 -0800)]
Merge pull request #32846 from smithfarm/wip-43256-nautilus

nautilus: common/config: update values when they are removed via mon

Reviewed-by: Sage Weil <sage@redhat.com>
5 years agoMerge pull request #32997 from neha-ojha/wip-32939-nautilus
Yuri Weinstein [Mon, 10 Feb 2020 20:46:12 +0000 (12:46 -0800)]
Merge pull request #32997 from neha-ojha/wip-32939-nautilus

nautilus: mon/MgrMonitor.cc: add always_on_modules to the output of "ceph mgr module ls"

Reviewed-by: David Zafman <dzafman@redhat.com>
5 years agoMerge pull request #32901 from smithfarm/wip-43631-nautilus
Yuri Weinstein [Mon, 10 Feb 2020 20:44:42 +0000 (12:44 -0800)]
Merge pull request #32901 from smithfarm/wip-43631-nautilus

nautilus: common/util: use ifstream to read from /proc files

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #32858 from smithfarm/wip-43473-nautilus
Yuri Weinstein [Mon, 10 Feb 2020 20:43:33 +0000 (12:43 -0800)]
Merge pull request #32858 from smithfarm/wip-43473-nautilus

nautilus: common: fix deadlocky inflight op visiting in OpTracker.

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #32845 from smithfarm/wip-43245-nautilus
Yuri Weinstein [Mon, 10 Feb 2020 20:41:21 +0000 (12:41 -0800)]
Merge pull request #32845 from smithfarm/wip-43245-nautilus

nautilus: os/bluestore/BlueStore.cc: set priorities for compression stats

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
5 years agoMerge pull request #32774 from dzafman/wip-43726-nautilus
Yuri Weinstein [Mon, 10 Feb 2020 20:38:35 +0000 (12:38 -0800)]
Merge pull request #32774 from dzafman/wip-43726-nautilus

nautilus: test: Fix wait_for_state() to wait for a PG to get into a state

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoceph-volume: Dereference symlink in lvm list 32877/head
Benoît Knecht [Thu, 2 Jan 2020 07:07:21 +0000 (08:07 +0100)]
ceph-volume: Dereference symlink in lvm list

This allows for a symlink to be passed to

```
ceph-volume lvm list <path>
```

which makes it possible to use `/dev/disk/by-path/*` devices, for
instance.

Fixes: https://tracker.ceph.com/issues/43497
Signed-off-by: Benoît Knecht <bknecht@protonmail.ch>
(cherry picked from commit 09fa3df8a39d361f2af11bded8aab9e0da334d51)

5 years agoceph-volume: use correct extents when using db-devices and >1 osds_per_device 32874/head
Fabian Niepelt [Wed, 11 Dec 2019 13:19:14 +0000 (14:19 +0100)]
ceph-volume: use correct extents when using db-devices and >1 osds_per_device

Actual data size depending on osds_per_device needs to be calculated here. Otherwise, if osds_per_device is greater than 1, ceph-volume will allocate 100% of the device to the first osd and then fail to create the LV for the second because the volume group is already full.

Fixes: https://tracker.ceph.com/issues/39442
Signed-off-by: Fabian Niepelt <f.niepelt@mittwald.de>
(cherry picked from commit ecde6cd619605003706f545b0b5ad4e2e8932f28)

 Conflicts:
src/ceph-volume/ceph_volume/devices/lvm/strategies/bluestore.py

I've removed `data_uuid` since it's not in nautilus already

5 years agoceph-volume: fix the type mismatch, covert the tries and interval to int from string. 32873/head
taodd [Sun, 8 Dec 2019 02:10:59 +0000 (10:10 +0800)]
ceph-volume: fix the type mismatch, covert the tries and interval to int from string.
Fixes: https://tracker.ceph.com/issues/43186
Signed-off-by: dongdong tao <dongdong.tao@canonical.com>
(cherry picked from commit 81ff4be4d13ce034d7a8b921113138a942e3051a)

5 years agoceph-volume: import mock.mock instead of unittest.mock (py2) 32870/head
Jan Fajerski [Fri, 22 Nov 2019 15:57:11 +0000 (16:57 +0100)]
ceph-volume: import mock.mock instead of unittest.mock (py2)

Fixes: bb4de1a3fc238eaf9f717dc59c6bdf338ef6d657
Fixes: https://tracker.ceph.com/issues/42970
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit c1bd09f2591d983f1988e3dadcf3c65c59afb15d)

Conflicts:
src/ceph-volume/ceph_volume/tests/api/test_lvm.py

5 years agolvm/activate.py: clarify error message: fsid refers to osd_fsid 32864/head
Yaniv Kaul [Thu, 19 Dec 2019 14:54:58 +0000 (16:54 +0200)]
lvm/activate.py: clarify error message: fsid refers to osd_fsid

Users complained[1] the error message isn't clear, and they thought
it referred to the cluster fsid instead of the osd_fsid.
Made it clearer.

[1] rook/rook#4547

Fixes: https://tracker.ceph.com/issues/43442
Signed-off-by: Yaniv Kaul <ykaul@redhat.com>
(cherry picked from commit ff3ba9200a6b5856fbdf4372fe292a7b94dd2539)

5 years agoceph-volume: util: look for executable in $PATH 32860/head
Shyukri Shyukriev [Thu, 21 Nov 2019 14:04:02 +0000 (15:04 +0100)]
ceph-volume: util: look for executable in $PATH

Fixes: https://tracker.ceph.com/issues/36728
Fallback to predefined paths for backward compatibility.
Alter test involved for partial match in warning

Signed-off-by: Shyukri Shyukriev <shshyukriev@suse.com>
(cherry picked from commit a8577085dc52b0f214d9568c29a9605d1a826a45)

5 years agoMerge pull request #30689 from smithfarm/wip-42120-nautilus
Yuri Weinstein [Sat, 8 Feb 2020 00:27:15 +0000 (16:27 -0800)]
Merge pull request #30689 from smithfarm/wip-42120-nautilus

nautilus: core: osd/OSDMap: health alert for non-power-of-two pg_num

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #32857 from smithfarm/wip-43471-nautilus
Yuri Weinstein [Fri, 7 Feb 2020 22:31:36 +0000 (14:31 -0800)]
Merge pull request #32857 from smithfarm/wip-43471-nautilus

nautilus: osd/PeeringState.cc: don't let num_objects become negative

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #32848 from smithfarm/wip-43346-nautilus
Yuri Weinstein [Fri, 7 Feb 2020 22:31:01 +0000 (14:31 -0800)]
Merge pull request #32848 from smithfarm/wip-43346-nautilus

nautilus: qa/suites/rados/thrash: force normal pg log length with cache tiering

Reviewed-by: Sage Weil <sage@redhat.com>
5 years agoMerge pull request #32847 from smithfarm/wip-43319-nautilus
Yuri Weinstein [Fri, 7 Feb 2020 22:30:26 +0000 (14:30 -0800)]
Merge pull request #32847 from smithfarm/wip-43319-nautilus

nautilus: osd/PeeringState.cc: skip peer_purged when discovering all missing

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #32843 from smithfarm/wip-43099-nautilus
Yuri Weinstein [Fri, 7 Feb 2020 22:29:48 +0000 (14:29 -0800)]
Merge pull request #32843 from smithfarm/wip-43099-nautilus

nautilus: osd/OSD: enhance osd numa affinity compatibility

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
5 years agoMerge pull request #32773 from dzafman/wip-43246-nautilus
Yuri Weinstein [Fri, 7 Feb 2020 22:29:08 +0000 (14:29 -0800)]
Merge pull request #32773 from dzafman/wip-43246-nautilus

nautilus: osd: Use physical ratio for nearfull (doesn't include backfill resserve)

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge branch 'nautilus' into wip-42120-nautilus 30689/head
David Zafman [Fri, 7 Feb 2020 22:27:18 +0000 (14:27 -0800)]
Merge branch 'nautilus' into wip-42120-nautilus

5 years agoMerge pull request #32716 from smithfarm/wip-43650-nautilus
Yuri Weinstein [Fri, 7 Feb 2020 22:11:40 +0000 (14:11 -0800)]
Merge pull request #32716 from smithfarm/wip-43650-nautilus

nautilus: osd: Diagnostic logging for upmap cleaning

Reviewed-by: David Zafman <dzafman@redhat.com>
5 years agoMerge pull request #32715 from smithfarm/wip-43620-nautilus
Yuri Weinstein [Fri, 7 Feb 2020 22:09:27 +0000 (14:09 -0800)]
Merge pull request #32715 from smithfarm/wip-43620-nautilus

nautilus: kv: fix shutdown vs async compaction

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
5 years agoMerge pull request #32259 from smithfarm/wip-43243-nautilus
Yuri Weinstein [Fri, 7 Feb 2020 22:08:44 +0000 (14:08 -0800)]
Merge pull request #32259 from smithfarm/wip-43243-nautilus

nautilus: selinux: Allow ceph to read udev db

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Boris Ranto <branto@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #32769 from liewegas/fix-42566-nautilus
Yuri Weinstein [Fri, 7 Feb 2020 22:03:28 +0000 (14:03 -0800)]
Merge pull request #32769 from liewegas/fix-42566-nautilus

nautilus: mgr/MgrClient: fix open condition

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
5 years agoqa: test volumes plugin mount cleanup 33116/head
Patrick Donnelly [Tue, 3 Dec 2019 23:14:49 +0000 (15:14 -0800)]
qa: test volumes plugin mount cleanup

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit 67143642db335fef2749559006776d4b4842f008)

5 years agopybind/mgr/volumes: use py3 items iterator
Patrick Donnelly [Tue, 3 Dec 2019 22:33:07 +0000 (14:33 -0800)]
pybind/mgr/volumes: use py3 items iterator

Otherwise this raises an exception.

Fixes: https://tracker.ceph.com/issues/43113
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit 03f80804784052d7bf8a0802c319dccaa9b12389)

5 years agopybind/mgr/volumes: print errors in cleanup timer
Patrick Donnelly [Tue, 3 Dec 2019 22:32:24 +0000 (14:32 -0800)]
pybind/mgr/volumes: print errors in cleanup timer

The squelched error prevented us from knowing connection cleanup doesn't
work on py3.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit b45c08b9977acbf8703259e78702b36ffba65162)

5 years agoqa: improve variable name
Patrick Donnelly [Wed, 4 Dec 2019 14:50:56 +0000 (06:50 -0800)]
qa: improve variable name

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoqa: test mgr cephfs mount blacklist
Patrick Donnelly [Tue, 3 Dec 2019 23:02:19 +0000 (15:02 -0800)]
qa: test mgr cephfs mount blacklist

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit 98e3b7efe8bc92d88f161c892ce91a7fff67052c)
Note: removed mgr blacklist test which applies to Octopus.

5 years agoMerge pull request #32930 from rhcs-dashboard/wip-43845-nautilus
Lenz Grimmer [Thu, 6 Feb 2020 10:33:33 +0000 (10:33 +0000)]
Merge pull request #32930 from rhcs-dashboard/wip-43845-nautilus

nautilus: mgr/dashboard: disable 'Add Capability' button in rgw user edit

Reviewed-by: Laura Paduano <lpaduano@suse.com>
5 years agoMerge pull request #32827 from rhcs-dashboard/wip-43811-nautilus
Lenz Grimmer [Thu, 6 Feb 2020 10:21:49 +0000 (10:21 +0000)]
Merge pull request #32827 from rhcs-dashboard/wip-43811-nautilus

nautilus: mgr/dashboard: check if user has config-opt permissions

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
5 years agoMerge pull request #31808 from bk201/wip-42956-nautilus
Lenz Grimmer [Thu, 6 Feb 2020 10:20:36 +0000 (10:20 +0000)]
Merge pull request #31808 from bk201/wip-42956-nautilus

nautilus: mgr/dashboard: check embedded Grafana dashboard references

Reviewed-by: Laura Paduano <lpaduano@suse.com>
5 years agoMerge pull request #31792 from rhcs-dashboard/wip-42936-nautilus
Lenz Grimmer [Thu, 6 Feb 2020 10:19:33 +0000 (10:19 +0000)]
Merge pull request #31792 from rhcs-dashboard/wip-42936-nautilus

nautilus: mgr/dashboard: Dashboard can't handle self-signed cert on Grafana API

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
5 years agoMerge pull request #31190 from rhcs-dashboard/wip-42294-nautilus
Lenz Grimmer [Thu, 6 Feb 2020 10:17:22 +0000 (10:17 +0000)]
Merge pull request #31190 from rhcs-dashboard/wip-42294-nautilus

nautilus: mgr/dashboard: add debug mode, and accept expected exception when SSL handshaking

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
5 years agoMerge pull request #32304 from ricardoasmarques/wip-43333-nautilus
Lenz Grimmer [Thu, 6 Feb 2020 10:15:34 +0000 (10:15 +0000)]
Merge pull request #32304 from ricardoasmarques/wip-43333-nautilus

nautilus: mgr/dashboard: iSCSI targets not available if any gateway is down (and more...)

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
5 years agoMerge pull request #32888 from shyukri/wip-42033-nautilus
Lenz Grimmer [Thu, 6 Feb 2020 10:13:27 +0000 (10:13 +0000)]
Merge pull request #32888 from shyukri/wip-42033-nautilus

nautilus: mgr/dashboard: Using wrong identifiers in RGW user/bucket datatables

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
5 years agoqa: force creation of fs with EC default data pool 32600/head
Patrick Donnelly [Fri, 20 Dec 2019 20:57:31 +0000 (12:57 -0800)]
qa: force creation of fs with EC default data pool

In the future, we should add the EC data pool as a supplementary data
pool but that requires a mount to setup which is awkward in the code
here. When cephfs-shell is more widely available, this will be easier.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit 6e448f9aa0e71f1e820f4bd1b53e067268e4b67a)

5 years agoqa: add tests for adding EC data pools
Patrick Donnelly [Fri, 13 Dec 2019 00:43:14 +0000 (16:43 -0800)]
qa: add tests for adding EC data pools

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit bf0cf8e08bfa49d2e84f079db2bd3b521ce5deec)

Conflicts:
qa/tasks/cephfs/filesystem.py

5 years agomon/MDSMonitor: warn when creating fs with default EC data pool
Patrick Donnelly [Thu, 7 Nov 2019 22:12:03 +0000 (14:12 -0800)]
mon/MDSMonitor: warn when creating fs with default EC data pool

Rationale can be found in [1]. Point is that EC pools incur a
significant performance penalty when dealing with small files and xattr
updates. This is because _every_ inode has a corresponding data pool
object with backtrace information stored in its xattr.

[1] doc/cephfs/createfs.rst

Fixes: https://tracker.ceph.com/issues/42450
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit 3e0aee5ed68b7b4018fb03d5160f3f19da0f6458)

5 years agoqa: add tests for CephFS admin commands
Patrick Donnelly [Wed, 30 Oct 2019 17:21:22 +0000 (10:21 -0700)]
qa: add tests for CephFS admin commands

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit 9dc07d80967287051eab3245e58d029157d3e1da)

5 years agomds: skip tell command scrub on multimds 32602/head
Patrick Donnelly [Mon, 20 Jan 2020 16:23:29 +0000 (08:23 -0800)]
mds: skip tell command scrub on multimds

The master version of this PR deals with the unified asok/tell
interface. Nautilus- are separated.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agomds: throttle scrub start for multiple active MDS
Milind Changire [Fri, 10 Jan 2020 06:31:34 +0000 (12:01 +0530)]
mds: throttle scrub start for multiple active MDS

* add check to "scrub start" command handler to dishonor request if
  multiple MDS are "active" for a recursive scrub request
* add check to MDSRank::handle_mds_map() to see if scrubbing is in
  progress and max_mds is greater than 1, if so then scrubbing is
  aborted. This is supposed to take care of the condition when scrubbing
  has been started with max_mds == 1 and then bumped to a higher value

Fixes: https://tracker.ceph.com/issues/43483
Signed-off-by: Milind Changire <mchangir@redhat.com>
(cherry picked from commit f50b87bcb4737befcccf6310aaf522200361e731)

Conflicts:
src/mds/MDSRank.cc
src/mds/ScrubStack.h

5 years agomgr/dashboard: disable 'Add Capability' button when all the capabilities are added 32930/head
Alfonso Martínez [Wed, 22 Jan 2020 15:05:12 +0000 (16:05 +0100)]
mgr/dashboard: disable 'Add Capability' button when all the capabilities are added

Fixes: https://tracker.ceph.com/issues/43564
Signed-off-by: Alfonso Martínez <almartin@redhat.com>
(cherry picked from commit 4ef0e2c1ba2c7c2b12556f5ee7a593ae4ba99144)

Conflicts:
  src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-user-form/rgw-user-form.component.html

- Change applied manually in conflicting file.

5 years agomgr/dashboard: check if user has config-opt permissions before retrieving settings. 32827/head
Alfonso Martínez [Tue, 21 Jan 2020 12:49:02 +0000 (13:49 +0100)]
mgr/dashboard: check if user has config-opt permissions before retrieving settings.

Fixes: https://tracker.ceph.com/issues/43595
Signed-off-by: Alfonso Martínez <almartin@redhat.com>
(cherry picked from commit ea1c8c7ef7f494208aec1c59d12fec2da759784a)

 Conflicts:
src/pybind/mgr/dashboard/frontend/src/app/core/navigation/navigation/navigation.component.ts
src/pybind/mgr/dashboard/frontend/src/app/shared/components/notifications-sidebar/notifications-sidebar.component.spec.ts
src/pybind/mgr/dashboard/frontend/src/app/shared/components/notifications-sidebar/notifications-sidebar.component.ts

5 years agomgr/dashboard: Using wrong identifiers in RGW user/bucket datatables 32888/head
Volker Theile [Fri, 20 Sep 2019 13:46:50 +0000 (15:46 +0200)]
mgr/dashboard: Using wrong identifiers in RGW user/bucket datatables

Fixes: https://tracker.ceph.com/issues/41940
Signed-off-by: Volker Theile <vtheile@suse.com>
(cherry picked from commit 1271bf73fb862b567739ea3f493c7f571794b4e4)

5 years agoqa: only restart MDS between tests 32912/head
Patrick Donnelly [Tue, 7 Jan 2020 20:51:38 +0000 (12:51 -0800)]
qa: only restart MDS between tests

"fs fail" will only fail the MDS that are part of the file system which
will generally allow us to avoid spurious MDS_INSUFFICIENT_STANDBY
warnings. Further, only restart the MDS, there's no reason to leave them
offline.

Fixes: https://tracker.ceph.com/issues/43514
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit 423dcb4c5470b48cac096b814d270c5c2c918c43)

5 years agomon: print FSMap if standbys exist
Patrick Donnelly [Tue, 17 Dec 2019 18:13:02 +0000 (10:13 -0800)]
mon: print FSMap if standbys exist

Fixes: https://tracker.ceph.com/issues/42088
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
(cherry picked from commit cd6f88d7ebe17edcf657d646d733c207930e4351)

5 years agomgr/dashboard: Unable to remove an iSCSI gateway that is already in use 32304/head
Ricardo Marques [Thu, 30 Jan 2020 13:19:48 +0000 (13:19 +0000)]
mgr/dashboard: Unable to remove an iSCSI gateway that is already in use

Fixes: https://tracker.ceph.com/issues/43900
Signed-off-by: Ricardo Marques <rimarques@suse.com>
(cherry picked from commit bcb05d0cae89deeb6c5e6a0cf282d84fed7811c3)

5 years agoMerge branch 'nautilus-saved' into nautilus
Josh Durgin [Fri, 31 Jan 2020 22:40:34 +0000 (17:40 -0500)]
Merge branch 'nautilus-saved' into nautilus

Resetting branch after 14.2.7 hotfix release

5 years ago14.2.7 v14.2.7
Jenkins Build Slave User [Fri, 31 Jan 2020 17:07:52 +0000 (17:07 +0000)]
14.2.7

5 years agorgw: drop the partial message check while reading messages
Abhishek Lekshmanan [Fri, 24 Jan 2020 14:41:51 +0000 (15:41 +0100)]
rgw: drop the partial message check while reading messages

Avoid leaking connections that had partially-consumed
client data on unexpected disconnect.

Signed-off-by: Or Friedmann <orfriedma@redhat.com>
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
5 years agoMerge pull request #32979 from leseb/bkp-32828
Sébastien Han [Thu, 30 Jan 2020 21:54:39 +0000 (22:54 +0100)]
Merge pull request #32979 from leseb/bkp-32828

nautilus: ceph-volume: add db and wal support to raw mode

5 years agocommon/options: bluestore 64k min_alloc_size for HDD 32998/head
Sage Weil [Thu, 23 Jan 2020 17:23:38 +0000 (11:23 -0600)]
common/options: bluestore 64k min_alloc_size for HDD

Until we understand the performance regression and allocator behavior,
go back to 64k.  This will continue to have a high space overhead for
small objects and EC, but will preserve the current performance levels
for all workloads.

This partially reverts 0ec75c99ddb103c664f66c04450003ed4c407708

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 66797ef19949503e77d52b567962c218ff0d8a77)

5 years agocommon/options: Set bluestore min_alloc size to 4K
Mark Nelson [Wed, 2 Oct 2019 17:18:38 +0000 (12:18 -0500)]
common/options: Set bluestore min_alloc size to 4K

Signed-off-by: Mark Nelson <mnelson@redhat.com>
(cherry picked from commit 0ec75c99ddb103c664f66c04450003ed4c407708)

5 years agoMerge pull request #32221 from smithfarm/wip-43168-nautilus
Casey Bodley [Thu, 30 Jan 2020 21:29:44 +0000 (16:29 -0500)]
Merge pull request #32221 from smithfarm/wip-43168-nautilus

nautilus: rgw/pubsub: fix records/event json format to match documentation

Reviewed-by: Yuval Lifshitz <yuvalif@yahoo.com>
5 years agomon/MgrMonitor.cc: add always_on_modules to the output of "ceph mgr module ls" 32997/head
Neha [Tue, 28 Jan 2020 18:24:55 +0000 (18:24 +0000)]
mon/MgrMonitor.cc: add always_on_modules to the output of "ceph mgr module ls"

Makes it easier to know what the always_on_modules for each release are, without
having to look at the code.

Signed-off-by: Neha Ojha <nojha@redhat.com>
(cherry picked from commit 8aa3c65b56add413d3fba1cb1d0cf84a10bfcf3c)

5 years agoceph-volume: add db and wal support to raw mode 32979/head
Sébastien Han [Fri, 24 Jan 2020 15:29:54 +0000 (16:29 +0100)]
ceph-volume: add db and wal support to raw mode

Using the raw mode, the OSD preparation can now be called with extra
arguments to specify a block device for either rocksdb db or wal.

The code expects the device to be available and no validation will be
performed. Also, the entire block device will be consumed.

The goal is run this on Kubernetes with Rook and OSD are running on PVC.
Users will request PVC from a certain size, the request will be
acknowledged and a block will be created, then attached to the machine.
Later on consumed by Rook's preparation job.

Signed-off-by: Sébastien Han <seb@redhat.com>
(cherry picked from commit c8f23c7182e2681f2bc756776a890995aca1efd2)

5 years agoceph-volume: fix raw list
Sébastien Han [Fri, 24 Jan 2020 16:25:42 +0000 (17:25 +0100)]
ceph-volume: fix raw list

There is no json anymore, just plain output.

Signed-off-by: Sébastien Han <seb@redhat.com>
(cherry picked from commit e99eb8cc95c5f50ec13170f202226c3581e3f5e2)

5 years agoceph-volume: remove unnecessary comment
Sébastien Han [Fri, 24 Jan 2020 15:28:17 +0000 (16:28 +0100)]
ceph-volume: remove unnecessary comment

This comment is not relevant since we will never bring systemd support
to the raw mode.

Signed-off-by: Sébastien Han <seb@redhat.com>
(cherry picked from commit af3f5fded95e4dcc0dfa2a0b2eec5fb2c4252b6c)