]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
5 years agoapi/lvm: add get_lv_by_osd_id method
Jan Fajerski [Wed, 11 Dec 2019 12:17:19 +0000 (13:17 +0100)]
api/lvm: add get_lv_by_osd_id method

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit 2558b55b0ecbcc83acccbf8412c19f01e8dafb3e)

5 years agoapi/lvm: add deactivate method to Volume class
Jan Fajerski [Wed, 11 Dec 2019 12:17:02 +0000 (13:17 +0100)]
api/lvm: add deactivate method to Volume class

Simply calls lvchange -an to deactivate a logical volume.

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit 8087600d4853554794b709291a08d97befd07ed1)

5 years agoMerge pull request #32868 from shyukri/wip-42945-nautilus
Jan Fajerski [Tue, 11 Feb 2020 13:23:27 +0000 (14:23 +0100)]
Merge pull request #32868 from shyukri/wip-42945-nautilus

nautilus: ceph-volume: allow raw block devices everywhere

5 years agodoc: update ceph-volume lvm prepare 32868/head
Jan Fajerski [Tue, 5 Nov 2019 12:39:27 +0000 (13:39 +0100)]
doc: update ceph-volume lvm prepare

Add option to pass raw physical devices everywhere, restructure a little
(bluestore section before filestore) and reword a few things.

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit f2018d76eb8936aed8643328f0d5f111c87514e4)

5 years agoceph-volume: make lvm report fields into constants
Jan Fajerski [Tue, 5 Nov 2019 07:31:44 +0000 (08:31 +0100)]
ceph-volume: make lvm report fields into constants

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit 01a603f6e952d2c5931b89699a86503e281fb376)

5 years agoceph-volume: api/lvm create or reuse a vg
Jan Fajerski [Tue, 22 Oct 2019 12:32:11 +0000 (14:32 +0200)]
ceph-volume: api/lvm create or reuse a vg

This changes create_lv so one can pass the desired device and either a
VG with a name starting with ceph is re-used or a new one is created.
This commit also adds two new lvm primitives, making use of lvm's select
feature. The goal is to eventually avoid keeping a full list of lv's (or
vg's) around and query the lvm system as needed.

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit bb4de1a3fc238eaf9f717dc59c6bdf338ef6d657)

5 years agoMerge pull request #33202 from jan--f/wip-43853-nautilus
Jan Fajerski [Tue, 11 Feb 2020 12:08:01 +0000 (13:08 +0100)]
Merge pull request #33202 from jan--f/wip-43853-nautilus

nautilus: ceph-volume/batch: fail on filtered devices when non-interactive

5 years agoMerge pull request #33200 from jan--f/wip-42898-nautilus
Jan Fajerski [Tue, 11 Feb 2020 12:03:59 +0000 (13:03 +0100)]
Merge pull request #33200 from jan--f/wip-42898-nautilus

nautilus: ceph-volume: make get_devices fs location independent

5 years agoMerge pull request #32870 from shyukri/wip-43117-nautilus
Jan Fajerski [Tue, 11 Feb 2020 11:34:53 +0000 (12:34 +0100)]
Merge pull request #32870 from shyukri/wip-43117-nautilus

nautilus: ceph-volume: import mock.mock instead of unittest.mock (py2)

5 years agoMerge pull request #32877 from shyukri/wip-43570-nautilus
Jan Fajerski [Tue, 11 Feb 2020 11:32:01 +0000 (12:32 +0100)]
Merge pull request #32877 from shyukri/wip-43570-nautilus

nautilus: ceph-volume: Dereference symlink in lvm list

5 years agoMerge pull request #32873 from shyukri/wip-43201-nautilus
Jan Fajerski [Tue, 11 Feb 2020 11:31:08 +0000 (12:31 +0100)]
Merge pull request #32873 from shyukri/wip-43201-nautilus

nautilus: ceph-volume: fix the integer overflow

5 years agoMerge pull request #32874 from shyukri/wip-43321-nautilus
Jan Fajerski [Tue, 11 Feb 2020 11:19:50 +0000 (12:19 +0100)]
Merge pull request #32874 from shyukri/wip-43321-nautilus

nautilus: ceph-volume: use correct extents if using db-devices and >1 osds_per_device

5 years agoMerge pull request #32864 from shyukri/wip-43462-nautilus
Jan Fajerski [Tue, 11 Feb 2020 11:09:23 +0000 (12:09 +0100)]
Merge pull request #32864 from shyukri/wip-43462-nautilus

nautilus: ceph-volume/lvm/activate.py: clarify error message: fsid refers to osd_fsid

5 years agoMerge pull request #32860 from shyukri/wip-43281-nautilus
Jan Fajerski [Tue, 11 Feb 2020 11:08:22 +0000 (12:08 +0100)]
Merge pull request #32860 from shyukri/wip-43281-nautilus

nautilus: ceph-volume: util: look for executable in $PATH

5 years agoMerge pull request #31616 from jan--f/wip-42800-nautilus
Jan Fajerski [Tue, 11 Feb 2020 11:07:20 +0000 (12:07 +0100)]
Merge pull request #31616 from jan--f/wip-42800-nautilus

nautilus: ceph-volume: assume msgrV1 for all branches containing mimic

5 years agoceph-volume/batch: fail on filtered devices when non-interactive 33202/head
Jan Fajerski [Tue, 3 Dec 2019 12:44:00 +0000 (13:44 +0100)]
ceph-volume/batch: fail on filtered devices when non-interactive

When batch is called non-interactively and a user explicitly specifies,
say a db-device, this will be filtered when unavailable. This can cause
the resulting OSD to be very different from the users intention
(standalone vs external db when the db-device was filtered). If devices
get filtered in non-interactive mode, ceph-volume should fail.

Fixes: https://tracker.ceph.com/issues/43105
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit 2e985053deec6c4cf60c0b85aec3df16cd77ceeb)

5 years agoceph-volume: refactor tests for refactored get_devices 33200/head
Jan Fajerski [Mon, 11 Nov 2019 13:35:43 +0000 (14:35 +0100)]
ceph-volume: refactor tests for refactored get_devices

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit 4749f4c59dc4edb1fd689e18e8d9f358f95cb945)

Conflicts:
src/ceph-volume/ceph_volume/tests/conftest.py
        resolved by importing PropertyMock

5 years agoceph-volume: refactor get_devices, don't use os.path.realpath
Jan Fajerski [Fri, 8 Nov 2019 15:36:30 +0000 (16:36 +0100)]
ceph-volume: refactor get_devices, don't use os.path.realpath

Fixes: https://tracker.ceph.com/issues/42777
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit b35e8c485f73b5b65e0be29444eb06172d6df3e3)

5 years agoMerge pull request #32558 from shyukri/wip-43275-nautilus
Jan Fajerski [Tue, 11 Feb 2020 10:40:48 +0000 (11:40 +0100)]
Merge pull request #32558 from shyukri/wip-43275-nautilus

nautilus: ceph-volume/test: patch VolumeGroups

5 years agoMerge pull request #32556 from shyukri/wip-43022-nautilus
Jan Fajerski [Tue, 11 Feb 2020 10:39:40 +0000 (11:39 +0100)]
Merge pull request #32556 from shyukri/wip-43022-nautilus

nautilus: ceph-volume: minor clean-up of "simple scan" subcommand help

5 years agoMerge pull request #32998 from neha-ojha/wip-min-alloc-nautilus
Yuri Weinstein [Mon, 10 Feb 2020 21:46:00 +0000 (13:46 -0800)]
Merge pull request #32998 from neha-ojha/wip-min-alloc-nautilus

nautilus: common/options: bluestore 4k min_alloc_size for SSD

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Igor Fedotov <ifedotov@suse.com>
5 years agoMerge pull request #32846 from smithfarm/wip-43256-nautilus
Yuri Weinstein [Mon, 10 Feb 2020 21:37:08 +0000 (13:37 -0800)]
Merge pull request #32846 from smithfarm/wip-43256-nautilus

nautilus: common/config: update values when they are removed via mon

Reviewed-by: Sage Weil <sage@redhat.com>
5 years agoMerge pull request #32997 from neha-ojha/wip-32939-nautilus
Yuri Weinstein [Mon, 10 Feb 2020 20:46:12 +0000 (12:46 -0800)]
Merge pull request #32997 from neha-ojha/wip-32939-nautilus

nautilus: mon/MgrMonitor.cc: add always_on_modules to the output of "ceph mgr module ls"

Reviewed-by: David Zafman <dzafman@redhat.com>
5 years agoMerge pull request #32901 from smithfarm/wip-43631-nautilus
Yuri Weinstein [Mon, 10 Feb 2020 20:44:42 +0000 (12:44 -0800)]
Merge pull request #32901 from smithfarm/wip-43631-nautilus

nautilus: common/util: use ifstream to read from /proc files

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #32858 from smithfarm/wip-43473-nautilus
Yuri Weinstein [Mon, 10 Feb 2020 20:43:33 +0000 (12:43 -0800)]
Merge pull request #32858 from smithfarm/wip-43473-nautilus

nautilus: common: fix deadlocky inflight op visiting in OpTracker.

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #32845 from smithfarm/wip-43245-nautilus
Yuri Weinstein [Mon, 10 Feb 2020 20:41:21 +0000 (12:41 -0800)]
Merge pull request #32845 from smithfarm/wip-43245-nautilus

nautilus: os/bluestore/BlueStore.cc: set priorities for compression stats

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
5 years agoMerge pull request #32774 from dzafman/wip-43726-nautilus
Yuri Weinstein [Mon, 10 Feb 2020 20:38:35 +0000 (12:38 -0800)]
Merge pull request #32774 from dzafman/wip-43726-nautilus

nautilus: test: Fix wait_for_state() to wait for a PG to get into a state

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoceph-volume: Dereference symlink in lvm list 32877/head
Benoît Knecht [Thu, 2 Jan 2020 07:07:21 +0000 (08:07 +0100)]
ceph-volume: Dereference symlink in lvm list

This allows for a symlink to be passed to

```
ceph-volume lvm list <path>
```

which makes it possible to use `/dev/disk/by-path/*` devices, for
instance.

Fixes: https://tracker.ceph.com/issues/43497
Signed-off-by: Benoît Knecht <bknecht@protonmail.ch>
(cherry picked from commit 09fa3df8a39d361f2af11bded8aab9e0da334d51)

5 years agoceph-volume: use correct extents when using db-devices and >1 osds_per_device 32874/head
Fabian Niepelt [Wed, 11 Dec 2019 13:19:14 +0000 (14:19 +0100)]
ceph-volume: use correct extents when using db-devices and >1 osds_per_device

Actual data size depending on osds_per_device needs to be calculated here. Otherwise, if osds_per_device is greater than 1, ceph-volume will allocate 100% of the device to the first osd and then fail to create the LV for the second because the volume group is already full.

Fixes: https://tracker.ceph.com/issues/39442
Signed-off-by: Fabian Niepelt <f.niepelt@mittwald.de>
(cherry picked from commit ecde6cd619605003706f545b0b5ad4e2e8932f28)

 Conflicts:
src/ceph-volume/ceph_volume/devices/lvm/strategies/bluestore.py

I've removed `data_uuid` since it's not in nautilus already

5 years agoceph-volume: fix the type mismatch, covert the tries and interval to int from string. 32873/head
taodd [Sun, 8 Dec 2019 02:10:59 +0000 (10:10 +0800)]
ceph-volume: fix the type mismatch, covert the tries and interval to int from string.
Fixes: https://tracker.ceph.com/issues/43186
Signed-off-by: dongdong tao <dongdong.tao@canonical.com>
(cherry picked from commit 81ff4be4d13ce034d7a8b921113138a942e3051a)

5 years agoceph-volume: import mock.mock instead of unittest.mock (py2) 32870/head
Jan Fajerski [Fri, 22 Nov 2019 15:57:11 +0000 (16:57 +0100)]
ceph-volume: import mock.mock instead of unittest.mock (py2)

Fixes: bb4de1a3fc238eaf9f717dc59c6bdf338ef6d657
Fixes: https://tracker.ceph.com/issues/42970
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit c1bd09f2591d983f1988e3dadcf3c65c59afb15d)

Conflicts:
src/ceph-volume/ceph_volume/tests/api/test_lvm.py

5 years agolvm/activate.py: clarify error message: fsid refers to osd_fsid 32864/head
Yaniv Kaul [Thu, 19 Dec 2019 14:54:58 +0000 (16:54 +0200)]
lvm/activate.py: clarify error message: fsid refers to osd_fsid

Users complained[1] the error message isn't clear, and they thought
it referred to the cluster fsid instead of the osd_fsid.
Made it clearer.

[1] rook/rook#4547

Fixes: https://tracker.ceph.com/issues/43442
Signed-off-by: Yaniv Kaul <ykaul@redhat.com>
(cherry picked from commit ff3ba9200a6b5856fbdf4372fe292a7b94dd2539)

5 years agoceph-volume: util: look for executable in $PATH 32860/head
Shyukri Shyukriev [Thu, 21 Nov 2019 14:04:02 +0000 (15:04 +0100)]
ceph-volume: util: look for executable in $PATH

Fixes: https://tracker.ceph.com/issues/36728
Fallback to predefined paths for backward compatibility.
Alter test involved for partial match in warning

Signed-off-by: Shyukri Shyukriev <shshyukriev@suse.com>
(cherry picked from commit a8577085dc52b0f214d9568c29a9605d1a826a45)

5 years agoMerge pull request #30689 from smithfarm/wip-42120-nautilus
Yuri Weinstein [Sat, 8 Feb 2020 00:27:15 +0000 (16:27 -0800)]
Merge pull request #30689 from smithfarm/wip-42120-nautilus

nautilus: core: osd/OSDMap: health alert for non-power-of-two pg_num

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #32857 from smithfarm/wip-43471-nautilus
Yuri Weinstein [Fri, 7 Feb 2020 22:31:36 +0000 (14:31 -0800)]
Merge pull request #32857 from smithfarm/wip-43471-nautilus

nautilus: osd/PeeringState.cc: don't let num_objects become negative

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #32848 from smithfarm/wip-43346-nautilus
Yuri Weinstein [Fri, 7 Feb 2020 22:31:01 +0000 (14:31 -0800)]
Merge pull request #32848 from smithfarm/wip-43346-nautilus

nautilus: qa/suites/rados/thrash: force normal pg log length with cache tiering

Reviewed-by: Sage Weil <sage@redhat.com>
5 years agoMerge pull request #32847 from smithfarm/wip-43319-nautilus
Yuri Weinstein [Fri, 7 Feb 2020 22:30:26 +0000 (14:30 -0800)]
Merge pull request #32847 from smithfarm/wip-43319-nautilus

nautilus: osd/PeeringState.cc: skip peer_purged when discovering all missing

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #32843 from smithfarm/wip-43099-nautilus
Yuri Weinstein [Fri, 7 Feb 2020 22:29:48 +0000 (14:29 -0800)]
Merge pull request #32843 from smithfarm/wip-43099-nautilus

nautilus: osd/OSD: enhance osd numa affinity compatibility

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
5 years agoMerge pull request #32773 from dzafman/wip-43246-nautilus
Yuri Weinstein [Fri, 7 Feb 2020 22:29:08 +0000 (14:29 -0800)]
Merge pull request #32773 from dzafman/wip-43246-nautilus

nautilus: osd: Use physical ratio for nearfull (doesn't include backfill resserve)

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge branch 'nautilus' into wip-42120-nautilus 30689/head
David Zafman [Fri, 7 Feb 2020 22:27:18 +0000 (14:27 -0800)]
Merge branch 'nautilus' into wip-42120-nautilus

5 years agoMerge pull request #32716 from smithfarm/wip-43650-nautilus
Yuri Weinstein [Fri, 7 Feb 2020 22:11:40 +0000 (14:11 -0800)]
Merge pull request #32716 from smithfarm/wip-43650-nautilus

nautilus: osd: Diagnostic logging for upmap cleaning

Reviewed-by: David Zafman <dzafman@redhat.com>
5 years agoMerge pull request #32715 from smithfarm/wip-43620-nautilus
Yuri Weinstein [Fri, 7 Feb 2020 22:09:27 +0000 (14:09 -0800)]
Merge pull request #32715 from smithfarm/wip-43620-nautilus

nautilus: kv: fix shutdown vs async compaction

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
5 years agoMerge pull request #32259 from smithfarm/wip-43243-nautilus
Yuri Weinstein [Fri, 7 Feb 2020 22:08:44 +0000 (14:08 -0800)]
Merge pull request #32259 from smithfarm/wip-43243-nautilus

nautilus: selinux: Allow ceph to read udev db

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Boris Ranto <branto@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #32769 from liewegas/fix-42566-nautilus
Yuri Weinstein [Fri, 7 Feb 2020 22:03:28 +0000 (14:03 -0800)]
Merge pull request #32769 from liewegas/fix-42566-nautilus

nautilus: mgr/MgrClient: fix open condition

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
5 years agoMerge pull request #32930 from rhcs-dashboard/wip-43845-nautilus
Lenz Grimmer [Thu, 6 Feb 2020 10:33:33 +0000 (10:33 +0000)]
Merge pull request #32930 from rhcs-dashboard/wip-43845-nautilus

nautilus: mgr/dashboard: disable 'Add Capability' button in rgw user edit

Reviewed-by: Laura Paduano <lpaduano@suse.com>
5 years agoMerge pull request #32827 from rhcs-dashboard/wip-43811-nautilus
Lenz Grimmer [Thu, 6 Feb 2020 10:21:49 +0000 (10:21 +0000)]
Merge pull request #32827 from rhcs-dashboard/wip-43811-nautilus

nautilus: mgr/dashboard: check if user has config-opt permissions

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
5 years agoMerge pull request #31808 from bk201/wip-42956-nautilus
Lenz Grimmer [Thu, 6 Feb 2020 10:20:36 +0000 (10:20 +0000)]
Merge pull request #31808 from bk201/wip-42956-nautilus

nautilus: mgr/dashboard: check embedded Grafana dashboard references

Reviewed-by: Laura Paduano <lpaduano@suse.com>
5 years agoMerge pull request #31792 from rhcs-dashboard/wip-42936-nautilus
Lenz Grimmer [Thu, 6 Feb 2020 10:19:33 +0000 (10:19 +0000)]
Merge pull request #31792 from rhcs-dashboard/wip-42936-nautilus

nautilus: mgr/dashboard: Dashboard can't handle self-signed cert on Grafana API

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
5 years agoMerge pull request #31190 from rhcs-dashboard/wip-42294-nautilus
Lenz Grimmer [Thu, 6 Feb 2020 10:17:22 +0000 (10:17 +0000)]
Merge pull request #31190 from rhcs-dashboard/wip-42294-nautilus

nautilus: mgr/dashboard: add debug mode, and accept expected exception when SSL handshaking

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
5 years agoMerge pull request #32304 from ricardoasmarques/wip-43333-nautilus
Lenz Grimmer [Thu, 6 Feb 2020 10:15:34 +0000 (10:15 +0000)]
Merge pull request #32304 from ricardoasmarques/wip-43333-nautilus

nautilus: mgr/dashboard: iSCSI targets not available if any gateway is down (and more...)

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
5 years agoMerge pull request #32888 from shyukri/wip-42033-nautilus
Lenz Grimmer [Thu, 6 Feb 2020 10:13:27 +0000 (10:13 +0000)]
Merge pull request #32888 from shyukri/wip-42033-nautilus

nautilus: mgr/dashboard: Using wrong identifiers in RGW user/bucket datatables

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
5 years agomgr/dashboard: disable 'Add Capability' button when all the capabilities are added 32930/head
Alfonso Martínez [Wed, 22 Jan 2020 15:05:12 +0000 (16:05 +0100)]
mgr/dashboard: disable 'Add Capability' button when all the capabilities are added

Fixes: https://tracker.ceph.com/issues/43564
Signed-off-by: Alfonso Martínez <almartin@redhat.com>
(cherry picked from commit 4ef0e2c1ba2c7c2b12556f5ee7a593ae4ba99144)

Conflicts:
  src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-user-form/rgw-user-form.component.html

- Change applied manually in conflicting file.

5 years agomgr/dashboard: check if user has config-opt permissions before retrieving settings. 32827/head
Alfonso Martínez [Tue, 21 Jan 2020 12:49:02 +0000 (13:49 +0100)]
mgr/dashboard: check if user has config-opt permissions before retrieving settings.

Fixes: https://tracker.ceph.com/issues/43595
Signed-off-by: Alfonso Martínez <almartin@redhat.com>
(cherry picked from commit ea1c8c7ef7f494208aec1c59d12fec2da759784a)

 Conflicts:
src/pybind/mgr/dashboard/frontend/src/app/core/navigation/navigation/navigation.component.ts
src/pybind/mgr/dashboard/frontend/src/app/shared/components/notifications-sidebar/notifications-sidebar.component.spec.ts
src/pybind/mgr/dashboard/frontend/src/app/shared/components/notifications-sidebar/notifications-sidebar.component.ts

5 years agomgr/dashboard: Using wrong identifiers in RGW user/bucket datatables 32888/head
Volker Theile [Fri, 20 Sep 2019 13:46:50 +0000 (15:46 +0200)]
mgr/dashboard: Using wrong identifiers in RGW user/bucket datatables

Fixes: https://tracker.ceph.com/issues/41940
Signed-off-by: Volker Theile <vtheile@suse.com>
(cherry picked from commit 1271bf73fb862b567739ea3f493c7f571794b4e4)

5 years agomgr/dashboard: Unable to remove an iSCSI gateway that is already in use 32304/head
Ricardo Marques [Thu, 30 Jan 2020 13:19:48 +0000 (13:19 +0000)]
mgr/dashboard: Unable to remove an iSCSI gateway that is already in use

Fixes: https://tracker.ceph.com/issues/43900
Signed-off-by: Ricardo Marques <rimarques@suse.com>
(cherry picked from commit bcb05d0cae89deeb6c5e6a0cf282d84fed7811c3)

5 years agoMerge branch 'nautilus-saved' into nautilus
Josh Durgin [Fri, 31 Jan 2020 22:40:34 +0000 (17:40 -0500)]
Merge branch 'nautilus-saved' into nautilus

Resetting branch after 14.2.7 hotfix release

5 years ago14.2.7 v14.2.7
Jenkins Build Slave User [Fri, 31 Jan 2020 17:07:52 +0000 (17:07 +0000)]
14.2.7

5 years agorgw: drop the partial message check while reading messages
Abhishek Lekshmanan [Fri, 24 Jan 2020 14:41:51 +0000 (15:41 +0100)]
rgw: drop the partial message check while reading messages

Avoid leaking connections that had partially-consumed
client data on unexpected disconnect.

Signed-off-by: Or Friedmann <orfriedma@redhat.com>
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
5 years agoMerge pull request #32979 from leseb/bkp-32828
Sébastien Han [Thu, 30 Jan 2020 21:54:39 +0000 (22:54 +0100)]
Merge pull request #32979 from leseb/bkp-32828

nautilus: ceph-volume: add db and wal support to raw mode

5 years agocommon/options: bluestore 64k min_alloc_size for HDD 32998/head
Sage Weil [Thu, 23 Jan 2020 17:23:38 +0000 (11:23 -0600)]
common/options: bluestore 64k min_alloc_size for HDD

Until we understand the performance regression and allocator behavior,
go back to 64k.  This will continue to have a high space overhead for
small objects and EC, but will preserve the current performance levels
for all workloads.

This partially reverts 0ec75c99ddb103c664f66c04450003ed4c407708

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 66797ef19949503e77d52b567962c218ff0d8a77)

5 years agocommon/options: Set bluestore min_alloc size to 4K
Mark Nelson [Wed, 2 Oct 2019 17:18:38 +0000 (12:18 -0500)]
common/options: Set bluestore min_alloc size to 4K

Signed-off-by: Mark Nelson <mnelson@redhat.com>
(cherry picked from commit 0ec75c99ddb103c664f66c04450003ed4c407708)

5 years agoMerge pull request #32221 from smithfarm/wip-43168-nautilus
Casey Bodley [Thu, 30 Jan 2020 21:29:44 +0000 (16:29 -0500)]
Merge pull request #32221 from smithfarm/wip-43168-nautilus

nautilus: rgw/pubsub: fix records/event json format to match documentation

Reviewed-by: Yuval Lifshitz <yuvalif@yahoo.com>
5 years agomon/MgrMonitor.cc: add always_on_modules to the output of "ceph mgr module ls" 32997/head
Neha [Tue, 28 Jan 2020 18:24:55 +0000 (18:24 +0000)]
mon/MgrMonitor.cc: add always_on_modules to the output of "ceph mgr module ls"

Makes it easier to know what the always_on_modules for each release are, without
having to look at the code.

Signed-off-by: Neha Ojha <nojha@redhat.com>
(cherry picked from commit 8aa3c65b56add413d3fba1cb1d0cf84a10bfcf3c)

5 years agoceph-volume: add db and wal support to raw mode 32979/head
Sébastien Han [Fri, 24 Jan 2020 15:29:54 +0000 (16:29 +0100)]
ceph-volume: add db and wal support to raw mode

Using the raw mode, the OSD preparation can now be called with extra
arguments to specify a block device for either rocksdb db or wal.

The code expects the device to be available and no validation will be
performed. Also, the entire block device will be consumed.

The goal is run this on Kubernetes with Rook and OSD are running on PVC.
Users will request PVC from a certain size, the request will be
acknowledged and a block will be created, then attached to the machine.
Later on consumed by Rook's preparation job.

Signed-off-by: Sébastien Han <seb@redhat.com>
(cherry picked from commit c8f23c7182e2681f2bc756776a890995aca1efd2)

5 years agoceph-volume: fix raw list
Sébastien Han [Fri, 24 Jan 2020 16:25:42 +0000 (17:25 +0100)]
ceph-volume: fix raw list

There is no json anymore, just plain output.

Signed-off-by: Sébastien Han <seb@redhat.com>
(cherry picked from commit e99eb8cc95c5f50ec13170f202226c3581e3f5e2)

5 years agoceph-volume: remove unnecessary comment
Sébastien Han [Fri, 24 Jan 2020 15:28:17 +0000 (16:28 +0100)]
ceph-volume: remove unnecessary comment

This comment is not relevant since we will never bring systemd support
to the raw mode.

Signed-off-by: Sébastien Han <seb@redhat.com>
(cherry picked from commit af3f5fded95e4dcc0dfa2a0b2eec5fb2c4252b6c)

5 years agoceph-volume: remove osd-id and osd-fsid flag
Sébastien Han [Fri, 24 Jan 2020 15:27:10 +0000 (16:27 +0100)]
ceph-volume: remove osd-id and osd-fsid flag

These are not used since we only rely on the device path so removing
them to avid confusion.

Signed-off-by: Sébastien Han <seb@redhat.com>
(cherry picked from commit 525957be98a0a6ff742f6bae4450f291591f516f)

5 years agoceph-volume: remove "create" call from raw mode
Sébastien Han [Fri, 24 Jan 2020 15:23:10 +0000 (16:23 +0100)]
ceph-volume: remove "create" call from raw mode

This mode is intented to work when the cluster is running on Kubernetes
and OSDs are running on PVC.
So we always have a "prepare" pod and an "activate" pod.

Signed-off-by: Sébastien Han <seb@redhat.com>
(cherry picked from commit c7a2ecc59394a9eb323a19ff233a2e3dfe04a018)

5 years agoMerge pull request #32835 from smithfarm/wip-43812-nautilus
Yuri Weinstein [Wed, 29 Jan 2020 20:33:54 +0000 (12:33 -0800)]
Merge pull request #32835 from smithfarm/wip-43812-nautilus

nautilus: rgw: support radosgw-admin zone/zonegroup placement get command

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #32834 from smithfarm/wip-43789-nautilus
Yuri Weinstein [Wed, 29 Jan 2020 20:33:30 +0000 (12:33 -0800)]
Merge pull request #32834 from smithfarm/wip-43789-nautilus

nautilus: rgw: fix opslog operation field as per Amazon s3

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #32833 from smithfarm/wip-43786-nautilus
Yuri Weinstein [Wed, 29 Jan 2020 20:33:02 +0000 (12:33 -0800)]
Merge pull request #32833 from smithfarm/wip-43786-nautilus

nautilus: rgw: the http response code of delete bucket should not be 204-no-content

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #32832 from smithfarm/wip-43782-nautilus
Yuri Weinstein [Wed, 29 Jan 2020 20:32:36 +0000 (12:32 -0800)]
Merge pull request #32832 from smithfarm/wip-43782-nautilus

nautilus: rgw: Incorrectly calling ceph::buffer::list::decode_base64 in bucket policy

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #32504 from smithfarm/wip-43477-nautilus
Yuri Weinstein [Wed, 29 Jan 2020 20:31:07 +0000 (12:31 -0800)]
Merge pull request #32504 from smithfarm/wip-43477-nautilus

nautilus: rgw: Select the std::bitset to resolv ambiguity

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
Reviewed-by: Adam Emerson <aemerson@redhat.com>
5 years agoMerge pull request #32437 from pritha-srivastava/wip-42385-nautilus
Yuri Weinstein [Wed, 29 Jan 2020 20:30:14 +0000 (12:30 -0800)]
Merge pull request #32437 from pritha-srivastava/wip-42385-nautilus

nautilus: rgw: Adding 'iam' namespace for Role and User Policy related REST APIs.

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #32239 from smithfarm/wip-43300-nautilus
Yuri Weinstein [Wed, 29 Jan 2020 20:29:34 +0000 (12:29 -0800)]
Merge pull request #32239 from smithfarm/wip-43300-nautilus

nautilus: rgw: fix bugs in listobjectsv1

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #32825 from smithfarm/wip-43779-nautilus
Yuri Weinstein [Wed, 29 Jan 2020 20:25:09 +0000 (12:25 -0800)]
Merge pull request #32825 from smithfarm/wip-43779-nautilus

nautilus: rgw: return error if lock log shard fails

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #32824 from smithfarm/wip-43728-nautilus
Yuri Weinstein [Wed, 29 Jan 2020 20:24:27 +0000 (12:24 -0800)]
Merge pull request #32824 from smithfarm/wip-43728-nautilus

nautilus: rgw: move forward marker even in case of many rgw.none indexes

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #32822 from smithfarm/wip-43576-nautilus
Yuri Weinstein [Wed, 29 Jan 2020 20:24:03 +0000 (12:24 -0800)]
Merge pull request #32822 from smithfarm/wip-43576-nautilus

nautilus: rgw: fix a bug that bucket instance obj can't be removed after resharding completed

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #32821 from smithfarm/wip-43574-nautilus
Yuri Weinstein [Wed, 29 Jan 2020 20:23:36 +0000 (12:23 -0800)]
Merge pull request #32821 from smithfarm/wip-43574-nautilus

nautilus: rgw: fix data consistency error casued by rgw sent timeout

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #32820 from smithfarm/wip-43571-nautilus
Yuri Weinstein [Wed, 29 Jan 2020 20:23:10 +0000 (12:23 -0800)]
Merge pull request #32820 from smithfarm/wip-43571-nautilus

nautilus: rgw: build_linked_oids_for_bucket and build_buckets_instance_index should return negative value if it fails

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #32819 from smithfarm/wip-43373-nautilus
Yuri Weinstein [Wed, 29 Jan 2020 20:22:43 +0000 (12:22 -0800)]
Merge pull request #32819 from smithfarm/wip-43373-nautilus

nautilus: rgw: data sync markers include timestamp from datalog entry

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #32818 from smithfarm/wip-43372-nautilus
Yuri Weinstein [Wed, 29 Jan 2020 20:22:15 +0000 (12:22 -0800)]
Merge pull request #32818 from smithfarm/wip-43372-nautilus

nautilus: rgw: radosgw-admin: sync status displays id of shard furthest behind

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #32759 from smithfarm/wip-43203-nautilus
Yuri Weinstein [Wed, 29 Jan 2020 20:21:48 +0000 (12:21 -0800)]
Merge pull request #32759 from smithfarm/wip-43203-nautilus

nautilus: rgw: adding mfa code validation when bucket versioning status is changed

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #32489 from bzed/clang-build-fix
Yuri Weinstein [Wed, 29 Jan 2020 20:18:35 +0000 (12:18 -0800)]
Merge pull request #32489 from bzed/clang-build-fix

nautilus: rgw/rgw_rest_conn.h: fix build with clang

Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #32057 from smithfarm/wip-43010-nautilus
Yuri Weinstein [Wed, 29 Jan 2020 20:17:08 +0000 (12:17 -0800)]
Merge pull request #32057 from smithfarm/wip-43010-nautilus

nautilus: rgw multisite: fixes for concurrent version creation

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #32900 from smithfarm/wip-43830-nautilus
Yuri Weinstein [Wed, 29 Jan 2020 19:55:44 +0000 (11:55 -0800)]
Merge pull request #32900 from smithfarm/wip-43830-nautilus

nautilus: rbd: librbd: don't call refresh from mirror::GetInfoRequest state machine

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Mykola Golub <mgolub@mirantis.com>
5 years agoMerge pull request #32842 from smithfarm/wip-43735-nautilus
Yuri Weinstein [Wed, 29 Jan 2020 19:55:09 +0000 (11:55 -0800)]
Merge pull request #32842 from smithfarm/wip-43735-nautilus

nautilus: librbd: support compression allocation hints to the OSD

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
5 years agoMerge pull request #32841 from smithfarm/wip-43511-nautilus
Yuri Weinstein [Wed, 29 Jan 2020 19:54:21 +0000 (11:54 -0800)]
Merge pull request #32841 from smithfarm/wip-43511-nautilus

nautilus:  librbd: skip stale child with non-existent pool for list descendants

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
5 years agoMerge pull request #32840 from smithfarm/wip-43508-nautilus
Yuri Weinstein [Wed, 29 Jan 2020 19:53:55 +0000 (11:53 -0800)]
Merge pull request #32840 from smithfarm/wip-43508-nautilus

nautilus: rbd:  creating thick-provision image progress percent info exceeds 100%

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
5 years agoMerge pull request #32839 from smithfarm/wip-43501-nautilus
Yuri Weinstein [Wed, 29 Jan 2020 19:51:11 +0000 (11:51 -0800)]
Merge pull request #32839 from smithfarm/wip-43501-nautilus

nautilus: librbd: remove pool objects when removing a namespace

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
5 years agoMerge pull request #32837 from smithfarm/wip-43237-nautilus
Yuri Weinstein [Wed, 29 Jan 2020 19:50:27 +0000 (11:50 -0800)]
Merge pull request #32837 from smithfarm/wip-43237-nautilus

nautilus: librbd: fix rbd_open_by_id, rbd_open_by_id_read_only

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
5 years agoMerge pull request #32815 from tchaikov/nautilus-pr-30284
Yuri Weinstein [Mon, 27 Jan 2020 20:14:40 +0000 (12:14 -0800)]
Merge pull request #32815 from tchaikov/nautilus-pr-30284

nautilus: tests: add missing header cmath to test/mon/test_mon_memory_target.cc

Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
Reviewed-by: Yuri Weinstein <yweinste@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
5 years agoMerge pull request #32441 from tchaikov/nautilus-boost-1.72
Yuri Weinstein [Mon, 27 Jan 2020 20:13:37 +0000 (12:13 -0800)]
Merge pull request #32441 from tchaikov/nautilus-boost-1.72

nautilus: switch to boost 1.72

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
5 years agolibrbd: don't call refresh from mirror::GetInfoRequest state machine 32900/head
Mykola Golub [Mon, 20 Jan 2020 13:42:47 +0000 (13:42 +0000)]
librbd: don't call refresh from mirror::GetInfoRequest state machine

Fixes: https://tracker.ceph.com/issues/43589
Signed-off-by: Mykola Golub <mgolub@suse.com>
(cherry picked from commit da46798ab3f56a639cc7a0b885778e8f75505b53)

Conflicts:
src/librbd/api/Mirror.cc
- C_ImageGetInfo ctor takes only two arguments in nautilus
- nautilus does not have LambdaContext as a class; use FunctionContext
  instead

5 years agocommon/util: use ifstream to read from /proc files 32901/head
Kefu Chai [Tue, 14 Jan 2020 08:47:41 +0000 (16:47 +0800)]
common/util: use ifstream to read from /proc files

refactor `collect_sys_info()` to use ifstream, getline and boost string
helpers to read and parse the /proc/meminfo and /proc/cpuinfo. for
better readability, and it's less error-prone.

Related-To: https://tracker.ceph.com/issues/43306
Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit ecddb1dd24756b0049cf9d32fe49ae5d13f96b44)

5 years agocommon,tools: make sure the destination buffer can handle the size of the string
songweibin [Thu, 25 Jul 2019 11:44:08 +0000 (19:44 +0800)]
common,tools: make sure the destination buffer can handle the size of the string

fix klocwork issues:
Width is not specified for 's' conversion specifier.
This can result in an overflow of the buffer
provided in argument 3 of a call to 'sscanf'

Signed-off-by: songweibin <song.weibin@zte.com.cn>
(cherry picked from commit 5e8c412e63d6a86aa4846efe4cceff52ca8f16d5)

5 years agonautilus: monitoring: add details to Prometheus' alerts (#32892)
Lenz Grimmer [Mon, 27 Jan 2020 12:10:15 +0000 (12:10 +0000)]
nautilus: monitoring: add details to Prometheus' alerts (#32892)

nautilus: monitoring: add details to Prometheus' alerts

Reviewed-by: Jan Fajerski <jfajerski@suse.com>
Reviewed-by: Patrick Seidensal <pnawracay@suse.com>
5 years agoMerge pull request #32838 from smithfarm/wip-43241-nautilus
Ilya Dryomov [Mon, 27 Jan 2020 10:21:31 +0000 (11:21 +0100)]
Merge pull request #32838 from smithfarm/wip-43241-nautilus

nautilus: qa: krbd_exclusive_option.sh: update for recent kernel changes

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
5 years agomonitoring: add details to Prometheus' alerts 32892/head
Patrick Seidensal [Thu, 23 Jan 2020 11:52:24 +0000 (12:52 +0100)]
monitoring: add details to Prometheus' alerts

Fixes: https://tracker.ceph.com/issues/43764
Signed-off-by: Patrick Seidensal <pseidensal@suse.com>
(cherry picked from commit fb51c589b5b5cd6a05cbfb08c41ca46a8941b269)

5 years agorgw: Adding 'iam' namespace for Role and User Policy related REST APIs. 32437/head
Pritha Srivastava [Mon, 25 Mar 2019 07:07:23 +0000 (12:37 +0530)]
rgw: Adding 'iam' namespace for Role and User Policy related REST APIs.

Signed-off-by: Pritha Srivastava <prsrivas@redhat.com>
(cherry picked from commit 121a2695544bd56973459fad9b4f545b4ee412f8)

Conflicts:
src/common/options.cc
src/rgw/CMakeLists.txt
src/rgw/rgw_main.cc
src/rgw/rgw_rest_s3.cc
src/rgw/rgw_rest_s3.h