Patrick Donnelly [Thu, 16 Jan 2020 22:35:22 +0000 (14:35 -0800)]
Merge PR #32114 into master
* refs/pull/32114/head:
doc: split index.rst of dev guide
doc: tweak few section titles in dev guide
doc: don't display contents twice in dev guide
doc: add guide for running tests with teuthology
Stephan Müller [Tue, 14 Jan 2020 13:38:03 +0000 (14:38 +0100)]
mgr/dashbaord: Fix E2E pools page failure
The problem was that pg autoscaling is set to "on" by default. Therefore
the pg_num field is hidden, which caused the error. Now the test sets
the pg autoscaling to "off" revealing the pg_num field to make the tests
pass.
Fixes: https://tracker.ceph.com/issues/43594 Fixes: https://tracker.ceph.com/issues/43102 Signed-off-by: Stephan Müller <smueller@suse.com>
Patrick Donnelly [Wed, 15 Jan 2020 04:32:44 +0000 (20:32 -0800)]
Merge PR #31763 into master
* refs/pull/31763/head:
test: auto-upgrade subvolume test
mgr/volumes: tie everything together to implement versioned subvolumes
mgr/volumes: provide subvolume create/remove/open APIs
mgr/volumes: implement subvolume based on subvolume template
mgr/volumes: implement subvolume group based on group template
mgr/volumes: implement trash as a subvolume group
mgr/volumes: snapshot util module
mgr/volumes: template for implementing groups and subvolumes
mgr/volumes: implement filesystem volume module
mgr/volumes: lock module to serialize volume operations
mgr/volumes: introduce volume specification module
mgr/volumes: add fs_util helper module
Reviewed-by: Ramana Raja <rraja@redhat.com> Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Kefu Chai [Tue, 14 Jan 2020 11:28:35 +0000 (19:28 +0800)]
include/cpp-btree: adapt from abseil::btree
adapt based on btree implementation from Abseil Common Libraries.
with following changes:
* remove abseil dependencies. as abseil libraries do support C++11,
they are written in C++11 compatible way. and use its homebrew
alternatives for the facilities offered by C++14 and C++17. but
Ceph is in C++17, so replace those facilities using the ones
from the C++ standard library
* change `key_compare_to_adapter` to adapt to arithmetic types, and
those who have `compare()` defined.
* move SlotPolicy into *_params types, simpler this way.
* continue using *_fields types. the layout facilities is nice. but
we don't need this flexibility at this moment.
* continue using `empty_base_handle` for EBCO, CompressedTuple is
nice, but it involves more dependencies which we don't want at
this moment.
* node handle support is dropped. it's part of C++17 standard for
node-based containers. we don't use it at this moment. but it's
relatively simple if we want to add it back.
Sage Weil [Tue, 14 Jan 2020 21:59:45 +0000 (15:59 -0600)]
Merge PR #32095 into master
* refs/pull/32095/head:
ceph-volume: raw: activate: drop --all, --osd-id and --osd-fsid args
raw: fix activate args
raw: --osd-fsid throughout
ceph-volume: add raw mode
ceph-volume: show devices with bluestore labels and unavailable
Casey Bodley [Tue, 14 Jan 2020 14:42:52 +0000 (09:42 -0500)]
qa/rgw: remove test against hadoop v2.8.5
the hadoop branch rel/release-2.8.5 fails to build with:
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 01:37 min
[INFO] Finished at: 2020-01-14T13:09:02Z
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-antrun-plugin:1.7:run (create-parallel-tests-dirs) on project hadoop-aws: An Ant BuildException has occured: Unable to create javax script engine for javascript
Rishabh Dave [Mon, 6 Jan 2020 07:08:08 +0000 (12:38 +0530)]
doc: don't display contents twice in dev guide
Content of this page is being displayed twice, once on the left side of
the page and once within the page. Display it only once at the left
side of the page.
Kefu Chai [Tue, 14 Jan 2020 08:47:41 +0000 (16:47 +0800)]
common/util: use ifstream to read from /proc files
refactor `collect_sys_info()` to use ifstream, getline and boost string
helpers to read and parse the /proc/meminfo and /proc/cpuinfo. for
better readability, and it's less error-prone.
Sage Weil [Mon, 13 Jan 2020 13:11:51 +0000 (07:11 -0600)]
osd/PG: clean up fastinfo key when last_update does not increase
If the last_update field goes backwards, we write a full info instead of
the fastinfo key. However, a stale fastinfo key may still be present, and
it may have a last_update that looks valid to a restarting OSD.
Fixes: https://tracker.ceph.com/issues/43580 Reported-by: song <jinglesong0814@163.com> Signed-off-by: Sage Weil <sage@redhat.com>
Sage Weil [Fri, 6 Dec 2019 20:08:12 +0000 (14:08 -0600)]
ceph-volume: add raw mode
list, prepare, activate, create (prepare+activate) basic bluestore OSDs
on a single device.
No support (or plans to ever support) dmcrypt.
I think support for db/wal could be added later without much trouble.
For now, we require --no-systemd and --bluestore flags because we haven't
implemented support for anything else but suspect we will in the future,
and would like to ensure users are being explicit about what they're
asking for.
Michael Fritch [Mon, 13 Jan 2020 21:54:32 +0000 (14:54 -0700)]
qa/workunits/cephadm/test_cephadm: add SUDO to `vgchange`
2020-01-13T10:48:14.235 INFO:tasks.workunit.client.0.smithi177.stderr:+ vgchange -an test_cephadm
2020-01-13T10:48:14.239 INFO:tasks.workunit.client.0.smithi177.stderr: WARNING: Running as a non-root user. Functionality may be unavailable.
2020-01-13T10:48:14.239 INFO:tasks.workunit.client.0.smithi177.stderr: /run/lvm/lvmetad.socket: access failed: Permission denied
2020-01-13T10:48:14.240 INFO:tasks.workunit.client.0.smithi177.stderr: WARNING: Failed to connect to lvmetad. Falling back to device scanning.
2020-01-13T10:48:14.260 INFO:tasks.workunit.client.0.smithi177.stderr: /dev/mapper/control: open failed: Permission denied
2020-01-13T10:48:14.261 INFO:tasks.workunit.client.0.smithi177.stderr: Failure to communicate with kernel device-mapper driver.
2020-01-13T10:48:14.261 INFO:tasks.workunit.client.0.smithi177.stderr: Incompatible libdevmapper 1.02.145 (2017-11-03) and kernel driver (unknown version).
2020-01-13T10:48:14.301 INFO:tasks.workunit.client.0.smithi177.stderr: /run/lock/lvm/V_test_cephadm:aux: open failed: Permission denied
2020-01-13T10:48:14.301 INFO:tasks.workunit.client.0.smithi177.stderr: Can't get lock for test_cephadm
2020-01-13T10:48:14.301 INFO:tasks.workunit.client.0.smithi177.stderr: Cannot process volume group test_cephadm
Rodrigo Severo [Fri, 10 Jan 2020 14:38:19 +0000 (11:38 -0300)]
doc/install/upgrading-ceph: using systemd commands in Ubuntu instructions
Before this change, we were using the "restart" command which is a symlink to
initctl(8). and it's offered by upstart. since ubuntu/vivid, ubuntu moved from
upstart to systemd.
Please see https://lists.ubuntu.com/archives/ubuntu-devel/2016-July/039465.html
Casey Bodley [Mon, 13 Jan 2020 19:44:47 +0000 (14:44 -0500)]
Merge pull request #32534 from cbodley/wip-43512
rgw multisite: enforce spawn window for incremental data sync
Reviewed-by: Daniel Gryniewicz <dang@redhat.com> Reviewed-by: Eric J. Ivancich <ivancich@redhat.com> Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>