]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
5 years agodoc: minor fix in mount.ceph 32748/head
Rishabh Dave [Tue, 21 Jan 2020 14:10:22 +0000 (19:40 +0530)]
doc: minor fix in mount.ceph

Also, fix the indentation since we are already here.

Fixes: https://tracker.ceph.com/issues/43743
Signed-off-by: Rishabh Dave <ridave@redhat.com>
5 years agoMerge pull request #32691 from rosinL/wip-txpkt
Kefu Chai [Fri, 17 Jan 2020 06:32:28 +0000 (14:32 +0800)]
Merge pull request #32691 from rosinL/wip-txpkt

msg/async/dpdk: Fix infinite loop when sending packets

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agomsg/async/dpdk: Fix infinite loop when sending packets 32691/head
Chunsong Feng [Sat, 11 Jan 2020 04:54:40 +0000 (12:54 +0800)]
msg/async/dpdk: Fix infinite loop when sending packets

tx_pkt_burst loops until the next pointer is null, set next pointer of
the last segment nullptr to fix this issue.

Signed-off-by: Chunsong Feng <fengchunsong@huawei.com>
Signed-off-by: luo rixin <luorixin@huawei.com>
5 years agoMerge PR #32114 into master
Patrick Donnelly [Thu, 16 Jan 2020 22:35:22 +0000 (14:35 -0800)]
Merge PR #32114 into master

* refs/pull/32114/head:
doc: split index.rst of dev guide
doc: tweak few section titles in dev guide
doc: don't display contents twice in dev guide
doc: add guide for running tests with teuthology

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #32513 from IlsooByun/loop_rgw_none
J. Eric Ivancich [Thu, 16 Jan 2020 17:32:28 +0000 (12:32 -0500)]
Merge pull request #32513 from IlsooByun/loop_rgw_none

rgw: move forward marker even in case of many rgw.none indexes

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
5 years agoMerge pull request #31878 from yuvalif/wip-yuval-tag-filter
Casey Bodley [Thu, 16 Jan 2020 16:04:19 +0000 (11:04 -0500)]
Merge pull request #31878 from yuvalif/wip-yuval-tag-filter

rgw/pubsub: notification filtering by object tags

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #32596 from linuxbox2/wip-rgwfile-pfront
Daniel Gryniewicz [Thu, 16 Jan 2020 15:12:51 +0000 (10:12 -0500)]
Merge pull request #32596 from linuxbox2/wip-rgwfile-pfront

rgw_file: avoid string::front() on empty path

5 years agoMerge pull request #32453 from majianpeng/kv-rocksdbstore-fix-option-work
Kefu Chai [Thu, 16 Jan 2020 15:11:26 +0000 (23:11 +0800)]
Merge pull request #32453 from majianpeng/kv-rocksdbstore-fix-option-work

kv/RocksDBStore: make option: compaction_threads/disableWAL/flusher_t…

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
5 years agoMerge pull request #32443 from tchaikov/wip-btree
Kefu Chai [Thu, 16 Jan 2020 15:09:52 +0000 (23:09 +0800)]
Merge pull request #32443 from tchaikov/wip-btree

include/cpp-btree: cleanups

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
5 years agoMerge PR #32670 into master
Sage Weil [Thu, 16 Jan 2020 14:07:02 +0000 (08:07 -0600)]
Merge PR #32670 into master

* refs/pull/32670/head:
doc: remove prod cluster examples from hardware recs

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
5 years agoMerge pull request #31923 from tspmelo/wip-vertical-navigation
Laura Paduano [Thu, 16 Jan 2020 13:43:19 +0000 (14:43 +0100)]
Merge pull request #31923 from tspmelo/wip-vertical-navigation

mgr/dashboard: Add vertical menu

Reviewed-by: Ernesto Puertat <epuertat@redhat.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
5 years agoMerge pull request #32654 from liewegas/fix-43273
Sebastian Wagner [Thu, 16 Jan 2020 09:18:23 +0000 (10:18 +0100)]
Merge pull request #32654 from liewegas/fix-43273

mgr/rook: provide full path for devices names in inventory

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
5 years agoMerge pull request #32372 from sebastian-philipp/cephadm-progress
Sebastian Wagner [Thu, 16 Jan 2020 08:55:41 +0000 (09:55 +0100)]
Merge pull request #32372 from sebastian-philipp/cephadm-progress

mgr/cephadm: Add progress to update_mgr()

Reviewed-by: Joshua Schmid <jschmid@suse.de>
5 years agodoc: remove prod cluster examples from hardware recs 32670/head
Zac Dover [Thu, 16 Jan 2020 03:14:50 +0000 (13:14 +1000)]
doc: remove prod cluster examples from hardware recs

This PR removes the now-very-old (2012) production cluster
examples from the hardware recommendations page.

Sage requested this change in IRC on 14 Jan 2020. There is no issue link.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
5 years agoMerge pull request #32497 from zhengchengyao/snap_exists
Jason Dillaman [Thu, 16 Jan 2020 01:15:39 +0000 (20:15 -0500)]
Merge pull request #32497 from zhengchengyao/snap_exists

rbd: add snap_exists method API

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
5 years agoMerge PR #32541 into master
Patrick Donnelly [Wed, 15 Jan 2020 20:40:05 +0000 (12:40 -0800)]
Merge PR #32541 into master

* refs/pull/32541/head:
mds: add comment in feature_bitset_t::empty

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge PR #32619 into master
Sage Weil [Wed, 15 Jan 2020 18:57:42 +0000 (12:57 -0600)]
Merge PR #32619 into master

* refs/pull/32619/head:
kv/RocksDBStore: break out of compaction thread early on shutdown
kv/RocksDBStore: debug async compaction

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #32569 from votdev/feature_toggle_output
Laura Paduano [Wed, 15 Jan 2020 15:47:13 +0000 (16:47 +0100)]
Merge pull request #32569 from votdev/feature_toggle_output

mgr/dashboard: Cleanup feature toggle status output

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Ernesto Puertat <epuertat@redhat.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
5 years agoMerge pull request #32635 from Devp00l/wip-43594
Laura Paduano [Wed, 15 Jan 2020 14:57:42 +0000 (15:57 +0100)]
Merge pull request #32635 from Devp00l/wip-43594

mgr/dashbaord: Fix E2E pools page failure

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
5 years agomgr/rook: provide full path for devices names in inventory 32654/head
Sage Weil [Wed, 15 Jan 2020 14:53:03 +0000 (08:53 -0600)]
mgr/rook: provide full path for devices names in inventory

This matches the cephadm behavior.

Fixes: https://tracker.ceph.com/issues/43273
Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoMerge PR #32411 into master
Sage Weil [Wed, 15 Jan 2020 14:39:48 +0000 (08:39 -0600)]
Merge PR #32411 into master

* refs/pull/32411/head:
qa/tasks/ceph_manager: enable ceph-objectstore-tool via cephadm
qa/tasks/cephadm: support crush_tunables config option

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
5 years agoqa/tasks/ceph_manager: enable ceph-objectstore-tool via cephadm 32411/head
Sage Weil [Mon, 23 Dec 2019 21:08:14 +0000 (15:08 -0600)]
qa/tasks/ceph_manager: enable ceph-objectstore-tool via cephadm

- drop support for keyvaluestore
- leave a few paths non-cephadm specific (filestore, upgrade workaround)

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoMerge PR #32643 into master
Sage Weil [Wed, 15 Jan 2020 13:47:24 +0000 (07:47 -0600)]
Merge PR #32643 into master

* refs/pull/32643/head:
doc/bootstrap: fixed default --keyring target

Reviewed-by: Sage Weil <sage@redhat.com>
5 years agoMerge pull request #32567 from trociny/wip-mirror-snap-promote
Jason Dillaman [Wed, 15 Jan 2020 13:09:31 +0000 (08:09 -0500)]
Merge pull request #32567 from trociny/wip-mirror-snap-promote

librbd: fix some edge cases for snapshot mirror mode promote

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
5 years agomgr/dashbaord: Fix E2E pools page failure 32635/head
Stephan Müller [Tue, 14 Jan 2020 13:38:03 +0000 (14:38 +0100)]
mgr/dashbaord: Fix E2E pools page failure

The problem was that pg autoscaling is set to "on" by default. Therefore
the pg_num field is hidden, which caused the error. Now the test sets
the pg autoscaling to "off" revealing the pg_num field to make the tests
pass.

Fixes: https://tracker.ceph.com/issues/43594
Fixes: https://tracker.ceph.com/issues/43102
Signed-off-by: Stephan Müller <smueller@suse.com>
5 years agomgr/dashboard: PageHelper.selectOption
Stephan Müller [Tue, 14 Jan 2020 13:31:52 +0000 (14:31 +0100)]
mgr/dashboard: PageHelper.selectOption

This helper method selects an option inside a select element.
It will also expect that the option was set.

Fixes: https://tracker.ceph.com/issues/43594
Signed-off-by: Stephan Müller <smueller@suse.com>
5 years agoMerge pull request #32584 from aclamk/fix-bluefs-vselector
Kefu Chai [Wed, 15 Jan 2020 04:38:57 +0000 (12:38 +0800)]
Merge pull request #32584 from aclamk/fix-bluefs-vselector

bluestore/bluefs: make accounting resiliant to unlock()

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
5 years agoMerge pull request #32625 from mgfritch/cephadm-workunit-test-cleanup
Kefu Chai [Wed, 15 Jan 2020 04:33:52 +0000 (12:33 +0800)]
Merge pull request #32625 from mgfritch/cephadm-workunit-test-cleanup

qa/workunits/cephadm/test_cephadm: workunit test cleanup

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
5 years agoMerge PR #31763 into master
Patrick Donnelly [Wed, 15 Jan 2020 04:32:44 +0000 (20:32 -0800)]
Merge PR #31763 into master

* refs/pull/31763/head:
test: auto-upgrade subvolume test
mgr/volumes: tie everything together to implement versioned subvolumes
mgr/volumes: provide subvolume create/remove/open APIs
mgr/volumes: implement subvolume based on subvolume template
mgr/volumes: implement subvolume group based on group template
mgr/volumes: implement trash as a subvolume group
mgr/volumes: snapshot util module
mgr/volumes: template for implementing groups and subvolumes
mgr/volumes: implement filesystem volume module
mgr/volumes: lock module to serialize volume operations
mgr/volumes: introduce volume specification module
mgr/volumes: add fs_util helper module

Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agobluestore/bluefs: make accounting resiliant to unlock() 32584/head
Adam Kupczyk [Thu, 9 Jan 2020 18:02:04 +0000 (13:02 -0500)]
bluestore/bluefs: make accounting resiliant to unlock()

Moved vselector.sub_usage, so sub_usage and add_usage will not cross
_flush_bdev_safely(), which contains unlock().

Fixes: https://tracker.ceph.com/issues/43538
Signed-off-by: Adam Kupczyk <akupczyk@redhat.com>
5 years agoMerge pull request #32615 from liewegas/fix-43580
Kefu Chai [Wed, 15 Jan 2020 04:18:42 +0000 (12:18 +0800)]
Merge pull request #32615 from liewegas/fix-43580

osd/PG: clean up fastinfo key when last_update does not increase

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #30985 from chenerqi/master
Kefu Chai [Wed, 15 Jan 2020 04:12:26 +0000 (12:12 +0800)]
Merge pull request #30985 from chenerqi/master

mgr: ceph fs status support json format

Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com>
5 years agoinclude/cpp-btree: use "constexpr inline" for constants 32443/head
Kefu Chai [Sat, 4 Jan 2020 15:04:23 +0000 (23:04 +0800)]
include/cpp-btree: use "constexpr inline" for constants

in C++17, it's a more general way to define constants. and these
constants are correctly typed.

Signed-off-by: Kefu Chai <kchai@redhat.com>
5 years agotest/common/test_interval_set: use ASSERT_EQ()
Kefu Chai [Fri, 3 Jan 2020 12:46:20 +0000 (20:46 +0800)]
test/common/test_interval_set: use ASSERT_EQ()

ASSERT_EQ() is better than ASSERT_TRUE() when checking for equality, as
it is able to print the unmatched variables.

also, in ASSERT_EQ(), the first parameter is the expected value. so
transpose the parameters for better error messages.

Signed-off-by: Kefu Chai <kchai@redhat.com>
5 years agoinclude/interval_set: use prefix operator for non-trivial iterator
Kefu Chai [Fri, 3 Jan 2020 12:45:05 +0000 (20:45 +0800)]
include/interval_set: use prefix operator for non-trivial iterator

for better performance. no need to create a temporary instance of
iterator and throw it away

Signed-off-by: Kefu Chai <kchai@redhat.com>
5 years agoinclude/cpp-btree: adapt from abseil::btree
Kefu Chai [Tue, 14 Jan 2020 11:28:35 +0000 (19:28 +0800)]
include/cpp-btree: adapt from abseil::btree

adapt based on btree implementation from Abseil Common Libraries.

with following changes:

* remove abseil dependencies. as abseil libraries do support C++11,
  they are written in C++11 compatible way. and use its homebrew
  alternatives for the facilities offered by C++14 and C++17. but
  Ceph is in C++17, so replace those facilities using the ones
  from the C++ standard library
* change `key_compare_to_adapter` to adapt to arithmetic types, and
  those who have `compare()` defined.
* move SlotPolicy into *_params types, simpler this way.
* continue using *_fields types. the layout facilities is nice. but
  we don't need this flexibility at this moment.
* continue using `empty_base_handle` for EBCO, CompressedTuple is
  nice, but it involves more dependencies which we don't want at
  this moment.
* node handle support is dropped. it's part of C++17 standard for
  node-based containers. we don't use it at this moment. but it's
  relatively simple if we want to add it back.

Signed-off-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #32630 from tchaikov/wip-43306
Kefu Chai [Wed, 15 Jan 2020 02:57:13 +0000 (10:57 +0800)]
Merge pull request #32630 from tchaikov/wip-43306

common/util: use ifstream to read from /proc files

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
5 years agodoc/bootstrap: fixed default --keyring target 32643/head
yaarith [Wed, 15 Jan 2020 01:17:08 +0000 (20:17 -0500)]
doc/bootstrap: fixed default --keyring target

Changed target from 'ceph.keyring' to 'ceph.client.admin.keyring'.

Signed-off-by: Yaarit Hatuka <yaarit@redhat.com>
5 years agocpp-btree: import abseil-cpp btree implementation
Kefu Chai [Sun, 29 Dec 2019 16:35:01 +0000 (00:35 +0800)]
cpp-btree: import abseil-cpp btree implementation

Signed-off-by: Kefu Chai <kchai@redhat.com>
5 years agoosd/osd_types: add pg_t::compare()
Kefu Chai [Sun, 29 Dec 2019 11:58:53 +0000 (19:58 +0800)]
osd/osd_types: add pg_t::compare()

it's equivalent to the `<=>` operator in C++20. it helps to simplify the
definition of other equality operators.

Signed-off-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge PR #32315 into master
Patrick Donnelly [Wed, 15 Jan 2020 02:15:34 +0000 (18:15 -0800)]
Merge PR #32315 into master

* refs/pull/32315/head:
client: disallow changing fuse_default_permissions option at runtime

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>
5 years agoMerge PR #32322 into master
Patrick Donnelly [Wed, 15 Jan 2020 02:14:45 +0000 (18:14 -0800)]
Merge PR #32322 into master

* refs/pull/32322/head:
mds: Reorganize class members in SimpleLock header

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge PR #32348 into master
Patrick Donnelly [Wed, 15 Jan 2020 02:14:06 +0000 (18:14 -0800)]
Merge PR #32348 into master

* refs/pull/32348/head:
mds: Move data members of struct SnapRealm to private.
mds: Reorganize structure members in SnapRealm header

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge PR #32416 into master
Patrick Donnelly [Wed, 15 Jan 2020 02:13:25 +0000 (18:13 -0800)]
Merge PR #32416 into master

* refs/pull/32416/head:
mds: Reorganize structure members in flock header

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge PR #32431 into master
Patrick Donnelly [Wed, 15 Jan 2020 02:12:05 +0000 (18:12 -0800)]
Merge PR #32431 into master

* refs/pull/32431/head:
mds: Reorganize structure members in inode_backtrace header

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agolibrbd: add snap_exists method API 32497/head
zhengyin [Tue, 17 Dec 2019 03:03:45 +0000 (11:03 +0800)]
librbd: add snap_exists method API

Signed-off-by: Zheng Yin <zhengyin@cmss.chinamobile.com>
5 years agoMerge PR #32585 into master
Sage Weil [Tue, 14 Jan 2020 22:37:31 +0000 (16:37 -0600)]
Merge PR #32585 into master

* refs/pull/32585/head:
MDSMonitor: handle standby already without fscid

Reviewed-by: Sage Weil <sage@redhat.com>
5 years agoMerge PR #32505 into master
Patrick Donnelly [Tue, 14 Jan 2020 22:29:24 +0000 (14:29 -0800)]
Merge PR #32505 into master

* refs/pull/32505/head:
mds: note client features when rejecting client
mds: add hex indicator to printed feature flags

Reviewed-by: Zheng Yan <zyan@redhat.com>
5 years agoMerge PR #32095 into master
Sage Weil [Tue, 14 Jan 2020 21:59:45 +0000 (15:59 -0600)]
Merge PR #32095 into master

* refs/pull/32095/head:
ceph-volume: raw: activate: drop --all, --osd-id and --osd-fsid args
raw: fix activate args
raw: --osd-fsid throughout
ceph-volume: add raw mode
ceph-volume: show devices with bluestore labels and unavailable

Reviewed-by: Sébastien Han <seb@redhat.com>
5 years agoMerge PR #32582 into master
Patrick Donnelly [Tue, 14 Jan 2020 20:43:28 +0000 (12:43 -0800)]
Merge PR #32582 into master

* refs/pull/32582/head:
qa/cephfs: don't run kclient tests on latest RHEL
qa/cephfs: don't test kclient on RHEL 7

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge pull request #32620 from cbodley/wip-qa-rgw-hadoop-versions
Casey Bodley [Tue, 14 Jan 2020 18:36:29 +0000 (13:36 -0500)]
Merge pull request #32620 from cbodley/wip-qa-rgw-hadoop-versions

qa/rgw: s3a-hadoop task defaults to maven-version 3.6.3

Reviewed-by: Ali Maredia <amaredia@redhat.com>
5 years agoMerge pull request #32492 from yaarith/wip-fix-device-anon
Kefu Chai [Tue, 14 Jan 2020 17:20:48 +0000 (01:20 +0800)]
Merge pull request #32492 from yaarith/wip-fix-device-anon

mgr/telemetry: fix device serial number anonymization

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #32608 from tchaikov/wip-rpm-byte-compile-with-python3
Kefu Chai [Tue, 14 Jan 2020 15:34:26 +0000 (23:34 +0800)]
Merge pull request #32608 from tchaikov/wip-rpm-byte-compile-with-python3

ceph.spec.in: use python3 to bytecompile .py files

Reviewed-by: Sage Weil <sage@redhat.com>
5 years agoMerge pull request #32605 from tchaikov/wip-silence-clang-warnings
Kefu Chai [Tue, 14 Jan 2020 15:13:06 +0000 (23:13 +0800)]
Merge pull request #32605 from tchaikov/wip-silence-clang-warnings

crimson: cleanups for clang build

Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
5 years agokv/RocksDBStore: break out of compaction thread early on shutdown 32619/head
Sage Weil [Mon, 13 Jan 2020 14:51:48 +0000 (08:51 -0600)]
kv/RocksDBStore: break out of compaction thread early on shutdown

Fixes: https://tracker.ceph.com/issues/43587
Signed-off-by: Sage Weil <sage@redhat.com>
5 years agokv/RocksDBStore: debug async compaction
Sage Weil [Mon, 13 Jan 2020 14:51:33 +0000 (08:51 -0600)]
kv/RocksDBStore: debug async compaction

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoMerge PR #32622 into master
Sage Weil [Tue, 14 Jan 2020 14:45:30 +0000 (08:45 -0600)]
Merge PR #32622 into master

* refs/pull/32622/head:
qa/workunits/cephadm/test_cephadm: drop stray 'exit 0'

Reviewed-by: Michael Fritch <mfritch@suse.com>
5 years agoqa/rgw: remove test against hadoop v2.8.5 32620/head
Casey Bodley [Tue, 14 Jan 2020 14:42:52 +0000 (09:42 -0500)]
qa/rgw: remove test against hadoop v2.8.5

the hadoop branch rel/release-2.8.5 fails to build with:

[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  01:37 min
[INFO] Finished at: 2020-01-14T13:09:02Z
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-antrun-plugin:1.7:run (create-parallel-tests-dirs) on project hadoop-aws: An Ant BuildException has occured: Unable to create javax script engine for javascript

Signed-off-by: Casey Bodley <cbodley@redhat.com>
5 years agoqa/rgw: remove test against hadoop trunk
Casey Bodley [Tue, 14 Jan 2020 14:39:32 +0000 (09:39 -0500)]
qa/rgw: remove test against hadoop trunk

hadoop's trunk fails to build with many 'package does not exist' errors:

[INFO] 100 errors
[INFO] -------------------------------------------------------------
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  48.792 s
[INFO] Finished at: 2020-01-14T13:07:36Z
[INFO] ------------------------------------------------------------------------

Signed-off-by: Casey Bodley <cbodley@redhat.com>
5 years agomgr/cephadm: add progress to update_mgr() 32372/head
Sebastian Wagner [Fri, 20 Dec 2019 12:27:28 +0000 (13:27 +0100)]
mgr/cephadm: add progress to update_mgr()

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
5 years agoMerge pull request #32032 from votdev/issue_43088_passwd_async_validator
Laura Paduano [Tue, 14 Jan 2020 10:15:10 +0000 (11:15 +0100)]
Merge pull request #32032 from votdev/issue_43088_passwd_async_validator

mgr/dashboard: Process password complexity checks immediately

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
5 years agoMerge pull request #32574 from sebastian-philipp/orchestrator-exception-add-type
Sebastian Wagner [Tue, 14 Jan 2020 09:57:32 +0000 (10:57 +0100)]
Merge pull request #32574 from sebastian-philipp/orchestrator-exception-add-type

mgr/orchestrator: raise_if_exception: Add exception type to message

Reviewed-by: Michael Fritch <mfritch@suse.com>
5 years agoMerge pull request #32491 from pcuzner/cephadm-deploy-grafana
Sebastian Wagner [Tue, 14 Jan 2020 09:50:31 +0000 (10:50 +0100)]
Merge pull request #32491 from pcuzner/cephadm-deploy-grafana

cephadm: Add ability to deploy grafana container

Reviewed-by: Patrick Seidensal <pseidensal@suse.com>
5 years agodoc: split index.rst of dev guide 32114/head
Rishabh Dave [Mon, 6 Jan 2020 07:40:50 +0000 (13:10 +0530)]
doc: split index.rst of dev guide

Move every section to a different file. Also, fix minor issues like
line-wrapping along.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
5 years agodoc: tweak few section titles in dev guide
Rishabh Dave [Mon, 6 Jan 2020 07:45:25 +0000 (13:15 +0530)]
doc: tweak few section titles in dev guide

Signed-off-by: Rishabh Dave <ridave@redhat.com>
5 years agodoc: don't display contents twice in dev guide
Rishabh Dave [Mon, 6 Jan 2020 07:08:08 +0000 (12:38 +0530)]
doc: don't display contents twice in dev guide

Content of this page is being displayed twice, once on the left side of
the page and once within the page. Display it only once at the left
side of the page.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
5 years agodoc: add guide for running tests with teuthology
Rishabh Dave [Mon, 9 Dec 2019 09:28:52 +0000 (14:58 +0530)]
doc: add guide for running tests with teuthology

The guide shows how to run integration tests using teuthology framework.

Fixes: https://tracker.ceph.com/issues/42749
Signed-off-by: Rishabh Dave <ridave@redhat.com>
5 years agocommon/util: use ifstream to read from /proc files 32630/head
Kefu Chai [Tue, 14 Jan 2020 08:47:41 +0000 (16:47 +0800)]
common/util: use ifstream to read from /proc files

refactor `collect_sys_info()` to use ifstream, getline and boost string
helpers to read and parse the /proc/meminfo and /proc/cpuinfo. for
better readability, and it's less error-prone.

Related-To: https://tracker.ceph.com/issues/43306
Signed-off-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #29669 from cqzcqq/fix-40117
Xie Xingguo [Tue, 14 Jan 2020 08:50:55 +0000 (16:50 +0800)]
Merge pull request #29669 from cqzcqq/fix-40117

osd/PeeringState.h: Fix pg stuck in WaitActingChange

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
5 years agoosd/PG: clean up fastinfo key when last_update does not increase 32615/head
Sage Weil [Mon, 13 Jan 2020 13:11:51 +0000 (07:11 -0600)]
osd/PG: clean up fastinfo key when last_update does not increase

If the last_update field goes backwards, we write a full info instead of
the fastinfo key. However, a stale fastinfo key may still be present, and
it may have a last_update that looks valid to a restarting OSD.

Fixes: https://tracker.ceph.com/issues/43580
Reported-by: song <jinglesong0814@163.com>
Signed-off-by: Sage Weil <sage@redhat.com>
5 years agocrimson: move PG::prepare_write() to .cc file
Kefu Chai [Tue, 14 Jan 2020 05:50:16 +0000 (13:50 +0800)]
crimson: move PG::prepare_write() to .cc file

less cluttered this way

Signed-off-by: Kefu Chai <kchai@redhat.com>
5 years agouse omap_rmkey() where appropriate
Sage Weil [Mon, 13 Jan 2020 13:56:38 +0000 (07:56 -0600)]
use omap_rmkey() where appropriate

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoos/Transaction: add omap_rmkey
Sage Weil [Mon, 13 Jan 2020 13:51:56 +0000 (07:51 -0600)]
os/Transaction: add omap_rmkey

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoMerge pull request #32595 from rs-fabrica/doc_install_upgrading-ceph_systemctl_use
Kefu Chai [Tue, 14 Jan 2020 02:29:45 +0000 (10:29 +0800)]
Merge pull request #32595 from rs-fabrica/doc_install_upgrading-ceph_systemctl_use

doc/install/upgrading-ceph: systemctl in Ubuntu instructions

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #32607 from tchaikov/wip-odr-global-context
Kefu Chai [Tue, 14 Jan 2020 02:25:36 +0000 (10:25 +0800)]
Merge pull request #32607 from tchaikov/wip-odr-global-context

cmake: do not include global_context.cc multiple times

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoqa/tasks/cephadm: support crush_tunables config option
Sage Weil [Wed, 25 Dec 2019 17:43:09 +0000 (17:43 +0000)]
qa/tasks/cephadm: support crush_tunables config option

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoMerge PR #31917 into master
Patrick Donnelly [Tue, 14 Jan 2020 00:40:35 +0000 (16:40 -0800)]
Merge PR #31917 into master

* refs/pull/31917/head:
vstart: Remove duplicate option -N

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoceph-volume: raw: activate: drop --all, --osd-id and --osd-fsid args 32095/head
Sage Weil [Mon, 13 Jan 2020 23:51:19 +0000 (17:51 -0600)]
ceph-volume: raw: activate: drop --all, --osd-id and --osd-fsid args

We don't need these currently.

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoraw: fix activate args
Sage Weil [Wed, 18 Dec 2019 14:27:47 +0000 (08:27 -0600)]
raw: fix activate args

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoraw: --osd-fsid throughout
Sage Weil [Wed, 18 Dec 2019 14:13:55 +0000 (08:13 -0600)]
raw: --osd-fsid throughout

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoceph-volume: add raw mode
Sage Weil [Fri, 6 Dec 2019 20:08:12 +0000 (14:08 -0600)]
ceph-volume: add raw mode

list, prepare, activate, create (prepare+activate) basic bluestore OSDs
on a single device.

No support (or plans to ever support) dmcrypt.

I think support for db/wal could be added later without much trouble.

For now, we require --no-systemd and --bluestore flags because we haven't
implemented support for anything else but suspect we will in the future,
and would like to ensure users are being explicit about what they're
asking for.

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoqa/workunits/cephadm/test_cephadm: add SUDO to `vgchange` 32625/head
Michael Fritch [Mon, 13 Jan 2020 21:54:32 +0000 (14:54 -0700)]
qa/workunits/cephadm/test_cephadm: add SUDO to `vgchange`

2020-01-13T10:48:14.235 INFO:tasks.workunit.client.0.smithi177.stderr:+ vgchange -an test_cephadm
2020-01-13T10:48:14.239 INFO:tasks.workunit.client.0.smithi177.stderr:  WARNING: Running as a non-root user. Functionality may be unavailable.
2020-01-13T10:48:14.239 INFO:tasks.workunit.client.0.smithi177.stderr:  /run/lvm/lvmetad.socket: access failed: Permission denied
2020-01-13T10:48:14.240 INFO:tasks.workunit.client.0.smithi177.stderr:  WARNING: Failed to connect to lvmetad. Falling back to device scanning.
2020-01-13T10:48:14.260 INFO:tasks.workunit.client.0.smithi177.stderr:  /dev/mapper/control: open failed: Permission denied
2020-01-13T10:48:14.261 INFO:tasks.workunit.client.0.smithi177.stderr:  Failure to communicate with kernel device-mapper driver.
2020-01-13T10:48:14.261 INFO:tasks.workunit.client.0.smithi177.stderr:  Incompatible libdevmapper 1.02.145 (2017-11-03) and kernel driver (unknown version).
2020-01-13T10:48:14.301 INFO:tasks.workunit.client.0.smithi177.stderr:  /run/lock/lvm/V_test_cephadm:aux: open failed: Permission denied
2020-01-13T10:48:14.301 INFO:tasks.workunit.client.0.smithi177.stderr:  Can't get lock for test_cephadm
2020-01-13T10:48:14.301 INFO:tasks.workunit.client.0.smithi177.stderr:  Cannot process volume group test_cephadm

Signed-off-by: Michael Fritch <mfritch@suse.com>
5 years agoqa/workunits/cephadm/test_cephadm: need to add quotes for PYTHONS var
Michael Fritch [Mon, 13 Jan 2020 21:51:41 +0000 (14:51 -0700)]
qa/workunits/cephadm/test_cephadm: need to add quotes for PYTHONS var

2020-01-13T10:48:13.374 INFO:tasks.workunit.client.0.smithi177.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh: line 46: [: python3: binary operator expected

Signed-off-by: Michael Fritch <mfritch@suse.com>
5 years agoMerge pull request #31873 from smanjara/wip-mdlog-crash
Casey Bodley [Mon, 13 Jan 2020 21:25:50 +0000 (16:25 -0500)]
Merge pull request #31873 from smanjara/wip-mdlog-crash

rgw: find oldest period and update RGWMetadataLogHistory()

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge PR #32425 into master
Sage Weil [Mon, 13 Jan 2020 20:42:29 +0000 (14:42 -0600)]
Merge PR #32425 into master

* refs/pull/32425/head:
cephadm: shell: do not bind ceph.conf twice

Reviewed-by: Sebastian Wagner <swagner@suse.com>
5 years agoqa/workunits/cephadm/test_cephadm: drop stray 'exit 0' 32622/head
Sage Weil [Mon, 13 Jan 2020 20:40:51 +0000 (14:40 -0600)]
qa/workunits/cephadm/test_cephadm: drop stray 'exit 0'

Introduced in 40b70c632d22dbd4cf68f8ad0df1b30ee28b9f19

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agodoc/install/upgrading-ceph: using systemd commands in Ubuntu instructions 32595/head
Rodrigo Severo [Fri, 10 Jan 2020 14:38:19 +0000 (11:38 -0300)]
doc/install/upgrading-ceph: using systemd commands in Ubuntu instructions

Before this change, we were using the "restart" command which is a symlink to
initctl(8). and it's offered by upstart. since ubuntu/vivid, ubuntu moved from
upstart to systemd.

Please see https://lists.ubuntu.com/archives/ubuntu-devel/2016-July/039465.html

Signed-off-by: Rodrigo Severo <rodrigo@fabricadeideias.com>
5 years agoMerge pull request #31976 from cbodley/wip-39142-revisited
Casey Bodley [Mon, 13 Jan 2020 19:45:39 +0000 (14:45 -0500)]
Merge pull request #31976 from cbodley/wip-39142-revisited

rgw: apply_olh_log ignores RGW_ATTR_OLH_VER decode error

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
5 years agoMerge pull request #32188 from cbodley/wip-qa-rgw-obj-manifest
Casey Bodley [Mon, 13 Jan 2020 19:45:19 +0000 (14:45 -0500)]
Merge pull request #32188 from cbodley/wip-qa-rgw-obj-manifest

qa/rgw: add rgw_obj and throttle tests to rgw verify suite

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
5 years agoMerge pull request #32534 from cbodley/wip-43512
Casey Bodley [Mon, 13 Jan 2020 19:44:47 +0000 (14:44 -0500)]
Merge pull request #32534 from cbodley/wip-43512

rgw multisite: enforce spawn window for incremental data sync

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
Reviewed-by: Eric J. Ivancich <ivancich@redhat.com>
Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
5 years agoMerge pull request #32550 from cbodley/wip-qa-rgw-multisite-admin-rest
Casey Bodley [Mon, 13 Jan 2020 19:43:37 +0000 (14:43 -0500)]
Merge pull request #32550 from cbodley/wip-qa-rgw-multisite-admin-rest

qa/rgw: remove failing radosgw_admin_rest from multisite suite

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
5 years agoMerge pull request #31580 from cbodley/wip-rgw-spawn
Matt Benjamin [Mon, 13 Jan 2020 19:41:54 +0000 (14:41 -0500)]
Merge pull request #31580 from cbodley/wip-rgw-spawn

rgw: beast frontend uses 512k mprotected coroutine stacks

5 years agoqa/rgw: s3a-hadoop task defaults to maven-version 3.6.3
Casey Bodley [Mon, 13 Jan 2020 19:15:01 +0000 (14:15 -0500)]
qa/rgw: s3a-hadoop task defaults to maven-version 3.6.3

binaries for v3.6.2 are no longer available under
http://www-us.apache.org/dist/maven/maven-3/

Signed-off-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #32578 from dillaman/wip-41556-3
Mykola Golub [Mon, 13 Jan 2020 17:30:55 +0000 (19:30 +0200)]
Merge pull request #32578 from dillaman/wip-41556-3

rbd-mirror: remove journal-specific logic from image replay and bootstrap state machines

Reviewed-by: Mykola Golub <mgolub@suse.com>
5 years agoMerge pull request #32614 from kalebskeithley/gcc10
Jason Dillaman [Mon, 13 Jan 2020 15:48:05 +0000 (10:48 -0500)]
Merge pull request #32614 from kalebskeithley/gcc10

librbd: added missing <string> include to PoolMetadata header

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
5 years agolibrbd: added missing <string> include to PoolMetadata header 32614/head
kalebskeithley [Mon, 13 Jan 2020 12:51:59 +0000 (07:51 -0500)]
librbd: added missing <string> include to PoolMetadata header

Signed-off-by: Kaleb S. KEITHLEY <kkeithle@redhat.com>
5 years agoMerge pull request #32597 from sebastian-philipp/mgr-mypy-mgr_util-mgr_module
Sebastian Wagner [Mon, 13 Jan 2020 10:08:28 +0000 (11:08 +0100)]
Merge pull request #32597 from sebastian-philipp/mgr-mypy-mgr_util-mgr_module

pyind/mgr: add mgr_module.py and mgr_util.py to mypy

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agomgr/dashboard: fix badges of SSD devices in inventory page (#32454)
Lenz Grimmer [Mon, 13 Jan 2020 08:56:54 +0000 (08:56 +0000)]
mgr/dashboard: fix badges of SSD devices in inventory page (#32454)

mgr/dashboard: fix badges of SSD devices in inventory page

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
5 years agomgr/dashboard: "Promote" CRUSH options in pool form (#32210)
Lenz Grimmer [Mon, 13 Jan 2020 08:52:29 +0000 (08:52 +0000)]
mgr/dashboard: "Promote" CRUSH options in pool form (#32210)

mgr/dashboard: "Promote" CRUSH options in pool form

Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
5 years agoqa/cephfs: don't run kclient tests on latest RHEL 32582/head
Rishabh Dave [Thu, 9 Jan 2020 17:56:02 +0000 (23:26 +0530)]
qa/cephfs: don't run kclient tests on latest RHEL

Fixes: https://tracker.ceph.com/issues/43541
Signed-off-by: Rishabh Dave <ridave@redhat.com>