]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
6 years agorpm: move Python deps out of distro-conditional blocks 25963/head
Nathan Cutler [Tue, 15 Jan 2019 14:43:13 +0000 (15:43 +0100)]
rpm: move Python deps out of distro-conditional blocks

The python%{_python_buildid}-bcrypt and python%{_python_buildid}-requests RPMs
are identically named across all the RPM distros, so move them out of the
distro conditional blocks.

Signed-off-by: Nathan Cutler <ncutler@suse.com>
6 years agorpm: make Python build deps somewhat less confusing
Nathan Cutler [Tue, 15 Jan 2019 14:34:42 +0000 (15:34 +0100)]
rpm: make Python build deps somewhat less confusing

Signed-off-by: Nathan Cutler <ncutler@suse.com>
6 years agoMerge pull request #26210 from falcon78921/wip-mgr-restful-python3
Kefu Chai [Thu, 14 Feb 2019 09:02:58 +0000 (17:02 +0800)]
Merge pull request #26210 from falcon78921/wip-mgr-restful-python3

mgr/restful: updated string formatting to str.format()

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoMerge pull request #26315 from tchaikov/wip-fix-Waddress-of-packed-member
Kefu Chai [Thu, 14 Feb 2019 09:01:02 +0000 (17:01 +0800)]
Merge pull request #26315 from tchaikov/wip-fix-Waddress-of-packed-member

msg/msg_types.h: do not cast `ceph_entity_name` to `entity_name_t` for printing

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agoMerge pull request #26380 from tchaikov/wip-split-dashboard-package
Kefu Chai [Thu, 14 Feb 2019 08:59:58 +0000 (16:59 +0800)]
Merge pull request #26380 from tchaikov/wip-split-dashboard-package

deb,rpm,qa: split dashboard package

Reviewed-by: Tim Serong <tserong@suse.com>
Reviewed-by: Sage Weil <sage@redhat.com>
6 years agoMerge pull request #26419 from cyx1231st/wip-fix-echo
Kefu Chai [Thu, 14 Feb 2019 08:43:40 +0000 (16:43 +0800)]
Merge pull request #26419 from cyx1231st/wip-fix-echo

test/crimson: fixes of unittest_seastar_echo

Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge pull request #25989 from votdev/feature_36488
Lenz Grimmer [Thu, 14 Feb 2019 08:43:15 +0000 (09:43 +0100)]
Merge pull request #25989 from votdev/feature_36488

mgr/dashboard: Add UI to configure the telemetry mgr plugin

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Patrick Nawracay <pnawracay@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
6 years agoMerge pull request #26398 from SUSE/wip-fix-spec-badness
Kefu Chai [Thu, 14 Feb 2019 07:53:52 +0000 (15:53 +0800)]
Merge pull request #26398 from SUSE/wip-fix-spec-badness

ceph.spec.in: Don't use noarch for mgr module subpackages, fix /usr/lib64/ceph/mgr dir ownership

Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge pull request #26393 from zmc/wip-rhel7-deps
Kefu Chai [Thu, 14 Feb 2019 05:03:07 +0000 (13:03 +0800)]
Merge pull request #26393 from zmc/wip-rhel7-deps

install-deps.sh: Fixes for RHEL 7

Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge pull request #26411 from liewegas/wip-remove-smart
Dan Mick [Wed, 13 Feb 2019 22:49:11 +0000 (14:49 -0800)]
Merge pull request #26411 from liewegas/wip-remove-smart

mgr/smart: remove obsolete smart module

6 years agoMerge PR #26389 into master
Sage Weil [Wed, 13 Feb 2019 22:22:40 +0000 (16:22 -0600)]
Merge PR #26389 into master

* refs/pull/26389/head:
message/MMonMgrReport: conditionally reencode PGMapDigest
qa/suites/upgrade/luminous-x/parallel: enable all classes
qa/suites/upgrade/luminous-x/parallel/5-final-workload/rados_mon_thrash: use x branch
qa/suites/upgade/luminous-x: pglog_hardlimit succeeds now on luminous due to backport
mgr/DaemonServer: use a luminous-compatible 'mgr metadata' command
mgr/Mgr: print bad (non-object) json
qa/suites/upgrade/luminous-x/stress-split: mons on separate hosts, enable msgr2
qa/suites/upgrade/luminous-x/parallel: mon per host, msgr2
qa/suites/upgrade/luminous-x: whitelist 'slow request'
mon/HealthMonitor: add mon_warn_on_msgr2_not_enabled

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agomessage/MMonMgrReport: conditionally reencode PGMapDigest 26389/head
Sage Weil [Wed, 13 Feb 2019 13:29:45 +0000 (07:29 -0600)]
message/MMonMgrReport: conditionally reencode PGMapDigest

The encoding changed between luminous and mimic.  Reencode the
structure if the target doesn't have all the features.

Fixes: http://tracker.ceph.com/issues/38295
Signed-off-by: Sage Weil <sage@redhat.com>
6 years agoqa/suites/upgrade/luminous-x/parallel: enable all classes
Sage Weil [Fri, 8 Feb 2019 19:46:00 +0000 (13:46 -0600)]
qa/suites/upgrade/luminous-x/parallel: enable all classes

Otherwise it's annoying because the class list changes between luminous and nautilus,
and we don't want to futz around with changing this setting during the upgrade.

The problematic classes are 'cas' (added) and 'sdk' (not enabled by default but
included by the cls/ workunit.

Signed-off-by: Sage Weil <sage@redhat.com>
6 years agoqa/suites/upgrade/luminous-x/parallel/5-final-workload/rados_mon_thrash: use x branch
Sage Weil [Sun, 3 Feb 2019 17:04:15 +0000 (11:04 -0600)]
qa/suites/upgrade/luminous-x/parallel/5-final-workload/rados_mon_thrash: use x branch

The luminous version is (1) not what we want and (2) will fail because
ceph_test_rados_api_tier no longer exists in master.

Signed-off-by: Sage Weil <sage@redhat.com>
6 years agoMerge pull request #26397 from guits/guits-fix_ceph-volume
Andrew Schoen [Wed, 13 Feb 2019 19:53:03 +0000 (13:53 -0600)]
Merge pull request #26397 from guits/guits-fix_ceph-volume

ceph-volume: update testing playbook 'deploy.yml'

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
6 years agomgr/smart: remove 26411/head
Sage Weil [Wed, 13 Feb 2019 18:38:53 +0000 (12:38 -0600)]
mgr/smart: remove

This is obsolete and replaced by the devicehealth module.

Signed-off-by: Sage Weil <sage@redhat.com>
6 years agomgr/restful: updated string formatting to str.format() 26210/head
James McClune [Wed, 30 Jan 2019 21:01:22 +0000 (16:01 -0500)]
mgr/restful: updated string formatting to str.format()

Made changes per @tchaikov's request

Signed-off-by: James McClune <jmcclune@mcclunetechnologies.net>
6 years agoqa/suites/upgade/luminous-x: pglog_hardlimit succeeds now on luminous due to backport
Sage Weil [Sat, 2 Feb 2019 18:08:02 +0000 (12:08 -0600)]
qa/suites/upgade/luminous-x: pglog_hardlimit succeeds now on luminous due to backport

Signed-off-by: Sage Weil <sage@redhat.com>
6 years agomgr/DaemonServer: use a luminous-compatible 'mgr metadata' command
Sage Weil [Wed, 30 Jan 2019 22:44:35 +0000 (16:44 -0600)]
mgr/DaemonServer: use a luminous-compatible 'mgr metadata' command

In luminous it was 'id', in mimic it changed to 'who'.

Signed-off-by: Sage Weil <sage@redhat.com>
6 years agomgr/Mgr: print bad (non-object) json
Sage Weil [Wed, 30 Jan 2019 22:17:25 +0000 (16:17 -0600)]
mgr/Mgr: print bad (non-object) json

Signed-off-by: Sage Weil <sage@redhat.com>
6 years agoqa/suites/upgrade/luminous-x/stress-split: mons on separate hosts, enable msgr2
Sage Weil [Tue, 29 Jan 2019 23:02:54 +0000 (17:02 -0600)]
qa/suites/upgrade/luminous-x/stress-split: mons on separate hosts, enable msgr2

Signed-off-by: Sage Weil <sage@redhat.com>
6 years agoqa/suites/upgrade/luminous-x/parallel: mon per host, msgr2
Sage Weil [Mon, 28 Jan 2019 22:54:20 +0000 (16:54 -0600)]
qa/suites/upgrade/luminous-x/parallel: mon per host, msgr2

- mon per host
- enable msgr2 at the end
- include the nautilus.yaml

Signed-off-by: Sage Weil <sage@redhat.com>
6 years agomsg/msg_types.h: do not cast `ceph_entity_name` to `entity_name_t` for printing 26315/head
Kefu Chai [Thu, 7 Feb 2019 13:13:14 +0000 (21:13 +0800)]
msg/msg_types.h: do not cast `ceph_entity_name` to `entity_name_t` for printing

in GCC-9, `-Waddress-of-packed-member` is enabled, so we have warnings like:

src/msg/msg_types.h:142:41: warning: converting a packed 'const
ceph_entity_name' pointer (alignment 1) to a 'const entity_name_t'
pointer (alignment 8) may result in an unaligned pointer value
[-Waddress-of-packed-member]
  142 |   return out << *(const entity_name_t*)&addr;
      |                                         ^~~~

since the alignment of these two structures are different, we cannot
cast a structure with the alignment of 1 to a structure with the
alignment of 8. as the code generated by compiler accessing the members
of alignment 8 won't work with the members of alignment 1, we need to
create a temporary structure for printing it.

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge pull request #26406 from drunkard/master
Kefu Chai [Wed, 13 Feb 2019 16:37:34 +0000 (00:37 +0800)]
Merge pull request #26406 from drunkard/master

doc: typo fixes, s/Requered/Required/

Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge pull request #26325 from jtlayton/wip-jlayton-dashboard-orch
Lenz Grimmer [Wed, 13 Feb 2019 16:08:23 +0000 (17:08 +0100)]
Merge pull request #26325 from jtlayton/wip-jlayton-dashboard-orch

mgr/dashboard: use the orchestrator_cli backend setting

Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
6 years agodoc: typo fixes, s/Requered/Required/ 26406/head
Drunkard Zhang [Wed, 13 Feb 2019 15:04:40 +0000 (23:04 +0800)]
doc: typo fixes, s/Requered/Required/

Signed-off-by: Drunkard Zhang <gongfan193@gmail.com>
6 years agoqa: exclude new packages when installing old versions 26380/head
Kefu Chai [Tue, 12 Feb 2019 09:14:19 +0000 (17:14 +0800)]
qa: exclude new packages when installing old versions

ceph-mgr-dashboard is introduced in nautilus, so exclude it when
installing old versions.

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agorpm: split ceph-mgr-dashboard plugin into its own package
Kefu Chai [Tue, 12 Feb 2019 09:13:12 +0000 (17:13 +0800)]
rpm: split ceph-mgr-dashboard plugin into its own package

to make ceph-mgr-dashboard a separated package

- helps to reduce the repo size of downstream. because
  ceph-mgr-dashboard is an architecture independent package. by
  making it separated package avoids needless duplication of
  the same data in mutiple .debs.
- gives user a fine grained control of selection.

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge pull request #26390 from smithfarm/wip-doc-mgr-dashboard
Kefu Chai [Wed, 13 Feb 2019 13:31:58 +0000 (21:31 +0800)]
Merge pull request #26390 from smithfarm/wip-doc-mgr-dashboard

doc: add Ceph Manager Dashboard to top-level TOC

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agoqa/suites/upgrade/luminous-x: whitelist 'slow request'
Sage Weil [Tue, 12 Feb 2019 17:26:54 +0000 (11:26 -0600)]
qa/suites/upgrade/luminous-x: whitelist 'slow request'

The luminous warnings say slow request.

Signed-off-by: Sage Weil <sage@redhat.com>
6 years agomon/HealthMonitor: add mon_warn_on_msgr2_not_enabled
Sage Weil [Mon, 28 Jan 2019 21:30:42 +0000 (15:30 -0600)]
mon/HealthMonitor: add mon_warn_on_msgr2_not_enabled

Default true, but allow users (or tests) to turn this warning off.

Signed-off-by: Sage Weil <sage@redhat.com>
6 years agoMerge PR #26265 into master
Sage Weil [Wed, 13 Feb 2019 12:40:41 +0000 (06:40 -0600)]
Merge PR #26265 into master

* refs/pull/26265/head:
qa/suites/rados/upgrade: whitelist 'slow request'

Reviewed-by: Yuri Weinstein <yweins@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agoMerge PR #26366 into master
Sage Weil [Wed, 13 Feb 2019 12:40:26 +0000 (06:40 -0600)]
Merge PR #26366 into master

* refs/pull/26366/head:
os/filestore: ceph_abort() on fsync(2) or fdatasync(2) failure

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
6 years agoMerge PR #26369 into master
Sage Weil [Wed, 13 Feb 2019 12:39:29 +0000 (06:39 -0600)]
Merge PR #26369 into master

* refs/pull/26369/head:
ceph-mon: slightly more helpful output during mkfs

Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agoMerge PR #26391 into master
Sage Weil [Wed, 13 Feb 2019 12:39:12 +0000 (06:39 -0600)]
Merge PR #26391 into master

* refs/pull/26391/head:
buffer: disable hypercombining in bufferlist.

Reviewed-by: Sage Weil <sage@redhat.com>
6 years agoMerge PR #26392 into master
Sage Weil [Wed, 13 Feb 2019 12:38:53 +0000 (06:38 -0600)]
Merge PR #26392 into master

* refs/pull/26392/head:
messages/MMonMgrReport: fix compat decoding

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
6 years agoceph-volume: update deploy.yml 26397/head
Guillaume Abrioux [Wed, 13 Feb 2019 10:27:12 +0000 (11:27 +0100)]
ceph-volume: update deploy.yml

update deploy.yml accordingly with recent changes in ceph-ansible.

Fixes: ceph/ceph-ansible#3602
Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>
6 years agoceph.spec.in: Make ceph-mgr own /usr/lib64/ceph/mgr directory 26398/head
Tim Serong [Wed, 13 Feb 2019 11:08:05 +0000 (22:08 +1100)]
ceph.spec.in: Make ceph-mgr own /usr/lib64/ceph/mgr directory

Without this, no package actually owns the /usr/lib64/ceph/mgr directory
so the build fails with "directories not owned by a package" errors for
ceph-mgr, ceph-mgr-diskprediction-local, ceph-mgr-diskprediction-cloud
and ceph-mgr-rook.

Signed-off-by: Tim Serong <tserong@suse.com>
6 years agoceph.spec.in: Don't use noarch for ceph-mgr module subpackages
Tim Serong [Wed, 13 Feb 2019 11:05:28 +0000 (22:05 +1100)]
ceph.spec.in: Don't use noarch for ceph-mgr module subpackages

Even though ceph-mgr modules are notionally non-architecture-specific,
the files themselves are installed to an architecture-specific path
(/usr/lib64/ceph/mgr/....), which causes the build to fail on SUSE
distros with a huge long list of errors like:

ceph-mgr-diskprediction-cloud.noarch: E: suse-filelist-forbidden-noarch
(Badness: 10000) /usr/lib64/ceph/mgr/diskprediction_cloud is not
allowed in a noarch package
[...]
(none): E: badness 1120287 exceeds threshold 1000, aborting.

Signed-off-by: Tim Serong <tserong@suse.com>
6 years agoMerge pull request #26367 from tspmelo/wip-iscsi-edit-ui
Lenz Grimmer [Wed, 13 Feb 2019 10:52:59 +0000 (11:52 +0100)]
Merge pull request #26367 from tspmelo/wip-iscsi-edit-ui

mgr/dashboard: Add iSCSI Target Edit UI

Reviewed-by: Ricardo Marques <rimarques@suse.com>
6 years agoMerge pull request #26346 from noahdesu/mgr-orch-cache-refresh
Sebastian Wagner [Wed, 13 Feb 2019 10:13:52 +0000 (11:13 +0100)]
Merge pull request #26346 from noahdesu/mgr-orch-cache-refresh

mgr/orch: refresh option for inventory query

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
6 years agoMerge pull request #26357 from rjfd/wip-orch-fix-dev-pretty-print
Sebastian Wagner [Wed, 13 Feb 2019 10:13:08 +0000 (11:13 +0100)]
Merge pull request #26357 from rjfd/wip-orch-fix-dev-pretty-print

mgr/orchestrator: fix device pretty print with None attributes

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
6 years agoMerge pull request #26384 from tspmelo/wip-e2e-login
Lenz Grimmer [Wed, 13 Feb 2019 10:06:44 +0000 (11:06 +0100)]
Merge pull request #26384 from tspmelo/wip-e2e-login

mgr/dashboard: Add implicit wait in e2e tests

Reviewed-by: Laura Paduano <lpaduano@suse.com>
6 years agodebian: split ceph-mgr-dashboard plugin into its own package
Kefu Chai [Tue, 12 Feb 2019 09:05:30 +0000 (17:05 +0800)]
debian: split ceph-mgr-dashboard plugin into its own package

to make ceph-mgr-dashboard a separated package

- helps to reduce the repo size of downstream. because
  ceph-mgr-dashboard is an architecture independent package. by
  making it separated package avoids needless duplication of
  the same data in mutiple .debs.
- gives user a fine grained control of selection.

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge pull request #26379 from tchaikov/wip-remove-jinja2
Kefu Chai [Wed, 13 Feb 2019 09:29:58 +0000 (17:29 +0800)]
Merge pull request #26379 from tchaikov/wip-remove-jinja2

rpm,deb: remove python-jinja2 dependency

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Ken Dreyer <kdreyer@redhat.com>
6 years agocrimson/net: msgr default to v1 in test_alien_echo 26419/head
Yingxin Cheng [Wed, 13 Feb 2019 03:40:16 +0000 (11:40 +0800)]
crimson/net: msgr default to v1 in test_alien_echo

Signed-off-by: Yingxin Cheng <yingxincheng@gmail.com>
6 years agocrimson/net: fix nonce setting in test_alien_echo
Yingxin Cheng [Wed, 13 Feb 2019 03:38:17 +0000 (11:38 +0800)]
crimson/net: fix nonce setting in test_alien_echo

Signed-off-by: Yingxin Cheng <yingxincheng@gmail.com>
6 years agocrimson/net: fix var capture in test_alien_echo
Yingxin Cheng [Wed, 13 Feb 2019 03:35:54 +0000 (11:35 +0800)]
crimson/net: fix var capture in test_alien_echo

Signed-off-by: Yingxin Cheng <yingxincheng@gmail.com>
6 years agoinstall-deps.sh: Fixes for RHEL 7 26393/head
Zack Cerza [Fri, 1 Feb 2019 00:36:17 +0000 (00:36 +0000)]
install-deps.sh: Fixes for RHEL 7

Signed-off-by: Zack Cerza <zack@redhat.com>
6 years agomgr/dashboard: Add implicit wait in e2e tests 26384/head
Tiago Melo [Tue, 12 Feb 2019 13:32:48 +0000 (13:32 +0000)]
mgr/dashboard: Add implicit wait in e2e tests

Fixes: https://tracker.ceph.com/issues/38269
Signed-off-by: Tiago Melo <tmelo@suse.com>
6 years agoMerge PR #26385 into master
Sage Weil [Tue, 12 Feb 2019 22:45:22 +0000 (16:45 -0600)]
Merge PR #26385 into master

* refs/pull/26385/head:
mon: mons also connect to mgrs

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: João Eduardo Luís <joao@suse.de>
6 years agomessages/MMonMgrReport: fix compat decoding 26392/head
Sage Weil [Tue, 12 Feb 2019 22:41:44 +0000 (16:41 -0600)]
messages/MMonMgrReport: fix compat decoding

Broken by 08d1a6fc3c57ccbeb6dff8fce1aae429edca97f3

Signed-off-by: Sage Weil <sage@redhat.com>
6 years agoMerge pull request #26377 from tchaikov/wip-mgr-plugin-arch-all
Dan Mick [Tue, 12 Feb 2019 22:06:21 +0000 (14:06 -0800)]
Merge pull request #26377 from tchaikov/wip-mgr-plugin-arch-all

debian/control: change Architecture python plugins to "all"

6 years agoMerge pull request #26246 from leseb/cb-typo
Andrew Schoen [Tue, 12 Feb 2019 20:08:17 +0000 (14:08 -0600)]
Merge pull request #26246 from leseb/cb-typo

ceph-volume: add space between words

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
6 years agoMerge pull request #26337 from dillaman/wip-37998
Mykola Golub [Tue, 12 Feb 2019 19:31:43 +0000 (21:31 +0200)]
Merge pull request #26337 from dillaman/wip-37998

librbd: get_parent API method should properly handle migrating image

Reviewed-by: Mykola Golub <mgolub@suse.com>
6 years agoMerge pull request #26368 from alfredodeza/wip-rm38261
Ken Dreyer [Tue, 12 Feb 2019 19:13:51 +0000 (12:13 -0700)]
Merge pull request #26368 from alfredodeza/wip-rm38261

build: further removal of `subman` configuration

Reviewed-by: Ken Dreyer <kdreyer@redhat.com>
Reviewed-by: Kefu Chai <tchaikov@gmail.com>
6 years agodoc: add Ceph Manager Dashboard to top-level TOC 26390/head
Nathan Cutler [Tue, 12 Feb 2019 17:17:11 +0000 (18:17 +0100)]
doc: add Ceph Manager Dashboard to top-level TOC

Signed-off-by: Nathan Cutler <ncutler@suse.com>
6 years agobuffer: disable hypercombining in bufferlist. 26391/head
Radoslaw Zarzynski [Tue, 12 Feb 2019 17:11:07 +0000 (18:11 +0100)]
buffer: disable hypercombining in bufferlist.

We're seeing various failures like:

      * http://tracker.ceph.com/issues/38024,
      * http://tracker.ceph.com/issues/38230,
      * http://tracker.ceph.com/issues/37910

without a clear cause. Disabling hypercombining makes at least one
reproducer happy.

Fixes: http://tracker.ceph.com/issues/38024
Fixes: http://tracker.ceph.com/issues/38230
Fixes: http://tracker.ceph.com/issues/37910
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
6 years agotest/crimson: should not capture temporary variables
Kefu Chai [Mon, 11 Feb 2019 15:23:08 +0000 (23:23 +0800)]
test/crimson: should not capture temporary variables

otherwise, we are passing dangling pointers down to
`app_template::run()`.

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agotest/crimson: always use "async" for alien msgr
Kefu Chai [Mon, 11 Feb 2019 14:02:02 +0000 (22:02 +0800)]
test/crimson: always use "async" for alien msgr

avoid reading from conf as it is not populated yet without calling
`ceph::common::sharded_conf().start()` first.

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agorbd: added missing feature bitmask to name mapping 26337/head
Jason Dillaman [Tue, 12 Feb 2019 15:43:49 +0000 (10:43 -0500)]
rbd: added missing feature bitmask to name mapping

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
6 years agorbd: removed migration source annotation from parent info
Jason Dillaman [Tue, 12 Feb 2019 15:43:14 +0000 (10:43 -0500)]
rbd: removed migration source annotation from parent info

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
6 years agomgr/dashboard: Add UI to configure the telemetry mgr plugin 25989/head
Volker Theile [Thu, 7 Feb 2019 14:54:24 +0000 (15:54 +0100)]
mgr/dashboard: Add UI to configure the telemetry mgr plugin

Fixes: tracker.ceph.com/issues/36488
Signed-off-by: Volker Theile <vtheile@suse.com>
6 years agoMerge PR #26340 into master
Sage Weil [Tue, 12 Feb 2019 15:26:56 +0000 (09:26 -0600)]
Merge PR #26340 into master

* refs/pull/26340/head:
osd/OSD: respect osdmap message limits
mon/OSDMonitor: limit MOSDMap message size by bytes
common/options: add osd_map_message_max_bytes

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
6 years agoMerge PR #26365 into master
Sage Weil [Tue, 12 Feb 2019 15:09:34 +0000 (09:09 -0600)]
Merge PR #26365 into master

* refs/pull/26365/head:
msg/async/ProtocolV2: refuse incoming reconnect attempt intended for someone else
msg/async/ProtocolV2: refuse incoming connection intended for someone else

Reviewed-by: Ricardo Dias <rdias@suse.com>
6 years agoMerge PR #26363 into master
Sage Weil [Tue, 12 Feb 2019 15:09:10 +0000 (09:09 -0600)]
Merge PR #26363 into master

* refs/pull/26363/head:
ceph.spec.in: python-kubernetes broken on rhel

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>
6 years agoMerge pull request #26323 from LenzGr/pools-typo
Kefu Chai [Tue, 12 Feb 2019 14:54:03 +0000 (22:54 +0800)]
Merge pull request #26323 from LenzGr/pools-typo

mgr/dashboard: Fix typo in pools management

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Patrick Nawracay <pnawracay@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
6 years agomon: mons also connect to mgrs 26385/head
Ricardo Dias [Tue, 12 Feb 2019 13:46:19 +0000 (13:46 +0000)]
mon: mons also connect to mgrs

Signed-off-by: Ricardo Dias <rdias@suse.com>
6 years agomgr/dashboard: Add iSCSI target edit UI 26367/head
Tiago Melo [Thu, 7 Feb 2019 15:38:21 +0000 (15:38 +0000)]
mgr/dashboard: Add iSCSI target edit UI

Fixes: http://tracker.ceph.com/issues/38014
Signed-off-by: Tiago Melo <tmelo@suse.com>
6 years agoMerge pull request #26320 from tspmelo/wip-iscsi-discovery-ui
Lenz Grimmer [Tue, 12 Feb 2019 14:04:22 +0000 (15:04 +0100)]
Merge pull request #26320 from tspmelo/wip-iscsi-discovery-ui

mgr/dashboard: Add iSCSI discovery authentication UI

Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
6 years agoMerge pull request #26383 from tchaikov/wip-auth-common-cleanup
Kefu Chai [Tue, 12 Feb 2019 13:22:45 +0000 (21:22 +0800)]
Merge pull request #26383 from tchaikov/wip-auth-common-cleanup

auth, common: cleanups

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
6 years agomgr/dashboard: use orchestrator_cli to figure out the backend 26325/head
Jeff Layton [Thu, 7 Feb 2019 18:00:38 +0000 (13:00 -0500)]
mgr/dashboard: use orchestrator_cli to figure out the backend

Currently the dashboard has its own setting for the orchestrator
backend, which means that one has to set it in both the dashboard and
the orchestrator_cli module if you intend to use both.

Change the dashboard code to use the setting in the orchestrator_cli
module, and eliminate the dashboard-specific setting.

Signed-off-by: Jeff Layton <jlayton@redhat.com>
6 years agomgr: make orchestrator_cli be always-on
Jeff Layton [Thu, 7 Feb 2019 18:39:59 +0000 (13:39 -0500)]
mgr: make orchestrator_cli be always-on

The volumes module has at least a loose dependency on the orchestrator,
and thus also relies on the orchestrator_cli module for the backend
setting. Since the volumes module is always-on, do the same with the
orchestrator_cli module.

Signed-off-by: Jeff Layton <jlayton@redhat.com>
6 years agomgr/volumes: properly handle NoOrchestrator exception
Jeff Layton [Mon, 11 Feb 2019 16:24:23 +0000 (11:24 -0500)]
mgr/volumes: properly handle NoOrchestrator exception

Signed-off-by: Jeff Layton <jlayton@redhat.com>
6 years agomgr/orchestrator: don't have _select_orchestrator raise exceptions
Jeff Layton [Tue, 12 Feb 2019 12:16:06 +0000 (07:16 -0500)]
mgr/orchestrator: don't have _select_orchestrator raise exceptions

This is problematic as this usually gets invoked via the Mgr remote
method, which will clobber any exception with a RuntimeError.

Instead, just have it return None if one isn't configured, and have the
callers raise the exception if necessary.

Signed-off-by: Jeff Layton <jlayton@redhat.com>
6 years agomgr/orchestrator: move NoOrchestrator definition to base orchestrator.py
Jeff Layton [Tue, 12 Feb 2019 11:51:40 +0000 (06:51 -0500)]
mgr/orchestrator: move NoOrchestrator definition to base orchestrator.py

Signed-off-by: Jeff Layton <jlayton@redhat.com>
6 years agoMerge pull request #26221 from cyx1231st/wip-seastar-msgr-perf
Kefu Chai [Tue, 12 Feb 2019 12:44:35 +0000 (20:44 +0800)]
Merge pull request #26221 from cyx1231st/wip-seastar-msgr-perf

crimson/net: misc fixes and features for crimson-messenger tests

Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agomon/MonClient: forward declare AuthRegistry instead of #include it 26383/head
Kefu Chai [Tue, 12 Feb 2019 11:44:04 +0000 (19:44 +0800)]
mon/MonClient: forward declare AuthRegistry instead of #include it

to speed up the compilation.

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agocommon/ceph_context: hardwire module_type to CEPH_ENTITY_TYPE_OSD
Kefu Chai [Tue, 12 Feb 2019 11:42:33 +0000 (19:42 +0800)]
common/ceph_context: hardwire module_type to CEPH_ENTITY_TYPE_OSD

currently, crimson project is only targeting crimson-osd.

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agoauth/AuthServer: fix typo in comments
Kefu Chai [Tue, 12 Feb 2019 11:41:41 +0000 (19:41 +0800)]
auth/AuthServer: fix typo in comments

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agocrimson/net: crimson messenger performance test tool 26221/head
Yingxin Cheng [Wed, 30 Jan 2019 02:29:33 +0000 (10:29 +0800)]
crimson/net: crimson messenger performance test tool

Support the following settings:
* mode: both, client mode, server mode;
* set server address;
* rounds of messages;
* keepalive-ratio;
* block size;
* io-depth;

Signed-off-by: Yingxin Cheng <yingxincheng@gmail.com>
6 years agocrimson/net: improve UT performance and added timing
Yingxin Cheng [Tue, 29 Jan 2019 12:08:47 +0000 (20:08 +0800)]
crimson/net: improve UT performance and added timing

Signed-off-by: Yingxin Cheng <yingxincheng@gmail.com>
6 years agoMerge pull request #26243 from nathan-weinberg/block-tabs
Lenz Grimmer [Tue, 12 Feb 2019 11:09:41 +0000 (12:09 +0100)]
Merge pull request #26243 from nathan-weinberg/block-tabs

mgr/dashboard: Added tab tests to Block menu items

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
6 years agoMerge pull request #26364 from tchaikov/wip-test-silence-warnings
Kefu Chai [Tue, 12 Feb 2019 09:41:45 +0000 (17:41 +0800)]
Merge pull request #26364 from tchaikov/wip-test-silence-warnings

test/rgw: silence -Wsign-compare warnings

Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
6 years agomgr/dashboard: Add iSCSI discovery authentication UI 26320/head
Tiago Melo [Tue, 5 Feb 2019 12:01:05 +0000 (12:01 +0000)]
mgr/dashboard: Add iSCSI discovery authentication UI

Fixes: https://tracker.ceph.com/issues/38021
Signed-off-by: Tiago Melo <tmelo@suse.com>
6 years agomgr/dashboard: Fix order of table buttons
Tiago Melo [Mon, 11 Feb 2019 15:08:25 +0000 (15:08 +0000)]
mgr/dashboard: Fix order of table buttons

"float:none" is changing  the order of the table buttons.
By reverting this change and setting .oadatatableactions to "float:left",
we get the same result as intended before.

Signed-off-by: Tiago Melo <tmelo@suse.com>
6 years agoMerge pull request #26319 from tspmelo/wip-iscsi-service-spec
Lenz Grimmer [Tue, 12 Feb 2019 09:23:15 +0000 (10:23 +0100)]
Merge pull request #26319 from tspmelo/wip-iscsi-service-spec

mgr/dashboard: Fix iSCSI service unit tests

Reviewed-by: Ricardo Marques <rimarques@suse.com>
6 years agorpm,deb: remove python-jinja2 dependency 26379/head
Kefu Chai [Tue, 12 Feb 2019 08:30:03 +0000 (16:30 +0800)]
rpm,deb: remove python-jinja2 dependency

python-jinja2 dependency was added for the dashboard v1 in 87399bea. but
dashboard v2, which is now known as "dashboard" has taken the place of
the old dashboard. and dashboard now does not use jinja2, so we should
drop this dependency.

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agocrimson/net: fix memory leak
Yingxin Cheng [Thu, 31 Jan 2019 07:48:24 +0000 (15:48 +0800)]
crimson/net: fix memory leak

Do not enqueue sent before lossless policy implemented, it is causing
memory leak.

Signed-off-by: Yingxin Cheng <yingxincheng@gmail.com>
6 years agocrimson/net: port sharded-msgr to existing code 24945/head
Yingxin Cheng [Sun, 3 Feb 2019 14:24:23 +0000 (22:24 +0800)]
crimson/net: port sharded-msgr to existing code

Port sharded-msgr to crimson osd, monc, heartbeat and tests with
compatible mode.

Signed-off-by: Yingxin Cheng <yingxincheng@gmail.com>
6 years agocrimson/net: promote policy related method to Messenger
Yingxin Cheng [Sun, 3 Feb 2019 12:52:51 +0000 (20:52 +0800)]
crimson/net: promote policy related method to Messenger

Signed-off-by: Yingxin Cheng <yingxincheng@gmail.com>
6 years agocrimson/net: compatible mode of crimson-msgr
Yingxin Cheng [Wed, 23 Jan 2019 03:37:57 +0000 (11:37 +0800)]
crimson/net: compatible mode of crimson-msgr

Added a compatible mode with master_sid to support single-core
dispatcher.

Signed-off-by: Yingxin Cheng <yingxincheng@gmail.com>
6 years agocrimson/net: suppress info logs for frequent keepalive
Yingxin Cheng [Sat, 2 Feb 2019 02:27:06 +0000 (10:27 +0800)]
crimson/net: suppress info logs for frequent keepalive

The new unittest_seastar_messenger will print out the count of keepalive
attempts at the end of the execution.

Signed-off-by: Yingxin Cheng <yingxincheng@gmail.com>
6 years agocrimson/net: enable connections on all cores
Yingxin Cheng [Tue, 12 Feb 2019 05:11:16 +0000 (13:11 +0800)]
crimson/net: enable connections on all cores

Implement the sharded crimson-messenger:

* Sharded Messenger: provides shared-nothing Messenger for each shard,
  it's interfaces are symmetric to be called, any modifications will be
  applied to all shards.

* Sharded/non-sharded Dispatcher interface: allow connections to be
  dispatched, and related resources (such as Session) to be managed in
  its own shard or not.

* Sharded Connection: A connection only lives at one dedicated core
  during its lifecycle. It's sharded by its peer_IP in this PoC, because
  peer port and nonce are not available when a socket is accepted. While
  its interfaces are safe to be called from all shards.

* Replace `boost::intrusive_ptr` by seastar native smart ptrs for
  `Connection` and `SocketConnection`, because they need to be
  destructed from its original core.

* Unit test: establish multiple connections on both client and server
  sides, they runs concurrently and creates sessions that are also
  following shared-nothing design.

Signed-off-by: Yingxin Cheng <yingxincheng@gmail.com>
6 years agodebian/control: change Architecture python plugins to "all" 26377/head
Kefu Chai [Tue, 12 Feb 2019 08:18:58 +0000 (16:18 +0800)]
debian/control: change Architecture python plugins to "all"

change following plugins' Architecture to "all", as they are pure python
plugins, and are architecture-independent packages.

- ceph-mgr-diskprediction-cloud
- ceph-mgr-diskprediction-local
- ceph-mgr-rook

this also matches their couterparts in ceph.spec.in, where we have
```
BuildArch:  noarch
```

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agomgr/orchestrator: fix device pretty-print, added unit test 26357/head
Sebastian Wagner [Tue, 12 Feb 2019 07:22:58 +0000 (07:22 +0000)]
mgr/orchestrator: fix device pretty-print, added unit test

Signed-off-by: Ricardo Dias <rdias@suse.com>
6 years agoMerge pull request #26255 from tchaikov/wip-crimson-hb
Kefu Chai [Tue, 12 Feb 2019 02:57:40 +0000 (10:57 +0800)]
Merge pull request #26255 from tchaikov/wip-crimson-hb

crimson/osd: add more heartbeat peers

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
6 years agopybind/orch: add refresh option to inventory query 26346/head
Noah Watkins [Fri, 8 Feb 2019 23:25:55 +0000 (15:25 -0800)]
pybind/orch: add refresh option to inventory query

allow a user of the orchestrator interface to express that the inventory
query should not read from any cached inventory state.

Signed-off-by: Noah Watkins <noahwatkins@gmail.com>
6 years agoMerge PR #26282 into master
Sage Weil [Mon, 11 Feb 2019 23:26:19 +0000 (17:26 -0600)]
Merge PR #26282 into master

* refs/pull/26282/head:
mon: include progress events in 'ceph status' output
mon/MgrStatMonitor: persist progress events
mgr: send progress events to mon
mgr/progress: revise message syntax a bit
mgr/progress: report events into mgr
mgr: allow progress events to be reported from modules
mgr/progress: make persist period/interval configurable
mgr/progress: prune completed events

Reviewed-by: Tim Serong <tserong@suse.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
6 years agoceph-mon: slightly more helpful output during mkfs 26369/head
Sage Weil [Mon, 11 Feb 2019 22:48:23 +0000 (16:48 -0600)]
ceph-mon: slightly more helpful output during mkfs

Signed-off-by: Sage Weil <sage@redhat.com>