mgr/dashboard_v2: Mark text with the i18n attribute

Signed-off-by: Volker Theile <vtheile@suse.com>

mgr/dashboard_v2: Use Awesome Bootstrap Checkbox.

Signed-off-by: Volker Theile <vtheile@suse.com>

mgr/dashboard_v2: Refactored logging

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>

mgr/dashboard_v2: Don't use localized config for auth

Signed-off-by: Ricardo Marques <rimarques@suse.com>

mgr/dashboard_v2: Session expire at browser close

Add support for session expire at browser close.

Signed-off-by: Volker Theile <vtheile@suse.com>

mgr/dashboard_v2: Fix content type (body) of error page

Signed-off-by: Patrick Nawracay <pnawracay@suse.com>

mgr/dashboard_v2: Fix content type of JSON responses

Signed-off-by: Patrick Nawracay <pnawracay@suse.com>

mgr/dashboard_v2: Added status route to cluster

* `RESTController`: added `@detail_route`
* Fixed `RequestHelper.assertJsonBody`

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>

mgr/dashboard_v2: Rename "host" module to "cluster"

Signed-off-by: Ricardo Marques <rimarques@suse.com>

mgr/dashboard_v2: Fix typo on method isLoginActive

Signed-off-by: Ricardo Marques <rimarques@suse.com>

mgr/dashboard_v2: Add hosts page

Signed-off-by: Ricardo Marques <rimarques@suse.com>

mgr/dashboard_v2: Fix bug in AuthRequired decorator

This PR fixes the fllowing bug:
When a subclass of `RESTController` was decorated with the `AuthRequired`
decorator, then all controllers that were also subclasses of
`RESTController` were automatically required authentication when accessing
them.

Signed-off-by: Ricardo Dias <rdias@suse.com>

mgr/dashboard_v2: Refactor controller base class

Make it a little bit more OO. This way the mgr and logger properties are well
designed and documented which should help contributors to understand the code.

Signed-off-by: Volker Theile <vtheile@suse.com>

mgr/dashboard_v2: Added API controller listing endpoint.

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>

mgr/dashboard_v2: Updated README with more developer notes

* Adds instructions on how to access the manager module instance from
  within the controller.
* Adds instructions on how to write unit tests to test a controller

Signed-off-by: Ricardo Dias <rdias@suse.com>

mgr/dashboard_v2: Refactoring of the access to mgr module instance

Signed-off-by: Ricardo Dias <rdias@suse.com>

mgr/dashboard_v2: simplify router and fix navigation

Signed-off-by: Tiago Melo <tmelo@suse.com>

mgr/dashboard_v2: removed auth handler form test_auth.py setup

The auth setup is already being set in module.py

Signed-off-by: Ricardo Dias <rdias@suse.com>

mgr/dashboard_v2: Disable CherryPi autoreload feature.

It does not work, either with the below code to fix the error

```
2018-01-26 13:21:15.779 7fa454add700 -1 log_channel(cluster) log [ERR] : Unhandled exception from module 'dashboard_v2' while running on mgr.x: execv() arg 2 must not be empty
2018-01-26 13:21:15.779 7fa454add700 -1 dashboard_v2.serve: File "/ceph/src/pybind/mgr/dashboard_v2/module.py", line 112, in serve
```

```
def _get_true_argv():
    return sys.argv[:]
cherrypy.engine._get_true_argv = _get_true_argv
```

Signed-off-by: Volker Theile <vtheile@suse.com>

mgr/dashboard_v2: several code style enhancements

* Replace double quotes with single quotes
* Modify log messages
* Fix typo, rename autenticate to authenticate

Signed-off-by: Volker Theile <vtheile@suse.com>

mgr/dashboard_v2: fix pycodestyle to exclude the frontend files

Signed-off-by: Ricardo Dias <rdias@suse.com>

mgr/dashboard_v2: add support for frontend CI coverage and unit testing

Signed-off-by: Ricardo Dias <rdias@suse.com>

mgr/dashboard_v2: .gitignore update

Signed-off-by: Ricardo Dias <rdias@suse.com>

mgr/dashboard_v2: Added unit test for module.py

Signed-off-by: Ricardo Dias <rdias@suse.com>

mgr/dashboard_v2: Moved set-login-cred command logic to Auth class

Signed-off-by: Ricardo Dias <rdias@suse.com>

mgr/dashboard_v2: Unit tests refactoring

Signed-off-by: Ricardo Dias <rdias@suse.com>

mgr/dashboard_v2: Rename angular components prefix

Signed-off-by: Ricardo Marques <rimarques@suse.com>

mgr/dashboard_v2: Add frontend login/logout

Signed-off-by: Ricardo Marques <rimarques@suse.com>

mgr/dashboard_v2: Combine coverage and tests results from py27 and py3

Signed-off-by: Ricardo Dias <rdias@suse.com>

mgr/dashboard_v2: Fix pylint executor and warnings/errors

Signed-off-by: Ricardo Dias <rdias@suse.com>

mgr/dashboard_v2: Refactoring of unit tests

Signed-off-by: Ricardo Dias <rdias@suse.com>

mgr/dashboard_v2: Added RESTController test case

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>

mgr/dashboard_v2: add initial frontend code

This contains the angular boilerplate, some initial structure and the navigation component.
Signed-off-by: Tiago Melo <tmelo@suse.com>

mgr/dashboard_v2: Renamed/moved RESTResource to RESTController

Signed-off-by: Ricardo Dias <rdias@suse.com>

mgr/dashboard_v2: Added developer notes to README

Signed-off-by: Ricardo Dias <rdias@suse.com>

mgr/dashboard_v2: Very simple ping example

Signed-off-by: Ricardo Dias <rdias@suse.com>

mgr/dashboard_v2: auth module refactoring

Signed-off-by: Ricardo Dias <rdias@suse.com>

mgr/dashboard_v2: pass json body keys as args to REST resource methods

Signed-off-by: Ricardo Dias <rdias@suse.com>

mgr/dashboard_v2: Ignore the __pycache__ directory.

Signed-off-by: Volker Theile <vtheile@suse.com>

mgr/dashboard_v2: use float values when checking session expire time

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>

mgr/dashboard_v2: Added test_restresource.py

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>

mgr/dashboard_v2: Log script_name on unauthorized access

This commit also replaces double quotes with single quotes.

Signed-off-by: Volker Theile <vtheile@suse.com>

mgr/dashboard_v2: Updated README

Signed-off-by: Lenz Grimmer <lgrimmer@suse.com>

mgr/dashboard_v2: Fix python 2/3 compability problems

Signed-off-by: Ricardo Dias <rdias@suse.com>

mgr/dashboard_v2: added tox conf file to run unit tests and linting

Signed-off-by: Ricardo Dias <rdias@suse.com>

mgr/dashboard_v2: Added `RESTResource` Python class.

This is the base class for providing a RESTful interface to a resource.

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>

mgr/dashboard_v2: Added pylint support and fixed linting errors

Signed-off-by: Ricardo Dias <rdias@suse.com>

mgr/dashboard_v2: Auth API

Signed-off-by: Ricardo Marques <rimarques@suse.com>

mgr/dashboard_v2: Create proper text editor config files to maintain consistent coding styles.

Signed-off-by: Volker Theile <vtheile@suse.com>

mgr/dashboard_v2: Add command to create/update username/password.

Signed-off-by: Volker Theile <vtheile@suse.com>

mgr/dashboard_v2: Fix cherrypy shutdown handler

This patch prevents cherrypy from crashing the mgr process when some
exception is thrown when shutting down cherrypy.

Signed-off-by: Ricardo Dias <rdias@suse.com>

mgr/dashboard_v2: updated READMED with unit testing info

Signed-off-by: Ricardo Dias <rdias@suse.com>

mgr/dashboard_v2: added first unit test example

Signed-off-by: Ricardo Dias <rdias@suse.com>

mgr/dashboard_v2: ceph_module mock to support unit testing

Signed-off-by: Ricardo Dias <rdias@suse.com>

mgr/dashboard_v2: Make host and port configurable.

Signed-off-by: Volker Theile <vtheile@suse.com>

mgr/dashboard_v2: Initial commit of the dashboard_v2 Manager module

Create the directory and basic module initialization.

Add a minimal `README.rst`

Signed-off-by: Lenz Grimmer <lgrimmer@suse.com>

Merge pull request #20687 from Songweibin/wip-misc-cleanup

mon,osd,crush: misc cleanup

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>

Merge pull request #20485 from jcsp/wip-23017

mgr: quieten logging on missing OSD stats

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #20573 from liewegas/wip-mgr-ovh

qa/suites/rados/rest/mgr: provision openstack volumes

Merge pull request #20692 from idryomov/wip-krbd-huge-image-test

qa: krbd huge-image test

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

qa: krbd huge-image test

We've had multiple overflows in ceph_calc_file_object_mapping().
It wasn't being used by rbd, but it now is.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>

qa/suites/krbd: rename blkroset to basic

More simple fixed-1.yaml based tests are coming.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>

Merge pull request #20680 from cbodley/wip-qa-dnsmasq

qa: clean up dnsmasq task and fix EPERM error

Merge pull request #19252 from joke-lee/website_redirect

rgw: fix s3 website redirection error

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #20635 from mdw-at-linuxbox/wip-master-rgw-openssl

rgw: curl* reuse and for debian, use openssl not gnutls.

Reviewed-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Mark Kogan <mkogan@redhat.com>
Reviewed-by: Orit Wasserman <owasserm@redhat.com>

Merge pull request #20673 from ceph/wip-rm23148

docs fix ceph-volume missing sub-commands

Reviewed-by: Andrew Schoen <aschoen@redhat.com>

crush: should break the loop if leaves overfull

Signed-off-by: songweibin <song.weibin@zte.com.cn>

osd: drop redundant assert check

Signed-off-by: songweibin <song.weibin@zte.com.cn>

Merge pull request #20684 from liewegas/wip-bluestore-cache-debug

os/bluestore: no trim debug noise if there is no trimming to be done

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>

os/bluestore: no trim debug noise if there is no trimming to be done

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #20637 from wjwithagen/wjw-fix-MDSmonitor.h

mon/MDSMonitor: fix clang build failure

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

Merge pull request #20671 from batrick/rados-doc-flags

doc: init flags to 0 in rados example

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #20653 from xiexingguo/wip-fix-upmap

mon, osd: fix potential collided *Up Set* after PG remapping

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #20655 from xiexingguo/wip-fix-calc-upmap

osd/OSDMap: skip out/crush-out osds

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #20506 from jan--f/prometheus-rm-outdated-daemon-metrics

pybind/mgr/prometheus: don't export metrics for dead daemon; new metrics

Reviewed-by: John Spray <john.spray@redhat.com>

Merge pull request #20667 from tchaikov/wip-qa-standalone

qa/standalone: s/delete_erasure_pool/delete_erasure_coded_pool/

Reviewed-by: David Zafman <dzafman@redhat.com>

qa: clean up dnsmasq task and fix EPERM error

Signed-off-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #20648 from trociny/wip-snap_set_diff-empty_snapset

librados/snap_set_diff: don't assert on empty snapset

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #20613 from Songweibin/wip-23038

rbd: import with option --export-format 2 fails to protect snapshot

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #20608 from Songweibin/wip-rbd-snap-purge

rbd: allow remove all unprotected snapshots

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #20578 from trociny/wip-pybind-group

librbd: small cleanup for recently merged code

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #20621 from cbodley/wip-rgw-data_lock

rgw: don't hold data_lock over frontend io

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>

Merge pull request #20449 from cbodley/wip-rgw-beast-coroutine

rgw: switch beast frontend back to stackful coroutine

Reviewed-by: Orit Wasserman <owasserm@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

doc/install add missing lvm subcommand for ceph-volume

Signed-off-by: Alfredo Deza <adeza@redhat.com>

doc/rados add missing lvm subcommand for ceph-volume

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #20546 from yehudasa/wip-rgw-gc-aio

rgw: gc use aio

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>

Merge PR #20643 into master

* refs/pull/20643/head:
ceph-volume-client: fix command argument order

Reviewed-by: Ramana Raja <rraja@redhat.com>

Merge pull request #20650 from ceph/wip-rm22841

ceph-volume be resilient to $PATH issues

Reviewed-by: Andrew Schoen <aschoen@redhat.com>

doc: init flags to 0 in rados example

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #20656 from yaozongyou/rbd-fix-return

librbd: fix missing return in NotifyMessage::get_notify_op

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

rbd: allow remove all unprotected snapshots

allow remove all unprotected snapshots when exiting
protected snapshots in the same image.
Fixes: http://tracker.ceph.com/issues/23126
Signed-off-by: songweibin <song.weibin@zte.com.cn>

rbd: import with option --export-format fails to protect snapshot

Fixes: http://tracker.ceph.com/issues/23038
Signed-off-by: songweibin <song.weibin@zte.com.cn>

mon, osd: fix potential collided *Up Set* after PG remapping

The mgr balancer module are basically doing optimizations based on
the snapshots of OSDMap at certain moments, which turns out to be
the culprit of data loss since it can produce bad PG mapping results
sometimes while in upmap mode.
I.e.:
1) original cluster topology:

-5       2.00000     host host-a
 0   ssd 1.00000         osd.0       up  1.00000 1.00000
 1   ssd 1.00000         osd.1       up  1.00000 1.00000
-7       2.00000     host host-b
 2   ssd 1.00000         osd.2       up  1.00000 1.00000
 3   ssd 1.00000         osd.3       up  1.00000 1.00000
-9       2.00000     host host-c
 4   ssd 1.00000         osd.4       up  1.00000 1.00000
 5   ssd 1.00000         osd.5       up  1.00000 1.00000

2) mgr balancer applies optimization for PG 3.f:

            pg-upmap-items[3.f : 1->4]
3.f [1 3] + -------------------------> [4 3]

3) osd.3 is out/reweighted etc., original crush mapping of 3.f changed
   (while pg-upmap-items did not):

            pg-upmap-items[3.f : 1->4]
3.f [1 5] + -------------------------> [4 5]

4) we are now mapping PG 3.f to two OSDs(osd.4 & osd.5) on the same host
   (host-c).

Fix the above problem by putting a guard procedure before we can
finally encode these *unsafe* upmap remappings into OSDMap.
If any of them turns out to be inappropriate, we can simply cancel it
since balancer can still re-calculate and re-generate later if necessary.

Fixes: http://tracker.ceph.com/issues/23118
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>

Merge pull request #20640 from tchaikov/wip-async-dpdk-temp-str

msg/async: avoid referencing the temporary string

Reviewed-by: Haomai Wang <haomai@xsky.com>

Merge pull request #20531 from xiexingguo/wip-ec-scrub-sleep

osd/ECBackend: inject sleep during deep scrub

Reviewed-by: Sage Weil <sage@redhat.com>

qa/standalone: s/delete_erasure_pool/delete_erasure_coded_pool/

it's a regression introduced by ac56a202

Signed-off-by: Kefu Chai <kchai@redhat.com>

mon: fix clang error

The specific specialisations in both .h and .cc does not really fly
with Clang

/home/jenkins/workspace/ceph-master/src/mon/MDSMonitor.cc:79:22: error: template parameter redefines default argument
template <int dblV = 7>
                     ^
/home/jenkins/workspace/ceph-master/src/mon/MDSMonitor.h:76:23: note: previous default template argument defined here
  template<int dblV = 7>
                      ^
1 error generated.

Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>

pybind/mgr/prometheus: extend daemon metadata with hostname and ceph version

Signed-off-by: Jan Fajerski <jfajerski@suse.com>

pybind/mgr/prometheus: add fs and mds metadata metrics

Signed-off-by: Jan Fajerski <jfajerski@suse.com>

pybind/mgr/prometheus: new mon metrics

Remove mon_quorum_count and replace it with per-MON quorum status
(mon_quorum_status). Also add mon_metadata metrics.

Signed-off-by: Jan Fajerski <jfajerski@suse.com>