mgr/dashboard_v2: added script to run backend API tests locally

Signed-off-by: Ricardo Dias <rdias@suse.com>

qa/suites/mgr/dashboard_v2: added suite yaml for testing dashboard_v2

Signed-off-by: Ricardo Dias <rdias@suse.com>

qa/tasks/mgr/dashboard_v2: implementation of backend API tests

We moved the dashboard_v2 test cases that required a real ceph cluster
to run into qa/tasks/mgr with the necessary adaptations.
These tests can now be run in teuthology using the cephfs_test_runner
task.

Signed-off-by: Ricardo Dias <rdias@suse.com>

qa/tasks/mgr: move test initialization to setUpClass method

With this change, we avoid the disabling/enabling of the ceph-mgr module
being tested for each test function declared in each test case. Now
the ceph-mgr module being tested is disabled/enabled only once for each
test case.

Signed-off-by: Ricardo Dias <rdias@suse.com>

mgr/dashboard_v2: Added smoke test.

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>

mgr/dashboard_v2: Add mgr-dashboard_v2 frontend unittests to `ctest`

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>

mgr/dashboard_v2: Add CMake target to build the frontend.

* Added new CMake flag `WITH_MGR_DASHBOARD_V2_FRONTEND`:
  Build the mgr/dashboard_v2 frontend using `npm install && npm run build`

* Set this flag to `OFF` when building packages.

* Removed creation of the frontend from `vstart.sh`

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>

mgr/dashboard_v2: Integrate dashboard_v2 into `make check`

Also:

* Disabled API tests in tox.
* No longer start a vstart.sh cluster in tox.

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>

mgr/dashboard_v2: Remove `Service` and `ServiceMeta` class

Signed-off-by: Patrick Nawracay <pnawracay@suse.com>

mgr/dashboard_v2: Remove `BaseControllerMeta` meta class

Signed-off-by: Patrick Nawracay <pnawracay@suse.com>

mgr/dashboard_v2: use global manager instance instead of injection

Signed-off-by: Ricardo Dias <rdias@suse.com>

mgr/dashboard_v2: Fix OSD menu entry position

Signed-off-by: Stephan Müller <smueller@suse.com>

mgr/dashboard_v2: Auto reload cd-table

Now every used cd-table with a valid "fetch" function will auto reload
itself by default every 10 seconds. You can also identify the unique
property of the row now, by default the unique identifier is "id".

Signed-off-by: Stephan Müller <smueller@suse.com>

mgr/dashboard_v2: Fixed exception in rbd_mirroring

Fixed issue when rbd-mirroring is enabled without any Pools.

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>

mgr/dashboard_v2: Enable table header and footer on perfcounters

Enable the ability to filter and paginate the performance counter tables
to make it easier to find specific information quickly.

Signed-off-by: Lenz Grimmer <lgrimmer@suse.com>

mgr/dashboard_v2: Add support for $PREFIX config

Signed-off-by: Ricardo Marques <rimarques@suse.com>

mgr/dashboard_v2: Add links on dashboard

User will be able to navigate from dashboard to "Monitor" and "OSDs" pages

Signed-off-by: Ricardo Marques <rimarques@suse.com>

mgr/dashboard_v2: enable rbd-mirror perf counters

Signed-off-by: Tiago Melo <tmelo@suse.com>

mgr/dashboard_v2: Updated reference documentation

Updated the dashboard chapter in the manual to reflect the
changes introduced by Dashboard v2 (e.g. username/password).

Updated description to include a high-level overview of the features
available.

Signed-off-by: Lenz Grimmer <lgrimmer@suse.com>

mgr/dashboard_v2: Adapt status datatable to default design of cd-table

Signed-off-by: Volker Theile <vtheile@suse.com>

mgr/dashboard_v2: add mirroring page

Signed-off-by: Tiago Melo <tmelo@suse.com>

mgr/dashboard_v2: Add rbd_mirroring to `/api/summary`

Also:

* Made `get_daemons_and_pools` a function independant of `RbdMirroring`.
* Added tests

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>

mgr/dashboard_v2: OSD pages

You can now list all osds and see details for each OSD.
The details can be viewed in tabs. You can view attributes, meta data
and histogram of the selected OSD.

Signed-off-by: Stephan Müller <smueller@suse.com>

mgr/dashboard_v2: Fix datatable header layout in configuration doc

Signed-off-by: Volker Theile <vtheile@suse.com>

mgr/dashboard_v2: Move `dashboard/toplevel` to a new controller

Details:

* Moved `/dashboard/toplevel` API endpoint to `/summary`.
* Moved testcase to `tests/test_summary.py`.
* Also renamed service in the frontend.

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>

mgr/dashboard_v2: Add RBD mirroring functionality

This commit adds the RBD mirroring functionality of the first dashboard to
the dashboard_v2 REST API. That's why the code is basically based on the
code of the first dashboard. It was just brought into a different structure
to fit into the structure of dashboard_v2.

The new API endpoint can be found at http://<host>:<port>/api/rbdmirror

The commit adds also related tests.

Signed-off-by: Tatjana Dehler <tdehler@suse.com>

mgr/dashboard_v2: add ceph configuration documentation page

Signed-off-by: Tiago Melo <tmelo@suse.com>

mgr/dashboard_v2: updated .gitignore

Signed-off-by: Ricardo Dias <rdias@suse.com>

install-deps: install dashboard_v2 development dependencies

Signed-off-by: Ricardo Dias <rdias@suse.com>
Signed-off-by: Kai Wagner <kwagner@suse.com>

debian/control: add dashboard_v2 development dependencies

Signed-off-by: Ricardo Dias <rdias@suse.com>

ceph.spec: added dashboard_v2 development and runtime dependencies

Signed-off-by: Ricardo Dias <rdias@suse.com>

mgr/dashboard_v2: fix tox.ini to handle the vstart changes

vstart.sh script now enables and configures dashboard_v2 module, so
tox.ini script needs to handle that.

Signed-off-by: Ricardo Dias <rdias@suse.com>

vstart: mgr/dashboard_v2 enabling and configuration

Signed-off-by: Ricardo Dias <rdias@suse.com>

make-dist: Added dashboard_v2 frontend build files to dist tarball

Signed-off-by: Ricardo Dias <rdias@suse.com>

mgr/dashboard_v2: Fix hosts columns width

Signed-off-by: Ricardo Marques <rimarques@suse.com>

mgr/dashboard_v2: Add missing 'aria-current' attribute to active breadcrumbs.

Signed-off-by: Volker Theile <vtheile@suse.com>

mgr/dashboard_v2: Add missing i18n attributes

Signed-off-by: Volker Theile <vtheile@suse.com>

mgr/dashboard_v2: get rgw service list using CephService

Signed-off-by: Ricardo Dias <rdias@suse.com>

mgr/dashboard_v2: get tcmu_runner service list using CephService

Signed-off-by: Ricardo Dias <rdias@suse.com>

mgr/dashboard_v2: get rbd pool list using CephService

Signed-off-by: Ricardo Dias <rdias@suse.com>

mgr/dashboard_v2: added CephService service class

This class provides methods to get the list of services registered in
the cluster, and also to get the list of pools by application type.

Signed-off-by: Ricardo Dias <rdias@suse.com>

mgr/dashboard_v2: Service class base code

Signed-off-by: Ricardo Dias <rdias@suse.com>

mgr/dashboard_v2: Data transform in k/v table

The key value table can transform the input data into key value objects
now, you don't have to care about that anymore.

Also the first column of the data used in cd-table will be sorted if
not set manual through the "sorts" array.

Signed-off-by: Stephan Müller <smueller@suse.com>

mgr/dashboard_v2: Also protect `/api`

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>

mgr/dashboard_v2: Fixed capitalization on login page

Changed "ceph" to "Ceph" in the welcome message.

Signed-off-by: Lenz Grimmer <lgrimmer@suse.com>

mgr/dashboard_v2: Improve empty row style

Signed-off-by: Ricardo Marques <rimarques@suse.com>

mgr/dashboard_v2: Reorder menu entries

Signed-off-by: Ricardo Marques <rimarques@suse.com>

mgr/dashboard_v2: Add footer and header to hosts table

Signed-off-by: Ricardo Marques <rimarques@suse.com>

mgr/dashboard_v2: Auto refresh hosts

Signed-off-by: Ricardo Marques <rimarques@suse.com>

mgr/dashboard_v2: Prevent double click on table refresh

Signed-off-by: Ricardo Marques <rimarques@suse.com>

mgr/dashboard_v2: Migrate cluster configuration

This commit adds the ability to retrieve and filter the cluster
configuration of Ceph through the RESTful API.

Parameters `level` and `service` can be added to filter the list.

Example:

    http://<host>:<port>/api/cluster_conf?level=basic&service=mds

Signed-off-by: Patrick Nawracay <pnawracay@suse.com>

mgr/dashboard_v2: Add iSCSI page

Signed-off-by: Ricardo Marques <rimarques@suse.com>

mgr/dashboard_v2: Use monospace font on logs

Signed-off-by: Ricardo Marques <rimarques@suse.com>

mgr/dashboard_v2: add filesystem page

Signed-off-by: Tiago Melo <tmelo@suse.com>

mgr/dashboard_v2: Datatable related code improvements

Signed-off-by: Volker Theile <vtheile@suse.com>

mgr/dashboard_v2: Add port to `ControllerTestCase.__init__`

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>

mgr/dashboard_v2: Added tcmu iSCSI controller.

* Based on `mgr/dashboard/rbd_iscsi.py`.
* Fixed Python3 compatibility issues.
* Added test.

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>

mgr/dashboard_v2: Add  bin dir to PATH

Add `<repo>/build/bin` to `PATH` when running unit tests.

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>

mgr/dashboard_v2: Create links to perf counters

- Display links to the services in the Hosts data table
- Add missing MDS performance counter backend

Signed-off-by: Volker Theile <vtheile@suse.com>

mgr/dashboard_v2: add 404 page

Add a 404 page that will be triggered every time the user tries to
access a route that does not exists or the servers responds with 404.

Signed-off-by: Tiago Melo <tmelo@suse.com>

mgr/dashboard_v2: Renamed `block_pool` controller to `rbd`

* Simplified the API
* Fixed and improved the rbd controller tests.

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>

mgr/dashboard_v2: add monitors page

Signed-off-by: Tiago Melo <tmelo@suse.com>

mgr/dashboard_v2: add router link table template

Signed-off-by: Tiago Melo <tmelo@suse.com>

mgr/dashboard_v2: add sparkline component

This also adds a template in the table component.

Signed-off-by: Tiago Melo <tmelo@suse.com>

mgr/dashboard_v2: move datatable module

By moving the datatable module outside of the  components module we
can avoid a circular dependency between the datatable and sparkline
component.

Signed-off-by: Tiago Melo <tmelo@suse.com>

mgr/dashboard_v2: add performance counter page

Signed-off-by: Tiago Melo <tmelo@suse.com>

mgr/dashboard_v2: Migrate standby module

This commit will add a StandbyModule class to enable redirects from any
inactive MGR instance to the active MGR instance.

Signed-off-by: Patrick Nawracay <pnawracay@suse.com>

mgr/dashboard_v2: Updated README.rst, added HACKING.rst

Moved developer-related documentation from `README.rst` to a
new file `HACKING.rst`.

Converted `frontend/README.md` to ReST and merged it into `HACKING.rst`.

Added updates to the README provided by @rjfd in PR#83
(updated the whole unit tests content to match the latest changes
on unit test execution, updated the development notes about
controller development)

Signed-off-by: Lenz Grimmer <lgrimmer@suse.com>

mgr/dashboard_v2: adapt pool detail with cache view component

This modifies how pool detail show the cache information to the user
and implements a continuous update of the images information.

Signed-off-by: Tiago Melo <tmelo@suse.com>

mgr/dashboard_v2: add view cache component

This component should be used in components that access endpoints
that implement ViewCache.
It will inform the user if the data is stale or if there were some
problems fetching it.

Signed-off-by: Tiago Melo <tmelo@suse.com>

mgr/dashboard_v2: fix visibility of frontend class properties

Signed-off-by: Ricardo Dias <rdias@suse.com>

mgr/dashboard_v2: add node as a local dependency

This will allow us to use the angular cli on systems that don't have node
v6.9.0 or higher installed.

Signed-off-by: Tiago Melo <tmelo@suse.com>

mgr/dashboard_v2: Highlight clickable datatable rows.

Signed-off-by: Volker Theile <vtheile@suse.com>

mgr/dashboard_v2: Add RGW page.

Signed-off-by: Volker Theile <vtheile@suse.com>

mgr/dashboard_v2: Update documentation

* Nested Controllers
* How to use RESTController

Signed-off-by: Patrick Nawracay <pnawracay@suse.com>

mgr/dashboard_v2: Easy table cell transformation

The table column definition is extended by "cellTransformation"
property, which is filled through the use of "CellTemplate" enum.
If you have set that, a specific template reference will be used for
the ngx column property "cellTemplate". All references are stored
at the bottom of the data table template.

Signed-off-by: Stephan Müller <smueller@suse.com>

mgr/dashboard_v2: fix frontend bug in table.component.hml

Signed-off-by: Ricardo Dias <rdias@suse.com>

mgr/dashboard_v2: Use datatable on Cluster/Hosts page.

Signed-off-by: Volker Theile <vtheile@suse.com>

mgr/dashboard_v2: Fix linting errors

Supposed to be squashed with 5236e6168d763c8b40742c33ffb0ebe8e55ce6e8.

Signed-off-by: Patrick Nawracay <pnawracay@suse.com>

mgr/dashboard_v2: Add support for nested controllers

The `ApiController` decorator is used to define a API endpoints.  This
change will enable to use `/` in paths, so that nested controllers can
be used.

Signed-off-by: Patrick Nawracay <pnawracay@suse.com>

mgr/dashboard_v2: Add cdPasswordButton directive

Signed-off-by: Volker Theile <vtheile@suse.com>

mgr/dashboard_v2: Let the pagination input field look nicer

Signed-off-by: Volker Theile <vtheile@suse.com>

mgr/dashboard_v2: table component style improvements

Signed-off-by: Ricardo Marques <rimarques@suse.com>

mgr/dashboard_v2: Add block pools page

Signed-off-by: Ricardo Marques <rimarques@suse.com>

mgr/dashboard_v2: add health page and its dependencies

Signed-off-by: Tiago Melo <tmelo@suse.com>

mgr/dashboard_v2: adaptation of dashboard RemoteViewCache as a decorator

We implemented a decorator called `ViewCache` that implements a similar
functionality as the dashboard `RemoteViewCache` class.
We even copied part of the code and adapted to the current
infrastructure.

Signed-off-by: Ricardo Dias <rdias@suse.com>

mgr/dashboard_v2: clean rados connection on shutdown

Signed-off-by: Ricardo Dias <rdias@suse.com>

mgr/dashboard_v2: Fix copy-webpack-plugin version

Signed-off-by: Ricardo Dias <rdias@suse.com>

mgr/dashboard_v2: removed mock classes, unit tests now run against real cluster

We changed tox.ini to run a vstart.sh cluster and run the unit tests
against that cluster. All unit tests code was adapted to make requests
to the real dashboard_v2 backend using the `requests` python library

Signed-off-by: Ricardo Dias <rdias@suse.com>

mgr/dashboard_v2: add more debug message to tools.py

Signed-off-by: Ricardo Dias <rdias@suse.com>

mgr/dashboard_v2: Added coverage tracking to module code

This will allow to collect code coverage information when the module
is running within the ceph-mgr daemon.

Signed-off-by: Ricardo Dias <rdias@suse.com>

mgr/dashboard_v2: Migrate RGW daemon REST resource

Signed-off-by: Patrick Nawracay <pnawracay@suse.com>

mgr/dashboard_v2: force whitespace in imports list

Signed-off-by: Tiago Melo <tmelo@suse.com>

mgr/dashboard_v2: add style guide to the frontend README

Add a README section for style guide where it mentions how to organize
the typescript imports.

Signed-off-by: Tiago Melo <tmelo@suse.com>

mgr/dashboard_v2: decrease max-line-length to 100

Signed-off-by: Tiago Melo <tmelo@suse.com>

mgr/dashboard_v2: add tslint no-consecutive-blank-lines rule

Signed-off-by: Tiago Melo <tmelo@suse.com>

mgr/dashboard_v2: add some eslint rules to tslint

Signed-off-by: Tiago Melo <tmelo@suse.com>

mgr/dashboard_v2: add tslint import linting rule

Signed-off-by: Tiago Melo <tmelo@suse.com>

mgr/dashboard_v2: add missing codealizer recommended rules

Signed-off-by: Tiago Melo <tmelo@suse.com>

mgr/dashboard_v2: Add table component

The current implementation isn't finished yet, but it's a start.

The ngx-datatable is used as the core of the table component. You can
use the table to show data in a table. You can search, paginate, sort,
refresh the table contents. Multi selection is possible, the details
of the selected items will be given to the specified detail component.

What will be fixed soon?
* Enable the usage of buttons in the table header
* Enable details inline not beneath the table
* Pagination to use a input field to switch pages
* The columns to show can be checked and predefined
* The selection made by the user will be saved in the local storage

Signed-off-by: Stephan Müller <smueller@suse.com>
Signed-off-by: Tiago Melo <tmelo@suse.com>