rpm: mark mgr plugins "noarch"

as they are architecture independent.

Signed-off-by: Kefu Chai <kchai@redhat.com>

debian: s|lib/ceph/mgr|share/ceph/mgr|

as the mgr plugins are installed into $prefix/share/ceph/mgr now.

Signed-off-by: Kefu Chai <kchai@redhat.com>

rpm: s|lib/ceph/mgr|share/ceph/mgr|

as the mgr plugins are installed into $prefix/share/ceph/mgr now.

Signed-off-by: Kefu Chai <kchai@redhat.com>

cmake: rename CMAKE_INSTALL_{FULL_}?PKGLIBDIR

rename CMAKE_INSTALL_{FULL_}?PKGLIBDIR to
CEPH_INSTALL_{FULL_}?PKGLIBDIR. in order to differentiate them from the
paths not ended with "ceph".

Signed-off-by: Kefu Chai <kchai@redhat.com>

cmake: install mgr plugins into $prefix/share/ceph

as mgr plugins are architecture independent source files. see also
/usr/share/cmake-*/

Signed-off-by: Kefu Chai <kchai@redhat.com>

cmake: move install(.. ./mgr) down to mgr

this helps to modularize the CMakeLists.txt

Signed-off-by: Kefu Chai <kchai@redhat.com>

Merge pull request #26437 from tspmelo/wip-npm-update-19-2

mgr/dashboard: Update npm packages

Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>

Merge pull request #26429 from rhcs-dashboard/fix-toast-notifications

mgr/dashboard: fix: toast notifications hiding utility menu

Reviewed-by: Sebastian Krah <skrah@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>

Merge pull request #26334 from votdev/fix_typo

mgr/dashboard: Fix typo in NoOrchesrtatorConfiguredException class name

Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>

mgr/dashboard: Update prettier to 1.16

Signed-off-by: Tiago Melo <tmelo@suse.com>

mgr/dashboard: Update npm packages

Signed-off-by: Tiago Melo <tmelo@suse.com>

Merge pull request #26375 from dzafman/wip-38034

pg stuck in backfill_wait with plenty of disk space

Reviewed-by: Neha Ojha <nojha@redhat.com>

Merge PR #26238 into master

* refs/pull/26238/head:
mds: resolve memory leak of recall gather

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Zheng Yan <zyan@redhat.com>

Merge PR #26374 into master

* refs/pull/26374/head:
mds: fix potential re-evaluate stray dentry in _unlink_local_finish

Reviewed-by: Zheng Yan <zyan@redhat.com>

Merge PR #26394 into master

* refs/pull/26394/head:
mds: remove superfluous cap sequence increment
mds: fix MDCache::finish_snaprealm_reconnect()

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

osd: Fix the problem by rechecking backfill status each time
a RemoteReservationRevoked message is received, so we can
restart the backfill process in a more safe and less-likely raced way.

Fixes: http://tracker.ceph.com/issues/38034
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>

Revert "osd: Handle getting RecoveryDone while in RepWaitBackfillReserved"

This reverts commit 83c2521a5316c922875746a40b95100b62865e67.

This original fix handled the race by accepting the RecoveryDone
while in RepWaitBackfillReserved by going to RepNotRecovering.
Once we weren't crashing OSDs, none of the tests at the time
detected that backfill was actually hung.

Signed-off-by: David Zafman <dzafman@redhat.com>

Merge pull request #26371 from dzafman/wip-38262

test: run-standalone.sh: point LD_LIBRARY_PATH to $(pwd)/lib

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #26297 from s0nea/wip-dashboard-readonly-config-options

mgr/dashboard: disallow editing read-only config options

Reviewed-by: Sebastian Krah <skrah@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>

Merge pull request #26316 from wjwithagen/wjw-fix-FindStdFilesystem

cmake: Make the tests for finding Filesystem with more serious functions

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge PR #26063 into master

* refs/pull/26063/head:
ceph: omit hidden commands from suggestions

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #26413 from liewegas/wip-38282

osd: fix build_incremental_map_msg

Reviewed-by: David Zafman <dzafman@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #26420 from tchaikov/wip-pgmap-more-includes

mon/PGMap: add more #include

Reviewed-by: Neha Ojha <nojha@redhat.com>

mgr/dashboard: fix: toast notifications hiding utility menu

* Fixed margin-top taking into account responsiveness.
* dropdown-menu class: set z-index to avoid notification
  hiding dropdown menus when menu item clicked.

Fixes: https://tracker.ceph.com/issues/38313
Signed-off-by: Alfonso Martínez <almartin@redhat.com>

cmake: Make the tests for finding Filesystem with more serious functions

Otherwise it is linked agains lc++ on FreeBSD,a dn that will satisfy both
tested libraries.

Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>

Merge pull request #26085 from tspmelo/wip-dashboard-nfs

mgr/dashboard: NFS management UI

Reviewed-by: Ricardo Dias <rdias@suse.com>

Merge pull request #26149 from votdev/improve_get_typed_config

mgr: Improve ActivePyModules::get_typed_config implementation

Reviewed-by: Boris Ranto <branto@redhat.com>
Reviewed-by: Mykola Golub <mgolub@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #26407 from votdev/rgw_column_style

mgr/dashboard: Sync column style with the rest of the UI

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>

Merge pull request #25963 from smithfarm/wip-python-dep-cleanup

rpm: make Python dependencies somewhat less confusing

Reviewed-by: Tim Serong <tserong@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #26421 from b-ranto/wip-rest-fix

restful: Fix regression when traversing leaf nodes

Reviewed-by: Kefu Chai <kchai@redhat.com>

mgr/dashboard: Add UI for NFS Form

Signed-off-by: Tiago Melo <tmelo@suse.com>

mgr/dashboard: Add UI for NFS List and Detail

Signed-off-by: Tiago Melo <tmelo@suse.com>

mgr/dashboard: Add NFS frontend services

Signed-off-by: Tiago Melo <tmelo@suse.com>

Merge pull request #26410 from tspmelo/wip-bootstrap-3.4.1

mgr/dashboard: Update bootstrap to v3.4.1

Reviewed-by: Stephan Müller <smueller@suse.com>

Merge pull request #26409 from rhcs-dashboard/fix-tox-ini

mgr/dashboard: fix: tox not detecting deps changes

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>

mgr/dashboard: Fix typo in NoOrchesrtatorConfiguredException class name

Signed-off-by: Volker Theile <vtheile@suse.com>

restful: Fix regression when traversing leaf nodes

The commit 23b6c90 introduced a regression when traversing leaf nodes.
The issue is that it traverses the keys of a `dict` returned by
`nodes_by_id`, not the actual `items` of the node. That resulted in an
500 error because it tried to treat `str` as a `dict` and failed.

Signed-off-by: Boris Ranto <branto@redhat.com>

rpm: move Python deps out of distro-conditional blocks

The python%{_python_buildid}-bcrypt and python%{_python_buildid}-requests RPMs
are identically named across all the RPM distros, so move them out of the
distro conditional blocks.

Signed-off-by: Nathan Cutler <ncutler@suse.com>

rpm: make Python build deps somewhat less confusing

Signed-off-by: Nathan Cutler <ncutler@suse.com>

mon/PGMap: add more #include

* common/Clock.h for ceph_clock_now()
* global/global_context.h for g_conf()

Signed-off-by: Kefu Chai <kchai@redhat.com>

Merge pull request #26210 from falcon78921/wip-mgr-restful-python3

mgr/restful: updated string formatting to str.format()

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #26315 from tchaikov/wip-fix-Waddress-of-packed-member

msg/msg_types.h: do not cast `ceph_entity_name` to `entity_name_t` for printing

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>

Merge pull request #26380 from tchaikov/wip-split-dashboard-package

deb,rpm,qa: split dashboard package

Reviewed-by: Tim Serong <tserong@suse.com>
Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #26419 from cyx1231st/wip-fix-echo

test/crimson: fixes of unittest_seastar_echo

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #25989 from votdev/feature_36488

mgr/dashboard: Add UI to configure the telemetry mgr plugin

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Patrick Nawracay <pnawracay@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>

Merge pull request #26398 from SUSE/wip-fix-spec-badness

ceph.spec.in: Don't use noarch for mgr module subpackages, fix /usr/lib64/ceph/mgr dir ownership

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #26393 from zmc/wip-rhel7-deps

install-deps.sh: Fixes for RHEL 7

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #26411 from liewegas/wip-remove-smart

mgr/smart: remove obsolete smart module

Merge PR #26389 into master

* refs/pull/26389/head:
message/MMonMgrReport: conditionally reencode PGMapDigest
qa/suites/upgrade/luminous-x/parallel: enable all classes
qa/suites/upgrade/luminous-x/parallel/5-final-workload/rados_mon_thrash: use x branch
qa/suites/upgade/luminous-x: pglog_hardlimit succeeds now on luminous due to backport
mgr/DaemonServer: use a luminous-compatible 'mgr metadata' command
mgr/Mgr: print bad (non-object) json
qa/suites/upgrade/luminous-x/stress-split: mons on separate hosts, enable msgr2
qa/suites/upgrade/luminous-x/parallel: mon per host, msgr2
qa/suites/upgrade/luminous-x: whitelist 'slow request'
mon/HealthMonitor: add mon_warn_on_msgr2_not_enabled

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>

osd: fix build_incremental_map_msg

We need to fall back to an old map if since (the peer's epoch) is *older*
than our oldest.  If it's newer, we have it, and can just send
incrementals.

Fixes: http://tracker.ceph.com/issues/38282
Signed-off-by: Sage Weil <sage@redhat.com>

message/MMonMgrReport: conditionally reencode PGMapDigest

The encoding changed between luminous and mimic.  Reencode the
structure if the target doesn't have all the features.

Fixes: http://tracker.ceph.com/issues/38295
Signed-off-by: Sage Weil <sage@redhat.com>

qa/suites/upgrade/luminous-x/parallel: enable all classes

Otherwise it's annoying because the class list changes between luminous and nautilus,
and we don't want to futz around with changing this setting during the upgrade.

The problematic classes are 'cas' (added) and 'sdk' (not enabled by default but
included by the cls/ workunit.

Signed-off-by: Sage Weil <sage@redhat.com>

qa/suites/upgrade/luminous-x/parallel/5-final-workload/rados_mon_thrash: use x branch

The luminous version is (1) not what we want and (2) will fail because
ceph_test_rados_api_tier no longer exists in master.

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #26397 from guits/guits-fix_ceph-volume

ceph-volume: update testing playbook 'deploy.yml'

Reviewed-by: Andrew Schoen <aschoen@redhat.com>

mgr/smart: remove

This is obsolete and replaced by the devicehealth module.

Signed-off-by: Sage Weil <sage@redhat.com>

mgr/restful: updated string formatting to str.format()

Made changes per @tchaikov's request

Signed-off-by: James McClune <jmcclune@mcclunetechnologies.net>

qa/suites/upgade/luminous-x: pglog_hardlimit succeeds now on luminous due to backport

Signed-off-by: Sage Weil <sage@redhat.com>

mgr/DaemonServer: use a luminous-compatible 'mgr metadata' command

In luminous it was 'id', in mimic it changed to 'who'.

Signed-off-by: Sage Weil <sage@redhat.com>

mgr/Mgr: print bad (non-object) json

Signed-off-by: Sage Weil <sage@redhat.com>

qa/suites/upgrade/luminous-x/stress-split: mons on separate hosts, enable msgr2

Signed-off-by: Sage Weil <sage@redhat.com>

qa/suites/upgrade/luminous-x/parallel: mon per host, msgr2

- mon per host
- enable msgr2 at the end
- include the nautilus.yaml

Signed-off-by: Sage Weil <sage@redhat.com>

msg/msg_types.h: do not cast `ceph_entity_name` to `entity_name_t` for printing

in GCC-9, `-Waddress-of-packed-member` is enabled, so we have warnings like:

src/msg/msg_types.h:142:41: warning: converting a packed 'const
ceph_entity_name' pointer (alignment 1) to a 'const entity_name_t'
pointer (alignment 8) may result in an unaligned pointer value
[-Waddress-of-packed-member]
  142 |   return out << *(const entity_name_t*)&addr;
      |                                         ^~~~

since the alignment of these two structures are different, we cannot
cast a structure with the alignment of 1 to a structure with the
alignment of 8. as the code generated by compiler accessing the members
of alignment 8 won't work with the members of alignment 1, we need to
create a temporary structure for printing it.

Signed-off-by: Kefu Chai <kchai@redhat.com>

Merge pull request #26406 from drunkard/master

doc: typo fixes, s/Requered/Required/

Reviewed-by: Kefu Chai <kchai@redhat.com>

mgr/dashboard: Update bootstrap to v3.4.1

This update fixes an XSS vulnerability (CVE-2019-8331)

Signed-off-by: Tiago Melo <tmelo@suse.com>

mgr/dashboard: fix: tox not detecting deps changes

* tox.ini: replaced 'deps' setting by appropriate commands
  due to this bug:
  https://github.com/tox-dev/tox/issues/149
  tox is not detecting changes in requirements.txt when using
  'deps' setting in 'tox.ini'.

Signed-off-by: Alfonso Martínez <almartin@redhat.com>

Merge pull request #26325 from jtlayton/wip-jlayton-dashboard-orch

mgr/dashboard: use the orchestrator_cli backend setting

Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Volker Theile <vtheile@suse.com>

ceph: omit hidden commands from suggestions

Fixes: http://tracker.ceph.com/issues/37955
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>

mgr/dashboard: Sync column style with the rest of the UI

Center the checkbox in the column.

Signed-off-by: Volker Theile <vtheile@suse.com>

mgr/dashboard: disallow editing read-only config options

Fixes: https://tracker.ceph.com/issues/34528
Signed-off-by: Tatjana Dehler <tdehler@suse.com>

doc: typo fixes, s/Requered/Required/

Signed-off-by: Drunkard Zhang <gongfan193@gmail.com>

qa: exclude new packages when installing old versions

ceph-mgr-dashboard is introduced in nautilus, so exclude it when
installing old versions.

Signed-off-by: Kefu Chai <kchai@redhat.com>

rpm: split ceph-mgr-dashboard plugin into its own package

to make ceph-mgr-dashboard a separated package

- helps to reduce the repo size of downstream. because
  ceph-mgr-dashboard is an architecture independent package. by
  making it separated package avoids needless duplication of
  the same data in mutiple .debs.
- gives user a fine grained control of selection.

Signed-off-by: Kefu Chai <kchai@redhat.com>

Merge pull request #26390 from smithfarm/wip-doc-mgr-dashboard

doc: add Ceph Manager Dashboard to top-level TOC

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

qa/suites/upgrade/luminous-x: whitelist 'slow request'

The luminous warnings say slow request.

Signed-off-by: Sage Weil <sage@redhat.com>

mon/HealthMonitor: add mon_warn_on_msgr2_not_enabled

Default true, but allow users (or tests) to turn this warning off.

Signed-off-by: Sage Weil <sage@redhat.com>

Merge PR #26265 into master

* refs/pull/26265/head:
qa/suites/rados/upgrade: whitelist 'slow request'

Reviewed-by: Yuri Weinstein <yweins@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>

Merge PR #26366 into master

* refs/pull/26366/head:
os/filestore: ceph_abort() on fsync(2) or fdatasync(2) failure

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>

Merge PR #26369 into master

* refs/pull/26369/head:
ceph-mon: slightly more helpful output during mkfs

Reviewed-by: Neha Ojha <nojha@redhat.com>

Merge PR #26391 into master

* refs/pull/26391/head:
buffer: disable hypercombining in bufferlist.

Reviewed-by: Sage Weil <sage@redhat.com>

Merge PR #26392 into master

* refs/pull/26392/head:
messages/MMonMgrReport: fix compat decoding

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>

ceph-volume: update deploy.yml

update deploy.yml accordingly with recent changes in ceph-ansible.

Fixes: ceph/ceph-ansible#3602
Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>

ceph.spec.in: Make ceph-mgr own /usr/lib64/ceph/mgr directory

Without this, no package actually owns the /usr/lib64/ceph/mgr directory
so the build fails with "directories not owned by a package" errors for
ceph-mgr, ceph-mgr-diskprediction-local, ceph-mgr-diskprediction-cloud
and ceph-mgr-rook.

Signed-off-by: Tim Serong <tserong@suse.com>

ceph.spec.in: Don't use noarch for ceph-mgr module subpackages

Even though ceph-mgr modules are notionally non-architecture-specific,
the files themselves are installed to an architecture-specific path
(/usr/lib64/ceph/mgr/....), which causes the build to fail on SUSE
distros with a huge long list of errors like:

ceph-mgr-diskprediction-cloud.noarch: E: suse-filelist-forbidden-noarch
(Badness: 10000) /usr/lib64/ceph/mgr/diskprediction_cloud is not
allowed in a noarch package
[...]
(none): E: badness 1120287 exceeds threshold 1000, aborting.

Signed-off-by: Tim Serong <tserong@suse.com>

Merge pull request #26367 from tspmelo/wip-iscsi-edit-ui

mgr/dashboard: Add iSCSI Target Edit UI

Reviewed-by: Ricardo Marques <rimarques@suse.com>

Merge pull request #26346 from noahdesu/mgr-orch-cache-refresh

mgr/orch: refresh option for inventory query

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>

Merge pull request #26357 from rjfd/wip-orch-fix-dev-pretty-print

mgr/orchestrator: fix device pretty print with None attributes

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>

Merge pull request #26384 from tspmelo/wip-e2e-login

mgr/dashboard: Add implicit wait in e2e tests

Reviewed-by: Laura Paduano <lpaduano@suse.com>

debian: split ceph-mgr-dashboard plugin into its own package

to make ceph-mgr-dashboard a separated package

- helps to reduce the repo size of downstream. because
  ceph-mgr-dashboard is an architecture independent package. by
  making it separated package avoids needless duplication of
  the same data in mutiple .debs.
- gives user a fine grained control of selection.

Signed-off-by: Kefu Chai <kchai@redhat.com>

Merge pull request #26379 from tchaikov/wip-remove-jinja2

rpm,deb: remove python-jinja2 dependency

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Ken Dreyer <kdreyer@redhat.com>

mds: remove superfluous cap sequence increment

"cap->issue_norevoke(cap->issued())" was introduced by commit
10b1a5663f5 "mds: share inode max size after MDS recovers".
It is no longer required since commit 77515b7a3c7 "mds: increase
cap sequence when sharing max size"

Signed-off-by: "Yan, Zheng" <zyan@redhat.com>

mds: fix MDCache::finish_snaprealm_reconnect()

It creates MClientSnap message, but does not send it to client

Signed-off-by: "Yan, Zheng" <zyan@redhat.com>

crimson/net: msgr default to v1 in test_alien_echo

Signed-off-by: Yingxin Cheng <yingxincheng@gmail.com>

crimson/net: fix nonce setting in test_alien_echo

Signed-off-by: Yingxin Cheng <yingxincheng@gmail.com>

crimson/net: fix var capture in test_alien_echo

Signed-off-by: Yingxin Cheng <yingxincheng@gmail.com>

install-deps.sh: Fixes for RHEL 7

Signed-off-by: Zack Cerza <zack@redhat.com>

mds: resolve memory leak of recall gather

Small change in behavior: after all clients respond to session flush, immediate
begin next recall instead of waiting a whole second.

Fixes: http://tracker.ceph.com/issues/38137
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>

mgr/dashboard: Add implicit wait in e2e tests

Fixes: https://tracker.ceph.com/issues/38269
Signed-off-by: Tiago Melo <tmelo@suse.com>

Merge PR #26385 into master

* refs/pull/26385/head:
mon: mons also connect to mgrs

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: João Eduardo Luís <joao@suse.de>

messages/MMonMgrReport: fix compat decoding

Broken by 08d1a6fc3c57ccbeb6dff8fce1aae429edca97f3

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #26377 from tchaikov/wip-mgr-plugin-arch-all

debian/control: change Architecture python plugins to "all"