msg/async: clean up code.

Currently, function submit_message only used by send_to, so conbine
them to one.

Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>

Merge PR #30871 into master

* refs/pull/30871/head:
mgr/telemetry: include balancer info (active=true/false, mode)
mgr/telemetry: include per-pool pg_autoscale info

Reviewed-by: Dan Mick <dmick@redhat.com>

Merge PR #30836 into master

* refs/pull/30836/head:
osd/PeeringState: send pg_info2 if release >= octopus

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>

Merge PR #30872 into master

* refs/pull/30872/head:
qa: more tries for mon tell when injecting msgr failures
qa/suites/rados/singleton*: symlink to same msgr-failures

Reviewed-by: Neha Ojha <nojha@redhat.com>

qa: more tries for mon tell when injecting msgr failures

With failure injection the default 2 tries isn't quite enough

Signed-off-by: Sage Weil <sage@redhat.com>

Merge PR #30734 into master

* refs/pull/30734/head:
mgr/ssh: pass crash agent keyring to deploy
ceph-daemon: deploy: require crash_keyring too
ceph-daemon: deploy crash unit on local host during bootstrap
ceph-daemon: create crash dir and pass through to daemon containers
ceph-crash: try to post as either client.crash[.$hostname] or client.admin
mon/MonCap: add 'crash' profile

Reviewed-by: Dan Mick <dmick@redhat.com>

Merge PR #30819 into master

* refs/pull/30819/head:
mgr/pg_autoscaler: complete event if pool disappears

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge PR #30781 into master

* refs/pull/30781/head:
cmake: detect linker support

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge PR #30753 into master

* refs/pull/30753/head:
os/bluestore: set STATE_KV_SUBMITTED properly.

Reviewed-by: Sage Weil <sage@redhat.com>

qa/suites/rados/singleton*: symlink to same msgr-failures

Signed-off-by: Sage Weil <sage@redhat.com>

mgr/telemetry: include balancer info (active=true/false, mode)

Signed-off-by: Sage Weil <sage@redhat.com>

mgr/telemetry: include per-pool pg_autoscale info

Mode and target size

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #30694 from rjfd/wip-dashboard-fix-translations

mgr/dashboard: internationalization support with AOT enabled

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>

Merge pull request #30522 from rhcs-dashboard/fix-41990-master

mgr/dashboard: add debug mode

Merge pull request #30789 from s0nea/wip-dashboard-exception-errorcodes

mgr/dashboard: fix existing issues in user integration tests

Reviewed-by: Stephan Müller <smueller@suse.com>

Merge pull request #30864 from s0nea/wip-dashboard-comment-failing-suites-out

mgr/dashboard: comment failing QA suites out

Ricardo Dias <rdias@suse.com>

Merge pull request #30847 from rhcs-dashboard/fix-42268-master

mgr/dashboard: fix typos in HACKING.rst

Reviewed-by: Ricardo Marques <rimarques@suse.com>

Merge pull request #26146 from snijhuis/master

mgr: zabbix triggers never triggered due to wrong trigger function

Reviewed-by: Wido den Hollander <wido@42on.com>
Reviewed-by: Dmitriy Rabotjagov <noonedeadpunk@ya.ru>

mgr/dashboard: fix typos in HACKING.rst

Fixes: https://tracker.ceph.com/issues/42268
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>

mgr/dashboard: comment questionable suites out

We're currently facing some issues with our integration
tests. Because of that we agreed on commenting questionable
suites out to be able to run all other suites on open pull
requests.

'test_health' and 'test_perf_counters' are commented out
because they led to issues in relation to
https://tracker.ceph.com/issues/41538
As soon as the issue has been fixed, we need to re-add
these two suites again.

Signed-off-by: Tatjana Dehler <tdehler@suse.com>

mgr/dashboard: sort QA suites alphabetically

Sort QA suites alphabetically to recognize a missing
suite faster.

Signed-off-by: Tatjana Dehler <tdehler@suse.com>

mgr/dashboard: wait a moment after module load

After a dashboard module load we need to wait (10 secs)
for the module to be back again. Otherwise the module
might not be able to answer requests properly. It could
lead to issues in some cases, e.g.: 'Failed to establish
a new connection: [Errno 111] Connection refused'.

Signed-off-by: Tatjana Dehler <tdehler@suse.com>

mgr/dashboard: reset login to admin user

After logging in with a separate testuser, especially a read-only
user, we need to reset the login to the admin user. This is important
in order to be able to continue with further tests. If not doing so
further tests might fail with the following error response:
{"status": "401 Unauthorized",
 "detail": "You are not authorized to access that resource", ...}

Fixes: https://tracker.ceph.com/issues/42226,
https://tracker.ceph.com/issues/42227
Signed-off-by: Tatjana Dehler <tdehler@suse.com>

mgr/dashboard: check for correct DashboardException error codes

We need to check for the correct error codes.
Otherwise the integration tests are going to fail.

Fixes: https://tracker.ceph.com/issues/42222
Signed-off-by: Tatjana Dehler <tdehler@suse.com>

Merge pull request #30658 from ricardoasmarques/delete-item-name

mgr/dashboard: Provide the name of the object being deleted

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>

Merge pull request #30815 from ricardoasmarques/remove-unused-endpoint

mgr/dashboard: Remove unused RBD "configuration" endpoint

Reviewed-by: Stephan Müller <smueller@suse.com>

mgr/pg_autoscaler: complete event if pool disappears

Fixes: 091dc321b10c8432192a8f76823a0ea97096885d
Fixes: https://tracker.ceph.com/issues/42249
Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #30854 from dmick/wip-fix-dict-pop

mgr/telemetry: dict.pop() errs on nonexistent key

Merge PR #30494 into master

* refs/pull/30494/head:
cmake: Allow cephfs and ceph-mds to be build when building on FreeBSD

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge PR #30817 into master

* refs/pull/30817/head:
qa/suites/rados/thrash-old-clients: exclude ceph-daemon on nautilus installs

mgr/telemetry: dict.pop() errs on nonexistent key

I suggested this in a review, but failed to correctly understand
what happens when the key doesn't exist.  Test for it.

Signed-off-by: Dan Mick <dan.mick@redhat.com>

Merge pull request #30742 from croit/rgw-fix-max-concurrent-ios-docs

radosgw-admin: update help for max-concurrent-ios

Reviewed-by: Casey Bodley <cbodley@redhat.com>

mgr/dashboard: Allow I18N when using "ng serve"

"ng serve" doesn't support i18n flags, so we need to define all language
specific settings in angular.json.

Then we can use them with the configuration flag, p.e.:
"ng serve --configuration=pt-BR"

We can also use this configurations for non production build, p.e.:
"ng build --configuration=pt-BR"

Set some global options, that will be shared by all configurations.

Signed-off-by: Tiago Melo <tmelo@suse.com>

mgr/dashboard: frontend: default language option in environment

Signed-off-by: Ricardo Dias <rdias@suse.com>

mgr/dashboard: Only show available languages

Read locale from LOCALE_ID, this is defined during build.

Signed-off-by: Tiago Melo <tmelo@suse.com>

mgr/dashboard: endpoint to list available languages

Signed-off-by: Ricardo Dias <rdias@suse.com>

mgr/dashboard: Store selected language in cookies

This will allow the backend access to this information in all requests.

Signed-off-by: Tiago Melo <tmelo@suse.com>

mgr/dashboard: Provide TRANSLATIONS directly in app.module.ts

Remove LOCALE_ID from provide list, since this is now defined during build.

Signed-off-by: Tiago Melo <tmelo@suse.com>

mgr/dashboard: Remove missing translation warnings during build

Signed-off-by: Tiago Melo <tmelo@suse.com>

mgr/dashboard: Remove support for older browsers.

This will reduce in half the time needed to compile the frontend.

Signed-off-by: Tiago Melo <tmelo@suse.com>

mgr/dashboard: Remove call to registerLocalData

Since we configure the locale during the build phase,
there is no need to set it dynamically.

Signed-off-by: Tiago Melo <tmelo@suse.com>

mgr/dashboard: Remove I18N from main.ts

With AOT I18N there is no need to provide I18N from the main.ts file.

Signed-off-by: Tiago Melo <tmelo@suse.com>

make-dist: build dashboard frontend for each language

Signed-off-by: Ricardo Dias <rdias@suse.com>

dashboard: detect language and serve correct frontend app

Signed-off-by: Ricardo Dias <rdias@suse.com>

doc: new Dashboard Plugin: Debug

Fixes: https://tracker.ceph.com/issues/41990
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>

cmake: dashboard: support locale-dependent frontend builds

Fixes: https://tracker.ceph.com/issues/41988
Signed-off-by: Ricardo Dias <rdias@suse.com>

mgr/dashboard: frontend: add npm-run-all dependency

Signed-off-by: Ricardo Dias <rdias@suse.com>

mgr/dashboard: package.json: add build scripts for each language

Signed-off-by: Ricardo Dias <rdias@suse.com>

Merge pull request #26524 from linuxbox2/wip-lc-days-0

rgw: lifecycle days may be 0

Merge pull request #30735 from yuvalif/fix_race_condition_in_amqp_test

rgw/amqp: fix race condition in AMQP unit test

Merge pull request #30725 from smithfarm/wip-more-cbs-2

ceph-backport.sh: automate setting of milestone and component label, implement --version option

Reviewed-by: Jan Fajerski <jfajerski@suse.com>

ceph-backport.sh: do not say "1 commits"

Signed-off-by: Nathan Cutler <ncutler@suse.com>

ceph-backport.sh: correctly add note to backport tracker

Before this commit, the JSON was wrong and Redmine silently ignored the note.

Signed-off-by: Nathan Cutler <ncutler@suse.com>

ceph-backport.sh: set SCRIPT_VERSION using --update-version

Signed-off-by: Nathan Cutler <ncutler@suse.com>

ceph-backport.sh: implement --update-version and --version options

--update-version (intended for use by script maintainer only) will derive
version number from the output of "git describe" and set the SCRIPT_VERSION
variable inside the script.

--version will display a version number message and exit immediately thereafter.

Signed-off-by: Nathan Cutler <ncutler@suse.com>

ceph-backport.sh: guess component label

If component label is not provided explicitly on the command line, attempt to
guess it.

Signed-off-by: Nathan Cutler <ncutler@suse.com>

Merge pull request #29447 from rafaelquint/osdtest2

mgr/dashboard: Verify fields on OSDs page

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>

mgr/dashboard: log request uuid

Fixes: https://tracker.ceph.com/issues/41990
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>

mgr/dashboard: add Debug plugin

Fixes: https://tracker.ceph.com/issues/41990
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>

mgr/dashboard: add new plugin hooks

New plugin hooks are: `init` and `update_cherrypy_config`.

Fixes: https://tracker.ceph.com/issues/41990
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>

mgr/dashboard: doc plugin infra changes

Fixes: https://tracker.ceph.com/issues/41990
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>

mgr/dashboard: add SimplePlugin helper

Helper added to simplify common tasks when creating a new plugin
(OPTIONS, COMMANDS, etc).

Fixes: https://tracker.ceph.com/issues/41990
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>

mgr/dashboard: add new interfaces to plugin

New plugin Mixins (`CanCherrypy`) and Interfaces (`Initializable`,
`ConfiguresCherryPy`) have been added to plugin interfaces.

Fixes: https://tracker.ceph.com/issues/41990
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>

mgr/dashboard: add Mixins and @final to plugins

Fixes: https://tracker.ceph.com/issues/41990
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>

Merge pull request #30400 from rhcs-dashboard/fix-41867-master

mgr: change perf-counter precision to float

Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>

Merge pull request #30814 from Devp00l/wip-42077

mgr/dashboard: Fixes random cephfs tab test failure

Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Patrick Nawracay <pnawracay@suse.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>

Merge pull request #30834 from tchaikov/wip-crimson/pg-lease

crimson/osd: should handle pg_lease messages

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

osd/PeeringState: send pg_info2 if release >= octopus

in octopus, we start using pg_info2 instead of pg_info. the latter is
being deprecated.

Signed-off-by: Kefu Chai <kchai@redhat.com>

mgr/dashboard: Remove unused RBD "configuration" endpoint

Signed-off-by: Ricardo Marques <rimarques@suse.com>

mgr: add new Command helper

Fixes: https://tracker.ceph.com/issues/41990
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>

mgr/dashboard: Fixes random cephfs tab test failure

Fixes: https://tracker.ceph.com/issues/42077
Signed-off-by: Stephan Müller <smueller@suse.com>

rgw/amqp: fix race condition in AMQP unit test

Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>

crimson/osd: always init BufferedRecoveryMessages w/ octopus

we don't need to be compatible with pre-octopus releases

Signed-off-by: Kefu Chai <kchai@redhat.com>

crimson/osd: use in-class initialization to init member variables

for better readability

Signed-off-by: Kefu Chai <kchai@redhat.com>

crimson/osd: should handle pg_lease and pg_lease_ack

Signed-off-by: Kefu Chai <kchai@redhat.com>

Merge pull request #30787 from zhangdaolong/master

doc, qa: remove invalid option mon_pg_warn_max_per_osd

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge PR #30724 into master

* refs/pull/30724/head:
mgr/telemetry: bump content revision and add a release note
telemetry/server: add device report endpoint
mgr/telemetry: include device telemetry
mgr/devicehealth: factor _get_device_metrics out of show_device_metrics
mgr/devicehealth: pull out MAX_SAMPLES

Reviewed-by: Dan Mick <dmick@redhat.com>

mgr/telemetry: bump content revision and add a release note

Signed-off-by: Sage Weil <sage@redhat.com>

telemetry/server: add device report endpoint

Add a standalone endpoint to report device telemetry.

Signed-off-by: Sage Weil <sage@redhat.com>

mgr/telemetry: include device telemetry

- anonymize device id
- anonymize host names
- strip out the serial number

Signed-off-by: Sage Weil <sage@redhat.com>

Merge PR #30809 into master

* refs/pull/30809/head:
qa: tolerate ECONNRESET errcode during logrotate

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge PR #30738 into master

* refs/pull/30738/head:
mgr/alerts: raise health alert if smtplib has a problem
mgr/alerts: simple module to send health alerts

Reviewed-by: Tim Serong <tserong@suse.com>

Merge pull request #30793 from ricardoasmarques/rbd-parent-namespace

pybind/rbd: parent_info should return pool namespace

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

qa/suites/rados/thrash-old-clients: exclude ceph-daemon on nautilus installs

i did the original addition by grepping for ceph-mgr-ssh, but that's
included in nautilus so I missed this one!

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #30800 from liewegas/wip-container-image

common: rename 'image' to 'container_image'

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #30619 from dang/wip-dang-zipper-2

rgw: Project Zipper - Bucketlist

Merge pull request #30811 from rzarzynski/wip-script-run-cbt-on-classical

script/run-cbt.sh: add support for ceph-osd testing.

Reviewed-by: Kefu Chai <kchai@redhat.com>

script/run-cbt.sh: add support for ceph-osd testing.

The patch brings `--classical` switch to the `run-cbt.sh`
script. Its purpose is to automate the apple-to-apple
comparison between OSD implementations. In both cases
memstore is selected and the same benchmarks are used.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

Merge pull request #30747 from rjfd/wip-dashboard-task-controller-race

mgr/dashboard: tasks: only unblock controller thread after TaskManager thread

Reviewed-by: Patrick Seidensal <pnawracay@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>

qa: tolerate ECONNRESET errcode during logrotate

Fixes: http://tracker.ceph.com/issues/41800
Signed-off-by: Venky Shankar <vshankar@redhat.com>

pybind/rbd: deprecate `parent_info`

`parent_info` is not returning the parent pool namespace
so `get_parent_image_spec` should be used instead.

Signed-off-by: Ricardo Marques <rimarques@suse.com>

doc, qa:remove invalid option mon_pg_warn_max_per_osd

The older mon_pg_warn_max_per_osd option has been removed in v12.2.1 Luminous
https://ceph.com/releases/v12-2-1-luminous-released/

Fixes: https://tracker.ceph.com/issues/42221
Signed-off-by: zhang daolong <zhangdaolong@fiberhome.com>

Merge pull request #30682 from badone/wip-bz1749874-pid-in-large-omap-log

osd/PG: Add PG to large omap log message

Reviewed-by: Vikhyat Umrao <vikhyat@redhat.com>

Merge pull request #30645 from tchaikov/wip-doc/man/ceph/config

doc/man/ceph: document 'ceph config'

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>

Merge pull request #30250 from tchaikov/wip-do-cmake.sh

do_cmake.sh: remove -DCMAKE_BUILD_TYPE=Debug from cmake options

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

Merge pull request #30799 from badone/wip-change-cmake-to-debug-default

cmake: Do a debug build by default

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #30794 from rzarzynski/wip-test-cbt-randread

test/crimson: cbt test does rand-reads instead of seq-reads.

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #30726 from tchaikov/wip-musl-alphine

test: define ALLPERMS if not yet

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>

do_cmake.sh: remove -DCMAKE_BUILD_TYPE=Debug from cmake options

so we can use do_cmake.sh for building release builds, which are
required for performance tests.

Signed-off-by: Kefu Chai <kchai@redhat.com>

cmake: Do a debug build by default

Signed-off-by: Brad Hubbard <bhubbard@redhat.com>