auth: EACCES, not EPERM

EPERM means an operation requires superuser; EACCES more generally means
permission denied.  We use EACCES elsewhere for ceph auth denials; use it
here too for consistency.  This fixes qa/workunits/mon/caps.sh.

Signed-off-by: Sage Weil <sage@redhat.com>

mon: shunt old tell commands from cli interface to asok

Pre-octopus clients will send tell commands as CLI commands.  Explicitly
identify those and send them to the asok infrastructure.

Signed-off-by: Sage Weil <sage@redhat.com>

mon: allow mgr to tell mon.foo smart

The mgr profile needs to do a tell command to the mon, which was restricted
to *only* allow_all (*) caps.  Additionally allow whitelisted commands,
and whitelist 'smart'.  This is somewhat imprecise since it conflates
tell vs cli commands in the MonCap, but since those don't overlap it should
be fine.

Signed-off-by: Sage Weil <sage@redhat.com>

mon: include quorum features in quorum_status

This is part of mon_status, and qa/standalone/mon/misc.sh mon_features test
uses it.

Signed-off-by: Sage Weil <sage@redhat.com>

qa/workunits/mon/caps.sh: fix test

I'm not really sure why this test expected EPERM before when it expects 0
a bit earlier, but it should certainly expect EPERM after the user is
deleted.

Signed-off-by: Sage Weil <sage@redhat.com>

ceph_test_rados_api_cmd: fix MonDescribe test

Signed-off-by: Sage Weil <sage@redhat.com>

Merge branch 'vstart-fs-auth' of git://github.com/batrick/ceph into wip-cleanup-mon-asok

test/pybind/test_ceph_argparse: fix tests

These are now tell/asok commands.

Signed-off-by: Sage Weil <sage@redhat.com>

vstart: add volume client keys to keyring

Otherwise, ceph-fuse cannot find them!

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>

vstart: use fs authorize to create master client key

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>

vstart: redirect some output to stderr

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>

vstart: output command strings to stderr

This allows redirecting prun/prunb to a file without using another
function. Also, write to the terminal if stderr is redirected to give a
visual glimpse of vstart's progress.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #30595 from p-se/wip-pna-extend-smart-types

mgr/dashboard: extend types of `smart` response

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Volker Theile <vtheile@suse.com>

Merge pull request #30558 from dillaman/wip-41555

rbd-mirror: image status should report remote status

Reviewed-by: Mykola Golub <mgolub@suse.com>

Merge pull request #30671 from tspmelo/wip-i18n-vars

mgr/dashboard: Fix translation of variables

Reviewed-by: Patrick Seidensal <pnawracay@suse.com>

Merge pull request #30803 from cyx1231st/wip-seastar-msgr-failover

test/crimson: v2 failover tests with ack/keepalive

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #30779 from rhcs-dashboard/tox-ini-fixes

mgr/dashboard: tox.ini fixes

Reviewed-by: Ernesto Puertat <epuertat@redhat.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Patrick Seidensal <pseidensal@suse.com>

Merge pull request #30600 from yuvalif/boto3_extensions_examples

rgw/examples: adding examples for boto3 extensions to AWS S3

Merge pull request #30874 from uweigand/add-cycles-ibmz

Cycles: Add support for IBM Z

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge PR #30816 into master

* refs/pull/30816/head:
qa: use small default pg count for CephFS pools
*: remove config of "mon pg warn min per osd" in testing

Reviewed-by: Laura Paduano <lpaduano@suse.com>

Merge PR #30641 into master

* refs/pull/30641/head:
pybind/cephfs: add cephfs python API removexattr()

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Varsha Rao <varao@redhat.com>

Merge PR #30873 into master

* refs/pull/30873/head:
qa: get rid of iterkeys for py3 compatibility

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>

Merge PR #30744 into master

* refs/pull/30744/head:
mds: Reorganize class members in MDLog header

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge PR #30206 into master

* refs/pull/30206/head:
test: add test_statx for new statx()
client: add statx in cephfs.pyx

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>

Merge PR #29626 into master

* refs/pull/29626/head:
client: fix return code handling from _lseek

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>

Merge PR #30585 into master

* refs/pull/30585/head:
docs/cephfs-shell: update doc about pyscript
cephfs-shell: make compatible with cmd2 versions after 0.9.13

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Varsha Rao <varao@redhat.com>

qa: use small default pg count for CephFS pools

The pg count needs to be a power-of-two since
dff5697464edb9931d5dfa08cd4a30f85c1f237e.

Also, mon_pg_warn_min_per_osd is disabled by default now (or set to a
low value in vstart/testing) so there's no need to base the pg count on
this value.

Ideally someday we can remove this so that the default cluster value is
used but we need to keep this for deployments of older versions of Ceph.

Fixes: https://tracker.ceph.com/issues/42228
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>

rgw/examples: adding info on boto3 extensions to docs

Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>

Merge pull request #30830 from tchaikov/wip/rpm-install-deps/python_provide

install-deps, rpm: use python_provide macro and cleanups

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
Reviewed-by: Tim Serong <tserong@suse.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>

Merge pull request #30151 from ofriedma/wip-ofriedma-lc-twice

fix rgw lc does not delete objects that do not have exactly the same tags as the rule

Merge pull request #30723 from vumrao/wip-vumrao-42111

mon/OSDMonitor: add check for crush rule size in pool set size command

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #30706 from vshankar/wip-42169

mgr: missing lock release in DaemonServer::handle_report()

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #29908 from batrick/rhel7.7

qa: add RHEL 7.7 and use as RHEL7 default

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Yuri Weinstein <yweinste@redhat.com>

Merge pull request #30637 from dongbula/add-maxread-for-rados-listomapkeys

tools: add maxread in rados listomapkeys

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #30737 from tchaikov/wip-os/bluestore/cleanup

os/bluestore: cleanups

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Igor Fedotov <ifedotov@suse.com>

Merge pull request #30792 from kshtsk/wip-python3-no-iteritems-ceph-task

tasks/ceph: get rid of iteritems for python3

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge PR #30871 into master

* refs/pull/30871/head:
mgr/telemetry: include balancer info (active=true/false, mode)
mgr/telemetry: include per-pool pg_autoscale info

Reviewed-by: Dan Mick <dmick@redhat.com>

Merge PR #30836 into master

* refs/pull/30836/head:
osd/PeeringState: send pg_info2 if release >= octopus

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>

Merge PR #30872 into master

* refs/pull/30872/head:
qa: more tries for mon tell when injecting msgr failures
qa/suites/rados/singleton*: symlink to same msgr-failures

Reviewed-by: Neha Ojha <nojha@redhat.com>

qa/workunits/cephtool/test.sh: fix 'quorum enter' caller

Signed-off-by: Sage Weil <sage@redhat.com>

qa: change mon_status calls to quorum_status or tell commands

The tests were doing logs of 'ceph mon_status'; change that to
quorum_status or tell.

Signed-off-by: Sage Weil <sage@redhat.com>

mon: fix 'heap ...' command

Duplicate what the OSD is doing here.

Signed-off-by: Sage Weil <sage@redhat.com>

mon: consolidate 'sync force' commands

Replace the 'ceph [mon] sync force' commands and just use the asok
sync_force command instead.  This is a low-level command that nobody should
reasonsbly using except in an emergency, so do not bother with trying to
maintain compatibility; it's a bit rediculous that we had 3 variations of
this to being with!

Signed-off-by: Sage Weil <sage@redhat.com>

qa: more tries for mon tell when injecting msgr failures

With failure injection the default 2 tries isn't quite enough

Signed-off-by: Sage Weil <sage@redhat.com>

Cycles: Add support for IBM Z

Patch provided by Yaakov Selkowitz <yselkowi@redhat.com>.

Signed-off-by: Ulrich Weigand <ulrich.weigand@de.ibm.com>

qa: get rid of iterkeys for py3 compatibility

Fixes: https://tracker.ceph.com/issues/42287
Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@suse.com>

Merge PR #30734 into master

* refs/pull/30734/head:
mgr/ssh: pass crash agent keyring to deploy
ceph-daemon: deploy: require crash_keyring too
ceph-daemon: deploy crash unit on local host during bootstrap
ceph-daemon: create crash dir and pass through to daemon containers
ceph-crash: try to post as either client.crash[.$hostname] or client.admin
mon/MonCap: add 'crash' profile

Reviewed-by: Dan Mick <dmick@redhat.com>

Merge PR #30819 into master

* refs/pull/30819/head:
mgr/pg_autoscaler: complete event if pool disappears

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge PR #30781 into master

* refs/pull/30781/head:
cmake: detect linker support

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge PR #30753 into master

* refs/pull/30753/head:
os/bluestore: set STATE_KV_SUBMITTED properly.

Reviewed-by: Sage Weil <sage@redhat.com>

mon: allow asok commands to return an error code

Signed-off-by: Sage Weil <sage@redhat.com>

mon: move 'quorum enter|exit' and 'mon_status' to asok

Signed-off-by: Sage Weil <sage@redhat.com>

mon: fix 'smart' asok command

Move to the right function, registery, and remove from the CLI command registry.

Signed-off-by: Sage Weil <sage@redhat.com>

mon: remove old 'config set' and 'injectargs'

These are handled by the generic cct's asok commands.

Signed-off-by: Sage Weil <sage@redhat.com>

qa/suites/rados/singleton*: symlink to same msgr-failures

Signed-off-by: Sage Weil <sage@redhat.com>

mgr/telemetry: include balancer info (active=true/false, mode)

Signed-off-by: Sage Weil <sage@redhat.com>

mgr/telemetry: include per-pool pg_autoscale info

Mode and target size

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #30694 from rjfd/wip-dashboard-fix-translations

mgr/dashboard: internationalization support with AOT enabled

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>

Merge pull request #30522 from rhcs-dashboard/fix-41990-master

mgr/dashboard: add debug mode

Merge pull request #30789 from s0nea/wip-dashboard-exception-errorcodes

mgr/dashboard: fix existing issues in user integration tests

Reviewed-by: Stephan Müller <smueller@suse.com>

Merge pull request #30864 from s0nea/wip-dashboard-comment-failing-suites-out

mgr/dashboard: comment failing QA suites out

Ricardo Dias <rdias@suse.com>

Merge pull request #30847 from rhcs-dashboard/fix-42268-master

mgr/dashboard: fix typos in HACKING.rst

Reviewed-by: Ricardo Marques <rimarques@suse.com>

Merge pull request #26146 from snijhuis/master

mgr: zabbix triggers never triggered due to wrong trigger function

Reviewed-by: Wido den Hollander <wido@42on.com>
Reviewed-by: Dmitriy Rabotjagov <noonedeadpunk@ya.ru>

mgr/dashboard: fix typos in HACKING.rst

Fixes: https://tracker.ceph.com/issues/42268
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>

mgr/dashboard: comment questionable suites out

We're currently facing some issues with our integration
tests. Because of that we agreed on commenting questionable
suites out to be able to run all other suites on open pull
requests.

'test_health' and 'test_perf_counters' are commented out
because they led to issues in relation to
https://tracker.ceph.com/issues/41538
As soon as the issue has been fixed, we need to re-add
these two suites again.

Signed-off-by: Tatjana Dehler <tdehler@suse.com>

mgr/dashboard: sort QA suites alphabetically

Sort QA suites alphabetically to recognize a missing
suite faster.

Signed-off-by: Tatjana Dehler <tdehler@suse.com>

mgr/dashboard: wait a moment after module load

After a dashboard module load we need to wait (10 secs)
for the module to be back again. Otherwise the module
might not be able to answer requests properly. It could
lead to issues in some cases, e.g.: 'Failed to establish
a new connection: [Errno 111] Connection refused'.

Signed-off-by: Tatjana Dehler <tdehler@suse.com>

mgr/dashboard: reset login to admin user

After logging in with a separate testuser, especially a read-only
user, we need to reset the login to the admin user. This is important
in order to be able to continue with further tests. If not doing so
further tests might fail with the following error response:
{"status": "401 Unauthorized",
 "detail": "You are not authorized to access that resource", ...}

Fixes: https://tracker.ceph.com/issues/42226,
https://tracker.ceph.com/issues/42227
Signed-off-by: Tatjana Dehler <tdehler@suse.com>

mgr/dashboard: check for correct DashboardException error codes

We need to check for the correct error codes.
Otherwise the integration tests are going to fail.

Fixes: https://tracker.ceph.com/issues/42222
Signed-off-by: Tatjana Dehler <tdehler@suse.com>

Merge pull request #30658 from ricardoasmarques/delete-item-name

mgr/dashboard: Provide the name of the object being deleted

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>

Merge pull request #30815 from ricardoasmarques/remove-unused-endpoint

mgr/dashboard: Remove unused RBD "configuration" endpoint

Reviewed-by: Stephan Müller <smueller@suse.com>

mgr/pg_autoscaler: complete event if pool disappears

Fixes: 091dc321b10c8432192a8f76823a0ea97096885d
Fixes: https://tracker.ceph.com/issues/42249
Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #30854 from dmick/wip-fix-dict-pop

mgr/telemetry: dict.pop() errs on nonexistent key

Merge PR #30494 into master

* refs/pull/30494/head:
cmake: Allow cephfs and ceph-mds to be build when building on FreeBSD

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge PR #30817 into master

* refs/pull/30817/head:
qa/suites/rados/thrash-old-clients: exclude ceph-daemon on nautilus installs

mgr/telemetry: dict.pop() errs on nonexistent key

I suggested this in a review, but failed to correctly understand
what happens when the key doesn't exist.  Test for it.

Signed-off-by: Dan Mick <dan.mick@redhat.com>

*: remove config of "mon pg warn min per osd" in testing

Follows: 609ab5aa850b147dd0ea799ff14ac594951cf748
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #30742 from croit/rgw-fix-max-concurrent-ios-docs

radosgw-admin: update help for max-concurrent-ios

Reviewed-by: Casey Bodley <cbodley@redhat.com>

mgr/dashboard: Allow I18N when using "ng serve"

"ng serve" doesn't support i18n flags, so we need to define all language
specific settings in angular.json.

Then we can use them with the configuration flag, p.e.:
"ng serve --configuration=pt-BR"

We can also use this configurations for non production build, p.e.:
"ng build --configuration=pt-BR"

Set some global options, that will be shared by all configurations.

Signed-off-by: Tiago Melo <tmelo@suse.com>

mgr/dashboard: frontend: default language option in environment

Signed-off-by: Ricardo Dias <rdias@suse.com>

mgr/dashboard: Only show available languages

Read locale from LOCALE_ID, this is defined during build.

Signed-off-by: Tiago Melo <tmelo@suse.com>

mgr/dashboard: endpoint to list available languages

Signed-off-by: Ricardo Dias <rdias@suse.com>

mgr/dashboard: Store selected language in cookies

This will allow the backend access to this information in all requests.

Signed-off-by: Tiago Melo <tmelo@suse.com>

mgr/dashboard: Provide TRANSLATIONS directly in app.module.ts

Remove LOCALE_ID from provide list, since this is now defined during build.

Signed-off-by: Tiago Melo <tmelo@suse.com>

mgr/dashboard: Remove missing translation warnings during build

Signed-off-by: Tiago Melo <tmelo@suse.com>

mgr/dashboard: Remove support for older browsers.

This will reduce in half the time needed to compile the frontend.

Signed-off-by: Tiago Melo <tmelo@suse.com>

mgr/dashboard: Remove call to registerLocalData

Since we configure the locale during the build phase,
there is no need to set it dynamically.

Signed-off-by: Tiago Melo <tmelo@suse.com>

mgr/dashboard: Remove I18N from main.ts

With AOT I18N there is no need to provide I18N from the main.ts file.

Signed-off-by: Tiago Melo <tmelo@suse.com>

make-dist: build dashboard frontend for each language

Signed-off-by: Ricardo Dias <rdias@suse.com>

dashboard: detect language and serve correct frontend app

Signed-off-by: Ricardo Dias <rdias@suse.com>

doc: new Dashboard Plugin: Debug

Fixes: https://tracker.ceph.com/issues/41990
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>

cmake: dashboard: support locale-dependent frontend builds

Fixes: https://tracker.ceph.com/issues/41988
Signed-off-by: Ricardo Dias <rdias@suse.com>

mgr/dashboard: frontend: add npm-run-all dependency

Signed-off-by: Ricardo Dias <rdias@suse.com>

mgr/dashboard: package.json: add build scripts for each language

Signed-off-by: Ricardo Dias <rdias@suse.com>

Merge pull request #26524 from linuxbox2/wip-lc-days-0

rgw: lifecycle days may be 0

Merge pull request #30735 from yuvalif/fix_race_condition_in_amqp_test

rgw/amqp: fix race condition in AMQP unit test

Merge pull request #30725 from smithfarm/wip-more-cbs-2

ceph-backport.sh: automate setting of milestone and component label, implement --version option

Reviewed-by: Jan Fajerski <jfajerski@suse.com>

ceph-backport.sh: do not say "1 commits"

Signed-off-by: Nathan Cutler <ncutler@suse.com>

ceph-backport.sh: correctly add note to backport tracker

Before this commit, the JSON was wrong and Redmine silently ignored the note.

Signed-off-by: Nathan Cutler <ncutler@suse.com>

ceph-backport.sh: set SCRIPT_VERSION using --update-version

Signed-off-by: Nathan Cutler <ncutler@suse.com>