mon/OSDMonitor: accept crush_device_class in 'osd new' json input

If provided, set the OSD device_class at OSD creation time.  This is
simpler than writing a file that the OSD has to read in and use to
set its initial device class, and also avoids a bit of sticky state
at the OSD that will make it keep trying to reset its device class on
startup if it ever gets cleared.

Note that we now ignore json input fields we don't understand, so remove
a test case.

Signed-off-by: Sage Weil <sage@redhat.com>

mon/OSDMonitor: fix 'osd crush set-device-class' for new osds

We should set the max_devices value for a new device.  (Actually,
finalize() will fix this for us on decode, but better to be
pendantic.)

Signed-off-by: Sage Weil <sage@redhat.com>

crush/CrushWrapper: fix finalize clobbering of max_devices

This hides device names when they don't appear in the hierarchy,
e.g. after setting a name and class for a new device that hasn't
yet been put in the tree.

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #19900 from dillaman/wip-rbd-lock-list

rbd: adjusted "lock list" JSON and XML formatted output

Reviewed-by: Mykola Golub <mgolub@suse.com>

Merge pull request #19933 from qrGitHub/wip-rgw-useless-line4

rgw: drop redundant RGW_OP_STAT_OBJ check

Reviewed-by: Casey Bodley <cbodley@redhat.com>

rbd: adjusted "lock list" JSON and XML formatted output

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

rgw: drop redundant RGW_OP_STAT_OBJ check

Signed-off-by: Bingyin Zhang <zhangbingyin@cloudin.cn>

Merge pull request #19886 from liu-chunmei/fix_dpdk_worker_references_issue

osd: fix dpdk worker references issue

Reviewed-by: Haomai Wang <haomai@xsky.com>

Merge branch 'wip-names!-in!-space!' of git://github.com/adamemerson/ceph

Reviewed-by: Jesse Williamson <jwilliamson@suse.de>
# Conflicts:
# src/cls/rbd/cls_rbd.cc
# src/cls/rbd/cls_rbd_types.cc

Merge pull request #19099 from ifed01/wip-ifed-faster-pglog

osd: eliminate ineffective container operations

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #19180 from theanalyst/tools/rados-omap-clear

tools: rados add a cli option to clear omap keys

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #19872 from tchaikov/wip-random_shuffle

osd: s/random_shuffle()/shuffle()/

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>

Merge pull request #19881 from liewegas/wip-kill-crush-location

ceph-crush-location: remove

Reviewed-by: Wido den Hollander <wido@widodh.nl>

Merge pull request #11544 from VictorDenisov/consistency_groups_snapshots

librbd: group snapshots

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

rbd-mirror: fix valgrind false positive from new boost release

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #19924 from rzarzynski/wip-rgw-drop-dump_uri_from_state

rgw: drop dump_uri_from_state() which isn't used anymore.

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>

librbd: ensure enums are prefixed w/ RBD_ to avoid collisions

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

librbd: fix false-positive compiler warning

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

test/pybind: corrected failures due to test execution ordering

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

librbd: group snapshots should be linked to image pool (not data pool)

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

rbd: restore snap list by image id functionality

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

cls/rbd: combined group_snap_add and group_snap_update

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

librbd: fix ImageCtx::get_snap_id method

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

librbd: fixed memory leak and use-after-free in group snap API

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

rbd: utilize '<name>@<snap>' format when creating/removing group snaps

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

pybind/rbd: added snap_get_group_namespace API method

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

librbd: added missing C API version for rbd_snap_get_group_namespace

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

librbd: moved new snapshot API methods to separate class

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

rbd: wrap object section around group snap list formatter

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

rbd: translate pool id into name

Signed-off-by: Victor Denisov <denisovenator@gmail.com>

rbd: translate group pool to name

Signed-off-by: Victor Denisov <denisovenator@gmail.com>

rbd: fix cli tests

Signed-off-by: Victor Denisov <denisovenator@gmail.com>

rbd: drop consistency from Info

Signed-off-by: Victor Denisov <denisovenator@gmail.com>

rbd: produce state string instead of integer

Signed-off-by: Victor Denisov <denisovenator@gmail.com>

rbd: Add snap rm alias

Signed-off-by: Victor Denisov <denisovenator@gmail.com>

rbd: Change message format

Signed-off-by: Victor Denisov <denisovenator@gmail.com>

rbd: Inline options function

Signed-off-by: Victor Denisov <denisovenator@gmail.com>

rbd: Drop consistency from tools

Signed-off-by: Victor Denisov <denisovenator@gmail.com>

rbd: Fix section name

Signed-off-by: Victor Denisov <denisovenator@gmail.com>

test/pybind: drop consistency from test name

Signed-off-by: Victor Denisov <denisovenator@gmail.com>

rbd: Drop consistency from help

Signed-off-by: Victor Denisov <denisovenator@gmail.com>

librbd: Drop consistency from pybind

Signed-off-by: Victor Denisov <denisovenator@gmail.com>

librbd: Fix indentation

Signed-off-by: Victor Denisov <denisovenator@gmail.com>

librbd: use RBD_GROUP_INVALID_POOL

Signed-off-by: Victor Denisov <denisovenator@gmail.com>

librbd: Drop word consistency in librbd

Signed-off-by: Victor Denisov <denisovenator@gmail.com>

librbd: remove get_snap_id_from_namespace

Signed-off-by: Victor Denisov <denisovenator@gmail.com>

librbd: fixup Move function declaration

Signed-off-by: Victor Denisov <denisovenator@gmail.com>

librbd: rename group state to 'incomplete'

Signed-off-by: Victor Denisov <denisovenator@gmail.com>

cls_rbd: initialize group state

Signed-off-by: Victor Denisov <denisovenator@gmail.com>

cls_rbd: Remove h_group_create

Signed-off-by: Victor Denisov <denisovenator@gmail.com>

cls_rbd: Address comments

Signed-off-by: Victor Denisov <denisovenator@gmail.com>

qa/workunits/rbd: Add tests for consistency groups

Signed-off-by: Victor Denisov <denisovenator@gmail.com>

rbd: Add group snapshot command

Signed-off-by: Victor Denisov <denisovenator@gmail.com>

librbd: Add group snapshot operations

Signed-off-by: Victor Denisov <denisovenator@gmail.com>

cls_rbd: Add group snapshot operations to cls_rbd

Signed-off-by: Victor Denisov <denisovenator@gmail.com>

Merge pull request #19919 from wjwithagen/wip-wjw-rbd-ggate-fix

rbd-ggate: fix syntax error.

Reviewed-by: Mykola Golub <mgolub@suse.com>

Merge pull request #19917 from yaozongyou/rgw-remove-unused-cls-user-add-bucket

rgw: remove unused cls_user_add_bucket

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #19699 from qrGitHub/wip-rgw-useless-line

rgw: remove useless lines in RGWDeleteBucket::execute

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>

Merge pull request #19632 from Rubab-Syed/outreachy_mgr_dashboard

mgr/dashboard: Add monitor list

Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #19898 from tchaikov/wip-cmake-build-with-clang

cmake: BuildBoost.cmake: use specified compiler for building boost

Reviewed-By: Casey Bodley <cbodley@redhat.com>

rgw: drop dump_uri_from_state() which isn't used anymore.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

rbd-ggate: fix syntax error.

Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>

rgw: remove unused cls_user_add_bucket

the function
`int cls_user_add_bucket(rgw_raw_obj& obj, list<cls_user_bucket_entry>& entries);`
is unsed and not implemented, so remove it.

Signed-off-by: Yao Zongyou <yaozongyou@vip.qq.com>

Merge pull request #19879 from jcsp/wip-doc-dashboard-standby

doc: update mgr/dashboard doc about standbys

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #19642 from xiexingguo/wip-pending-new-state

osd/OSDMap.h: toss osd out if it has no more pending states

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #19901 from vico-research-and-consulting/master

mgr/zabbix: monitoring template improvements

Reviewed-by: Wido den Hollander <wido@widodh.nl>

Merge pull request #18833 from yuyuyu101/wip-async-perf

msg/async/AsyncConnection: combine multi alloc into one

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #18906 from ovh/bp-buffer-crc-improvements

common/buffer: switch crc cache to single pair instead of map

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #19547 from tchaikov/wip-22344

ceph.in: print all matched commands if arg missing

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>

Merge pull request #19832 from shinobu-x/min_max_filestore

os: FileStore, Using stl min | max, MIN | MAX macros instead

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #19874 from myoungwon/wip-fix-22641

osd: fix a valgrind issue (conditional jump depends on uninitialized value)

Reviewed-by: Sage Weil <sage@redhat.com>

mgr/zabbix: monitoring template improvements

The changes need some review because i am currently not able to test this in a environment.
- added a host screen which displays all graphs in a convenient way
- replaced AVG by MAX Function in Graphs where maximum values are of
  high interest from operational view
- changed graph type to stacked where combined behavior is of interest
  (i.e. bandwidth and storage consumption)

Signed-off-by: Marc Schoechlin <ms@256bit.org>

include: Remove fallback usings from encoding.h

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

test: Use unqualified encode/decode

This is a portion of Part 1 of the namespace project: using ADL
properly in encode and decode so we can use namespaces easily in Ceph.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

tools: Use unqualified encode/decode

This is a portion of Part 1 of the namespace project: using ADL
properly in encode and decode so we can use namespaces easily in Ceph.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

rgw: Use unqualified encode/decode

This is a portion of Part 1 of the namespace project: using ADL
properly in encode and decode so we can use namespaces easily in Ceph.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

rbd_replay: Use unqualified encode/decode

This is a portion of Part 1 of the namespace project: using ADL
properly in encode and decode so we can use namespaces easily in Ceph.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

osdc: Use unqualified encode/decode

This is a portion of Part 1 of the namespace project: using ADL
properly in encode and decode so we can use namespaces easily in Ceph.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

osd: Use unqualified encode/decode

This is a portion of Part 1 of the namespace project: using ADL
properly in encode and decode so we can use namespaces easily in Ceph.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

os: Use unqualified encode/decode

This is a portion of Part 1 of the namespace project: using ADL
properly in encode and decode so we can use namespaces easily in Ceph.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

objclass: Use unqualified encode/decode

This is a portion of Part 1 of the namespace project: using ADL
properly in encode and decode so we can use namespaces easily in Ceph.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

msg: Use unqualified encode/decode

This is a portion of Part 1 of the namespace project: using ADL
properly in encode and decode so we can use namespaces easily in Ceph.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

mon: Use unqualified encode/decode

This is a portion of Part 1 of the namespace project: using ADL
properly in encode and decode so we can use namespaces easily in Ceph.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

mgr: Use unqualified encode/decode

This is a portion of Part 1 of the namespace project: using ADL
properly in encode and decode so we can use namespaces easily in Ceph.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

messages: Use unqualified encode/decode

This is a portion of Part 1 of the namespace project: using ADL
properly in encode and decode so we can use namespaces easily in Ceph.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

mds: Use unqualified encode/decode

This is a portion of Part 1 of the namespace project: using ADL
properly in encode and decode so we can use namespaces easily in Ceph.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

rbd: Use unqualified encode/decode

This is a portion of Part 1 of the namespace project: using ADL
properly in encode and decode so we can use namespaces easily in Ceph.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

librados: Use unqualified encode/decode

This is a portion of the namespace project.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

kv: Use unqualified encode/decode

This is a portion of the namespace project.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

key_value_store: Use unqualified encode/decode

This is a portion of the namespace project.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

journal: Use unqualified encode/decode

This is a portion of the namespace project.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

include: Use unqualified encode/decode

This is a portion of the namespace project.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

crush: Use unqualified encode/decode

This is a portion of the namespace project.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

compressor: Use unqualified encode/decode

This is a portion of the namespace project.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

cls: Use unqualified encode/decode

This is a portion of the namespace project.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

client: Use unqualified encode/decode

This is a portion of the namespace project.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

auth: Use unqualified encode/decode

This is a portion of the namespace project.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

common: Use unqualified encoding in the rest of the files

And now we're done with this directory, for now.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

common: Use unqualified encoding in ceph_time.h

Well, actually move encode/decode into encoding.h and include ceph_time.h
from there.

Also in any function that encodes a timepoint.

Also clean up a few include file problems that come out of having
ceph_time.h not include encoding.h

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>

common: Use unqualified encoding in some files

bit_vector.hpp and bloom_filter.cc to be specific.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>