rbd: spell out image features unsupported by the kernel

/sys/bus/rbd/supported_features is available on kernels starting with
4.11.  Example output:

    $ sudo rbd map x
    rbd: sysfs write failed
    RBD image feature set mismatch. This image cannot be mapped because the following immutable features are unsupported by the kernel: data-pool.
    In some cases useful info is found in syslog - try "dmesg | tail".
    rbd: map failed: (6) No such device or address

    $ sudo rbd map -p foo y
    rbd: sysfs write failed
    RBD image feature set mismatch. You can disable features unsupported by the kernel with "rbd feature disable foo/y object-map fast-diff deep-flatten".
    In some cases useful info is found in syslog - try "dmesg | tail".
    rbd: map failed: (6) No such device or address

or, if /sys/bus/rbd/supported_features isn't there:

    $ sudo rbd map z
    rbd: sysfs write failed
    RBD image feature set mismatch. Try disabling features unsupported by the kernel with "rbd feature disable".
    In some cases useful info is found in syslog - try "dmesg | tail".
    rbd: map failed: (6) No such device or address

Fixes: http://tracker.ceph.com/issues/19095
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>

Merge pull request #13765 from guihecheng/rgwfs-time-attrs

rgw_file: posix style atime,ctime,mtime

Merge pull request #13712 from linuxbox2/wip-dtor-fhcache

rgw_file: RGWFileHandle dtor must also cond-unlink from FHCache

Merge pull request #13645 from yehudasa/wip-rgw-support-ragweed

rgw: add apis to support ragweed
Reviewed-by: Orit Wasserman <owasserm@redhat.com>

Merge pull request #13413 from zhaochao/fix-mailmap-affiation

mailmap: fix Zhao Chao affiliation.

Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>

Merge pull request #13767 from tchaikov/wip-vstart-no-multiple-mgr-x

vstart.sh: do not add host for mgr.* section if not $overwrite_conf

Reviewed-by: Sage Weil <sage@redhat.com>

rgw_file: RGWFileHandle dtor must also cond-unlink from FHCache

Formerly masked in part by the reclaim() action, direct-delete now
substitutes for reclaim() iff its LRU lane is over its high-water
mark, and in particular, like reclaim() the destructor is certain
to see handles still interned on the FHcache when nfs-ganesha is
recycling objects from its own LRU.

Fixes: http://tracker.ceph.com/issues/19112
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>

Merge pull request #13584 from theanalyst/doc/release-luminous

doc: releases update the luminous, hammer, jewel release dates

Reviewed-by: Loic Dachary <ldachary@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>

vstart.sh: do not add host for mgr.* section if not $overwrite_conf

Signed-off-by: Kefu Chai <kchai@redhat.com>

Merge pull request #13678 from liewegas/wip-readable

test/encoding: fix readable.sh bugs; fix ceph-object-corpus

Reviewed-by: Kefu Chai <kchai@redhat.com>

rgw_file: posix style atime,ctime,mtime

As an ganesha FSAL backend, rgw_file should properly maintain
the atime,ctime,mtime properly against operations such as:
(read,write) for file
(create,unlink,mkdir,rmdir,rename) for dir
(setattr) for file and dir

Signed-off-by: Gui Hecheng <guihecheng@cmss.chinamobile.com>

Merge pull request #13762 from Liuchang0812/wip-remove-unnecessary-code-in-mon

mon: remove unnecessary function declaration

Reviewed-by: Kefu Chai <kchai@redhat.com>

mon: remove unnecessary function declaration

Signed-off-by: liuchang0812 <liuchang0812@gmail.com>

Merge pull request #12566 from Liuchang0812/wip-rados

tools/rados: remove useless function declaration

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #12421 from cernceph/wip-dvanders-split

os/filestore/HashIndex: be loud about splits

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #12627 from liupan1111/wip-fix-remove-when-full

rbd: When Ceph cluster becomes full, should allow user to remove rbd …

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #13289 from songbaisen/s13

rados:  we need to get the latest osdmap when pool does not exists

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #13599 from kylinstorage/cleanup_bitmapallocator

os/bluestore/BitMapAllocator: rm unused variable

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #13744 from smithfarm/wip-19129

build/ops: add psmisc dependency to ceph-base (deb and rpm)

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #13750 from Saumay-Agrawal/master

mon: Update OSDMon.cc comments

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #13751 from Saumay-Agrawal/patch-1

doc: Update sample.ceph.conf

Reviewed-by: Sage Weil <sage@redhat.com>

Update sample.ceph.conf

I have fixed the cleanup issue #19090: Wrong hard-coded URLs
Please add these changes to your documentation.

Update OSDMon.cc

I have fixed the issue cleanup #19090: Wrong hard-coded URLs
I have replaced the wrong URLs with correct URLs redirecting to the Tunables headline under Crush Map documentation.
Please add it to the documentation.

Merge pull request #13748 from tchaikov/wip-disable-dwz

rpm: disable dwz to speed up valgrind

Reviewed-by: Ken Dreyer <kdreyer@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #13571 from trociny/wip-18784

rbd-mirror A/A: leader should track up/down rbd-mirror instances

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #13746 from tahia-khan/wip-doc-quick-ceph-deploy

doc: deletes duplicated word and clarifies an example

Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #13689 from Liuchang0812/wip-19107-cleanup-confutil

common: use ref to avoid unnecessary memory copy

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #13739 from Liuchang0812/fix-unittest-hostname

test: unittest_hostname compile error on freebsd

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>

Merge pull request #13693 from Liuchang0812/wip-add-override-in-mon-headers

mon: add override in headers

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #13701 from dillaman/wip-19010

librbd: simplify image open/close semantics

Reviewed-by: Mykola Golub <mgolub@mirantis.com>

common: use ref to avoid unnecessary memory copy

Fixes: http://tracker.ceph.com/issues/19107
Signed-off-by: liuchang0812 <liuchang0812@gmail.com>

doc: deletes duplicated word and clarifies an example

Signed-off-by: Tahia Khan <tahia.khan@gmail.com>

Merge pull request #13679 from dillaman/wip-librbd-image-cache-clip

librbd: image-extent cache needs to clip out-of-bounds read buffers

Reviewed-by: Mykola Golub <mgolub@mirantis.com>

mon: add override in headers

Signed-off-by: liuchang0812 <liuchang0812@gmail.com>

build/ops: add psmisc dependency to ceph-base (deb and rpm)

Fixes: http://tracker.ceph.com/issues/19129
Signed-off-by: Nathan Cutler <ncutler@suse.com>

mailmap: fix Zhao Chao affiliation.

Signed-off-by: Zhao Chao <zhaochao1984@gmail.com>

Merge pull request #13427 from ly798/update-info

mailmap: Liu Yang affiliation

Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>

Merge pull request #13738 from yuyuyu101/wip-fix-ib

msg/async/rdma: fix potential racing connection usage

Reviewed-by: Adir lev <adirl@mellanox.com>

Merge pull request #13655 from Adirl/ulimit

msg/async/rdma: check ulimit

Reviewed-by: Haomai Wang <haomai@xsky.com>

msg/async/rdma: check ulimit

On RDMA, memlock should be unlimited. If it is not then
warn the user

issue: 973654

Change-Id: If1e07722aaca9df88714828ca3f7398a2504e262
Signed-off-by: Sarit Zubakov <saritz@mellanox.com>
Signed-off-by: Adir Lev <adirl@mellanox.com>

Merge pull request #13510 from yuyuyu101/wip-rdma-buffer-size

common/config_opts: improve rdma buffer size to 128k

test: unittest_hostname compile error on freebsd

Signed-off-by: liuchang0812 <liuchang0812@gmail.com>

Merge pull request #13713 from drunkard/master

doc: misc minor fixes

Reviewed-by: Kefu Chai <kchai@redhat.com>

rpm: disable dwz to speed up valgrind

Fixes: http://tracker.ceph.com/issues/19099
Signed-off-by: Kefu Chai <kchai@redhat.com>

msg/async/rdma: fix incorrect method name

Signed-off-by: Haomai Wang <haomai@xsky.com>

msg/async/rdma: keep qp_conns lock to prevent connection alive

Signed-off-by: Haomai Wang <haomai@xsky.com>

msg/async/rdma: remove unused variables

Signed-off-by: Haomai Wang <haomai@xsky.com>

Merge pull request #13525 from yuyuyu101/wip-infiniband-fork

msg/async/rdma: make Infiniband can be forkable

msg/async/rdma: restart Infiniband resources to handle fork properly

Signed-off-by: Haomai Wang <haomai@xsky.com>

Merge pull request #13666 from Adirl/chunk_size

msg/async/rdma: rename chunk_size to buffer_size

Reviewed-by: Haomai Wang <haomai@xsky.com>

doc: add missed commas

Signed-off-by: Drunkard Zhang <gongfan193@gmail.com>

doc: add mark for quoted content

Signed-off-by: Drunkard Zhang <gongfan193@gmail.com>

doc: command typo fix, s/radosgw_admin/radosgw-admin

Signed-off-by: Drunkard Zhang <gongfan193@gmail.com>

doc: fix aiming of command ping

Signed-off-by: Drunkard Zhang <gongfan193@gmail.com>

doc: hyperlink typo fix in dev/index

The doc compiler complains about this.

Signed-off-by: Drunkard Zhang <gongfan193@gmail.com>

Merge pull request #13680 from yuyuyu101/wip-tx-zerocopy

msg/async/rdma: refactor tx handle flow to get rid of locks

Reviewed-by: Adir lev <adirl@mellanox.com>

Merge pull request #13706 from zmc/wip-openstack-volumes

qa/suites/ceph-deploy: Drop OpenStack volume count

Merge pull request #13657 from badone/wip-rgw-setuid-no-coredump

rgw: set dumpable flag after setuid post ff0e521

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>

Merge pull request #12998 from Liuchang0812/wip-11081

common: fix that $host always expands to localhost instead of actual hostname

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #13651 from rzarzynski/wip-bs-bitmap-nocct-in-entry

os/bluestore: remove CephContext* from BmapEntry.

Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #13662 from majianpeng/aio-memset

os/aio: remove the redundant memset(struct iocb)

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #13668 from songbaisen/m3

osd: the osd should not share map with others when it is in stopping state

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #13702 from liewegas/wip-trackedop-desc

common/TrackedOp: make TrackedOp::reset_desc() safe

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

qa/suites/ceph-deploy: Drop OpenStack volume count

Looks like we only need two per node, since there is only one OSD per
node, and ceph-deploy wants two disks per OSD to account for the
journal.

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #13729 from dillaman/wip-librbd-compile-warnings

librbd: eliminate compiler warnings

Reviewed-by: Mykola Golub <mgolub@mirantis.com>

Merge pull request #11995 from SUSE/wip_timeouts_ceph-create-keys

ceph-create-keys: Add connection timeouts.

Reviewed-by: Loic Dachary <ldachary@redhat.com>

msg/async: must destruct ConnectedSocket in the his own thread

Signed-off-by: Haomai Wang <haomai@xsky.com>

msg/async/rdma: refactor RDMAStack to accelerate tx handle

previously Dispatcher thread will poll both rx and tx events, then dispatch
these events to RDMAWorker and RDMAConnectedSocketImpl.

Actually tx event handling is a lightweight task and we make these handling
inline now. rx event dispatching is still working.

Another change is adding tx cq to make event polling separated.

removing lots of codes yet.

Signed-off-by: Haomai Wang <haomai@xsky.com>

librbd: eliminate compiler warnings

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #13343 from liewegas/wip-faster-dispatch

osd: faster dispatch

Reviewed-by: Greg Farnum <gfarnum@redhat.com>

Merge pull request #13557 from prallabh/healthcheck

rgw: Correct the return codes for the health check feature

Reviewed-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>

Merge pull request #13685 from tchaikov/wip-19097

mgr/MgrClient: use unique_ptr for MgrClient::session

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #13716 from Adirl/move_counter

msg/async/rdma: move active_queue_pairs perf counter dec to polling

Reviewed-by: Haomai Wang <haomai@xsky.com>

msg/async/rdma: move active_queue_pairs perf counter dec to polling

removing dead qp's is actually done at polling. if polling is busy then
dead qp will not be removed and active_queue_pair counter is not correct.

issue: 992513

Change-Id: I825e813ce0632fd01f6d29adc87e0e33a2bc13d9
Signed-off-by: DanielBar-On <danielbo@mellanox.com>

rgw: Correct the return codes for the health check feature
Fixes: http://tracker.ceph.com/issues/19025
Signed-off-by: Pavan Rallabhandi <PRallabhandi@walmartlabs.com>

mon/MonClient: do not assert on auth in build_authorizer()

* there is chance that some connections is still trying to authorize
  itself after the MonClient is shut down. do not assert in this case,
  but it is a sign of bug, or bad shutdown sequence, so print a message to
  dout().
* do not use active_con->get_auth() as an alternative to `this->auth` if
  it is not available. because we promote the authorized conn in
  pending_cons as the active_con, and std::swap(active_conn->auth, this->auth)
  with the monc_lock. so there is no point to return active_con->get_auth(),
  as it's always null.

Signed-off-by: Kefu Chai <kchai@redhat.com>

doc: command typo fix

Signed-off-by: Drunkard Zhang <gongfan193@gmail.com>

doc: remove dead doc from index

Signed-off-by: Drunkard Zhang <gongfan193@gmail.com>

doc: hyperlink fix

Signed-off-by: Drunkard Zhang <gongfan193@gmail.com>

Merge pull request #13703 from linuxbox2/wip-is-linked

rgw_file:  use fh_hook::is_linked() to check residence
verified by hand f23

rgw_file:  use fh_hook::is_linked() to check residence

Previously we assumed that !deleted handles were resident--there
is an observed case where a !deleted handle is !linked.  Since
we currently use safe_link mode, an is_linked() check is
available, and exhaustive.

Fixes: http://tracker.ceph.com/issues/19111
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>

Merge pull request #13671 from liewegas/wip-filestore-omap

os/filestore: debug which omap keys are set

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #13546 from cbodley/wip-19019

rgw: RGWMetaSyncShardControlCR retries with backoff on all error codes
tested by-had, using fault injection

Merge pull request #13415 from ifed01/wip-fix-storetest

test/store_test: add deferred test case setup to support explicit min…

Reviewed-by: Varada Kari <varada.kari@sandisk.com>
Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #13476 from songbaisen/s18

osd: small clear up and optimize on _recover_now and should_share_map function

Reviewed-by: Kefu Chai <kchai@redhat.com>

common/TrackedOp: make TrackedOp::reset_desc() safe

It is possible for a reset_desc() call to clear the desc char* while
get_desc() is executing such that it will return a nullptr to the caller.
This can lead to bad results, like a crash in std::string() (which does
not like to take null).

Fix this by not clearing desc.  Instead, set a separate flag to indicate
that desc should be (safely) rebuilt on the next get_desc() call.

Fixes: http://tracker.ceph.com/issues/19110
Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #13686 from wjwithagen/wip-wjw-fsx-linux-2

test: Need to exclude the fsx executable also on FreeBSD

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

rbd-mirror: eliminate context switch from close image state machine

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

librbd: eliminate context switch from remove state machine

Also cleaned up formatting issues within the state machine.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #13523 from wjwithagen/wip-wjw-clang-mempool

include/mempool.h: fix Clangs complaint about types

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #13659 from majianpeng/compiler-warning

common/EventTrace: fix compiler warning.

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #13667 from jcsp/wip-mgr-misc

mgr: use unique_ptr for MgrStandby::active_mgr

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #13669 from jcsp/wip-mgr-get-version

mgr: add a get_version to the python interface

Reviewed-by: Kefu Chai <kchai@redhat.com>

librbd: cleanup synchronous open/close memory management

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #13692 from Liuchang0812/wip-add-override-in-auth-headers

common/auth: add override in headers

Reviewed-by: Sage Weil <sage@redhat.com>

doc:releases update the luminous, hammer, jewel release dates

Also add row lines to make the table look consistent

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>

Merge pull request #13591 from batrick/mds-static-counters

mds: automate MDS object count tracking

Reviewed-by: John Spray <john.spray@redhat.com>

Merge pull request #13581 from jcsp/wip-mdsmonitor-refactor

mon: refactor MDSMonitor command handling

Reviewed-by: Yan, Zheng <zyan@redhat.com>

Merge pull request #13532 from ukernel/wip-18995

ceph_fuse: fix daemonization when pid file is non-empty

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #13464 from jcsp/wip-sessionmap-ioerror

mds: fix IO error handling in SessionMap

Reviewed-by: Yan, Zheng <zyan@redhat.com>