tools/rbd: use create4() for both of format 1 and format 2.

Signed-off-by: Dongsheng Yang <dongsheng.yang@easystack.cn>

tools/rbd: set order to default value if it is not specified in options.

Signed-off-by: Dongsheng Yang <dongsheng.yang@easystack.cn>

librbd: check the RBD_FEATURE_LAYERING for the features of child image.

Signed-off-by: Dongsheng Yang <dongsheng.yang@easystack.cn>

librbd: set RBD_FEATURE_STRIPINGV2 in create if needed.

Signed-off-by: Dongsheng Yang <dongsheng.yang@easystack.cn>

pybind: don't set the default values for the options not specified in copying

Signed-off-by: Dongsheng Yang <dongsheng.yang@easystack.cn>

pybind: don't set the default values for the options not specified in cloning

Signed-off-by: Dongsheng Yang <dongsheng.yang@easystack.cn>

pybind: don't set the default values for the options not specified in creating

Signed-off-by: Dongsheng Yang <dongsheng.yang@easystack.cn>

tools/rbd: set RBD_IMAGE_OPTION_FEATURES_CLEAR when --image-shared specified.

Signed-off-by: Dongsheng Yang <dongsheng.yang@easystack.cn>

librbd: introduce RBD_IMAGE_OPTION_FEATURES_[SET|CLEAR] for features overwriting.

Currently, if we want to use the default options for rbd, we need to omit the
RBD_IMAGE_OPTION_FEATURES, but if we want --image-shared. we need to overwrite
something bese on the default value of image options.

This patch introduce two flags in image_options, RBD_IMAGE_OPTION_FEATURES_SET
means, we want to set something after you get the features from default, parent
or user. And RBD_IMAGE_OPTION_FEATURES_CLEAR will do a bit clear.

Signed-off-by: Dongsheng Yang <dongsheng.yang@easystack.cn>

librbd/copy: set RBD_FEATURE_STRIPINGV2 in feature if stripe related options specified

Signed-off-by: Dongsheng Yang <dongsheng.yang@easystack.cn>

librbd/clone: set RBD_FEATURE_STRIPINGV2 in feature if stripe related options specified

Signed-off-by: Dongsheng Yang <dongsheng.yang@easystack.cn>

librbd: set the default options when they are not specified.

Signed-off-by: Dongsheng Yang <dongsheng.yang@easystack.cn>

tools/rbd: only set the options specified by user in get_image_options().

Signed-off-by: Dongsheng Yang <dongsheng.yang@easystack.cn>

tools/rbd: fix a wrong value setting for format_specified

Signed-off-by: Dongsheng Yang <dongsheng.yang@easystack.cn>

tools/rbd: skip the check of options in Clone action.

Signed-off-by: Dongsheng Yang <dongsheng.yang@easystack.cn>

tools/rbd: use rbd.create4() for all formats

Signed-off-by: Dongsheng Yang <dongsheng.yang@easystack.cn>

Merge pull request #9670 from ceph/wip-debian-clean

debian: silence couple warnings

Reviewed-by: Dan Mick <dmick@redhat.com>

Merge pull request #9832 from ceph/wip-cmake-librbd-unittest-fix

cmake: unittest_librbd missing a source file

cmake: unittest_librbd missing a source file

src/test/librbd/test_ConsistencyGroups.cc missing
from ${unittest_librbd_srcs}.

Signed-off-by: Ali Maredia <amaredia@redhat.com>

Merge pull request #9531 from yehudasa/wip-16175

rgw: data sync debug logging

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #9676 from efirs/fix_bitmap_freelist

os/bluestore: Fix enumeration when only single key in BitmapFreelistManager

test: remove remaining references to compression_dir

Removed in 38c7f4a06673e4806d327931744338a7393b45ef

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #9829 from ceph/wip-cmake-readme

cmake: updated CMake README instructions

Merge pull request #9814 from songbaisen/a11

mon: remove the repeat quorum size jugement

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #9818 from ifed01/wip-zero-length-writes

os/store_test: uniform zero length writes handling

Reviewed-by: Sage Weil <sage@redhat.com>

cmake: updated CMake README instructions

Updated testing and cluster start up instructions
for CMake in README.md

Signed-off-by: Ali Maredia <amaredia@redhat.com>

Merge pull request #9605 from liewegas/wip-statfs

os: simplify store_statfs_t

Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>

Merge pull request #9261 from prallabh/user_quota

rgw: Let the default quota settings take effect during user creation

Merge pull request #9817 from theanalyst/wip/boost-optional

rgw_swift: newer versions of boost/utility no longer include in_place
Reviewed-by: Orit Wasserman <owasserm@redhat.com>

os/store_test: fix synthetic test cases to handle zero-writes properly, i.e. do not increase object size.

Signed-off-by: Igor Fedotov <ifedotov@mirantis.com>

os/memstore: zero-length write should not effect object size

Signed-off-by: Sage Weil <sage@redhat.com>

ceph_test_objectstore: zero-length write should not affect object size

Signed-off-by: Sage Weil <sage@redhat.com>

rgw_swift: newer versions of boost/utility no longer include in_place

boost > 1.58 no longer includes in_place in boost/utility, we need to
include in_place_factory explicitly. This causes build failures in
distros that ship with a higher version of boost. Since the only call is for
swift_ver_location, another possibility is to use emplace()
instead (though this requires boost ~ 1.56)

Fixes: http://tracker.ceph.com/issues/16391
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>

Merge pull request #9786 from pritha-srivastava/wip-multisite-error-msgs

rgw: modifying multi-site log messages.

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #9812 from zhjwpku/cephx_protocol

doc: cephx_protocol typos

  mon: remove the repeat quorum size jugement

  Signed-off-by:song baisen <song.baisen@zte.com.cn>

rgw: Add documentation for RGW default quota

Signed-off-by: Pavan Rallabhandi <PRallabhandi@walmartlabs.com>

Merge pull request #9188 from rzarzynski/wip-rgw-swift-versioning-new-2

rgw: improve support for Swift's object versioning.
Reviewed-by: Orit Wasserman <owasserm@redhat.com>

rgw: modifying multi-site log messages.

Increasing the log level and removing 'ERROR' from messages that appear during normal multi-site operation.
Fixes: http://tracker.ceph.com/issues/16121
Signed-off-by: Pritha Srivastava <prsrivas@redhat.com>

Merge pull request #9804 from ceph/revert-9801-msg_msg_types_entity_name_t_makeprivate

Revert "msg/msg_types.h: make members private in ..."

Reviewed-by: Kefu Chai <kchai@redhat.com>

Revert "msg/msg_types.h: make members private in ..."

Merge pull request #9801 from stiopaa1/msg_msg_types_entity_name_t_makeprivate

msg/msg_types.h: make members private in `entity_name_t`

Reviewed-by: Kefu Chai <kchai@redhat.com>

doc:cephx_protocol

The goal of phase II is to provide C with a session key and ticekt
allowing it to communicate with S

Signed-off-by: Zhao Junwang <zhjwpku@gmail.com>

rgw: Do not bother to check against conf values during quota handling

Signed-off-by: Pavan Rallabhandi <PRallabhandi@walmartlabs.com>

rgw: Let the default quota settings take effect during user creation

Signed-off-by: Pavan Rallabhandi <PRallabhandi@walmartlabs.com>

msg/msg_types.h: make members private in ...

... entity_name_t class.

Signed-off-by: Michal Jarzabek <stiopa@gmail.com>

Merge pull request #9778 from ifed01/wip-bluestore-blob-reduce

os/bluestore: reduce bluestore blob

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #9750 from ifed01/wip-bluestore-csum-output-fix

os/bluestore: fix improper blob's csum visualization.

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #9756 from liewegas/wip-bluestore-diet

os/bluestore: remove unused bluestore fields

Reviewed-by: Allen Samuels <allen.samuels@sandisk.com>

debian: move libcephfs-jni to section "java"

Signed-off-by: Kefu Chai <kchai@redhat.com>

debian: remove X-Python-Version section

it's obsolete and can be removed now,
see
https://www.debian.org/doc/packaging-manuals/python-policy/ch-module_packages.html#s-specifying_versions

Signed-off-by: Kefu Chai <kchai@redhat.com>

debian: add ${shlibs:Depends} to binary packages' Depends

rationale
* this fixes:
  warning: dpkg-gencontrol: package python-rbd: unused substitution
  variable ${shlibs:Depends}
* and to comply to debian policy. see
  https://www.debian.org/doc/debian-policy/ch-sharedlibs.html#s-dpkg-shlibdeps

Signed-off-by: Kefu Chai <kchai@redhat.com>

debian: add jh_depends for ${java:Depends}

this fixes:
warning: dpkg-gencontrol: Depends field of package libcephfs-java:
unknown substitution variable ${java:Depends}

Signed-off-by: Kefu Chai <kchai@redhat.com>

makefile: add librgw_file_* as noninst_PROGRAMS

Signed-off-by: Kefu Chai <kchai@redhat.com>

Merge pull request #9119 from runsisi/wip-fix-cmake-desc

cmake: update description for cmake module Findkeyutils.cmake

Reviewed-by: Ali Maredia <amaredia@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #9799 from stiopaa1/common_address_helper_changeScope

common/address_helper.cc:move variables closer...

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #9797 from Yan-waller/yj-wip-rgwcompiling

rgw: kill compiling warning

Reviewed-by: Casey Bodley <cbodley@redhat.com>

common/address_helper.cc:move variables closer...

... to the point where they are first used.

Signed-off-by: Michal Jarzabek <stiopa@gmail.com>

rgw: kill compiling warning

test/rgw/test_http_manager.cc: In member function ‘virtual void HTTPManager_SignalThread_Test::TestBody()’:
test/rgw/test_http_manager.cc:40:23: warning: comparison between signed and unsigned integer expressions [-Wsign-compare]
   for (int i = 0; i < num_requests; i++) {
                       ^

Signed-off-by: Yan Jun <yan.jun8@zte.com.cn>

Merge pull request #9764 from vasukulkarni/master

mention change of owner for /var/log/ceph

Merge pull request #9599 from sdieffen/feature15904

added -f flag for formatting to rados command line tool

Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #9785 from cbodley/wip-rgw-httpmgr-select

rgw: fix deadlock in RGWHTTPManager when HAVE_CURL_MULTI_WAIT=0
Reviewed-by: Orit Wasserman <owasserm@redhat.com>

Merge pull request #9765 from dx9/wip-run-cmake

cmake: add arguments to cmake invocation to support cache configuration

Reviewed-by: Ali Maredia <amaredia@redhat.com>

Merge pull request #9634 from ceph/cmake-git-rev

Update git rev parsing in CMake

Reviewed-by: Ali Maredia <amaredia@redhat.com>

Merge pull request #9601 from ceph/wip-cmake

cmake: add ceph_test_* used by qa units and ceph-qa-suite tasks

Reviewed-by: Ali Maredia <amaredia@redhat.com>

Merge pull request #9725 from SUSE/wip-16327

rgw: check for -ERR_NOT_MODIFIED in rgw_rest_s3.cc
Reviewed-by: Orit Wasserman <owasserm@redhat.com>

rgw: add pipe fd to set for select() in do_curl_wait()

when HAVE_CURL_MULTI_WAIT is 0, the pipe fd is never added to the
readfds for select(), so FD_ISSET() is always false. this prevents us
from ever trying to read from the fd, and the pipe's buffer eventually
fills up and deadlocks callers of RGWHTTPManager::signal_thread() when
they try to write to the pipe

Fixes: http://tracker.ceph.com/issues/16368
Signed-off-by: Casey Bodley <cbodley@redhat.com>

test/rgw: add unit test for HTTPManager

unit test to detect a deadlock in RGWHTTPManager::signal_thread() when
HAVE_CURL_MULTI_WAIT=0

Signed-off-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #9779 from smanjara/wip-zone-rename

rgw: added zone rename to radosgw_admin

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #9686 from weiqiaomiao/wqm-wip-rgw-output

rgw: remove unnecessary output
Reviewed-by: Orit Wasserman <owasserm@redhat.com>

Merge pull request #9687 from theanalyst/rgw/orphans-find-msg

rgw-admin: don't print on ENOENT for orphans find
Reviewed-by" Orit Wasserman <owasserm@redhat.com>

Merge pull request #9736 from tchaikov/wip-test-timeout

test: disable dup test for mds respawn cmd

Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #9086 from ceph/wip-15849

msg/async/AsyncConnection: create writable event for in progress connection

Merge pull request #9461 from liewegas/wip-msgr2

doc: msgr2 protocol spec

Merge pull request #8963 from yuyuyu101/wip-15758

msg/async: Separated nonfast message and fast dispatch message thread

Reviewed-by: Sage Weil <sage@redhat.com>

os/bluestore: change bluestore_extent_ref_map_t key value(i.e. offset) from 64 to 32 bits.

Signed-off-by: Igor Fedotov <ifedotov@mirantis.com>

os/bluestore: remove bluestore_blob_t::length field

Signed-off-by: Igor Fedotov <ifedotov@mirantis.com>

rgw: added zone rename to radosgw_admin

Added zone rename option to radosgw-admin help

Signed-off-by: Shilpa Jagannath <smanjara@redhat.com>

Merge pull request #9759 from dillaman/wip-16352

rbd-mirror: ensure replay status formatter has completed before stopping

Reviewed-by: Mykola Golub <mgolub@mirantis.com>

Merge pull request #9730 from dillaman/wip-16329

rbd-mirror: gracefully handle missing sync point snapshots

Reviewed-by: Mykola Golub <mgolub@mirantis.com>

Merge pull request #9751 from dillaman/wip-16348

librbd: unable to disable journaling feature if in unexpected mirror state

Reviewed-by: Mykola Golub <mgolub@mirantis.com>

Merge pull request #8749 from Aran85/wip-check-failure-grace

mon/osdmonitor: decouple adjust_heartbeat_grace and min_down_reporters

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #8827 from majianpeng/ceph-tell-osd

osd/OSD: make 'ceph tell osd.x get_command_descriptions' work.

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #9056 from stiopaa1/osd_pistate_localstruct

osd/OSD.cc: make pistate a local struct

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

qa/workunits/cephtool/test.sh: disable dup test for mds respawn cmd

we set the CEPH_CLI_TEST_DUP_COMMAND enn var to verify the successful
commands are idempotent. but some of them are just not. among the other
things:
- ceph tell mds.a exit
- ceph tell mds.a respawn
the respawn command restart the mds daemon, its bind port changes and
all run-time status are reset. so strictly speaking, even the from the
point of view of client, this command is not idempotent. further more,
it fails the test, if the client sends the 2nd command too soon. because
the monitor might not able to update the re-spawned mds address before
the client asking for the new fsmap. so the cephfs client will just
use the old address of the specified mds, and hence will send the
request to port no one is listening anymore.

Signed-off-by: Kefu Chai <kchai@redhat.com>

cmake: add arguments to cmake invocation to support cache configuration

Signed-off-by: John Coyle <dx9err@gmail.com>

Also mention change of owner for /var/log/ceph

Signed-off-by: Vasu Kulkarni <vasu@redhat.com>

os/bluestore/bluestore_types: drop overlay types

Signed-off-by: Sage Weil <sage@redhat.com>

os/bluestore/bluestore_types: drop overlay fields from wal and onode

Signed-off-by: Sage Weil <sage@redhat.com>

os/bluestore: drop overlay support

We can resurrect this from the history if/when we decide we want it.

Signed-off-by: Sage Weil <sage@redhat.com>

os/bluestore/bluestore_types: remove flags from lextent_t

Signed-off-by: Sage Weil <sage@redhat.com>

rbd-mirror: ensure replay status formatter has completed before stopping

Fixes: http://tracker.ceph.com/issues/16352
Signed-off-by: Jason Dillaman <dillaman@redhat.com>

os/bluestore: drop old bluestore_extent_t

Signed-off-by: Sage Weil <sage@redhat.com>

os/bluestore: extent_t -> pextent_t

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #9753 from liewegas/wip-readme

README: update with vstart, test, and make check instructions

Reviewed-by: Ali Maredia <amaredia@redhat.com>

README.md: note where make check test log output goes

Signed-off-by: Sage Weil <sage@redhat.com>

README.md: document running a test cluster

Signed-off-by: Sage Weil <sage@redhat.com>

README.md: simplify cmake instructions

Assume build is subdir of the ceph.git checkout.

Signed-off-by: Sage Weil <sage@redhat.com>

README.md: drop obsolete comment about debian squeeze

Signed-off-by: Sage Weil <sage@redhat.com>

README.md: get source first (including submodules!)

Signed-off-by: Sage Weil <sage@redhat.com>