cmake: CMake environment variables added to automake

Signed-off-by: Ali Maredia <amaredia@redhat.com>

cmake: Building ceph-detect-init from source code

Signed-off-by: Ali Maredia <amaredia@redhat.com>

cmake: Building ceph-disk from source code

Signed-off-by: Ali Maredia <amaredia@redhat.com>

cmake: Add librgw_file tests

Signed-off-by: Ali Maredia <amaredia@redhat.com>

cmake: Added rbd_mirror targets

Added rbd_mirror libraries, unit tests, executables

Signed-off-by: Ali Maredia <amaredia@redhat.com>

cmake: Added an absolute path for libs

Signed-off-by: Ali Maredia <amaredia@redhat.com>

cmake: test_pidfile.sh test passing

Replaced relative paths in test_pidfile.sh
with CEPH_VAR environment variables set in cmake.

Signed-off-by: Ali Maredia <amaredia@redhat.com>

cmake: Protect againist getenv returning nullptr

Signed-off-by: Ali Maredia <amaredia@redhat.com>

cmake: erasure-decode-non-regression.sh passing

Added missing dependencies and link libraries for
erasure-decode-non-regression.sh and added absolute
paths to ceph_erasure_code_non_regression.cc.

Signed-off-by: Ali Maredia <amaredia@redhat.com>

unittest_journal: got rid of relative paths

Replaced .libs in TestClassHandler.cc with CEPH_LIB

Signed-off-by: Ali Maredia <amaredia@redhat.com>

unittest_blkdev: absolute path for cmake make check

Signed-off-by: Ali Maredia <amaredia@redhat.com>

cmake: test_objectstore_memstore.sh test passing

Replaced relative paths in test_objectstore_memstore.sh
with CEPH_VAR environment variables set in cmake.

Signed-off-by: Ali Maredia <amaredia@redhat.com>

cmake: erasure-code tests passing

Replaced relative paths in test-erausure-eio.sh
test-erasure-code.sh, and replaced .libs in
erasure_code unittests with CEPH_VAR environment
variables set in cmake.

Signed-off-by: Ali Maredia <amaredia@redhat.com>

cmake: ceph_objectstore_tool.py test passing

Replaced relative paths in shell scripts in
test/ceph_objectstore_tool.py and init-ceph.in to
work with CEPH_FOO environment variables set in cmake.
Also added CEPH_BUILD_DIR environment variable set
to CMAKE_BINARY_DIR. It is used in init-ceph and
ceph_objectstore_tool.py.

Signed-off-by: Ali Maredia <amaredia@redhat.com>

cmake: unittest_bufferlist passing in cmake

Replaced relative paths in unittest_bufferlist.sh
to work with CEPH_FOO environment variables set in
cmake.

Signed-off-by: Ali Maredia <amaredia@redhat.com>

cmake: cephtool-test-rados/mds/osd passing in cmake

Replaced relative paths in test/cephtool-test-mon.sh,
qa/workunits/cephtool/test.sh, and test/cephtool-test-mon.sh
to work with CEPH_FOO environment variables set in cmake.

Signed-off-by: Ali Maredia <amaredia@redhat.com>

cmake: working on cephtool-test-rados.sh test

Replaced relative paths in test/cephtool-test-rados.sh,
qa/workunits/rados/test_rados_tool.sh,
src/test/vstart_wrapper.sh, with CEPH_FOO environment
variables set in cmake. Also edited the CMake path
finding logic in vstart.sh with the CEPH_FOO variables.

NOTE: test is not passing yet, possibly due to the
filesystem. this commit is a work in progress

Signed-off-by: Ali Maredia <amaredia@redhat.com>

cmake: working on rados-striper.sh test

Replaced relative paths in test/mon/osd-crush.sh
with CEPH_VAR environment variables set in cmake.

NOTE: test is not passing yet, possibly due to the
filesystem. this commit is a work in progress

Signed-off-by: Ali Maredia <amaredia@redhat.com>

cmake: librbd fixes

Added src/librbd and test/librbd CMakeLists.txt's,
various previously missing libraries and targets,
revised unittest_librbd.

Signed-off-by: Ali Maredia <amaredia@redhat.com>

cmake: moved tests into test/system dir

Added a CMakeLists.txt into test/system.

Signed-off-by: Ali Maredia <amaredia@redhat.com>

cmake: moved tests into test/rgw dir

Added a CMakeLists.txt into test/rgw.

Signed-off-by: Ali Maredia <amaredia@redhat.com>

cmake: moved tests into test/osdc dir

Added a CMakeLists.txt into test/osdc.

Signed-off-by: Ali Maredia <amaredia@redhat.com>

cmake: moved tests into test/ObjectMap dir

Added a CMakeLists.txt into test/ObjectMap.

Signed-off-by: Ali Maredia <amaredia@redhat.com>

cmake: moved tests into test/msgr dir

Added a CMakeLists.txt into test/msgr.

Signed-off-by: Ali Maredia <amaredia@redhat.com>

cmake: moved tests into test/messenger dir

Added a CMakeLists.txt into test/messenger.

Signed-off-by: Ali Maredia <amaredia@redhat.com>

cmake: moved tests into test/librados_test_stub dir

Added a CMakeLists.txt into test/librados_test_stub.

Signed-off-by: Ali Maredia <amaredia@redhat.com>

cmake: moved tests into test/libcephfs dir

Added a CMakeLists.txt into test/libcephfs.

Signed-off-by: Ali Maredia <amaredia@redhat.com>

cmake: moved tests into test/journal dir

Added a CMakeLists.txt into test/journal.

Signed-off-by: Ali Maredia <amaredia@redhat.com>

cmake: moved tests into test/filestore dir

Added a CMakeLists.txt into test/filestore.

Signed-off-by: Ali Maredia <amaredia@redhat.com>

cmake: moved tests into test/compressor dir

Added a CMakeLists.txt into test/compressor,
libcompressor to src/compressor/CMakeLists.txt,
added absolute path into $snappy_sources, removed
.libs from compressor unit test source files

Signed-off-by: Ali Maredia <amaredia@redhat.com>

cmake: moved tests into test/cls_version dir

Added a CMakeLists.txt into test/cls_version.

Signed-off-by: Ali Maredia <amaredia@redhat.com>

cmake: moved tests into test/cls_statelog dir

Added a CMakeLists.txt into test/cls_statelog.

Signed-off-by: Ali Maredia <amaredia@redhat.com>

cmake: moved tests into test/cls_rgw dir

Added a CMakeLists.txt into test/cls_rgw.

Signed-off-by: Ali Maredia <amaredia@redhat.com>

cmake: moved tests into test/cls_replica_log dir

Added a CMakeLists.txt into test/cls_replica_log.

Signed-off-by: Ali Maredia <amaredia@redhat.com>

cmake: moved tests into test/cls_refcount dir

Added a CMakeLists.txt into test/cls_refcount.

Signed-off-by: Ali Maredia <amaredia@redhat.com>

cmake: moved tests into test/cls_rbd dir

Added a CMakeLists.txt into test/cls_rbd.

Signed-off-by: Ali Maredia <amaredia@redhat.com>

cmake: moved tests into test/cls_numops dir

Added a CMakeLists.txt into test/cls_numops.

Signed-off-by: Ali Maredia <amaredia@redhat.com>

cmake: moved tests into test/cls_log dir

Added a CMakeLists.txt into test/cls_log.

Signed-off-by: Ali Maredia <amaredia@redhat.com>

cmake: moved tests into test/cls_lock dir

Added a CMakeLists.txt into test/cls_lock.

Signed-off-by: Ali Maredia <amaredia@redhat.com>

cmake: moved tests into test/cls_hello dir

Added a CMakeLists.txt into test/cls_hello.

Signed-off-by: Ali Maredia <amaredia@redhat.com>

cmake: moved tests into test/bench dir

Added a CMakeLists.txt into test/bench.

Signed-off-by: Ali Maredia <amaredia@redhat.com>

cmake: moved tests into test/os dir

Added a CMakeLists.txt into test/os.

Signed-off-by: Ali Maredia <amaredia@redhat.com>

cmake: moved tests into test/pybind dir

Added a CMakeLists.txt into test/pybind. Added
CEPH_BIN in front of relative path in
test_ceph_argparse.py.

Signed-off-by: Ali Maredia <amaredia@redhat.com>

cmake: moved tests into test/objectstore dir

Added a CMakeLists.txt into test/objectstore.

Signed-off-by: Ali Maredia <amaredia@redhat.com>

cmake: moved tests into test/mds dir

Added a CMakeLists.txt into test/mds.

Signed-off-by: Ali Maredia <amaredia@redhat.com>

cmake: moved tests into test/libradosstriper dir

Added a CMakeLists.txt into test/libradosstriper.

Signed-off-by: Ali Maredia <amaredia@redhat.com>

cmake: moved tests into test/librados dir

Added a CMakeLists.txt into test/librados.

Signed-off-by: Ali Maredia <amaredia@redhat.com>

cmake: moved tests into test/fs dir

Added a CMakeLists.txt into test/fs.

Signed-off-by: Ali Maredia <amaredia@redhat.com>

cmake: moved tests into test/crush dir

Added a CMakeLists.txt into test/crush.

Signed-off-by: Ali Maredia <amaredia@redhat.com>

cmake: moved tests into test/common dir

Added a CMakeLists.txt into test/common.

Signed-off-by: Ali Maredia <amaredia@redhat.com>

cmake: shell scripts in test/encoding passing in cmake

Replaced relative paths in scripts in test/encoding
to work with CEPH_FOO environment variables set in
cmake, CMakeLists.txt added.

Signed-off-by: Ali Maredia <amaredia@redhat.com>

cmake: shell scripts in test/mon passing in cmake

Replaced relative paths in shell scripts in test/mon
to work with CEPH_FOO environment variables set in
cmake, added CMakelists.txt to test/mon

Signed-off-by: Ali Maredia <amaredia@redhat.com>

cmake: moved tests into test/osd dir

Replaced relative paths in shell scripts in test/osd
directory with CEPH_VAR environment variables set in cmake,
added a CMakeLists.txt in test/osd.

Signed-off-by: Ali Maredia <amaredia@redhat.com>

cmake: encode-decode-non-regression.sh passing in cmake

Replaced relative paths in encode-decode-non-regression.sh
to work with CEPH_FOO environment variables set in
cmake.

Signed-off-by: Ali Maredia <amaredia@redhat.com>

cmake: test-ceph-helpers working

Moved all the libraries in CMAKE_BINARY_DIR/lib
and all the binaries in CMAKE_BINARY_DIR/bin. Set
various environment variables for test-ceph-helpers.
Put those variables throughout
qa/workunits/ceph-helpers.sh.

NOTE: This is a very rough draft of these fixes.

Signed-off-by: Ali Maredia <amaredia@redhat.com>

cmake: Reorganized test dir, added cmake functions

make check targets now use add_ceph_test, or
add_ceph_unittest to be added to CTest. Renamed and
reordered targets in tests/CMakeLists.txt

Signed-off-by: Ali Maredia <amaredia@redhat.com>

Merge pull request #8606 from dillaman/wip-15457

rbd: loosen image spec validation requirements

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #8603 from rmechler/wip-15362

pybind/rados: fix omap method return values

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

release-notes: document rbd cli name validation override

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

rbd: fail if cannot extract spec from legacy "--image" optional

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

rbd: optionally disable spec validation when creating images/snapshots

Setting the "rbd-validate-names" config propery to false will disable
spec validation.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

rbd: add support for relaxed image spec validation

Operations which create images or snapshots still fully enforce
the spec validation.  All other operations use a relaxed validation
format.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

common: new rbd image spec validation option

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

Removed parentheses for if statement.

Signed-off-by: Roland Mechler <rmechler@cisco.com>

Merge pull request #8588 from yehudasa/wip-rgw-period-id

rgw: try to use current period id in a few more cases

Merge pull request #8566 from cbodley/wip-rgw-period-reflect

rgw: RGWPeriod::reflect() sets master zonegroup as default
Reviewed-by: Orit Wasserman<owasserm@redhat.com>

update release-notes manually

Signed-off-by: Greg Farnum <gfarnum@redhat.com>

Merge pull request #8585 from cbodley/wip-rgw-reload-usage

rgw: call rgw_log_usage_finalize() on reconfiguration

Reviewed-by: Orit Wasserman <owasserm@redhat.com>
Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>

Merge pull request #8600 from liewegas/wip-rados-lfn

ceph_test_rados: make long name ~300 chars, (not ~800)

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #8604 from gregsfortytwo/wip-fsmap-decode-fix

mds: FSmap decode fix

Reviewed-by: Sage Weil <sage@redhat.com>
Tested-by: Sage Weil <sage@redhat.com>

Merge pull request #8565 from dillaman/wip-15471

librbd: fix handling of proxied maintenance operations during shut down

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

librbd: do not return a failure if a peer cannot be notified of updateReviewed-by: Josh Durgin <jdurgin@redhat.com>

librbd: do not return a failure if a peer cannot be notified of update

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #8511 from dillaman/wip-15436

librbd: IO deadlock when dynamically enabling/disabling features

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #8494 from dillaman/wip-15352

journal: possible race condition during live replay

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Fixes for python omap method return values.

Signed-off-by: Roland Mechler <rmechler@cisco.com>

FSMap: guard the ever_enabled_multiple decode

Signed-off-by: Greg Farnum <gfarnum@redhat.com>

ceph_test_rados: make long name ~300 chars, (not ~800)

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #8594 from dachary/wip-releases

release-notes: v10.1.2 release notes

cmake: pass RULE_LAUNCHER_* to cythonReviewed-by: Josh Durgin <jdurgin@redhat.com>

cmake: pass RULE_LAUNCHER_* to cython

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Robin H. Johnson <robin.johnson@dreamhost.com>

librbd: dynamically disabling exclusive lock might leave lingering request

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #8534 from kmroz/wip-rgw-rados-cleanup-1

rgw-rados: return RGWSystemMetaObj init directly
Reviewed-by: Orit Wasserman <owasserm@redhat.com>

release-notes: v10.1.2 release notes

Signed-off-by: Loic Dachary <loic@dachary.org>

release-notes: v10.1.2 release notes (draft)

cd src/script
virtualenv v
source v/bin/activate
pip install githubpy GitPython requests
GITHUB_ACCESS_TOKEN=xxxxxxx ./ceph-release-notes \
    -r tags/v10.1.1..tags/v10.1.2 $(git rev-parse --show-toplevel)

Signed-off-by: Loic Dachary <loic@dachary.org>

Merge pull request #8381 from ceph/wip-cython-tarball-build

cmake/pybind: fix include paths for cephfs

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #8569 from jdurgin/wip-dev-package-doc

doc: reinstate accidentally removed section header

Reviewed-by: Abhishek Lekshmanan <alekshmanan@suse.com>

Merge pull request #8587 from emenguy/fix_dependencies_documentation

doc: fix dependencies

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #8584 from dillaman/wip-15479

test: image replayer needs dummy remote mirror peer uuid

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

rgw: try to use current period id in a few more cases

If missing period id, try to use the current period id. This is needed
for sync agent compatibility.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

Merge pull request #8188 from ceph/wip-systemd-restart-defaults

systemd: Use the same restart limits as upstart

Reviewed-by: Ken Dreyer <kdreyer@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>

doc: fix dependencies

Signed-off-by: Etienne Menguy <etienne.menguy@corp.ovh.com>

systemd: Use the same restart limits as upstart

Currently, the systemd daemons are not restarted on failure. This patch
adds this functionality and sets the defaults to those defined in
upstart. This resolves to 3 fails per 30 minutes for osd, mon and mds
and 5 fails per 30 seconds for radosgw.

Signed-off-by: Boris Ranto <branto@redhat.com>

rgw: call rgw_log_usage_finalize() on reconfiguration

RGWRealmReloader was calling rgw_log_usage_init() with the new RGWRados
instance, but never cleaned up the previous one with
rgw_log_usage_finalize()

Signed-off-by: Casey Bodley <cbodley@redhat.com>

test: image replayer needs dummy remote mirror peer uuid

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #8498 from liewegas/wip-bluestore

os/bluestore: fix shortened bluefs paths in env mirror case

rgw: RGWPeriod::reflect() sets master zonegroup as default

if RGWPeriod::reflect() is called right after a 'realm pull', it will
create the zonegroup objects but not set any as default.  so the next
time RGWRados is initialized, create_defaults() will add a new 'default'
zonegroup and set it as the master.  this causes a 'period update' to
find multiple master zonegroups and fail with EINVAL

reflect() now calls set_as_default(exclusive=true) on the master
zonegroup to guarantee that a default is set

Signed-off-by: Casey Bodley <cbodley@redhat.com>

journal: race possible when re-watching a journal object

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

os/bluestore: fix shortened bluefs paths in env mirror case

If we are mirroring the rocksdb env, don't shorten the
paths.

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #8556 from liewegas/wip-ext4

doc: recommend against ext4

Reviewed-by: Alfredo Deza <adeza@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.cz>

Merge pull request #8574 from tchaikov/wip-readable-test-fix

test/encoding/readable: use [ for "test" not ((

Reviewed-by: Erwan Velu <erwan@redhat.com>

Merge pull request #8567 from cbodley/wip-rgw-period-pull-url

radosgw-admin: allow 'period pull --url' without full multisite config
Reviewed-by: Orit Wasserman <owasserm@redhat.com>