vstart: detect CEPH_BIN in stop.sh too

...for the benefit of rbd.

Signed-off-by: John Spray <john.spray@redhat.com>

ceph.in: detect paths in out of tree build

a la what we currently do for PYTHONPATH
and LD_LIBRARY_PATH, but for cmake out
of tree builds.

Signed-off-by: John Spray <john.spray@redhat.com>

vstart: detect and handle cmake environ

Signed-off-by: John Spray <john.spray@redhat.com>

vstart: enable more path customization

...for working with out-of-tree builds.

Signed-off-by: John Spray <john.spray@redhat.com>

Makefile: build ceph.in the cmake way

A little bit more of a tongue-twisting command line
to do string replacement, but saves us from having
separate ceph.in files for cmake vs autotools.

Signed-off-by: John Spray <john.spray@redhat.com>

ceph.in: use cmake-style substitution

Avoid need for separate ceph.in and ceph.in.cmake files.

Signed-off-by: John Spray <john.spray@redhat.com>

init-ceph.in: set executable bit

Scripts expect the generated init-ceph script
to be +x, and CMake does that if the file you
feed into it is +x.  This matches what we already
do with ceph.in.

Signed-off-by: John Spray <john.spray@redhat.com>

CMake: build dencoder at src/ceph-dencoder

...instead of in src/test/dencoder.

While the source lives in test/, the dencoder tool is built
and distributed as a first class binary, so it's awkward for
paths in dev/test to have it in a unique location.

Signed-off-by: John Spray <john.spray@redhat.com>

Merge pull request #5522 from oritwas/wip-cmake-fix-mds

cmake: fix mds compilation and link

Reviewed-by: John Spray <john.spray@redhat.com>

cmake: fix mds compilation and link

Rename MDS.cc MDSDaemon.cc
Add missing files and match order to the Makefile

Signed-off-by: Orit Wasserman <owasserm@redhat.com>

Merge branch 'wip-vumrao-12111' of https://github.com/vumrao/ceph

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

rbd: creating refused, if feature is specified when the format is equal to 1

Signed-off-by: x11562 <xie.na@h3c.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #5520 from badone/master

doc: remove duplicate word in Motivation section.

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #4927 from wonzhq/snapset-obc

osd/ReplicatedPG: snapset is not persisted

Merge pull request #5212 from ceph/wip-mds-refactor

mds: big refactor of MDS into MDSDaemon, MDSRank, MDSRank Dispatcher

doc: remove duplicate word in Motivation section.

Remove to\nto typo in doc/dev/osd_internals/erasure_coding/pgbackend.rst

Signed-off-by: Brad Hubbard <bhubbard@redhat.com>

Merge pull request #5517 from tchaikov/wip-cmake-remove-flat-index

cmake: remove Flat_index stuff

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #5515 from ceph/wip-make-check-fixes

several fixes for make check

Reviewed-by: Loic Dachary <ldachary@redhat.com>
Reviewed-by: David Zafman <dzafman@redhat.com>

Merge pull request #4683 from ceph/wip-siddharth-security-fixes

Enable security hardening flags globally

Testedj-by: Kefu Chai <kchai@redhat.com>

cmake: remove Flat_index stuff

the Flat_index stuff was removed in 5df688a

Signed-off-by: Kefu Chai <kchai@redhat.com>

Merge pull request #5504 from tchaikov/wip-check-good-yasm

cmake: check for good yasm

Removing unwanted -fPIC in cflags

Removing unwanted -grecord-gcc-switches , relro in cflags and adding -fPIC

Enable security hardening flags globally

Merge pull request #5293 from majianpeng/oprequest-markevent

osd: Oprequest markevent

Reviewed-by: Huang Jun <hjwsm1989@gmail.com>
Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #5267 from dachary/wip-12356-rados-osds-out-in

tests: test-erasure-code.sh/rados_osds_out_in must wait_for_clean

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #4909 from zhouyuan/rgw_doc_bucket_index

doc: update rgw configuration doc on bucket index sharing feature

Reviewed-by: Abhishek Lekshmanan <abhishek.lekshmanan@ril.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

test/encoding/check-generated: make error msg cut and pasteable

Signed-off-by: Sage Weil <sage@redhat.com>

osd/HitSet: make subclasses dump deterministically

Signed-off-by: Sage Weil <sage@redhat.com>

osd/HitSet: mark subclasses that encode nondeterministically

Signed-off-by: Sage Weil <sage@redhat.com>

mon/PGMap: dump osd_epochs in deterministic order

Signed-off-by: Sage Weil <sage@redhat.com>

test/encoding/check-generated: skip some tests if non-determinstic encoding

Signed-off-by: Sage Weil <sage@redhat.com>

ceph-dencoder: add 'is_deterministic' command

Signed-off-by: Sage Weil <sage@redhat.com>

ceph-dencoder: clean up macro name

Signed-off-by: Sage Weil <sage@redhat.com>

ceph-dencoder: mark PGMap with nondeterministic encoding

Signed-off-by: Sage Weil <sage@redhat.com>

test/encoding: c++11 STL appears to make fewer copies, yay

The failure was

test/encoding.cc:191: Failure
Value of: 10
Expected: my_key_t::get_copy_ctor()
Which is: 5
test/encoding.cc:196: Failure
Value of: 10
Expected: my_val_t::get_copy_ctor()
Which is: 5

Signed-off-by: Sage Weil <sage@redhat.com>

cmake: check for good yasm

this enables faster crc32 calculation on x64 intel platforms,
see common/crc32c_intel_fast.c

Signed-off-by: Kefu Chai <kchai@redhat.com>

Merge pull request #5500 from oritwas/wip-cmake-isa

cmake: check for better yasm and fix isa

Reviewed-by: Kefu Chai <kchai@redhat.com>

mon/PGMap: make PGMap dump osd_epochs too

Signed-off-by: Sage Weil <sage@redhat.com>

cmake: check for better yasm and fix isa

Signed-off-by: Orit Wasserman <owasserm@redhat.com>

ceph-object-corpus: do not try to decode pre-hammer ObjectStore::Transactions

We don't understand collection_attr any more.

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #5510 from yuyuyu101/fix-async-fix-22

AsyncConnection: Fix wrong order of local message delivering

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #5512 from ddiss/rbd_initrd_no_tr

rbdnamer: drop unneccessary tr usage

Reviewed-by: Sage Weil <sage@redhat.com>

rbdnamer: drop unneccessary tr usage

tr is not present by default in Dracut generated initramfs images. The
same logic can anyhow be performed via the existing sed call.

Signed-off-by: David Disseldorp <ddiss@suse.de>

Merge pull request #5310 from ceph/wip-pipefd-leak

Wip pipefd leak

Reviewed-by: Jianpeng Ma <jianpeng.ma@intel.com>

Merge pull request #5511 from ceph/wip-cxx11

c++11 ftw

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>

c++11: xlist needs a value_type for back_inserter

Signed-off-by: Casey Bodley <cbodley@redhat.com>

c++11: fix shared_ptr conversions to bool

operator bool() is marked as explicit, which prevents it from being used
directly in gtest macros

Signed-off-by: Casey Bodley <cbodley@redhat.com>

c++11: remove hash_namespace.h and default to std

Signed-off-by: Casey Bodley <cbodley@redhat.com>

c++11: disambiguate std::isnan

c++11's isnan() is a constexpr function, while c's is a macro

Signed-off-by: Casey Bodley <cbodley@redhat.com>

c++11: fixes for preprocessor string concatenation

c++11 adds user-defined literals through type suffixes. for example,
"foo"s is a literal of type std::basic_string. this means that any
non-whitespace characters following a string literal will be interpreted
as a suffix. this causes issues with string concatenation done by the
preprocessor, which can only be resolved by adding whitespace

Signed-off-by: Casey Bodley <cbodley@redhat.com>

c++11: replace boost::assign with initializer list

Signed-off-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #4832 from ceph/wip-11511

osd: Even in objects_read_sync() case don't read past oi.size

Reviewed-by: Samuel Just <sjust@redhat.com>

AsyncConnection: Fix wrong order of local message delivering

Signed-off-by: Haomai Wang <haomaiwang@gmail.com>

Merge pull request #5331 from liewegas/wip-collection-list

os: clean up collection_list

Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #5271 from wonzhq/cache-rate

mon: add cache tier IO rate in the 'osd pool stats' command

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #5507 from athanatos/wip-12436

blkdev.cc::get_device_by_uuid: do not leak cache

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #5506 from athanatos/wip-12338

OSD: break connection->session->waiting message->connection cycle

Reviewed-by: Sage Weil <sage@redhat.com>

os/ObjectStore: drop get_ideal_list_min()

Unused.  Fix comment on get_ideal_list_max while we are here.

Signed-off-by: Sage Weil <sage@redhat.com>

os: drop snapid_t arg to collection_list

All this does is filter out objects with old snapids, but this can be
just as easily done in the one caller that specifies a non-zero value
(PGLS and PGNLS), which in fact already do that filtering.

Signed-off-by: Sage Weil <sage@redhat.com>

s/collection_list_impl/collection_list/

Signed-off-by: Sage Weil <sage@redhat.com>

Kill collection_list in CollectionIndex

Now we use CollectionIndex.collection_list_partial.

Signed-off-by: Xiaoxi Chen <xiaoxi.chen@intel.com>

Kill Flat_index.

Too old, remove it entirely.

Signed-off-by: Xiaoxi Chen <xiaoxi.chen@intel.com>

Kill collection_list

use collection_list_impl as well.

Signed-off-by: Xiaoxi Chen <xiaoxi.chen@intel.com>

Kill collection_list_partial

Use collection_list_impl directly.

Signed-off-by: Xiaoxi Chen <xiaoxi.chen@intel.com>

Kill collection_list_range

We can directly use collection_list_impl.

Signed-off-by: Xiaoxi Chen <xiaoxi.chen@intel.com>

os/KeyValuestore:Refactor collection_list_range and collection_list_partial

Add collection_list_impl which abstract the common process
of collection list behavior.

Signed-off-by: Xiaoxi Chen <xiaoxi.chen@intel.com>

os/CollectionIndex: use const ref for end

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #5509 from ceph/wip-12536

common/hobject_t: correctly decode pre-infernalis hobject_t min

Reviewed-by: Samuel Just <sjust@redhat.com>

os/Filestore:Refactor collection_list_range and collection_list_partial

Add collection_list_impl which abstract the common process
of coleection list behavior.

Todo: Refactor Index::collection_list_partial as
well.

Signed-off-by: Xiaoxi Chen <xiaoxi.chen@intel.com>

os/Memstore:Refactor collection_list_range and collection_list_partial

Add collection_list_impl which abstract the common process
of collection list behavior.

Signed-off-by: Xiaoxi Chen <xiaoxi.chen@intel.com>

Merge pull request #5508 from athanatos/wip-12410

OSDMonitor::preprocess_get_osdmap: send the last map as well

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #5413 from guangyy/wip-12523

osd: copy the RecoveryCtx::handle for when creating RecoveryCtx instance from another one

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #5488 from oritwas/wip-cmake-fix-rbd

cmake: add global lib to rbd

Reviewed-by: John Spray <john.spray@redhat.com>

rbd: support size suffixes for size-based options

This patch will provide support for size suffixes for
below given options:

--stripe-unit <size in B/K/M>
--io-size <size in B/K/M/G/T>
--io-total <size in B/K/M/G/T>

Signed-off-by: Vikhyat Umrao <vumrao@redhat.com>

Merge pull request #5475 from cxwshawn/com-fix

rgw_user.h: modify interface comments.

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #5483 from oddomatik/patch-1

Fix location of --access=full in SWIFT user creation

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #5484 from cxwshawn/de-fix

ceph-dencoder: add RGWRegion, RGWZoneParams, RGWOLHInfo support.

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #5421 from ceph/wip-selinux-policy-no-user

SELinux support for ceph

Reviewed-by: Kefu Chai <kchai@redhat.com>
Tested-by: Yuri Weinstein <yweinstei@redhat.com>

Merge pull request #5487 from ceph/wip-12619

mds: initialize InodeStoreBase::damage_flags

Reviewed-by: John Spray <john.spray@redhat.com>

cmake: add global lib to rbd

Signed-off-by: Orit Wasserman <owasserm@redhat.com>

mds: initialize InodeStoreBase::damage_flags

Fixes: #12619
Signed-off-by: Yan, Zheng <zyan@redhat.com>

ceph-dencoder: add RGWRegion, RGWZoneParams, RGWOLHInfo support.

    since ceph-dencoder does not support the up-list structures, so
    I add these three supports to analyze data more quickly.

Signed-off-by: shawn chen <cxwshawn@gmail.com>

Fix location of --access=full in SWIFT user creation

--access=full was incorrectly placed in the output of the command, while it was supposed to have been a flag run with the command.

ceph.spec.in: Make SELinux opt-out, not opt-in

We should enable SELinux support by default on rpm-based systems that
build with SELinux support to get better QE coverage in future runs.

Signed-off-by: Boris Ranto <branto@redhat.com>

Merge pull request #5478 from dachary/wip-test-rados-striper

tests: rados striper tests use 7116 instead of 7113

Reviewed-by: Sebastien Ponce <sebastien.ponce@cern.ch>

Merge pull request #5459 from cxwshawn/master

radosgw-admin: use cout instead of cerr to print help message.

Reviewed-by: Sage Weil <sage@redhat.com>

selinux: Add .gitignore file

The gitbuilders release script needs this. Otherwise, the ceph-release
build will fail because there were some untracked files.

Signed-off-by: Boris Ranto <branto@redhat.com>

ceph.spec.in: stop/start service on policy upgrade/removal

Signed-off-by: Boris Ranto <branto@redhat.com>

selinux: Update the SELinux policy rules

Few new denials were found while testing the policy. Updating the policy
rules to refelct that.

Signed-off-by: Boris Ranto <branto@redhat.com>

SELinux Makefile can't work in parallel

We need to force single-core compilation of SELinux policy files in the
sub-make target as SELinux Makefile does not work properly when run in
parallel mode.

Signed-off-by: Boris Ranto <branto@redhat.com>

ceph-disk: set selinux context

Ensure that SELinux context is properly set according to policy.We
need this as SELinux context is not preserved across mount points.

Signed-off-by: Milan Broz <mbroz@redhat.com>

selinux: Allow setuid and setgid to ceph-mon and ceph-osd

Signed-off-by: Boris Ranto <branto@redhat.com>

Update selinux policy (after local test).

Changes enerated with ceph-test package.

Signed-off-by: Milan Broz <mbroz@redhat.com>

Fix selinux context after intitial OSD mount.

The SELinux context is not preserved across file-systems, we need to
manually set the context of the root of the file-system in order to
preserve SELinux context inheritence rules.

Signed-off-by: Milan Broz <mbroz@redhat.com>
Reviewed-by: Boris Ranto <branto@redhat.com>

Add initial SELinux support

This patch modifies the build system and spec file to provide a support
for SELinux enforcing in an opt-in matter via ceph-selinux package.

Signed-off-by: Boris Ranto <branto@redhat.com>

Merge pull request #4860 from ceph/wip-nobjectiterator-crash

librados: fix empty NObjectIterator crash on comparisons

Reviewed-by: Sage Weil <sage@redhat.com>

librados: fix empty NObjectIterator crash on comparisons

This would segfault if you did a
NObjectIterator i;
i == ...

Fix comparisons by allowing pointer-wise comparisons
for iterators with impl==NULL, and asserting in
other methods that require a non-null ::impl

Signed-off-by: John Spray <john.spray@redhat.com>

tests: rados striper tests use 7116 instead of 7113

Change src/test/libradosstriper/rados-striper.sh monitor address to 7116
because src/test/mon/osd-crush.sh uses 7113 already.

Signed-off-by: Loic Dachary <ldachary@redaht.com>

Merge pull request #5474 from kylinstorage/wip-sparse_read_bugfix

osd/ReplicatedPG: sparse read should return (extent_map, data_bufferlist)

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Haomai Wang <haomaiwang@gmail.com>