doc/rados/operations/add-or-rm-mons: simplify the steps to add a mon

this change removes the step to "ceph mon add" before starting a new
monitor. because the existing leader will start an election at seeing
the MMonJoin message sent by the new joiner, after the quorum is
archieved, the monmap will be updated with the new monitor.
so, "ceph mon add" is not necessary to add a new monitor.
moreover, this command will be blocked until a new quorum is formed,
and the proposed monmap is accepted. but in case of adding a monitor
to a single monitor cluster, the leader will wait until at least two
of the monitors reply to it. apparently, this does not happen unless
the new monitor starts. so from the user's point of view, this
command hangs until timesout, if he/she does not start the mon.b
beforehand. but this is an expected behaviour.

so, to avoid this confusion and simplify the steps to add a new
monitor. we'd better simply remove this "ceph mon add" step.

Fixes: #12620
Signed-off-by: Kefu Chai <kchai@redhat.com>

Merge pull request #5344 from trhoden/update_debain_maintainer

debian: Update maintainers and uploaders

Reviewed-by: Ken Dreyer <kdreyer@redhat.com>

Fixed mistaken reference to mon in osd section. Changed release name to hammer.

Fixes: #7807
Signed-off-by: John Wilkins <jowilkin@redhat.com>

Merge pull request #5353 from ceph/wip-pgls-filter-osd

Make PGLSFilter interface more flexible (for cephfs)

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #5522 from oritwas/wip-cmake-fix-mds

cmake: fix mds compilation and link

Reviewed-by: John Spray <john.spray@redhat.com>

cmake: fix mds compilation and link

Rename MDS.cc MDSDaemon.cc
Add missing files and match order to the Makefile

Signed-off-by: Orit Wasserman <owasserm@redhat.com>

Merge branch 'wip-vumrao-12111' of https://github.com/vumrao/ceph

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

rbd: creating refused, if feature is specified when the format is equal to 1

Signed-off-by: x11562 <xie.na@h3c.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #5520 from badone/master

doc: remove duplicate word in Motivation section.

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #4927 from wonzhq/snapset-obc

osd/ReplicatedPG: snapset is not persisted

Merge pull request #5212 from ceph/wip-mds-refactor

mds: big refactor of MDS into MDSDaemon, MDSRank, MDSRank Dispatcher

doc: remove duplicate word in Motivation section.

Remove to\nto typo in doc/dev/osd_internals/erasure_coding/pgbackend.rst

Signed-off-by: Brad Hubbard <bhubbard@redhat.com>

Merge pull request #5517 from tchaikov/wip-cmake-remove-flat-index

cmake: remove Flat_index stuff

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #5515 from ceph/wip-make-check-fixes

several fixes for make check

Reviewed-by: Loic Dachary <ldachary@redhat.com>
Reviewed-by: David Zafman <dzafman@redhat.com>

Merge pull request #4683 from ceph/wip-siddharth-security-fixes

Enable security hardening flags globally

Testedj-by: Kefu Chai <kchai@redhat.com>

cmake: remove Flat_index stuff

the Flat_index stuff was removed in 5df688a

Signed-off-by: Kefu Chai <kchai@redhat.com>

Merge pull request #5504 from tchaikov/wip-check-good-yasm

cmake: check for good yasm

Removing unwanted -fPIC in cflags

Removing unwanted -grecord-gcc-switches , relro in cflags and adding -fPIC

Enable security hardening flags globally

Merge pull request #5293 from majianpeng/oprequest-markevent

osd: Oprequest markevent

Reviewed-by: Huang Jun <hjwsm1989@gmail.com>
Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #5267 from dachary/wip-12356-rados-osds-out-in

tests: test-erasure-code.sh/rados_osds_out_in must wait_for_clean

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #4909 from zhouyuan/rgw_doc_bucket_index

doc: update rgw configuration doc on bucket index sharing feature

Reviewed-by: Abhishek Lekshmanan <abhishek.lekshmanan@ril.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

test/encoding/check-generated: make error msg cut and pasteable

Signed-off-by: Sage Weil <sage@redhat.com>

osd/HitSet: make subclasses dump deterministically

Signed-off-by: Sage Weil <sage@redhat.com>

osd/HitSet: mark subclasses that encode nondeterministically

Signed-off-by: Sage Weil <sage@redhat.com>

mon/PGMap: dump osd_epochs in deterministic order

Signed-off-by: Sage Weil <sage@redhat.com>

test/encoding/check-generated: skip some tests if non-determinstic encoding

Signed-off-by: Sage Weil <sage@redhat.com>

ceph-dencoder: add 'is_deterministic' command

Signed-off-by: Sage Weil <sage@redhat.com>

ceph-dencoder: clean up macro name

Signed-off-by: Sage Weil <sage@redhat.com>

ceph-dencoder: mark PGMap with nondeterministic encoding

Signed-off-by: Sage Weil <sage@redhat.com>

test/encoding: c++11 STL appears to make fewer copies, yay

The failure was

test/encoding.cc:191: Failure
Value of: 10
Expected: my_key_t::get_copy_ctor()
Which is: 5
test/encoding.cc:196: Failure
Value of: 10
Expected: my_val_t::get_copy_ctor()
Which is: 5

Signed-off-by: Sage Weil <sage@redhat.com>

cmake: check for good yasm

this enables faster crc32 calculation on x64 intel platforms,
see common/crc32c_intel_fast.c

Signed-off-by: Kefu Chai <kchai@redhat.com>

Merge pull request #5500 from oritwas/wip-cmake-isa

cmake: check for better yasm and fix isa

Reviewed-by: Kefu Chai <kchai@redhat.com>

mon/PGMap: make PGMap dump osd_epochs too

Signed-off-by: Sage Weil <sage@redhat.com>

cmake: check for better yasm and fix isa

Signed-off-by: Orit Wasserman <owasserm@redhat.com>

ceph-object-corpus: do not try to decode pre-hammer ObjectStore::Transactions

We don't understand collection_attr any more.

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #5510 from yuyuyu101/fix-async-fix-22

AsyncConnection: Fix wrong order of local message delivering

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #5512 from ddiss/rbd_initrd_no_tr

rbdnamer: drop unneccessary tr usage

Reviewed-by: Sage Weil <sage@redhat.com>

rbdnamer: drop unneccessary tr usage

tr is not present by default in Dracut generated initramfs images. The
same logic can anyhow be performed via the existing sed call.

Signed-off-by: David Disseldorp <ddiss@suse.de>

Merge pull request #5310 from ceph/wip-pipefd-leak

Wip pipefd leak

Reviewed-by: Jianpeng Ma <jianpeng.ma@intel.com>

Merge pull request #5511 from ceph/wip-cxx11

c++11 ftw

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>

c++11: xlist needs a value_type for back_inserter

Signed-off-by: Casey Bodley <cbodley@redhat.com>

c++11: fix shared_ptr conversions to bool

operator bool() is marked as explicit, which prevents it from being used
directly in gtest macros

Signed-off-by: Casey Bodley <cbodley@redhat.com>

c++11: remove hash_namespace.h and default to std

Signed-off-by: Casey Bodley <cbodley@redhat.com>

c++11: disambiguate std::isnan

c++11's isnan() is a constexpr function, while c's is a macro

Signed-off-by: Casey Bodley <cbodley@redhat.com>

c++11: fixes for preprocessor string concatenation

c++11 adds user-defined literals through type suffixes. for example,
"foo"s is a literal of type std::basic_string. this means that any
non-whitespace characters following a string literal will be interpreted
as a suffix. this causes issues with string concatenation done by the
preprocessor, which can only be resolved by adding whitespace

Signed-off-by: Casey Bodley <cbodley@redhat.com>

c++11: replace boost::assign with initializer list

Signed-off-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #4832 from ceph/wip-11511

osd: Even in objects_read_sync() case don't read past oi.size

Reviewed-by: Samuel Just <sjust@redhat.com>

AsyncConnection: Fix wrong order of local message delivering

Signed-off-by: Haomai Wang <haomaiwang@gmail.com>

Merge pull request #5331 from liewegas/wip-collection-list

os: clean up collection_list

Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #5271 from wonzhq/cache-rate

mon: add cache tier IO rate in the 'osd pool stats' command

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #5507 from athanatos/wip-12436

blkdev.cc::get_device_by_uuid: do not leak cache

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #5506 from athanatos/wip-12338

OSD: break connection->session->waiting message->connection cycle

Reviewed-by: Sage Weil <sage@redhat.com>

os/ObjectStore: drop get_ideal_list_min()

Unused.  Fix comment on get_ideal_list_max while we are here.

Signed-off-by: Sage Weil <sage@redhat.com>

os: drop snapid_t arg to collection_list

All this does is filter out objects with old snapids, but this can be
just as easily done in the one caller that specifies a non-zero value
(PGLS and PGNLS), which in fact already do that filtering.

Signed-off-by: Sage Weil <sage@redhat.com>

s/collection_list_impl/collection_list/

Signed-off-by: Sage Weil <sage@redhat.com>

Kill collection_list in CollectionIndex

Now we use CollectionIndex.collection_list_partial.

Signed-off-by: Xiaoxi Chen <xiaoxi.chen@intel.com>

Kill Flat_index.

Too old, remove it entirely.

Signed-off-by: Xiaoxi Chen <xiaoxi.chen@intel.com>

Kill collection_list

use collection_list_impl as well.

Signed-off-by: Xiaoxi Chen <xiaoxi.chen@intel.com>

Kill collection_list_partial

Use collection_list_impl directly.

Signed-off-by: Xiaoxi Chen <xiaoxi.chen@intel.com>

Kill collection_list_range

We can directly use collection_list_impl.

Signed-off-by: Xiaoxi Chen <xiaoxi.chen@intel.com>

os/KeyValuestore:Refactor collection_list_range and collection_list_partial

Add collection_list_impl which abstract the common process
of collection list behavior.

Signed-off-by: Xiaoxi Chen <xiaoxi.chen@intel.com>

os/CollectionIndex: use const ref for end

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #5509 from ceph/wip-12536

common/hobject_t: correctly decode pre-infernalis hobject_t min

Reviewed-by: Samuel Just <sjust@redhat.com>

os/Filestore:Refactor collection_list_range and collection_list_partial

Add collection_list_impl which abstract the common process
of coleection list behavior.

Todo: Refactor Index::collection_list_partial as
well.

Signed-off-by: Xiaoxi Chen <xiaoxi.chen@intel.com>

os/Memstore:Refactor collection_list_range and collection_list_partial

Add collection_list_impl which abstract the common process
of collection list behavior.

Signed-off-by: Xiaoxi Chen <xiaoxi.chen@intel.com>

Merge pull request #5508 from athanatos/wip-12410

OSDMonitor::preprocess_get_osdmap: send the last map as well

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #5413 from guangyy/wip-12523

osd: copy the RecoveryCtx::handle for when creating RecoveryCtx instance from another one

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #5488 from oritwas/wip-cmake-fix-rbd

cmake: add global lib to rbd

Reviewed-by: John Spray <john.spray@redhat.com>

rbd: support size suffixes for size-based options

This patch will provide support for size suffixes for
below given options:

--stripe-unit <size in B/K/M>
--io-size <size in B/K/M/G/T>
--io-total <size in B/K/M/G/T>

Signed-off-by: Vikhyat Umrao <vumrao@redhat.com>

Merge pull request #5475 from cxwshawn/com-fix

rgw_user.h: modify interface comments.

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #5483 from oddomatik/patch-1

Fix location of --access=full in SWIFT user creation

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #5484 from cxwshawn/de-fix

ceph-dencoder: add RGWRegion, RGWZoneParams, RGWOLHInfo support.

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #5421 from ceph/wip-selinux-policy-no-user

SELinux support for ceph

Reviewed-by: Kefu Chai <kchai@redhat.com>
Tested-by: Yuri Weinstein <yweinstei@redhat.com>

Merge pull request #5487 from ceph/wip-12619

mds: initialize InodeStoreBase::damage_flags

Reviewed-by: John Spray <john.spray@redhat.com>

cmake: add global lib to rbd

Signed-off-by: Orit Wasserman <owasserm@redhat.com>

mds: initialize InodeStoreBase::damage_flags

Fixes: #12619
Signed-off-by: Yan, Zheng <zyan@redhat.com>

ceph-dencoder: add RGWRegion, RGWZoneParams, RGWOLHInfo support.

    since ceph-dencoder does not support the up-list structures, so
    I add these three supports to analyze data more quickly.

Signed-off-by: shawn chen <cxwshawn@gmail.com>

Fix location of --access=full in SWIFT user creation

--access=full was incorrectly placed in the output of the command, while it was supposed to have been a flag run with the command.

ceph.spec.in: Make SELinux opt-out, not opt-in

We should enable SELinux support by default on rpm-based systems that
build with SELinux support to get better QE coverage in future runs.

Signed-off-by: Boris Ranto <branto@redhat.com>

Merge pull request #5478 from dachary/wip-test-rados-striper

tests: rados striper tests use 7116 instead of 7113

Reviewed-by: Sebastien Ponce <sebastien.ponce@cern.ch>

Merge pull request #5459 from cxwshawn/master

radosgw-admin: use cout instead of cerr to print help message.

Reviewed-by: Sage Weil <sage@redhat.com>

osd: make PGLSFilter xattr read optional

The cephfs filter needs to be able to express
interest in an xattr, but not reject objects
which do not have it.

Signed-off-by: John Spray <john.spray@redhat.com>

osd: enable PGLS filters to see hobject_t

We will want this for CephFS, where the name's suffix
(i.e. .00000000) is important to us.

Signed-off-by: John Spray <john.spray@redhat.com>

selinux: Add .gitignore file

The gitbuilders release script needs this. Otherwise, the ceph-release
build will fail because there were some untracked files.

Signed-off-by: Boris Ranto <branto@redhat.com>

ceph.spec.in: stop/start service on policy upgrade/removal

Signed-off-by: Boris Ranto <branto@redhat.com>

selinux: Update the SELinux policy rules

Few new denials were found while testing the policy. Updating the policy
rules to refelct that.

Signed-off-by: Boris Ranto <branto@redhat.com>

SELinux Makefile can't work in parallel

We need to force single-core compilation of SELinux policy files in the
sub-make target as SELinux Makefile does not work properly when run in
parallel mode.

Signed-off-by: Boris Ranto <branto@redhat.com>

ceph-disk: set selinux context

Ensure that SELinux context is properly set according to policy.We
need this as SELinux context is not preserved across mount points.

Signed-off-by: Milan Broz <mbroz@redhat.com>

selinux: Allow setuid and setgid to ceph-mon and ceph-osd

Signed-off-by: Boris Ranto <branto@redhat.com>

Update selinux policy (after local test).

Changes enerated with ceph-test package.

Signed-off-by: Milan Broz <mbroz@redhat.com>

Fix selinux context after intitial OSD mount.

The SELinux context is not preserved across file-systems, we need to
manually set the context of the root of the file-system in order to
preserve SELinux context inheritence rules.

Signed-off-by: Milan Broz <mbroz@redhat.com>
Reviewed-by: Boris Ranto <branto@redhat.com>

Add initial SELinux support

This patch modifies the build system and spec file to provide a support
for SELinux enforcing in an opt-in matter via ceph-selinux package.

Signed-off-by: Boris Ranto <branto@redhat.com>

Merge pull request #4860 from ceph/wip-nobjectiterator-crash

librados: fix empty NObjectIterator crash on comparisons

Reviewed-by: Sage Weil <sage@redhat.com>

librados: fix empty NObjectIterator crash on comparisons

This would segfault if you did a
NObjectIterator i;
i == ...

Fix comparisons by allowing pointer-wise comparisons
for iterators with impl==NULL, and asserting in
other methods that require a non-null ::impl

Signed-off-by: John Spray <john.spray@redhat.com>

tests: rados striper tests use 7116 instead of 7113

Change src/test/libradosstriper/rados-striper.sh monitor address to 7116
because src/test/mon/osd-crush.sh uses 7113 already.

Signed-off-by: Loic Dachary <ldachary@redaht.com>

Merge pull request #5474 from kylinstorage/wip-sparse_read_bugfix

osd/ReplicatedPG: sparse read should return (extent_map, data_bufferlist)

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Haomai Wang <haomaiwang@gmail.com>

osd/ReplicatedPG: sparse read should return (extent_map, data_bufferlist)

Signed-off-by: Yunchuan Wen <yunchuanwen@ubuntukylin.com>

rgw_user.h: modify interface comments.

Signed-off-by: shawn chen <cxwshawn@gmail.com>