Add common/PluginRegistry.cc to CMakeLists.txt

Else this happens:

  [ 15%] Linking CXX executable ceph-authtool
  libcommon.a(ceph_context.cc.o): In function `CephContext::CephContext(unsigned int, int)':
  ceph_context.cc:(.text+0x2620): undefined reference to `ceph::PluginRegistry::PluginRegistry(CephContext*)'
  libcommon.a(ceph_context.cc.o): In function `CephContext::~CephContext()':
  ceph_context.cc:(.text+0x3db0): undefined reference to `ceph::PluginRegistry::~PluginRegistry()'
  collect2: error: ld returned 1 exit status
  src/CMakeFiles/ceph-authtool.dir/build.make:120: recipe for target 'src/ceph-authtool' failed
  make[2]: *** [src/ceph-authtool] Error 1
  CMakeFiles/Makefile2:331: recipe for target 'src/CMakeFiles/ceph-authtool.dir/all' failed

The ceph_context.cc is the only user of PluginRegistry at
present, so adding it without conditionals should be correct.

Signed-Off-By: Pete Zaitcev <zaitcev@redhat.com>

Merge pull request #6641 from aclamk/wip-log-alloc-predictor

common: log: predict log message buffer allocation size

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #6642 from 0003ydlom/decode_reorder

osd: move newest decode version of MOSDOp and MOSDOpReply to the front

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #6696 from Ved-vampir/wip_common_plugin

common: add generic plugin infrastructure

Reviewed-by: Varada Kari <varada.kari@sandisk.com>

Merge pull request #6779 from ceph/wip-librados-xattr

librados: avoid malloc(0) (which can return NULL on some platforms)

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #6759 from liewegas/wip-bdev-probe

osd: make backend and block device code a bit more generic

Reviewed-by: Loic Dachary <ldachary@redhat.com>
Reviewed-by: Varada Kari <varada.kari@sandisk.com>

Merge pull request #6686 from stiopaa1/namespace_buffer

common: use namespace instead of subclasses for buffer

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #6535 from mslovy/wip-crc-cache-tracker

common: buffer: add cached_crc and cached_crc_adjust counts to perf dump

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #6058 from guangyy/wip-pg-query

osd: dump number of missing objects for each peer with pg query

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #5953 from guangyy/wip-13121

osd: support pool level recovery_priority and recovery_op_priority

Reviewed-by: David Zafman <dzafman@redhat.com>

Merge pull request #5670 from david-z/master

osd: FileJournal: reduce locking scope in write_aio_bl

Reviewed-by: Haomai Wang <haomai@xsky.com>

Merge pull request #6798 from trociny/fix-rbd_mirror-bool

librbd: include missing header for bool type

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

librbd: include missing header for bool type

Signed-off-by: Mykola Golub <mgolub@mirantis.com>

Merge pull request #6129 from dillaman/wip-13292

RBD pool mirroring configuration API + CLI

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #6780 from smithfarm/wip-index-20151201

doc/dev/index.rst: fix headings

Reviewed-by: Loic Dachary <ldachary@redhat.com>

Merge pull request #6786 from oritwas/wip-cmake-fix-radosgw

cmake: add rgw_basic_types.cc to librgw.a

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>

doc/dev/index.rst: fix links

Signed-off-by: Nathan Cutler <ncutler@suse.com>

doc/dev/index.rst: Flesh out the IRC section

Signed-off-by: Nathan Cutler <ncutler@suse.com>

doc/dev/index.rst: Make Issue tracker a separate chapter

Signed-off-by: Nathan Cutler <ncutler@suse.com>

Merge pull request #6789 from dillaman/wip-13969

librbd: partial revert of commit 9b0e359

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #6748 from liewegas/wip-fix-cephtool

qa/workunits/cephtool/test.sh: no ./

Reviewed-by: Loic Dachary <ldachary@redhat.com>

Merge pull request #5941 from jcsp/wip-12137

#12137: cephfs-data-scan scan_frags

Merge pull request #6777 from dillaman/wip-librbd-lockdep

librbd: journaling-related lock dependency cleanup

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #6762 from dillaman/wip-13924

journal: fire replay complete event after reading last object

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #6703 from dillaman/wip-tests-librbd-gmock-state-machines

librbd: initial collection of state machine unit tests

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

librbd: partial revert of commit 9b0e359

Fixes: #13969
Signed-off-by: Jason Dillaman <dillaman@redhat.com>

doc/dev/index.rst: start writing Bugfixing chapter

Signed-off-by: Nathan Cutler <ncutler@suse.com>

Merge pull request #6690 from branch-predictor/bp-smaller-pglog-2

osd: slightly reduce actual size of pg_log_entry_t

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #6689 from 0003ydlom/doubled_cond

osd: avoid duplicate op->mark_started in ReplicatedBackend

Reviewed-by: xinxin shu <xinxin.shu@intel.com>

Merge pull request #6681 from ifed01/wip-objstore-bench-stabilization

ceph_objectstore_bench: fix race condition, bugs

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #6677 from jack-changtao/test-bench

rados: bench: fix off-by-one to avoid writing past object_size

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #6555 from mslovy/wip-reduce-omap-transaction

osd: don't update epoch and rollback_info objects attrs if there is no need

Reviewed-by: Sage Weil <sage@redhat.com>

cmake: add rgw_basic_types.cc to librgw.a

Signed-off-by: Orit Wasserman <owasserm@redhat.com>

doc/dev/index.rst: rewrite introductory material

Signed-off-by: Nathan Cutler <ncutler@suse.com>

Merge pull request #6784 from ceph/wip-5073

rgw multitenancy

Buckets and users can now have a tenant associated with them. Buckets can be specified as [<tenant>:]<bucket> and users can be specified as [<tenant>$]<uid>. The existing users and buckets are part of the default global tenant.
This is first phase. Future work will add tighter integration (e.g., swift tenant mapping, s3 subdomain tenant mapping, etc.)

Reviewed-by: Pete Zaitcev <zaitcev@redhat.com>
Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>

qa: add a test for the recovery_priority/recovery_op_priority pool settings.

Signed-off-by: Guang Yang <yguang@yahoo-inc.com>

mon: support recovery_priority and recovery_op_priority with monitor commands

Fixes: 13121
Signed-off-by: Guang Yang yguang@yahoo-inc.com

osd: prioritize recovery based on pool's customized priority

Fixes: 13121
Signed-off-by: Guang Yang <yguang@yahoo-inc.com>

doc/dev/index.rst: fix headings

This commit fixes the headings so they render properly on http://ceph.com

Signed-off-by: Nathan Cutler <ncutler@suse.com>

Merge pull request #6727 from smithfarm/wip-index

doc/dev/index.rst: begin writing Contributing to Ceph

Reviewed-by: Loic Dachary <ldachary@redhat.com>

doc/dev/index.rst: begin writing Contributing to Ceph

Replace existing index.rst with the beginnings of a comprehensive
developer guide.

Move the old index.rst to index-old.rst.

Signed-off-by: Nathan Cutler <ncutler@suse.com>

common: lockdep now tracks lock ordering when backtraces disabled

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

librbd: correct lock ordering issues discovered by lockdep

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #6775 from mkoderer/doc/fixowner

doc: remove unnecessary period in headline

Reviewed-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>

doc: remove unnecessary period in headline

Signed-off-by: Marc Koderer <marc@koderer.com>

journal: correct lock ordering issues discovered by lockdep

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

rgw: remove comments

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: a minor cleanup

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: don't re-set bucket tenant and name when selecting location

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: fix a typo

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: don't allow cross-tenant bucket creation

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: avoid calling rgw_make_bucket_entry_name() when not needed

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: objexp hint name backward compatibility

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

rgw: inherit bucket tenant from user if not specified

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

Merge pull request #6739 from dreamhost/wip-13920

Gentoo: _FORTIFY_SOURCE fix.

Reviewed-by: Samuel Just <sjust@redhat.com>

tests: added new rbd mirroring CLI commands

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #6771 from dillaman/wip-backtrace-fixes

common: re-enable backtrace support

Reviewed-by: Loic Dachary <ldachary@redhat.com>

rbd: add new 'mirror pool' rbd commands

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

tests: librbd new pool mirror API methods

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

librbd: new pool mirror API methods

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

ceph-dencoder: new cls::rbd::MirrorPeer type

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

test: new cls_rbd methods for pool mirroring

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

cls_rbd: new methods for handling mirroring

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

tests: initial set of test cases for op state machines

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

librbd: snap create doesn't properly handle race conditions

The ESTALE result code was being filtered out, preventing the retry
logic.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

librbd: use md_ctx for self-managed snapshot management

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

librbd: convert op state machines to templates

Using templates allows the creation of mocked test cases to
verify non-librados expectations.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

tests: add gmock unit tests for librbd object map state machines

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

librbd: ensure object map is invalidated on disk if forced

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #6657 from kylinstorage/wip-rbd-nbd

rbd-nbd: network block device (NBD) support for RBD

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #6769 from aiicore/configure_fix

configure.ac: macro fix

Reviewed-by: Boris Ranto <branto@redhat.com>

common: PluginRegistry modification

common: PluginRegistry

Generic plugin loader.  Based on the ErasureCodePlugin.

Signed-off-by: Sage Weil <sage@redhat.com>
Conflicts:
src/common/Makefile.am
src/common/ceph_context.cc
src/common/ceph_context.h

missing files

configure.ac: macro fix

Configure fails with autoconf 2.63 on Centos 6.6 with:

./configure: line 34026: syntax error near unexpected token `newline'
./configure: line 34026: `  yes:no:'

Signed-off-by: Igor Podoski <igor.podoski@ts.fujitsu.com>

Merge pull request #5685 from ceph/wip-12133

cephfs-data-scan: scrub tag filtering (#12133 and #12145)

tools/cephfs: enable tag filter in DataScan

Fixes: #12133
Signed-off-by: John Spray <john.spray@redhat.com>

tools/cephfs: fix datascan kwarg parsing

Signed-off-by: John Spray <john.spray@redhat.com>

cls_cephfs: add PGLSCephFSFilter

Special purpose filter for use with CephFS disaster
recovery.

Fixes: #12145
Signed-off-by: John Spray <john.spray@redhat.com>

common: re-enable backtrace support

A recent porting effort disabled support for backtrace creation.  It
also didn't initialize all variables, which would lead to a crash when
deleting a backtrace instance.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #6719 from jcsp/wip-13898

tools: Fix layout handing in cephfs-data-scan (#13898)

Update man page for new rbd nbd command

Signed-off-by: Yunchuan Wen <yunchuan.wen@kylin-cloud.com>

update test_librbd_fsx to support rbd-nbd

Signed-off-by: Yunchuan Wen <yunchuan.wen@kylin-cloud.com>

add rbd-nbd man page reference

Signed-off-by: Yunchuan Wen <yunchuan.wen@kylin-cloud.com>

add rbd-nbd wrap to rbd CLI

Signed-off-by: Yunchuan Wen <yunchuan.wen@kylin-cloud.com>

Merge pull request #6661 from xiaoxichen/rbd_misc_fix1

cls/cls_rbd.cc: fix misused metadata_name_from_key

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

cls/cls_rbd.cc: no need to skip key == after.

We already skip the pair where key == after in both LevelDBWholeSpaceIteratorImpl::upper_bound
and RocksDBWholeSpaceIteratorImpl::upper_bound.

Fixes: #13922
Signed-off-by: Xiaoxi Chen <xiaoxi.chen@intel.com>

journal: fire replay complete event after reading last object

Fixes: #13924
Signed-off-by: Jason Dillaman <dillaman@redhat.com>

osd: add recovery_priority and recovery_op_priority to pool_opts_t

Fixes: 13121
Signed-off-by: Guang Yang <yguang@yahoo-inc.com>

tests and tools/scratchtool: Don't attempt to use NULL xattr

Prior commit changes rados{striper}_getxattrs_next to be able to return
NULL in the 'val' param.  Handle that.

Fixes: #13944
Signed-off-by: Dan Mick <dan.mick@redhat.com>

librados.cc: rados_getxattrs_next: don't try to use malloc(0)

If an xattr is 0 length, don't try to malloc a buffer for the value;
leave it NULL.  (Linux doesn't promise malloc(0) returns a pointer,
and other implementations, like AIX, definitely return NULL.)

Usage changes are in following commits.

Fixes: #13944
Signed-off-by: Dan Mick <dan.mick@redhat.com>

osd: mark osd backend type in osd_data dir

When we create an osd, mark the type of the backend in the
osd_data dir in the 'type' file.  On startup, if this file is
present, us this to decide which ObjectStore to instantiate.  If
it is not present, use the osd_objectstore option as before.

Signed-off-by: Sage Weil <sage@redhat.com>

osd: make block device fsid probing generic

Currently the option name and invocation assume that the block device
is a journal (and FileStore journal, managed by FileJournal).  Rework
the interface so that we can probe any block device and other ObjectStore
implementations will have a chance to identify the device (and return the
osd fsid).

Switch to a static method while we are at it so we avoid instantiating
each backend.

Note that only FileStore is probed at the moment; that will change soon!

Signed-off-by: Sage Weil <sage@redhat.com>

Implemented log message size predictor. It tracks size of log messages.
Initial allocation size is derived from last log message from the same line of code.
Fixed bug in test.

Signed-off-by: Adam Kupczyk <akupczyk@mirantis.com>

Merge pull request #6742 from dillaman/wip-13913

librbd: automatically flush IO after blocking write operations

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

init-ceph: fix systemd-run cant't start ceph daemon sometimes

Fixes: #13474
Signed-off-by: Chuanhong Wang <wang.chuanhong@zte.com.cn>

Merge pull request #6749 from dachary/wip-doc-install

doc: INSTALL redirect to online documentation

Reviewed-by: Loic Dachary <ldachary@redhat.com>

tools/cephfs: fix layout handling in injection

When the stashed-layout handling stuff was added,
the guessing part got lost from the path where
we only had a single object.  Broke test_data_scan.

Signed-off-by: John Spray <john.spray@redhat.com>

Merge pull request #6729 from majianpeng/librbd-journal

librbd: only send signal when AIO completions queue empty

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #6751 from ceph/wip-cmake-strerror_r

cmake: define STRERROR_R_CHAR_P for GNU-specific strerror_r

Reviewed-by: John Spray <john.spray@redhat.com>

Merge pull request #5465 from yuyuyu101/wip-librbd-ap

librbd: support eventfd for AIO completion notifications

Reviewed-by: Jason Dillaman <dillaman@redhat.com>