doc: MDS internal data structure

Signed-off-by: Yan, Zheng <zyan@redhat.com>

mds: remove MDSCacheObject::get_pin_totals()

MDSCacheObject::get_pin_totals() is debug code of debug code, which
is not quite useful.

Signed-off-by: Yan, Zheng <zyan@redhat.com>

mds: optimize CDir::is_{freezing,frozen}_tree()

avoid checking ancestor CDir(s) when there is no freezing/frozen tree

Signed-off-by: Yan, Zheng <zyan@redhat.com>

mds: optimize get_projected_{xattrs,srnode}

these two functions traverse the whole projected_nodes list if there
is no projected xatts/srnode. busy directory inode can have large
projected_nodes list.

Signed-off-by: Yan, Zheng <zyan@redhat.com>

mds: use compact_map/compact_set to optimize memory usage of CDir

define some rarely used containers as compact_map/compact_set. Each
replacement can save 40 bytes for 64 bits program.

Signed-off-by: Yan, Zheng <zyan@redhat.com>

mds: dynamiclly allocate data structures for file locks

Size of ceph_lock_state_t is about 200 bytes, CInode contains two
ceph_lock_state_t. Dynamiclly allocating them can save about 400
bytes.

Signed-off-by: Yan, Zheng <zyan@redhat.com>

mds: use compact_map/compact_set to optimize memory usage of CInode

define some rarely used containers as compact_map/compact_set. Each
replacement can save 40 bytes for 64 bits program.

Signed-off-by: Yan, Zheng <zyan@redhat.com>

mds: optimize memory usage of inode_t

inode_t::old_pools is rarely used. Defining it as compact_set can save
40 bytes. inline_data is also rarely used, dynamiclly allocating bufferlist
for inline_data can save another 72 bytes.

Signed-off-by: Yan, Zheng <zyan@redhat.com>

mds: optimize memory usage of class InodeStore

InodeStore::old_inodes and InodeStore::snap_blob are for snapshotted
inode only. their size are 48 bytes and 80 bytes respectively. Defining
InodeStore::old_inodes can save 40 bytes, allocating bufferlist for
snap_blob dynamiclly can save 72 bytes.

Signed-off-by: Yan, Zheng <zyan@redhat.com>

mds: use compact_map to optimize memory usage of MDSCacheObject

Replica map and waiting list in MDSCacheObject are rarely used and
mostly empty. Defining them as compact_map can save 80 bytes for 64
bits program.

Signed-off-by: Yan, Zheng <zyan@redhat.com>

fragtree_t: define fragtree_t::_splits as compact_map

In most case, directory inode only contain one dirfrag. So fragtree_t
for most directory inode is empty. define fragtree_t::_splits as
compact_map can reduce memory usage of CInode.

Signed-off-by: Yan, Zheng <zyan@redhat.com>

introduce compact_set and compact_map

They are wrapper classes of std::set and std::map, which only contain a
pointer to the actual std::set/std::map. They are aimed for replacing
std::set/std::map for class members which are rarely used and mostly
empty. Replacing each std::set/std::map can save 40 bytes for 64 bits
program.

Signed-off-by: Yan, Zheng <zyan@redhat.com>

Merge pull request #3757 from theanalyst/0.93/contributors

mailmap updates

Reviewed-by: Loic Dachary <ldachary@redhat.com>

mailmap: Kefu Chai affiliation

Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@ril.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

mailmap: Andy Allan affiliation

Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@ril.com>

mailmap: Anis Ayari affiliation

Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@ril.com>
Reviewed-by: Loic Dachary <loic@dachary.org>

mailmap: Armando Segnini affiliation

Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@ril.com>

mailmap: Billy Olsen affiliation

Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@ril.com>
Reviewed-by: Billy Olsen <billy.olsen@canonical.com>

mailmap: Ahoussi Armand affiliation

Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@ril.com>

mailmap: Hazem Amara affiliation

Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@ril.com>

mailmap: Karel Striegel affiliation

Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@ril.com>

mailmap: Florian Coste affiliation

Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@ril.com>

mailmap: Petr Machata affiliation

Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@ril.com>

mailmap: Shanggao Qiu affiliation

Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@ril.com>

mailmap: Thomas Cantin affiliation

Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@ril.com>

mailmap: Tim Freund affiliation

Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@ril.com>

mailmap: Travis Rhoden affiliation

Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@ril.com>

mailmap: Kiseleva Alyona affiliation

Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@ril.com>
Reviewed-by: Loic Dachary <loic@dachary.org>

mailmap: Baptiste Veuillez affiliation

Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@ril.com>

mailmap: Viktor Suprun affiliation

Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@ril.com>

mailmap: Feng He affiliation

Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@ril.com>

mailmap: Jian Wen affiliation

Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@ril.com>
Reviewed-by: Jian Wen <wenjian@letv.com>

mailmap: Kim Vandry affiliation

Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@ril.com>

mailmap: Robert Jansen affiliation

Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@ril.com>

mailmap: MingXin Liu affiliation

Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@ril.com>

mailmap: Andrew Bartlett affiliation

Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@ril.com>
Reviewed-by: Andrew Bartlett <abartlet@catalyst.net.nz>

Merge pull request #3787 from ceph/wip-da-SCA-20150219

SCA fixes

Reviewed-by: Kefu Chai <kchai@redhat.com>

Corrected arch diagram signed off by: pmcgarry@redhat.com

test/librados/misc.cc: fix -Wsign-compare

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>

Merge pull request #3785 from ceph/wip-da-doc-erasure

doc: add erasure-code-shec to plugin list

Reviewed-by: Loic Dachary <ldachary@redhat.com>

doc: add erasure-code-shec to plugin list

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>

fix build with clang/clang++

Fix for:

./include/types.h:121:9: error: call to function 'operator<<'
that is neither visible in the template definition nor found
by argument-dependent lookup

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>

Merge pull request #3784 from Ved-vampir/master

common: add perf counters description

Reviewed-by: Loic Dachary <ldachary@redhat.com>

Merge pull request #3783 from tchaikov/update-doc

doc: update doc with latest code

Reviewed-by: Loic Dachary <ldachary@redhat.com>

common: add perf counters description

Signed-off-by: Kiseleva Alyona <akiselyova@mirantis.com>

erasure-code/shec/shec.cc: fix resource leak

Free tmpmat in error case. Fix for:

[src/erasure-code/shec/shec.cc:176]: (error) Memory leak: tmpmat

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>

TestErasureCodeShec_all.cc: prefer ++operator for non-primitive iter

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>

osd/osd_types.cc: prefer ++operator for non-primitive iter

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>

mon/PGMap.cc: prefer ++operator for non-primitive iter

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>

erasure-code/shec/shec.cc: reduce scope of variables

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>

ErasureCodeShec.cc: prefer ++operator for non-primitive iter

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>

libradosstriper/striping.cc: fix resource leak

Fix for:

CID 1221525 (#1 of 1): Resource leak (RESOURCE_LEAK)
 leaked_storage: Failing to save or free storage allocated
 by this->getObjName(soid, 0UL) leaks it.

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>

doc: update doc with latest code

* also silence some warnings of doxygen

Signed-off-by: Kefu Chai <kchai@redhat.com>

Merge pull request #3782 from ceph/hadoop-workunits

Hadoop workunits

Merge pull request #3753 from ceph/wip-10743

mds: wait for mydir replicas to go away in stopping

Reviewed-by: Greg Farnum <gfarnum@redhat.com>

Merge pull request #3775 from ceph/wip-10862

mon: do not try and "deactivate" the last MDS

Reviewed-by: Greg Farnum <gfarnum@redhat.com>

qa: update old replication tests

Signed-off-by: Noah Watkins <noahwatkins@gmail.com>

hadoop: add terasort workunit

Signed-off-by: Noah Watkins <noahwatkins@gmail.com>

Merge pull request #3686 from ceph/wip-crushtool

crushtool: process commands in a sensible order

Reviewed-by: Loic Dachary <ldachary@redhat.com>

Merge pull request #3778 from dachary/wip-crushtool

crush: re-organize the help to clarify ordering

crush: re-organize the help to clarify ordering

The options are grouped according to the stage they relate to

   - input/build
   - tunables adjustments
   - modifications
   - display/test
   - output

Signed-off-by: Loic Dachary <ldachary@redhat.com>

crushtool: add test for crushtool ordering

Signed-off-by: Sage Weil <sage@redhat.com>

crushtool: send --tree to stdout

Signed-off-by: Sage Weil <sage@redhat.com>

crushtool: name osds with --build function

Signed-off-by: Sage Weil <sage@redhat.com>

crushtool: do not dump tree on build

This pollutes the output.

Signed-off-by: Sage Weil <sage@redhat.com>

doc/release-notes: v0.87.1

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #3776 from dachary/wip-development-workflows

doc: development workflows

Reviewed-by: Yuri Weinstein <yuriw@redhat.com>

doc: development workflows

Document the high level view of the development workflows which are
otherwise implicit and non trivial to figure out.

Signed-off-by: Loic Dachary <ldachary@redhat.com>

doc: page title suitable for :doc:

When using :doc:`/dev/sepia` the page title is inlined. The modified
title is easier to include as part of a sensible sentence.

Signed-off-by: Loic Dachary <ldachary@redhat.com>

doc: spellcheck quick development guide

Signed-off-by: Loic Dachary <ldachary@redhat.com>

doc: do not doxygen src/tracing

because it does not publish an API that needs to be documented and
because it triggers https://github.com/ceph/asphyxiate/issues/1 in some
contexts.

Signed-off-by: Loic Dachary <ldachary@redhat.com>

mon: do not try and "deactivate" the last MDS

Fixes: #10862
Signed-off-by: John Spray <john.spray@redhat.com>

Merge pull request #3763 from Ved-vampir/master

common: add description in PerfCounter class

Reviewed-by: Sage Weil <sage@redhat.com>

Merge remote-tracking branch 'gh/hammer'

Merge pull request #3741 from ceph/wip-cmake-vstart

cmake fixes and enable vstart with cmake build

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #3729 from guangyy/wip-4254-hammer

osd: number of degraded objects in EC pool is wrong when there is OSD down(in).

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #3722 from ceph/wip-10787

mon: fix osd_epoch cache bug 10787

Reviewed-by: Joao Eduardo Luis <joao@redhat.com>

Merge branch 'osd-fix' of git://github.com/wonzhq/ceph into hammer

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>

Merge branch 'wip-5639' of git://github.com/rzarzynski/ceph into hammer

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #3760 from ceph/wip-10883

osd: Fix FileJournal wrap to get header out first

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #3767 from athanatos/wip-10881

Wip 10881

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #3768 from athanatos/wip-10780

Wip 10780

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #3769 from athanatos/wip-10908

Wip 10908

Reviewed-by: Sage Weil <sage@redhat.com>

cmake: radosgw, radosgw-admin related fixes

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

vstart.sh: can use binaries outside of ceph/src

If setting CEPH_BUILD_ROOT, will use that path, otherwise runs
everything from current directory as before.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

Merge pull request #3612 from zhouyuan/acct_get_resp_headers

rgw: Adding stats in the header of GET response on account

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>

Merge pull request #3648 from theanalyst/doc/swift-temp-url

doc: swift tempurl functionality

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>

Merge pull request #3766 from tchaikov/chain_xattr-wrong-size-for-snprintf

os/chain_xattr: fix wrong `size` for snprintf()

Reviewed-by: Loic Dachary <ldachary@redhat.com>

Merge pull request #3744 from ceph/wip-10884-hammer-rpm-devel-split

ceph.spec: split ceph-devel to appropriate *-devel packages

Reviewed-by: Sandon Van Ness <sandon@redhat.com>
Reviewed-by: Boris Ranto <branto@redhat.com>

os/chain_xattr: fix wrong `size` for snprintf()

Signed-off-by: Kefu Chai <kchai@redhat.com>

Merge pull request #3764 from ceph/wip-10919

cls_rbd: invalidate bufferlist CRC when updating object map

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #3754 from ceph/wip-10907

rgw: pass civetweb configurables to civetweb

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #3762 from fghaas/master

doc: explain that ceph tell osd.N bench is non-destructive

mon: fix bug with counter name (win counter was inc-ed in lose func)

Signed-off-by: Kiseleva Alyona akiselyova@mirantis.com

Merge pull request #3697 from yuyuyu101/wip-async-fix-2

AsyncMessenger: Fix fd leak and lossless_peer_reuse policy problem

common: add description in PerfCounter class

Signed-off-by: Kiseleva Alyona <akiselyova@mirantis.com>

cls_rbd: invalidate bufferlist CRC when updating object map

The bit vector was not invalidating the bufferlist's CRC, resulting
in peer OSDs rejecting write op due to a mismatched CRC on the
message.

Fixes: #10919
Signed-off-by: Jason Dillaman <dillaman@redhat.com>

doc: explain that tell bench is non-destructive

Mention that "ceph tell osd.N bench" will not overwrite data in a live
OSD, but might temporarily affect OSD performance.

Signed-off-by: Florian Haas <florian@hastexo.com>

Merge remote-tracking branch 'gh/hammer'

Merge pull request #3759 from ceph/wip-10914

osdc: pass fadvise op flags to WritebackHandler read requests

Reviewed-by: Josh Durgin <jdurgin@redhat.com>