test/admin_socket: check error message according to OS

Signed-off-by: Yan, Zheng <zyan@redhat.com>

compat: move definitions in porting.h into include/compat.h

Signed-off-by: Yan, Zheng <zyan@redhat.com>

TestLFNIndex.cc: don't use "cp --preserve=xattr"

--preserve option is not supported by OSX's cp. use 'cp -a' instead

Signed-off-by: Yan, Zheng <zyan@redhat.com>

tests: replace std::tr1::shared_ptr with ceph::shared_ptr

Signed-off-by: Yan, Zheng <zyan@redhat.com>

tests: disable unittest_blkdev on OSX

the test uses sysfs, which does not exist on OSX

Signed-off-by: Yan, Zheng <zyan@redhat.com>

test/librados: replace sem_init() with sem_open()

sem_init() always fails on OSX (it's no longer supported).

Signed-off-by: Yan, Zheng <zyan@redhat.com>

buffer: make buffer::exception classes undefined in dynamic objects

On OSX, if the an exception class is declared and defined in header file,
but it ends up being compiled as private symbols in different binaries.
The exception handling code will take the two compiled exception classes
as different types! In our case, the one in libcls_xxx.so and the one is
ceph-osd are considered as different classes, thus the try-catch statement
fails to work.

The fix is force buffer::exception classes undefined in libcls_xxx.so. The
ibcls_xxx.so are compiled with '-undefined dynamic_lookup' option. when
it is loaded into ceph-osd, buffer::exception classes in ceph-osd will be
used.

Signed-off-by: Yan, Zheng <zyan@redhat.com>

test/librados: replace errno -125 with -ECANCELED

Signed-off-by: Yan, Zheng <zyan@redhat.com>

client: convert XATTR_{CREATE,REPLACE} to CEPH_XATTR_{CREATE,REPLACE}

Signed-off-by: Yan, Zheng <zyan@redhat.com>

xattr: convert ENOATTR to ENODATA on DARWIN

On Darwin, getxattr/removexattr return ENOATTR when extended
attribute does not exist. But lots of ceph codes expect ENODATA
is returned in that case. On Darwin, ENOATTR and ENODATA have
different values, so we convert ENOATTR to ENODATA.

Signed-off-by: Yan, Zheng <zyan@redhat.com>

test_libcephfs: disable flock test on OSX

there is no sem_timedwait on OSX. For inter-threads communication,
we can replace sem_t with pthread_cond_t. But for inter-processes
communication, it's extremely hard to figure out how to do a timed
wait. So disable the test case on OSX

Signed-off-by: Yan, Zheng <zyan@redhat.com>

libradosstriper/striping.cc: include "include/types.h"

include definitions of __le{32,64)

Signed-off-by: Yan, Zheng <zyan@redhat.com>

test_c_headers: don't use -Wold-style-declaration option for clang

clang does not support this option

Signed-off-by: Yan, Zheng <zyan@redhat.com>

libcephfs: define loff_t as off_t on OSX

Signed-off-by: Yan, Zheng <zyan@redhat.com>

tools: link ceph-client-debug to LIBCLIENT

Signed-off-by: Yan, Zheng <zyan@redhat.com>

init-ceph: check if /lib/lsb/init-functions exists

On OSX/FreeBSD, /lib/lsb/init-functions does not exist

Signed-off-by: Yan, Zheng <zyan@redhat.com>

init-ceph: don't use procfs to check if daemon is running

use ps(1) instead, which is portable

Signed-off-by: Yan, Zheng <zyan@redhat.com>

init-ceph: replace 'echo -n' with printf

'echo -n' is no portable. On OSX, output of 'echo -n' can be '-n'

Signed-off-by: Yan, Zheng <zyan@redhat.com>

vstart.sh: use portable way to get ip address

Signed-off-by: Yan, Zheng <zyan@redhat.com>

vstart.sh: append ceph library path to {LD,DYLD}_LIBRARY_PATH

Signed-off-by: Yan, Zheng <zyan@redhat.com>

On Darwin: subfix of dynamic library is dylib

Signed-off-by: Yan, Zheng <zyan@redhat.com>

porting.h: add TODO comment

Signed-off-by: Kefu Chai <kchai@redhat.com>

Makefile: add porting.h to dist tarball

Signed-off-by: Kefu Chai <kchai@redhat.com>

Don't use '--exclude-libs' linker option on DARWIN

Only GNU linker supports this option

Signed-off-by: Yan, Zheng <zyan@redhat.com>

client: don't try trimming kernel dcache on DARWIN/FreeBSD

still don't know if the methods used on linux also works on
DARWIN/FreeBSD

Signed-off-by: Yan, Zheng <zyan@redhat.com>

client: don't include unsupported mount options on DARWIN/FreeBSD

Signed-off-by: Yan, Zheng <zyan@redhat.com>

Link ceph-fuse to fuse on DARWIN

Signed-off-by: Yan, Zheng <zyan@redhat.com>

msg: fix encoding/decoding sockaddr_storage on DARWIN/FreeBSD

sockaddr_storage on DARWIN/FreeBSD is different from sockaddr_storage
on Linux. sockaddr_storage on DARWIN/FreeBSD includes a ss_len field.
Besides, Its ss_len and ss_family fields are 'unsigned char'.

Signed-off-by: Yan, Zheng <zyan@redhat.com>

librbd: Need to include errno.h on DARWIN.

The file is not really required

Signed-off-by: Dennis Schafroth <dennis@schafroth.com>

porting.h: add porting.h for porting/compatibility on DARWIN

Collection of porting/compatibility defines to compile on DARWIN

Signed-off-by: Dennis Schafroth <dennis@schafroth.com>

tools/ceph_objectstore_tool: Missing O_LARGEFILE on DARWIN

Signed-off-by: Dennis Schafroth <dennis@schafroth.com>

test: Fix error with clang on DARWIN (LLVM 3.6.0svn)

Signed-off-by: Dennis Schafroth <dennis@schafroth.com>

rbd-replay: Different location of endian.h on DARWIN

Signed-off-by: Dennis Schafroth <dennis@schafroth.com>

rbd-fuse: Add position to set/get xattr on DARWIN

Signed-off-by: Dennis Schafroth <dennis@schafroth.com>

os/FileStore: fail with ENOTSUP if using sparse files on DARWIN

For now, fail with Not supported (ENOTSUP) if configured using sparse files on DARWIN.

Signed-off-by: Dennis Schafroth <dennis@schafroth.com>

librbd: Include porting header

Signed-off-by: Dennis Schafroth <dennis@schafroth.com>

common/xattr: Split out xattr on Linux and DARWIN.

DARWIN requires position parameter

Signed-off-by: Dennis Schafroth <dennis@schafroth.com>

common/util: include sys/param.h and mount.h on DARWIN

Signed-off-by: Dennis Schafroth <dennis@schafroth.com>

common/SubProcess: fix build on DARWIN

include <signal.h> to avoid errors/warnings on missing functions

Signed-off-by: Dennis Schafroth <dennis@schafroth.com>

ceph_fuse: Implement set/get xattr with position parameter on OSX

Signed-off-by: Dennis Schafroth <dennis@schafroth.com>

msg/async: Include porting.h for MSG_*

Signed-off-by: Dennis Schafroth <dennis@schafroth.com>

msg/simple: Move MSG_ and SO_NOSIGPIPE into porting.h

Only enable SO_PRIORITY on Linux

Signed-off-by: Dennis Schafroth <dennis@schafroth.com>

Merge pull request #5710 from tchaikov/wip-check-boost_random-mt

configure.ac: check for libboost_random-mt also

Reviewed-by: Loic Dachary <ldachary@redhat.com>

Merge pull request #5711 from dachary/wip-12781-dmcrypt

ceph-disk: fix dmcrypt typo

Reviewed-by: Kefu Chai <kchai@redhat.com>

ceph-disk: fix dmcrypt typo

Fix the typo introduced by 29431944c77adbc3464a8faeb7e052b24f821780

http://tracker.ceph.com/issues/12781 Fixes: #12781

Signed-off-by: Loic Dachary <ldachary@redhat.com>

Merge pull request #4731 from stiopaa1/cephdetectinitfix

ceph-detect-init/debian/__init__: improved syntax

Reviewed-by: Loic Dachary <ldachary@redhat.com>

Merge pull request #5503 from zhouyuan/isal_2.14_update

erasure-code: Update ISA-L to 2.14

Reviewed-by: Loic Dachary <ldachary@redhat.com>

configure.ac: check for libboost_random-mt also

Signed-off-by: Kefu Chai <kchai@redhat.com>

Merge pull request #5467 from dachary/wip-ceph-release-notes

tools: ceph-release-notes unicode handling

Reviewed-by: Abhishek Lekshmanan <abhishek.lekshmanan@ril.com>

Merge pull request #5333 from ceph/wip-12437

osd: Keep a reference count on Connection while calling send_mes…

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge remote-tracking branch 'gh/infernalis'

Merge pull request #5690 from dzafman/wip-pgls-zafman

cls: Fix successful return found by compiler warning

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #5704 from tchaikov/wip-adventure-mode

common: 'enable experimental data corrupting features' now understand '*'

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #5667 from liewegas/wip-9221

ceph_test_rados_api_tier: make PromoteOn2ndRead tolerate thrashing

Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #5666 from liewegas/wip-12785

osd: fix off-by-one in hobject_t::is_temp()  (bug 12785)

Reviewed-by: Samuel Just <sjust@redhat.com>

common: 'enable experimental data corrupting features' now understands '*'

'*' allows any feature.

Signed-off-by: Kefu Chai <kchai@redhat.com>

Merge pull request #5609 from rohanmars/wip-timegm

added boost timegm impl for cross platform support

In the future it would be nice to avoid duplication of the code in each compiled module, but this works for now.  The only real user right now is rgw.

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #5627 from wonzhq/agent-work

osd: do evict before flush in agent_work

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #5640 from liewegas/wip-mutex-lock

mutex: avoid trylock unless instrumentation is enabled

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Piotr Dałek <piotr.dalek@ts.fujitsu.com>

Merge pull request #5656 from XinzeChi/wip-buffer-emtpyptr

common: fix insert empty ptr when bufferlist rebuild

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #5453 from wonzhq/recover-primary

osd: recovery fixes

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #5415 from wonzhq/do-recovery

osd: do_recovery cleanup

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #5703 from ceph/wip-boost-random-cmake

CMake: update for boost_random

CMake: update for boost_random

This became a dependency in dbcaa544

Signed-off-by: John Spray <john.spray@redhat.com>

Merge pull request #5701 from guce/h3c_mail_organization_map

h3c mail organization map

Reviewed-by: Loic Dachary <ldachary@redhat.com>

h3c mail organization map

update .mailmap and .organizationmap for h3c organization

Signed-off-by: Ce Gu <guce@h3c.com>

Merge pull request #5114 from branch-predictor/bp-reduced-memzero

ObjectStore/FileJournal: reduce impact of memset()

Reviewed-by: Sage Weil <sage@redhat.com>

cls: Fix successful return found by compiler warning

Signed-off-by: David Zafman <dzafman@redhat.com>

Merge pull request #5688 from dzafman/wip-decode-zafman

osd: Decode use_gmt_hitset with a unique version

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #5679 from wonzhq/store-test

test: disable newstore test until it's merged

Reviewed-by: Samuel Just <sjust@redhat.com>

osd: Decode use_gmt_hitset with a unique version

Signed-off-by: David Zafman <dzafman@redhat.com>

Merge pull request #5545 from ceph/wip-objclass-filters

Allow object classes to define PGLS filters

Reviewed-by: David Zafman <dzafman@redhat.com>

Merge remote-tracking branch 'gh/wip-osd-compat'

Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #5683 from tchaikov/wip-hitset-gmt-yet-another-feature-bit

osd: do not let OSD_HITSET_GMT reuse the feature bit

Reviewed-by: Sage Weil <sage@redhat.com>

osd: do not let OSD_HITSET_GMT reuse the feature bit

* to ease the backport to hammer

Signed-off-by: Kefu Chai <kchai@redhat.com>

Merge pull request #5524 from tchaikov/wip-monstore-cache

mon: add a cache layer over MonitorDBStore

Reviewed-by: Joao Eduardo Luis <joao@suse.de>
Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #5669 from yuyuyu101/wip-12745

ms/simple: Messenger/MessengerTest.SyntheticInjectTest2/1 hang

Reviewed-by: Sage Weil <sage@redhat.com>

doc/release-notes: v0.94.3

Fix up the release timeline link for v9.0.3 too.

Signed-off-by: Sage Weil <sage@redhat.com>

osd: separate filter init from construction

...so that implementations can readily handle
decode errors in client args and return an
error code.

Signed-off-by: John Spray <john.spray@redhat.com>

test: add a test for filter in cls hello

Signed-off-by: John Spray <john.spray@redhat.com>

cls: add a filter to the hello class for testing

Signed-off-by: John Spray <john.spray@redhat.com>

objclass: enable unregistering filter factory

Signed-off-by: John Spray <john.spray@redhat.com>

AsyncConnection: Fix uninitialized variable compile warning

Signed-off-by: Haomai Wang <haomaiwang@gmail.com>

TestMsgr: Fix forever hang under lossless policy and one is WAIT another down

Signed-off-by: Haomai Wang <haomaiwang@gmail.com>

Merge pull request #5678 from ceph/wip-12208

rgw: delete finisher only after finalizing watches

Merge pull request #5677 from ceph/wip-11455

rgw: init some manifest fields when handling explicit objs

Merge pull request #5651 from theanalyst/rgw/fixiso8601

rgw: be more flexible with iso8601 timestamps

test: don't unmount when no store is created

When store is not created in SetUp for some reasons, unmounting it would
lead to segment fault.

Signed-off-by: Zhiqiang Wang <zhiqiang.wang@intel.com>

test: handle the case when ObjectStore::create returns NULL

When the objectstore type doesn't exist, NULL is returned in SetUp.
Handle the NULL return code to avoid a segment fault.

Signed-off-by: Zhiqiang Wang <zhiqiang.wang@intel.com>

test: disable newstore test until it's merged

Newstore hasn't been merged. It leads to a segment fault in one of the
teuthology testing job since ObjectStore::create() returns NULL.

Signed-off-by: Zhiqiang Wang <zhiqiang.wang@intel.com>

Merge pull request #4456 from ceph/wip-user

run ceph daemons as user and group ceph

Merge pull request #5674 from ceph/wip-selinux-post-script

ceph.spec.in: Restart services only if they are running

Reviewed-by: Milan Broz <mbroz@redhat.com>

debian: /var/run/ceph should be owned by ceph:ceph

Fix upstart and sysvinit scripts to create /var/run/ceph properly.

Chown existing dir on upgrade.

Signed-off-by: Sage Weil <sage@redhat.com>

upstart: setuser ceph

Signed-off-by: Sage Weil <sage@redhat.com>

debian/ceph-common.dirs: install /var/lib/ceph

It is the ceph user's home dir and we need to set the ownership.

Signed-off-by: Sage Weil <sage@redhat.com>

debian/ceph-common.postinst: fix adduser, addgroup

Drop the extra groups thing--it's broken anyway.

Signed-off-by: Sage Weil <sage@redhat.com>

debian/ceph-common.postinst: fix /var/log/ceph permissions

Signed-off-by: Sage Weil <sage@redhat.com>

debian: rename ceph-common.postinst

There was a trailing space!

Signed-off-by: Sage Weil <sage@redhat.com>

PendingReleaseNotes: more notes about the 'ceph' user

Signed-off-by: Sage Weil <sage@redhat.com>

global_init: ignore --set{user,group} if not root

Assume these options can only drop privileges; normal users can't setuid
root (and even if they could we wouldn't want to).

This makes ceph-disk behave when it sees the ceph user as 'root' and
invokes things with --setuser root but runs as a non-root user.

Signed-off-by: Sage Weil <sage@redhat.com>