Link ceph-fuse to fuse on DARWIN

Signed-off-by: Yan, Zheng <zyan@redhat.com>

msg: fix encoding/decoding sockaddr_storage on DARWIN/FreeBSD

sockaddr_storage on DARWIN/FreeBSD is different from sockaddr_storage
on Linux. sockaddr_storage on DARWIN/FreeBSD includes a ss_len field.
Besides, Its ss_len and ss_family fields are 'unsigned char'.

Signed-off-by: Yan, Zheng <zyan@redhat.com>

librbd: Need to include errno.h on DARWIN.

The file is not really required

Signed-off-by: Dennis Schafroth <dennis@schafroth.com>

porting.h: add porting.h for porting/compatibility on DARWIN

Collection of porting/compatibility defines to compile on DARWIN

Signed-off-by: Dennis Schafroth <dennis@schafroth.com>

tools/ceph_objectstore_tool: Missing O_LARGEFILE on DARWIN

Signed-off-by: Dennis Schafroth <dennis@schafroth.com>

test: Fix error with clang on DARWIN (LLVM 3.6.0svn)

Signed-off-by: Dennis Schafroth <dennis@schafroth.com>

rbd-replay: Different location of endian.h on DARWIN

Signed-off-by: Dennis Schafroth <dennis@schafroth.com>

rbd-fuse: Add position to set/get xattr on DARWIN

Signed-off-by: Dennis Schafroth <dennis@schafroth.com>

os/FileStore: fail with ENOTSUP if using sparse files on DARWIN

For now, fail with Not supported (ENOTSUP) if configured using sparse files on DARWIN.

Signed-off-by: Dennis Schafroth <dennis@schafroth.com>

librbd: Include porting header

Signed-off-by: Dennis Schafroth <dennis@schafroth.com>

common/xattr: Split out xattr on Linux and DARWIN.

DARWIN requires position parameter

Signed-off-by: Dennis Schafroth <dennis@schafroth.com>

common/util: include sys/param.h and mount.h on DARWIN

Signed-off-by: Dennis Schafroth <dennis@schafroth.com>

common/SubProcess: fix build on DARWIN

include <signal.h> to avoid errors/warnings on missing functions

Signed-off-by: Dennis Schafroth <dennis@schafroth.com>

ceph_fuse: Implement set/get xattr with position parameter on OSX

Signed-off-by: Dennis Schafroth <dennis@schafroth.com>

msg/async: Include porting.h for MSG_*

Signed-off-by: Dennis Schafroth <dennis@schafroth.com>

msg/simple: Move MSG_ and SO_NOSIGPIPE into porting.h

Only enable SO_PRIORITY on Linux

Signed-off-by: Dennis Schafroth <dennis@schafroth.com>

Merge pull request #5710 from tchaikov/wip-check-boost_random-mt

configure.ac: check for libboost_random-mt also

Reviewed-by: Loic Dachary <ldachary@redhat.com>

Merge pull request #5711 from dachary/wip-12781-dmcrypt

ceph-disk: fix dmcrypt typo

Reviewed-by: Kefu Chai <kchai@redhat.com>

ceph-disk: fix dmcrypt typo

Fix the typo introduced by 29431944c77adbc3464a8faeb7e052b24f821780

http://tracker.ceph.com/issues/12781 Fixes: #12781

Signed-off-by: Loic Dachary <ldachary@redhat.com>

Merge pull request #4731 from stiopaa1/cephdetectinitfix

ceph-detect-init/debian/__init__: improved syntax

Reviewed-by: Loic Dachary <ldachary@redhat.com>

Merge pull request #5503 from zhouyuan/isal_2.14_update

erasure-code: Update ISA-L to 2.14

Reviewed-by: Loic Dachary <ldachary@redhat.com>

configure.ac: check for libboost_random-mt also

Signed-off-by: Kefu Chai <kchai@redhat.com>

Merge pull request #5467 from dachary/wip-ceph-release-notes

tools: ceph-release-notes unicode handling

Reviewed-by: Abhishek Lekshmanan <abhishek.lekshmanan@ril.com>

Merge pull request #5333 from ceph/wip-12437

osd: Keep a reference count on Connection while calling send_mes…

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge remote-tracking branch 'gh/infernalis'

Merge pull request #5690 from dzafman/wip-pgls-zafman

cls: Fix successful return found by compiler warning

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #5704 from tchaikov/wip-adventure-mode

common: 'enable experimental data corrupting features' now understand '*'

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #5667 from liewegas/wip-9221

ceph_test_rados_api_tier: make PromoteOn2ndRead tolerate thrashing

Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #5666 from liewegas/wip-12785

osd: fix off-by-one in hobject_t::is_temp()  (bug 12785)

Reviewed-by: Samuel Just <sjust@redhat.com>

common: 'enable experimental data corrupting features' now understands '*'

'*' allows any feature.

Signed-off-by: Kefu Chai <kchai@redhat.com>

Merge pull request #5609 from rohanmars/wip-timegm

added boost timegm impl for cross platform support

In the future it would be nice to avoid duplication of the code in each compiled module, but this works for now.  The only real user right now is rgw.

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #5627 from wonzhq/agent-work

osd: do evict before flush in agent_work

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #5640 from liewegas/wip-mutex-lock

mutex: avoid trylock unless instrumentation is enabled

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Piotr Dałek <piotr.dalek@ts.fujitsu.com>

Merge pull request #5656 from XinzeChi/wip-buffer-emtpyptr

common: fix insert empty ptr when bufferlist rebuild

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #5453 from wonzhq/recover-primary

osd: recovery fixes

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #5415 from wonzhq/do-recovery

osd: do_recovery cleanup

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #5703 from ceph/wip-boost-random-cmake

CMake: update for boost_random

CMake: update for boost_random

This became a dependency in dbcaa544

Signed-off-by: John Spray <john.spray@redhat.com>

Merge pull request #5701 from guce/h3c_mail_organization_map

h3c mail organization map

Reviewed-by: Loic Dachary <ldachary@redhat.com>

h3c mail organization map

update .mailmap and .organizationmap for h3c organization

Signed-off-by: Ce Gu <guce@h3c.com>

Merge pull request #5114 from branch-predictor/bp-reduced-memzero

ObjectStore/FileJournal: reduce impact of memset()

Reviewed-by: Sage Weil <sage@redhat.com>

cls: Fix successful return found by compiler warning

Signed-off-by: David Zafman <dzafman@redhat.com>

Merge pull request #5688 from dzafman/wip-decode-zafman

osd: Decode use_gmt_hitset with a unique version

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #5679 from wonzhq/store-test

test: disable newstore test until it's merged

Reviewed-by: Samuel Just <sjust@redhat.com>

osd: Decode use_gmt_hitset with a unique version

Signed-off-by: David Zafman <dzafman@redhat.com>

Merge pull request #5545 from ceph/wip-objclass-filters

Allow object classes to define PGLS filters

Reviewed-by: David Zafman <dzafman@redhat.com>

Merge remote-tracking branch 'gh/wip-osd-compat'

Reviewed-by: Samuel Just <sjust@redhat.com>

Merge pull request #5683 from tchaikov/wip-hitset-gmt-yet-another-feature-bit

osd: do not let OSD_HITSET_GMT reuse the feature bit

Reviewed-by: Sage Weil <sage@redhat.com>

osd: do not let OSD_HITSET_GMT reuse the feature bit

* to ease the backport to hammer

Signed-off-by: Kefu Chai <kchai@redhat.com>

Merge pull request #5524 from tchaikov/wip-monstore-cache

mon: add a cache layer over MonitorDBStore

Reviewed-by: Joao Eduardo Luis <joao@suse.de>
Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #5669 from yuyuyu101/wip-12745

ms/simple: Messenger/MessengerTest.SyntheticInjectTest2/1 hang

Reviewed-by: Sage Weil <sage@redhat.com>

doc/release-notes: v0.94.3

Fix up the release timeline link for v9.0.3 too.

Signed-off-by: Sage Weil <sage@redhat.com>

osd: separate filter init from construction

...so that implementations can readily handle
decode errors in client args and return an
error code.

Signed-off-by: John Spray <john.spray@redhat.com>

test: add a test for filter in cls hello

Signed-off-by: John Spray <john.spray@redhat.com>

cls: add a filter to the hello class for testing

Signed-off-by: John Spray <john.spray@redhat.com>

objclass: enable unregistering filter factory

Signed-off-by: John Spray <john.spray@redhat.com>

AsyncConnection: Fix uninitialized variable compile warning

Signed-off-by: Haomai Wang <haomaiwang@gmail.com>

TestMsgr: Fix forever hang under lossless policy and one is WAIT another down

Signed-off-by: Haomai Wang <haomaiwang@gmail.com>

Merge pull request #5678 from ceph/wip-12208

rgw: delete finisher only after finalizing watches

Merge pull request #5677 from ceph/wip-11455

rgw: init some manifest fields when handling explicit objs

Merge pull request #5651 from theanalyst/rgw/fixiso8601

rgw: be more flexible with iso8601 timestamps

test: don't unmount when no store is created

When store is not created in SetUp for some reasons, unmounting it would
lead to segment fault.

Signed-off-by: Zhiqiang Wang <zhiqiang.wang@intel.com>

test: handle the case when ObjectStore::create returns NULL

When the objectstore type doesn't exist, NULL is returned in SetUp.
Handle the NULL return code to avoid a segment fault.

Signed-off-by: Zhiqiang Wang <zhiqiang.wang@intel.com>

test: disable newstore test until it's merged

Newstore hasn't been merged. It leads to a segment fault in one of the
teuthology testing job since ObjectStore::create() returns NULL.

Signed-off-by: Zhiqiang Wang <zhiqiang.wang@intel.com>

Merge pull request #4456 from ceph/wip-user

run ceph daemons as user and group ceph

Merge pull request #5674 from ceph/wip-selinux-post-script

ceph.spec.in: Restart services only if they are running

Reviewed-by: Milan Broz <mbroz@redhat.com>

debian: /var/run/ceph should be owned by ceph:ceph

Fix upstart and sysvinit scripts to create /var/run/ceph properly.

Chown existing dir on upgrade.

Signed-off-by: Sage Weil <sage@redhat.com>

upstart: setuser ceph

Signed-off-by: Sage Weil <sage@redhat.com>

debian/ceph-common.dirs: install /var/lib/ceph

It is the ceph user's home dir and we need to set the ownership.

Signed-off-by: Sage Weil <sage@redhat.com>

debian/ceph-common.postinst: fix adduser, addgroup

Drop the extra groups thing--it's broken anyway.

Signed-off-by: Sage Weil <sage@redhat.com>

debian/ceph-common.postinst: fix /var/log/ceph permissions

Signed-off-by: Sage Weil <sage@redhat.com>

debian: rename ceph-common.postinst

There was a trailing space!

Signed-off-by: Sage Weil <sage@redhat.com>

PendingReleaseNotes: more notes about the 'ceph' user

Signed-off-by: Sage Weil <sage@redhat.com>

global_init: ignore --set{user,group} if not root

Assume these options can only drop privileges; normal users can't setuid
root (and even if they could we wouldn't want to).

This makes ceph-disk behave when it sees the ceph user as 'root' and
invokes things with --setuser root but runs as a non-root user.

Signed-off-by: Sage Weil <sage@redhat.com>

ceph-disk: fix get_ceph_user

getpwnam throws an exception

Signed-off-by: Sage Weil <sage@redhat.com>

PendingReleaseNotes: some notes about upgrade and ceph user

Signed-off-by: Sage Weil <sage@redhat.com>

systemd: use --setuser and --setgroup for all daemons

Allow all daemons drop privilege themselves, instead of letting
systemd do it.

Among other things, this means that admins can conditionally not
drop prives by setting

  setuser match path = /var/lib/ceph/$type/$cluster-$id

in their ceph.conf to ease the pain of upgrade.

Signed-off-by: Sage Weil <sage@redhat.com>
Reviewed-by: Boris Ranto <branto@redhat.com>

global: implement setuser_match_path

Allow the --setuser and --setgroup to be conditional on the
specified user/group matching the ownership of a given path.
This allows the ceph daemons to switch to user ceph for newly
deployed instances or stay as root depending on the ownership of
the data directory.

Signed-off-by: Sage Weil <sage@redhat.com>
Reviewed-by: Boris Ranto <branto@redhat.com>

ceph-disk: set owner of created files to ceph

Signed-off-by: Milan Broz <mbroz@redhat.com>

Set keys owner to ceph user if exists.

Also fix directory access rigths.

Signed-off-by: Milan Broz <mbroz@redhat.com>

Set Ceph device partitions owner to ceph user in udev.

Signed-off-by: Milan Broz <mbroz@redhat.com>

ceph-osd-prestart.sh: ensure data dir is root or ceph before start

Signed-off-by: Sage Weil <sage@redhat.com>

init-ceph.in: Set ceph user and group when running the daemons

Signed-off-by: Boris Ranto <branto@redhat.com>

ceph.spec.in: User and group must be created in ceph-common pre-install script

The package ceph-common uses ceph user and group but they are both created in
ceph package %pre phase. We need to move the script to ceph-common %pre phase.

Signed-off-by: Boris Ranto <branto@redhat.com>

ceph.spec.in: /var/lib/ceph is owned by ceph package

Signed-off-by: Boris Ranto <branto@redhat.com>

ceph.spec.in: Fix ceph.limits.d path

Signed-off-by: Boris Ranto <branto@redhat.com>

ceph.spec.in: Fixup uid/gid setting

We need to set the variables in the %pre phase, otherwise they are not properly
evaluated. Also use /sbin/nolongin instead of /bin/false and set the default
uid/gid pair for fedora and rhel (these were already allocated). We can also
use them for older fedora releases as they are guaranteed to be free.

Signed-off-by: Boris Ranto <branto@redhat.com>

ceph.spec.in: install ceph.limits.d

limits.d expect the file to end with *.conf. Add the
installed file to package list of the ceph package.

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>

ceph.spec.in: add ceph user/group

Add support of create ceph user/group.

TODO: Add correct number for SUSE.

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>

set nofile ulimit in /etc/security/limits.d/ceph only

Specify the nofile ulimit in one standard place, where everyone expects it
to be.  Drop it from the ceph-osd unit file.

Leave upstart and sysvinit untouched for the time being to avoid compat
issues.

Signed-off-by: Sage Weil <sage@redhat.com>

systemd: make ceph-osd setuid/gid to ceph:ceph

Signed-off-by: Sage Weil <sage@redhat.com>

global: add --setuser and --setgroup options

These are done after reading config files/environment and before log files
are opened.  Allow a name or id to be specified.  In the case of --setuser,
also switch to that user's gid, unless --setgroup is also specified.

Signed-off-by: Sage Weil <sage@redhat.com>

debian: fix /var/lib/ceph/* directory ownership

These dirs are owned by the package; make sure they are owend by the ceph
user.

Signed-off-by: Sage Weil <sage@redhat.com>

systemd: chown ceph:ceph /var/run/ceph

Signed-off-by: Sage Weil <sage@redhat.com>

systemd: run mon and mds as ceph:ceph

Signed-off-by: Sage Weil <sage@redhat.com>

ceph.spec: chown and chmod /var/lib/ceph and /var/log/ceph

Signed-off-by: Sage Weil <sage@redhat.com>

debian: chown -R ceph:ceph /var/log/ceph

The number of log files is generally bounded; safe to chown these.

Allow ceph group members to write to this dir.

Signed-off-by: Sage Weil <sage@redhat.com>

debian: chown ceph:ceph /var/llib/ceph

Do not do it recursively--there may already be huge amounts of data
here.

Signed-off-by: Sage Weil <sage@redhat.com>

debian: create ceph user and group

Use Debian base-passwd allocated UID/GID pair.

Signed-off-by: Sage Weil <sage@redhat.com>

rgw: delete finisher only after finalizing watches

Fixes: #12208
The watch error path might try to schedule a finisher work, delete finisher
only after watch destruction.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>