tools: remove old ceph.cc

Signed-off-by: John Spray <john.spray@redhat.com>

Merge pull request #2649 from ceph/wip-os-recommend-doc-fix

doc: update kernel recommendations, add tunables link

doc: update kernel recommendations, add tunables link

No 3.16.[0-2] - same rbd deadlock regression as in 3.15.

Signed-off-by: Ilya Dryomov <idryomov@redhat.com>

Merge pull request #2644 from objoo/master

Add one more case ( "=" ) and test get_str_vec as well.

Reviewed-by: Loic Dachary <loic-201408@dachary.org>

Add one more case ( "=" ) and test get_str_vec as well.
Signed-off-by: Yann Dupont <yann@objoo.org>

Merge pull request #2641 from dachary/wip-9655-osd-tell

qa: ceph tell must retry on ENXIO

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #2599 from johnugeorge/wip-9492-crush-indep

Crush: Ensuring at most num-rep osds are selected for indep rules

Reviewed-by: Loic Dachary <loic-201408@dachary.org>

qa: ceph tell must retry on ENXIO

It is expected for ceph tell to fail with ENXIO if the daemon it is
trying to join is not ready for some reason. This should be handled as a
transient error instead of a fatal error.

Add two shell functions to help with retry. They may prove useful if
other cases requiring a few retries show up.

http://tracker.ceph.com/issues/9655 Fixes: #9655

Signed-off-by: Loic Dachary <loic-201408@dachary.org>

Crush: Ensuring at most num-rep osds are selected

Crush temporary buffers are allocated as per replica size configured
by the user.When there are more final osds (to be selected as per
rule) than the replicas, buffer overlaps and it causes crash.Now, it
ensures that at most num-rep osds are selected even if more number of
osds are allowed by indep rule. The fix for firstn rules is already
merged as part of bug #9492. Required test files are added.

Fixes: #9492
Signed-off-by: Johnu George johnugeo@cisco.com

Merge remote-tracking branch 'gh/giant'

Merge pull request #2640 from ceph/wip-9657

messages: provide an explicit COMPAT_VERSION in MMDSBeacon

Reviewed-by: Sage Weil <sage@redhat.com>

messages: provide an explicit COMPAT_VERSION in MMDSBeacon

We weren't setting an explicit compat version and so the Message
was setting it to the head version, breaking communication with
older daemons.

Fixes: #9657
Signed-off-by: Greg Farnum <greg@inktank.com>

debian/control: BuildDepend on lsb-release

debian/rules uses it to make lttng build conditional.

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #2635 from dachary/wip-9653-ceph-disk-bootstrap-osd-giant

ceph-disk: bootstrap-osd keyring ignores --statedir (giant)

Merge pull request #2633 from dachary/wip-9653-ceph-disk-bootstrap-osd

ceph-disk: bootstrap-osd keyring ignores --statedir

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #2637 from dachary/wip-9245-test-mon-pending-giant

mon: obsolete osdmonitor_prepare_command (giant)

tests: remove tests requiring osdmonitor_prepare_command

Although they have been useful, their maintenance and fragility caused
more trouble than their benefits.

Signed-off-by: Loic Dachary <loic-201408@dachary.org>
(cherry picked from commit 038de0031bc0892359201012dafb82ac1b1a4d0f)

mon: obsolete osdmonitor_prepare_command

And the mon_advanced_debug_mode option that is only used in the context
of osdmonitor_prepare_command.

http://tracker.ceph.com/issues/9245 Fixes: #9245

Signed-off-by: Loic Dachary <loic-201408@dachary.org>
(cherry picked from commit 2abc8f400f7db256c2a30f1d0886a593e6c194eb)

test: minor case fix

Signed-off-by: Loic Dachary <loic-201408@dachary.org>
(cherry picked from commit 6f698374562de74806203c7b41072572b59bd256)

Merge pull request #2636 from dachary/wip-9245-test-mon-pending

mon: obsolete osdmonitor_prepare_command

Reviewed-by: Sage Weil <sage@redhat.com>

tests: remove tests requiring osdmonitor_prepare_command

Although they have been useful, their maintenance and fragility caused
more trouble than their benefits.

Signed-off-by: Loic Dachary <loic-201408@dachary.org>

mon: obsolete osdmonitor_prepare_command

And the mon_advanced_debug_mode option that is only used in the context
of osdmonitor_prepare_command.

http://tracker.ceph.com/issues/9245 Fixes: #9245

Signed-off-by: Loic Dachary <loic-201408@dachary.org>

test: minor case fix

Signed-off-by: Loic Dachary <loic-201408@dachary.org>

ceph-disk: bootstrap-osd keyring ignores --statedir

The STATEDIR variable is used to initialize the bootstrap-osd keyring
before it gets a chance to be overriden by --statedir. Replace it with
{statedir} so that it can be substituted after all options have been
parsed.

http://tracker.ceph.com/issues/9653 Fixes: #9653

Signed-off-by: Loic Dachary <loic-201408@dachary.org>
(cherry picked from commit fa0bd06b4657e5b84e237b76033ac3d3478b6a1f)

Merge pull request #2577 from dachary/wip-9570-cpp-strerror

os: io_event.res is the size written

Reviewed-By: Christophe Courtaut <christophe.courtaut@gmail.com>

ceph-disk: bootstrap-osd keyring ignores --statedir

The STATEDIR variable is used to initialize the bootstrap-osd keyring
before it gets a chance to be overriden by --statedir. Replace it with
{statedir} so that it can be substituted after all options have been
parsed.

http://tracker.ceph.com/issues/9653 Fixes: #9653

Signed-off-by: Loic Dachary <loic-201408@dachary.org>

Merge pull request #2627 from theanalyst/fix/mailmap

mailmap: Yehuda Sadeh name normalization

Reviewed-by: Loic Dachary <loic-201408@dachary.org>

mailmap: Yehuda Sadeh name normalization

Reported-by: Loic Dachary <loic@dachary.org>
Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>

Merge pull request #2625 from ceph/wip-ysw-mailmap

mailmap: update email address

Reviewed-by: Loic Dachary <loic-201408@dachary.org>

mailmap: update email address

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

doc/release-notes: fix attributions for 8702 fix

Oops!

Signed-off-by: Sage Weil <sage@redhat.com>

doc/release-notes: v0.80.6

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #2623 from ceph/wip-coverity-20141002

build and coverity fixes

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #2622 from dachary/wip-osd-pool-ls

qa: fix osd pool ls invalid test

Merge pull request #2621 from ceph/wip-objecter-shutdown

Fix Objecter shutdown races with message handling

Reviewed-by: Sage Weil <sage@redhat.com>

qa: fix osd pool ls invalid test

expect_false does not extend past the pipe and fails because the command
succeeds

introduced in f05c977bbcd310a83e6df03344a72d4cc06e1cc3

Signed-off-by: Loic Dachary <loic-201408@dachary.org>

BtrfsFileStoreBackend.cc: fix string overflow

Use strncpy() instead of strcpy and make sure the result
is '\0' terminated.

Fix for:

CID 1063700 (#1 of 1): Copy into fixed size buffer (STRING_OVERFLOW)
 fixed_size_dest: You might overrun the 4088 byte fixed-size string
 vol_args.name by copying the return value of c_str without checking
 the length.

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>

test_librbd.cc: fix compiler warning, cast to size_t

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>

Objecter: check the 'initialized' atomic_t safely

shutdown() resets initialized to 0, but we can still receive messages
after this point, so fix message handlers to skip messages in this
case instead of asserting.

Also read initialized while holding Objecter::rwlock to avoid races
where e.g. handle_osd_map() checks initialized -> 1, continues,
shutdown() is called, sets initialized to 0, then handle_osd_map()
goes about its business and calls op_submit(), which would fail the
assert(initialized.read()) check. Similar races existed in other
message handlers which change Objecter state.

The Objecter is not destroyed until after its Messenger in
the MDS, OSD, and librados, so this should be safe.

Fixes: #9617
Backport: giant
Signed-off-by: Josh Durgin <josh.durgin@inktank.com>

Merge pull request #2525 from ceph/wip-9487

RFC: initialize purged_snaps on backfill

Reviewed-by: Samuel Just <sam.just@inktank.com>
Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #2620 from ceph/revert-2604-wip-9113

Revert "ReplicatedPG: clean out completed trimmed objects as we go"

Revert "ReplicatedPG: clean out completed trimmed objects as we go"

Merge pull request #2619 from ceph/wip-8187

librbd: Skip tier pools in list_children and snap_unprotect

Reviewed-by: Josh Durgin <josh.durgin@inktank.com>

ceph.spec: fix typo

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #2614 from ceph/wip-rpm-epoch

rpm: set epoch 1 to match fedora

Reviewed-by: Boris Ranto <branto@redhat.com>

librbd: Skip tier pools in list_children and snap_unprotect

Fixes: #8187
Signed-off-by: Adam Crume <adamcrume@gmail.com>

Merge branch 'wip-9013' into giant

rgw: add civetweb as a default frontend

Fixes: #9013
Originally the configurable was empty, now setting explicitly both
fastcgi and civetweb (on port 7480).

Reviewed-by: Sage Weil <sage@redhat.com>
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

Merge pull request #2552 from ceph/wip-8188

librados: Add rados_pool_get_tiers call

Reviewed-by: Sage Weil <sage@redhat.com>

librados: Add rados_pool_get_base_tier call

Fixes: #8188
Signed-off-by: Adam Crume <adamcrume@gmail.com>

Merge pull request #2618 from ceph/wip-coverity-20141001

Fixes for Coverity issues

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #2452 from ceph/wip-pool-ls

mon: add 'osd pool ls [detail]' command

Reviewed-by: Joao Eduardo Luis <joao@redhat.com>

test_librbd.cc: fix compiler warning

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>

client/SyntheticClient.cc: remove dead code

Fix for:

const: At condition do_sync, the value of do_sync must be equal to 0.
dead_error_condition: The condition do_sync cannot be true.
CID 716893 (#1 of 1): Logically dead code (DEADCODE)
dead_error_begin: Execution cannot reach this statement op.OSDOp()

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>

doc: A couple of fixes to the CloudStack documentation

SyntheticClient.cc: remove dead code

Fix for coverity issue:

const: At condition unsafe > 0, the value of unsafe must be equal to 0.
dead_error_condition: The condition unsafe > 0 cannot be true.

CID 716892 (#1 of 1): Logically dead code (DEADCODE)
dead_error_begin: Execution cannot reach this statement

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>

LogEntry.h: init LogEntry::prio in constructor

CID 1240202 (#1 of 1): Uninitialized scalar field (UNINIT_CTOR)
 uninit_member: Non-static class member prio is not initialized
 in this constructor nor in any functions that it calls.

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>

osd: fix need_journal call

From 2955b3da4e2c472c18b45e81eba791f8ccd58061

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #2607 from yuyuyu101/wip-9580

ObjectStore: Add "need_journal" interface to make aware of journal devic...

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #2608 from yuyuyu101/pipe-iovec

Pipe: avoid redundancy new/delete for struct iovec

Reviewed-by: Sage Weil <sage@redhat.com>

ceph.spec.: add epoch

This is done in fedora packaging.  Do it here too so that you can move
between upstream packages (from ceph.com) and fedora and other derivatives
will builds.

Backport: firefly, dumpling
Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #2615 from ceph/wip-fsls-json

mon: fix JSON `fs ls` output

Reviewed-by: Sage Weil <sage@redhat.com>

mon: fix JSON `fs ls` output

A missing list terminator was causing unparseable output.

Signed-off-by: John Spray <john.spray@redhat.com>

ObjectStore: Add "need_journal" interface to make aware of journal device

Impl feature #9580

Signed-off-by: Haomai Wang <haomaiwang@gmail.com>

Pipe: avoid redundancy new/delete for struct iovec

Signed-off-by: Haomai Wang <haomaiwang@gmail.com>

Merge pull request #2564 from ceph/wip-8587

rgw: subuser creation fixes

Reviewed-by: Josh Durgin <josh.durgin@inktank.com>

Merge pull request #2613 from ceph/wip-8822

osd: swap state spinlock for atomic_t

Reviewed-by: Samuel Just <sam.just@inktank.com>

osd: swap state spinlock for atomic_t

We are hitting a strange issue with valgrind and pthread spinlocks. Avoid
the issue by using an atomic_t here (which is simpler anyway).

Avoids: #8822
Backport: firefly
Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #2612 from ceph/wip-9562-backport

osdc/Filer: drop probe/purge locks before calling objecter

Reviewed-by: Greg Farnum <greg@inktank.com>

osdc/Filer: drop probe/purge locks before calling objecter

Fixes: #9562
Signed-off-by: John Spray <john.spray@redhat.com>
(cherry picked from commit 8dc94a2d8ce3364c0d8d52f634e5fc967e43d819)

Locker: accept ctime updates from clients without dirty write caps

The ctime changes any time the inode does. That can happen even without
the file itself having changed, so we'd better accept the update whenever
the auth caps have dirtied, without worrying about the file caps!

Fixes: #9514
Backport: firefly

Signed-off-by: Greg Farnum <greg@inktank.com>
Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: John Spray <john.spray@redhat.com>

Merge pull request #2605 from ceph/wip-osd-objecter

osd: do not bind ms_objecter messenger

Reviewed-by: Greg Farnum <greg@inktank.com>

Merge pull request #2597 from cchengleo/wip-test-shared-cache

test shared cache

Reviewed-by: Loic Dachary <loic-201408@dachary.org>

test-shared-cache:
  Add test for "lower_bound" method.
  Add multithread tests for "lookup" and "lower_bound" methods.

Signed-off-by: Cheng Cheng <ccheng.leo@gmail.com>
               Loic Dachary <loic@dachary.org>

test-shared-cache:
  Initial draft for the unit test of "common/shared_cache.hpp".

Signed-off-by: Cheng Cheng <ccheng.leo@gmail.com>
               Loic Dachary <loic@dachary.org>

Merge pull request #2609 from dachary/wip-doc-context

common: document C_GatherBuilder and C_Gather

Reviewed-by: John Spray <john.spray@redhat.com>

common: document C_GatherBuilder and C_Gather

* Introduction explaining what they are used for
* Commented example to illustrate the abstract description

Signed-off-by: Loic Dachary <loic-201408@dachary.org>

Objecter: init with a constant of the correct type

Just a tiny cleanup.

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>

Merge pull request #2556 from dachary/wip-9572-erasure-code-blaumroth

erasure-code: restore jerasure BlaumRoth default w

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #2502 from yuyuyu101/kvstore-meta-cache

KeyValueStore: performance improvement and docs

Merge pull request #2523 from ceph/wip-6926

rbd: Fix rbd diff for non-existent objects

Reviewed-by: Josh Durgin <josh.durgin@inktank.com>

Merge pull request #2601 from ceph/wip-python-flask

debian: python-flask is needed by ceph, not python-ceph

Reviewed-by: Loic Dachary <loic@dachary.org>

Merge remote-tracking branch 'gh/giant'

Conflicts:
qa/workunits/cephtool/test.sh
src/test/erasure-code/TestErasureCodeIsa.cc

osd: do not bind ms_objecter messenger

The objecter messenger is only used as a client to initiate client-side
connections to other OSDs.  It doesn't need to bind to a port.

This was added in 558d9fc956204b7a18001b148e171b893cb63d85 to push client
traffic to the cluster interface.  This doesn't actually help/work because
we are still connecting to our peers' client-facing addresses.

Signed-off-by: Sage Weil <sage@redhat.com>

debian: move ceph_rest_api.py into ceph

Signed-off-by: Sage Weil <sage@redhat.com>

ceph.spec.in: move ceph_rest_api.py into ceph

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #2602 from athanatos/wip-9574

PG: check full ratio again post-reservation

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #2604 from athanatos/wip-9113

ReplicatedPG: clean out completed trimmed objects as we go

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #2549 from ceph/wip-9545

os/FileJournal: do not request sync while shutting down

Reviewed-by: Samuel Just <sam.just@inktank.com>

Merge pull request #2550 from ceph/wip-8629

osd: fix cache_evict vs make_writeable/finish_ctx snapdir bug #8629

Reviewed-by: Samuel Just <sam.just@inktank.com>

Merge pull request #2510 from somnathr/wip-obj-delete-fix

FileStore: Race condition during object delete is fixed

Reviewed-by: Samuel Just <sam.just@inktank.com>

ceph.spec: fix python-flask dependency

This is needed by ceph-rest-api, which is in ceph.rpm; it's not related to
python-ceph (except that ceph-rest-api happens to require that too).

Backport: firefly
Signed-off-by: Sage Weil <sage@redhat.com>

debian: python-flask is needed by ceph, not python-ceph

It's used by ceph-rest-api which is in the 'ceph' (server) package.

Backport: firefly
Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #2598 from ceph/wip-9582

librados: fix other timeout segfault

Reviewed-by: Greg Farnum <greg@inktank.com>

Merge pull request #2458 from ceph/wip-9341

client: trim unused inodes before reconnecting to recovering MDS

Reviewed-by: Greg Farnum <greg@inktank.com>
Reviewed-by: John Spray <john.spray@redhat.com>

Merge pull request #2555 from theanalyst/wip/mailmap

mailmap updates

Reviewed-by: Loic Dachary <loic-201408@dachary.org>

mailmap: Riccardo Ferretti affiliation

Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>

mailmap: Casey Marshall affiliation

Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>

mailmap: Feng Wang affiliation

Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>

mailmap: Scott A. Brandt affiliation

Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>