mon/OSDMonitor: assert(pg in creating_pgs.pg) in send_pg_creates()

and mark OSDMonitor::send_pg_creates() a const method.

See-also: http://tracker.ceph.com/issues/20785
Signed-off-by: Kefu Chai <kchai@redhat.com>

mon/OSDMonitor: more verbose message for pg creation

See-also: http://tracker.ceph.com/issues/20785
Signed-off-by: Kefu Chai <kchai@redhat.com>

osd: do not send pg_created unless luminous

See-also: http://tracker.ceph.com/issues/20785
Signed-off-by: Kefu Chai <kchai@redhat.com>

Merge pull request #16669 from Yan-waller/wip-walle-0729testpglogcompile

test/osd: kill compile warning

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>

test/osd: kill compile warning

Signed-off-by: Yan Jun <yan.jun8@zte.com.cn>

Merge pull request #16667 from tchaikov/wip-objclass-omap

objclass: modify omap_get_{keys,vals} api

Reviewed-by: Sage Weil <sage@redhat.com>

librados_test_stub: use omap_get_vals2() and modify stubs

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
Signed-off-by: Casey Bodley <cbodley@redhat.com>

cls_kvs: adjust objclass api

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

cls_{rbd, journal, lua}: adjust api

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

cls/lua: add 'more' param for cls_cxx_map_get_vals()

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

cls/*: adjust use of cls_cxx_map_get_vals()

Now that objclass call gets a new 'more' param.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

objclass: add 'more' param to omap listing

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>

Merge pull request #16617 from dillaman/wip-20783

osd: moved OpFinisher logic from OSDOp to OpContext

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #16590 from LianneWang/master

ceph_test_rados: max_stride_size must be more than min_stride_size

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #16615 from tchaikov/wip-no-vla-in-cxx

kv/RocksDBStore: use vector instead of VLA for holding slices

Reviewed-by: Haomai Wang <haomai@xsky.com>
Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>

Merge pull request #16655 from liewegas/wip-osd-warning

osd/PG: fix warning so we discard_event() on a no-op state change

Reviewed-by: Greg Farnum <gfarnum@redhat.com>

Merge PR #16640 into master

* refs/remotes/upstream/pull/16640/head:
qa: fix wait for wrong health message

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge PR #16550 into master

* refs/remotes/upstream/pull/16550/head:
cephfs/ceph-fuse: add and modify ceph-fuse mount hint

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge PR #16413 into master

* refs/remotes/upstream/pull/16413/head:
qa/cephfs: lsof if umount fails

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

Merge PR #16410 into master

* refs/remotes/upstream/pull/16410/head:
mds: refuse 'export dir' request when mds is stopping

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>

osd/PG: fix warning

Introduced by 4af49a886679ceb8e8afba47f04e828e5911e325

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #16645 from tchaikov/wip-bluefs-allocator-is-dev-only-option

common/options: make "blue{fs,store}_allocator" LEVEL_DEV

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #16489 from liewegas/wip-bluestore-options

common/options.cc: document bluestore config options

Merge pull request #16520 from xiexingguo/wip-application-warn

mon/OSDMonitor: issue pool application related warning

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #16568 from liewegas/wip-application-warn

qa,doc: document and fix tests for pool application warnings

Merge pull request #16634 from neha-ojha/wip-default-device-class

osd: add default_device_class to metadata

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #16638 from liewegas/wip-20804

osd/PG: ignore CancelRecovery in NotRecovering

Reviewed-by: Greg Farnum <gfarnum@redhat.com>

Merge pull request #16646 from tchaikov/wip-qa-run-standalone-work-with-gnu-find

qa/run-standalone.sh: fix the find option to be compatible with GNU find

Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>

Merge pull request #16487 from liewegas/wip-mgr-module-health

mgr: mgr_module interface to report health alerts

Reviewed-by: John Spray <john.spray@redhat.com>

Merge pull request #16641 from liewegas/wip-mgr-configs

mgr/PyState: shut up about get_config on nonexistent keys

Reviewed-by: John Spray <john.spray@redhat.com>

Merge pull request #16582 from liewegas/wip-20633

mon/MgrMonitor: reset mgrdigest timer with new subscription

Reviewed-by: Kefu Chai <kchai@redhat.com>

qa/run-standalone.sh: fix the find option to be compatible with GNU find

also re-indent to be consistent with other part of this script

Signed-off-by: Kefu Chai <kchai@redhat.com>

common/options: make "blue{fs,store}_allocator" LEVEL_DEV

See-also: http://tracker.ceph.com/issues/20660
Signed-off-by: Kefu Chai <kchai@redhat.com>

Merge pull request #16599 from liewegas/wip-standalone-fixes

qa/workunits: adjust path to ceph-helpers.sh

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #16482 from tchaikov/wip-opt

common/options: refactors to set the properties in a more structured way

Reviewed-by: John Spray <john.spray@redhat.com>

Merge pull request #16589 from Yan-waller/wip-walle-0726testwatchnotify

test/rados: fix wrong parameter order of RETURN1_IF_NOT_VAL

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #16609 from wjwithagen/wip-wjw-FreeBSD-group-wheel

ceph_disk/main.py: FreeBSD root has wheel for group

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #16593 from shangzhong/wip-20660

os/bluestore/StupidAllocator: rounded down len to an align boundary

Reviewed-by: Sage Weil <sage@redhat.com>

common/options: document bluestore options

Signed-off-by: Sage Weil <sage@redhat.com>

compressor: accept 'none' or '' for none

This makes the parse and output methods match up.

Signed-off-by: Sage Weil <sage@redhat.com>

os/bluestore: observe bluestore_compression_required_ratio

Signed-off-by: Sage Weil <sage@redhat.com>

doc/dev/config: some guidance around defining config options

Signed-off-by: Sage Weil <sage@redhat.com>

Merge PR #16435 into master

* refs/remotes/upstream/pull/16435/head:
qa: whitelist trim error during powercycle tests

Reviewed-by: Kefu Chai <kchai@redhat.com>

mgr/PyState: shut up about get_config on nonexistent keys

Signed-off-by: Sage Weil <sage@redhat.com>

qa: fix wait for wrong health message

Fixes: http://tracker.ceph.com/issues/20805
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #16450 from markhpc/wip-rocksdb-bloomsettings

kv/RocksDBStore: Table options for indexing and filtering

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #16281 from badone/wip-PG-cluster-log-audit

osd: Log audit

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #16514 from liewegas/wip-20744

qa/tasks/ceph: wait for mgr to activate and pg stats to flush in health()

Reviewed-by: John Spray <john.spray@redhat.com>

osd/PG: ignore CancelRecovery in NotRecovering

It's possible to get >1 CancelRecovery events in the queue.
The first will transition us from Recovering to NotRecovering.
Currently the second will make us crash.

This is harmless; instead just swallow the event.

Fixes: http://tracker.ceph.com/issues/20804
Signed-off-by: Sage Weil <sage@redhat.com>

qa: whitelist trim error during powercycle tests

Fixes: http://tracker.ceph.com/issues/20566
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>

Merge pull request #16635 from dzafman/wip-fix-test-pidfile

test: test_pidfile running 2nd mon has unreliable log output

Reviewed-by: Sage Weil <sage@redhat.com>

osd: silence coverity warning in async read operation contexts

Coverity doesn't know that the context is deleted via the "complete"
method and the embedded context is therefore also destructed when
it's completed.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

test: test_pidfile running 2nd mon has unreliable log output

Signed-off-by: David Zafman <dzafman@redhat.com>

osd: add default_device_class to metadata

Signed-off-by: Neha Ojha <nojha@redhat.com>

osd: moved OpFinisher logic from OSDOp to OpContext

This allows the memory lifetime of the OpFinisher to be tightly
controlled since the OpContext cannot be copied.

Fixes: http://tracker.ceph.com/issues/20783
Signed-off-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #16629 from johnwilkins/wip-doc-remove-contractions

Remove contractions from the documentation.

Reviewed-by: Greg Farnum <gfarnum@redhat.com>

Merge pull request #16572 from liewegas/wip-pidfile

test: add separate ceph-helpers-based smoke test

Reviewed-by: Kefu Chai <kchai@redhat.com>

doc/cephfs: Removed contractions for ESL speakers.

Signed-off-by: John Wilkins <jowilkin@redhat.com>

doc/start: Removed contractions for ESL speakers.

Signed-off-by: John Wilkins <jowilkin@redhat.com>

doc/man: Removed contractions for ESL speakers.

Signed-off-by: John Wilkins <jowilkin@redhat.com>

doc/install: Removed contractions for ESL speakers.

Signed-off-by: John Wilkins <jowilkin@redhat.com>

doc/rgw: Removed contractions for ESL speakers.

Signed-off-by: John Wilkins <jowilkin@redhat.com>

doc/rbd: Removed contractions for ESL speakers.

Signed-off-by: John Wilkins <jowilkin@redhat.com>

doc/rados: Removed contractions to improve readabilty for ESL speakers.

Signed-off-by: John Wilkins <jowilkin@redhat.com>

Merge pull request #16569 from liewegas/wip-set-not-put

mon: 'config-key put' -> 'config-key set'

Reviewed-by: Joao Eduardo Luis <joao@suse.de>

qa/standalone/crush/crush-classes: fix test

Signed-off-by: Sage Weil <sage@redhat.com>

qa/standalone/README

Signed-off-by: Sage Weil <sage@redhat.com>

test/smoke.sh: add simple ceph-helpers-based smoke test

This is just enough during make check to know things aren't totally
broken.

Signed-off-by: Sage Weil <sage@redhat.com>

qa/suites/rados/upgrade: fix upgrade wait for healthy

There is no mgr, so we can't call ceph.healthy.

Signed-off-by: Sage Weil <sage@redhat.com>

qa/tasks/ceph: wait for pg stats to flush in healthy check

Signed-off-by: Sage Weil <sage@redhat.com>

qa/tasks/ceph_manager: wait_for_all_up -> wait_for_all_osds_up

Signed-off-by: Sage Weil <sage@redhat.com>

qa/tasks/ceph_manager: expose flush_all_pg_stats

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #16388 from xiexingguo/wip-class-misc-fixes

crush, mon: simplify device class manipulation commands

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #16172 from ivancich/wip-dup-ops

PGLog: store extra duplicate ops beyond the normal log entries

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #16558 from hjwsm1989/fix-recovering-hang-with-unfound-objects

  osd/PrimaryLogPG: fix recovering hang when have unfound objects

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #16561 from Yan-waller/wip-walle-0725osddumpclinfo

osd: add dump filter for tracked ops

Reviewed-by: Gregory Farnum <gfarnum@redhat.com>

PGLog: continuation, store extra duplicate ops beyond the normal log entries

This helps us avoid replaying non-idempotent client operations when
the pg log is very short, e.g. in an effort to force OSDs to use
backfill rather than regular recovery. This can be advantageous to
avoid blocking i/o to objects, at the cost of longer total time to
become clean (since backfill requires scanning the objects to see what
is missing).

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>

Merge pull request #16384 from mikulely/2-checkout-placmenet-target-existness

rgw: check placement target existence during bucket creation

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #16389 from prallabh/wip-20661

rgw: Do not decrement stats cache when the cache values are zero

Reviewed-by: Orit Wasserman <owasserm@redhat.com>

Merge pull request #16463 from cbodley/wip-20708

rgw: fix parse/eval of policy conditions with IfExists

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>

Merge pull request #16495 from weiqiaomiao/wip_weiqm_rgw_crash

rgw: fix radosgw will crash when service is restarted during lifecycl…

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Daniel Gryniewicz <dang@redhat.com>

Merge pull request #16531 from rzarzynski/wip-rgw-20757

rgw: fix memory leaks during Swift Static Website's error handling.

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #16601 from rzarzynski/wip-rgw-20774

rgw: never let http_redirect_code of RGWRedirectInfo to stay uninitialized

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>

Merge pull request #16604 from rzarzynski/wip-rgw-20779

rgw: fix the UTF8 check on bucket entry name in rgw_log_op().

Reviewed-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #16575 from liewegas/wip-20693

qa/suites/rados: at-end: ignore PG_{AVAILABILITY,DEGRADED}

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

qa/suites: more whitelisting

Signed-off-by: Sage Weil <sage@redhat.com>

cephfs/ceph-fuse: add and modify ceph-fuse mount hint

1. "-n" is applied the client authorization feature.
2. "root_directory" misleading to mount the root directory ,
     in fact, here mount should be "sub_directory".
Refer to: http://docs.ceph.com/docs/master/cephfs/client-auth/#cephfs-client-capabilities

Signed-off-by: huanwen ren <ren.huanwen@zte.com.cn>

Merge pull request #16398 from dillaman/wip-20655

rbd-mirror: guard the deletion of non-primary images

Reviewed-by: Venky Shankar <vshankar@redhat.com>

Merge pull request #16574 from batrick/rgw-rbd-stripped-build

CMakeLists: trim rbd/rgw forced dependencies

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #16603 from dillaman/wip-rbd-mirror-valgrind

rbd-mirror: initialize timer context pointer to null

kv/RocksDBStore: use vector instead of VLA for holding slices

clang complains:

ceph/src/kv/RocksDBStore.cc:611:32: error: variable length array of
non-POD element type
      'rocksdb::Slice'
    rocksdb::Slice value_slices[to_set_bl.buffers().size()];

and i believe GCC will also complains with: -Wvla or -pedantic. as
to_set_bl.buffers().size() is not a const expr at compile time.

Signed-off-by: Kefu Chai <kchai@redhat.com>

Merge pull request #16613 from liewegas/wip-vstart-mgr

vstart.sh: start mgr after mon, before osds

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>

Merge pull request #16584 from gregsfortytwo/wip-deletes-coverity

messages: default-initialize MOSDPGRecoveryDelete[Reply] members

Reviewed-by: Jos Collin <jcollin@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>

vstart.sh: start mgr after mon, before osds

Signed-off-by: Sage Weil <sage@redhat.com>

src/ceph-disk/ceph_disk/main.py: FreeBSD root has wheel for group

Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>

kv/RocksDBStore: Add table options for filter and index tuning.

Signed-off-by: Mark Nelson <mnelson@redhat.com>

Merge pull request #16610 from dzafman/wip-fix-reg11184

test: reg11184 might not always find pg 2.0 prior to import

Reviewed-by: Sage Weil <sage@redhat.com>

PendingReleaseNotes: note about put -> set

Signed-off-by: Sage Weil <sage@redhat.com>

qa/workunits/cephtool/test.sh: add some config-key tests

Signed-off-by: Sage Weil <sage@redhat.com>

mon: 'config-key put' -> 'config-key set'

Signed-off-by: Sage Weil <sage@redhat.com>