run-make-check.sh: run ulimit without sudo

ulimit is a shell builtin like cd, not a separate program.
sudo looks for a binary to run, but there is no ulimit binary,
then you will get an error message like:
          "sudo: ulimit: command not found"
ulimit can only be run with root if you want raise the ulimit -n

Change-Id: I59ab09240cb15cabe5b0a7342c3f562cd50c75e9
Signed-off-by: yang.wang <yang.wang@easystack.cn>

Merge pull request #17358 from tchaikov/wip-doc-disable-ofp

doc/dev/perf: add doc on disabling -fomit-frame-pointer

Reviewed-by: Haomai Wang <haomai@xsky.com>

Merge pull request #16357 from Blackclaws/master

ceph-disk activate unlocks bluestore data partition

Reviewed-by: Loic Dachary <ldachary@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #16312 from tchaikov/wip-store-event-if-added

common,mds,mgr,mon,osd: store event only if it's added

Reviewed-by: Sage Weil <sage@redhat.com>

doc/dev/perf: add doc on disabling -fomit-frame-pointer

Signed-off-by: Kefu Chai <kchai@redhat.com>

Merge pull request #15847 from jan--f/doc-fix-multimds-cmds

doc: add allow_multimds and fs_name parameter

Reviewed-by: Yan, Zheng <zyan@redhat.com>

Merge pull request #16210 from aclamk/fix-radosgw-nfs-sync-hint

rgw,nfs: Add hint to use -o sync when mouting

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>

Merge pull request #16542 from linuxbox2/wip-rados-urls

librados.h:  add LIBRADOS_SUPPORTS_APP_METADATA

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #17346 from idryomov/wip-krbd-xfstests-update

qa/suites/krbd: rbd_xfstests job overhaul

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #16771 from yanyixing/fix-base

mgr/dashboard: fix pool size base conversion

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #16988 from mikulely/wip-mstart

mstart.sh: support read CLUSTERS_LIST from env var

Reviewed-by: Sage Weil <sage@redhat.com.>

Merge pull request #17057 from mikulely/enhance-vstart

vstart.sh: quote cmd params when display executing cmd

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #17092 from Liuchang0812/wip-man-kvstore-tool

doc: add ceph-kvstore-tool's man

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #17119 from nrdmn/wip-dashboard-httproot

pybind/mgr/dashboard: add url_prefix

Reviewed-by: John Spray <john.spray@redhat.com>

Merge pull request #17135 from amitkumar50/cov-tools-1

tools: Initialization of *server, command variables

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #17143 from smithfarm/wip-50-too-short

doc: SubmittingPatches: clarify PR title section

Merge pull request #17177 from liupan1111/wip-fix-rm

osd: allow FULL_TRY after failsafe

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #17220 from amitkumar50/cov-test-2

test: Check to avoid divide by zero

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #17313 from mslovy/wip-fix-storetest

os: kstore fix unittest for FiemapHole

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #17329 from xiexingguo/wip-21162

mon/OSDMonitor: make 'osd crush rule rename' idempotent

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #17296 from amitkumar50/cov-test-4

test: assert check for negative returns

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #17297 from amitkumar50/cov-os-2

os: Removing dead code from LFNIndex.cc

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #17334 from chenliuzhong/modify-fault_rang-parameter-in-reshard

os/bluestore: ExtentMap::reshard - fix wrong shard length

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Dongsheng Yang <dongsheng.yang@easystack.cn>

Merge pull request #17337 from scienceluo/wip-luo-fix-cinder-conf-branch

doc: move glance_api_version option to the right place

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #17341 from amitkumar50/cov-common-1

common: logically dead code inside shunique_lock.h

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #16915 from theanalyst/doc-12.2.0-major-changes

doc: 12.2.0 major release announcements

doc: release notes: changelog for 12.2.0

Amalgamated all the dev & RC changelogs + the changelog we saw post
12.1.4 into one large 12.2.0 changelog.

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>

Merge pull request #17308 from jcsp/wip-21157

mgr: fix crash in MonCommandCompletion

Reviewed-by: Tim Serong <tserong@suse.com>

Merge pull request #17312 from cbodley/wip-21155

qa: create_cache_pool no longer runs 'pool application enable'

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #17125 from xiexingguo/wip-add-bucket-with-loc

mon/OSDMonitor: add location option for "crush add-bucket" command

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #17239 from zmedico/PGPool-update-eliminate-expensive-union_of

osd/PG: PGPool::update: avoid expensive union_of

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #17276 from yuyuyu101/wip-mon-loop

msg/async: don't stuck into resetsession/retrysession loop

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #17288 from yuyuyu101/wip-21143

msg/async: don't kill connection if replacing

Reviewed-by: Sage Weil <sage@redhat.com>

common: logically dead code inside shunique_lock.h

Fixes the coverity issue:

** 1352097 Structurally dead code

CID 1352097 (#1 of 1): Structurally dead code (UNREACHABLE)
unreachable: This code cannot be reached: return ceph::shunique_lock<...

Signed-off-by: Amit Kumar <amitkuma@redhat.com>

Merge pull request #17254 from joscollin/wip-cleanup-rgw-override

rgw: add missing override in list_keys_init()

Reviewed-by: Casey Bodley <cbodley@redhat.com>

qa/suites/krbd: new rbd_xfstests job definition

ext4 seems to be a better choice for our purposes -- less test churn,
rather small and reliable exclude list.

All excluded tests but generic/050 fail with no krbd in the mix, most
have popped up on linux-ext4 list at least once.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>

qa/tasks/rbd.xfstests: take exclude list from yaml

Different filesystems (and further, different configurations of the
same filesystem) need different exclude lists.  Hard coding the list in
a wrapper script is inflexible.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>

qa/run_xfstests.sh: quit building xfstests on test nodes

xfstests is a pain to build on trusty, xenial and centos7 with a single
script.  It is also very sensitive to dependencies, which again need to
be managed on all those distros -- different sets of supported commands
and switches, some versions have known bugs, etc.

Download a pre-built, statically linked tarball and use it instead.
The tarball was generated using xfstests-bld by Ted Ts'o, with a number
of tweaks by myself (mostly concerning the build environment).

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>

qa/run_xfstests.sh: drop *_MKFS_OPTIONS variables

AFAICT ./check doesn't query EXT4_MKFS_OPTIONS or BTRFS_MKFS_OPTIONS,
We don't need anything special for xfs, so remove all of them to avoid
confusion.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>

qa/run_xfstests.sh: kill FS_TYPE variable

./check expects FSTYP, so use that throughout.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>

qa: create_cache_pool no longer runs 'pool application enable'

Fixes: http://tracker.ceph.com/issues/21155
Signed-off-by: Casey Bodley <cbodley@redhat.com>

Merge pull request #17311 from hjwsm1989/wip-monop-tracker

mon: use ceph_clock_now if message is self-generated

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #17330 from xiexingguo/wip-class-rename-idempotent

mon/OSDMonitor: make 'osd crush class rename' idempotent

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #16863 from mikulely/fix-curl-referer

rgw: fix opslog can't record referrer when using curl as client

Reviewed-by: Jos Collin <jcollin@redhat.com>
Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>

Merge pull request #16860 from mikulely/fix-opslog

rgw: fix opslog cannot record remote_addr

Reviewed-by: Jos Collin <jcollin@redhat.com>
Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>

Merge pull request #16933 from amitkumar50/cov-rgw-3

rgw: Initialize is_master, max_aio, size

Reviewed-by: Jos Collin <jcollin@redhat.com>
Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>

Merge pull request #17185 from oritwas/wip-rgw-20777

rgw-admin: require --yes-i-really-mean-it when using --inconsistent_index

Reviewed-by: Casey Bodley <cbodley@redhat.com>

doc: 12.2.0 major release announcements

Reordered the RC releases sections back to their respective components,
added a ceph-mon section, added links to documentation wherever
possible, and a few forgotten RGW announcements. Also cleared up the
PendingReleaseNotes upto this point

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>

os/bluestore:reshard-fix wrong shard length

change fault_range parameter from 'needs_reshard_end' to 'needs_reshard_end-needs_reshard_begin'
be given needs_reshard_end may be out of bounds

Signed-off-by: chenliuzhong <liuzhong.chen@easystack.cn>

doc: move glance_api_version option to the right place

Signed-off-by: Luo Kexue <luo.kexue@zte.com.cn>

pybind: fix filesystem page's pool size display

Signed-off-by: Yixing Yan <yanyx@umcloud.com>

pybind: using default column text-align same as others

Signed-off-by: Yixing Yan <yanyx@umcloud.com>

pybind: fix health page's pool size display

Signed-off-by: Yixing Yan <yanyx@umcloud.com>

Merge pull request #16774 from yanyixing/fix-sidenav

mgr/dashboard: fix rbd's pool sub menu

Reviewed-by: Kefu Chai <kchai@redhat.com>

vstart.sh: quote cmd params when display executing cmd

vstart.sh will echo executed cmd to the stdout:

/root/jiaying/ceph/build/bin/radosgw -c /root/jiaying/ceph/build/ceph.conf --log-file=/root/jiaying/ceph/build/out/rgw.j.log --debug-ms=1 -n client.rgw --rgw_frontends=civetweb port=8000

As params contain whitespaces, pasting the above cmd into the shell didn't start rgw
on the port 8000. Now the vstart.sh output is like the following:

'/root/jiaying/ceph/build/bin/radosgw' '-c' '/root/jiaying/ceph/build/ceph.conf' '--log-file=/root/jiaying/ceph/build/out/rgw.j.log' '--debug-ms=1' '-n' 'client.rgw' '--rgw_frontends=civetweb port=8000'

We can paste above cmd to the shell to restart rgw, it's more convenient for debugging.

Signed-off-by: Jiaying Ren <jiaying.ren@umcloud.com>

Merge pull request #17283 from liupan1111/wip-final-nbd

rbd-nbd: cleanup for NBDServer shut down

Reviewed-by: Mykola Golub <mgolub@mirantis.com>

doc: add ceph-kvstore-tool's man

Signed-off-by: liuchang0812 <liuchang0812@gmail.com>

Merge pull request #17269 from liewegas/wip-health

mon: fix two stray legacy get_health() callers

Reviewed-by: Kefu Chai <kchai@redhat.com

Merge pull request #17328 from tchaikov/wip-kill-gcc-warning

test/unittest_pg_log: silence gcc warning

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #17146 from shangzhong/wip-add-line-break

common: add line break for "ceph daemon TYPE.ID version"

Reviewed-by: huanwen ren <ren.huanwen@zte.com.cn>
Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #17091 from liupan1111/wip-txc-add

os/bluestore: support calculate cost when using spdk.

Reviewed-by: Haomai Wang <haomai@xsky.com>

Merge pull request #17251 from Songweibin/wip-unused-variable

os/bluestore: drop unused param "what" in apply()

Reviewed-by: Kefu Chai <kchai@redhat.com>

mon/OSDMonitor: make 'osd crush class rename' idempotent

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>

test/unittest_pg_log: silence gcc warning

this silences following warning:

In file included from ceph/src/test/osd/TestPGLog.cc:24:0:
ceph/src/googletest/googletest/include/gtest/gtest.h:430:16:
warning: ‘virtual void testing::Test::SetUp()’ was hidden
[-Woverloaded-virtual]
   virtual void SetUp();
                ^~~~~
ceph/src/test/osd/TestPGLog.cc:2703:8: warning:   by ‘void
PGLogTrimTest::SetUp(unsigned int, unsigned int, unsigned int)’
[-Woverloaded-virtual]
   void SetUp(unsigned min_entries, unsigned max_entries, unsigned
dup_track) {
        ^~~~~

Signed-off-by: Kefu Chai <kchai@redhat.com>

Merge pull request #17326 from neha-ojha/wip-21023-contd

doc: fix order of options in osd new

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #17180 from tchaikov/wip-literals-for-options

common/options: use user-defined literals for default values

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: John Spray <john.spray@redhat.com>

Merge pull request #16066 from tanghaodong25/bluefs-sync-write

os/bluestore/BlueFS: don't need wait for aio when using _sync_write

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #15479 from yonghengdexin735/wip-zzz-const

messages/MDentryLink: add const to member function

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #17256 from scienceluo/wip-luo-add-log-branch

auth: add err reason for log info in load function

Reviewed-by: Sage Weil <sage@redhat.com>

mon/OSDMonitor: make 'osd crush rule rename' idempotent

Fixes: http://tracker.ceph.com/issues/21162
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>

doc: fix order of options in osd new

Signed-off-by: Neha Ojha <nojha@redhat.com>

Merge pull request #17307 from liewegas/wip-powercycle-slow-trim

qa/suites/powercycle/osd/whitelist_health: whitelist slow trimming

qa/suites/powercycle/osd/whitelist_health: whitelist more

"2017-08-26 16:09:27.704418 mon.a mon.0 172.21.15.169:6789/0 876 : cluster [WRN] MDS health message (mds.0): Behind on trimming (66/30)" in cluster log

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #16857 from yanyixing/chartfix

pybind: fix chart size become bigger when refresh

Reviewed-by: John Spray <john.spray@redhat.com>

os: Removing dead code from LFNIndex.cc

Fixes the coverity issue:

** 1394832 Logically dead code
cannot_single: At condition r, the value of r
cannot be equal to 0.
dead_error_condition: The condition r must be true.
CID 1394832 (#1 of 1): Logically dead code (DEADCODE)
dead_error_line: Execution cannot reach the expression
-22 inside this statement: return r ? 0 : -22;.

Signed-off-by: Amit Kumar <amitkuma@redhat.com>

os:kstore fix unittest for FiemapHole

kstore always return [0, object_size] regardless of offset and length

Signed-off-by: Ning Yao <yaoning@unitedstack.com>

test: Check to avoid divide by zero

Fixes the coverity issue:

** 1219467 Division or modulo by zero
CID 1219467 (#1 of 1): Division or modulo by zero (DIVIDE_BY_ZERO)
74. divide_by_zero: In expression 100 / atoi(args[i + 1U]), division
 by expression atoi(args[i + 1U]) which may be zero has undefined behavior.

Signed-off-by: Amit Kumar amitkuma@redhat.com

test: assert check for negetive returns

Fixes the coverity issue:

** 1395371 Argument cannot be negative
1. negative_return_fn: Function open(file, 578, 448) returs a negative number.
2. var_assign: Assigning: signed variable fd = open

** 1395427 Argument cannot be negative
1. negative_return_fn: Function open(file, 578, 448) returns a negative number.
2. var_assign: Assigning: signed variable fd = open

Signed-off-by: Amit Kumar <amitkuma@redhat.com>

Merge pull request #17267 from linuxbox2/wip-lock-qlane

rgw_file:  fix LRU lane lock in evict_block()

mon: use ceph_clock_now if message is self-generated

Signed-off-by: huangjun <huangjun@xsky.com>

mgr: fix crash in MonCommandCompletion

Fixes: http://tracker.ceph.com/issues/21157
Signed-off-by: John Spray <john.spray@redhat.com>

Merge pull request #17293 from tchaikov/wip-jewel-x-singleton

qa/suites/rados/upgrade/jewel-x-singleton: tolerate sloppy past_intervals

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #17019 from dachary/wip-doc-ceph-disk

doc: document ceph-disk prepare class hierarchy

Reviewed-by: Kefu Chai <kchai@redhat.com>

qa/suites/rados/upgrade/jewel-x-singleton: tolerate sloppy past_intervals

See-also: d5d5d7d1
Signed-off-by: Kefu Chai <kchai@redhat.com>

Merge pull request #17284 from liupan1111/wip-nvme-cleanup

bluestore/NVMEDevice: code cleanup

Merge pull request #17253 from hjwsm1989/fix-qa-bug

qa: fix the potential delay of pg state change

Reviewed-by: Sage Weil <sage@redhat.com>

msg/async: don't kill connection if replacing

when existing connection is replacing, then meet send error, we can't kill
this existing connection. otherwise, when peer side reconnect, we will detect
reset condition and send resetsession to make peer discard messages.

Fixes: http://tracker.ceph.com/issues/21143
Signed-off-by: Haomai Wang <haomai@xsky.com>

bluestore/NVMEDevice: remove useless IOSegment, and set
dpdk_thread_adaptor as static.

Signed-off-by: Pan Liu <wanjun.lp@alibaba-inc.com>
Signed-off-by: Ziye Yang <optimistyzy@intel.com>

bluestore/NVMEDevice: remove useless aio_stop in class NVMEDevice

Signed-off-by: Pan Liu <wanjun.lp@alibaba-inc.com>
Signed-off-by: Ziye Yang <optimistyzy@gmail.com>

os/bluestore/NVMEDevice: remove not used BufferedExtents.

Signed-off-by: Pan Liu <wanjun.lp@alibaba-inc.com>
Signed-off-by: Ziye Yang <optimistyzy@gmail.com>

rbd-nbd: don't need call "stop()" seperately, and ~NBDServer will do it.

Signed-off-by: Pan Liu <wanjun.lp@alibaba-inc.com>

Merge pull request #17055 from dillaman/wip-21017

mgr/dashboard: fix duplicate images listed on iSCSI status page

Reviewed-by: John Spray <john.spray@redhat.com>

Merge pull request #17216 from Yan-waller/wip-walle-0824imagectx

test/librbd: fix mock method macro of set_journal_policy

Reviewed-by: Jason Dillaman <dillaman@redhat.com>

msg/async: don't stuck into resetsession/retrysession loop

if exist connection's connect_seq is zero and state is STANDBY and peer
connection is new, we will reply with RETRYSESSION and make peer connection
incr connect_seq. Then we receive connect.connect_seq==1, but
existing->connect_seq is still zero, so RESETSESSION tag replied.

RESET->RETRY->RESET loop is forever

Signed-off-by: Haomai Wang <haomai@xsky.com>

Merge pull request #17275 from ceph/revert-17268-wip-21089

Revert "os/bluestore: compensate for bad freelistmanager size/blocks metadata"

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #16494 from asomers/bin_bash

misc: Fix bash path in shebangs

Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
Reviewed-by: Kefu Chai <kchai@redhat.com>

Revert "os/bluestore: compensate for bad freelistmanager size/blocks metadata"

Merge pull request #17268 from liewegas/wip-21089

os/bluestore: compensate for bad freelistmanager size/blocks metadata

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>

Merge pull request #17271 from xiexingguo/wip-ls-by-class

mon/MonCommands: fix copy-and-paste error

Reviewed-by: Kefu Chai <kchai@redhat.com>

Merge pull request #17272 from scienceluo/wip-luo-silence-buiding-warning-branch

common: silence jenkins's buiding warning in obj_bencher.cc

Reviewed-by: Kefu Chai <kchai@redhat.com>