]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
8 years agoMerge pull request #16196 from liewegas/wip-19518
Sage Weil [Fri, 7 Jul 2017 15:07:44 +0000 (10:07 -0500)]
Merge pull request #16196 from liewegas/wip-19518

ceph_test_rados_api_c_read_operations: do not assert per-op rval is correct

Reviewed-by: Kefu Chai <kchai@redhat.com>
8 years agoMerge pull request #16201 from tchaikov/wip-20432
Kefu Chai [Fri, 7 Jul 2017 14:40:57 +0000 (22:40 +0800)]
Merge pull request #16201 from tchaikov/wip-20432

common/Timer: do not add event if already shutdown

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
8 years agoMerge pull request #16208 from ceph/wip-base-postun
Boris Ranto [Fri, 7 Jul 2017 14:20:15 +0000 (16:20 +0200)]
Merge pull request #16208 from ceph/wip-base-postun

rpm: Fix undefined FIRST_ARG

Reviewed-by: Nathan Cutler <ncutler@suse.com>
8 years agorpm: Fix undefined FIRST_ARG 16208/head
Boris Ranto [Fri, 7 Jul 2017 10:37:55 +0000 (12:37 +0200)]
rpm: Fix undefined FIRST_ARG

If FIRST_ARG is undefined, the rpms will show an error on upgrade
because the condition in the postun script gets broken.

This was a regression introduced by commit for issue 20077 that moved
ceph-disk unit files to ceph-base.

Fixes: http://tracker.ceph.com/issues/20077
Signed-off-by: Boris Ranto <branto@redhat.com>
8 years agoMerge pull request #16126 from ktdreyer/rpm-epoch-2
Boris Ranto [Fri, 7 Jul 2017 12:29:18 +0000 (14:29 +0200)]
Merge pull request #16126 from ktdreyer/rpm-epoch-2

rpm: bump epoch ahead of RHEL base

Reviewed-by: Nathan Cutler <ncutler@suse.com>
Reviewed-by: Boris Ranto <branto@redhat.com>
8 years agoMerge pull request #16199 from tchaikov/wip-release-note-escape-stars
Nathan Cutler [Fri, 7 Jul 2017 07:52:06 +0000 (09:52 +0200)]
Merge pull request #16199 from tchaikov/wip-release-note-escape-stars

tools: ceph-release-notes: escape asterisks not for inline emphasis

Reviewed-by: Nathan Cutler <ncutler@suse.com>
8 years agoMerge pull request #15895 from ganeshmaharaj/isal-v2.18
Kefu Chai [Fri, 7 Jul 2017 07:16:09 +0000 (15:16 +0800)]
Merge pull request #15895 from ganeshmaharaj/isal-v2.18

isa-l: update isa-l to v2.18

Reviewed-by: Kefu Chai <kchai@redhat.com>
8 years agocommon/Timer: do not add event if already shutdown 16201/head
Kefu Chai [Fri, 7 Jul 2017 05:44:03 +0000 (13:44 +0800)]
common/Timer: do not add event if already shutdown

otherwise the callback is leaked.

Fixes: http://tracker.ceph.com/issues/20432
Signed-off-by: Kefu Chai <kchai@redhat.com>
8 years agotools: ceph-release-notes: escape asterisks not for inline emphasis 16199/head
Kefu Chai [Fri, 7 Jul 2017 03:48:50 +0000 (11:48 +0800)]
tools: ceph-release-notes: escape asterisks not for inline emphasis

Signed-off-by: Kefu Chai <kchai@redhat.com>
8 years agoMerge remote-tracking branch 'upstream/pull/15844/head' into master
Patrick Donnelly [Fri, 7 Jul 2017 05:15:33 +0000 (22:15 -0700)]
Merge remote-tracking branch 'upstream/pull/15844/head' into master

* commit '47ab651a1f':
  qa: reset journal before cephfs_journal_tool_smoke.sh exits
  qa: remove 'apply' from journal_tool_smoke.sh

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
8 years agoMerge remote-tracking branch 'upstream/pull/15822/head' into master
Patrick Donnelly [Fri, 7 Jul 2017 05:14:32 +0000 (22:14 -0700)]
Merge remote-tracking branch 'upstream/pull/15822/head' into master

* upstream/pull/15822/head:
  qa: add timeout/repeat to pool df

Reviewed-by: John Spray <jspray@redhat.com>
8 years agoMerge remote-tracking branch 'upstream/pull/15950/head' into master
Patrick Donnelly [Fri, 7 Jul 2017 05:11:18 +0000 (22:11 -0700)]
Merge remote-tracking branch 'upstream/pull/15950/head' into master

* upstream/pull/15950/head:
  qa: update thrash max mds testing

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
8 years agoMerge remote-tracking branch 'upstream/pull/15758/head' into master
Patrick Donnelly [Fri, 7 Jul 2017 04:49:08 +0000 (21:49 -0700)]
Merge remote-tracking branch 'upstream/pull/15758/head' into master

* upstream/pull/15758/head:
  mds: repeat dir->is_frozen in rdlock_path_xlock_dentry

Reviewed-by: Zheng Yan <zyan@redhat.com>
8 years agoMerge remote-tracking branch 'upstream/pull/15510/head' into master
Patrick Donnelly [Fri, 7 Jul 2017 04:48:47 +0000 (21:48 -0700)]
Merge remote-tracking branch 'upstream/pull/15510/head' into master

* upstream/pull/15510/head:
  mds: improve freeze deadlock detection

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
8 years agoMerge remote-tracking branch 'upstream/pull/15937/head' into master
Patrick Donnelly [Fri, 7 Jul 2017 04:38:45 +0000 (21:38 -0700)]
Merge remote-tracking branch 'upstream/pull/15937/head' into master

* upstream/pull/15937/head:
  qa: remove unused quota config option

Reviewed-by: John Spray <jspray@redhat.com>
8 years agoMerge remote-tracking branch 'upstream/pull/15825/head' into master
Patrick Donnelly [Fri, 7 Jul 2017 04:38:13 +0000 (21:38 -0700)]
Merge remote-tracking branch 'upstream/pull/15825/head' into master

* upstream/pull/15825/head:
  mds: remove unused MDBalancer member
  Update last_epoch_(over|under) in MDBalaner if mds0 has failed

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
8 years agoMerge remote-tracking branch 'upstream/pull/15818/head' into master
Patrick Donnelly [Fri, 7 Jul 2017 04:37:45 +0000 (21:37 -0700)]
Merge remote-tracking branch 'upstream/pull/15818/head' into master

* upstream/pull/15818/head:
  mds: assert straydn to silence coverity error

Reviewed-by: Zheng Yan <zyan@redhat.com>
8 years agoMerge remote-tracking branch 'upstream/pull/15817/head' into master
Patrick Donnelly [Fri, 7 Jul 2017 04:36:34 +0000 (21:36 -0700)]
Merge remote-tracking branch 'upstream/pull/15817/head' into master

* upstream/pull/15817/head:
  qa: wait for healthy cluster before testing pins

Reviewed-by: Zheng Yan <zyan@redhat.com>
8 years agoMerge remote-tracking branch 'upstream/pull/13770/head' into master
Patrick Donnelly [Fri, 7 Jul 2017 04:32:45 +0000 (21:32 -0700)]
Merge remote-tracking branch 'upstream/pull/13770/head' into master

* upstream/pull/13770/head:
  tasks/cephfs: add TestStrays.test_replicated_delete_speed

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
8 years agoMerge pull request #15786 from markhpc/wip-bluestore-cache-behavior
Sage Weil [Fri, 7 Jul 2017 02:59:43 +0000 (21:59 -0500)]
Merge pull request #15786 from markhpc/wip-bluestore-cache-behavior

os/bluestore: cap rocksdb cache size

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
8 years agoMerge pull request #16120 from yanghonggang/master
Sage Weil [Fri, 7 Jul 2017 02:39:00 +0000 (21:39 -0500)]
Merge pull request #16120 from yanghonggang/master

os/filestore/FileJournal: FileJournal::open() close journal file before return error

Reviewed-by: Kefu Chai <kchai@redhat.com>
8 years agoMerge pull request #16019 from wido/mgr-plugin-zabbix
Sage Weil [Fri, 7 Jul 2017 02:38:01 +0000 (21:38 -0500)]
Merge pull request #16019 from wido/mgr-plugin-zabbix

mgr: Zabbix monitoring module

Reviewed-by: Kefu Chai <kchai@redhat.com>
8 years agoceph_test_rados_api_c_read_operations: do not assert per-op rval is correct 16196/head
Sage Weil [Fri, 7 Jul 2017 02:34:58 +0000 (22:34 -0400)]
ceph_test_rados_api_c_read_operations: do not assert per-op rval is correct

This is not included in the pg log and may be zeroed if there is an op
replayed.  Disable the assertion until the underlying bug is fixed.  See
http://tracker.ceph.com/issues/19518

Signed-off-by: Sage Weil <sage@redhat.com>
8 years agoMerge pull request #15647 from gmayyyha/format-config-show
Sage Weil [Fri, 7 Jul 2017 02:25:19 +0000 (21:25 -0500)]
Merge pull request #15647 from gmayyyha/format-config-show

common,config: OPT_FLOAT and OPT_DOUBLE output format in config show

Reviewed-by: Kefu Chai <kchai@redhat.com>
8 years agoMerge pull request #15743 from yuyuyu101/wip-20330
Sage Weil [Fri, 7 Jul 2017 02:24:22 +0000 (21:24 -0500)]
Merge pull request #15743 from yuyuyu101/wip-20330

msg: make listen backlog an option, increase from 128 to 512

Reviewed-by: Kefu Chai <kchai@redhat.com>
8 years agoMerge pull request #15781 from kchiu/wip-filejournal-fix
Sage Weil [Fri, 7 Jul 2017 02:23:56 +0000 (21:23 -0500)]
Merge pull request #15781 from kchiu/wip-filejournal-fix

os/filestore: call committed_thru when no journal entries are replayed

Reviewed-by: Sage Weil <sage@redhat.com>
8 years agoMerge pull request #15810 from liupan1111/wip-precise
Sage Weil [Fri, 7 Jul 2017 02:22:38 +0000 (21:22 -0500)]
Merge pull request #15810 from liupan1111/wip-precise

msg/async: make recv_stamp more precise

Reviewed-by: Haomai Wang <haomai@xsky.com>
8 years agoMerge pull request #16159 from tchaikov/wip-20432
Sage Weil [Fri, 7 Jul 2017 02:21:57 +0000 (21:21 -0500)]
Merge pull request #16159 from tchaikov/wip-20432

Context: C_ContextsBase: delete enclosed contexts in dtor

Reviewed-by: Sage Weil <sage@redhat.com>
8 years agoMerge pull request #15878 from renhwztetecs/renhw-wip-common-dns
Jos Collin [Fri, 7 Jul 2017 01:40:52 +0000 (01:40 +0000)]
Merge pull request #15878 from renhwztetecs/renhw-wip-common-dns

common: Update the error string when res_nsearch() or res_search() fails

Reviewed-by: Jos Collin <jcollin@redhat.com>
Reviewed-by: Sage Weil <sweil@redhat.com>
8 years agoUpdate isa-l to v2.18 15895/head
Ganesh Mahalingam [Wed, 31 May 2017 15:10:24 +0000 (08:10 -0700)]
Update isa-l to v2.18

This upgrade brings
-  Complete rewrite of DEFLATE optimizations resulting in 5X better
   throughput and compression ratios comapred to  zlib, lz4, lzo and 2X
   better decompression performance when compared to zlib.
-  AVX512 improvements to multi-buffer versions of MD5, SHA-1 and SHA-256
   cryptographic hashing functions resulting in 3X better in performance
   compared to the AVX2 generation.

This update improves bluestore compression and potential to improve
dedup performance.

Testing this patch with objectstore fio yeided a max of 37% increase in
compression performance.

Fio Params:
rw=randwrite,buffer_compress_percentage=50,nr_files=64,direct=1,buffered=0,size=4G,bs=64k

Test Avg BlueStore Compression Time
v2.16(us)  v2.18(us)
iodepth=1,jobs=1 241.658    175.476 27.39%
iodepth=2,jobs=2 184.174    145.861 20.80%
iodepth=4,jobs=4 143.617    104.392 27.31%
iodepth=8,jobs=8 146.984    116.505 20.74%
iodepth=16,jobs=8 180.167    112.769 37.41%

Signed-off-by: Ganesh Mahalingam <ganesh.mahalingam@intel.com>
Signed-off-by: Tushar Gohad <tushar.gohad@intel.com>
8 years agocommon/config_opts: favor bluestore kv cache before meta until max. 15786/head
Mark Nelson [Tue, 27 Jun 2017 13:15:47 +0000 (08:15 -0500)]
common/config_opts: favor bluestore kv cache before meta until max.

Signed-off-by: Mark Nelson <mnelson@redhat.com>
8 years agoMerge pull request #16171 from wjwithagen/wip-wjw-freebsd-nobtrfs
Sage Weil [Thu, 6 Jul 2017 19:07:34 +0000 (14:07 -0500)]
Merge pull request #16171 from wjwithagen/wip-wjw-freebsd-nobtrfs

os/filestore: Exclude BTRFS on FreeBSD

Reviewed-by: Sage Weil <sage@redhat.com>
8 years agokv/RocksDBStore: explicitly disable block_cache when set to 0.
Mark Nelson [Tue, 27 Jun 2017 13:15:03 +0000 (08:15 -0500)]
kv/RocksDBStore: explicitly disable block_cache when set to 0.

Signed-off-by: Mark Nelson <mnelson@redhat.com>
8 years agoos/bluestore: limit kv cache size.
Mark Nelson [Tue, 27 Jun 2017 13:13:13 +0000 (08:13 -0500)]
os/bluestore: limit kv cache size.

Signed-off-by: Mark Nelson <mnelson@redhat.com>
8 years agocommon/config_opts: Better rocksdb cache size description.
Mark Nelson [Tue, 20 Jun 2017 12:20:05 +0000 (07:20 -0500)]
common/config_opts: Better rocksdb cache size description.

Signed-off-by: Mark Nelson <mnelson@redhat.com>
8 years agokv/RocksDBStore: default to disable row cache.
Mark Nelson [Tue, 20 Jun 2017 12:15:53 +0000 (07:15 -0500)]
kv/RocksDBStore: default to disable row cache.

Signed-off-by: Mark Nelson <mnelson@redhat.com>
8 years agoMerge pull request #15670 from rzarzynski/wip-rgw-postobj-get_params-error-handling
Yuri Weinstein [Thu, 6 Jul 2017 15:47:02 +0000 (08:47 -0700)]
Merge pull request #15670 from rzarzynski/wip-rgw-postobj-get_params-error-handling

rgw: fix error handling in get_params() of RGWPostObj_ObjStore_S3.

Reviewed-by: Casey Bodley <cbodley@redhat.com>
8 years agoMerge pull request #15700 from mikulely/olh-cleanup
Yuri Weinstein [Thu, 6 Jul 2017 15:46:33 +0000 (08:46 -0700)]
Merge pull request #15700 from mikulely/olh-cleanup

rgw: cleanup rgw-admin duplicated judge during OLH GET/READLOG

Reviewed-by: Casey Bodley <cbodley@redhat.com>
8 years agoMerge pull request #15777 from oritwas/wip-rgw-no-log-meta
Yuri Weinstein [Thu, 6 Jul 2017 15:46:12 +0000 (08:46 -0700)]
Merge pull request #15777 from oritwas/wip-rgw-no-log-meta

rgw: log_meta only for more than one zone

Reviewed-by: Casey Bodley <cbodley@redhat.com>
8 years agoMerge pull request #15827 from joscollin/wip-CID1412979-uninitialized-members
Yuri Weinstein [Thu, 6 Jul 2017 15:45:07 +0000 (08:45 -0700)]
Merge pull request #15827 from joscollin/wip-CID1412979-uninitialized-members

rgw: Uninitialized member in LCRule

Reviewed-by: Casey Bodley <cbodley@redhat.com>
8 years agoMerge pull request #15938 from shashalu/fix-data-sync-run
Yuri Weinstein [Thu, 6 Jul 2017 15:44:12 +0000 (08:44 -0700)]
Merge pull request #15938 from shashalu/fix-data-sync-run

rgw: fix radosgw-admin data sync run crash

Reviewed-by: Casey Bodley <cbodley@redhat.com>
8 years agoMerge pull request #15949 from joscollin/wip-cleanup-rgw-rest-warning
Yuri Weinstein [Thu, 6 Jul 2017 15:43:41 +0000 (08:43 -0700)]
Merge pull request #15949 from joscollin/wip-cleanup-rgw-rest-warning

rgw: silence warning from -Wmaybe-uninitialized

Reviewed-by: Casey Bodley <cbodley@redhat.com>
8 years agoMerge pull request #15960 from aclamk/fix-rgw-cryptopp-compilation
Yuri Weinstein [Thu, 6 Jul 2017 15:43:25 +0000 (08:43 -0700)]
Merge pull request #15960 from aclamk/fix-rgw-cryptopp-compilation

radosgw: fix compilation with cryptopp

Reviewed-by: Casey Bodley <cbodley@redhat.com>
8 years agoMerge pull request #15965 from mdw-at-linuxbox/signature
Yuri Weinstein [Thu, 6 Jul 2017 15:42:50 +0000 (08:42 -0700)]
Merge pull request #15965 from mdw-at-linuxbox/signature

rgw: fix s3 object uploads with chunked transfers and v4 signatures.

Reviewed-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
8 years agoMerge pull request #16156 from tchaikov/wip-20524
Kefu Chai [Thu, 6 Jul 2017 15:00:58 +0000 (23:00 +0800)]
Merge pull request #16156 from tchaikov/wip-20524

osd/filestore: Revert "os/filestore: move ondisk in front

Reviewed-by: Pan Liu <liupan1111@gmail.com>
8 years agofilestore: Exclude BTRFS on FreeBSD 16171/head
Willem Jan Withagen [Thu, 6 Jul 2017 12:20:02 +0000 (14:20 +0200)]
filestore: Exclude BTRFS on FreeBSD

Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
8 years agoMerge pull request #16155 from majianpeng/man-rados-add-offset
Kefu Chai [Thu, 6 Jul 2017 09:02:48 +0000 (17:02 +0800)]
Merge pull request #16155 from majianpeng/man-rados-add-offset

doc/rados.8: add offset option for put command

Reviewed-by: Kefu Chai <kchai@redhat.com>
8 years agodoc/rados.8: add offset option for put command. 16155/head
Jianpeng Ma [Thu, 6 Jul 2017 13:55:11 +0000 (21:55 +0800)]
doc/rados.8: add offset option for put command.

Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
8 years agoContext: C_ContextsBase: delete enclosed contexts in dtor 16159/head
Kefu Chai [Thu, 6 Jul 2017 08:06:33 +0000 (16:06 +0800)]
Context: C_ContextsBase: delete enclosed contexts in dtor

there are chances that these contexts are never finished/completed

Fixes: http://tracker.ceph.com/issues/20432
Signed-off-by: Kefu Chai <kchai@redhat.com>
8 years agoMerge pull request #16032 from tanghaodong25/bluestore-aio-submit
Kefu Chai [Thu, 6 Jul 2017 08:01:50 +0000 (16:01 +0800)]
Merge pull request #16032 from tanghaodong25/bluestore-aio-submit

os/bluestore/KernelDevice: batch aio submit

Reviewed-by: Sage Weil <sage@redhat.com>
8 years agoMerge pull request #16086 from liewegas/wip-btrfs-experimental
Kefu Chai [Thu, 6 Jul 2017 08:00:48 +0000 (16:00 +0800)]
Merge pull request #16086 from liewegas/wip-btrfs-experimental

os/filestore: require experimental flag for btrfs

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
8 years agoRevert "os/filestore: move ondisk in front, so that return oncommit earlier, and... 16156/head
Kefu Chai [Thu, 6 Jul 2017 06:07:06 +0000 (14:07 +0800)]
Revert "os/filestore: move ondisk in front, so that return oncommit earlier, and improve write op performance."

This reverts commit 21f167cf39cc7c025004e9b455ce8ba1252863f0.

Fixes: http://tracker.ceph.com/issues/20524
Signed-off-by: Kefu Chai <kchai@redhat.com>
8 years agocommon: add query_str when res_search() failed 15878/head
huanwen ren [Thu, 6 Jul 2017 02:04:02 +0000 (10:04 +0800)]
common: add query_str when res_search() failed

I don't know the abort information about DNS Resolver,
if not add "query_str".

Signed-off-by: huanwen ren <ren.huanwen@zte.com.cn>
8 years agoMerge pull request #16026 from linuxbox2/wip-tag-timeout-secs
Yehuda Sadeh [Wed, 5 Jul 2017 18:22:35 +0000 (11:22 -0700)]
Merge pull request #16026 from linuxbox2/wip-tag-timeout-secs

rgw: cls: ceph::timespan tag_timeout wrong units

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
8 years agoMerge pull request #15873 from ztczll/zl
Sage Weil [Wed, 5 Jul 2017 15:47:23 +0000 (10:47 -0500)]
Merge pull request #15873 from ztczll/zl

osd: check queue_transaction return value

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>
8 years agoMerge pull request #16048 from Yan-waller/wip-waller-0630mon
Sage Weil [Wed, 5 Jul 2017 15:46:55 +0000 (10:46 -0500)]
Merge pull request #16048 from Yan-waller/wip-waller-0630mon

mon/mgr: add detail error infomation

Reviewed-by: John Spray <john.spray@redhat.com>
8 years agorpm: bump epoch ahead of RHEL base 16126/head
Ken Dreyer [Wed, 5 Jul 2017 15:32:54 +0000 (09:32 -0600)]
rpm: bump epoch ahead of RHEL base

RHEL's ceph-common package is "1". Move our upstream packages' epoch
ahead of that, so that upstream will always override whatever is in
RHEL, even if it happens to have a higher NVR one day.

Fixes: http://tracker.ceph.com/issues/20508
Signed-off-by: Ken Dreyer <kdreyer@redhat.com>
8 years agoMerge pull request #16122 from tchaikov/wip-qa-warning-msg
Sage Weil [Wed, 5 Jul 2017 15:26:56 +0000 (10:26 -0500)]
Merge pull request #16122 from tchaikov/wip-qa-warning-msg

qa/tasks/ceph: should be "Waiting for all PGs", not "all osds"

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
8 years agoMerge pull request #16117 from majianpeng/bluestore-move-object-exist-in-assign-nid
Kefu Chai [Wed, 5 Jul 2017 15:05:23 +0000 (23:05 +0800)]
Merge pull request #16117 from majianpeng/bluestore-move-object-exist-in-assign-nid

os/bluestore: move object exist in assign nid

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Sage Weil <sage@redhat.com>
8 years agoos/bluestore/BlueStore: move "onode::exists=true" in _assign_nid. 16117/head
Jianpeng Ma [Mon, 3 Jul 2017 10:48:13 +0000 (18:48 +0800)]
os/bluestore/BlueStore: move "onode::exists=true" in _assign_nid.

If object  has nid, it always set exists =true in get_onode.

Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
8 years agoMerge pull request #16110 from javacruft/wrap-and-sort
Kefu Chai [Wed, 5 Jul 2017 13:57:21 +0000 (21:57 +0800)]
Merge pull request #16110 from javacruft/wrap-and-sort

debian: wrap-and-sort all files

Reviewed-by: Kefu Chai <kchai@redhat.com>
8 years agoMerge pull request #15642 from wjwithagen/wip-wjw-freebsd-ceph-disk-zap
Kefu Chai [Wed, 5 Jul 2017 13:52:29 +0000 (21:52 +0800)]
Merge pull request #15642 from wjwithagen/wip-wjw-freebsd-ceph-disk-zap

ceph_disk/main.py: Allow FreeBSD zap a OSD disk

Reviewed-by: Loic Dachary <loic@dachary.org>
Reviewed-by: Kefu Chai <kchai@redhat.com>
8 years agoMerge pull request #16084 from mikulely/fix-data-pool-cli
Jos Collin [Wed, 5 Jul 2017 12:48:37 +0000 (12:48 +0000)]
Merge pull request #16084 from mikulely/fix-data-pool-cli

rgw,test: fix rgw placement rule pool config option

Reviewed By: Jos Collin <jcollin@redhat.com>

8 years agoMerge pull request #16024 from dillaman/wip-19035
Mykola Golub [Wed, 5 Jul 2017 11:53:46 +0000 (14:53 +0300)]
Merge pull request #16024 from dillaman/wip-19035

rbd: do not attempt to load key if auth is disabled

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
8 years agoMerge pull request #15860 from dillaman/wip-20168
Mykola Golub [Wed, 5 Jul 2017 11:52:55 +0000 (14:52 +0300)]
Merge pull request #15860 from dillaman/wip-20168

librbd: fail IO request when exclusive lock cannot be obtained

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
8 years agoos/filestore/FileJournal: FileJournal::open() close journal file before return error 16120/head
Yang Honggang [Wed, 5 Jul 2017 09:19:11 +0000 (17:19 +0800)]
os/filestore/FileJournal: FileJournal::open() close journal file before return error

After successfully opened journal in FileJournal::open(), the following
error returns will cause journal->open() in JournalingObjectStore::journal_replay()
failed and delete journal. In ~FileJournal(), we assert fd == -1. As we not cleanup
journal fd in FileJournal::open(), fd is not -1. This will generate a core.

Fixes: http://tracker.ceph.com/issues/20504
Signed-off-by: Yang Honggang <joseph.yang@xtaotech.com>
8 years agoMerge pull request #16118 from IlsooByun/fix-spdk-build-error
Kefu Chai [Wed, 5 Jul 2017 11:15:19 +0000 (19:15 +0800)]
Merge pull request #16118 from IlsooByun/fix-spdk-build-error

os/bluestore: fix build errors when spdk is on

Reviewed-by: Haomai Wang <haomai@xsky.com>
8 years agoqa/tasks/ceph: should be "Waiting for all PGs", not "all osds" 16122/head
Kefu Chai [Wed, 5 Jul 2017 03:44:55 +0000 (11:44 +0800)]
qa/tasks/ceph: should be "Waiting for all PGs", not "all osds"

amend the warning message

Signed-off-by: Kefu Chai <kchai@redhat.com>
8 years agoMerge pull request #15265 from cooldavid/pr-osd-historic-op
Kefu Chai [Wed, 5 Jul 2017 10:51:42 +0000 (18:51 +0800)]
Merge pull request #15265 from cooldavid/pr-osd-historic-op

osd: Preserve OSDOp information for historic ops

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
8 years agoMerge pull request #15964 from tchaikov/wip-5249
Kefu Chai [Wed, 5 Jul 2017 10:48:29 +0000 (18:48 +0800)]
Merge pull request #15964 from tchaikov/wip-5249

mon/MonClient: respect the priority in SRV RR

Reviewed-by: Gregory Farnum <gfarnum@redhat.com>
8 years agoMerge pull request #15780 from wjwithagen/wip-wjw-freebsd-use-ceph_to_hostos_errno
Kefu Chai [Wed, 5 Jul 2017 10:46:21 +0000 (18:46 +0800)]
Merge pull request #15780 from wjwithagen/wip-wjw-freebsd-use-ceph_to_hostos_errno

core: make the conversion from wire error to host OS work

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
8 years agocore: make the conversion from wire error to host OS work 15780/head
Willem Jan Withagen [Tue, 20 Jun 2017 13:52:06 +0000 (15:52 +0200)]
core: make the conversion from wire error to host OS work

 - The key change is the type of rval,
   that will call the conversion when en/decoded
 - Remainder is fixes for the type change and promotions

Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
8 years agomgr: Zabbix monitoring module 16019/head
Wido den Hollander [Tue, 27 Jun 2017 13:49:03 +0000 (15:49 +0200)]
mgr: Zabbix monitoring module

This ceph-mgr module will pull various values from the Ceph cluster
and send them to a Zabbix Server using zabbix_sender.

This requires the zabbix_sender executable to be present on the system
running ceph-mgr as it will be invoked to send data to Zabbix.

A Zabbix template can be found in this directory which can be used
to easily get data from your Ceph cluster into Zabbix.

More information is available in the README file found in the module's
directory.

Signed-off-by: Wido den Hollander <wido@42on.com>
8 years agoMerge pull request #15897 from yuyuyu101/wip-20390
Kefu Chai [Wed, 5 Jul 2017 07:06:21 +0000 (15:06 +0800)]
Merge pull request #15897 from yuyuyu101/wip-20390

msg/async: increase worker reference with local listen table enabled backend

Reviewed-by: Kefu Chai <kchai@redhat.com>
8 years agoMerge pull request #15754 from tchaikov/wip-test-auth-caps
Kefu Chai [Wed, 5 Jul 2017 07:05:21 +0000 (15:05 +0800)]
Merge pull request #15754 from tchaikov/wip-test-auth-caps

qa/suites: add test exercising workunits/mon/auth_caps.sh

Reviewed By: Brad Hubbard <bhubbard@redhat.com>
Reviewed-by: Joao Eduardo Luis <joao@suse.de>
8 years agoMerge pull request #16011 from hsepeng/cache-osd-bugfix
Kefu Chai [Wed, 5 Jul 2017 07:04:24 +0000 (15:04 +0800)]
Merge pull request #16011 from hsepeng/cache-osd-bugfix

osd/PrimaryLogPG solve cache tier osd high memory consumption

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
8 years agoMerge pull request #13918 from liupan1111/wip-fix-performance-filestore
Kefu Chai [Wed, 5 Jul 2017 07:00:44 +0000 (15:00 +0800)]
Merge pull request #13918 from liupan1111/wip-fix-performance-filestore

os/filestore: queue ondisk completion before apply work

Reviewed-by: Sage Weil <sage@redhat.com>
8 years agoMerge pull request #16051 from liewegas/wip-20381
Kefu Chai [Wed, 5 Jul 2017 06:59:32 +0000 (14:59 +0800)]
Merge pull request #16051 from liewegas/wip-20381

os/bluestore: fix deferred_aio deadlock

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
8 years agoos/bluestore: fix build errors when spdk is on 16118/head
Ilsoo Byun [Wed, 5 Jul 2017 05:42:10 +0000 (01:42 -0400)]
os/bluestore: fix build errors when spdk is on

- remove pthread library link from dpdk cmake
- fix the bugs of NVMEDevice

Signed-off-by: Ilsoo Byun <ilsoo.byun@sk.com>
8 years agoMerge pull request #15958 from liewegas/wip-mgr-modules 16065/head
John Spray [Tue, 4 Jul 2017 23:04:59 +0000 (00:04 +0100)]
Merge pull request #15958 from liewegas/wip-mgr-modules

mgr,mon: enable/disable mgr modules via 'ceph mgr module ...' commands

Reviewed-by: John Spray <john.spray@redhat.com>
8 years agodebian: wrap-and-sort all files 16110/head
James Page [Tue, 4 Jul 2017 16:37:23 +0000 (17:37 +0100)]
debian: wrap-and-sort all files

'wrap-and-sort -a -t' debian folder to apply consistent
ordering/formatting to all files.

This makes synchronization of debian package changes
between Ceph packages and Ubuntu packages easier to
manage.

Signed-off-by: James Page <james.page@ubuntu.com>
8 years agoMerge pull request #15305 from wjwithagen/wip-wjw-HAVE_BABELTRACE
Kefu Chai [Tue, 4 Jul 2017 12:20:12 +0000 (20:20 +0800)]
Merge pull request #15305 from wjwithagen/wip-wjw-HAVE_BABELTRACE

cmake: Rewrite HAVE_BABELTRACE  option to WITH_

Reviewed-by: Kefu Chai <kchai@redhat.com>
8 years agoMerge pull request #16094 from zphj1987/master
Kefu Chai [Tue, 4 Jul 2017 10:38:29 +0000 (18:38 +0800)]
Merge pull request #16094 from zphj1987/master

pybind/mgr/dashboard: fix get kernel_version error

Reviewed-by: Kefu Chai <kchai@redhat.com>
8 years agoceph-mgr:fix ceph-mgr web get kernel_version error 16094/head
Peng Zhang [Tue, 4 Jul 2017 08:08:28 +0000 (16:08 +0800)]
ceph-mgr:fix ceph-mgr web get kernel_version error

fix :
File "/usr/lib64/ceph/mgr/dashboard/module.py", line 523, in _clients
client['version'] = client['kernel_version']
----------

change client['kernel_version'] to
client['client_metadata']['kernel_version']

Signed-off-by: Peng Zhang zphj1987@gmail.com
8 years agoMerge pull request #16093 from tchaikov/wip-20432
Josh Durgin [Tue, 4 Jul 2017 07:06:38 +0000 (00:06 -0700)]
Merge pull request #16093 from tchaikov/wip-20432

osd: clear_queued_recovery() in on_shutdown()

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
8 years agoMerge pull request #15823 from jdurgin/wip-omap-tp-heartbeat
Kefu Chai [Tue, 4 Jul 2017 06:46:18 +0000 (14:46 +0800)]
Merge pull request #15823 from jdurgin/wip-omap-tp-heartbeat

osd/ReplicatedBackend: reset thread heartbeat after every omap entry …

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
8 years agoosd: clear_queued_recovery() in on_shutdown() 16093/head
Kefu Chai [Tue, 4 Jul 2017 02:45:44 +0000 (10:45 +0800)]
osd: clear_queued_recovery() in on_shutdown()

otherwise when we are kicking the PG waiting in OSD's awaiting_throttle
queue, the queue is still holding a strong reference of it. then we will
have warnings like "pgid 0.7 has ref count of 2" when shutting down OSD,
because pgmap is also holding a reference of it.

we could clear the "awaiting_throttle" directly in OSD::shutdown(), but
clear_queued_recovery() is more consistent this way, because it is PG
which registered itself to the queue in OSD, it'd be better if PG can
remove itself from the OSD when it is shutting down itself.

Fixes: http://tracker.ceph.com/issues/20432
Signed-off-by: Kefu Chai <kchai@redhat.com>
8 years agoMerge pull request #16081 from tsg-/tsg-affiliation
Xie Xingguo [Tue, 4 Jul 2017 00:42:28 +0000 (08:42 +0800)]
Merge pull request #16081 from tsg-/tsg-affiliation

mailmap, organizationmap: add affiliation for Tushar Gohad

Reviewed-by: Jos Collin <jcollin@redhat.com>
8 years agoos/filestore: require experimental flag for btrfs 16086/head
Sage Weil [Mon, 3 Jul 2017 16:16:53 +0000 (12:16 -0400)]
os/filestore: require experimental flag for btrfs

This isn't strictly accurate since we're really deprecating, but the
message is appropriately scary and reflects the risk of data loss.

Signed-off-by: Sage Weil <sage@redhat.com>
8 years agoMerge remote-tracking branch 'upstream/pull/16080/head' into HEAD
Patrick Donnelly [Mon, 3 Jul 2017 16:11:25 +0000 (09:11 -0700)]
Merge remote-tracking branch 'upstream/pull/16080/head' into HEAD

* upstream/pull/16080/head:
  doc/mon: clean up `mds fail`/`mds deactivate` descriptions

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
8 years agodoc: fix rgw placment rule pool config option 16084/head
Jiaying Ren [Mon, 3 Jul 2017 15:39:10 +0000 (23:39 +0800)]
doc: fix rgw placment rule pool config option

actually we're checking '--data-pool' and '--data-extra-pool'
during the argument parsing.

Signed-off-by: Jiaying Ren <jiaying.ren@umcloud.com>
8 years agoMerge pull request #15833 from Linbing/wip-osd-delete-MPing
Sage Weil [Mon, 3 Jul 2017 14:03:38 +0000 (09:03 -0500)]
Merge pull request #15833 from Linbing/wip-osd-delete-MPing

osd: osd does not using MPing Messages,do not include unused include

Reviewed-by: Kefu Chai <kchai@redhat.com>
8 years agodoc/mon: clean up `mds fail`/`mds deactivate` descriptions 16080/head
John Spray [Mon, 3 Jul 2017 13:46:47 +0000 (14:46 +0100)]
doc/mon: clean up `mds fail`/`mds deactivate` descriptions

Fixes: http://tracker.ceph.com/issues/20424
Signed-off-by: John Spray <john.spray@redhat.com>
8 years agoMerge pull request #16072 from tchaikov/wip-20453
Sage Weil [Mon, 3 Jul 2017 13:37:25 +0000 (08:37 -0500)]
Merge pull request #16072 from tchaikov/wip-20453

debian: workaround the bug in dpkg-maintscript-helper

Reviewed-by: Sage Weil <sage@redhat.com>
8 years agoMerge pull request #15835 from SUSE/wip-flatten-systemd-target-hierarchy-master
Sage Weil [Mon, 3 Jul 2017 13:34:04 +0000 (08:34 -0500)]
Merge pull request #15835 from SUSE/wip-flatten-systemd-target-hierarchy-master

systemd: Add explicit Before=ceph.target

Reviewed-by: Nathan Cutler <ncutler@suse.com>
Reviewed-by: Boris Ranto <branto@redhat.com>
8 years agomgr: Implement self_test() method in MgrModule
Wido den Hollander [Mon, 3 Jul 2017 12:48:06 +0000 (14:48 +0200)]
mgr: Implement self_test() method in MgrModule

Other modules are encouraged to override this method and implement
a as good as possible self-test which returns True or False

It should be a simple way of running (automated) testing on a ceph-mgr
module

Signed-off-by: Wido den Hollander <wido@42on.com>
8 years agomgr: set/get_localized_config in MgrModule
Wido den Hollander [Fri, 30 Jun 2017 14:49:46 +0000 (16:49 +0200)]
mgr: set/get_localized_config in MgrModule

get_localized_config was getting redundant as it was copied to various
modules.

This commit also introduces set_localized_config() which set a localized
configuration option for a module.

Signed-off-by: Wido den Hollander <wido@42on.com>
8 years agoMerge pull request #16067 from YangFanlinux/affi
Jos Collin [Mon, 3 Jul 2017 10:35:52 +0000 (10:35 +0000)]
Merge pull request #16067 from YangFanlinux/affi

 .mailmap, .organizationmap: Update Fan Yang information and affiliation

Reviewed By: Jos Collin <jcollin@redhat.com>

8 years agoMerge pull request #16055 from dmick/master
Kefu Chai [Mon, 3 Jul 2017 10:01:22 +0000 (18:01 +0800)]
Merge pull request #16055 from dmick/master

ceph.in: allow developer mode from outside build tree

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
8 years agodebian: workaround the bug in dpkg-maintscript-helper 16072/head
Kefu Chai [Mon, 3 Jul 2017 08:51:21 +0000 (16:51 +0800)]
debian: workaround the bug in dpkg-maintscript-helper

see https://bugs.launchpad.net/ubuntu/+source/snap-confine/+bug/1605052
and https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=582819

Fixes: http://tracker.ceph.com/issues/20453
Signed-off-by: Kefu Chai <kchai@redhat.com>