]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
4 years agodoc: introduce Poseidon store 36343/head
myoungwon oh [Thu, 23 Jul 2020 08:12:07 +0000 (17:12 +0900)]
doc: introduce Poseidon store

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
Signed-off-by: Jiwoong Park <jw12.park@samsung.com>
Signed-off-by: Kyuho Son <kyuho.son@samsung.com>
Signed-off-by: Sungkyu Park <sk921.park@samsung.com>
5 years agoMerge pull request #35989 from bigwhite37/fix-dedup-tool-unused-var-warn
myoungwon oh [Thu, 16 Jul 2020 00:42:30 +0000 (09:42 +0900)]
Merge pull request #35989 from bigwhite37/fix-dedup-tool-unused-var-warn

tools/ceph_dedup_tool: fix unused variable warning

Reviewed-by: Myoungwon Oh <myoungwon.oh@samsung.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #30780 from zhangsw/fix-rgw-multipart-abortdate
ofriedma [Wed, 15 Jul 2020 16:21:55 +0000 (19:21 +0300)]
Merge pull request #30780 from zhangsw/fix-rgw-multipart-abortdate

rgw: add abort multipart date and rule-id header to init multipart upload response

5 years agoMerge pull request #35950 from zdover23/wip-doc-dev-guide-add-zdover-to-lead-list
zdover23 [Wed, 15 Jul 2020 14:37:46 +0000 (00:37 +1000)]
Merge pull request #35950 from zdover23/wip-doc-dev-guide-add-zdover-to-lead-list

doc/devel: add zdover to leads list

5 years agoMerge pull request #34537 from ideepika/wip-bluestore-mem-tracking
Josh Durgin [Wed, 15 Jul 2020 13:50:58 +0000 (06:50 -0700)]
Merge pull request #34537 from ideepika/wip-bluestore-mem-tracking

os/bluestore: mempool split for finer granularity

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Mark Nelson <mnelson@redhat.com>
Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
5 years agoMerge pull request #35901 from sebastian-philipp/juanmi-firewall-refactor
Sebastian Wagner [Wed, 15 Jul 2020 12:44:20 +0000 (14:44 +0200)]
Merge pull request #35901 from sebastian-philipp/juanmi-firewall-refactor

cephadm: refactor update_firewalld

Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
5 years agoMerge pull request #35862 from adk3798/cephadm_45724
Sebastian Wagner [Wed, 15 Jul 2020 12:42:54 +0000 (14:42 +0200)]
Merge pull request #35862 from adk3798/cephadm_45724

mgr/cephadm: check-host should not fail as hard using fqdn

Reviewed-by: Michael Fritch <mfritch@suse.com>
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
5 years agoMerge pull request #35471 from sebastian-philipp/cephadm-daemon-spec
Sebastian Wagner [Wed, 15 Jul 2020 12:39:35 +0000 (14:39 +0200)]
Merge pull request #35471 from sebastian-philipp/cephadm-daemon-spec

mgr/cephadm: Add CephadmDaemonSpec class

5 years agoMerge pull request #35838 from mgfritch/cephadm-rgw-spec-validate
Sebastian Wagner [Wed, 15 Jul 2020 12:37:56 +0000 (14:37 +0200)]
Merge pull request #35838 from mgfritch/cephadm-rgw-spec-validate

python-common: RGW service_id might not contain a zone

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
5 years agodoc/devel: add zdover to leads list 35950/head
Zac Dover [Wed, 15 Jul 2020 10:59:06 +0000 (20:59 +1000)]
doc/devel: add zdover to leads list

This commit adds "zdover" to the list of
leads as the Docs Lead.

Fixes: https://tracker.ceph.com/issues/46378
Signed-off-by: Zac Dover <zac.dover@gmail.com>
5 years agoMerge pull request #36096 from BenoitKnecht/doc-osd-scrub-during-recovery
Kefu Chai [Wed, 15 Jul 2020 10:58:43 +0000 (18:58 +0800)]
Merge pull request #36096 from BenoitKnecht/doc-osd-scrub-during-recovery

doc/rados: Fix osd_scrub_during_recovery default value

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Zac Dover <zac.dover@gmail.com>
5 years agoMerge pull request #36052 from smithfarm/wip-focce
Kefu Chai [Wed, 15 Jul 2020 10:52:18 +0000 (18:52 +0800)]
Merge pull request #36052 from smithfarm/wip-focce

bluestore: fix typo in _flush function declaration

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #35991 from votdev/adapt_cephadm_vagrantbox_to_el8
Sebastian Wagner [Wed, 15 Jul 2020 10:46:58 +0000 (12:46 +0200)]
Merge pull request #35991 from votdev/adapt_cephadm_vagrantbox_to_el8

mgr/cephadm: Adapt Vagrantbox to el8

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
5 years agoMerge pull request #35315 from weixinwei/master
Kefu Chai [Wed, 15 Jul 2020 10:42:57 +0000 (18:42 +0800)]
Merge pull request #35315 from weixinwei/master

blk:BlockDevice.cc: use pending_aios instead of iovec size as ios num

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
5 years agoMerge pull request #35844 from wuhongsong/fuse-assert-Dprocess
Kefu Chai [Wed, 15 Jul 2020 10:39:19 +0000 (18:39 +0800)]
Merge pull request #35844 from wuhongsong/fuse-assert-Dprocess

common:  ignore SIGHUP prior to fork

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #36054 from tchaikov/wip-blk-no-unused-label
Kefu Chai [Wed, 15 Jul 2020 10:38:02 +0000 (18:38 +0800)]
Merge pull request #36054 from tchaikov/wip-blk-no-unused-label

blk/BlockDevice: use ceph_assertf() for assert

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
5 years agoMerge pull request #35744 from jmolmo/document_unmanaged_use
Sebastian Wagner [Wed, 15 Jul 2020 10:33:39 +0000 (12:33 +0200)]
Merge pull request #35744 from jmolmo/document_unmanaged_use

doc: Add information about unmanaged parameter

Reviewed-by: Alexandra Settle <asettle@suse.com>
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
Reviewed-by: Zac Dover <zac.dover@gmail.com>
5 years agomgr/cephadm: Add test for _check_daemons() 35471/head
Sebastian Wagner [Thu, 18 Jun 2020 12:07:54 +0000 (14:07 +0200)]
mgr/cephadm: Add test for _check_daemons()

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
5 years agomgr/cephadm: refactor `_create_daemon()`
Sebastian Wagner [Mon, 8 Jun 2020 10:45:14 +0000 (12:45 +0200)]
mgr/cephadm: refactor `_create_daemon()`

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
5 years agomgr/cephadm: Add CephadmDaemonSpec class
Sebastian Wagner [Mon, 8 Jun 2020 07:36:20 +0000 (09:36 +0200)]
mgr/cephadm: Add CephadmDaemonSpec class

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
5 years agoMerge pull request #35709 from zdover23/wip-doc-preferring-yaml-to-cli-in-cephadm
Sebastian Wagner [Wed, 15 Jul 2020 08:10:38 +0000 (10:10 +0200)]
Merge pull request #35709 from zdover23/wip-doc-preferring-yaml-to-cli-in-cephadm

doc/cephadm: add yaml info for orch apply mon

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
5 years agoMerge pull request #29283 from myoungwon/wip-refcount-snap
Samuel Just [Tue, 14 Jul 2020 22:52:42 +0000 (15:52 -0700)]
Merge pull request #29283 from myoungwon/wip-refcount-snap

osd: refcounting chunks for snapshotted manifest object

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com> (portions Sam wrote)
5 years agoMerge pull request #35955 from jschmid1/deprecate_filstore
Sebastian Wagner [Tue, 14 Jul 2020 14:17:52 +0000 (16:17 +0200)]
Merge pull request #35955 from jschmid1/deprecate_filstore

mgr/cephadm: do not accept filestore osds in osdspecs

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
Reviewed-by: Travis Nielsen <tnielsen@redhat.com>
Reviewed-by: Varsha Rao <varao@redhat.com>
5 years agodoc/cephadm: add yaml infor for orch apply mon 35709/head
Zac Dover [Tue, 14 Jul 2020 13:51:08 +0000 (23:51 +1000)]
doc/cephadm: add yaml infor for orch apply mon

This commit breaks one of the long sentences into
three shorter sentences, and adds a parenthetical
comment walking the reader through a series of commands,
explaining what each command does and why only the last
of the commands ends up having a lasting effect on the Ceph
environment.

Fixes: https://tracker.ceph.com/issues/46133
Signed-off-by: Zac Dover <zac.dover@gmail.com>
5 years agomgr/cephadm: check-host should not fail as hard using fqdn 35862/head
Adam King [Tue, 30 Jun 2020 21:49:09 +0000 (17:49 -0400)]
mgr/cephadm: check-host should not fail as hard using fqdn

Print error message instead of traceback when check-host
fails in due to host address not being found

Fixes: https://tracker.ceph.com/issues/45724
Signed-off-by: Adam King <adking@redhat.com>
5 years agocephadm: refactor update_firewalld 35901/head
Sebastian Wagner [Thu, 2 Jul 2020 14:28:14 +0000 (16:28 +0200)]
cephadm: refactor update_firewalld

* split into three different methods
* untangle service and port lists

This helps in making our firewall handling more dynamic.

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
Co-authored-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
5 years agodoc/rados: Fix osd_scrub_during_recovery default value 36096/head
Benoît Knecht [Tue, 14 Jul 2020 11:50:28 +0000 (13:50 +0200)]
doc/rados: Fix osd_scrub_during_recovery default value

Since 8dca17c, `osd_scrub_during_recovery` defaults to `false`, but the
documentation was still stating that its default value is `true`.

Fixes: https://tracker.ceph.com/issues/46531
Signed-off-by: Benoît Knecht <bknecht@protonmail.ch>
5 years agoMerge pull request #36013 from Devp00l/wip-46376
Sebastian Wagner [Tue, 14 Jul 2020 08:38:09 +0000 (10:38 +0200)]
Merge pull request #36013 from Devp00l/wip-46376

cephadm: Make Vagrantfile more flexible

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
5 years agoMerge pull request #36072 from zdover23/wip-doc-dev-word-choice-guidance
zdover23 [Tue, 14 Jul 2020 07:46:40 +0000 (17:46 +1000)]
Merge pull request #36072 from zdover23/wip-doc-dev-word-choice-guidance

doc/dev: remove extraneous word "guidance".

5 years agoMerge pull request #35931 from tchaikov/wip-mds-denc
Kefu Chai [Tue, 14 Jul 2020 04:04:32 +0000 (12:04 +0800)]
Merge pull request #35931 from tchaikov/wip-mds-denc

mds,denc: prepare for the enabling of denc support of EMetaBlob::fullbit

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge PR #35755 into master
Patrick Donnelly [Tue, 14 Jul 2020 02:53:29 +0000 (19:53 -0700)]
Merge PR #35755 into master

* refs/pull/35755/head:
mgr/volumes: Deprecate protect/unprotect CLI calls for subvolume snapshots

Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Kotresh Hiremath Ravishankar <khiremat@redhat.com>
Reviewed-by: Victoria Martinez de la Cruz <vkmc@redhat.com>
Reviewed-by: Goutham Pacha Ravi <gouthamr@redhat.com>
5 years agoMerge pull request #35970 from athanatos/sjust/wip-fix-lba-addrs
Kefu Chai [Tue, 14 Jul 2020 02:18:41 +0000 (10:18 +0800)]
Merge pull request #35970 from athanatos/sjust/wip-fix-lba-addrs

crimson/seastore: fix lba btree internal references

Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge PR #34246 into master
Patrick Donnelly [Mon, 13 Jul 2020 18:17:44 +0000 (11:17 -0700)]
Merge PR #34246 into master

* refs/pull/34246/head:
mds: add request to batch_op before taking auth pins and locks
mds: move MDRequestImpl::batch_reqs into Batch_Getattr_Lookup
mds: track which map batch_op is in-use in MDRequest

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge PR #34785 into master
Patrick Donnelly [Mon, 13 Jul 2020 18:16:28 +0000 (11:16 -0700)]
Merge PR #34785 into master

* refs/pull/34785/head:
ceph-fuse: show fuse helper options for libfuse >= 3.0
ceph-fuse: add splice read/write support to reduce the memory copy
ceph-fuse: add connection args parsing support for libfuse > 3.0
ceph-fuse: switch to fuse_reply_iov to reduce the memory copy

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>
5 years agoMerge PR #35327 into master
Patrick Donnelly [Mon, 13 Jul 2020 18:15:14 +0000 (11:15 -0700)]
Merge PR #35327 into master

* refs/pull/35327/head:
client: fix directory inode can not call release callback

Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge PR #35690 into master
Patrick Donnelly [Mon, 13 Jul 2020 18:14:16 +0000 (11:14 -0700)]
Merge PR #35690 into master

* refs/pull/35690/head:
mds: fix hang issue when accessing a file under a lost parent directory

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge PR #35848 into master
Patrick Donnelly [Mon, 13 Jul 2020 18:13:43 +0000 (11:13 -0700)]
Merge PR #35848 into master

* refs/pull/35848/head:
mds: do not submit omap_rm_keys if the dir is the basedir of merge.

Reviewed-by: Zheng Yan <zyan@redhat.com>
5 years agoos/Bluefs: fix file reader/writer buffer mempool 34537/head
Deepika Upadhyay [Wed, 17 Jun 2020 14:42:32 +0000 (10:42 -0400)]
os/Bluefs: fix file reader/writer buffer mempool

Signed-off-by: Deepika Upadhyay <dupadhya@redhat.com>
5 years agobluestore: _get_used_bytes should reflect new mempool fields
Deepika Upadhyay [Wed, 20 May 2020 20:32:02 +0000 (02:02 +0530)]
bluestore: _get_used_bytes should reflect new mempool fields

with bluestore_cache_other split further, the _get_used_bytes should
take into account the new mempool splits as well.

see also: 0ce8ee4b123eacfc2bfb14f554487e928512415a
  68ee931fd4b6bf748f95b14dae31d11738fbaf1e

Signed-off-by: Deepika Upadhyay <dupadhya@redhat.com>
5 years agocommon/mempool: More detailed bluestore stats
Adam Kupczyk [Thu, 14 May 2020 11:24:15 +0000 (07:24 -0400)]
common/mempool: More detailed bluestore stats

Splits bluestore bluestore_cache_other, exposes accounting of some internals.

Signed-off-by: Adam Kupczyk <akupczyk@redhat.com>
5 years agoIntroduce separate mempool for FileReaderBuffer and FileWriter
Deepika Upadhyay [Wed, 15 Apr 2020 12:10:15 +0000 (17:40 +0530)]
Introduce separate mempool for FileReaderBuffer and FileWriter

FileReaderBuffer and FileWriter uses Bufferlists which needs to be
tracked by mempool to get the proper memory usage.

Signed-off-by: Deepika Upadhyay <dupadhya@redhat.com>
5 years agosplit mempool allocation for bluestore_cache_other
Deepika Upadhyay [Wed, 15 Apr 2020 12:01:46 +0000 (17:31 +0530)]
split mempool allocation for bluestore_cache_other

While doing root cause analysis it bluestore_cache_other gives a bit of
a crude estimate, something more helpful would be to have it split into
the following fields:

- bluestore_cache_onode
- bluestore_cache_meta
- bluestore_onode_attrs

Signed-off-by: Deepika Upadhyay <dupadhya@redhat.com>
5 years agoMerge PR #35951 into master
Patrick Donnelly [Mon, 13 Jul 2020 18:10:00 +0000 (11:10 -0700)]
Merge PR #35951 into master

* refs/pull/35951/head:
qa/cephfs: set omit_sudo to False for wait_until_mounted() in...

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agocrimson/os/seastore: fix internal relative btree addrs 35970/head
Samuel Just [Tue, 7 Jul 2020 22:44:42 +0000 (15:44 -0700)]
crimson/os/seastore: fix internal relative btree addrs

Internal relative addrs must be block relative on disk and record
relative in deltas.  Use maybe_generate_relative as intended.

Signed-off-by: Samuel Just <sjust@redhat.com>
5 years agoseastore/test_transaction_manager: add a test which forces an lba split
Samuel Just [Tue, 7 Jul 2020 22:44:04 +0000 (15:44 -0700)]
seastore/test_transaction_manager: add a test which forces an lba split

Signed-off-by: Samuel Just <sjust@redhat.com>
5 years agoseastore/test_btree_lba_manager: ensure record and block addrs are different
Samuel Just [Tue, 7 Jul 2020 23:23:29 +0000 (16:23 -0700)]
seastore/test_btree_lba_manager: ensure record and block addrs are different

Adds an extra extent to each transaction in the test to ensure that
record and block relative addresses differ as they do in real usage.

Signed-off-by: Samuel Just <sjust@redhat.com>
5 years agoMerge pull request #34920 from ofriedma/ofriedma-civetweb-timeout
Casey Bodley [Mon, 13 Jul 2020 14:42:46 +0000 (10:42 -0400)]
Merge pull request #34920 from ofriedma/ofriedma-civetweb-timeout

rgw: increase civetweb request timeout to 65 seconds

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
5 years agodoc/dev: remove extraneous word "guidance". 36072/head
Zac Dover [Mon, 13 Jul 2020 14:19:19 +0000 (00:19 +1000)]
doc/dev: remove extraneous word "guidance".

This bug changes the sentence "If your patches emit
messages to the Ceph cluster log, please consult this
guidance:" to "If your patches emit messages to the
Ceph cluster log, please consult this:". This new sentence
is more natural and idiomatic.

Fixes: https://tracker.ceph.com/issues/46363
Signed-off-by: Zac Dover <zac.dover@gmail.com>
5 years agoMerge pull request #36055 from zli091/master
Casey Bodley [Mon, 13 Jul 2020 14:04:30 +0000 (10:04 -0400)]
Merge pull request #36055 from zli091/master

 rgw: lc: fix Segmentation Fault when the tag of the object was not f…

Reviewed-by: Or Friedmann <ofriedma@redhat.com>
Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
5 years agocephadm: Make Vagrantfile more flexible 36013/head
Stephan Müller [Wed, 1 Jul 2020 14:27:50 +0000 (16:27 +0200)]
cephadm: Make Vagrantfile more flexible

Now you can use a JSON or pass multiple variable to vagrant in order to
configure the outcome of VMs you get. Similar to vstart.sh you can use
OSDS, MGRS and MONS as arguments to pass. As OSDS behave a bit different
in this scenario you can also specify the amount of extra disks and OSD
VM has.

Fixes: https://tracker.ceph.com/issues/46376
Signed-off-by: Stephan Müller <smueller@suse.com>
5 years agocommon: ignore SIGHUP prior to fork 35844/head
hzwuhongsong [Tue, 30 Jun 2020 07:46:28 +0000 (15:46 +0800)]
common: ignore SIGHUP prior to fork

Otherwise, the ceph-fuse process is terminated by the logratote task and will produce one Uninterruptible Sleep process.

Fixes: http://tracker.ceph.com/issues/46269
Signed-off-by: hzwuhongsong <hzwuhongsong@corp.netease.com>
5 years agoblk/zoned: do not use g_ceph_context for reading conf 36054/head
Kefu Chai [Mon, 13 Jul 2020 03:19:53 +0000 (11:19 +0800)]
blk/zoned: do not use g_ceph_context for reading conf

use local `cct` instead, more consistent this way

Signed-off-by: Kefu Chai <kchai@redhat.com>
5 years agoblk/BlockDevice: use ceph_assertf() for assert
Kefu Chai [Sat, 11 Jul 2020 17:04:19 +0000 (01:04 +0800)]
blk/BlockDevice: use ceph_assertf() for assert

also silences a warning like

src/blk/BlockDevice.cc:158:1: warning: label 'out_fail' defined but not used [-Wunused-label]
  158 | out_fail:
      | ^~~~~~~~

Signed-off-by: Kefu Chai <kchai@redhat.com>
5 years agorgwlc: fix Segmentation Fault related to tags. 36055/head
zhuo li [Sun, 12 Jul 2020 09:31:20 +0000 (17:31 +0800)]
rgwlc: fix Segmentation Fault related to tags.

It is found that rgw crashes when putting a tag beyond the rule to the object, which can be solved by adding the return value judgment.

Fixes: https://tracker.ceph.com/issues/46485
Signed-off-by: zhuo li <lizhuo@chinatelecom.cn>
Signed-off-by: yupeng chen <chenyupeng@chinatelecom.cn>
5 years agoMerge pull request #36008 from idryomov/wip-krbd-58-options
Ilya Dryomov [Sat, 11 Jul 2020 20:19:34 +0000 (22:19 +0200)]
Merge pull request #36008 from idryomov/wip-krbd-58-options

rbd: recognize crush_location, read_from_replica and compression_hint map options

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
5 years agomds: do not decode EMetaBlob::fullbit struct_v < 8 35931/head
Kefu Chai [Fri, 3 Jul 2020 12:33:04 +0000 (20:33 +0800)]
mds: do not decode EMetaBlob::fullbit struct_v < 8

the struct_v of EMetaBlob::fullbit::encode was bumped from 7 to 8 in
d62c67ca2041797fc7aa212ae4a37ba91e5620e7, the oldest release containing
this change was hammer rc1.

`EMetaBlob::fullbit` is used to persist dentry + inode as part of
journal, after the journal is flushed to the metadata pool, and applied to
dirty metadata, the flushed segments are trimmed. also, it's not allowed
to upgrade a Ceph cluster across 2 releases. so, there is no need
to decode an on-disk struct which will be trimmmed as part of journal
recycling, and that struct was encoded in hammer.

Signed-off-by: Kefu Chai <kchai@redhat.com>
5 years agodenc: add boost::container::small_vector support
Kefu Chai [Sat, 4 Jul 2020 10:10:55 +0000 (18:10 +0800)]
denc: add boost::container::small_vector support

i could use `_denc::container_base<>` and `_denc::pushback_details<>` to
implement the traits for boost::container::small_vector (bcs for short),
but the second template parameter of bcs is a value of type size_t, so
the value it not a type, forunately, C++17 allows us to declare non-type
template parameter using `auto`, but when instantiating
_denc::container_base<>, the compiler complains that it expects a
constatnt of `auto` but `T` is passed in. because i have to change the
signature of `container_base` to something like
```
template<template<auto...> class C, typename Details, auto ...Ts>
  struct container_base {
```

so, in this change, the traits for bsc is implemented from scratch.

Signed-off-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #36041 from tchaikov/wip-mds-EMetaBlob
Kefu Chai [Sat, 11 Jul 2020 17:14:49 +0000 (01:14 +0800)]
Merge pull request #36041 from tchaikov/wip-mds-EMetaBlob

ceph-object-corpus: pick up changes to drop backward compatibility of…

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoceph-object-corpus: pick up changes to drop backward compatibility 36041/head
Kefu Chai [Sat, 11 Jul 2020 15:11:21 +0000 (23:11 +0800)]
ceph-object-corpus: pick up changes to drop backward compatibility

to drop backward compatibility of EMetaBlob

see also https://github.com/ceph/ceph-object-corpus/pull/12

Signed-off-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #35747 from adk3798/cephadm-44877
Kefu Chai [Sat, 11 Jul 2020 14:49:47 +0000 (22:49 +0800)]
Merge pull request #35747 from adk3798/cephadm-44877

mgr/cephadm: allow custom dashboard grafana url

Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
5 years agoMerge pull request #32852 from ifed01/wip-ifed-simplify-pin
Kefu Chai [Sat, 11 Jul 2020 12:12:27 +0000 (20:12 +0800)]
Merge pull request #32852 from ifed01/wip-ifed-simplify-pin

os/bluestore: simplify Onode pin/unpin logic.

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
5 years agoMerge pull request #35973 from mlausch/mgr-progress-perf
Kefu Chai [Sat, 11 Jul 2020 11:32:02 +0000 (19:32 +0800)]
Merge pull request #35973 from mlausch/mgr-progress-perf

mgr/progress: Skip pg_summary update if _events dict is empty.

Reviewed-by: Mykola Golub <mgolub@suse.com>
5 years agoMerge pull request #35915 from jmolmo/fix_rook_create_osd
Kefu Chai [Sat, 11 Jul 2020 11:31:14 +0000 (19:31 +0800)]
Merge pull request #35915 from jmolmo/fix_rook_create_osd

mgr/rook: Fix error creating OSDs

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
5 years agoMerge pull request #35968 from optimistyzy/73_debug
Kefu Chai [Sat, 11 Jul 2020 11:28:56 +0000 (19:28 +0800)]
Merge pull request #35968 from optimistyzy/73_debug

NVMEDevice: Fix the issue of multiple OSDs when using SPDK

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #32707 from petrutlucian94/windows.4
Kefu Chai [Sat, 11 Jul 2020 11:28:16 +0000 (19:28 +0800)]
Merge pull request #32707 from petrutlucian94/windows.4

Windows support [part 4]

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #35971 from tchaikov/wip-addr-parsing-strncpy
Kefu Chai [Sat, 11 Jul 2020 11:26:59 +0000 (19:26 +0800)]
Merge pull request #35971 from tchaikov/wip-addr-parsing-strncpy

common/addr_parsing: refactor safe_cat()

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge pull request #35990 from votdev/fix_cephadm_py_code
Kefu Chai [Sat, 11 Jul 2020 11:24:14 +0000 (19:24 +0800)]
Merge pull request #35990 from votdev/fix_cephadm_py_code

cephadm: Fix Python formating issues

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agobluestore: fix typo in _flush function declaration 36052/head
Nathan Cutler [Sat, 11 Jul 2020 09:00:45 +0000 (11:00 +0200)]
bluestore: fix typo in _flush function declaration

fab0c7148e84b1612e8e422e1876643a7cd4070b split BlueFS::_flush() into two
functions, each with a slightly different argument list. One of the
arguments is "bool force", but -- due to a typo -- it was declared as
"bool focce".

Fixes: fab0c7148e84b1612e8e422e1876643a7cd4070b
Signed-off-by: Nathan Cutler <ncutler@suse.com>
5 years agoMerge pull request #35717 from dmick/wip-cephadm-doc
Dan Mick [Sat, 11 Jul 2020 07:13:06 +0000 (00:13 -0700)]
Merge pull request #35717 from dmick/wip-cephadm-doc

doc/dev/cephadm.rst: clarify, fix spelling nits

5 years agoMerge PR #35813 into master
Patrick Donnelly [Sat, 11 Jul 2020 02:42:33 +0000 (19:42 -0700)]
Merge PR #35813 into master

* refs/pull/35813/head:
vstart.sh: use output of hostname for cephadm

Reviewed-by: Michael Fritch <mfritch@suse.com>
5 years agoMerge PR #36009 into master
Patrick Donnelly [Fri, 10 Jul 2020 23:46:50 +0000 (16:46 -0700)]
Merge PR #36009 into master

* refs/pull/36009/head:
doc: Update nfs-ganesha package requirements

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge pull request #35930 from smithfarm/wip-luminous-eol
Josh Durgin [Fri, 10 Jul 2020 21:34:31 +0000 (14:34 -0700)]
Merge pull request #35930 from smithfarm/wip-luminous-eol

doc: remove luminous from active releases

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-By: Abhishek Lekshmanan <abhishek@suse.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoqa/suites/krbd: turn on balanced reads for the fsx subsuite 36008/head
Ilya Dryomov [Thu, 9 Jul 2020 15:25:45 +0000 (17:25 +0200)]
qa/suites/krbd: turn on balanced reads for the fsx subsuite

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
5 years agotest/librbd/fsx: respect rbd_default_map_options in krbd_open()
Ilya Dryomov [Thu, 9 Jul 2020 20:27:41 +0000 (22:27 +0200)]
test/librbd/fsx: respect rbd_default_map_options in krbd_open()

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
5 years agorbd: recognize compression_hint map option
Ilya Dryomov [Wed, 17 Jun 2020 12:13:12 +0000 (14:13 +0200)]
rbd: recognize compression_hint map option

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
5 years agorbd: recognize crush_location and read_from_replica map options
Ilya Dryomov [Wed, 17 Jun 2020 12:12:01 +0000 (14:12 +0200)]
rbd: recognize crush_location and read_from_replica map options

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
5 years agomgr/volumes: Deprecate protect/unprotect CLI calls for subvolume snapshots 35755/head
Shyamsundar Ranganathan [Tue, 23 Jun 2020 20:53:46 +0000 (16:53 -0400)]
mgr/volumes: Deprecate protect/unprotect CLI calls for subvolume snapshots

Subvolume snapshots required to be protected, prior to cloning the same.

Also, protected snapshots were not allowed to be unprotected or removed,
if there were in-flight clones, whose source was the snapshot being
removed.

The protection of snapshots explicitly is not required, as these can be
prevented from being removed based only on the in-flight clones checks.

This commit hence deprecates the additional protect/unprotect requirements
prior to cloning a snapshot.

In addition to deprecating the above, support to query a subvolume for
supported features, via the info command, is added. The feature list
is set to "clone" and "auto-protect", where the latter is useful to
decide if protect/unprotect commands are required or not.

Fixes: https://tracker.ceph.com/issues/45371
Signed-off-by: Shyamsundar Ranganathan <srangana@redhat.com>
5 years agoMerge pull request #36010 from votdev/issue_46450_fix_stateful_tab_unit_test
Lenz Grimmer [Fri, 10 Jul 2020 14:46:54 +0000 (16:46 +0200)]
Merge pull request #36010 from votdev/issue_46450_fix_stateful_tab_unit_test

mgr/dashboard: StatefulTabDirective unit test fails

Reviewed-by: Tiago Melo <tmelo@suse.com>
5 years agoMerge pull request #36003 from tserlin/private-tserlin-selinux-add-amqp-soundd-types
Kefu Chai [Fri, 10 Jul 2020 14:25:05 +0000 (22:25 +0800)]
Merge pull request #36003 from tserlin/private-tserlin-selinux-add-amqp-soundd-types

selinux: add amqp and soundd types to ceph.te

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agomgr/dashboard: StatefulTabDirective unit test fails 36010/head
Volker Theile [Fri, 10 Jul 2020 11:42:53 +0000 (13:42 +0200)]
mgr/dashboard: StatefulTabDirective unit test fails

Fixes: https://tracker.ceph.com/issues/46450
Signed-off-by: Volker Theile <vtheile@suse.com>
5 years agoMerge pull request #35967 from tspmelo/wip-language-selector
Lenz Grimmer [Fri, 10 Jul 2020 11:31:38 +0000 (13:31 +0200)]
Merge pull request #35967 from tspmelo/wip-language-selector

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Sebastian Krah <skrah@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
5 years agodoc: Update nfs-ganesha package requirements 36009/head
Varsha Rao [Fri, 10 Jul 2020 11:25:41 +0000 (16:55 +0530)]
doc: Update nfs-ganesha package requirements

Fixes: https://tracker.ceph.com/issues/46449
Signed-off-by: Varsha Rao <varao@redhat.com>
5 years agoMerge pull request #35939 from votdev/issue_46370_fix_edit_host_label
Lenz Grimmer [Fri, 10 Jul 2020 09:10:44 +0000 (11:10 +0200)]
Merge pull request #35939 from votdev/issue_46370_fix_edit_host_label

mgr/dashboard: Edit host label dialog is crashing

Reviewed-by: Kiefer Chang <kiefer.chang@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
5 years agoMerge pull request #34946 from votdev/issue_43120_stateful_tabs
Lenz Grimmer [Fri, 10 Jul 2020 09:03:54 +0000 (11:03 +0200)]
Merge pull request #34946 from votdev/issue_43120_stateful_tabs

mgr/dashboard: stay on active tab

Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
5 years agomds: fix hang issue when accessing a file under a lost parent directory 35690/head
Zhi Zhang [Fri, 10 Jul 2020 09:03:50 +0000 (17:03 +0800)]
mds: fix hang issue when accessing a file under a lost parent directory

When a directory metadata is lost, if we looked up a file under this lost directory,
this request will hang forever.

Fixes: https://tracker.ceph.com/issues/46129
Signed-off-by: Zhi Zhang <zhangz.david@outlook.com>
5 years agocephadm: Fix Python formating issues 35990/head
Volker Theile [Thu, 9 Jul 2020 09:16:42 +0000 (11:16 +0200)]
cephadm: Fix Python formating issues

Fix obvious Python formating errors reported by my IDE.

Signed-off-by: Volker Theile <vtheile@suse.com>
5 years agoselinux: add amqp and soundd types to ceph.te 36003/head
Thomas Serlin [Fri, 10 Jul 2020 05:36:28 +0000 (01:36 -0400)]
selinux: add amqp and soundd types to ceph.te

Signed-off-by: Thomas Serlin <tserlin@redhat.com>
5 years agoMerge pull request #35904 from mkogan1/wip-fix-endpoint-not-connected-r2
J. Eric Ivancich [Fri, 10 Jul 2020 02:51:47 +0000 (22:51 -0400)]
Merge pull request #35904 from mkogan1/wip-fix-endpoint-not-connected-r2

rgw: fix boost::asio::async_write() does not return error...

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #35853 from wjwithagen/wjw-fix-rgw-to-base64
J. Eric Ivancich [Fri, 10 Jul 2020 02:50:43 +0000 (22:50 -0400)]
Merge pull request #35853 from wjwithagen/wjw-fix-rgw-to-base64

rgw: include string header

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Prateek Sachan <psachan@cs.iitr.ac.in>
5 years agoMerge pull request #35735 from ivancich/wip-radoslist-incomplete-multiparts-marker...
J. Eric Ivancich [Fri, 10 Jul 2020 02:48:25 +0000 (22:48 -0400)]
Merge pull request #35735 from ivancich/wip-radoslist-incomplete-multiparts-marker-maintenance

rgw: radoslist incomplete multipart uploads fix marker progression

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #35525 from cbodley/wip-45969
J. Eric Ivancich [Fri, 10 Jul 2020 02:46:36 +0000 (22:46 -0400)]
Merge pull request #35525 from cbodley/wip-45969

rgw: stop realm reloader before store shutdown

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
5 years agoMerge pull request #35409 from pritha-srivastava/wip-iam-get-role-policy
J. Eric Ivancich [Fri, 10 Jul 2020 02:45:00 +0000 (22:45 -0400)]
Merge pull request #35409 from pritha-srivastava/wip-iam-get-role-policy

rgw/iam: correcting the result of get role policy.

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #35189 from linuxbox2/wip-xxh-gc
J. Eric Ivancich [Fri, 10 Jul 2020 02:42:12 +0000 (22:42 -0400)]
Merge pull request #35189 from linuxbox2/wip-xxh-gc

rgw:gc: use XXHash for gc queue selection

Signed-off-by: Casey Bodley <cbodley@redhat.com>
Signed-off-by: Pritha Srivastava <prsrivas@redhat.com>
5 years agotools/ceph_dedup_tool: rm unused var "cur_time" 35989/head
SHU Zhenyi [Fri, 10 Jul 2020 02:41:37 +0000 (02:41 +0000)]
tools/ceph_dedup_tool: rm unused var "cur_time"

Signed-off-by: SHU Zhenyi <shuzhenyi@live.com>
5 years agotools/ceph_dedup_tool: fix unused var "debug"
SHU Zhenyi [Fri, 10 Jul 2020 02:41:14 +0000 (02:41 +0000)]
tools/ceph_dedup_tool: fix unused var "debug"

Signed-off-by: SHU Zhenyi <shuzhenyi@live.com>
5 years agoMerge PR #35999 into master
Patrick Donnelly [Thu, 9 Jul 2020 23:38:35 +0000 (16:38 -0700)]
Merge PR #35999 into master

* refs/pull/35999/head:
doc/governance: add Patrick to CLTW
doc/governance: correct João's name

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agodoc/governance: add Patrick to CLTW 35999/head
Patrick Donnelly [Thu, 9 Jul 2020 17:05:39 +0000 (10:05 -0700)]
doc/governance: add Patrick to CLTW

I guess I was missed!

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agodoc/governance: correct João's name
Patrick Donnelly [Thu, 9 Jul 2020 17:30:43 +0000 (10:30 -0700)]
doc/governance: correct João's name

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge pull request #35963 from ricardoasmarques/enable-iscsi-edit
Lenz Grimmer [Thu, 9 Jul 2020 14:07:32 +0000 (16:07 +0200)]
Merge pull request #35963 from ricardoasmarques/enable-iscsi-edit

mgr/dashboard: Allow to edit iSCSI target with active session

Reviewed-by: Tiago Melo <tmelo@suse.com>
5 years agoMerge pull request #35983 from ceph/kalebskeithley-1854083-1
kalebskeithley [Thu, 9 Jul 2020 13:43:05 +0000 (09:43 -0400)]
Merge pull request #35983 from ceph/kalebskeithley-1854083-1

selinux: allow ceph_t amqp_port_t:tcp_socket