]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
6 years agomds: handle leftover reconnect information 25739/head
Yan, Zheng [Thu, 20 Dec 2018 13:16:15 +0000 (21:16 +0800)]
mds: handle leftover reconnect information

previous commit allows client to split reconnect into multiple
messages. mds may evict client after getting incomplete recconect.

Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
6 years agoclient: split large reconnect into multiple messages
Yan, Zheng [Thu, 20 Dec 2018 13:09:31 +0000 (21:09 +0800)]
client: split large reconnect into multiple messages

Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
6 years agomds: update MClientReconnect encoding
Yan, Zheng [Tue, 18 Dec 2018 08:22:21 +0000 (16:22 +0800)]
mds: update MClientReconnect encoding

The old encoding assumes that snaprealms are encoded at the tail of
message payload. So it does not allow adding new fields to the message.
The patch introduce new encoding for MClientReconnect, the new encoding
allows us to extend MClientReconnect.

The new encoding is not compatible with the old encoding. If mds does
not understand the new encoding. client needs to use the old encoding
to encode MClientReconnect.

Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
6 years agoMerge pull request #26250 from falcon78921/wip-doc-rados-typo
Xie Xingguo [Sat, 2 Feb 2019 00:26:50 +0000 (08:26 +0800)]
Merge pull request #26250 from falcon78921/wip-doc-rados-typo

doc: fixed typo in add-or-rm-mons.rst

Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agodoc: fixed typo in add-or-rm-mons.rst 26250/head
James McClune [Fri, 1 Feb 2019 22:12:24 +0000 (17:12 -0500)]
doc: fixed typo in add-or-rm-mons.rst

Redundant use of the word "monitor"

Signed-off-by: James McClune <jmcclune@mcclunetechnologies.net>
6 years agoMerge PR #25703 into master
Sage Weil [Fri, 1 Feb 2019 18:43:03 +0000 (12:43 -0600)]
Merge PR #25703 into master

* refs/pull/25703/head:
os/bluestore: option to disable bluestore warns on spillover.
mon: expose object store health warnings
osd: expose object store alerts
os/bluestore: indicate BlueFS spillover and lacking compressor alerts
os:enable ObjectStore::statfs() api to return OS alert list.

Reviewed-by: Sage Weil <sage@redhat.com>
6 years agoMerge PR #25773 into master
Sage Weil [Fri, 1 Feb 2019 18:42:38 +0000 (12:42 -0600)]
Merge PR #25773 into master

* refs/pull/25773/head:
common: Use OpenSSL for cryptographic hashing

Reviewed-by: Casey Bodley <cbodley@redhat.com>
6 years agoMerge PR #26067 into master
Sage Weil [Fri, 1 Feb 2019 18:41:25 +0000 (12:41 -0600)]
Merge PR #26067 into master

* refs/pull/26067/head:
pybind/rados: fix application metadata list

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
6 years agoMerge PR #26112 into master
Sage Weil [Fri, 1 Feb 2019 18:40:55 +0000 (12:40 -0600)]
Merge PR #26112 into master

* refs/pull/26112/head:
mgr: load modules in finisher to avoid potential lock cycles

Reviewed-by: Boris Ranto <branto@redhat.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
6 years agoMerge PR #26164 into master
Sage Weil [Fri, 1 Feb 2019 18:40:12 +0000 (12:40 -0600)]
Merge PR #26164 into master

* refs/pull/26164/head:
mon/LogMonitor: lower logging level for check_sub

Reviewed-by: Sage Weil <sage@redhat.com>
6 years agoMerge pull request #26224 from tchaikov/radek-lru-cleanup
Kefu Chai [Fri, 1 Feb 2019 16:01:58 +0000 (00:01 +0800)]
Merge pull request #26224 from tchaikov/radek-lru-cleanup

common: drop the unused methods from SharedLRU.

Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge pull request #26171 from sebastian-philipp/orchestrator-merge-create-add
Sebastian Wagner [Fri, 1 Feb 2019 15:42:36 +0000 (16:42 +0100)]
Merge pull request #26171 from sebastian-philipp/orchestrator-merge-create-add

mgr/orchestrator: Unify `osd create` and `osd add`

Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
6 years agoMerge pull request #26151 from nathan-weinberg/cluster-tests
Patrick Nawracay [Fri, 1 Feb 2019 15:09:11 +0000 (16:09 +0100)]
Merge pull request #26151 from nathan-weinberg/cluster-tests

mgr/dashboard: Added additional breadcrumb and tab tests to Cluster menu

Reviewed-by: Volker Theile <vtheile@suse.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
6 years agoMerge pull request #26231 from ivancich/wip-infinite-bucket-rm
J. Eric Ivancich [Fri, 1 Feb 2019 14:08:06 +0000 (09:08 -0500)]
Merge pull request #26231 from ivancich/wip-infinite-bucket-rm

rgw: `radosgw-admin bucket rm ... --purge-objects` can hang...

Reviewed-by: Casey Bodley <cbodley@redhat.com>
6 years agomgr/dashboard: Added additional breadcrumb and tab tests to Cluster menu 26151/head
Nathan Weinberg [Fri, 1 Feb 2019 13:55:37 +0000 (08:55 -0500)]
mgr/dashboard: Added additional breadcrumb and tab tests to Cluster menu

Fixes: https://tracker.ceph.com/issues/38050
Signed-off-by: Nathan Weinberg <nweinber@redhat.com>
6 years agoMerge pull request #26203 from rhcs-dashboard/updated-pg-status-chart-colors
Lenz Grimmer [Fri, 1 Feb 2019 11:29:21 +0000 (12:29 +0100)]
Merge pull request #26203 from rhcs-dashboard/updated-pg-status-chart-colors

mgr/dashboard: Updated colors in PG Status chart

Reviewed-by: Volker Theile <vtheile@suse.com>
6 years agoMerge pull request #25929 from falcon78921/wip-doc-37880
Kefu Chai [Fri, 1 Feb 2019 09:21:54 +0000 (17:21 +0800)]
Merge pull request #25929 from falcon78921/wip-doc-37880

doc: updated rgw multitenancy link

Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agomgr/orchestrator: Unify `osd create` and `osd add` 26171/head
Sebastian Wagner [Mon, 28 Jan 2019 15:57:38 +0000 (16:57 +0100)]
mgr/orchestrator: Unify `osd create` and `osd add`

Also:

* Added some more tests
* Better validation of drive Groups
* Simplified `TestWriteCompletion`

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
6 years agoMerge pull request #26228 from theanalyst/doc/releases/12.2.11
Abhishek L [Fri, 1 Feb 2019 07:46:53 +0000 (08:46 +0100)]
Merge pull request #26228 from theanalyst/doc/releases/12.2.11

doc: add release notes for 12.2.11 luminous

Reviewed-By: Sage Weil <sage@redhat.com>
Reviewed-By: Neha Ojha <nojha@redhat.com>
Reviewed-By: Nathan Cutler <ncutler@suse.com>
Reviewed-By: Eric Ivanvich <ivanvich@redhat.com>
6 years agorgw: `radosgw-admin bucket rm ... --purge-objects` can hang... 26231/head
J. Eric Ivancich [Thu, 31 Jan 2019 19:21:07 +0000 (14:21 -0500)]
rgw: `radosgw-admin bucket rm ... --purge-objects` can hang...

This command can hang (i.e., enter an infinite loop) due to
problematic bucket index entries left as a result of bug
https://tracker.ceph.com/issues/38007 .

The fix is to ignore the false bucket index entries -- since they do
not represent actual objects -- and remove all actual objects in the
bucket, so that bucket itself can be removed.

This fixes the both code paths whether `--bypass-gc` is specified or
not.

Furthermore, to made these operations more efficient, the internal
listing of the bucket is done unordered. This would improve behavior
when removing buckets with a large number of objects.

Fixes: http://tracker.ceph.com/issues/38134
Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
6 years agodoc: add release notes for 12.2.11 luminous 26228/head
Abhishek Lekshmanan [Thu, 31 Jan 2019 15:55:31 +0000 (16:55 +0100)]
doc: add release notes for 12.2.11 luminous

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
6 years agoMerge PR #26193 into master
Patrick Donnelly [Thu, 31 Jan 2019 20:35:36 +0000 (12:35 -0800)]
Merge PR #26193 into master

* refs/pull/26193/head:
mds: move session setup to ms_handle_accept
common: add method to get StackStringStream ptr

Reviewed-by: Sage Weil <sage@redhat.com>
6 years agoMerge PR #26038 into master
Patrick Donnelly [Thu, 31 Jan 2019 20:08:26 +0000 (12:08 -0800)]
Merge PR #26038 into master

* refs/pull/26038/head:
mds: simplify recall warnings
mds: add extra details for cache drop output
qa: test mds_max_caps_per_client conf
mds: limit maximum number of caps held by session
mds: adapt drop cache for incremental recall
mds: recall caps incrementally
mds: adapt drop cache for incremental trim
mds: add throttle for trimming MDCache
mds: cleanup SessionMap init
mds: cleanup Session init

Reviewed-by: Zheng Yan <zyan@redhat.com>
6 years agomds: simplify recall warnings 26038/head
Patrick Donnelly [Mon, 28 Jan 2019 23:48:38 +0000 (15:48 -0800)]
mds: simplify recall warnings

Instead of a timeout and complicated decisions about whether the client is
releasing caps in an expeditious fashion, just use a DecayCounter that tracks
the number of caps we've recalled. This counter is decremented whenever the
client releases caps. If the counter passes a threshold, then we raise the
warning.

Similar reworking is done for the steady-state recall of client caps. Another
release DecayCounter is added so we can tell when the client is not releasing
any more caps.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agomds: move session setup to ms_handle_accept 26193/head
Patrick Donnelly [Wed, 30 Jan 2019 23:52:06 +0000 (15:52 -0800)]
mds: move session setup to ms_handle_accept

Session setup in ms_handle_authentication is (historically) racy where multiple
connections from the same client can come in before one is finally accepted.  A
session should only be created after ms_handle_accept. The MDS did some
backflips before this commit to ensure this.

Moreover, with the msgr2 changes, it is even more necessary since the address
nonce is not set until before ms_handle_accept is called.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoMerge pull request #26190 from cbodley/wip-rgw-datalog-last-trim
Casey Bodley [Thu, 31 Jan 2019 17:37:09 +0000 (12:37 -0500)]
Merge pull request #26190 from cbodley/wip-rgw-datalog-last-trim

rgw multisite: only update last_trim marker on ENODATA

Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
6 years agocommon: drop the unused reset_comparator() from SharedLRU. 26224/head
Radoslaw Zarzynski [Wed, 12 Sep 2018 21:28:27 +0000 (23:28 +0200)]
common: drop the unused reset_comparator() from SharedLRU.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
6 years agocommon: drop the unused get_comparator() from SharedLRU.
Radoslaw Zarzynski [Wed, 12 Sep 2018 21:08:50 +0000 (23:08 +0200)]
common: drop the unused get_comparator() from SharedLRU.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
6 years agoMerge pull request #26188 from Exotelis/tracker-37916
Lenz Grimmer [Thu, 31 Jan 2019 09:59:06 +0000 (10:59 +0100)]
Merge pull request #26188 from Exotelis/tracker-37916

mgr/dashboard: Cleanup of the cluster and audit log

Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
6 years agocommon: add method to get StackStringStream ptr
Patrick Donnelly [Wed, 30 Jan 2019 22:23:53 +0000 (14:23 -0800)]
common: add method to get StackStringStream ptr

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoMerge pull request #25542 from jan--f/c-v-extend-batch
Andrew Schoen [Wed, 30 Jan 2019 19:29:40 +0000 (13:29 -0600)]
Merge pull request #25542 from jan--f/c-v-extend-batch

Extend batch to accept explicit device lists

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
6 years agoMerge pull request #26205 from cbodley/wip-38115
Casey Bodley [Wed, 30 Jan 2019 18:55:52 +0000 (13:55 -0500)]
Merge pull request #26205 from cbodley/wip-38115

qa/mon: fix cluster support for monmap bootstrap

Reviewed-by: Sage Weil <sage@redhat.com>
6 years agoMerge pull request #26204 from pritha-srivastava/wip-rgw-signature-mismatch
Casey Bodley [Wed, 30 Jan 2019 17:39:39 +0000 (12:39 -0500)]
Merge pull request #26204 from pritha-srivastava/wip-rgw-signature-mismatch

rgw: Fix for SignatureMismatchError in s3 commands.

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Ricardo Dias <rdias@suse.com>
6 years agoMerge pull request #25403 from liyichao/rdigest
David Zafman [Wed, 30 Jan 2019 17:30:23 +0000 (09:30 -0800)]
Merge pull request #25403 from liyichao/rdigest

tools: Add clear-data-digest command to objectstore tool.

Reviewed-by: David Zafman <dzafman@redhat.com>
6 years agoMerge pull request #26158 from dzafman/wip-38053
David Zafman [Wed, 30 Jan 2019 17:29:01 +0000 (09:29 -0800)]
Merge pull request #26158 from dzafman/wip-38053

Add hashinfo testing for dump command of ceph-objectstore-tool

Reviewed-by: Neha Ojha <nojha@redhat.com>
6 years agoqa/mon: fix cluster support for monmap bootstrap 26205/head
Casey Bodley [Wed, 30 Jan 2019 17:23:10 +0000 (12:23 -0500)]
qa/mon: fix cluster support for monmap bootstrap

-filter out mons from other clusters
-fix parsing of mon name from role

Fixes: http://tracker.ceph.com/issues/38115
Signed-off-by: Casey Bodley <cbodley@redhat.com>
6 years agomgr: load modules in finisher to avoid potential lock cycles 26112/head
Mykola Golub [Thu, 24 Jan 2019 09:04:24 +0000 (11:04 +0200)]
mgr: load modules in finisher to avoid potential lock cycles

Fixes: https://tracker.ceph.com/issues/37997
Signed-off-by: Mykola Golub <mgolub@suse.com>
6 years agorgw: Fix for SignatureMismatchError in s3 commands. 26204/head
Pritha Srivastava [Wed, 30 Jan 2019 15:39:34 +0000 (21:09 +0530)]
rgw: Fix for SignatureMismatchError in s3 commands.

Signed-off-by: Pritha Srivastava <prsrivas@redhat.com>
6 years agoMerge pull request #25638 from ricardoasmarques/iscsi-management-w
Lenz Grimmer [Wed, 30 Jan 2019 14:56:48 +0000 (15:56 +0100)]
Merge pull request #25638 from ricardoasmarques/iscsi-management-w

mgr/dashboard: iSCSI management API

Reviewed-by: Tiago Melo <tmelo@suse.com>
6 years agoMerge pull request #26172 from rhcs-dashboard/fix-skipped-api-tests
Lenz Grimmer [Wed, 30 Jan 2019 14:49:06 +0000 (15:49 +0100)]
Merge pull request #26172 from rhcs-dashboard/fix-skipped-api-tests

mgr/dashboard: fix skipped backend API tests

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Patrick Nawracay <pnawracay@suse.com>
Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
6 years agoceph-volume: don't crash on unusable data devices 25542/head
Jan Fajerski [Sat, 26 Jan 2019 10:08:01 +0000 (11:08 +0100)]
ceph-volume: don't crash on unusable data devices

Also add test case for a MixedStrategy with unusable data devices.

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
6 years agoceph-volume: add a wal device specific unit test and size validator
Jan Fajerski [Thu, 24 Jan 2019 17:10:45 +0000 (18:10 +0100)]
ceph-volume: add a wal device specific unit test and size validator

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
6 years agoceph-volume: add osd_ids argument
Jan Fajerski [Wed, 23 Jan 2019 14:04:29 +0000 (15:04 +0100)]
ceph-volume: add osd_ids argument

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
6 years agomgr/dashboard: Updated colors in PG Status chart 26203/head
alfonsomthd [Wed, 30 Jan 2019 14:27:47 +0000 (15:27 +0100)]
mgr/dashboard: Updated colors in PG Status chart

* For consistency:
  Set 'Clean' status color to 'HEALTH_OK' color
  (Cluster Status card).

  Set 'Warning' status color to 'HEALTH_WARN' color.

  'Working' (blue) & 'Unknown' (red) are kept due to
  previous consensus about these complementary colors
  in doughnut/pie charts.

* Renamed Health Pie colors for the sake of clarity.

Signed-off-by: Alfonso Martínez <almartin@redhat.com>
6 years agoMerge pull request #26091 from tchaikov/wip-36737
Kefu Chai [Wed, 30 Jan 2019 13:35:52 +0000 (21:35 +0800)]
Merge pull request #26091 from tchaikov/wip-36737

cmake: use $CMAKE_BINARY_DIR for default $CEPH_BUILD_VIRTUALENV

Tested-by: Yuri Weinstein <yweins@redhat.com>
Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
6 years agoMerge PR #26142 into master
Sage Weil [Wed, 30 Jan 2019 13:06:42 +0000 (07:06 -0600)]
Merge PR #26142 into master

* refs/pull/26142/head:
doc/dev/cephx: document current implementation of cephx

Reviewed-by: Alfredo Deza <adeza@redhat.com>
6 years agoMerge pull request #26097 from trociny/wip-rbd-mirror-perf-lock
Jason Dillaman [Wed, 30 Jan 2019 12:52:41 +0000 (07:52 -0500)]
Merge pull request #26097 from trociny/wip-rbd-mirror-perf-lock

rbd-mirror: guard access to image replayer perf counters

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
6 years agoMerge pull request #26168 from shyukri/qa-rbd-replace-bench-write
Jason Dillaman [Wed, 30 Jan 2019 12:51:55 +0000 (07:51 -0500)]
Merge pull request #26168 from shyukri/qa-rbd-replace-bench-write

qa: rbd/workunits : Replace "rbd bench-write" with "rbd bench --io-type write"

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Mykola Golub <mgolub@suse.com>
6 years agomgr/dashboard: fix skipped backend API tests 26172/head
alfonsomthd [Wed, 30 Jan 2019 12:05:02 +0000 (13:05 +0100)]
mgr/dashboard: fix skipped backend API tests

* When the creation of the cluster is delegated to vstart_runner.py
(--create or --create-target-only) the amount of MGRs required
is calculated by the script so there is no more skipped tests
due to insufficient amount of MGRs.

* Additionally, this issue is not reproducible anymore:
Fixes: https://tracker.ceph.com/issues/37964
* Fixed typo: TEUTHOLOFY_PY_REQS

Signed-off-by: Alfonso Martínez <almartin@redhat.com>
6 years agoMerge pull request #26162 from familyuu/crush
Lenz Grimmer [Wed, 30 Jan 2019 10:43:59 +0000 (11:43 +0100)]
Merge pull request #26162 from familyuu/crush

mgr/dashboard: CRUSH map viewer RFE

Reviewed-by: Kanika Murarka <kmurarka@redhat.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
6 years agoMerge pull request #26182 from p-na/wip-pna-fix-pool-reload
Lenz Grimmer [Wed, 30 Jan 2019 10:26:28 +0000 (11:26 +0100)]
Merge pull request #26182 from p-na/wip-pna-fix-pool-reload

mgr/dashboard: Fix reloading of pool listing

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
6 years agoMerge pull request #26143 from LenzGr/master-documentation
Ricardo Marques [Wed, 30 Jan 2019 09:49:35 +0000 (09:49 +0000)]
Merge pull request #26143 from LenzGr/master-documentation

doc: Updated feature list and overview in dashboard.rst

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
6 years agoMerge pull request #25893 from sebastian-philipp/orchestrator-current-status
Sebastian Wagner [Wed, 30 Jan 2019 08:48:11 +0000 (09:48 +0100)]
Merge pull request #25893 from sebastian-philipp/orchestrator-current-status

doc/orchestrator: Aligned Documentation with specification

Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
Reviewed-by: Noah Watkins <noahwatkins@gmail.com>
6 years agomgr/dashboard: CRUSH map viewer RFE 26162/head
guodan1 [Fri, 25 Jan 2019 11:12:22 +0000 (19:12 +0800)]
mgr/dashboard: CRUSH map viewer RFE

Fixes: http://tracker.ceph.com/issues/37794
Signed-off-by: familyuu <guodan1@lenovo.com>
6 years agoMerge pull request #26175 from neha-ojha/wip-37919
Neha Ojha [Wed, 30 Jan 2019 00:19:34 +0000 (16:19 -0800)]
Merge pull request #26175 from neha-ojha/wip-37919

osd/PG.cc: account for missing set irrespective of last_complete

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed By: Xie Xingguo <xie.xingguo@zte.com.cn>

6 years agoMerge pull request #25737 from arthurhsliu/patch-1
Neha Ojha [Wed, 30 Jan 2019 00:11:26 +0000 (16:11 -0800)]
Merge pull request #25737 from arthurhsliu/patch-1

doc: fix typo in erasure coding example

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agomds: add extra details for cache drop output
Patrick Donnelly [Fri, 25 Jan 2019 23:59:13 +0000 (15:59 -0800)]
mds: add extra details for cache drop output

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agoqa: test mds_max_caps_per_client conf
Patrick Donnelly [Fri, 25 Jan 2019 20:13:50 +0000 (12:13 -0800)]
qa: test mds_max_caps_per_client conf

That the MDS will not let a client sit above mds_max_caps_per_client caps.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agomds: limit maximum number of caps held by session
Patrick Donnelly [Thu, 24 Jan 2019 22:23:08 +0000 (14:23 -0800)]
mds: limit maximum number of caps held by session

This is to prevent unsustainable situations where a client has so many
outstanding caps that a linear traversal/operation on the session's caps takes
unacceptable amounts of time.

Fixes: http://tracker.ceph.com/issues/38022
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agomds: adapt drop cache for incremental recall
Patrick Donnelly [Thu, 24 Jan 2019 22:22:42 +0000 (14:22 -0800)]
mds: adapt drop cache for incremental recall

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agomds: recall caps incrementally
Patrick Donnelly [Wed, 23 Jan 2019 14:41:55 +0000 (06:41 -0800)]
mds: recall caps incrementally

As with trimming, use DecayCounters to throttle the number of caps we recall,
both globally and per-session.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agomds: adapt drop cache for incremental trim
Patrick Donnelly [Sun, 20 Jan 2019 04:40:11 +0000 (20:40 -0800)]
mds: adapt drop cache for incremental trim

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agomds: add throttle for trimming MDCache
Patrick Donnelly [Sat, 19 Jan 2019 00:18:59 +0000 (16:18 -0800)]
mds: add throttle for trimming MDCache

This is necessary when the MDS cache size decreases by a significant amount.
For example, when stopping a large MDS or when the operator makes a large cache
size reduction.

Fixes: http://tracker.ceph.com/issues/37723
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agomds: cleanup SessionMap init
Patrick Donnelly [Fri, 18 Jan 2019 23:43:48 +0000 (15:43 -0800)]
mds: cleanup SessionMap init

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agomds: cleanup Session init
Patrick Donnelly [Mon, 21 Jan 2019 18:57:45 +0000 (10:57 -0800)]
mds: cleanup Session init

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
6 years agodoc/dev/cephx: document current implementation of cephx 26142/head
Sage Weil [Fri, 25 Jan 2019 08:50:16 +0000 (02:50 -0600)]
doc/dev/cephx: document current implementation of cephx

Signed-off-by: Sage Weil <sage@redhat.com>
6 years agorgw: only update last_trim marker on ENODATA 26190/head
Casey Bodley [Tue, 29 Jan 2019 15:43:58 +0000 (10:43 -0500)]
rgw: only update last_trim marker on ENODATA

if cls_log_trim() returns 0, it may have stopped after 1000 entries
before trimming all the way to to_marker. only update last_trim on
ENODATA, so we continue trimming until done

Fixes: http://tracker.ceph.com/issues/38075
Signed-off-by: Casey Bodley <cbodley@redhat.com>
6 years agoMerge pull request #26157 from cbodley/wip-rgw-olh-repair
Casey Bodley [Tue, 29 Jan 2019 17:04:39 +0000 (12:04 -0500)]
Merge pull request #26157 from cbodley/wip-rgw-olh-repair

rgw: repair olh attributes that were broken by sync

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
6 years agoMerge pull request #26002 from pritha-srivastava/wip-sts-assumerole-webidentity
Matt Benjamin [Tue, 29 Jan 2019 16:58:50 +0000 (11:58 -0500)]
Merge pull request #26002 from pritha-srivastava/wip-sts-assumerole-webidentity

rgw: Initial commit for AssumeRoleWithWebIdentity.

6 years agoMerge pull request #26110 from yaozongyou/fix-statistics-bug
Kefu Chai [Tue, 29 Jan 2019 16:19:01 +0000 (00:19 +0800)]
Merge pull request #26110 from yaozongyou/fix-statistics-bug

mon: fix pg_sum_old not copied correctly

Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agodoc/orchestrator: Aligned Documentaiton with specification 25893/head
Sebastian Wagner [Tue, 29 Jan 2019 14:51:16 +0000 (15:51 +0100)]
doc/orchestrator: Aligned Documentaiton with specification

Also: add current implementation status
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
6 years agomgr/dashboard: Cleanup cluster and audit log 26188/head
Sebastian Krah [Tue, 29 Jan 2019 13:38:31 +0000 (14:38 +0100)]
mgr/dashboard: Cleanup cluster and audit log

Applies the following changes:
- Makes the timestamp bold and not the message
- Colors the priority according to its level
- Indents the message correct if it's longer than one line
- Displays a message when the log is empty

Fixes: https://tracker.ceph.com/issues/37916
Signed-off-by: Sebastian Krah <skrah@suse.com>
6 years agomgr/dashboard: Refactor log pipe
Sebastian Krah [Tue, 29 Jan 2019 13:32:52 +0000 (14:32 +0100)]
mgr/dashboard: Refactor log pipe

The pipe returns a class name instead of an object now. This has the advantage,
that the layout can be modified directly in scss and keeps the code seperated
from the layout.

Fixes: https://tracker.ceph.com/issues/37916
Signed-off-by: Sebastian Krah <skrah@suse.com>
6 years agomgr/dashboard: Move and rename pipe
Sebastian Krah [Tue, 29 Jan 2019 13:25:09 +0000 (14:25 +0100)]
mgr/dashboard: Move and rename pipe

Moves file to the shared directory to make it available for every module.
Also renames the file, because it will be refactored.

Fixes: https://tracker.ceph.com/issues/37916
Signed-off-by: Sebastian Krah <skrah@suse.com>
6 years agoMerge pull request #26090 from tchaikov/wip-crimson-osdmap
Kefu Chai [Tue, 29 Jan 2019 13:31:51 +0000 (21:31 +0800)]
Merge pull request #26090 from tchaikov/wip-crimson-osdmap

crimson: persist/load osdmap to/from store

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
6 years agomgr/dashboard: Fix reloading of pool listing 26182/head
Patrick Nawracay [Tue, 29 Jan 2019 09:31:19 +0000 (09:31 +0000)]
mgr/dashboard: Fix reloading of pool listing

Remove broken functionality that prevents pools from being reloaded after
deletion. The code also introduced a different problem; when clicking on a tab
shortly after the page has been loaded, the code will restore the tab to the
wrong one.

Introduced by 9e913bfd59c3a08c9e06bd8535bb7b92593ba549

Signed-off-by: Patrick Nawracay <pnawracay@suse.com>
6 years agoMerge pull request #26135 from Tinatinak/fix_permission_decorator
Lenz Grimmer [Tue, 29 Jan 2019 12:38:36 +0000 (13:38 +0100)]
Merge pull request #26135 from Tinatinak/fix_permission_decorator

mgr/dashboard: Correct permission decorator

Reviewed-by: Ricardo Dias <rdias@suse.com>
6 years agoMerge pull request #26165 from rhcs-dashboard/ng-envbuild-e2e
Lenz Grimmer [Tue, 29 Jan 2019 12:34:36 +0000 (13:34 +0100)]
Merge pull request #26165 from rhcs-dashboard/ng-envbuild-e2e

mgr/dashboard: added 'env_build' to 'npm run e2e'

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
6 years agocrimson/osd: fix boot process 26090/head
Kefu Chai [Tue, 29 Jan 2019 11:20:05 +0000 (19:20 +0800)]
crimson/osd: fix boot process

* send my client addresses to mon
* always update osdmap with the latest one

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agocrimson/osd: load_pgs()
Kefu Chai [Wed, 23 Jan 2019 09:58:20 +0000 (17:58 +0800)]
crimson/osd: load_pgs()

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agocrimson/os: add omap_get_values()
Kefu Chai [Tue, 29 Jan 2019 09:10:47 +0000 (17:10 +0800)]
crimson/os: add omap_get_values()

osd uses it for storing the pg_info.

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agoosd/HitSet: mark copy ctor of HitSet::Params noexcept
Kefu Chai [Tue, 29 Jan 2019 09:18:21 +0000 (17:18 +0800)]
osd/HitSet: mark copy ctor of HitSet::Params noexcept

to be returned using seastar::future<...> the value type should satisfy
std::is_nothrow_constructible<T>.

with this change, pg_pool_t will be nothrow_constructible. and hence
can be returned using seastar::future<pg_pool_t>. otherwise
std::is_nothrow_constructible<pg_pool_t>::value would be false.

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agocrimson/osd: add operator<< to OSDState
Kefu Chai [Wed, 23 Jan 2019 09:54:24 +0000 (17:54 +0800)]
crimson/osd: add operator<< to OSDState

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agocrimson/os: note missing coll/oid in exception
Kefu Chai [Wed, 23 Jan 2019 09:51:46 +0000 (17:51 +0800)]
crimson/os: note missing coll/oid in exception

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agocrimson/osd: load/store osdmap from/to store
Kefu Chai [Wed, 23 Jan 2019 05:49:37 +0000 (13:49 +0800)]
crimson/osd: load/store osdmap from/to store

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge pull request #26133 from dillaman/wip-37913
Mykola Golub [Tue, 29 Jan 2019 10:41:23 +0000 (12:41 +0200)]
Merge pull request #26133 from dillaman/wip-37913

rbd: implement new 'rbd perf image iostat/iotop' commands

Reviewed-by: Mykola Golub <mgolub@suse.com>
6 years agocrimson/osd: add "--mkfs" support to crimson-osd
Kefu Chai [Tue, 22 Jan 2019 12:37:18 +0000 (20:37 +0800)]
crimson/osd: add "--mkfs" support to crimson-osd

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agocrimson/os: move more features from MemStore to CyanStore
Kefu Chai [Mon, 21 Jan 2019 11:24:19 +0000 (19:24 +0800)]
crimson/os: move more features from MemStore to CyanStore

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 years agomgr/dashboard: Correct permission decorator 26135/head
Tina Kallio [Thu, 27 Dec 2018 09:48:08 +0000 (10:48 +0100)]
mgr/dashboard: Correct permission decorator

'CreatePermission' is required in order to restore an image from trash.

Signed-off-by: Tina Kallio <tina.kallio@gmail.com>
6 years agorgw: Initial commit for AssumeRoleWithWebIdentity. 26002/head
Pritha Srivastava [Mon, 31 Dec 2018 06:12:49 +0000 (11:42 +0530)]
rgw: Initial commit for AssumeRoleWithWebIdentity.

Signed-off-by: Pritha Srivastava <prsrivas@redhat.com>
6 years agorbd: new 'perf image iostat/iotop' actions 26133/head
Jason Dillaman [Tue, 22 Jan 2019 19:04:15 +0000 (14:04 -0500)]
rbd: new 'perf image iostat/iotop' actions

This provides an 'iostat' and 'top'-like IO monitor for all
RBD images

Fixes: http://tracker.ceph.com/issues/37913
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
6 years agorgw: add RGWRados::repair_olh() to reconstruct olh attrs 26157/head
Casey Bodley [Fri, 25 Jan 2019 21:44:03 +0000 (16:44 -0500)]
rgw: add RGWRados::repair_olh() to reconstruct olh attrs

Signed-off-by: Casey Bodley <cbodley@redhat.com>
6 years agorgw: add RGWRados::bi_get_olh() to read/decode olh entry
Casey Bodley [Fri, 25 Jan 2019 21:43:36 +0000 (16:43 -0500)]
rgw: add RGWRados::bi_get_olh() to read/decode olh entry

Signed-off-by: Casey Bodley <cbodley@redhat.com>
6 years agorgw: bi_get() takes bucket_info
Casey Bodley [Fri, 25 Jan 2019 21:42:50 +0000 (16:42 -0500)]
rgw: bi_get() takes bucket_info

and calls the bucket_info overload of BucketShard::init() to avoid
reading the bucket info again

Signed-off-by: Casey Bodley <cbodley@redhat.com>
6 years agorgw: add BucketShard::init overload for bucket_info,obj
Casey Bodley [Fri, 25 Jan 2019 21:17:19 +0000 (16:17 -0500)]
rgw: add BucketShard::init overload for bucket_info,obj

Signed-off-by: Casey Bodley <cbodley@redhat.com>
6 years agorbd: simplify pool namespace positional argument handling
Jason Dillaman [Mon, 21 Jan 2019 22:29:19 +0000 (17:29 -0500)]
rbd: simplify pool namespace positional argument handling

The pool and namespace can now be specified as in a
<pool-name>[/<namespace-name>] format as positional
arguments.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
6 years agomgr/rbd_support: support module for RBD features that require coordination
Jason Dillaman [Thu, 24 Jan 2019 05:00:26 +0000 (00:00 -0500)]
mgr/rbd_support: support module for RBD features that require coordination

This initially adds mgr commands to collect RBD performance metrics
from the OSD dynamic perf collector:

  rbd perf image stats: collects IO rate statistics
  rbd perf image counters: collects raw IO counters

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
6 years agoMerge pull request #25112 from dzafman/wip-scrub-warning
David Zafman [Mon, 28 Jan 2019 18:46:18 +0000 (10:46 -0800)]
Merge pull request #25112 from dzafman/wip-scrub-warning

scrub warning check incorrectly uses mon scrub interval

Reviewed-by: Gregory Farnum <gfarnum@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
6 years agoMerge pull request #26081 from cbodley/wip-38007
Casey Bodley [Mon, 28 Jan 2019 17:07:18 +0000 (12:07 -0500)]
Merge pull request #26081 from cbodley/wip-38007

rgw: bucket full sync handles delete markers

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
6 years agoMerge pull request #25137 from yehudasa/wip-archive-zone-3
Yehuda Sadeh [Mon, 28 Jan 2019 17:05:23 +0000 (09:05 -0800)]
Merge pull request #25137 from yehudasa/wip-archive-zone-3

rgw: archive zone

Reviewed-By: Abhishek Lekshmanan <abhishek@suse.com>