]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
5 years agomgr/telemetry: track telemetry report revisions
Sage Weil [Thu, 25 Jul 2019 21:45:09 +0000 (16:45 -0500)]
mgr/telemetry: track telemetry report revisions

Assign revisions to track changes to the content of the telemetry
reports.

Track the revision when the user opts in or out.

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit b93e4050261b962449c9721cea713616ce5e03bd)

5 years agoqa/tasks/mgr/dashboard/test_mgr_module: adjust expected schema
Sage Weil [Fri, 26 Jul 2019 18:53:55 +0000 (13:53 -0500)]
qa/tasks/mgr/dashboard/test_mgr_module: adjust expected schema

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 6d1dd6181b847f8b04b20c7647a725d814583c70)

5 years agomgr/telemetry: separate out cluster config vs running daemons
Sage Weil [Fri, 26 Jul 2019 15:05:36 +0000 (10:05 -0500)]
mgr/telemetry: separate out cluster config vs running daemons

This indirectly tells us whether the cluster config is being used (vs
ceph.conf).

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 58135db31757c45f9c92c37f9ebb263c68125f31)

5 years agomgr/telemetry: include any config options that are customized
Sage Weil [Thu, 25 Jul 2019 21:22:55 +0000 (16:22 -0500)]
mgr/telemetry: include any config options that are customized

This does not reveal the value of the options, only which options have
been customized.

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit fce9fe87df8d9a00c5da905009589d6514e4013c)

5 years agomgr/telemetry: specify license when opting in
Sage Weil [Thu, 25 Jul 2019 22:28:34 +0000 (17:28 -0500)]
mgr/telemetry: specify license when opting in

Choosing not to include this in the docs so that the user is more likely
to see this interactively.  (That is...probably good?)

Choose sharing-1-0.

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit f1eac8ba4becfb0ad6a7e7a303fc45a9d6ab59ee)

5 years agodoc/mgr/telemetry: update
Sage Weil [Thu, 25 Jul 2019 15:47:07 +0000 (10:47 -0500)]
doc/mgr/telemetry: update

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 9fd65934de43899547f3b8358d3f2b1f3149ee09)

5 years agomgr/telemetry: move contact info to an 'ident' channel
Sage Weil [Thu, 25 Jul 2019 15:46:55 +0000 (10:46 -0500)]
mgr/telemetry: move contact info to an 'ident' channel

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 35c273c9c3ebd00fbac8e1a9fd281333a24c5fe7)

5 years agomgr/telemetry: accept channel list to 'telemetry show'
Sage Weil [Tue, 9 Jul 2019 19:25:23 +0000 (14:25 -0500)]
mgr/telemetry: accept channel list to 'telemetry show'

Also include a 'channels_available' item so that a user can tell which
channels are available.

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit e9fdb219c1b946dc2b346b11c5e5d4b04786345d)

5 years agomgr/telemetry: always generate new report for 'telemetry show'
Sage Weil [Tue, 9 Jul 2019 19:18:37 +0000 (14:18 -0500)]
mgr/telemetry: always generate new report for 'telemetry show'

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit f0762ce4470972ce8f555d8aab87362331a53afd)

5 years agomgr/telemetry: add 'device' channel and call out to devicehealth module
Sage Weil [Tue, 2 Jul 2019 14:39:54 +0000 (09:39 -0500)]
mgr/telemetry: add 'device' channel and call out to devicehealth module

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 28fdba4fdcedd81c33cc58bc3dd9bad2337eb5e2)

5 years agomgr/telemetry: add telemetry channel 'device'
Sage Weil [Mon, 1 Jul 2019 22:36:14 +0000 (17:36 -0500)]
mgr/telemetry: add telemetry channel 'device'

This will enable/disable sharing of device health metrics and failure data.

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit a4e013a7a0dcae69229159048a8e46cdd5c5a74a)

5 years agomgr/telemetry: add separate channels
Sage Weil [Thu, 10 Oct 2019 16:18:02 +0000 (11:18 -0500)]
mgr/telemetry: add separate channels

'basic' is the basic cluster stats (version, size, etc)
'crash' is the crash dumps.

By default these are both on, but they can be selectively enabled or
disabled.

New channels will follow.

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit f3a3ccb52fa5a7b24f8d11138b5b51345865547e)

# Conflicts:
# src/pybind/mgr/telemetry/module.py
- the 'created' field in master is a psss-through due to the string format
change; here we need to convert it to iso9660

5 years agomgr/devicehealth: pull out MAX_SAMPLES
Sage Weil [Fri, 4 Oct 2019 18:50:49 +0000 (13:50 -0500)]
mgr/devicehealth: pull out MAX_SAMPLES

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 2f1670e9fbc2d50a6be830c3f419a42c0dd42adc)

5 years agoMerge pull request #30889 from yuvalif/nautilus-backport-42042
Nathan Cutler [Tue, 5 Nov 2019 18:25:38 +0000 (19:25 +0100)]
Merge pull request #30889 from yuvalif/nautilus-backport-42042

nautilus: rgw/amqp: fix race condition in AMQP unit test

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #30259 from LenzGr/wip-41604-nautilus
Lenz Grimmer [Tue, 5 Nov 2019 11:46:40 +0000 (11:46 +0000)]
Merge pull request #30259 from LenzGr/wip-41604-nautilus

nautilus: mgr/dashboard: access_control: add grafana scope read access to *-manager roles

Reviewed-by: Ricardo Dias <rdias@suse.com>
5 years agonautilus: mgr/dashboard: Allow the decrease of pg's of an exis… (#30376)
Lenz Grimmer [Tue, 5 Nov 2019 11:44:33 +0000 (11:44 +0000)]
nautilus: mgr/dashboard: Allow the decrease of pg's of an exis… (#30376)

nautilus: mgr/dashboard: Allow the decrease of pg's of an existing pool

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
5 years agonautilus: mgr/dashboard: Allow disabling redirection on standb… (#30382)
Lenz Grimmer [Tue, 5 Nov 2019 11:40:18 +0000 (11:40 +0000)]
nautilus: mgr/dashboard: Allow disabling redirection on standb… (#30382)

nautilus: mgr/dashboard: Allow disabling redirection on standby Dashboards

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
5 years agonautilus: mgr/dashboard: Automatically use correct chromedrive… (#31371)
Lenz Grimmer [Tue, 5 Nov 2019 10:00:37 +0000 (10:00 +0000)]
nautilus: mgr/dashboard: Automatically use correct chromedrive… (#31371)

nautilus: mgr/dashboard: Automatically use correct chromedriver version

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
5 years agoMerge pull request #30532 from mikechristie/nautilus-rbd-nbd-netlink
Yuri Weinstein [Mon, 4 Nov 2019 21:04:37 +0000 (13:04 -0800)]
Merge pull request #30532 from mikechristie/nautilus-rbd-nbd-netlink

nautilus: rbd-nbd: add netlink support and nl resize

5 years agoMerge pull request #30661 from smithfarm/wip-41771-nautilus
Yuri Weinstein [Mon, 4 Nov 2019 21:04:01 +0000 (13:04 -0800)]
Merge pull request #30661 from smithfarm/wip-41771-nautilus

nautilus: common/config_proxy: hold lock while accessing mutable container

5 years agoMerge pull request #30464 from smithfarm/wip-41915-nautilus
Yuri Weinstein [Mon, 4 Nov 2019 21:03:00 +0000 (13:03 -0800)]
Merge pull request #30464 from smithfarm/wip-41915-nautilus

nautilus: qa: avoid page cache for krbd discard round off tests

5 years agoMerge pull request #30423 from smithfarm/wip-41545-nautilus
Yuri Weinstein [Mon, 4 Nov 2019 21:02:19 +0000 (13:02 -0800)]
Merge pull request #30423 from smithfarm/wip-41545-nautilus

nautilus: test/librbd: set nbd timeout due to newer kernels defaulting it on

5 years agoMerge pull request #30354 from pdvian/wip-41764-nautilus
Yuri Weinstein [Mon, 4 Nov 2019 21:01:35 +0000 (13:01 -0800)]
Merge pull request #30354 from pdvian/wip-41764-nautilus

nautilus: test/cls_rbd/test_cls_rbd: update TestClsRbd.sparsify

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
5 years agoMerge pull request #30120 from pdvian/wip-41620-nautilus
Yuri Weinstein [Mon, 4 Nov 2019 21:01:17 +0000 (13:01 -0800)]
Merge pull request #30120 from pdvian/wip-41620-nautilus

nautilus: tools/rbd-ggate: close log before running postfork

5 years agoMerge pull request #30697 from uweigand/nautilus-endian-fixes
Yuri Weinstein [Mon, 4 Nov 2019 21:00:27 +0000 (13:00 -0800)]
Merge pull request #30697 from uweigand/nautilus-endian-fixes

nautilus: backport endian fixes

Reviewed-by: Sage Weil <sage@redhat.com>
5 years agoMerge pull request #30048 from smithfarm/wip-41258-nautilus
Yuri Weinstein [Mon, 4 Nov 2019 20:53:19 +0000 (12:53 -0800)]
Merge pull request #30048 from smithfarm/wip-41258-nautilus

nautilus: bluestore: Don't forget sub kv_submitted_waiters

5 years agoMerge pull request #30007 from smithfarm/wip-41279-nautilus
Yuri Weinstein [Mon, 4 Nov 2019 20:52:27 +0000 (12:52 -0800)]
Merge pull request #30007 from smithfarm/wip-41279-nautilus

nautilus: mgr/prometheus: Cast collect_timeout (scrape_interval) to float

5 years agoMerge pull request #30000 from smithfarm/wip-41503-nautilus
Yuri Weinstein [Mon, 4 Nov 2019 20:51:36 +0000 (12:51 -0800)]
Merge pull request #30000 from smithfarm/wip-41503-nautilus

nautilus: osd/PeeringState: do not complain about past_intervals constrained by oldest epoch

5 years agoMerge pull request #29999 from smithfarm/wip-41501-nautilus
Yuri Weinstein [Mon, 4 Nov 2019 20:50:25 +0000 (12:50 -0800)]
Merge pull request #29999 from smithfarm/wip-41501-nautilus

nautilus: core: Improve health status for backfill_toofull and recovery_toofull and fix backfill_toofull seen on cluster where the most full OSD is at 1%

5 years agoMerge pull request #30050 from smithfarm/wip-41443-nautilus
Yuri Weinstein [Mon, 4 Nov 2019 20:49:36 +0000 (12:49 -0800)]
Merge pull request #30050 from smithfarm/wip-41443-nautilus

nautilus: core: osd: clear PG_STATE_CLEAN when repair object

5 years agoMerge pull request #30051 from smithfarm/wip-41456-nautilus
Yuri Weinstein [Mon, 4 Nov 2019 20:48:46 +0000 (12:48 -0800)]
Merge pull request #30051 from smithfarm/wip-41456-nautilus

nautilus: core: osd: merge replica log on primary need according to replica log's crt

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #30080 from pdvian/wip-41596-nautilus
Yuri Weinstein [Mon, 4 Nov 2019 20:48:15 +0000 (12:48 -0800)]
Merge pull request #30080 from pdvian/wip-41596-nautilus

nautilus: tools: ceph-objectstore-tool can't remove head with bad snapset

Reviewed-by: David Zafman <dzafman@redhat.com>
5 years agomgr/dashboard: Automatically use correct chromedriver version 31371/head
Tiago Melo [Mon, 4 Nov 2019 11:27:46 +0000 (10:27 -0100)]
mgr/dashboard: Automatically use correct chromedriver version

Every Chrome version requires a corresponding chromedriver version for the e2e
test to work.
Since we were using a fixed chromedriver version, each time chrome was updated
the e2e scripts stopped working.
With this new script we will check which version of Chrome is installed and
update chromedriver to the correct version.

Fixes: https://tracker.ceph.com/issues/42607
Signed-off-by: Alfonso Martínez <almartin@redhat.com>
Signed-off-by: Tiago Melo <tmelo@suse.com>
(cherry picked from commit 242e76e8840b5d9085239a6fa55a29a093792ee3)

Conflicts:
src/pybind/mgr/dashboard/frontend/package.json
- use "e2e:dev" in nautilus, instead of "e2e:ci"

5 years agoMerge pull request #31228 from jan--f/wip-42540-nautilus
Jan Fajerski [Sat, 2 Nov 2019 14:20:46 +0000 (15:20 +0100)]
Merge pull request #31228 from jan--f/wip-42540-nautilus

nautilus: ceph-volume: api/lvm: check if list of LVs is empty

5 years agoMerge pull request #29994 from smithfarm/wip-41448-nautilus
Yuri Weinstein [Fri, 1 Nov 2019 19:12:14 +0000 (12:12 -0700)]
Merge pull request #29994 from smithfarm/wip-41448-nautilus

nautilus: osd/PrimaryLogPG: Avoid accessing destroyed references in finish_degr…

5 years agoMerge pull request #29992 from smithfarm/wip-40084-nautilus
Yuri Weinstein [Fri, 1 Nov 2019 19:11:20 +0000 (12:11 -0700)]
Merge pull request #29992 from smithfarm/wip-40084-nautilus

nautilus: osd: Better error message when OSD count is less than osd_pool_default_size

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #29991 from smithfarm/wip-39700-nautilus
Yuri Weinstein [Fri, 1 Nov 2019 19:09:04 +0000 (12:09 -0700)]
Merge pull request #29991 from smithfarm/wip-39700-nautilus

nautilus: core: If the nodeep-scrub/noscrub flags are set in pools instead of global cluster. List the pool names in the ceph status

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #29988 from smithfarm/wip-39682-nautilus
Yuri Weinstein [Fri, 1 Nov 2019 19:05:18 +0000 (12:05 -0700)]
Merge pull request #29988 from smithfarm/wip-39682-nautilus

nautilus: core: filestore pre-split may not split enough directories

5 years agoMerge pull request #29979 from smithfarm/wip-41341-nautilus
Yuri Weinstein [Fri, 1 Nov 2019 19:04:24 +0000 (12:04 -0700)]
Merge pull request #29979 from smithfarm/wip-41341-nautilus

nautilus: tests: "CMake Error" in test_envlibrados_for_rocksdb.sh

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #29997 from smithfarm/wip-41453-nautilus
Yuri Weinstein [Fri, 1 Nov 2019 19:03:42 +0000 (12:03 -0700)]
Merge pull request #29997 from smithfarm/wip-41453-nautilus

nautilus: core: mon: C_AckMarkedDown has not handled the Callback Arguments

5 years agoMerge pull request #29998 from smithfarm/wip-41491-nautilus
Yuri Weinstein [Fri, 1 Nov 2019 19:03:02 +0000 (12:03 -0700)]
Merge pull request #29998 from smithfarm/wip-41491-nautilus

nautilus: core: osd/OSDCap: Check for empty namespace

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #30805 from jan--f/wip-42236-nautilus
Jan Fajerski [Fri, 1 Nov 2019 13:38:35 +0000 (14:38 +0100)]
Merge pull request #30805 from jan--f/wip-42236-nautilus

nautilus: ceph-volume: PVolumes.filter shouldn't purge itself

5 years agoMerge pull request #30807 from jan--f/wip-42234-nautilus
Jan Fajerski [Fri, 1 Nov 2019 13:38:21 +0000 (14:38 +0100)]
Merge pull request #30807 from jan--f/wip-42234-nautilus

nautilus: ceph-volume: VolumeGroups.filter shouldn't purge itself

5 years agoMerge pull request #31290 from idryomov/wip-krbd-unmap-msgr1-nautilus
Nathan Cutler [Fri, 1 Nov 2019 07:42:54 +0000 (08:42 +0100)]
Merge pull request #31290 from idryomov/wip-krbd-unmap-msgr1-nautilus

nautilus: qa/suites/krbd: run unmap subsuite with msgr1 only

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
5 years agoqa/suites/krbd: run unmap subsuite with msgr1 only 31290/head
Ilya Dryomov [Tue, 29 Oct 2019 15:19:14 +0000 (16:19 +0100)]
qa/suites/krbd: run unmap subsuite with msgr1 only

pre-single-major.yaml kernel doesn't have any of the monitor client
fixes that came in 4.6.  If the connection is closed, it closes the
session and retries only after 10 seconds.  On top of that, there is
nothing to prevent it from picking the same monitor when reconnecting.
This means that when given both v1 and v2 ports (which look like two
different monitors), it is susceptible to mount_timeout (60 seconds):

  $ sudo rbd map img
  rbd: sysfs write failed
  In some cases useful info is found in syslog - try "dmesg | tail".
  rbd: map failed: (5) Input/output error

  [  822.242313] libceph: mon0 172.21.15.132:3300 socket closed (con state CONNECTING)
  [  832.265494] libceph: mon0 172.21.15.132:3300 socket closed (con state CONNECTING)
  [  842.296175] libceph: mon0 172.21.15.132:3300 socket closed (con state CONNECTING)
  [  852.326924] libceph: mon0 172.21.15.132:3300 socket closed (con state CONNECTING)
  [  862.357611] libceph: mon0 172.21.15.132:3300 socket closed (con state CONNECTING)
  [  872.388373] libceph: mon0 172.21.15.132:3300 socket closed (con state CONNECTING)
  [  882.676136] libceph: mon0 172.21.15.132:3300 socket closed (con state CONNECTING)

Unlike newer kernels that return ETIMEDOUT, it returns EIO.

Newer kernels are much more aggressive about retries and will pick
a different monitor when reconnecting, hence they are always able to
establish the session in time.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 5011cc926cd434a6c095bab57e4b0658f98f5657)

5 years agoMerge pull request #31210 from sebastian-philipp/nautilus-ceph-volume-device_id
Jan Fajerski [Thu, 31 Oct 2019 10:48:15 +0000 (11:48 +0100)]
Merge pull request #31210 from sebastian-philipp/nautilus-ceph-volume-device_id

nautilus: ceph-volume: add Ceph's device id to inventory

5 years agoMerge pull request #31259 from jan--f/wip-41290-nautilus
Nathan Cutler [Thu, 31 Oct 2019 10:20:56 +0000 (11:20 +0100)]
Merge pull request #31259 from jan--f/wip-41290-nautilus

nautilus: doc: update bluestore cache settings and clarify data fraction

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
5 years agodoc: update bluestore cache settings and clarify data fraction 31259/head
Jan Fajerski [Mon, 29 Apr 2019 12:52:27 +0000 (14:52 +0200)]
doc: update bluestore cache settings and clarify data fraction

Fixes: http://tracker.ceph.com/issues/39522
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit 9d8336a7f418fe2bb11361dd74a214403b1e5be7)

5 years agoapi/lvm: rewrite a condition 31228/head
Rishabh Dave [Tue, 3 Sep 2019 13:06:23 +0000 (18:36 +0530)]
api/lvm: rewrite a condition

Create the list of logical volumes if the list passed in arguments is
empty and rewrite the condition to make it more readable.

Fixes: https://tracker.ceph.com/issues/41649
Signed-off-by: Rishabh Dave <ridave@redhat.com>
(cherry picked from commit d1f1bfd3635501090f4069be59e0bcde94dd64ec)

5 years agoceph-volume: add Ceph's device id to inventory 31210/head
Sebastian Wagner [Fri, 18 Oct 2019 11:59:44 +0000 (13:59 +0200)]
ceph-volume: add Ceph's device id to inventory

This will benefit the orchestrator and dashboard to show a unified view of devices with SMART data

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
(cherry picked from commit e70d6041c1a093ed5c2b77abe17e1ede533d9659)

5 years agoMerge pull request #31074 from smithfarm/wip-42417-nautilus
Nathan Cutler [Wed, 23 Oct 2019 14:01:24 +0000 (16:01 +0200)]
Merge pull request #31074 from smithfarm/wip-42417-nautilus

nautilus: doc/rbd: s/guess/xml/ for codeblock lexer

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
5 years agodoc/rbd: s/guess/xml/ for codeblock lexer 31074/head
Kefu Chai [Wed, 16 Oct 2019 04:34:19 +0000 (12:34 +0800)]
doc/rbd: s/guess/xml/ for codeblock lexer

this change silences the warning of

```
doc/rbd/qemu-rbd.rst:174: WARNING: Pygments lexer name 'guess' is not
known
```

see http://pygments.org/docs/lexers/, we should use "xml" for XML .

Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit df226da996e468d2707b08eb012d54b4e37ffdc6)

5 years agoMerge pull request #31009 from SUSE/wip-doc-telemetry-default-interval-nautilus
Nathan Cutler [Mon, 21 Oct 2019 20:22:21 +0000 (22:22 +0200)]
Merge pull request #31009 from SUSE/wip-doc-telemetry-default-interval-nautilus

nautilus: doc/mgr/telemetry: update default interval

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
5 years agodoc/mgr/telemetry: update default interval 31009/head
Tim Serong [Mon, 21 Oct 2019 07:11:35 +0000 (18:11 +1100)]
doc/mgr/telemetry: update default interval

Commit 712987d533 changed the default interval to 24h;
updating the docs to match (this also should go to
the Nautilus branch as that commit landed there too
in https://github.com/ceph/ceph/pull/27709)

Signed-off-by: Tim Serong <tserong@suse.com>
(cherry picked from commit 3c8793c4bd077db2796b512a3b59cd6a01cb3a8c)

5 years agorgw/amqp: fix race condition in AMQP unit test 30889/head
Yuval Lifshitz [Sun, 6 Oct 2019 08:31:35 +0000 (11:31 +0300)]
rgw/amqp: fix race condition in AMQP unit test

Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
(cherry picked from commit 5934ef5071a71c7ae8604d5f2a5e83ac4d01d263)
Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
5 years agoosd: Rename backfill reservation reject names to reflect too full use 29999/head
David Zafman [Fri, 23 Aug 2019 15:54:28 +0000 (08:54 -0700)]
osd: Rename backfill reservation reject names to reflect too full use

The only reason for a reject is in a too full condition.  Now that we
have two types of revoke, let's make this clearer.

Signed-off-by: David Zafman <dzafman@redhat.com>
(cherry picked from commit 0115595c1d1366cb3633e9dc6730496b9e5cf5c4)

Conflicts:
src/osd/PeeringEvent.h
- file does not exist in nautilus due to refactoring: made the changes manually to src/osd/PGPeeringEvent.h
src/osd/PeeringState.cc
src/osd/PeeringState.h
- files do not exist in nautilus due to refactoring: made the changes manually to src/osd/PG.{cc,h}
  by doing:
      s/RejectRemoteReservation/RejectTooFullRemoteReservation/g
      s/RemoteReservationRejected/RemoteReservationRejectedTooFull/g

5 years agoosd: Rename MBackfillReserve::TOOFULL to what it does in particular (revoke)
David Zafman [Thu, 22 Aug 2019 17:30:01 +0000 (10:30 -0700)]
osd: Rename MBackfillReserve::TOOFULL to what it does in particular (revoke)

Signed-off-by: David Zafman <dzafman@redhat.com>
(cherry picked from commit 7810ee584cc0fe9ca1b819d2a807dfc7cd13d292)

Conflicts:
src/osd/PeeringState.cc
- file does not exist in nautilus due to refactoring: made the changes manually
  to src/osd/PG.cc

5 years agoosd: Don't set backfill_toofull in RemoteReservationRevoked path
David Zafman [Fri, 23 Aug 2019 15:52:39 +0000 (08:52 -0700)]
osd: Don't set backfill_toofull in RemoteReservationRevoked path

We shouldn't set backfill_toofull when a revoke occurs in the non-toofull
case.

Fixes: https://tracker.ceph.com/issues/41255
Signed-off-by: David Zafman <dzafman@redhat.com>
(cherry picked from commit fa569ecfecc43ce685b29e0456f62cb085788f25)

Conflicts:
src/osd/PeeringState.cc
- file does not exist in nautilus due to refactoring: made the changes manually
  to src/osd/PG.cc
- no "DECLARE_LOCALS" in nautilus

5 years agoceph-volume: update tests since VolumeGroups.filter returns a list 30807/head
Rishabh Dave [Thu, 3 Oct 2019 12:14:37 +0000 (17:44 +0530)]
ceph-volume: update tests since VolumeGroups.filter returns a list

VolumeGroups.filter returns VolumeGroups object that contains VGs
matching the filter. Update the tests to hold the list returned by the
Volumes.filter() call.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
(cherry picked from commit da58d239a0e067cd3ea5fd26aac24a2551b871c1)

5 years agoceph-volume: VolumeGroups.filter shouldn't purge itself
Rishabh Dave [Thu, 3 Oct 2019 12:09:37 +0000 (17:39 +0530)]
ceph-volume: VolumeGroups.filter shouldn't purge itself

VolumeGroups.filter remove VGs from the list that do no match filter.
Instead of doing that, return a new list that contains VGs that match
the fiter so that VolumeGroups object held by code calling it is not
modified.

Fixes: https://tracker.ceph.com/issues/42171
Signed-off-by: Rishabh Dave <ridave@redhat.com>
(cherry picked from commit 028757813282f764ebcce05572f9e4b76ea4e552)

5 years agoceph-volume: allow creating empty VolumeGroup objects
Rishabh Dave [Thu, 3 Oct 2019 12:10:37 +0000 (17:40 +0530)]
ceph-volume: allow creating empty VolumeGroup objects

Signed-off-by: Rishabh Dave <ridave@redhat.com>
(cherry picked from commit 2dc4f7de96e51c8117b719640ec4c09388a1412e)

5 years agoceph-volume: update tests since PVolumes.filter returns a list 30805/head
Rishabh Dave [Thu, 3 Oct 2019 11:30:38 +0000 (17:00 +0530)]
ceph-volume: update tests since PVolumes.filter returns a list

...returns a list of filtered PVs instead of removing the items that do
not match the filters from itself.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
(cherry picked from commit 38ccfe089a86f86b6e48b9a60286f26bb2444596)

5 years agoceph-volume: PVolumes.filter shouldn't purge itself
Rishabh Dave [Thu, 3 Oct 2019 11:18:46 +0000 (16:48 +0530)]
ceph-volume: PVolumes.filter shouldn't purge itself

PVolumes.filter removes the PVs that do not match the filters from its
list. This approach is problematic since the code calling this method
has to create a copy beforehand. Therefore, it's better to return a new
object that contains PVs that matches the filters.

Fixes: https://tracker.ceph.com/issues/42170
Signed-off-by: Rishabh Dave <ridave@redhat.com>
(cherry picked from commit fcec33ee50457d43add844aef3b81bbf9dd2ad58)

5 years agoceph-volume: allow creating empty PVolumes objects
Rishabh Dave [Thu, 3 Oct 2019 11:14:35 +0000 (16:44 +0530)]
ceph-volume: allow creating empty PVolumes objects

Signed-off-by: Rishabh Dave <ridave@redhat.com>
(cherry picked from commit 384aaee8fd2b0de7120e58efc3ebbd2a520d709f)

5 years agoMerge pull request #30676 from sobelek/wip-42050-nautilus
Jan Fajerski [Wed, 9 Oct 2019 11:15:12 +0000 (13:15 +0200)]
Merge pull request #30676 from sobelek/wip-42050-nautilus

nautilus: ceph-volume: fix warnings raised by pytest

5 years agoMerge pull request #29965 from smithfarm/wip-41272-nautilus
Yuri Weinstein [Tue, 8 Oct 2019 19:51:20 +0000 (12:51 -0700)]
Merge pull request #29965 from smithfarm/wip-41272-nautilus

nautilus: rgw: rgw-log issues the wrong message when decompression fails

5 years agoMerge pull request #29969 from smithfarm/wip-41446-nautilus
Yuri Weinstein [Tue, 8 Oct 2019 19:50:35 +0000 (12:50 -0700)]
Merge pull request #29969 from smithfarm/wip-41446-nautilus

nautilus: rgw_file: readdir: do not construct markers w/leading '/'

5 years agoMerge pull request #29970 from smithfarm/wip-41459-nautilus
Yuri Weinstein [Tue, 8 Oct 2019 19:50:09 +0000 (12:50 -0700)]
Merge pull request #29970 from smithfarm/wip-41459-nautilus

nautilus: rgw: Put User Policy is sensitive to whitespace

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #29972 from smithfarm/wip-41482-nautilus
Yuri Weinstein [Tue, 8 Oct 2019 19:49:41 +0000 (12:49 -0700)]
Merge pull request #29972 from smithfarm/wip-41482-nautilus

nautilus: rgw: potential realm watch lost

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #29974 from smithfarm/wip-41493-nautilus
Yuri Weinstein [Tue, 8 Oct 2019 19:49:06 +0000 (12:49 -0700)]
Merge pull request #29974 from smithfarm/wip-41493-nautilus

nautilus: rgw: multisite: radosgw-admin bucket sync status incorrectly reports "caught up" during full sync

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #29963 from smithfarm/wip-41267-nautilus
Yuri Weinstein [Tue, 8 Oct 2019 19:46:39 +0000 (12:46 -0700)]
Merge pull request #29963 from smithfarm/wip-41267-nautilus

nautilus: rgw: beast frontend throws an exception when running out of FDs

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #29971 from smithfarm/wip-41479-nautilus
Yuri Weinstein [Tue, 8 Oct 2019 19:45:43 +0000 (12:45 -0700)]
Merge pull request #29971 from smithfarm/wip-41479-nautilus

nautilus: rgw: dns name is not case sensitive

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #30037 from smithfarm/wip-41588-nautilus
Yuri Weinstein [Tue, 8 Oct 2019 19:44:56 +0000 (12:44 -0700)]
Merge pull request #30037 from smithfarm/wip-41588-nautilus

nautilus: rgw: fix a bug that lifecycle expiraton generates delete marker continuously

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #30068 from smithfarm/wip-41485-nautilus
Yuri Weinstein [Tue, 8 Oct 2019 19:44:30 +0000 (12:44 -0700)]
Merge pull request #30068 from smithfarm/wip-41485-nautilus

nautilus: rgw: fix list bucket with delimiter wrongly skip some special keys

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #30160 from pdvian/wip-41624-nautilus
Yuri Weinstein [Tue, 8 Oct 2019 19:44:05 +0000 (12:44 -0700)]
Merge pull request #30160 from pdvian/wip-41624-nautilus

nautilus: rgw/rgw_op: Remove get_val from hotpath via legacy options

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #30748 from smithfarm/wip-42194
Nathan Cutler [Tue, 8 Oct 2019 14:06:22 +0000 (16:06 +0200)]
Merge pull request #30748 from smithfarm/wip-42194

nautilus: tools: ceph-backport.sh: add deprecation warning

Reviewed-by: Mykola Golub <mgolub@suse.com>
5 years agoMerge pull request #29591 from pdvian/wip-40894-nautilus
Yuri Weinstein [Mon, 7 Oct 2019 19:41:03 +0000 (12:41 -0700)]
Merge pull request #29591 from pdvian/wip-40894-nautilus

nautilus: mds: cleanup truncating inodes when standby replay mds trim log segments

Reviewed-by: Venky Shankar <vshankar@redhat.com>
5 years agoMerge pull request #29878 from pdvian/wip-41096-nautilus
Yuri Weinstein [Mon, 7 Oct 2019 19:40:38 +0000 (12:40 -0700)]
Merge pull request #29878 from pdvian/wip-41096-nautilus

nautilus: cephfs: avoid map been inserted by mistake

Reviewed-by: Venky Shankar <vshankar@redhat.com>
5 years agoMerge pull request #29879 from pdvian/wip-41099-nautilus
Yuri Weinstein [Mon, 7 Oct 2019 19:40:17 +0000 (12:40 -0700)]
Merge pull request #29879 from pdvian/wip-41099-nautilus

nautilus: cephfs: fix a memory leak

Reviewed-by: Venky Shankar <vshankar@redhat.com>
5 years agoMerge pull request #29938 from pdvian/wip-41107-nautilus
Yuri Weinstein [Mon, 7 Oct 2019 19:39:57 +0000 (12:39 -0700)]
Merge pull request #29938 from pdvian/wip-41107-nautilus

nautilus: mds: delay exporting directory whose pin value exceeds max rank id

Reviewed-by: Venky Shankar <vshankar@redhat.com>
5 years agoMerge pull request #29983 from pdvian/wip-41128-nautilus
Yuri Weinstein [Mon, 7 Oct 2019 19:39:35 +0000 (12:39 -0700)]
Merge pull request #29983 from pdvian/wip-41128-nautilus

nautilus: qa: power off still resulted in client sending session close

Reviewed-by: Venky Shankar <vshankar@redhat.com>
5 years agoMerge pull request #30026 from smithfarm/wip-40895-nautilus
Yuri Weinstein [Mon, 7 Oct 2019 19:38:20 +0000 (12:38 -0700)]
Merge pull request #30026 from smithfarm/wip-40895-nautilus

nautilus: pybind/cephfs: Modification to error message

Reviewed-by: Venky Shankar <vshankar@redhat.com>
5 years agoMerge pull request #30030 from smithfarm/wip-40887-nautilus
Yuri Weinstein [Mon, 7 Oct 2019 19:37:04 +0000 (12:37 -0700)]
Merge pull request #30030 from smithfarm/wip-40887-nautilus

nautilus: ceph_volume_client: convert string to bytes object

Reviewed-by: Venky Shankar <vshankar@redhat.com>
5 years agoMerge pull request #30031 from smithfarm/wip-40900-nautilus
Yuri Weinstein [Mon, 7 Oct 2019 19:36:21 +0000 (12:36 -0700)]
Merge pull request #30031 from smithfarm/wip-40900-nautilus

nautilus: mds: evict an unresponsive client only when another client wants its caps

Reviewed-by: Venky Shankar <vshankar@redhat.com>
5 years agoMerge pull request #30032 from smithfarm/wip-41113-nautilus
Yuri Weinstein [Mon, 7 Oct 2019 19:35:56 +0000 (12:35 -0700)]
Merge pull request #30032 from smithfarm/wip-41113-nautilus

nautilus: cephfs: client: more precise CEPH_CLIENT_CAPS_PENDING_CAPSNAP

Reviewed-by: Venky Shankar <vshankar@redhat.com>
5 years agoMerge pull request #30038 from smithfarm/wip-41276-nautilus
Yuri Weinstein [Mon, 7 Oct 2019 19:35:29 +0000 (12:35 -0700)]
Merge pull request #30038 from smithfarm/wip-41276-nautilus

nautilus: tests: cephfs: fix malformed qa suite config

Reviewed-by: Venky Shankar <vshankar@redhat.com>
5 years agoMerge pull request #30039 from smithfarm/wip-41465-nautilus
Yuri Weinstein [Mon, 7 Oct 2019 19:34:56 +0000 (12:34 -0700)]
Merge pull request #30039 from smithfarm/wip-41465-nautilus

nautilus: cephfs: mount.ceph: properly handle -o strictatime

Reviewed-by: Venky Shankar <vshankar@redhat.com>
5 years agoMerge pull request #30040 from smithfarm/wip-41467-nautilus
Yuri Weinstein [Mon, 7 Oct 2019 19:34:26 +0000 (12:34 -0700)]
Merge pull request #30040 from smithfarm/wip-41467-nautilus

nautilus: mds: trim cache on regular schedule

Reviewed-by: Venky Shankar <vshankar@redhat.com>
5 years agoMerge pull request #30041 from smithfarm/wip-41477-nautilus
Yuri Weinstein [Mon, 7 Oct 2019 19:34:00 +0000 (12:34 -0700)]
Merge pull request #30041 from smithfarm/wip-41477-nautilus

nautilus: mds: fix InoTable::force_consume_to()

5 years agoMerge pull request #30057 from varshar16/wip-nautilus-cephfs-shell-path-conversion
Yuri Weinstein [Mon, 7 Oct 2019 19:33:34 +0000 (12:33 -0700)]
Merge pull request #30057 from varshar16/wip-nautilus-cephfs-shell-path-conversion

nautilus: cephfs-shell: Convert paths type from string to bytes

Reviewed-by: Venky Shankar <vshankar@redhat.com>
5 years agoMerge pull request #30418 from pdvian/wip-41851-nautilus
Yuri Weinstein [Mon, 7 Oct 2019 19:33:07 +0000 (12:33 -0700)]
Merge pull request #30418 from pdvian/wip-41851-nautilus

nautilus: mds: make MDSIOContextBase delete itself when shutting down

Reviewed-by: Venky Shankar <vshankar@redhat.com>
5 years agoMerge pull request #30442 from pdvian/wip-41855-nautilus
Yuri Weinstein [Mon, 7 Oct 2019 19:32:39 +0000 (12:32 -0700)]
Merge pull request #30442 from pdvian/wip-41855-nautilus

nautilus: client: nfs-ganesha with cephfs client, removing dir reports not empty

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>
5 years agoMerge pull request #30455 from smithfarm/wip-41889-nautilus
Yuri Weinstein [Mon, 7 Oct 2019 19:29:43 +0000 (12:29 -0700)]
Merge pull request #30455 from smithfarm/wip-41889-nautilus

nautilus: mgr/volumes: handle exceptions in purge thread with retry

Reviewed-by: Venky Shankar <vshankar@redhat.com>
5 years agoMerge pull request #30508 from ukernel/nautilus-41948
Yuri Weinstein [Mon, 7 Oct 2019 19:28:52 +0000 (12:28 -0700)]
Merge pull request #30508 from ukernel/nautilus-41948

nautilus: mds: wake up lock waiters after forcibly changing lock state

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
5 years agoceph-backport.sh: add deprecation warning 30748/head
Nathan Cutler [Mon, 7 Oct 2019 10:49:33 +0000 (12:49 +0200)]
ceph-backport.sh: add deprecation warning

The script is not maintained in the stable versions of Ceph.

This commit is not a cherry-pick from master, because the script is maintained
in master. It is unmaintained only in the stable versions, like "nautilus".

Also add a --version option which, in this case, will also indicate to the
user that this is an outdated, deprecated version of the script.

Fixes: https://tracker.ceph.com/issues/42194
Signed-off-by: Nathan Cutler <ncutler@suse.com>
5 years agoMerge pull request #30325 from theanalyst/wip-41498-nautilus
Yuri Weinstein [Thu, 3 Oct 2019 20:07:01 +0000 (13:07 -0700)]
Merge pull request #30325 from theanalyst/wip-41498-nautilus

nautilus: rgw: fix the bug of rgw not doing necessary checking to website configuration

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #30437 from smithfarm/wip-41846-nautilus
Yuri Weinstein [Thu, 3 Oct 2019 20:06:38 +0000 (13:06 -0700)]
Merge pull request #30437 from smithfarm/wip-41846-nautilus

nautilus: rgw: increase beast parse buffer size to 64k

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #30604 from vumrao/wip-vumrao-41976
Yuri Weinstein [Thu, 3 Oct 2019 20:06:15 +0000 (13:06 -0700)]
Merge pull request #30604 from vumrao/wip-vumrao-41976

nautilus: radosgw-admin: add --uid check in bucket list command

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #30651 from pdvian/wip-41970-nautilus
Yuri Weinstein [Thu, 3 Oct 2019 20:05:52 +0000 (13:05 -0700)]
Merge pull request #30651 from pdvian/wip-41970-nautilus

nautilus: rgw: ldap auth: S3 auth failure should return InvalidAccessKeyId

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #30680 from pdvian/wip-41974-nautilus
Yuri Weinstein [Thu, 3 Oct 2019 20:05:28 +0000 (13:05 -0700)]
Merge pull request #30680 from pdvian/wip-41974-nautilus

nautilus: rgw: add minssing admin property when sync user info.

Reviewed-by: Casey Bodley <cbodley@redhat.com>