]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
5 years agoPendingReleaseNotes: fix typo
Sage Weil [Fri, 1 Nov 2019 22:17:47 +0000 (17:17 -0500)]
PendingReleaseNotes: fix typo

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoPendingReleaseNotes: remove kludge
Sage Weil [Fri, 1 Nov 2019 22:17:41 +0000 (17:17 -0500)]
PendingReleaseNotes: remove kludge

This was there just to make make cherry-pick procees without conflicts.

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agomgr/telemetry: add stats about crush map
Sage Weil [Fri, 1 Nov 2019 12:58:54 +0000 (07:58 -0500)]
mgr/telemetry: add stats about crush map

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 713dbc9722888d3bf60d772dbca23e13b0cafc38)

5 years agomgr/telemetry: add rgw metadata
Abhishek Lekshmanan [Wed, 30 Oct 2019 20:34:43 +0000 (15:34 -0500)]
mgr/telemetry: add rgw metadata

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit f62c6e8cba2e894f84ddabdea6db4ce56e02ea63)

5 years agomgr/telemetry: include fs size (files, bytes, snaps)
Sage Weil [Tue, 29 Oct 2019 19:03:24 +0000 (14:03 -0500)]
mgr/telemetry: include fs size (files, bytes, snaps)

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 2b7ac440ab4e3b6e91e36431e69289123049ae7b)

5 years agomds: report r{files,bytes,snaps} via perfcounters
Sage Weil [Tue, 29 Oct 2019 19:00:15 +0000 (14:00 -0500)]
mds: report r{files,bytes,snaps} via perfcounters

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit de5bfb67b4a84a69a6fb4d563cc19bcdb687e955)

5 years agomgr/telemetry: mds cache stats
Sage Weil [Tue, 29 Oct 2019 18:53:50 +0000 (13:53 -0500)]
mgr/telemetry: mds cache stats

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit f4c736699478f608bba77770a85f96a7bf8d24e5)

5 years agomgr/telemetry: add some rbd metadata
Sage Weil [Tue, 29 Oct 2019 18:30:15 +0000 (13:30 -0500)]
mgr/telemetry: add some rbd metadata

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit a42dc0a3d07b813aaa7f44b168e27fe58fbe60e3)

5 years agomgr/telemetry: note whether osd cluster_network is in use
Sage Weil [Tue, 29 Oct 2019 18:20:07 +0000 (13:20 -0500)]
mgr/telemetry: note whether osd cluster_network is in use

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 702175f49361f3875c5e356c812d45e34d01a021)

5 years agomgr/telemetry: add host counts
Sage Weil [Tue, 29 Oct 2019 18:14:40 +0000 (13:14 -0500)]
mgr/telemetry: add host counts

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 9e6fbaaaa023a96db62a76ce72b0f6bb3a025297)

5 years agomgr/telemetry: add more pool metadata
Sage Weil [Tue, 29 Oct 2019 18:05:30 +0000 (13:05 -0500)]
mgr/telemetry: add more pool metadata

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 87670fdc3c227387068d527b4659b50bc3bb64a3)

5 years agomgr/telemetry: remove crush rule name
Sage Weil [Tue, 29 Oct 2019 16:29:46 +0000 (11:29 -0500)]
mgr/telemetry: remove crush rule name

This is a user-specified string and could contain identifying info.

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 26b427356d920682b61cdf98fc2745e324c28baa)

5 years agomgr/telemetry: include min_mon_release and msgr v1 vs v2 addr count
Sage Weil [Tue, 29 Oct 2019 16:14:30 +0000 (11:14 -0500)]
mgr/telemetry: include min_mon_release and msgr v1 vs v2 addr count

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 3453930d438dc3ba9ba5addca59aec6786293bd4)

5 years agomgr/telemetry: add CephFS metadata
Sage Weil [Tue, 29 Oct 2019 16:08:42 +0000 (11:08 -0500)]
mgr/telemetry: add CephFS metadata

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 7f6aad677b76847514f6f9b893827412dfb35a6b)

5 years agomgr/telemetry: include balancer info (active=true/false, mode)
Sage Weil [Fri, 11 Oct 2019 14:03:04 +0000 (09:03 -0500)]
mgr/telemetry: include balancer info (active=true/false, mode)

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 13976e5d7a83a7947adc5f0debfabcbee3c36c74)

5 years agomgr/telemetry: include per-pool pg_autoscale info
Sage Weil [Fri, 11 Oct 2019 13:57:43 +0000 (08:57 -0500)]
mgr/telemetry: include per-pool pg_autoscale info

Mode and target size

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit ac2c2f7e986ee6f01e129b8b10db144f49c6c6e2)

5 years agomgr/telemetry: dict.pop() errs on nonexistent key
Dan Mick [Thu, 10 Oct 2019 22:18:51 +0000 (15:18 -0700)]
mgr/telemetry: dict.pop() errs on nonexistent key

I suggested this in a review, but failed to correctly understand
what happens when the key doesn't exist.  Test for it.

Signed-off-by: Dan Mick <dan.mick@redhat.com>
(cherry picked from commit 19028f0d9da8c010700b7f0bfced3de0423a1682)

5 years agomgr/telemetry: send device telemetry via per-host POST to device endpoint
Sage Weil [Tue, 29 Oct 2019 14:28:18 +0000 (09:28 -0500)]
mgr/telemetry: send device telemetry via per-host POST to device endpoint

We do not want to associate devices with clusters because that may
communicate unnecessary information about the association between vendors
and clusters (which, when large, are potentially identifying).

Instead, do a POST per host with all of the devices on that host only.

The devices endpoint does not log the POST time, so these per-host
records won't be associated with each other.

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit af64b18f1caa278dc0f73d4e203265f2625e35d4)

5 years agomgr/telemetry: fix remote into crash do_ls()
Sage Weil [Wed, 17 Jul 2019 16:15:35 +0000 (11:15 -0500)]
mgr/telemetry: fix remote into crash do_ls()

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 01d1d232abec93a591e936acd195023bc8c51a69)

5 years agomgr/telemetry: clear the event after being awaken by it
Kefu Chai [Thu, 8 Aug 2019 04:24:53 +0000 (12:24 +0800)]
mgr/telemetry: clear the event after being awaken by it

otherwise telemetry will have a busy-loop once it's signaled.

Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit 0dddb20685007d990dc30daddca6212d36e5e308)

5 years agomgr/telemetry: bump content revision and add a release note
Sage Weil [Thu, 10 Oct 2019 16:58:12 +0000 (11:58 -0500)]
mgr/telemetry: bump content revision and add a release note

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 47d3406fb2ad75f525d7141a322fdff81749c81a)

# Conflicts:
# PendingReleaseNotes

5 years agotelemetry/server: add device report endpoint
Sage Weil [Fri, 4 Oct 2019 20:17:07 +0000 (15:17 -0500)]
telemetry/server: add device report endpoint

Add a standalone endpoint to report device telemetry.

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 877183f64249a17b2fd8e0aef5e51595a341b7f2)

5 years agomgr/telemetry: include device telemetry
Sage Weil [Fri, 4 Oct 2019 20:03:53 +0000 (15:03 -0500)]
mgr/telemetry: include device telemetry

- anonymize device id
- anonymize host names
- strip out the serial number

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit eff32aab979f87c7ed59b8b3843c5c882bc491c8)

5 years agomgr/telemetry: salt osd ids too
Sage Weil [Fri, 26 Jul 2019 15:17:22 +0000 (10:17 -0500)]
mgr/telemetry: salt osd ids too

Better to fully obfuscate here.

This has a nice side-effect of assigning entity names that are *globally*
unique across the full telemetry data set, since the salts are unique and
sha1 is (sufficiently) collision-free.

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 753174cdaed1fcfdb123c06dc20b699f324442cc)

5 years agomgr/telemetry: obscure entity_name with a salt
Sage Weil [Thu, 25 Jul 2019 17:20:52 +0000 (12:20 -0500)]
mgr/telemetry: obscure entity_name with a salt

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit e82bd5136a7fbfcd305615aafb246ccc27f5bc69)

5 years agomgr/telemetry: force re-opt-in if the report contents change
Sage Weil [Thu, 10 Oct 2019 16:23:57 +0000 (11:23 -0500)]
mgr/telemetry: force re-opt-in if the report contents change

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 143e1f046909cb68d769ebbbaa80cb7106879997)

# Conflicts:
# doc/rados/operations/health-checks.rst
- no RECENT_CRASH

5 years agomgr/telemetry: less noise in the log
Sage Weil [Thu, 25 Jul 2019 21:46:03 +0000 (16:46 -0500)]
mgr/telemetry: less noise in the log

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 7f1897b238f5c55859229748b200bac715941cc3)

5 years agomgr/telemetry: wake up serve on config change
Sage Weil [Thu, 25 Jul 2019 21:45:23 +0000 (16:45 -0500)]
mgr/telemetry: wake up serve on config change

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 3055d6cb9b71c9d580cd2cd9656bd90f7d270a5c)

5 years agomgr/telemetry: track telemetry report revisions
Sage Weil [Thu, 25 Jul 2019 21:45:09 +0000 (16:45 -0500)]
mgr/telemetry: track telemetry report revisions

Assign revisions to track changes to the content of the telemetry
reports.

Track the revision when the user opts in or out.

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit b93e4050261b962449c9721cea713616ce5e03bd)

5 years agoqa/tasks/mgr/dashboard/test_mgr_module: adjust expected schema
Sage Weil [Fri, 26 Jul 2019 18:53:55 +0000 (13:53 -0500)]
qa/tasks/mgr/dashboard/test_mgr_module: adjust expected schema

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 6d1dd6181b847f8b04b20c7647a725d814583c70)

5 years agomgr/telemetry: separate out cluster config vs running daemons
Sage Weil [Fri, 26 Jul 2019 15:05:36 +0000 (10:05 -0500)]
mgr/telemetry: separate out cluster config vs running daemons

This indirectly tells us whether the cluster config is being used (vs
ceph.conf).

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 58135db31757c45f9c92c37f9ebb263c68125f31)

5 years agomgr/telemetry: include any config options that are customized
Sage Weil [Thu, 25 Jul 2019 21:22:55 +0000 (16:22 -0500)]
mgr/telemetry: include any config options that are customized

This does not reveal the value of the options, only which options have
been customized.

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit fce9fe87df8d9a00c5da905009589d6514e4013c)

5 years agomgr/telemetry: specify license when opting in
Sage Weil [Thu, 25 Jul 2019 22:28:34 +0000 (17:28 -0500)]
mgr/telemetry: specify license when opting in

Choosing not to include this in the docs so that the user is more likely
to see this interactively.  (That is...probably good?)

Choose sharing-1-0.

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit f1eac8ba4becfb0ad6a7e7a303fc45a9d6ab59ee)

5 years agodoc/mgr/telemetry: update
Sage Weil [Thu, 25 Jul 2019 15:47:07 +0000 (10:47 -0500)]
doc/mgr/telemetry: update

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 9fd65934de43899547f3b8358d3f2b1f3149ee09)

5 years agomgr/telemetry: move contact info to an 'ident' channel
Sage Weil [Thu, 25 Jul 2019 15:46:55 +0000 (10:46 -0500)]
mgr/telemetry: move contact info to an 'ident' channel

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 35c273c9c3ebd00fbac8e1a9fd281333a24c5fe7)

5 years agomgr/telemetry: accept channel list to 'telemetry show'
Sage Weil [Tue, 9 Jul 2019 19:25:23 +0000 (14:25 -0500)]
mgr/telemetry: accept channel list to 'telemetry show'

Also include a 'channels_available' item so that a user can tell which
channels are available.

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit e9fdb219c1b946dc2b346b11c5e5d4b04786345d)

5 years agomgr/telemetry: always generate new report for 'telemetry show'
Sage Weil [Tue, 9 Jul 2019 19:18:37 +0000 (14:18 -0500)]
mgr/telemetry: always generate new report for 'telemetry show'

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit f0762ce4470972ce8f555d8aab87362331a53afd)

5 years agomgr/telemetry: add 'device' channel and call out to devicehealth module
Sage Weil [Tue, 2 Jul 2019 14:39:54 +0000 (09:39 -0500)]
mgr/telemetry: add 'device' channel and call out to devicehealth module

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 28fdba4fdcedd81c33cc58bc3dd9bad2337eb5e2)

5 years agomgr/telemetry: add telemetry channel 'device'
Sage Weil [Mon, 1 Jul 2019 22:36:14 +0000 (17:36 -0500)]
mgr/telemetry: add telemetry channel 'device'

This will enable/disable sharing of device health metrics and failure data.

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit a4e013a7a0dcae69229159048a8e46cdd5c5a74a)

5 years agomgr/telemetry: add separate channels
Sage Weil [Thu, 10 Oct 2019 16:18:02 +0000 (11:18 -0500)]
mgr/telemetry: add separate channels

'basic' is the basic cluster stats (version, size, etc)
'crash' is the crash dumps.

By default these are both on, but they can be selectively enabled or
disabled.

New channels will follow.

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit f3a3ccb52fa5a7b24f8d11138b5b51345865547e)

# Conflicts:
# src/pybind/mgr/telemetry/module.py
- the 'created' field in master is a psss-through due to the string format
change; here we need to convert it to iso9660

5 years agomgr/devicehealth: pull out MAX_SAMPLES
Sage Weil [Fri, 4 Oct 2019 18:50:49 +0000 (13:50 -0500)]
mgr/devicehealth: pull out MAX_SAMPLES

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 2f1670e9fbc2d50a6be830c3f419a42c0dd42adc)

5 years agoMerge pull request #30889 from yuvalif/nautilus-backport-42042
Nathan Cutler [Tue, 5 Nov 2019 18:25:38 +0000 (19:25 +0100)]
Merge pull request #30889 from yuvalif/nautilus-backport-42042

nautilus: rgw/amqp: fix race condition in AMQP unit test

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #30259 from LenzGr/wip-41604-nautilus
Lenz Grimmer [Tue, 5 Nov 2019 11:46:40 +0000 (11:46 +0000)]
Merge pull request #30259 from LenzGr/wip-41604-nautilus

nautilus: mgr/dashboard: access_control: add grafana scope read access to *-manager roles

Reviewed-by: Ricardo Dias <rdias@suse.com>
5 years agonautilus: mgr/dashboard: Allow the decrease of pg's of an exis… (#30376)
Lenz Grimmer [Tue, 5 Nov 2019 11:44:33 +0000 (11:44 +0000)]
nautilus: mgr/dashboard: Allow the decrease of pg's of an exis… (#30376)

nautilus: mgr/dashboard: Allow the decrease of pg's of an existing pool

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
5 years agonautilus: mgr/dashboard: Allow disabling redirection on standb… (#30382)
Lenz Grimmer [Tue, 5 Nov 2019 11:40:18 +0000 (11:40 +0000)]
nautilus: mgr/dashboard: Allow disabling redirection on standb… (#30382)

nautilus: mgr/dashboard: Allow disabling redirection on standby Dashboards

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
5 years agonautilus: mgr/dashboard: Automatically use correct chromedrive… (#31371)
Lenz Grimmer [Tue, 5 Nov 2019 10:00:37 +0000 (10:00 +0000)]
nautilus: mgr/dashboard: Automatically use correct chromedrive… (#31371)

nautilus: mgr/dashboard: Automatically use correct chromedriver version

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
5 years agoMerge pull request #30532 from mikechristie/nautilus-rbd-nbd-netlink
Yuri Weinstein [Mon, 4 Nov 2019 21:04:37 +0000 (13:04 -0800)]
Merge pull request #30532 from mikechristie/nautilus-rbd-nbd-netlink

nautilus: rbd-nbd: add netlink support and nl resize

5 years agoMerge pull request #30661 from smithfarm/wip-41771-nautilus
Yuri Weinstein [Mon, 4 Nov 2019 21:04:01 +0000 (13:04 -0800)]
Merge pull request #30661 from smithfarm/wip-41771-nautilus

nautilus: common/config_proxy: hold lock while accessing mutable container

5 years agoMerge pull request #30464 from smithfarm/wip-41915-nautilus
Yuri Weinstein [Mon, 4 Nov 2019 21:03:00 +0000 (13:03 -0800)]
Merge pull request #30464 from smithfarm/wip-41915-nautilus

nautilus: qa: avoid page cache for krbd discard round off tests

5 years agoMerge pull request #30423 from smithfarm/wip-41545-nautilus
Yuri Weinstein [Mon, 4 Nov 2019 21:02:19 +0000 (13:02 -0800)]
Merge pull request #30423 from smithfarm/wip-41545-nautilus

nautilus: test/librbd: set nbd timeout due to newer kernels defaulting it on

5 years agoMerge pull request #30354 from pdvian/wip-41764-nautilus
Yuri Weinstein [Mon, 4 Nov 2019 21:01:35 +0000 (13:01 -0800)]
Merge pull request #30354 from pdvian/wip-41764-nautilus

nautilus: test/cls_rbd/test_cls_rbd: update TestClsRbd.sparsify

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
5 years agoMerge pull request #30120 from pdvian/wip-41620-nautilus
Yuri Weinstein [Mon, 4 Nov 2019 21:01:17 +0000 (13:01 -0800)]
Merge pull request #30120 from pdvian/wip-41620-nautilus

nautilus: tools/rbd-ggate: close log before running postfork

5 years agoMerge pull request #30697 from uweigand/nautilus-endian-fixes
Yuri Weinstein [Mon, 4 Nov 2019 21:00:27 +0000 (13:00 -0800)]
Merge pull request #30697 from uweigand/nautilus-endian-fixes

nautilus: backport endian fixes

Reviewed-by: Sage Weil <sage@redhat.com>
5 years agoMerge pull request #30048 from smithfarm/wip-41258-nautilus
Yuri Weinstein [Mon, 4 Nov 2019 20:53:19 +0000 (12:53 -0800)]
Merge pull request #30048 from smithfarm/wip-41258-nautilus

nautilus: bluestore: Don't forget sub kv_submitted_waiters

5 years agoMerge pull request #30007 from smithfarm/wip-41279-nautilus
Yuri Weinstein [Mon, 4 Nov 2019 20:52:27 +0000 (12:52 -0800)]
Merge pull request #30007 from smithfarm/wip-41279-nautilus

nautilus: mgr/prometheus: Cast collect_timeout (scrape_interval) to float

5 years agoMerge pull request #30000 from smithfarm/wip-41503-nautilus
Yuri Weinstein [Mon, 4 Nov 2019 20:51:36 +0000 (12:51 -0800)]
Merge pull request #30000 from smithfarm/wip-41503-nautilus

nautilus: osd/PeeringState: do not complain about past_intervals constrained by oldest epoch

5 years agoMerge pull request #29999 from smithfarm/wip-41501-nautilus
Yuri Weinstein [Mon, 4 Nov 2019 20:50:25 +0000 (12:50 -0800)]
Merge pull request #29999 from smithfarm/wip-41501-nautilus

nautilus: core: Improve health status for backfill_toofull and recovery_toofull and fix backfill_toofull seen on cluster where the most full OSD is at 1%

5 years agoMerge pull request #30050 from smithfarm/wip-41443-nautilus
Yuri Weinstein [Mon, 4 Nov 2019 20:49:36 +0000 (12:49 -0800)]
Merge pull request #30050 from smithfarm/wip-41443-nautilus

nautilus: core: osd: clear PG_STATE_CLEAN when repair object

5 years agoMerge pull request #30051 from smithfarm/wip-41456-nautilus
Yuri Weinstein [Mon, 4 Nov 2019 20:48:46 +0000 (12:48 -0800)]
Merge pull request #30051 from smithfarm/wip-41456-nautilus

nautilus: core: osd: merge replica log on primary need according to replica log's crt

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #30080 from pdvian/wip-41596-nautilus
Yuri Weinstein [Mon, 4 Nov 2019 20:48:15 +0000 (12:48 -0800)]
Merge pull request #30080 from pdvian/wip-41596-nautilus

nautilus: tools: ceph-objectstore-tool can't remove head with bad snapset

Reviewed-by: David Zafman <dzafman@redhat.com>
5 years agomgr/dashboard: Automatically use correct chromedriver version 31371/head
Tiago Melo [Mon, 4 Nov 2019 11:27:46 +0000 (10:27 -0100)]
mgr/dashboard: Automatically use correct chromedriver version

Every Chrome version requires a corresponding chromedriver version for the e2e
test to work.
Since we were using a fixed chromedriver version, each time chrome was updated
the e2e scripts stopped working.
With this new script we will check which version of Chrome is installed and
update chromedriver to the correct version.

Fixes: https://tracker.ceph.com/issues/42607
Signed-off-by: Alfonso Martínez <almartin@redhat.com>
Signed-off-by: Tiago Melo <tmelo@suse.com>
(cherry picked from commit 242e76e8840b5d9085239a6fa55a29a093792ee3)

Conflicts:
src/pybind/mgr/dashboard/frontend/package.json
- use "e2e:dev" in nautilus, instead of "e2e:ci"

5 years agoMerge pull request #31228 from jan--f/wip-42540-nautilus
Jan Fajerski [Sat, 2 Nov 2019 14:20:46 +0000 (15:20 +0100)]
Merge pull request #31228 from jan--f/wip-42540-nautilus

nautilus: ceph-volume: api/lvm: check if list of LVs is empty

5 years agoMerge pull request #29994 from smithfarm/wip-41448-nautilus
Yuri Weinstein [Fri, 1 Nov 2019 19:12:14 +0000 (12:12 -0700)]
Merge pull request #29994 from smithfarm/wip-41448-nautilus

nautilus: osd/PrimaryLogPG: Avoid accessing destroyed references in finish_degr…

5 years agoMerge pull request #29992 from smithfarm/wip-40084-nautilus
Yuri Weinstein [Fri, 1 Nov 2019 19:11:20 +0000 (12:11 -0700)]
Merge pull request #29992 from smithfarm/wip-40084-nautilus

nautilus: osd: Better error message when OSD count is less than osd_pool_default_size

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #29991 from smithfarm/wip-39700-nautilus
Yuri Weinstein [Fri, 1 Nov 2019 19:09:04 +0000 (12:09 -0700)]
Merge pull request #29991 from smithfarm/wip-39700-nautilus

nautilus: core: If the nodeep-scrub/noscrub flags are set in pools instead of global cluster. List the pool names in the ceph status

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #29988 from smithfarm/wip-39682-nautilus
Yuri Weinstein [Fri, 1 Nov 2019 19:05:18 +0000 (12:05 -0700)]
Merge pull request #29988 from smithfarm/wip-39682-nautilus

nautilus: core: filestore pre-split may not split enough directories

5 years agoMerge pull request #29979 from smithfarm/wip-41341-nautilus
Yuri Weinstein [Fri, 1 Nov 2019 19:04:24 +0000 (12:04 -0700)]
Merge pull request #29979 from smithfarm/wip-41341-nautilus

nautilus: tests: "CMake Error" in test_envlibrados_for_rocksdb.sh

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #29997 from smithfarm/wip-41453-nautilus
Yuri Weinstein [Fri, 1 Nov 2019 19:03:42 +0000 (12:03 -0700)]
Merge pull request #29997 from smithfarm/wip-41453-nautilus

nautilus: core: mon: C_AckMarkedDown has not handled the Callback Arguments

5 years agoMerge pull request #29998 from smithfarm/wip-41491-nautilus
Yuri Weinstein [Fri, 1 Nov 2019 19:03:02 +0000 (12:03 -0700)]
Merge pull request #29998 from smithfarm/wip-41491-nautilus

nautilus: core: osd/OSDCap: Check for empty namespace

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #30805 from jan--f/wip-42236-nautilus
Jan Fajerski [Fri, 1 Nov 2019 13:38:35 +0000 (14:38 +0100)]
Merge pull request #30805 from jan--f/wip-42236-nautilus

nautilus: ceph-volume: PVolumes.filter shouldn't purge itself

5 years agoMerge pull request #30807 from jan--f/wip-42234-nautilus
Jan Fajerski [Fri, 1 Nov 2019 13:38:21 +0000 (14:38 +0100)]
Merge pull request #30807 from jan--f/wip-42234-nautilus

nautilus: ceph-volume: VolumeGroups.filter shouldn't purge itself

5 years agoMerge pull request #31290 from idryomov/wip-krbd-unmap-msgr1-nautilus
Nathan Cutler [Fri, 1 Nov 2019 07:42:54 +0000 (08:42 +0100)]
Merge pull request #31290 from idryomov/wip-krbd-unmap-msgr1-nautilus

nautilus: qa/suites/krbd: run unmap subsuite with msgr1 only

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
5 years agoqa/suites/krbd: run unmap subsuite with msgr1 only 31290/head
Ilya Dryomov [Tue, 29 Oct 2019 15:19:14 +0000 (16:19 +0100)]
qa/suites/krbd: run unmap subsuite with msgr1 only

pre-single-major.yaml kernel doesn't have any of the monitor client
fixes that came in 4.6.  If the connection is closed, it closes the
session and retries only after 10 seconds.  On top of that, there is
nothing to prevent it from picking the same monitor when reconnecting.
This means that when given both v1 and v2 ports (which look like two
different monitors), it is susceptible to mount_timeout (60 seconds):

  $ sudo rbd map img
  rbd: sysfs write failed
  In some cases useful info is found in syslog - try "dmesg | tail".
  rbd: map failed: (5) Input/output error

  [  822.242313] libceph: mon0 172.21.15.132:3300 socket closed (con state CONNECTING)
  [  832.265494] libceph: mon0 172.21.15.132:3300 socket closed (con state CONNECTING)
  [  842.296175] libceph: mon0 172.21.15.132:3300 socket closed (con state CONNECTING)
  [  852.326924] libceph: mon0 172.21.15.132:3300 socket closed (con state CONNECTING)
  [  862.357611] libceph: mon0 172.21.15.132:3300 socket closed (con state CONNECTING)
  [  872.388373] libceph: mon0 172.21.15.132:3300 socket closed (con state CONNECTING)
  [  882.676136] libceph: mon0 172.21.15.132:3300 socket closed (con state CONNECTING)

Unlike newer kernels that return ETIMEDOUT, it returns EIO.

Newer kernels are much more aggressive about retries and will pick
a different monitor when reconnecting, hence they are always able to
establish the session in time.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 5011cc926cd434a6c095bab57e4b0658f98f5657)

5 years agoMerge pull request #31210 from sebastian-philipp/nautilus-ceph-volume-device_id
Jan Fajerski [Thu, 31 Oct 2019 10:48:15 +0000 (11:48 +0100)]
Merge pull request #31210 from sebastian-philipp/nautilus-ceph-volume-device_id

nautilus: ceph-volume: add Ceph's device id to inventory

5 years agoMerge pull request #31259 from jan--f/wip-41290-nautilus
Nathan Cutler [Thu, 31 Oct 2019 10:20:56 +0000 (11:20 +0100)]
Merge pull request #31259 from jan--f/wip-41290-nautilus

nautilus: doc: update bluestore cache settings and clarify data fraction

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
5 years agodoc: update bluestore cache settings and clarify data fraction 31259/head
Jan Fajerski [Mon, 29 Apr 2019 12:52:27 +0000 (14:52 +0200)]
doc: update bluestore cache settings and clarify data fraction

Fixes: http://tracker.ceph.com/issues/39522
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit 9d8336a7f418fe2bb11361dd74a214403b1e5be7)

5 years agoapi/lvm: rewrite a condition 31228/head
Rishabh Dave [Tue, 3 Sep 2019 13:06:23 +0000 (18:36 +0530)]
api/lvm: rewrite a condition

Create the list of logical volumes if the list passed in arguments is
empty and rewrite the condition to make it more readable.

Fixes: https://tracker.ceph.com/issues/41649
Signed-off-by: Rishabh Dave <ridave@redhat.com>
(cherry picked from commit d1f1bfd3635501090f4069be59e0bcde94dd64ec)

5 years agoceph-volume: add Ceph's device id to inventory 31210/head
Sebastian Wagner [Fri, 18 Oct 2019 11:59:44 +0000 (13:59 +0200)]
ceph-volume: add Ceph's device id to inventory

This will benefit the orchestrator and dashboard to show a unified view of devices with SMART data

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
(cherry picked from commit e70d6041c1a093ed5c2b77abe17e1ede533d9659)

5 years agoMerge pull request #31074 from smithfarm/wip-42417-nautilus
Nathan Cutler [Wed, 23 Oct 2019 14:01:24 +0000 (16:01 +0200)]
Merge pull request #31074 from smithfarm/wip-42417-nautilus

nautilus: doc/rbd: s/guess/xml/ for codeblock lexer

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
5 years agodoc/rbd: s/guess/xml/ for codeblock lexer 31074/head
Kefu Chai [Wed, 16 Oct 2019 04:34:19 +0000 (12:34 +0800)]
doc/rbd: s/guess/xml/ for codeblock lexer

this change silences the warning of

```
doc/rbd/qemu-rbd.rst:174: WARNING: Pygments lexer name 'guess' is not
known
```

see http://pygments.org/docs/lexers/, we should use "xml" for XML .

Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit df226da996e468d2707b08eb012d54b4e37ffdc6)

5 years agoMerge pull request #31009 from SUSE/wip-doc-telemetry-default-interval-nautilus
Nathan Cutler [Mon, 21 Oct 2019 20:22:21 +0000 (22:22 +0200)]
Merge pull request #31009 from SUSE/wip-doc-telemetry-default-interval-nautilus

nautilus: doc/mgr/telemetry: update default interval

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
5 years agodoc/mgr/telemetry: update default interval 31009/head
Tim Serong [Mon, 21 Oct 2019 07:11:35 +0000 (18:11 +1100)]
doc/mgr/telemetry: update default interval

Commit 712987d533 changed the default interval to 24h;
updating the docs to match (this also should go to
the Nautilus branch as that commit landed there too
in https://github.com/ceph/ceph/pull/27709)

Signed-off-by: Tim Serong <tserong@suse.com>
(cherry picked from commit 3c8793c4bd077db2796b512a3b59cd6a01cb3a8c)

5 years agorgw/amqp: fix race condition in AMQP unit test 30889/head
Yuval Lifshitz [Sun, 6 Oct 2019 08:31:35 +0000 (11:31 +0300)]
rgw/amqp: fix race condition in AMQP unit test

Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
(cherry picked from commit 5934ef5071a71c7ae8604d5f2a5e83ac4d01d263)
Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
5 years agoosd: Rename backfill reservation reject names to reflect too full use 29999/head
David Zafman [Fri, 23 Aug 2019 15:54:28 +0000 (08:54 -0700)]
osd: Rename backfill reservation reject names to reflect too full use

The only reason for a reject is in a too full condition.  Now that we
have two types of revoke, let's make this clearer.

Signed-off-by: David Zafman <dzafman@redhat.com>
(cherry picked from commit 0115595c1d1366cb3633e9dc6730496b9e5cf5c4)

Conflicts:
src/osd/PeeringEvent.h
- file does not exist in nautilus due to refactoring: made the changes manually to src/osd/PGPeeringEvent.h
src/osd/PeeringState.cc
src/osd/PeeringState.h
- files do not exist in nautilus due to refactoring: made the changes manually to src/osd/PG.{cc,h}
  by doing:
      s/RejectRemoteReservation/RejectTooFullRemoteReservation/g
      s/RemoteReservationRejected/RemoteReservationRejectedTooFull/g

5 years agoosd: Rename MBackfillReserve::TOOFULL to what it does in particular (revoke)
David Zafman [Thu, 22 Aug 2019 17:30:01 +0000 (10:30 -0700)]
osd: Rename MBackfillReserve::TOOFULL to what it does in particular (revoke)

Signed-off-by: David Zafman <dzafman@redhat.com>
(cherry picked from commit 7810ee584cc0fe9ca1b819d2a807dfc7cd13d292)

Conflicts:
src/osd/PeeringState.cc
- file does not exist in nautilus due to refactoring: made the changes manually
  to src/osd/PG.cc

5 years agoosd: Don't set backfill_toofull in RemoteReservationRevoked path
David Zafman [Fri, 23 Aug 2019 15:52:39 +0000 (08:52 -0700)]
osd: Don't set backfill_toofull in RemoteReservationRevoked path

We shouldn't set backfill_toofull when a revoke occurs in the non-toofull
case.

Fixes: https://tracker.ceph.com/issues/41255
Signed-off-by: David Zafman <dzafman@redhat.com>
(cherry picked from commit fa569ecfecc43ce685b29e0456f62cb085788f25)

Conflicts:
src/osd/PeeringState.cc
- file does not exist in nautilus due to refactoring: made the changes manually
  to src/osd/PG.cc
- no "DECLARE_LOCALS" in nautilus

5 years agoceph-volume: update tests since VolumeGroups.filter returns a list 30807/head
Rishabh Dave [Thu, 3 Oct 2019 12:14:37 +0000 (17:44 +0530)]
ceph-volume: update tests since VolumeGroups.filter returns a list

VolumeGroups.filter returns VolumeGroups object that contains VGs
matching the filter. Update the tests to hold the list returned by the
Volumes.filter() call.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
(cherry picked from commit da58d239a0e067cd3ea5fd26aac24a2551b871c1)

5 years agoceph-volume: VolumeGroups.filter shouldn't purge itself
Rishabh Dave [Thu, 3 Oct 2019 12:09:37 +0000 (17:39 +0530)]
ceph-volume: VolumeGroups.filter shouldn't purge itself

VolumeGroups.filter remove VGs from the list that do no match filter.
Instead of doing that, return a new list that contains VGs that match
the fiter so that VolumeGroups object held by code calling it is not
modified.

Fixes: https://tracker.ceph.com/issues/42171
Signed-off-by: Rishabh Dave <ridave@redhat.com>
(cherry picked from commit 028757813282f764ebcce05572f9e4b76ea4e552)

5 years agoceph-volume: allow creating empty VolumeGroup objects
Rishabh Dave [Thu, 3 Oct 2019 12:10:37 +0000 (17:40 +0530)]
ceph-volume: allow creating empty VolumeGroup objects

Signed-off-by: Rishabh Dave <ridave@redhat.com>
(cherry picked from commit 2dc4f7de96e51c8117b719640ec4c09388a1412e)

5 years agoceph-volume: update tests since PVolumes.filter returns a list 30805/head
Rishabh Dave [Thu, 3 Oct 2019 11:30:38 +0000 (17:00 +0530)]
ceph-volume: update tests since PVolumes.filter returns a list

...returns a list of filtered PVs instead of removing the items that do
not match the filters from itself.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
(cherry picked from commit 38ccfe089a86f86b6e48b9a60286f26bb2444596)

5 years agoceph-volume: PVolumes.filter shouldn't purge itself
Rishabh Dave [Thu, 3 Oct 2019 11:18:46 +0000 (16:48 +0530)]
ceph-volume: PVolumes.filter shouldn't purge itself

PVolumes.filter removes the PVs that do not match the filters from its
list. This approach is problematic since the code calling this method
has to create a copy beforehand. Therefore, it's better to return a new
object that contains PVs that matches the filters.

Fixes: https://tracker.ceph.com/issues/42170
Signed-off-by: Rishabh Dave <ridave@redhat.com>
(cherry picked from commit fcec33ee50457d43add844aef3b81bbf9dd2ad58)

5 years agoceph-volume: allow creating empty PVolumes objects
Rishabh Dave [Thu, 3 Oct 2019 11:14:35 +0000 (16:44 +0530)]
ceph-volume: allow creating empty PVolumes objects

Signed-off-by: Rishabh Dave <ridave@redhat.com>
(cherry picked from commit 384aaee8fd2b0de7120e58efc3ebbd2a520d709f)

5 years agoMerge pull request #30676 from sobelek/wip-42050-nautilus
Jan Fajerski [Wed, 9 Oct 2019 11:15:12 +0000 (13:15 +0200)]
Merge pull request #30676 from sobelek/wip-42050-nautilus

nautilus: ceph-volume: fix warnings raised by pytest

5 years agoMerge pull request #29965 from smithfarm/wip-41272-nautilus
Yuri Weinstein [Tue, 8 Oct 2019 19:51:20 +0000 (12:51 -0700)]
Merge pull request #29965 from smithfarm/wip-41272-nautilus

nautilus: rgw: rgw-log issues the wrong message when decompression fails

5 years agoMerge pull request #29969 from smithfarm/wip-41446-nautilus
Yuri Weinstein [Tue, 8 Oct 2019 19:50:35 +0000 (12:50 -0700)]
Merge pull request #29969 from smithfarm/wip-41446-nautilus

nautilus: rgw_file: readdir: do not construct markers w/leading '/'

5 years agoMerge pull request #29970 from smithfarm/wip-41459-nautilus
Yuri Weinstein [Tue, 8 Oct 2019 19:50:09 +0000 (12:50 -0700)]
Merge pull request #29970 from smithfarm/wip-41459-nautilus

nautilus: rgw: Put User Policy is sensitive to whitespace

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #29972 from smithfarm/wip-41482-nautilus
Yuri Weinstein [Tue, 8 Oct 2019 19:49:41 +0000 (12:49 -0700)]
Merge pull request #29972 from smithfarm/wip-41482-nautilus

nautilus: rgw: potential realm watch lost

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #29974 from smithfarm/wip-41493-nautilus
Yuri Weinstein [Tue, 8 Oct 2019 19:49:06 +0000 (12:49 -0700)]
Merge pull request #29974 from smithfarm/wip-41493-nautilus

nautilus: rgw: multisite: radosgw-admin bucket sync status incorrectly reports "caught up" during full sync

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #29963 from smithfarm/wip-41267-nautilus
Yuri Weinstein [Tue, 8 Oct 2019 19:46:39 +0000 (12:46 -0700)]
Merge pull request #29963 from smithfarm/wip-41267-nautilus

nautilus: rgw: beast frontend throws an exception when running out of FDs

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #29971 from smithfarm/wip-41479-nautilus
Yuri Weinstein [Tue, 8 Oct 2019 19:45:43 +0000 (12:45 -0700)]
Merge pull request #29971 from smithfarm/wip-41479-nautilus

nautilus: rgw: dns name is not case sensitive

Reviewed-by: Casey Bodley <cbodley@redhat.com>