]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
5 years agoos/bluestore/BlueStore.cc: start should be >= _get_ondisk_reserved()
Neha [Fri, 2 Aug 2019 18:26:52 +0000 (18:26 +0000)]
os/bluestore/BlueStore.cc: start should be >= _get_ondisk_reserved()

Signed-off-by: Neha Ojha <nojha@redhat.com>
(cherry picked from commit 27aa0db8e57bffd61225f2c4e73f596c7399d2b1)

5 years agonautilus: mgr/dashboard: Fix data point alignment in MDS count… (#31535)
Lenz Grimmer [Tue, 19 Nov 2019 10:27:58 +0000 (10:27 +0000)]
nautilus: mgr/dashboard: Fix data point alignment in MDS count… (#31535)

nautilus: mgr/dashboard: Fix data point alignment in MDS counters chart

Reviewed-by: Stephan Müller <smueller@suse.com>
5 years agoMerge pull request #31658 from smithfarm/wip-42731-nautilus
Yuri Weinstein [Mon, 18 Nov 2019 20:15:00 +0000 (12:15 -0800)]
Merge pull request #31658 from smithfarm/wip-42731-nautilus

nautilus: mon/MonMap: encode (more) valid compat monmap when we have v2-only addrs

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
5 years agoMerge pull request #31604 from smithfarm/wip-42782-nautilus
Yuri Weinstein [Mon, 18 Nov 2019 20:14:10 +0000 (12:14 -0800)]
Merge pull request #31604 from smithfarm/wip-42782-nautilus

nautilus: tests: test_librados_build.sh: grab from nautilus branch in nautilus

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #31444 from dzafman/wip-41785
Yuri Weinstein [Mon, 18 Nov 2019 20:13:42 +0000 (12:13 -0800)]
Merge pull request #31444 from dzafman/wip-41785

nautilus: core: Make dumping of reservation info congruent between scrub and recovery

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #31261 from ceph/wip-nautilus-restful-node-items
Yuri Weinstein [Mon, 18 Nov 2019 20:13:08 +0000 (12:13 -0800)]
Merge pull request #31261 from ceph/wip-nautilus-restful-node-items

nautilus: restful: Query nodes_by_id for items

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
5 years agoMerge pull request #31125 from smithfarm/wip-42439-nautilus
Yuri Weinstein [Mon, 18 Nov 2019 20:12:18 +0000 (12:12 -0800)]
Merge pull request #31125 from smithfarm/wip-42439-nautilus

nautilus: build/ops: rpm: make librados2, libcephfs2 own (create) /etc/ceph

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #31011 from smithfarm/wip-42401-nautilus
Yuri Weinstein [Mon, 18 Nov 2019 20:11:44 +0000 (12:11 -0800)]
Merge pull request #31011 from smithfarm/wip-42401-nautilus

nautilus: cmake: Allow cephfs and ceph-mds to be build when building on FreeBSD

Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #30740 from smithfarm/wip-41463-nautilus
Yuri Weinstein [Mon, 18 Nov 2019 20:10:35 +0000 (12:10 -0800)]
Merge pull request #30740 from smithfarm/wip-41463-nautilus

nautilus: ceph-objectstore-tool: update-mon-db: do not fail if incmap is missing

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #31682 from dzafman/wip-42432-nautilus
Yuri Weinstein [Mon, 18 Nov 2019 20:09:15 +0000 (12:09 -0800)]
Merge pull request #31682 from dzafman/wip-42432-nautilus

nautilus: mgr: Release GIL before calling OSDMap::calc_pg_upmaps()

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #31077 from smithfarm/wip-42141-nautilus
Yuri Weinstein [Mon, 18 Nov 2019 20:08:31 +0000 (12:08 -0800)]
Merge pull request #31077 from smithfarm/wip-42141-nautilus

nautilus: core: osd/PGLog: persist num_objects_missing for replicas when peering is done

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
5 years agoMerge pull request #30900 from smithfarm/wip-42136-nautilus
Yuri Weinstein [Mon, 18 Nov 2019 20:05:28 +0000 (12:05 -0800)]
Merge pull request #30900 from smithfarm/wip-42136-nautilus

nautilus: osd: Remove unused osdmap flags full, nearfull from output

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #31136 from wjwithagen/wip-fixup-cephfs-nautilus
Yuri Weinstein [Mon, 18 Nov 2019 16:53:11 +0000 (08:53 -0800)]
Merge pull request #31136 from wjwithagen/wip-fixup-cephfs-nautilus

nautilus: test/{fs,cephfs}: Get libcephfs and cephfs to compile with FreeBSD

Reviewed-by: Ramana Raja <rraja@redhat.com>
5 years agoMerge pull request #30951 from sidharthanup/mds-evict-duplicate-nautilus
Yuri Weinstein [Mon, 18 Nov 2019 16:52:33 +0000 (08:52 -0800)]
Merge pull request #30951 from sidharthanup/mds-evict-duplicate-nautilus

nautilus: cephfs: mds: Fix duplicate client entries in eviction list

Reviewed-by: Ramana Raja <rraja@redhat.com>
5 years agoMerge pull request #30043 from smithfarm/wip-41488-nautilus
Yuri Weinstein [Mon, 18 Nov 2019 16:51:58 +0000 (08:51 -0800)]
Merge pull request #30043 from smithfarm/wip-41488-nautilus

nautilus: cephfs: client: return -eio when sync file which unsafe reqs have been dropped

Reviewed-by: Ramana Raja <rraja@redhat.com>
5 years agoMerge pull request #29832 from pdvian/wip-41095-nautilus
Yuri Weinstein [Mon, 18 Nov 2019 16:50:59 +0000 (08:50 -0800)]
Merge pull request #29832 from pdvian/wip-41095-nautilus

nautilus: cephfs: qa: wait for MDS to come back after removing it

Reviewed-by: Ramana Raja <rraja@redhat.com>
5 years agoMerge pull request #29811 from pdvian/wip-41093-nautilus
Yuri Weinstein [Mon, 18 Nov 2019 16:50:29 +0000 (08:50 -0800)]
Merge pull request #29811 from pdvian/wip-41093-nautilus

nautilus: cephfs: qa: ignore expected MDS_CLIENT_LATE_RELEASE warning

Reviewed-by: Ramana Raja <rraja@redhat.com>
5 years agoMerge pull request #29750 from pdvian/wip-41087-nautilus
Yuri Weinstein [Mon, 18 Nov 2019 16:49:58 +0000 (08:49 -0800)]
Merge pull request #29750 from pdvian/wip-41087-nautilus

nautilus: qa: sleep briefly after resetting kclient

Reviewed-by: Ramana Raja <rraja@redhat.com>
5 years agoMerge pull request #31650 from uweigand/nautilus-backport-28013
Yuri Weinstein [Mon, 18 Nov 2019 15:57:05 +0000 (07:57 -0800)]
Merge pull request #31650 from uweigand/nautilus-backport-28013

nautilus: rgw: use explicit to_string() overload for boost::string_ref

Reviewed-by: Nathan Cutler <ncutler@suse.com>
5 years agoMerge pull request #31079 from smithfarm/wip-42155-nautilus
Yuri Weinstein [Mon, 18 Nov 2019 14:54:18 +0000 (06:54 -0800)]
Merge pull request #31079 from smithfarm/wip-42155-nautilus

nautilus: cephfs: mds: fix infinite loop in Locker::file_update_finish

Reviewed-by: Yan, Zheng <zyan@redhat.com>
5 years agoMerge pull request #30144 from ifed01/wip-ifed-gc-blobs-nau
Yuri Weinstein [Sat, 16 Nov 2019 16:07:30 +0000 (08:07 -0800)]
Merge pull request #30144 from ifed01/wip-ifed-gc-blobs-nau

nautilus: os/bluestore: apply garbage collection against excessive blob count growth

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #31397 from jan--f/wip-41460-nautilus
Yuri Weinstein [Sat, 16 Nov 2019 16:06:12 +0000 (08:06 -0800)]
Merge pull request #31397 from jan--f/wip-41460-nautilus

nautilus: os/bluestore/KernelDevice: fix RW_IO_MAX constant

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
5 years agoMerge pull request #30774 from smithfarm/wip-42144-nautilus
Yuri Weinstein [Sat, 16 Nov 2019 16:04:29 +0000 (08:04 -0800)]
Merge pull request #30774 from smithfarm/wip-42144-nautilus

nautilus: mgr/prometheus: Fix KeyError in get_mgr_status

5 years agoMerge pull request #30624 from tchaikov/wip-nautilus-41983
Yuri Weinstein [Sat, 16 Nov 2019 16:03:33 +0000 (08:03 -0800)]
Merge pull request #30624 from tchaikov/wip-nautilus-41983

nautilus: mgr: set hostname in DeviceState::set_metadata()

5 years agoMerge pull request #30622 from smithfarm/wip-42083-nautilus
Yuri Weinstein [Sat, 16 Nov 2019 16:02:53 +0000 (08:02 -0800)]
Merge pull request #30622 from smithfarm/wip-42083-nautilus

nautilus: pybind/rados: fix set_omap() crash on py3

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
5 years agoMerge pull request #30390 from pdvian/wip-41804-nautilus
Yuri Weinstein [Sat, 16 Nov 2019 16:01:49 +0000 (08:01 -0800)]
Merge pull request #30390 from pdvian/wip-41804-nautilus

nautilus: mgr: do not reset reported if a new metric is not collected

5 years agoMerge pull request #30370 from pdvian/wip-41766-nautilus
Yuri Weinstein [Sat, 16 Nov 2019 16:01:15 +0000 (08:01 -0800)]
Merge pull request #30370 from pdvian/wip-41766-nautilus

nautilus: ceph.spec.in: reserve 2500MB per build job

5 years agoMerge pull request #30360 from yuvalif/allow_gcc9_compilation
Yuri Weinstein [Sat, 16 Nov 2019 16:00:37 +0000 (08:00 -0800)]
Merge pull request #30360 from yuvalif/allow_gcc9_compilation

 nautilus: build/ops: cmake/BuildDPDK: ignore gcc8/9 warnings

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
5 years agoMerge pull request #30261 from smithfarm/wip-41724-nautilus
Yuri Weinstein [Sat, 16 Nov 2019 15:59:33 +0000 (07:59 -0800)]
Merge pull request #30261 from smithfarm/wip-41724-nautilus

nautilus: build/ops: fix build fail related to PYTHON_EXECUTABLE variable

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #30215 from sebastian-philipp/nautilus-k8sevents
Yuri Weinstein [Sat, 16 Nov 2019 15:58:39 +0000 (07:58 -0800)]
Merge pull request #30215 from sebastian-philipp/nautilus-k8sevents

nautilus: mgr/k8sevents: Initial ceph -> k8s events integration

Reviewed-by: Boris Ranto <branto@redhat.com>
Reviewed-by: Yuri Weinstein <yweinste@redhat.com>
Reviewed-by: Paul Cuzner <pcuzner@redhat.com>
5 years agoMerge pull request #30016 from smithfarm/wip-41509-nautilus
Yuri Weinstein [Sat, 16 Nov 2019 15:56:17 +0000 (07:56 -0800)]
Merge pull request #30016 from smithfarm/wip-41509-nautilus

nautilus: mgr/zabbix: encode string for Python 3 compatibility

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #30006 from smithfarm/wip-40043-nautilus
Yuri Weinstein [Sat, 16 Nov 2019 15:54:43 +0000 (07:54 -0800)]
Merge pull request #30006 from smithfarm/wip-40043-nautilus

nautilus: mgr/zabbix: Fix typo in key name for PGs in backfill_wait state

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
5 years agoMerge pull request #29949 from smithfarm/wip-41282-nautilus
Yuri Weinstein [Sat, 16 Nov 2019 15:52:47 +0000 (07:52 -0800)]
Merge pull request #29949 from smithfarm/wip-41282-nautilus

nautilus: bluestore: tool to check fragmentation

5 years agoMerge pull request #30046 from smithfarm/wip-40270-nautilus
Yuri Weinstein [Sat, 16 Nov 2019 15:51:46 +0000 (07:51 -0800)]
Merge pull request #30046 from smithfarm/wip-40270-nautilus

nautilus: build/ops: make patch build dependency explicit

5 years agoMerge pull request #30089 from tchaikov/wip-nautilus-gcc-8
Yuri Weinstein [Sat, 16 Nov 2019 15:50:55 +0000 (07:50 -0800)]
Merge pull request #30089 from tchaikov/wip-nautilus-gcc-8

nautilus: build/ops: use gcc-8

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge PR #30008 into nautilus
Sage Weil [Fri, 15 Nov 2019 23:17:07 +0000 (17:17 -0600)]
Merge PR #30008 into nautilus

* refs/pull/30008/head:
mgr/pg_autoscaler: fix race with pool deletion

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
5 years agoMerge PR #30851 into nautilus
Sage Weil [Fri, 15 Nov 2019 23:16:43 +0000 (17:16 -0600)]
Merge PR #30851 into nautilus

* refs/pull/30851/head:
doc/mgr/crash: document missing commands, options
qa/suites/rados/singleton/all/test-crash: whitelist RECENT_CRASH
qa/suites/rados/mgr/tasks/insights: whitelist RECENT_CRASH
qa/tasks/mgr/test_insights: crash module now rejects bad crash reports
mgr/crash: don't make these methods static
mgr/BaseMgrModule: handle unicode health detail strings
mgr/crash: verify timestamp is valid
qa/suites/mgr: whitelist RECENT_CRASH
mgr/crash: remove unused var
mgr/crash: remove unused import 'six'
qa/workunits/rados/test_crash: health check
mgr/crash: improve validation on post
mgr/crash: automatically prune old crashes after a year
mgr/crash: raise RECENT_CRASH warning for recent (new) crashes
mgr/crash: add 'crash ls-new'
mgr/crash: add option and serve infra
mgr/crash: keep copy of crashes in memory
mgr/pg_autoscaler: adjust style to match built-in tables
mgr/crash: make 'crash ls' a nice table with a NEW column
mgr/crash: nicely format 'crash info' output
mgr/crash: add 'crash archive <id>', 'crash archive-all' commands

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge PR #30849 into nautilus
Sage Weil [Fri, 15 Nov 2019 23:16:30 +0000 (17:16 -0600)]
Merge PR #30849 into nautilus

* refs/pull/30849/head:
mgr/dashboard: fix mgr module API tests
qa/tasks/mgr/dashboard/test_mgr_module: remove enable/disable test from MgrModuleTelemetryTest
qa/tasks/mgr/dashboard/test_mgr_module: sync w/ telemetry
mgr/dashboard/qa: add more fields to report
Merge branch 'nautilus' into wip-device-telemetry-nautilus
PendingReleaseNotes: fix typo
PendingReleaseNotes: remove kludge
mgr/telemetry: add stats about crush map
mgr/telemetry: add rgw metadata
mgr/telemetry: include fs size (files, bytes, snaps)
mds: report r{files,bytes,snaps} via perfcounters
mgr/telemetry: mds cache stats
mgr/telemetry: add some rbd metadata
mgr/telemetry: note whether osd cluster_network is in use
mgr/telemetry: add host counts
mgr/telemetry: add more pool metadata
mgr/telemetry: remove crush rule name
mgr/telemetry: include min_mon_release and msgr v1 vs v2 addr count
mgr/telemetry: add CephFS metadata
mgr/telemetry: include balancer info (active=true/false, mode)
mgr/telemetry: include per-pool pg_autoscale info
mgr/telemetry: dict.pop() errs on nonexistent key
mgr/telemetry: send device telemetry via per-host POST to device endpoint
mgr/telemetry: fix remote into crash do_ls()
mgr/telemetry: clear the event after being awaken by it
mgr/telemetry: bump content revision and add a release note
telemetry/server: add device report endpoint
mgr/telemetry: include device telemetry
mgr/telemetry: salt osd ids too
mgr/telemetry: obscure entity_name with a salt
mgr/telemetry: force re-opt-in if the report contents change
mgr/telemetry: less noise in the log
mgr/telemetry: wake up serve on config change
mgr/telemetry: track telemetry report revisions
qa/tasks/mgr/dashboard/test_mgr_module: adjust expected schema
mgr/telemetry: separate out cluster config vs running daemons
mgr/telemetry: include any config options that are customized
mgr/telemetry: specify license when opting in
doc/mgr/telemetry: update
mgr/telemetry: move contact info to an 'ident' channel
mgr/telemetry: accept channel list to 'telemetry show'
mgr/telemetry: always generate new report for 'telemetry show'
mgr/telemetry: add 'device' channel and call out to devicehealth module
mgr/telemetry: add telemetry channel 'device'
mgr/telemetry: add separate channels
mgr/devicehealth: pull out MAX_SAMPLES

Reviewed-by: Wido den Hollander <wido@42on.com>
5 years agoMerge pull request #31605 from rhcs-dashboard/42795-fixtypo
Nathan Cutler [Fri, 15 Nov 2019 22:47:24 +0000 (23:47 +0100)]
Merge pull request #31605 from rhcs-dashboard/42795-fixtypo

nautilus: common: fix typo in rgw_user_max_buckets option long description.

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
5 years agoMerge pull request #31334 from LongDuncan/nautilus
Yuri Weinstein [Fri, 15 Nov 2019 22:41:10 +0000 (14:41 -0800)]
Merge pull request #31334 from LongDuncan/nautilus

nautilus: mgr/restful: requests api adds support multiple commands

Reviewed-by: Boris Ranto <branto@redhat.com>
5 years agoMerge pull request #31304 from smithfarm/wip-42545-nautilus
Yuri Weinstein [Fri, 15 Nov 2019 22:40:30 +0000 (14:40 -0800)]
Merge pull request #31304 from smithfarm/wip-42545-nautilus

nautilus: qa/tasks/cbt: run stop-all.sh while shutting down

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #31040 from smithfarm/wip-41495-nautilus
Yuri Weinstein [Fri, 15 Nov 2019 22:39:58 +0000 (14:39 -0800)]
Merge pull request #31040 from smithfarm/wip-41495-nautilus

nautilus: tests: add debugging failed osd-release setting

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
5 years agoMerge pull request #31019 from ifed01/wip-42041-nautilus
Yuri Weinstein [Fri, 15 Nov 2019 22:39:31 +0000 (14:39 -0800)]
Merge pull request #31019 from ifed01/wip-42041-nautilus

nautilus: core: os/bluestore: fix objectstore_blackhole read-after-write

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
5 years agoMerge pull request #30983 from tchaikov/wip-nautilus-42363
Yuri Weinstein [Fri, 15 Nov 2019 22:39:02 +0000 (14:39 -0800)]
Merge pull request #30983 from tchaikov/wip-nautilus-42363

nautilus: build/ops: python3-cephfs should provide python36-cephfs

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
5 years agoMerge pull request #31097 from smithfarm/wip-42395-nautilus
Yuri Weinstein [Fri, 15 Nov 2019 22:38:21 +0000 (14:38 -0800)]
Merge pull request #31097 from smithfarm/wip-42395-nautilus

nautilus: common/ceph_context: avoid unnecessary wait during service thread shutdown

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
5 years agoMerge pull request #29592 from penglaiyxy/wip-simple-messenger
Yuri Weinstein [Fri, 15 Nov 2019 22:35:06 +0000 (14:35 -0800)]
Merge pull request #29592 from penglaiyxy/wip-simple-messenger

nautilus: msg/simple: reset in_seq_acked to zero when session is reset

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agomgr/dashboard: fix mgr module API tests 30849/head
alfonsomthd [Tue, 13 Aug 2019 10:15:38 +0000 (12:15 +0200)]
mgr/dashboard: fix mgr module API tests

Signed-off-by: alfonsomthd <almartin@redhat.com>
(cherry picked from commit 6e6711a1e217042390b379f98c0ec064ab4e2702)

5 years agoqa/tasks/mgr/dashboard/test_mgr_module: remove enable/disable test from MgrModuleTele...
Kefu Chai [Tue, 13 Aug 2019 01:54:24 +0000 (09:54 +0800)]
qa/tasks/mgr/dashboard/test_mgr_module: remove enable/disable test from MgrModuleTelemetryTest

telemetry is always enabled since 2d62d71cd46d791294b3803e034c0995fef08b33

Fixes: https://tracker.ceph.com/issues/41186
Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit cc3ae85b05b759fd6ac955d2e798d5fe3a109294)

5 years agoqa/tasks/mgr/dashboard/test_mgr_module: sync w/ telemetry
Kefu Chai [Wed, 7 Aug 2019 07:23:19 +0000 (15:23 +0800)]
qa/tasks/mgr/dashboard/test_mgr_module: sync w/ telemetry

* use primitive types instead of `JLeaf(the_type)` as they are
  equivalent in this context
* remove fields which are added only if certain channels are
  activated.
* allow unknown fields, as we are including various stuff
  in the report, for instance, osdmap, usage, crash info, etc.

Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit 3303116f5681f317dee53988e1de9d840d250884)

5 years agomgr/dashboard/qa: add more fields to report
Kefu Chai [Fri, 26 Jul 2019 17:50:30 +0000 (01:50 +0800)]
mgr/dashboard/qa: add more fields to report

to be in sync with #28847

Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit d6170e70b6d1d634be6af5540d85572a9c425d0c)

5 years agomgr: Improve balancer module status 31682/head
David Zafman [Thu, 24 Oct 2019 00:00:14 +0000 (17:00 -0700)]
mgr: Improve balancer module status

Add balancer status fields so that slow optimizations can be detected

Signed-off-by: David Zafman <dzafman@redhat.com>
(cherry picked from commit f04c505b9dc128bdfbcca49d82f8aac4abf8b56f)

5 years agotest: Test balancer module commands
David Zafman [Wed, 23 Oct 2019 23:38:48 +0000 (16:38 -0700)]
test: Test balancer module commands

Signed-off-by: David Zafman <dzafman@redhat.com>
(cherry picked from commit 3a0e2c8ff1cce44bf44b139572f4d1bd9bbfb766)

5 years agomgr: Release GIL before calling OSDMap::calc_pg_upmaps()
David Zafman [Tue, 22 Oct 2019 22:24:05 +0000 (15:24 -0700)]
mgr: Release GIL before calling OSDMap::calc_pg_upmaps()

Prevent optimize and execute commands from running with active balancer

Fixes: https://tracker.ceph.com/issues/42432
Signed-off-by: David Zafman <dzafman@redhat.com>
(cherry picked from commit e2a35e8c8e9f381a635ad0ca01326a2c512590a9)

5 years agoqa/mgr/balancer: Add cram based test for altering target_max_misplaced_ratio setting
Shyukri Shyukriev [Thu, 26 Sep 2019 08:24:08 +0000 (11:24 +0300)]
qa/mgr/balancer: Add cram based test for altering target_max_misplaced_ratio setting

Signed-off-by: Shyukri Shyukriev <shshyukriev@suse.com>
(cherry picked from commit 37a45deb5bb435afd056a05d09cf691bb36f2086)

5 years agorgw: use explicit to_string() overload for boost::string_ref 31650/head
Casey Bodley [Tue, 7 May 2019 18:08:25 +0000 (14:08 -0400)]
rgw: use explicit to_string() overload for boost::string_ref

Fixes: http://tracker.ceph.com/issues/39611
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 04c326795d2afe63c679f2542565763fee6acc09)

Conflicts:
    src/rgw/rgw_json_enc.cc
Signed-off-by: Ulrich Weigand <ulrich.weigand@de.ibm.com>
5 years agodoc/mgr/crash: document missing commands, options 30851/head
Sage Weil [Wed, 24 Jul 2019 17:57:18 +0000 (12:57 -0500)]
doc/mgr/crash: document missing commands, options

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 1ea7570bb1b637a436c209dcc4559e206a20ad42)

5 years agoqa/suites/rados/singleton/all/test-crash: whitelist RECENT_CRASH
Sage Weil [Mon, 22 Jul 2019 22:13:30 +0000 (17:13 -0500)]
qa/suites/rados/singleton/all/test-crash: whitelist RECENT_CRASH

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 9257175f086e7ca36189badbac192522856dbcce)

5 years agoqa/suites/rados/mgr/tasks/insights: whitelist RECENT_CRASH
Sage Weil [Fri, 19 Jul 2019 19:10:22 +0000 (14:10 -0500)]
qa/suites/rados/mgr/tasks/insights: whitelist RECENT_CRASH

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 209ce4ec6889a0a012fb862238c454738adb4ff2)

5 years agoqa/tasks/mgr/test_insights: crash module now rejects bad crash reports
Sage Weil [Thu, 18 Jul 2019 14:31:09 +0000 (09:31 -0500)]
qa/tasks/mgr/test_insights: crash module now rejects bad crash reports

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 3bddcc5ddf1a96413a9efa439b167a471eee362d)

5 years agomgr/crash: don't make these methods static
Sage Weil [Wed, 17 Jul 2019 22:00:57 +0000 (17:00 -0500)]
mgr/crash: don't make these methods static

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 32a4b510aa93664f2beaadecedc9ce6e8e87b931)

5 years agomgr/BaseMgrModule: handle unicode health detail strings
Sage Weil [Wed, 17 Jul 2019 16:48:50 +0000 (11:48 -0500)]
mgr/BaseMgrModule: handle unicode health detail strings

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 52875c6cb2c615d1070a456d0e1dcc708d5fd5db)

5 years agomgr/crash: verify timestamp is valid
Sage Weil [Wed, 17 Jul 2019 16:11:01 +0000 (11:11 -0500)]
mgr/crash: verify timestamp is valid

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 277d974b4a74fa40d0305bdc5afc66e2f2186576)

5 years agoqa/suites/mgr: whitelist RECENT_CRASH
Sage Weil [Wed, 17 Jul 2019 15:55:33 +0000 (10:55 -0500)]
qa/suites/mgr: whitelist RECENT_CRASH

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit e2ff58ba166efb42836466c745a4b9d136810a00)

5 years agomgr/crash: remove unused var
Sage Weil [Wed, 17 Jul 2019 14:36:11 +0000 (09:36 -0500)]
mgr/crash: remove unused var

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 37a8f2d66ac8330ca72d7a13dd2864529a87edbb)

5 years agomgr/crash: remove unused import 'six'
Sage Weil [Wed, 17 Jul 2019 14:35:57 +0000 (09:35 -0500)]
mgr/crash: remove unused import 'six'

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 5b2cbb3a10f8011fbc3d5245801009557404ddc5)

5 years agoqa/workunits/rados/test_crash: health check
Sage Weil [Tue, 16 Jul 2019 14:26:21 +0000 (09:26 -0500)]
qa/workunits/rados/test_crash: health check

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit f6e0894902a6646e73e3db123d48fe2fac9570ea)

5 years agomgr/crash: improve validation on post
Sage Weil [Tue, 16 Jul 2019 14:18:50 +0000 (09:18 -0500)]
mgr/crash: improve validation on post

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 422871d63ea8069453c435bd5559bea68f942eaf)

5 years agomgr/crash: automatically prune old crashes after a year
Sage Weil [Sun, 14 Jul 2019 16:31:56 +0000 (11:31 -0500)]
mgr/crash: automatically prune old crashes after a year

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit b2e20858f42e3775adda4bd054fc8fa15e205453)

5 years agomgr/crash: raise RECENT_CRASH warning for recent (new) crashes
Sage Weil [Thu, 10 Oct 2019 17:46:36 +0000 (12:46 -0500)]
mgr/crash: raise RECENT_CRASH warning for recent (new) crashes

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit c885ee7f0c9c7c232fda81bfd6f9eca0e182ee3d)

# Conflicts:
# doc/rados/operations/health-checks.rst
- TELEMETRY_CHANGED alert order in doc

5 years agomgr/crash: add 'crash ls-new'
Sage Weil [Sun, 14 Jul 2019 16:26:41 +0000 (11:26 -0500)]
mgr/crash: add 'crash ls-new'

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit bebb1c31006ff3cba67831879b34699cf111f945)

5 years agomgr/crash: add option and serve infra
Sage Weil [Sat, 13 Jul 2019 16:06:41 +0000 (11:06 -0500)]
mgr/crash: add option and serve infra

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 7cbaa5ac563bf0be7dd2227ef8a1ae7d0ae20143)

5 years agomgr/crash: keep copy of crashes in memory
Sage Weil [Sat, 13 Jul 2019 15:39:41 +0000 (10:39 -0500)]
mgr/crash: keep copy of crashes in memory

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 6ae4c42bae80c732391e200d56f512d4ea639504)

5 years agomgr/pg_autoscaler: adjust style to match built-in tables
Sage Weil [Sat, 13 Jul 2019 13:35:01 +0000 (08:35 -0500)]
mgr/pg_autoscaler: adjust style to match built-in tables

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 44a99f2f7692e2ab2a74f8a0df983a81a3dea299)

5 years agomgr/crash: make 'crash ls' a nice table with a NEW column
Sage Weil [Fri, 12 Jul 2019 21:34:37 +0000 (16:34 -0500)]
mgr/crash: make 'crash ls' a nice table with a NEW column

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit c691f2f8763a9db081a0b61294c5eedf4e9c2cee)

5 years agomgr/crash: nicely format 'crash info' output
Sage Weil [Fri, 12 Jul 2019 21:23:17 +0000 (16:23 -0500)]
mgr/crash: nicely format 'crash info' output

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 35f15f87cb936705f77ed1ca1ecaad796e021e7a)

5 years agomgr/crash: add 'crash archive <id>', 'crash archive-all' commands
Sage Weil [Fri, 12 Jul 2019 21:23:03 +0000 (16:23 -0500)]
mgr/crash: add 'crash archive <id>', 'crash archive-all' commands

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 31f650cb2049995faa03288e22591d967fd8a14d)

5 years agoMerge branch 'nautilus' into wip-device-telemetry-nautilus
Sage Weil [Fri, 15 Nov 2019 14:23:53 +0000 (08:23 -0600)]
Merge branch 'nautilus' into wip-device-telemetry-nautilus

5 years agoMerge PR #30755 into nautilus
Sage Weil [Fri, 15 Nov 2019 13:11:57 +0000 (07:11 -0600)]
Merge PR #30755 into nautilus

* refs/pull/30755/head:
os/bluestore: fix improper setting of STATE_KV_SUBMITTED.

5 years agoMerge PR #30773 into nautilus
Sage Weil [Fri, 15 Nov 2019 13:11:33 +0000 (07:11 -0600)]
Merge PR #30773 into nautilus

* refs/pull/30773/head:
mgr/BaseMgrStandbyModule: drop GIL in ceph_get_module_option()

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge PR #31099 into nautilus
Sage Weil [Fri, 15 Nov 2019 13:11:05 +0000 (07:11 -0600)]
Merge PR #31099 into nautilus

* refs/pull/31099/head:
auth/cephx/CephxClientHandler: handle decode errors
auth/cephx/CephxProtocol: handle decode errors in CephXTicketHandler::verify_service_ticket_reply
auth/cephx/CephxServiceHandler: handle decode errors

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
5 years agoMerge PR #31100 into nautilus
Sage Weil [Fri, 15 Nov 2019 13:10:37 +0000 (07:10 -0600)]
Merge PR #31100 into nautilus

* refs/pull/31100/head:
mgr/pg_autoscaler: use 'stored' for pool_logical_used

Reviewed-by: Sage Weil <sage@redhat.com>
5 years agoMerge PR #31411 into nautilus
Sage Weil [Fri, 15 Nov 2019 13:10:15 +0000 (07:10 -0600)]
Merge PR #31411 into nautilus

* refs/pull/31411/head:
mgr/ActivePyModules: behave if a module queries a devid that does not exist

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
5 years agoMerge PR #31446 into nautilus
Sage Weil [Fri, 15 Nov 2019 13:09:55 +0000 (07:09 -0600)]
Merge PR #31446 into nautilus

* refs/pull/31446/head:
mgr/devicehealth: do not scrape mon devices

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge PR #31612 into nautilus
Sage Weil [Fri, 15 Nov 2019 13:09:38 +0000 (07:09 -0600)]
Merge PR #31612 into nautilus

* refs/pull/31612/head:
Revert "rocksdb: enable rocksdb_rmrange=true by default"

Reviewed-by: Mark Nelson <mnelson@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Igor Fedotov <ifedotov@suse.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge PR #31644 into nautilus
Sage Weil [Fri, 15 Nov 2019 13:09:20 +0000 (07:09 -0600)]
Merge PR #31644 into nautilus

* refs/pull/31644/head:
os/bluestore: consolidate extents from the same device only

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoceph-objectstore-tool: return 0 if incmap is sane 30740/head
Kefu Chai [Fri, 16 Aug 2019 11:09:24 +0000 (19:09 +0800)]
ceph-objectstore-tool: return 0 if incmap is sane

this change addresses the regression introduced by 2e2414b3

Fixes: https://tracker.ceph.com/issues/41177
Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit d03f397544187d7de21d4849f58ce51baafcff8b)

5 years agoMerge pull request #31565 from tspmelo/wip-42747-nautilus
Lenz Grimmer [Fri, 15 Nov 2019 08:37:46 +0000 (08:37 +0000)]
Merge pull request #31565 from tspmelo/wip-42747-nautilus

nautilus: mgr/dashboard: Improve position of MDS chart tooltip

Reviewed-by: Laura Paduano <lpaduano@suse.com>
5 years agomon/MonMap: encode (more) valid compat monmap when we have v2-only addrs 31658/head
Sage Weil [Thu, 7 Nov 2019 18:54:00 +0000 (12:54 -0600)]
mon/MonMap: encode (more) valid compat monmap when we have v2-only addrs

If we have 1 or more mons with v2-only addrs, pre-nautilus clients can't
talk to them.  If there are more than 1 such mons in the map, they also
fail when loading the map because they expect the addrs to be unique. In
such situations, lie by giving them v1 addrs that are actually v2 ip:port
(so not actually valid).  Hopefully there are enough other mons that do
have v1 addrs that the clients can still connect.

Fixes: https://tracker.ceph.com/issues/42600
Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit c457db1205cd36352115137be232d07e0493af8d)

5 years agoMerge PR #30827 into nautilus
Patrick Donnelly [Thu, 14 Nov 2019 17:37:22 +0000 (09:37 -0800)]
Merge PR #30827 into nautilus

* refs/pull/30827/head:
qa/tasks: tests for ls
mgr/volumes: list FS subvolumes, subvolume groups and their snapshots

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge PR #31076 into nautilus
Patrick Donnelly [Thu, 14 Nov 2019 17:34:46 +0000 (09:34 -0800)]
Merge PR #31076 into nautilus

* refs/pull/31076/head:
mgr/volumes: fix incorrect snapshot path creation

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge PR #30768 into nautilus
Patrick Donnelly [Thu, 14 Nov 2019 17:30:24 +0000 (09:30 -0800)]
Merge PR #30768 into nautilus

* refs/pull/30768/head:
doc: protection for 'fs volume rm' command
doc: add ceph fs volumes and subvolumes documentation
qa/tasks: add/update tests for --yes-i-really-mean-it
mgr/volumes: protection for 'fs volume rm' command

Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge pull request #31641 from liewegas/fix-42783-nautilus
Nathan Cutler [Thu, 14 Nov 2019 17:15:09 +0000 (18:15 +0100)]
Merge pull request #31641 from liewegas/fix-42783-nautilus

nautilus: qa/tasks/ceph.conf.template: increase mon tell retries

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
5 years agoRevert "rocksdb: enable rocksdb_rmrange=true by default" 31612/head
Neha Ojha [Wed, 13 Nov 2019 15:33:01 +0000 (07:33 -0800)]
Revert "rocksdb: enable rocksdb_rmrange=true by default"

This reverts commit 29bafe57503066c962cc692a66178b083fd43343.

We have observed drastically poor performance when rocksdb_rmrange is
used for every key deletion.

This change is specific to nautilus, since we are experimenting with rocksdb_rmrange
along with https://github.com/ceph/ceph/pull/31442 in master.

Signed-off-by: Neha Ojha <nojha@redhat.com>
5 years agoos/bluestore: consolidate extents from the same device only 31644/head
Igor Fedotov [Wed, 13 Nov 2019 19:09:53 +0000 (22:09 +0300)]
os/bluestore: consolidate extents from the same device only

Presumably Fixes: https://tracker.ceph.com/issues/42223

Signed-off-by: Igor Fedotov <ifedotov@suse.com>
(cherry picked from commit 20a90698a262905e97bae771b5950af04c00c67a)

5 years agoqa/tasks/ceph.conf.template: increase mon tell retries 31641/head
Sage Weil [Thu, 14 Nov 2019 16:14:11 +0000 (10:14 -0600)]
qa/tasks/ceph.conf.template: increase mon tell retries

With lots of ms failure injection we see these failing in QA.  Bump this
up as a kludge for nautilus *only*; the master tell implementation no
longer sucks.

Fixes: https://tracker.ceph.com/issues/42783
Signed-off-by: Sage Weil <sage@redhat.com>
5 years agocmake: Allow cephfs and ceph-mds to be build when building on FreeBSD 31011/head
Willem Jan Withagen [Fri, 20 Sep 2019 14:02:23 +0000 (16:02 +0200)]
cmake: Allow cephfs and ceph-mds to be build when building on FreeBSD

on FreeBSD keyutil absence prevents building KRBD and mount.
But on FreeBSD icephfs, ceph-fuse and ceph-mds do work, so we need
ceph-mds to be build.

Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
(cherry picked from commit f698f3c3eef4034799005b8816de5d468ef9fe18)

Conflicts:
CMakeLists.txt
- nautilus does not have "if (HAVE_LIBTCMALLOC AND TCMALLOC_VERSION_STRING
  VERSION_LESS 2.6.2)" clause, and c028de2f938bc9b8c0193b9219fb64e1416037cf
  refactored HAVE_GENL out of master
        src/mount/CMakeLists.txt
- CAPNG was introduced in master: omitted the changes

5 years agoMerge pull request #31248 from smithfarm/wip-42562-nautilus
Nathan Cutler [Thu, 14 Nov 2019 15:46:50 +0000 (16:46 +0100)]
Merge pull request #31248 from smithfarm/wip-42562-nautilus

nautilus: tests: enable dashboard tests to be run with "--suite rados/dashboard"

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
5 years agoqa: enable dashboard tests to be run with "--suite rados/dashboard" 31248/head
Nathan Cutler [Tue, 17 Sep 2019 16:11:11 +0000 (18:11 +0200)]
qa: enable dashboard tests to be run with "--suite rados/dashboard"

This moves dashboard.yaml from rados/mgr into a new, separate rados/dashboard
suite. The common elements it uses are moved from rados/mgr into qa/ and
replaced with symlinks.

Fixes: https://tracker.ceph.com/issues/41820
Signed-off-by: Nathan Cutler <ncutler@suse.com>
(cherry picked from commit 493ee6d78ff90c4c3d81f5c7edac6d06fbe3d295)

5 years agoMerge pull request #31628 from yuvalif/nautilus-backport-of-42497
Nathan Cutler [Thu, 14 Nov 2019 15:24:43 +0000 (16:24 +0100)]
Merge pull request #31628 from yuvalif/nautilus-backport-of-42497

nautilus: rgw/amqp: remove flaky amqp test

Reviewed-by: Nathan Cutler <ncutler@suse.com>
5 years agorgw/amqp: remove a test that requires syncronization 31628/head
Yuval Lifshitz [Sun, 10 Nov 2019 09:57:57 +0000 (11:57 +0200)]
rgw/amqp: remove a test that requires syncronization
betwen the amqp manager internal thread and the test itself
amqp reconnect should be tested by system test instead

Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
(cherry picked from commit 10a27ef809c4e3f745f2726a5f0be8d8579a5979)
Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>