]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
5 years agoMerge pull request #31011 from smithfarm/wip-42401-nautilus
Yuri Weinstein [Mon, 18 Nov 2019 20:11:44 +0000 (12:11 -0800)]
Merge pull request #31011 from smithfarm/wip-42401-nautilus

nautilus: cmake: Allow cephfs and ceph-mds to be build when building on FreeBSD

Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #30740 from smithfarm/wip-41463-nautilus
Yuri Weinstein [Mon, 18 Nov 2019 20:10:35 +0000 (12:10 -0800)]
Merge pull request #30740 from smithfarm/wip-41463-nautilus

nautilus: ceph-objectstore-tool: update-mon-db: do not fail if incmap is missing

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #31682 from dzafman/wip-42432-nautilus
Yuri Weinstein [Mon, 18 Nov 2019 20:09:15 +0000 (12:09 -0800)]
Merge pull request #31682 from dzafman/wip-42432-nautilus

nautilus: mgr: Release GIL before calling OSDMap::calc_pg_upmaps()

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #31077 from smithfarm/wip-42141-nautilus
Yuri Weinstein [Mon, 18 Nov 2019 20:08:31 +0000 (12:08 -0800)]
Merge pull request #31077 from smithfarm/wip-42141-nautilus

nautilus: core: osd/PGLog: persist num_objects_missing for replicas when peering is done

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
5 years agoMerge pull request #30900 from smithfarm/wip-42136-nautilus
Yuri Weinstein [Mon, 18 Nov 2019 20:05:28 +0000 (12:05 -0800)]
Merge pull request #30900 from smithfarm/wip-42136-nautilus

nautilus: osd: Remove unused osdmap flags full, nearfull from output

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #31136 from wjwithagen/wip-fixup-cephfs-nautilus
Yuri Weinstein [Mon, 18 Nov 2019 16:53:11 +0000 (08:53 -0800)]
Merge pull request #31136 from wjwithagen/wip-fixup-cephfs-nautilus

nautilus: test/{fs,cephfs}: Get libcephfs and cephfs to compile with FreeBSD

Reviewed-by: Ramana Raja <rraja@redhat.com>
5 years agoMerge pull request #30951 from sidharthanup/mds-evict-duplicate-nautilus
Yuri Weinstein [Mon, 18 Nov 2019 16:52:33 +0000 (08:52 -0800)]
Merge pull request #30951 from sidharthanup/mds-evict-duplicate-nautilus

nautilus: cephfs: mds: Fix duplicate client entries in eviction list

Reviewed-by: Ramana Raja <rraja@redhat.com>
5 years agoMerge pull request #30043 from smithfarm/wip-41488-nautilus
Yuri Weinstein [Mon, 18 Nov 2019 16:51:58 +0000 (08:51 -0800)]
Merge pull request #30043 from smithfarm/wip-41488-nautilus

nautilus: cephfs: client: return -eio when sync file which unsafe reqs have been dropped

Reviewed-by: Ramana Raja <rraja@redhat.com>
5 years agoMerge pull request #29832 from pdvian/wip-41095-nautilus
Yuri Weinstein [Mon, 18 Nov 2019 16:50:59 +0000 (08:50 -0800)]
Merge pull request #29832 from pdvian/wip-41095-nautilus

nautilus: cephfs: qa: wait for MDS to come back after removing it

Reviewed-by: Ramana Raja <rraja@redhat.com>
5 years agoMerge pull request #29811 from pdvian/wip-41093-nautilus
Yuri Weinstein [Mon, 18 Nov 2019 16:50:29 +0000 (08:50 -0800)]
Merge pull request #29811 from pdvian/wip-41093-nautilus

nautilus: cephfs: qa: ignore expected MDS_CLIENT_LATE_RELEASE warning

Reviewed-by: Ramana Raja <rraja@redhat.com>
5 years agoMerge pull request #29750 from pdvian/wip-41087-nautilus
Yuri Weinstein [Mon, 18 Nov 2019 16:49:58 +0000 (08:49 -0800)]
Merge pull request #29750 from pdvian/wip-41087-nautilus

nautilus: qa: sleep briefly after resetting kclient

Reviewed-by: Ramana Raja <rraja@redhat.com>
5 years agoMerge pull request #31650 from uweigand/nautilus-backport-28013
Yuri Weinstein [Mon, 18 Nov 2019 15:57:05 +0000 (07:57 -0800)]
Merge pull request #31650 from uweigand/nautilus-backport-28013

nautilus: rgw: use explicit to_string() overload for boost::string_ref

Reviewed-by: Nathan Cutler <ncutler@suse.com>
5 years agoMerge pull request #31079 from smithfarm/wip-42155-nautilus
Yuri Weinstein [Mon, 18 Nov 2019 14:54:18 +0000 (06:54 -0800)]
Merge pull request #31079 from smithfarm/wip-42155-nautilus

nautilus: cephfs: mds: fix infinite loop in Locker::file_update_finish

Reviewed-by: Yan, Zheng <zyan@redhat.com>
5 years agoMerge pull request #30144 from ifed01/wip-ifed-gc-blobs-nau
Yuri Weinstein [Sat, 16 Nov 2019 16:07:30 +0000 (08:07 -0800)]
Merge pull request #30144 from ifed01/wip-ifed-gc-blobs-nau

nautilus: os/bluestore: apply garbage collection against excessive blob count growth

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #31397 from jan--f/wip-41460-nautilus
Yuri Weinstein [Sat, 16 Nov 2019 16:06:12 +0000 (08:06 -0800)]
Merge pull request #31397 from jan--f/wip-41460-nautilus

nautilus: os/bluestore/KernelDevice: fix RW_IO_MAX constant

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
5 years agoMerge pull request #30774 from smithfarm/wip-42144-nautilus
Yuri Weinstein [Sat, 16 Nov 2019 16:04:29 +0000 (08:04 -0800)]
Merge pull request #30774 from smithfarm/wip-42144-nautilus

nautilus: mgr/prometheus: Fix KeyError in get_mgr_status

5 years agoMerge pull request #30624 from tchaikov/wip-nautilus-41983
Yuri Weinstein [Sat, 16 Nov 2019 16:03:33 +0000 (08:03 -0800)]
Merge pull request #30624 from tchaikov/wip-nautilus-41983

nautilus: mgr: set hostname in DeviceState::set_metadata()

5 years agoMerge pull request #30622 from smithfarm/wip-42083-nautilus
Yuri Weinstein [Sat, 16 Nov 2019 16:02:53 +0000 (08:02 -0800)]
Merge pull request #30622 from smithfarm/wip-42083-nautilus

nautilus: pybind/rados: fix set_omap() crash on py3

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
5 years agoMerge pull request #30390 from pdvian/wip-41804-nautilus
Yuri Weinstein [Sat, 16 Nov 2019 16:01:49 +0000 (08:01 -0800)]
Merge pull request #30390 from pdvian/wip-41804-nautilus

nautilus: mgr: do not reset reported if a new metric is not collected

5 years agoMerge pull request #30370 from pdvian/wip-41766-nautilus
Yuri Weinstein [Sat, 16 Nov 2019 16:01:15 +0000 (08:01 -0800)]
Merge pull request #30370 from pdvian/wip-41766-nautilus

nautilus: ceph.spec.in: reserve 2500MB per build job

5 years agoMerge pull request #30360 from yuvalif/allow_gcc9_compilation
Yuri Weinstein [Sat, 16 Nov 2019 16:00:37 +0000 (08:00 -0800)]
Merge pull request #30360 from yuvalif/allow_gcc9_compilation

 nautilus: build/ops: cmake/BuildDPDK: ignore gcc8/9 warnings

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
5 years agoMerge pull request #30261 from smithfarm/wip-41724-nautilus
Yuri Weinstein [Sat, 16 Nov 2019 15:59:33 +0000 (07:59 -0800)]
Merge pull request #30261 from smithfarm/wip-41724-nautilus

nautilus: build/ops: fix build fail related to PYTHON_EXECUTABLE variable

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #30215 from sebastian-philipp/nautilus-k8sevents
Yuri Weinstein [Sat, 16 Nov 2019 15:58:39 +0000 (07:58 -0800)]
Merge pull request #30215 from sebastian-philipp/nautilus-k8sevents

nautilus: mgr/k8sevents: Initial ceph -> k8s events integration

Reviewed-by: Boris Ranto <branto@redhat.com>
Reviewed-by: Yuri Weinstein <yweinste@redhat.com>
Reviewed-by: Paul Cuzner <pcuzner@redhat.com>
5 years agoMerge pull request #30016 from smithfarm/wip-41509-nautilus
Yuri Weinstein [Sat, 16 Nov 2019 15:56:17 +0000 (07:56 -0800)]
Merge pull request #30016 from smithfarm/wip-41509-nautilus

nautilus: mgr/zabbix: encode string for Python 3 compatibility

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #30006 from smithfarm/wip-40043-nautilus
Yuri Weinstein [Sat, 16 Nov 2019 15:54:43 +0000 (07:54 -0800)]
Merge pull request #30006 from smithfarm/wip-40043-nautilus

nautilus: mgr/zabbix: Fix typo in key name for PGs in backfill_wait state

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
5 years agoMerge pull request #29949 from smithfarm/wip-41282-nautilus
Yuri Weinstein [Sat, 16 Nov 2019 15:52:47 +0000 (07:52 -0800)]
Merge pull request #29949 from smithfarm/wip-41282-nautilus

nautilus: bluestore: tool to check fragmentation

5 years agoMerge pull request #30046 from smithfarm/wip-40270-nautilus
Yuri Weinstein [Sat, 16 Nov 2019 15:51:46 +0000 (07:51 -0800)]
Merge pull request #30046 from smithfarm/wip-40270-nautilus

nautilus: build/ops: make patch build dependency explicit

5 years agoMerge pull request #30089 from tchaikov/wip-nautilus-gcc-8
Yuri Weinstein [Sat, 16 Nov 2019 15:50:55 +0000 (07:50 -0800)]
Merge pull request #30089 from tchaikov/wip-nautilus-gcc-8

nautilus: build/ops: use gcc-8

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge PR #30008 into nautilus
Sage Weil [Fri, 15 Nov 2019 23:17:07 +0000 (17:17 -0600)]
Merge PR #30008 into nautilus

* refs/pull/30008/head:
mgr/pg_autoscaler: fix race with pool deletion

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
5 years agoMerge PR #30851 into nautilus
Sage Weil [Fri, 15 Nov 2019 23:16:43 +0000 (17:16 -0600)]
Merge PR #30851 into nautilus

* refs/pull/30851/head:
doc/mgr/crash: document missing commands, options
qa/suites/rados/singleton/all/test-crash: whitelist RECENT_CRASH
qa/suites/rados/mgr/tasks/insights: whitelist RECENT_CRASH
qa/tasks/mgr/test_insights: crash module now rejects bad crash reports
mgr/crash: don't make these methods static
mgr/BaseMgrModule: handle unicode health detail strings
mgr/crash: verify timestamp is valid
qa/suites/mgr: whitelist RECENT_CRASH
mgr/crash: remove unused var
mgr/crash: remove unused import 'six'
qa/workunits/rados/test_crash: health check
mgr/crash: improve validation on post
mgr/crash: automatically prune old crashes after a year
mgr/crash: raise RECENT_CRASH warning for recent (new) crashes
mgr/crash: add 'crash ls-new'
mgr/crash: add option and serve infra
mgr/crash: keep copy of crashes in memory
mgr/pg_autoscaler: adjust style to match built-in tables
mgr/crash: make 'crash ls' a nice table with a NEW column
mgr/crash: nicely format 'crash info' output
mgr/crash: add 'crash archive <id>', 'crash archive-all' commands

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge PR #30849 into nautilus
Sage Weil [Fri, 15 Nov 2019 23:16:30 +0000 (17:16 -0600)]
Merge PR #30849 into nautilus

* refs/pull/30849/head:
mgr/dashboard: fix mgr module API tests
qa/tasks/mgr/dashboard/test_mgr_module: remove enable/disable test from MgrModuleTelemetryTest
qa/tasks/mgr/dashboard/test_mgr_module: sync w/ telemetry
mgr/dashboard/qa: add more fields to report
Merge branch 'nautilus' into wip-device-telemetry-nautilus
PendingReleaseNotes: fix typo
PendingReleaseNotes: remove kludge
mgr/telemetry: add stats about crush map
mgr/telemetry: add rgw metadata
mgr/telemetry: include fs size (files, bytes, snaps)
mds: report r{files,bytes,snaps} via perfcounters
mgr/telemetry: mds cache stats
mgr/telemetry: add some rbd metadata
mgr/telemetry: note whether osd cluster_network is in use
mgr/telemetry: add host counts
mgr/telemetry: add more pool metadata
mgr/telemetry: remove crush rule name
mgr/telemetry: include min_mon_release and msgr v1 vs v2 addr count
mgr/telemetry: add CephFS metadata
mgr/telemetry: include balancer info (active=true/false, mode)
mgr/telemetry: include per-pool pg_autoscale info
mgr/telemetry: dict.pop() errs on nonexistent key
mgr/telemetry: send device telemetry via per-host POST to device endpoint
mgr/telemetry: fix remote into crash do_ls()
mgr/telemetry: clear the event after being awaken by it
mgr/telemetry: bump content revision and add a release note
telemetry/server: add device report endpoint
mgr/telemetry: include device telemetry
mgr/telemetry: salt osd ids too
mgr/telemetry: obscure entity_name with a salt
mgr/telemetry: force re-opt-in if the report contents change
mgr/telemetry: less noise in the log
mgr/telemetry: wake up serve on config change
mgr/telemetry: track telemetry report revisions
qa/tasks/mgr/dashboard/test_mgr_module: adjust expected schema
mgr/telemetry: separate out cluster config vs running daemons
mgr/telemetry: include any config options that are customized
mgr/telemetry: specify license when opting in
doc/mgr/telemetry: update
mgr/telemetry: move contact info to an 'ident' channel
mgr/telemetry: accept channel list to 'telemetry show'
mgr/telemetry: always generate new report for 'telemetry show'
mgr/telemetry: add 'device' channel and call out to devicehealth module
mgr/telemetry: add telemetry channel 'device'
mgr/telemetry: add separate channels
mgr/devicehealth: pull out MAX_SAMPLES

Reviewed-by: Wido den Hollander <wido@42on.com>
5 years agoMerge pull request #31605 from rhcs-dashboard/42795-fixtypo
Nathan Cutler [Fri, 15 Nov 2019 22:47:24 +0000 (23:47 +0100)]
Merge pull request #31605 from rhcs-dashboard/42795-fixtypo

nautilus: common: fix typo in rgw_user_max_buckets option long description.

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
5 years agoMerge pull request #31334 from LongDuncan/nautilus
Yuri Weinstein [Fri, 15 Nov 2019 22:41:10 +0000 (14:41 -0800)]
Merge pull request #31334 from LongDuncan/nautilus

nautilus: mgr/restful: requests api adds support multiple commands

Reviewed-by: Boris Ranto <branto@redhat.com>
5 years agoMerge pull request #31304 from smithfarm/wip-42545-nautilus
Yuri Weinstein [Fri, 15 Nov 2019 22:40:30 +0000 (14:40 -0800)]
Merge pull request #31304 from smithfarm/wip-42545-nautilus

nautilus: qa/tasks/cbt: run stop-all.sh while shutting down

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #31040 from smithfarm/wip-41495-nautilus
Yuri Weinstein [Fri, 15 Nov 2019 22:39:58 +0000 (14:39 -0800)]
Merge pull request #31040 from smithfarm/wip-41495-nautilus

nautilus: tests: add debugging failed osd-release setting

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
5 years agoMerge pull request #31019 from ifed01/wip-42041-nautilus
Yuri Weinstein [Fri, 15 Nov 2019 22:39:31 +0000 (14:39 -0800)]
Merge pull request #31019 from ifed01/wip-42041-nautilus

nautilus: core: os/bluestore: fix objectstore_blackhole read-after-write

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
5 years agoMerge pull request #30983 from tchaikov/wip-nautilus-42363
Yuri Weinstein [Fri, 15 Nov 2019 22:39:02 +0000 (14:39 -0800)]
Merge pull request #30983 from tchaikov/wip-nautilus-42363

nautilus: build/ops: python3-cephfs should provide python36-cephfs

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
5 years agoMerge pull request #31097 from smithfarm/wip-42395-nautilus
Yuri Weinstein [Fri, 15 Nov 2019 22:38:21 +0000 (14:38 -0800)]
Merge pull request #31097 from smithfarm/wip-42395-nautilus

nautilus: common/ceph_context: avoid unnecessary wait during service thread shutdown

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
5 years agoMerge pull request #29592 from penglaiyxy/wip-simple-messenger
Yuri Weinstein [Fri, 15 Nov 2019 22:35:06 +0000 (14:35 -0800)]
Merge pull request #29592 from penglaiyxy/wip-simple-messenger

nautilus: msg/simple: reset in_seq_acked to zero when session is reset

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agomgr/dashboard: fix mgr module API tests 30849/head
alfonsomthd [Tue, 13 Aug 2019 10:15:38 +0000 (12:15 +0200)]
mgr/dashboard: fix mgr module API tests

Signed-off-by: alfonsomthd <almartin@redhat.com>
(cherry picked from commit 6e6711a1e217042390b379f98c0ec064ab4e2702)

5 years agoqa/tasks/mgr/dashboard/test_mgr_module: remove enable/disable test from MgrModuleTele...
Kefu Chai [Tue, 13 Aug 2019 01:54:24 +0000 (09:54 +0800)]
qa/tasks/mgr/dashboard/test_mgr_module: remove enable/disable test from MgrModuleTelemetryTest

telemetry is always enabled since 2d62d71cd46d791294b3803e034c0995fef08b33

Fixes: https://tracker.ceph.com/issues/41186
Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit cc3ae85b05b759fd6ac955d2e798d5fe3a109294)

5 years agoqa/tasks/mgr/dashboard/test_mgr_module: sync w/ telemetry
Kefu Chai [Wed, 7 Aug 2019 07:23:19 +0000 (15:23 +0800)]
qa/tasks/mgr/dashboard/test_mgr_module: sync w/ telemetry

* use primitive types instead of `JLeaf(the_type)` as they are
  equivalent in this context
* remove fields which are added only if certain channels are
  activated.
* allow unknown fields, as we are including various stuff
  in the report, for instance, osdmap, usage, crash info, etc.

Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit 3303116f5681f317dee53988e1de9d840d250884)

5 years agomgr/dashboard/qa: add more fields to report
Kefu Chai [Fri, 26 Jul 2019 17:50:30 +0000 (01:50 +0800)]
mgr/dashboard/qa: add more fields to report

to be in sync with #28847

Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit d6170e70b6d1d634be6af5540d85572a9c425d0c)

5 years agomgr: Improve balancer module status 31682/head
David Zafman [Thu, 24 Oct 2019 00:00:14 +0000 (17:00 -0700)]
mgr: Improve balancer module status

Add balancer status fields so that slow optimizations can be detected

Signed-off-by: David Zafman <dzafman@redhat.com>
(cherry picked from commit f04c505b9dc128bdfbcca49d82f8aac4abf8b56f)

5 years agotest: Test balancer module commands
David Zafman [Wed, 23 Oct 2019 23:38:48 +0000 (16:38 -0700)]
test: Test balancer module commands

Signed-off-by: David Zafman <dzafman@redhat.com>
(cherry picked from commit 3a0e2c8ff1cce44bf44b139572f4d1bd9bbfb766)

5 years agomgr: Release GIL before calling OSDMap::calc_pg_upmaps()
David Zafman [Tue, 22 Oct 2019 22:24:05 +0000 (15:24 -0700)]
mgr: Release GIL before calling OSDMap::calc_pg_upmaps()

Prevent optimize and execute commands from running with active balancer

Fixes: https://tracker.ceph.com/issues/42432
Signed-off-by: David Zafman <dzafman@redhat.com>
(cherry picked from commit e2a35e8c8e9f381a635ad0ca01326a2c512590a9)

5 years agoqa/mgr/balancer: Add cram based test for altering target_max_misplaced_ratio setting
Shyukri Shyukriev [Thu, 26 Sep 2019 08:24:08 +0000 (11:24 +0300)]
qa/mgr/balancer: Add cram based test for altering target_max_misplaced_ratio setting

Signed-off-by: Shyukri Shyukriev <shshyukriev@suse.com>
(cherry picked from commit 37a45deb5bb435afd056a05d09cf691bb36f2086)

5 years agorgw: use explicit to_string() overload for boost::string_ref 31650/head
Casey Bodley [Tue, 7 May 2019 18:08:25 +0000 (14:08 -0400)]
rgw: use explicit to_string() overload for boost::string_ref

Fixes: http://tracker.ceph.com/issues/39611
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 04c326795d2afe63c679f2542565763fee6acc09)

Conflicts:
    src/rgw/rgw_json_enc.cc
Signed-off-by: Ulrich Weigand <ulrich.weigand@de.ibm.com>
5 years agodoc/mgr/crash: document missing commands, options 30851/head
Sage Weil [Wed, 24 Jul 2019 17:57:18 +0000 (12:57 -0500)]
doc/mgr/crash: document missing commands, options

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 1ea7570bb1b637a436c209dcc4559e206a20ad42)

5 years agoqa/suites/rados/singleton/all/test-crash: whitelist RECENT_CRASH
Sage Weil [Mon, 22 Jul 2019 22:13:30 +0000 (17:13 -0500)]
qa/suites/rados/singleton/all/test-crash: whitelist RECENT_CRASH

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 9257175f086e7ca36189badbac192522856dbcce)

5 years agoqa/suites/rados/mgr/tasks/insights: whitelist RECENT_CRASH
Sage Weil [Fri, 19 Jul 2019 19:10:22 +0000 (14:10 -0500)]
qa/suites/rados/mgr/tasks/insights: whitelist RECENT_CRASH

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 209ce4ec6889a0a012fb862238c454738adb4ff2)

5 years agoqa/tasks/mgr/test_insights: crash module now rejects bad crash reports
Sage Weil [Thu, 18 Jul 2019 14:31:09 +0000 (09:31 -0500)]
qa/tasks/mgr/test_insights: crash module now rejects bad crash reports

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 3bddcc5ddf1a96413a9efa439b167a471eee362d)

5 years agomgr/crash: don't make these methods static
Sage Weil [Wed, 17 Jul 2019 22:00:57 +0000 (17:00 -0500)]
mgr/crash: don't make these methods static

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 32a4b510aa93664f2beaadecedc9ce6e8e87b931)

5 years agomgr/BaseMgrModule: handle unicode health detail strings
Sage Weil [Wed, 17 Jul 2019 16:48:50 +0000 (11:48 -0500)]
mgr/BaseMgrModule: handle unicode health detail strings

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 52875c6cb2c615d1070a456d0e1dcc708d5fd5db)

5 years agomgr/crash: verify timestamp is valid
Sage Weil [Wed, 17 Jul 2019 16:11:01 +0000 (11:11 -0500)]
mgr/crash: verify timestamp is valid

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 277d974b4a74fa40d0305bdc5afc66e2f2186576)

5 years agoqa/suites/mgr: whitelist RECENT_CRASH
Sage Weil [Wed, 17 Jul 2019 15:55:33 +0000 (10:55 -0500)]
qa/suites/mgr: whitelist RECENT_CRASH

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit e2ff58ba166efb42836466c745a4b9d136810a00)

5 years agomgr/crash: remove unused var
Sage Weil [Wed, 17 Jul 2019 14:36:11 +0000 (09:36 -0500)]
mgr/crash: remove unused var

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 37a8f2d66ac8330ca72d7a13dd2864529a87edbb)

5 years agomgr/crash: remove unused import 'six'
Sage Weil [Wed, 17 Jul 2019 14:35:57 +0000 (09:35 -0500)]
mgr/crash: remove unused import 'six'

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 5b2cbb3a10f8011fbc3d5245801009557404ddc5)

5 years agoqa/workunits/rados/test_crash: health check
Sage Weil [Tue, 16 Jul 2019 14:26:21 +0000 (09:26 -0500)]
qa/workunits/rados/test_crash: health check

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit f6e0894902a6646e73e3db123d48fe2fac9570ea)

5 years agomgr/crash: improve validation on post
Sage Weil [Tue, 16 Jul 2019 14:18:50 +0000 (09:18 -0500)]
mgr/crash: improve validation on post

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 422871d63ea8069453c435bd5559bea68f942eaf)

5 years agomgr/crash: automatically prune old crashes after a year
Sage Weil [Sun, 14 Jul 2019 16:31:56 +0000 (11:31 -0500)]
mgr/crash: automatically prune old crashes after a year

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit b2e20858f42e3775adda4bd054fc8fa15e205453)

5 years agomgr/crash: raise RECENT_CRASH warning for recent (new) crashes
Sage Weil [Thu, 10 Oct 2019 17:46:36 +0000 (12:46 -0500)]
mgr/crash: raise RECENT_CRASH warning for recent (new) crashes

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit c885ee7f0c9c7c232fda81bfd6f9eca0e182ee3d)

# Conflicts:
# doc/rados/operations/health-checks.rst
- TELEMETRY_CHANGED alert order in doc

5 years agomgr/crash: add 'crash ls-new'
Sage Weil [Sun, 14 Jul 2019 16:26:41 +0000 (11:26 -0500)]
mgr/crash: add 'crash ls-new'

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit bebb1c31006ff3cba67831879b34699cf111f945)

5 years agomgr/crash: add option and serve infra
Sage Weil [Sat, 13 Jul 2019 16:06:41 +0000 (11:06 -0500)]
mgr/crash: add option and serve infra

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 7cbaa5ac563bf0be7dd2227ef8a1ae7d0ae20143)

5 years agomgr/crash: keep copy of crashes in memory
Sage Weil [Sat, 13 Jul 2019 15:39:41 +0000 (10:39 -0500)]
mgr/crash: keep copy of crashes in memory

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 6ae4c42bae80c732391e200d56f512d4ea639504)

5 years agomgr/pg_autoscaler: adjust style to match built-in tables
Sage Weil [Sat, 13 Jul 2019 13:35:01 +0000 (08:35 -0500)]
mgr/pg_autoscaler: adjust style to match built-in tables

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 44a99f2f7692e2ab2a74f8a0df983a81a3dea299)

5 years agomgr/crash: make 'crash ls' a nice table with a NEW column
Sage Weil [Fri, 12 Jul 2019 21:34:37 +0000 (16:34 -0500)]
mgr/crash: make 'crash ls' a nice table with a NEW column

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit c691f2f8763a9db081a0b61294c5eedf4e9c2cee)

5 years agomgr/crash: nicely format 'crash info' output
Sage Weil [Fri, 12 Jul 2019 21:23:17 +0000 (16:23 -0500)]
mgr/crash: nicely format 'crash info' output

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 35f15f87cb936705f77ed1ca1ecaad796e021e7a)

5 years agomgr/crash: add 'crash archive <id>', 'crash archive-all' commands
Sage Weil [Fri, 12 Jul 2019 21:23:03 +0000 (16:23 -0500)]
mgr/crash: add 'crash archive <id>', 'crash archive-all' commands

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 31f650cb2049995faa03288e22591d967fd8a14d)

5 years agoMerge branch 'nautilus' into wip-device-telemetry-nautilus
Sage Weil [Fri, 15 Nov 2019 14:23:53 +0000 (08:23 -0600)]
Merge branch 'nautilus' into wip-device-telemetry-nautilus

5 years agoMerge PR #30755 into nautilus
Sage Weil [Fri, 15 Nov 2019 13:11:57 +0000 (07:11 -0600)]
Merge PR #30755 into nautilus

* refs/pull/30755/head:
os/bluestore: fix improper setting of STATE_KV_SUBMITTED.

5 years agoMerge PR #30773 into nautilus
Sage Weil [Fri, 15 Nov 2019 13:11:33 +0000 (07:11 -0600)]
Merge PR #30773 into nautilus

* refs/pull/30773/head:
mgr/BaseMgrStandbyModule: drop GIL in ceph_get_module_option()

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge PR #31099 into nautilus
Sage Weil [Fri, 15 Nov 2019 13:11:05 +0000 (07:11 -0600)]
Merge PR #31099 into nautilus

* refs/pull/31099/head:
auth/cephx/CephxClientHandler: handle decode errors
auth/cephx/CephxProtocol: handle decode errors in CephXTicketHandler::verify_service_ticket_reply
auth/cephx/CephxServiceHandler: handle decode errors

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
5 years agoMerge PR #31100 into nautilus
Sage Weil [Fri, 15 Nov 2019 13:10:37 +0000 (07:10 -0600)]
Merge PR #31100 into nautilus

* refs/pull/31100/head:
mgr/pg_autoscaler: use 'stored' for pool_logical_used

Reviewed-by: Sage Weil <sage@redhat.com>
5 years agoMerge PR #31411 into nautilus
Sage Weil [Fri, 15 Nov 2019 13:10:15 +0000 (07:10 -0600)]
Merge PR #31411 into nautilus

* refs/pull/31411/head:
mgr/ActivePyModules: behave if a module queries a devid that does not exist

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
5 years agoMerge PR #31446 into nautilus
Sage Weil [Fri, 15 Nov 2019 13:09:55 +0000 (07:09 -0600)]
Merge PR #31446 into nautilus

* refs/pull/31446/head:
mgr/devicehealth: do not scrape mon devices

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge PR #31612 into nautilus
Sage Weil [Fri, 15 Nov 2019 13:09:38 +0000 (07:09 -0600)]
Merge PR #31612 into nautilus

* refs/pull/31612/head:
Revert "rocksdb: enable rocksdb_rmrange=true by default"

Reviewed-by: Mark Nelson <mnelson@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Igor Fedotov <ifedotov@suse.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge PR #31644 into nautilus
Sage Weil [Fri, 15 Nov 2019 13:09:20 +0000 (07:09 -0600)]
Merge PR #31644 into nautilus

* refs/pull/31644/head:
os/bluestore: consolidate extents from the same device only

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoceph-objectstore-tool: return 0 if incmap is sane 30740/head
Kefu Chai [Fri, 16 Aug 2019 11:09:24 +0000 (19:09 +0800)]
ceph-objectstore-tool: return 0 if incmap is sane

this change addresses the regression introduced by 2e2414b3

Fixes: https://tracker.ceph.com/issues/41177
Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit d03f397544187d7de21d4849f58ce51baafcff8b)

5 years agoMerge pull request #31565 from tspmelo/wip-42747-nautilus
Lenz Grimmer [Fri, 15 Nov 2019 08:37:46 +0000 (08:37 +0000)]
Merge pull request #31565 from tspmelo/wip-42747-nautilus

nautilus: mgr/dashboard: Improve position of MDS chart tooltip

Reviewed-by: Laura Paduano <lpaduano@suse.com>
5 years agoMerge PR #30827 into nautilus
Patrick Donnelly [Thu, 14 Nov 2019 17:37:22 +0000 (09:37 -0800)]
Merge PR #30827 into nautilus

* refs/pull/30827/head:
qa/tasks: tests for ls
mgr/volumes: list FS subvolumes, subvolume groups and their snapshots

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge PR #31076 into nautilus
Patrick Donnelly [Thu, 14 Nov 2019 17:34:46 +0000 (09:34 -0800)]
Merge PR #31076 into nautilus

* refs/pull/31076/head:
mgr/volumes: fix incorrect snapshot path creation

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge PR #30768 into nautilus
Patrick Donnelly [Thu, 14 Nov 2019 17:30:24 +0000 (09:30 -0800)]
Merge PR #30768 into nautilus

* refs/pull/30768/head:
doc: protection for 'fs volume rm' command
doc: add ceph fs volumes and subvolumes documentation
qa/tasks: add/update tests for --yes-i-really-mean-it
mgr/volumes: protection for 'fs volume rm' command

Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge pull request #31641 from liewegas/fix-42783-nautilus
Nathan Cutler [Thu, 14 Nov 2019 17:15:09 +0000 (18:15 +0100)]
Merge pull request #31641 from liewegas/fix-42783-nautilus

nautilus: qa/tasks/ceph.conf.template: increase mon tell retries

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
5 years agoRevert "rocksdb: enable rocksdb_rmrange=true by default" 31612/head
Neha Ojha [Wed, 13 Nov 2019 15:33:01 +0000 (07:33 -0800)]
Revert "rocksdb: enable rocksdb_rmrange=true by default"

This reverts commit 29bafe57503066c962cc692a66178b083fd43343.

We have observed drastically poor performance when rocksdb_rmrange is
used for every key deletion.

This change is specific to nautilus, since we are experimenting with rocksdb_rmrange
along with https://github.com/ceph/ceph/pull/31442 in master.

Signed-off-by: Neha Ojha <nojha@redhat.com>
5 years agoos/bluestore: consolidate extents from the same device only 31644/head
Igor Fedotov [Wed, 13 Nov 2019 19:09:53 +0000 (22:09 +0300)]
os/bluestore: consolidate extents from the same device only

Presumably Fixes: https://tracker.ceph.com/issues/42223

Signed-off-by: Igor Fedotov <ifedotov@suse.com>
(cherry picked from commit 20a90698a262905e97bae771b5950af04c00c67a)

5 years agoqa/tasks/ceph.conf.template: increase mon tell retries 31641/head
Sage Weil [Thu, 14 Nov 2019 16:14:11 +0000 (10:14 -0600)]
qa/tasks/ceph.conf.template: increase mon tell retries

With lots of ms failure injection we see these failing in QA.  Bump this
up as a kludge for nautilus *only*; the master tell implementation no
longer sucks.

Fixes: https://tracker.ceph.com/issues/42783
Signed-off-by: Sage Weil <sage@redhat.com>
5 years agocmake: Allow cephfs and ceph-mds to be build when building on FreeBSD 31011/head
Willem Jan Withagen [Fri, 20 Sep 2019 14:02:23 +0000 (16:02 +0200)]
cmake: Allow cephfs and ceph-mds to be build when building on FreeBSD

on FreeBSD keyutil absence prevents building KRBD and mount.
But on FreeBSD icephfs, ceph-fuse and ceph-mds do work, so we need
ceph-mds to be build.

Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
(cherry picked from commit f698f3c3eef4034799005b8816de5d468ef9fe18)

Conflicts:
CMakeLists.txt
- nautilus does not have "if (HAVE_LIBTCMALLOC AND TCMALLOC_VERSION_STRING
  VERSION_LESS 2.6.2)" clause, and c028de2f938bc9b8c0193b9219fb64e1416037cf
  refactored HAVE_GENL out of master
        src/mount/CMakeLists.txt
- CAPNG was introduced in master: omitted the changes

5 years agoMerge pull request #31248 from smithfarm/wip-42562-nautilus
Nathan Cutler [Thu, 14 Nov 2019 15:46:50 +0000 (16:46 +0100)]
Merge pull request #31248 from smithfarm/wip-42562-nautilus

nautilus: tests: enable dashboard tests to be run with "--suite rados/dashboard"

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
5 years agoqa: enable dashboard tests to be run with "--suite rados/dashboard" 31248/head
Nathan Cutler [Tue, 17 Sep 2019 16:11:11 +0000 (18:11 +0200)]
qa: enable dashboard tests to be run with "--suite rados/dashboard"

This moves dashboard.yaml from rados/mgr into a new, separate rados/dashboard
suite. The common elements it uses are moved from rados/mgr into qa/ and
replaced with symlinks.

Fixes: https://tracker.ceph.com/issues/41820
Signed-off-by: Nathan Cutler <ncutler@suse.com>
(cherry picked from commit 493ee6d78ff90c4c3d81f5c7edac6d06fbe3d295)

5 years agoMerge pull request #31628 from yuvalif/nautilus-backport-of-42497
Nathan Cutler [Thu, 14 Nov 2019 15:24:43 +0000 (16:24 +0100)]
Merge pull request #31628 from yuvalif/nautilus-backport-of-42497

nautilus: rgw/amqp: remove flaky amqp test

Reviewed-by: Nathan Cutler <ncutler@suse.com>
5 years agorgw/amqp: remove a test that requires syncronization 31628/head
Yuval Lifshitz [Sun, 10 Nov 2019 09:57:57 +0000 (11:57 +0200)]
rgw/amqp: remove a test that requires syncronization
betwen the amqp manager internal thread and the test itself
amqp reconnect should be tested by system test instead

Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
(cherry picked from commit 10a27ef809c4e3f745f2726a5f0be8d8579a5979)
Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
5 years agoMerge pull request #30899 from smithfarm/wip-42126-nautilus
Yuri Weinstein [Wed, 13 Nov 2019 20:30:46 +0000 (12:30 -0800)]
Merge pull request #30899 from smithfarm/wip-42126-nautilus

nautilus: core/osd,crush: "do not trust partially simplified pg_upmap_item" and "remove invalid upmap items"

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #31482 from callithea/wip-42682-nautilus
Yuri Weinstein [Wed, 13 Nov 2019 20:28:54 +0000 (12:28 -0800)]
Merge pull request #31482 from callithea/wip-42682-nautilus

nautilus: mgr/{dashboard,prometheus}: return FQDN instead of '0.0.0.0'

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Jan Fajerski <jfajerski@suse.com>
Reviewed-by: Patrick Seidensal <pseidensal@suse.com>
5 years agoMerge pull request #30696 from uweigand/nautilus-z-build
Yuri Weinstein [Wed, 13 Nov 2019 20:26:22 +0000 (12:26 -0800)]
Merge pull request #30696 from uweigand/nautilus-z-build

nautilus: cmake,rgw: IBM Z build fixes

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #30419 from ceph/wip-41238-nautilus
Yuri Weinstein [Wed, 13 Nov 2019 20:25:24 +0000 (12:25 -0800)]
Merge pull request #30419 from ceph/wip-41238-nautilus

nautilus: mon/OSDMonitor: Use generic priority cache tuner for mon caches

5 years agoMerge pull request #29961 from smithfarm/wip-41130-nautilus
Yuri Weinstein [Wed, 13 Nov 2019 20:24:38 +0000 (12:24 -0800)]
Merge pull request #29961 from smithfarm/wip-41130-nautilus

nautilus: rgw: Swift metadata dropped after S3 bucket versioning enabled

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #29960 from smithfarm/wip-41125-nautilus
Yuri Weinstein [Wed, 13 Nov 2019 20:24:11 +0000 (12:24 -0800)]
Merge pull request #29960 from smithfarm/wip-41125-nautilus

nautilus: rgw: returns one byte more data than the requested range from the SLO object

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #29959 from smithfarm/wip-41119-nautilus
Yuri Weinstein [Wed, 13 Nov 2019 20:23:22 +0000 (12:23 -0800)]
Merge pull request #29959 from smithfarm/wip-41119-nautilus

nautilus: rgw: rgw-admin: search for user by access key

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #29956 from smithfarm/wip-41109-nautilus
Yuri Weinstein [Wed, 13 Nov 2019 20:22:21 +0000 (12:22 -0800)]
Merge pull request #29956 from smithfarm/wip-41109-nautilus

nautilus: rgw: fix drain handles error when deleting bucket with bypass-gc option

Reviewed-by: Casey Bodley <cbodley@redhat.com>