]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
5 years agoMerge pull request #30261 from smithfarm/wip-41724-nautilus
Yuri Weinstein [Sat, 16 Nov 2019 15:59:33 +0000 (07:59 -0800)]
Merge pull request #30261 from smithfarm/wip-41724-nautilus

nautilus: build/ops: fix build fail related to PYTHON_EXECUTABLE variable

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #30215 from sebastian-philipp/nautilus-k8sevents
Yuri Weinstein [Sat, 16 Nov 2019 15:58:39 +0000 (07:58 -0800)]
Merge pull request #30215 from sebastian-philipp/nautilus-k8sevents

nautilus: mgr/k8sevents: Initial ceph -> k8s events integration

Reviewed-by: Boris Ranto <branto@redhat.com>
Reviewed-by: Yuri Weinstein <yweinste@redhat.com>
Reviewed-by: Paul Cuzner <pcuzner@redhat.com>
5 years agoMerge pull request #30016 from smithfarm/wip-41509-nautilus
Yuri Weinstein [Sat, 16 Nov 2019 15:56:17 +0000 (07:56 -0800)]
Merge pull request #30016 from smithfarm/wip-41509-nautilus

nautilus: mgr/zabbix: encode string for Python 3 compatibility

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #30006 from smithfarm/wip-40043-nautilus
Yuri Weinstein [Sat, 16 Nov 2019 15:54:43 +0000 (07:54 -0800)]
Merge pull request #30006 from smithfarm/wip-40043-nautilus

nautilus: mgr/zabbix: Fix typo in key name for PGs in backfill_wait state

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
5 years agoMerge pull request #29949 from smithfarm/wip-41282-nautilus
Yuri Weinstein [Sat, 16 Nov 2019 15:52:47 +0000 (07:52 -0800)]
Merge pull request #29949 from smithfarm/wip-41282-nautilus

nautilus: bluestore: tool to check fragmentation

5 years agoMerge pull request #30046 from smithfarm/wip-40270-nautilus
Yuri Weinstein [Sat, 16 Nov 2019 15:51:46 +0000 (07:51 -0800)]
Merge pull request #30046 from smithfarm/wip-40270-nautilus

nautilus: build/ops: make patch build dependency explicit

5 years agoMerge pull request #30089 from tchaikov/wip-nautilus-gcc-8
Yuri Weinstein [Sat, 16 Nov 2019 15:50:55 +0000 (07:50 -0800)]
Merge pull request #30089 from tchaikov/wip-nautilus-gcc-8

nautilus: build/ops: use gcc-8

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge PR #30008 into nautilus
Sage Weil [Fri, 15 Nov 2019 23:17:07 +0000 (17:17 -0600)]
Merge PR #30008 into nautilus

* refs/pull/30008/head:
mgr/pg_autoscaler: fix race with pool deletion

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
5 years agoMerge PR #30851 into nautilus
Sage Weil [Fri, 15 Nov 2019 23:16:43 +0000 (17:16 -0600)]
Merge PR #30851 into nautilus

* refs/pull/30851/head:
doc/mgr/crash: document missing commands, options
qa/suites/rados/singleton/all/test-crash: whitelist RECENT_CRASH
qa/suites/rados/mgr/tasks/insights: whitelist RECENT_CRASH
qa/tasks/mgr/test_insights: crash module now rejects bad crash reports
mgr/crash: don't make these methods static
mgr/BaseMgrModule: handle unicode health detail strings
mgr/crash: verify timestamp is valid
qa/suites/mgr: whitelist RECENT_CRASH
mgr/crash: remove unused var
mgr/crash: remove unused import 'six'
qa/workunits/rados/test_crash: health check
mgr/crash: improve validation on post
mgr/crash: automatically prune old crashes after a year
mgr/crash: raise RECENT_CRASH warning for recent (new) crashes
mgr/crash: add 'crash ls-new'
mgr/crash: add option and serve infra
mgr/crash: keep copy of crashes in memory
mgr/pg_autoscaler: adjust style to match built-in tables
mgr/crash: make 'crash ls' a nice table with a NEW column
mgr/crash: nicely format 'crash info' output
mgr/crash: add 'crash archive <id>', 'crash archive-all' commands

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge PR #30849 into nautilus
Sage Weil [Fri, 15 Nov 2019 23:16:30 +0000 (17:16 -0600)]
Merge PR #30849 into nautilus

* refs/pull/30849/head:
mgr/dashboard: fix mgr module API tests
qa/tasks/mgr/dashboard/test_mgr_module: remove enable/disable test from MgrModuleTelemetryTest
qa/tasks/mgr/dashboard/test_mgr_module: sync w/ telemetry
mgr/dashboard/qa: add more fields to report
Merge branch 'nautilus' into wip-device-telemetry-nautilus
PendingReleaseNotes: fix typo
PendingReleaseNotes: remove kludge
mgr/telemetry: add stats about crush map
mgr/telemetry: add rgw metadata
mgr/telemetry: include fs size (files, bytes, snaps)
mds: report r{files,bytes,snaps} via perfcounters
mgr/telemetry: mds cache stats
mgr/telemetry: add some rbd metadata
mgr/telemetry: note whether osd cluster_network is in use
mgr/telemetry: add host counts
mgr/telemetry: add more pool metadata
mgr/telemetry: remove crush rule name
mgr/telemetry: include min_mon_release and msgr v1 vs v2 addr count
mgr/telemetry: add CephFS metadata
mgr/telemetry: include balancer info (active=true/false, mode)
mgr/telemetry: include per-pool pg_autoscale info
mgr/telemetry: dict.pop() errs on nonexistent key
mgr/telemetry: send device telemetry via per-host POST to device endpoint
mgr/telemetry: fix remote into crash do_ls()
mgr/telemetry: clear the event after being awaken by it
mgr/telemetry: bump content revision and add a release note
telemetry/server: add device report endpoint
mgr/telemetry: include device telemetry
mgr/telemetry: salt osd ids too
mgr/telemetry: obscure entity_name with a salt
mgr/telemetry: force re-opt-in if the report contents change
mgr/telemetry: less noise in the log
mgr/telemetry: wake up serve on config change
mgr/telemetry: track telemetry report revisions
qa/tasks/mgr/dashboard/test_mgr_module: adjust expected schema
mgr/telemetry: separate out cluster config vs running daemons
mgr/telemetry: include any config options that are customized
mgr/telemetry: specify license when opting in
doc/mgr/telemetry: update
mgr/telemetry: move contact info to an 'ident' channel
mgr/telemetry: accept channel list to 'telemetry show'
mgr/telemetry: always generate new report for 'telemetry show'
mgr/telemetry: add 'device' channel and call out to devicehealth module
mgr/telemetry: add telemetry channel 'device'
mgr/telemetry: add separate channels
mgr/devicehealth: pull out MAX_SAMPLES

Reviewed-by: Wido den Hollander <wido@42on.com>
5 years agoMerge pull request #31605 from rhcs-dashboard/42795-fixtypo
Nathan Cutler [Fri, 15 Nov 2019 22:47:24 +0000 (23:47 +0100)]
Merge pull request #31605 from rhcs-dashboard/42795-fixtypo

nautilus: common: fix typo in rgw_user_max_buckets option long description.

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
5 years agoMerge pull request #31334 from LongDuncan/nautilus
Yuri Weinstein [Fri, 15 Nov 2019 22:41:10 +0000 (14:41 -0800)]
Merge pull request #31334 from LongDuncan/nautilus

nautilus: mgr/restful: requests api adds support multiple commands

Reviewed-by: Boris Ranto <branto@redhat.com>
5 years agoMerge pull request #31304 from smithfarm/wip-42545-nautilus
Yuri Weinstein [Fri, 15 Nov 2019 22:40:30 +0000 (14:40 -0800)]
Merge pull request #31304 from smithfarm/wip-42545-nautilus

nautilus: qa/tasks/cbt: run stop-all.sh while shutting down

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #31040 from smithfarm/wip-41495-nautilus
Yuri Weinstein [Fri, 15 Nov 2019 22:39:58 +0000 (14:39 -0800)]
Merge pull request #31040 from smithfarm/wip-41495-nautilus

nautilus: tests: add debugging failed osd-release setting

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
5 years agoMerge pull request #31019 from ifed01/wip-42041-nautilus
Yuri Weinstein [Fri, 15 Nov 2019 22:39:31 +0000 (14:39 -0800)]
Merge pull request #31019 from ifed01/wip-42041-nautilus

nautilus: core: os/bluestore: fix objectstore_blackhole read-after-write

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
5 years agoMerge pull request #30983 from tchaikov/wip-nautilus-42363
Yuri Weinstein [Fri, 15 Nov 2019 22:39:02 +0000 (14:39 -0800)]
Merge pull request #30983 from tchaikov/wip-nautilus-42363

nautilus: build/ops: python3-cephfs should provide python36-cephfs

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
5 years agoMerge pull request #31097 from smithfarm/wip-42395-nautilus
Yuri Weinstein [Fri, 15 Nov 2019 22:38:21 +0000 (14:38 -0800)]
Merge pull request #31097 from smithfarm/wip-42395-nautilus

nautilus: common/ceph_context: avoid unnecessary wait during service thread shutdown

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
5 years agoMerge pull request #29592 from penglaiyxy/wip-simple-messenger
Yuri Weinstein [Fri, 15 Nov 2019 22:35:06 +0000 (14:35 -0800)]
Merge pull request #29592 from penglaiyxy/wip-simple-messenger

nautilus: msg/simple: reset in_seq_acked to zero when session is reset

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agomgr/dashboard: fix mgr module API tests 30849/head
alfonsomthd [Tue, 13 Aug 2019 10:15:38 +0000 (12:15 +0200)]
mgr/dashboard: fix mgr module API tests

Signed-off-by: alfonsomthd <almartin@redhat.com>
(cherry picked from commit 6e6711a1e217042390b379f98c0ec064ab4e2702)

5 years agoqa/tasks/mgr/dashboard/test_mgr_module: remove enable/disable test from MgrModuleTele...
Kefu Chai [Tue, 13 Aug 2019 01:54:24 +0000 (09:54 +0800)]
qa/tasks/mgr/dashboard/test_mgr_module: remove enable/disable test from MgrModuleTelemetryTest

telemetry is always enabled since 2d62d71cd46d791294b3803e034c0995fef08b33

Fixes: https://tracker.ceph.com/issues/41186
Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit cc3ae85b05b759fd6ac955d2e798d5fe3a109294)

5 years agoqa/tasks/mgr/dashboard/test_mgr_module: sync w/ telemetry
Kefu Chai [Wed, 7 Aug 2019 07:23:19 +0000 (15:23 +0800)]
qa/tasks/mgr/dashboard/test_mgr_module: sync w/ telemetry

* use primitive types instead of `JLeaf(the_type)` as they are
  equivalent in this context
* remove fields which are added only if certain channels are
  activated.
* allow unknown fields, as we are including various stuff
  in the report, for instance, osdmap, usage, crash info, etc.

Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit 3303116f5681f317dee53988e1de9d840d250884)

5 years agomgr/dashboard/qa: add more fields to report
Kefu Chai [Fri, 26 Jul 2019 17:50:30 +0000 (01:50 +0800)]
mgr/dashboard/qa: add more fields to report

to be in sync with #28847

Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit d6170e70b6d1d634be6af5540d85572a9c425d0c)

5 years agodoc/mgr/crash: document missing commands, options 30851/head
Sage Weil [Wed, 24 Jul 2019 17:57:18 +0000 (12:57 -0500)]
doc/mgr/crash: document missing commands, options

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 1ea7570bb1b637a436c209dcc4559e206a20ad42)

5 years agoqa/suites/rados/singleton/all/test-crash: whitelist RECENT_CRASH
Sage Weil [Mon, 22 Jul 2019 22:13:30 +0000 (17:13 -0500)]
qa/suites/rados/singleton/all/test-crash: whitelist RECENT_CRASH

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 9257175f086e7ca36189badbac192522856dbcce)

5 years agoqa/suites/rados/mgr/tasks/insights: whitelist RECENT_CRASH
Sage Weil [Fri, 19 Jul 2019 19:10:22 +0000 (14:10 -0500)]
qa/suites/rados/mgr/tasks/insights: whitelist RECENT_CRASH

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 209ce4ec6889a0a012fb862238c454738adb4ff2)

5 years agoqa/tasks/mgr/test_insights: crash module now rejects bad crash reports
Sage Weil [Thu, 18 Jul 2019 14:31:09 +0000 (09:31 -0500)]
qa/tasks/mgr/test_insights: crash module now rejects bad crash reports

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 3bddcc5ddf1a96413a9efa439b167a471eee362d)

5 years agomgr/crash: don't make these methods static
Sage Weil [Wed, 17 Jul 2019 22:00:57 +0000 (17:00 -0500)]
mgr/crash: don't make these methods static

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 32a4b510aa93664f2beaadecedc9ce6e8e87b931)

5 years agomgr/BaseMgrModule: handle unicode health detail strings
Sage Weil [Wed, 17 Jul 2019 16:48:50 +0000 (11:48 -0500)]
mgr/BaseMgrModule: handle unicode health detail strings

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 52875c6cb2c615d1070a456d0e1dcc708d5fd5db)

5 years agomgr/crash: verify timestamp is valid
Sage Weil [Wed, 17 Jul 2019 16:11:01 +0000 (11:11 -0500)]
mgr/crash: verify timestamp is valid

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 277d974b4a74fa40d0305bdc5afc66e2f2186576)

5 years agoqa/suites/mgr: whitelist RECENT_CRASH
Sage Weil [Wed, 17 Jul 2019 15:55:33 +0000 (10:55 -0500)]
qa/suites/mgr: whitelist RECENT_CRASH

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit e2ff58ba166efb42836466c745a4b9d136810a00)

5 years agomgr/crash: remove unused var
Sage Weil [Wed, 17 Jul 2019 14:36:11 +0000 (09:36 -0500)]
mgr/crash: remove unused var

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 37a8f2d66ac8330ca72d7a13dd2864529a87edbb)

5 years agomgr/crash: remove unused import 'six'
Sage Weil [Wed, 17 Jul 2019 14:35:57 +0000 (09:35 -0500)]
mgr/crash: remove unused import 'six'

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 5b2cbb3a10f8011fbc3d5245801009557404ddc5)

5 years agoqa/workunits/rados/test_crash: health check
Sage Weil [Tue, 16 Jul 2019 14:26:21 +0000 (09:26 -0500)]
qa/workunits/rados/test_crash: health check

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit f6e0894902a6646e73e3db123d48fe2fac9570ea)

5 years agomgr/crash: improve validation on post
Sage Weil [Tue, 16 Jul 2019 14:18:50 +0000 (09:18 -0500)]
mgr/crash: improve validation on post

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 422871d63ea8069453c435bd5559bea68f942eaf)

5 years agomgr/crash: automatically prune old crashes after a year
Sage Weil [Sun, 14 Jul 2019 16:31:56 +0000 (11:31 -0500)]
mgr/crash: automatically prune old crashes after a year

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit b2e20858f42e3775adda4bd054fc8fa15e205453)

5 years agomgr/crash: raise RECENT_CRASH warning for recent (new) crashes
Sage Weil [Thu, 10 Oct 2019 17:46:36 +0000 (12:46 -0500)]
mgr/crash: raise RECENT_CRASH warning for recent (new) crashes

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit c885ee7f0c9c7c232fda81bfd6f9eca0e182ee3d)

# Conflicts:
# doc/rados/operations/health-checks.rst
- TELEMETRY_CHANGED alert order in doc

5 years agomgr/crash: add 'crash ls-new'
Sage Weil [Sun, 14 Jul 2019 16:26:41 +0000 (11:26 -0500)]
mgr/crash: add 'crash ls-new'

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit bebb1c31006ff3cba67831879b34699cf111f945)

5 years agomgr/crash: add option and serve infra
Sage Weil [Sat, 13 Jul 2019 16:06:41 +0000 (11:06 -0500)]
mgr/crash: add option and serve infra

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 7cbaa5ac563bf0be7dd2227ef8a1ae7d0ae20143)

5 years agomgr/crash: keep copy of crashes in memory
Sage Weil [Sat, 13 Jul 2019 15:39:41 +0000 (10:39 -0500)]
mgr/crash: keep copy of crashes in memory

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 6ae4c42bae80c732391e200d56f512d4ea639504)

5 years agomgr/pg_autoscaler: adjust style to match built-in tables
Sage Weil [Sat, 13 Jul 2019 13:35:01 +0000 (08:35 -0500)]
mgr/pg_autoscaler: adjust style to match built-in tables

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 44a99f2f7692e2ab2a74f8a0df983a81a3dea299)

5 years agomgr/crash: make 'crash ls' a nice table with a NEW column
Sage Weil [Fri, 12 Jul 2019 21:34:37 +0000 (16:34 -0500)]
mgr/crash: make 'crash ls' a nice table with a NEW column

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit c691f2f8763a9db081a0b61294c5eedf4e9c2cee)

5 years agomgr/crash: nicely format 'crash info' output
Sage Weil [Fri, 12 Jul 2019 21:23:17 +0000 (16:23 -0500)]
mgr/crash: nicely format 'crash info' output

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 35f15f87cb936705f77ed1ca1ecaad796e021e7a)

5 years agomgr/crash: add 'crash archive <id>', 'crash archive-all' commands
Sage Weil [Fri, 12 Jul 2019 21:23:03 +0000 (16:23 -0500)]
mgr/crash: add 'crash archive <id>', 'crash archive-all' commands

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 31f650cb2049995faa03288e22591d967fd8a14d)

5 years agoMerge branch 'nautilus' into wip-device-telemetry-nautilus
Sage Weil [Fri, 15 Nov 2019 14:23:53 +0000 (08:23 -0600)]
Merge branch 'nautilus' into wip-device-telemetry-nautilus

5 years agoMerge PR #30755 into nautilus
Sage Weil [Fri, 15 Nov 2019 13:11:57 +0000 (07:11 -0600)]
Merge PR #30755 into nautilus

* refs/pull/30755/head:
os/bluestore: fix improper setting of STATE_KV_SUBMITTED.

5 years agoMerge PR #30773 into nautilus
Sage Weil [Fri, 15 Nov 2019 13:11:33 +0000 (07:11 -0600)]
Merge PR #30773 into nautilus

* refs/pull/30773/head:
mgr/BaseMgrStandbyModule: drop GIL in ceph_get_module_option()

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge PR #31099 into nautilus
Sage Weil [Fri, 15 Nov 2019 13:11:05 +0000 (07:11 -0600)]
Merge PR #31099 into nautilus

* refs/pull/31099/head:
auth/cephx/CephxClientHandler: handle decode errors
auth/cephx/CephxProtocol: handle decode errors in CephXTicketHandler::verify_service_ticket_reply
auth/cephx/CephxServiceHandler: handle decode errors

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
5 years agoMerge PR #31100 into nautilus
Sage Weil [Fri, 15 Nov 2019 13:10:37 +0000 (07:10 -0600)]
Merge PR #31100 into nautilus

* refs/pull/31100/head:
mgr/pg_autoscaler: use 'stored' for pool_logical_used

Reviewed-by: Sage Weil <sage@redhat.com>
5 years agoMerge PR #31411 into nautilus
Sage Weil [Fri, 15 Nov 2019 13:10:15 +0000 (07:10 -0600)]
Merge PR #31411 into nautilus

* refs/pull/31411/head:
mgr/ActivePyModules: behave if a module queries a devid that does not exist

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
5 years agoMerge PR #31446 into nautilus
Sage Weil [Fri, 15 Nov 2019 13:09:55 +0000 (07:09 -0600)]
Merge PR #31446 into nautilus

* refs/pull/31446/head:
mgr/devicehealth: do not scrape mon devices

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge PR #31612 into nautilus
Sage Weil [Fri, 15 Nov 2019 13:09:38 +0000 (07:09 -0600)]
Merge PR #31612 into nautilus

* refs/pull/31612/head:
Revert "rocksdb: enable rocksdb_rmrange=true by default"

Reviewed-by: Mark Nelson <mnelson@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Igor Fedotov <ifedotov@suse.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge PR #31644 into nautilus
Sage Weil [Fri, 15 Nov 2019 13:09:20 +0000 (07:09 -0600)]
Merge PR #31644 into nautilus

* refs/pull/31644/head:
os/bluestore: consolidate extents from the same device only

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #31565 from tspmelo/wip-42747-nautilus
Lenz Grimmer [Fri, 15 Nov 2019 08:37:46 +0000 (08:37 +0000)]
Merge pull request #31565 from tspmelo/wip-42747-nautilus

nautilus: mgr/dashboard: Improve position of MDS chart tooltip

Reviewed-by: Laura Paduano <lpaduano@suse.com>
5 years agoMerge PR #30827 into nautilus
Patrick Donnelly [Thu, 14 Nov 2019 17:37:22 +0000 (09:37 -0800)]
Merge PR #30827 into nautilus

* refs/pull/30827/head:
qa/tasks: tests for ls
mgr/volumes: list FS subvolumes, subvolume groups and their snapshots

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge PR #31076 into nautilus
Patrick Donnelly [Thu, 14 Nov 2019 17:34:46 +0000 (09:34 -0800)]
Merge PR #31076 into nautilus

* refs/pull/31076/head:
mgr/volumes: fix incorrect snapshot path creation

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge PR #30768 into nautilus
Patrick Donnelly [Thu, 14 Nov 2019 17:30:24 +0000 (09:30 -0800)]
Merge PR #30768 into nautilus

* refs/pull/30768/head:
doc: protection for 'fs volume rm' command
doc: add ceph fs volumes and subvolumes documentation
qa/tasks: add/update tests for --yes-i-really-mean-it
mgr/volumes: protection for 'fs volume rm' command

Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agoMerge pull request #31641 from liewegas/fix-42783-nautilus
Nathan Cutler [Thu, 14 Nov 2019 17:15:09 +0000 (18:15 +0100)]
Merge pull request #31641 from liewegas/fix-42783-nautilus

nautilus: qa/tasks/ceph.conf.template: increase mon tell retries

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
5 years agoRevert "rocksdb: enable rocksdb_rmrange=true by default" 31612/head
Neha Ojha [Wed, 13 Nov 2019 15:33:01 +0000 (07:33 -0800)]
Revert "rocksdb: enable rocksdb_rmrange=true by default"

This reverts commit 29bafe57503066c962cc692a66178b083fd43343.

We have observed drastically poor performance when rocksdb_rmrange is
used for every key deletion.

This change is specific to nautilus, since we are experimenting with rocksdb_rmrange
along with https://github.com/ceph/ceph/pull/31442 in master.

Signed-off-by: Neha Ojha <nojha@redhat.com>
5 years agoos/bluestore: consolidate extents from the same device only 31644/head
Igor Fedotov [Wed, 13 Nov 2019 19:09:53 +0000 (22:09 +0300)]
os/bluestore: consolidate extents from the same device only

Presumably Fixes: https://tracker.ceph.com/issues/42223

Signed-off-by: Igor Fedotov <ifedotov@suse.com>
(cherry picked from commit 20a90698a262905e97bae771b5950af04c00c67a)

5 years agoqa/tasks/ceph.conf.template: increase mon tell retries 31641/head
Sage Weil [Thu, 14 Nov 2019 16:14:11 +0000 (10:14 -0600)]
qa/tasks/ceph.conf.template: increase mon tell retries

With lots of ms failure injection we see these failing in QA.  Bump this
up as a kludge for nautilus *only*; the master tell implementation no
longer sucks.

Fixes: https://tracker.ceph.com/issues/42783
Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoMerge pull request #31248 from smithfarm/wip-42562-nautilus
Nathan Cutler [Thu, 14 Nov 2019 15:46:50 +0000 (16:46 +0100)]
Merge pull request #31248 from smithfarm/wip-42562-nautilus

nautilus: tests: enable dashboard tests to be run with "--suite rados/dashboard"

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
5 years agoqa: enable dashboard tests to be run with "--suite rados/dashboard" 31248/head
Nathan Cutler [Tue, 17 Sep 2019 16:11:11 +0000 (18:11 +0200)]
qa: enable dashboard tests to be run with "--suite rados/dashboard"

This moves dashboard.yaml from rados/mgr into a new, separate rados/dashboard
suite. The common elements it uses are moved from rados/mgr into qa/ and
replaced with symlinks.

Fixes: https://tracker.ceph.com/issues/41820
Signed-off-by: Nathan Cutler <ncutler@suse.com>
(cherry picked from commit 493ee6d78ff90c4c3d81f5c7edac6d06fbe3d295)

5 years agoMerge pull request #31628 from yuvalif/nautilus-backport-of-42497
Nathan Cutler [Thu, 14 Nov 2019 15:24:43 +0000 (16:24 +0100)]
Merge pull request #31628 from yuvalif/nautilus-backport-of-42497

nautilus: rgw/amqp: remove flaky amqp test

Reviewed-by: Nathan Cutler <ncutler@suse.com>
5 years agorgw/amqp: remove a test that requires syncronization 31628/head
Yuval Lifshitz [Sun, 10 Nov 2019 09:57:57 +0000 (11:57 +0200)]
rgw/amqp: remove a test that requires syncronization
betwen the amqp manager internal thread and the test itself
amqp reconnect should be tested by system test instead

Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
(cherry picked from commit 10a27ef809c4e3f745f2726a5f0be8d8579a5979)
Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
5 years agoMerge pull request #30899 from smithfarm/wip-42126-nautilus
Yuri Weinstein [Wed, 13 Nov 2019 20:30:46 +0000 (12:30 -0800)]
Merge pull request #30899 from smithfarm/wip-42126-nautilus

nautilus: core/osd,crush: "do not trust partially simplified pg_upmap_item" and "remove invalid upmap items"

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #31482 from callithea/wip-42682-nautilus
Yuri Weinstein [Wed, 13 Nov 2019 20:28:54 +0000 (12:28 -0800)]
Merge pull request #31482 from callithea/wip-42682-nautilus

nautilus: mgr/{dashboard,prometheus}: return FQDN instead of '0.0.0.0'

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Jan Fajerski <jfajerski@suse.com>
Reviewed-by: Patrick Seidensal <pseidensal@suse.com>
5 years agoMerge pull request #30696 from uweigand/nautilus-z-build
Yuri Weinstein [Wed, 13 Nov 2019 20:26:22 +0000 (12:26 -0800)]
Merge pull request #30696 from uweigand/nautilus-z-build

nautilus: cmake,rgw: IBM Z build fixes

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #30419 from ceph/wip-41238-nautilus
Yuri Weinstein [Wed, 13 Nov 2019 20:25:24 +0000 (12:25 -0800)]
Merge pull request #30419 from ceph/wip-41238-nautilus

nautilus: mon/OSDMonitor: Use generic priority cache tuner for mon caches

5 years agoMerge pull request #29961 from smithfarm/wip-41130-nautilus
Yuri Weinstein [Wed, 13 Nov 2019 20:24:38 +0000 (12:24 -0800)]
Merge pull request #29961 from smithfarm/wip-41130-nautilus

nautilus: rgw: Swift metadata dropped after S3 bucket versioning enabled

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #29960 from smithfarm/wip-41125-nautilus
Yuri Weinstein [Wed, 13 Nov 2019 20:24:11 +0000 (12:24 -0800)]
Merge pull request #29960 from smithfarm/wip-41125-nautilus

nautilus: rgw: returns one byte more data than the requested range from the SLO object

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #29959 from smithfarm/wip-41119-nautilus
Yuri Weinstein [Wed, 13 Nov 2019 20:23:22 +0000 (12:23 -0800)]
Merge pull request #29959 from smithfarm/wip-41119-nautilus

nautilus: rgw: rgw-admin: search for user by access key

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #29956 from smithfarm/wip-41109-nautilus
Yuri Weinstein [Wed, 13 Nov 2019 20:22:21 +0000 (12:22 -0800)]
Merge pull request #29956 from smithfarm/wip-41109-nautilus

nautilus: rgw: fix drain handles error when deleting bucket with bypass-gc option

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #30941 from vumrao/wip-vumrao-42326
Yuri Weinstein [Wed, 13 Nov 2019 20:21:09 +0000 (12:21 -0800)]
Merge pull request #30941 from vumrao/wip-vumrao-42326

nautilus: mon/OSDMonitor: add check for crush rule size in pool set size command

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
5 years agoMerge pull request #30923 from vumrao/wip-vumrao-42242
Yuri Weinstein [Wed, 13 Nov 2019 20:20:21 +0000 (12:20 -0800)]
Merge pull request #30923 from vumrao/wip-vumrao-42242

nautilus: osd/PG: Add PG to large omap log message

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
5 years agoMerge pull request #29748 from dzafman/wip-40840
Yuri Weinstein [Wed, 13 Nov 2019 20:13:33 +0000 (12:13 -0800)]
Merge pull request #29748 from dzafman/wip-40840

nautilus: osd: support osd_repair_during_recovery

5 years agoMerge pull request #29649 from pdvian/wip-40944-nautilus
Yuri Weinstein [Wed, 13 Nov 2019 20:13:03 +0000 (12:13 -0800)]
Merge pull request #29649 from pdvian/wip-40944-nautilus

nautilus: tests: rados/mgr/tasks/module_selftest: whitelist mgr client getting blacklisted

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #29550 from pdvian/wip-40878-nautilus
Yuri Weinstein [Wed, 13 Nov 2019 20:11:37 +0000 (12:11 -0800)]
Merge pull request #29550 from pdvian/wip-40878-nautilus

nautilus: mgr: Unable to reset / unset module options

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
5 years agoMerge pull request #30546 from pdvian/wip-41917-nautilus
Yuri Weinstein [Wed, 13 Nov 2019 20:09:50 +0000 (12:09 -0800)]
Merge pull request #30546 from pdvian/wip-41917-nautilus

nautilus: core: osd: add log information to record the cause of do_osd_ops failure

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #30528 from smithfarm/wip-42014-nautilus
Yuri Weinstein [Wed, 13 Nov 2019 20:09:26 +0000 (12:09 -0800)]
Merge pull request #30528 from smithfarm/wip-42014-nautilus

nautilus: core: osd/PeeringState: recover_got - add special handler for empty log and improvements to standalone tests

5 years agoMerge pull request #30524 from liewegas/bugfix-40716-nautilus
Yuri Weinstein [Wed, 13 Nov 2019 20:08:25 +0000 (12:08 -0800)]
Merge pull request #30524 from liewegas/bugfix-40716-nautilus

nautilus: core: msg,mon/MonClient: fix auth for clients without CEPHX_V2 feature

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
5 years agoMerge pull request #30486 from sobelek/wip-41921-nautilus
Yuri Weinstein [Wed, 13 Nov 2019 20:07:49 +0000 (12:07 -0800)]
Merge pull request #30486 from sobelek/wip-41921-nautilus

nautilus: core: mon: show pool id in pool ls command

5 years agoMerge pull request #30480 from pdvian/wip-41862-nautilus
Yuri Weinstein [Wed, 13 Nov 2019 20:07:08 +0000 (12:07 -0800)]
Merge pull request #30480 from pdvian/wip-41862-nautilus

nautilus: mon: ensure prepare_failure() marks no_reply on op

5 years agoMerge pull request #30371 from pdvian/wip-41712-nautilus
Yuri Weinstein [Wed, 13 Nov 2019 20:06:40 +0000 (12:06 -0800)]
Merge pull request #30371 from pdvian/wip-41712-nautilus

nautilus: osd: prime splits/merges for any potential fabricated split/merge par…

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #30280 from smithfarm/wip-41640-nautilus
Yuri Weinstein [Wed, 13 Nov 2019 20:05:56 +0000 (12:05 -0800)]
Merge pull request #30280 from smithfarm/wip-41640-nautilus

nautilus: osd/PeeringState: fix wrong history of merge target

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
5 years agoMerge pull request #31027 from smithfarm/wip-42182-nautilus
Yuri Weinstein [Wed, 13 Nov 2019 16:54:00 +0000 (08:54 -0800)]
Merge pull request #31027 from smithfarm/wip-42182-nautilus

nautilus: rgw: sync with elastic search v7

5 years agoMerge pull request #31026 from smithfarm/wip-41981-nautilus
Yuri Weinstein [Wed, 13 Nov 2019 16:53:27 +0000 (08:53 -0800)]
Merge pull request #31026 from smithfarm/wip-41981-nautilus

nautilus: rgw: fix default storage class for get_compression_type

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #30869 from smithfarm/wip-41323-nautilus
Yuri Weinstein [Wed, 13 Nov 2019 16:53:02 +0000 (08:53 -0800)]
Merge pull request #30869 from smithfarm/wip-41323-nautilus

nautilus: rgw: datalog/mdlog trim commands loop until done

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #31073 from smithfarm/wip-42281-nautilus
Yuri Weinstein [Wed, 13 Nov 2019 16:50:23 +0000 (08:50 -0800)]
Merge pull request #31073 from smithfarm/wip-42281-nautilus

nautilus: rgw: lifecycle days may be 0

Reviewed-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
5 years agoMerge pull request #30999 from cbodley/wip-40630
Yuri Weinstein [Wed, 13 Nov 2019 16:49:20 +0000 (08:49 -0800)]
Merge pull request #30999 from cbodley/wip-40630

nautilus: rgw: data/bilogs are trimmed when no peers are reading them

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #30746 from IlsooByun/rgw_race_condition
Yuri Weinstein [Wed, 13 Nov 2019 16:48:25 +0000 (08:48 -0800)]
Merge pull request #30746 from IlsooByun/rgw_race_condition

nautilus: rgw: protect AioResultList by a lock to avoid race condition

Reviewed-by: Nathan Cutler <ncutler@suse.com>
Reviewed-by: Adam Emerson <aemerson@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #29785 from pdvian/wip-41090-nautilus
Yuri Weinstein [Wed, 13 Nov 2019 16:46:38 +0000 (08:46 -0800)]
Merge pull request #29785 from pdvian/wip-41090-nautilus

nautilus: rpm: put librgw lttng SOs in the librgw-devel package

Reviewed-by: Nathan Cutler <ncutler@suse.com>
5 years agoMerge pull request #29784 from pdvian/wip-41091-nautilus
Yuri Weinstein [Wed, 13 Nov 2019 16:46:13 +0000 (08:46 -0800)]
Merge pull request #29784 from pdvian/wip-41091-nautilus

nautilus: rpm: fdupes in SUSE builds to conform with packaging guidelines

Reviewed-by: Nathan Cutler <ncutler@suse.com>
5 years agoMerge pull request #29772 from smithfarm/wip-41350-nautilus
Yuri Weinstein [Wed, 13 Nov 2019 16:45:42 +0000 (08:45 -0800)]
Merge pull request #29772 from smithfarm/wip-41350-nautilus

nautilus: build/ops: hidden corei7 requirement in binary packages

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agocommon: fix typo in rgw_user_max_buckets option long description. 31605/head
Alfonso Martínez [Tue, 12 Nov 2019 15:33:50 +0000 (16:33 +0100)]
common: fix typo in rgw_user_max_buckets option long description.

Fixes: https://tracker.ceph.com/issues/42775
Signed-off-by: Alfonso Martínez <almartin@redhat.com>
(cherry picked from commit c91c2cea65cb42c2b92b10543366e00079f7def8)

5 years agoMerge pull request #31555 from jan--f/wip-42755-nautilus
Alfredo Deza [Wed, 13 Nov 2019 13:56:27 +0000 (08:56 -0500)]
Merge pull request #31555 from jan--f/wip-42755-nautilus

nautilus: ceph-volume: allow to skip restorecon calls

5 years agoMerge pull request #31576 from ricardoasmarques/wip-42745-nautilus
Lenz Grimmer [Wed, 13 Nov 2019 12:16:36 +0000 (12:16 +0000)]
Merge pull request #31576 from ricardoasmarques/wip-42745-nautilus

nautilus: mgr/dashboard: Wait for breadcrumb text is present in e2e tests

Reviewed-by: Laura Paduano <lpaduano@suse.com>
5 years agoMerge pull request #30195 from dzafman/wip-network-nautilus
Yuri Weinstein [Tue, 12 Nov 2019 23:40:47 +0000 (15:40 -0800)]
Merge pull request #30195 from dzafman/wip-network-nautilus

nautilus: core: Health warnings on long network ping times

5 years agoMerge pull request #30904 from smithfarm/wip-42152-nautilus
Yuri Weinstein [Tue, 12 Nov 2019 23:39:55 +0000 (15:39 -0800)]
Merge pull request #30904 from smithfarm/wip-42152-nautilus

nautilus: mon/OSDMonitor: trim not-longer-exist failure reporters

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agomgr/dashboard: Wait for breadcrumb text is present in e2e tests 31576/head
Volker Theile [Mon, 9 Sep 2019 14:43:13 +0000 (16:43 +0200)]
mgr/dashboard: Wait for breadcrumb text is present in e2e tests

When the cluster is busy it might take some time until the tested component has loaded it's data and is rendered in the browser. Waiting for the breadcrumb text to be present might help to fix errors in the e2e tests.

Signed-off-by: Volker Theile <vtheile@suse.com>
(cherry picked from commit e28d7287bd109b5c1682dc832c4a77ea47505165)

 Conflicts:
src/pybind/mgr/dashboard/frontend/e2e/block/images.e2e-spec.ts
src/pybind/mgr/dashboard/frontend/e2e/block/iscsi.e2e-spec.ts
src/pybind/mgr/dashboard/frontend/e2e/block/mirroring.e2e-spec.ts
src/pybind/mgr/dashboard/frontend/e2e/cluster/alerts.e2e-spec.ts
src/pybind/mgr/dashboard/frontend/e2e/cluster/configuration.e2e-spec.ts
src/pybind/mgr/dashboard/frontend/e2e/cluster/configuration.po.ts
src/pybind/mgr/dashboard/frontend/e2e/cluster/crush-map.e2e-spec.ts
src/pybind/mgr/dashboard/frontend/e2e/cluster/hosts.e2e-spec.ts
src/pybind/mgr/dashboard/frontend/e2e/cluster/hosts.po.ts
src/pybind/mgr/dashboard/frontend/e2e/cluster/logs.e2e-spec.ts
src/pybind/mgr/dashboard/frontend/e2e/cluster/mgr-modules.e2e-spec.ts
src/pybind/mgr/dashboard/frontend/e2e/cluster/monitors.e2e-spec.ts
src/pybind/mgr/dashboard/frontend/e2e/cluster/osds.e2e-spec.ts
src/pybind/mgr/dashboard/frontend/e2e/dashboard.e2e-spec.ts
src/pybind/mgr/dashboard/frontend/e2e/filesystems/filesystems.e2e-spec.ts
src/pybind/mgr/dashboard/frontend/e2e/nfs/nfs.e2e-spec.ts
src/pybind/mgr/dashboard/frontend/e2e/page-helper.po.ts
src/pybind/mgr/dashboard/frontend/e2e/pools/pools.e2e-spec.ts
src/pybind/mgr/dashboard/frontend/e2e/pools/pools.po.ts
src/pybind/mgr/dashboard/frontend/e2e/rgw/buckets.po.ts
src/pybind/mgr/dashboard/frontend/e2e/rgw/daemons.e2e-spec.ts
src/pybind/mgr/dashboard/frontend/e2e/rgw/users.e2e-spec.ts
src/pybind/mgr/dashboard/frontend/e2e/rgw/users.po.ts
src/pybind/mgr/dashboard/frontend/e2e/user-mgmt.e2e-spec.ts

Conflicts are caused by E2E refactoring in master branch.

5 years agoMerge pull request #29905 from croit/backport-26538
Yuri Weinstein [Tue, 12 Nov 2019 15:24:54 +0000 (07:24 -0800)]
Merge pull request #29905 from croit/backport-26538

nautilus: rgw: add S3 object lock feature to support object worm

Reviewed-by: Casey Bodley <cbodley@redhat.com>