]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
5 years agoMerge pull request #30910 from rjfd/wip-42283-nautilus
Yuri Weinstein [Wed, 20 Nov 2019 20:03:02 +0000 (12:03 -0800)]
Merge pull request #30910 from rjfd/wip-42283-nautilus

nautilus: mgr/dashboard: internationalization support with AOT enabled

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Sebastian Krah <skrah@suse.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
5 years agoMerge pull request #30685 from ifed01/wip-ifed-fast-fsck-nau
Yuri Weinstein [Wed, 20 Nov 2019 20:01:28 +0000 (12:01 -0800)]
Merge pull request #30685 from ifed01/wip-ifed-fast-fsck-nau

nautilus: os/bluestore: shallow fsck mode and legacy statfs auto repair.

Reviewed-by: Sage Weil <sage@redhat.com>
5 years agoMerge pull request #31742 from smithfarm/wip-42836-nautilus
Nathan Cutler [Tue, 19 Nov 2019 16:51:20 +0000 (17:51 +0100)]
Merge pull request #31742 from smithfarm/wip-42836-nautilus

nautilus: rgw: Silence warning: control reaches end of non-void function

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
5 years agorgw: drop getting list-type when get_data is false 31742/head
Jos Collin [Wed, 3 Jul 2019 04:44:21 +0000 (10:14 +0530)]
rgw: drop getting list-type when get_data is false

Signed-off-by: Jos Collin <jcollin@redhat.com>
(cherry picked from commit ae56a918174cc6899bf7384004560ea57036b009)

5 years agorgw: Silence warning: control reaches end of non-void function
Jos Collin [Mon, 1 Jul 2019 09:02:33 +0000 (14:32 +0530)]
rgw: Silence warning: control reaches end of non-void function

Build shows:
[ 53%] Building CXX object src/mds/CMakeFiles/mds.dir/JournalPointer.cc.o
ceph/src/rgw/rgw_rest_s3.cc: In member function ‘RGWOp* RGWHandler_REST_Bucket_S3::get_obj_op(bool)’:
ceph/src/rgw/rgw_rest_s3.cc:3588:5: warning: control reaches end of non-void function [-Wreturn-type]
   }   }
     ^
Fixes: 4ffc765c4c5debc665ade7769c4647c3a7278fd2
Fixes: http://tracker.ceph.com/issues/40747
Signed-off-by: Jos Collin <jcollin@redhat.com>
(cherry picked from commit abb2451dd5164e6b610589207b900a6464e21282)

5 years agoMerge pull request #31522 from ricardoasmarques/wip-42729-nautilus
Laura Paduano [Tue, 19 Nov 2019 15:57:17 +0000 (16:57 +0100)]
Merge pull request #31522 from ricardoasmarques/wip-42729-nautilus

nautilus: mgr/dashboard: RBD tests must use pools with power-of-two pg_n…

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
5 years agoMerge pull request #31516 from rhcs-dashboard/42694-filter-non-pool-fields
Laura Paduano [Tue, 19 Nov 2019 15:56:34 +0000 (16:56 +0100)]
Merge pull request #31516 from rhcs-dashboard/42694-filter-non-pool-fields

nautilus: mgr/dashboard: do not show non-pool data in pool details

Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
5 years agoMerge pull request #31413 from smithfarm/wip-41980-nautilus
Laura Paduano [Tue, 19 Nov 2019 15:55:55 +0000 (16:55 +0100)]
Merge pull request #31413 from smithfarm/wip-41980-nautilus

nautilus: mgr/dashboard: do not log tokens

5 years agoMerge pull request #31375 from tspmelo/wip-42150-nautilus
Laura Paduano [Tue, 19 Nov 2019 15:55:14 +0000 (16:55 +0100)]
Merge pull request #31375 from tspmelo/wip-42150-nautilus

nautilus: mgr/dashboard: Configuring an URL prefix does not work as expected

Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
5 years agoMerge pull request #31349 from rhcs-dashboard/42589-edit-image-after-data-received
Laura Paduano [Tue, 19 Nov 2019 15:29:26 +0000 (16:29 +0100)]
Merge pull request #31349 from rhcs-dashboard/42589-edit-image-after-data-received

nautilus: mgr/dashboard: edit/clone/copy rbd image after its data is received

Reviewed-by: Ernesto Puertat <epuertat@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
5 years agoMerge pull request #31263 from ricardoasmarques/wip-42295-nautilus
Laura Paduano [Tue, 19 Nov 2019 15:02:32 +0000 (16:02 +0100)]
Merge pull request #31263 from ricardoasmarques/wip-42295-nautilus

nautilus: mgr/dashboard: Provide the name of the object being deleted

Reviewed-by: Ernesto Puertat <epuertat@redhat.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
5 years agoMerge pull request #31160 from Exotelis/wip-42482-nautilus
Laura Paduano [Tue, 19 Nov 2019 15:00:42 +0000 (16:00 +0100)]
Merge pull request #31160 from Exotelis/wip-42482-nautilus

nautilus: mgr/dashboard: Add transifex-i18ntool

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
5 years agonautilus: mgr/dashboard: Fix data point alignment in MDS count… (#31535)
Lenz Grimmer [Tue, 19 Nov 2019 10:27:58 +0000 (10:27 +0000)]
nautilus: mgr/dashboard: Fix data point alignment in MDS count… (#31535)

nautilus: mgr/dashboard: Fix data point alignment in MDS counters chart

Reviewed-by: Stephan Müller <smueller@suse.com>
5 years agoMerge pull request #31658 from smithfarm/wip-42731-nautilus
Yuri Weinstein [Mon, 18 Nov 2019 20:15:00 +0000 (12:15 -0800)]
Merge pull request #31658 from smithfarm/wip-42731-nautilus

nautilus: mon/MonMap: encode (more) valid compat monmap when we have v2-only addrs

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
5 years agoMerge pull request #31604 from smithfarm/wip-42782-nautilus
Yuri Weinstein [Mon, 18 Nov 2019 20:14:10 +0000 (12:14 -0800)]
Merge pull request #31604 from smithfarm/wip-42782-nautilus

nautilus: tests: test_librados_build.sh: grab from nautilus branch in nautilus

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #31444 from dzafman/wip-41785
Yuri Weinstein [Mon, 18 Nov 2019 20:13:42 +0000 (12:13 -0800)]
Merge pull request #31444 from dzafman/wip-41785

nautilus: core: Make dumping of reservation info congruent between scrub and recovery

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #31261 from ceph/wip-nautilus-restful-node-items
Yuri Weinstein [Mon, 18 Nov 2019 20:13:08 +0000 (12:13 -0800)]
Merge pull request #31261 from ceph/wip-nautilus-restful-node-items

nautilus: restful: Query nodes_by_id for items

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
5 years agoMerge pull request #31125 from smithfarm/wip-42439-nautilus
Yuri Weinstein [Mon, 18 Nov 2019 20:12:18 +0000 (12:12 -0800)]
Merge pull request #31125 from smithfarm/wip-42439-nautilus

nautilus: build/ops: rpm: make librados2, libcephfs2 own (create) /etc/ceph

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #31011 from smithfarm/wip-42401-nautilus
Yuri Weinstein [Mon, 18 Nov 2019 20:11:44 +0000 (12:11 -0800)]
Merge pull request #31011 from smithfarm/wip-42401-nautilus

nautilus: cmake: Allow cephfs and ceph-mds to be build when building on FreeBSD

Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #30740 from smithfarm/wip-41463-nautilus
Yuri Weinstein [Mon, 18 Nov 2019 20:10:35 +0000 (12:10 -0800)]
Merge pull request #30740 from smithfarm/wip-41463-nautilus

nautilus: ceph-objectstore-tool: update-mon-db: do not fail if incmap is missing

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #31682 from dzafman/wip-42432-nautilus
Yuri Weinstein [Mon, 18 Nov 2019 20:09:15 +0000 (12:09 -0800)]
Merge pull request #31682 from dzafman/wip-42432-nautilus

nautilus: mgr: Release GIL before calling OSDMap::calc_pg_upmaps()

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #31077 from smithfarm/wip-42141-nautilus
Yuri Weinstein [Mon, 18 Nov 2019 20:08:31 +0000 (12:08 -0800)]
Merge pull request #31077 from smithfarm/wip-42141-nautilus

nautilus: core: osd/PGLog: persist num_objects_missing for replicas when peering is done

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
5 years agoMerge pull request #30900 from smithfarm/wip-42136-nautilus
Yuri Weinstein [Mon, 18 Nov 2019 20:05:28 +0000 (12:05 -0800)]
Merge pull request #30900 from smithfarm/wip-42136-nautilus

nautilus: osd: Remove unused osdmap flags full, nearfull from output

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #31136 from wjwithagen/wip-fixup-cephfs-nautilus
Yuri Weinstein [Mon, 18 Nov 2019 16:53:11 +0000 (08:53 -0800)]
Merge pull request #31136 from wjwithagen/wip-fixup-cephfs-nautilus

nautilus: test/{fs,cephfs}: Get libcephfs and cephfs to compile with FreeBSD

Reviewed-by: Ramana Raja <rraja@redhat.com>
5 years agoMerge pull request #30951 from sidharthanup/mds-evict-duplicate-nautilus
Yuri Weinstein [Mon, 18 Nov 2019 16:52:33 +0000 (08:52 -0800)]
Merge pull request #30951 from sidharthanup/mds-evict-duplicate-nautilus

nautilus: cephfs: mds: Fix duplicate client entries in eviction list

Reviewed-by: Ramana Raja <rraja@redhat.com>
5 years agoMerge pull request #30043 from smithfarm/wip-41488-nautilus
Yuri Weinstein [Mon, 18 Nov 2019 16:51:58 +0000 (08:51 -0800)]
Merge pull request #30043 from smithfarm/wip-41488-nautilus

nautilus: cephfs: client: return -eio when sync file which unsafe reqs have been dropped

Reviewed-by: Ramana Raja <rraja@redhat.com>
5 years agoMerge pull request #29832 from pdvian/wip-41095-nautilus
Yuri Weinstein [Mon, 18 Nov 2019 16:50:59 +0000 (08:50 -0800)]
Merge pull request #29832 from pdvian/wip-41095-nautilus

nautilus: cephfs: qa: wait for MDS to come back after removing it

Reviewed-by: Ramana Raja <rraja@redhat.com>
5 years agoMerge pull request #29811 from pdvian/wip-41093-nautilus
Yuri Weinstein [Mon, 18 Nov 2019 16:50:29 +0000 (08:50 -0800)]
Merge pull request #29811 from pdvian/wip-41093-nautilus

nautilus: cephfs: qa: ignore expected MDS_CLIENT_LATE_RELEASE warning

Reviewed-by: Ramana Raja <rraja@redhat.com>
5 years agoMerge pull request #29750 from pdvian/wip-41087-nautilus
Yuri Weinstein [Mon, 18 Nov 2019 16:49:58 +0000 (08:49 -0800)]
Merge pull request #29750 from pdvian/wip-41087-nautilus

nautilus: qa: sleep briefly after resetting kclient

Reviewed-by: Ramana Raja <rraja@redhat.com>
5 years agoMerge pull request #31650 from uweigand/nautilus-backport-28013
Yuri Weinstein [Mon, 18 Nov 2019 15:57:05 +0000 (07:57 -0800)]
Merge pull request #31650 from uweigand/nautilus-backport-28013

nautilus: rgw: use explicit to_string() overload for boost::string_ref

Reviewed-by: Nathan Cutler <ncutler@suse.com>
5 years agoMerge pull request #31079 from smithfarm/wip-42155-nautilus
Yuri Weinstein [Mon, 18 Nov 2019 14:54:18 +0000 (06:54 -0800)]
Merge pull request #31079 from smithfarm/wip-42155-nautilus

nautilus: cephfs: mds: fix infinite loop in Locker::file_update_finish

Reviewed-by: Yan, Zheng <zyan@redhat.com>
5 years agoos/bluestore: test conversion from global statfs 30685/head
Sage Weil [Wed, 11 Sep 2019 21:43:11 +0000 (16:43 -0500)]
os/bluestore: test conversion from global statfs

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 923becc88257a70604b313a3ea0419a1024c62d2)

5 years agoos/bluestore: simplify per-pool-stat config options
Sage Weil [Wed, 11 Sep 2019 17:52:57 +0000 (12:52 -0500)]
os/bluestore: simplify per-pool-stat config options

The previous bluestore_no_per_pool_stats_tolerance had a lot of possible
values, not all of which make sense to users.  Replace with a single new
option, bluestore_fsck_error_on_no_per_pool_stats, which controls whether
the lack of per-pool stats is an error or a warning.  On repair, we will
unconditionally convert to per-pool stats.

This brings us in sync with the newer
bluestore_fsck_error_on_no_per_pool_omap.

Note that one part of the ceph_test_objectstore test is dropped since it
is no longer possible to create a store with legacy stats.

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 7e96024254d98591a5431623fb355a20f322b554)

 Conflicts:
PendingReleaseNotes
        - trivial
src/os/bluestore/BlueStore.cc
        - lacking of int_repaired method

5 years agoos/bluestore: fix invalid stray shared blob detection in fsck.
Igor Fedotov [Fri, 27 Sep 2019 10:51:54 +0000 (13:51 +0300)]
os/bluestore: fix invalid stray shared blob detection in fsck.

This is a regression, caused by https://github.com/ceph/ceph/pull/30264

Signed-off-by: Igor Fedotov <ifedotov@suse.com>
(cherry picked from commit 3f79b1976885880a188ed0a7f5e7d40dd554dc15)

5 years agoos/bluestore: fix warning counting in fsck
Igor Fedotov [Mon, 9 Sep 2019 13:46:31 +0000 (16:46 +0300)]
os/bluestore: fix warning counting in fsck

Signed-off-by: Igor Fedotov <ifedotov@suse.com>
(cherry picked from commit d3308d2cc17b0a12480e5dce850d2bda84985add)

5 years agoos/bluestore: remove duplicate logging
Igor Fedotov [Tue, 10 Sep 2019 11:24:14 +0000 (14:24 +0300)]
os/bluestore: remove duplicate logging

Signed-off-by: Igor Fedotov <ifedotov@suse.com>
(cherry picked from commit f1346a0ce1e9c35d44d016380c6a962d23288de4)

5 years agoos/bluestore: introduce 'fix_on_mount' mode for no per pool tolerance.
Igor Fedotov [Mon, 9 Sep 2019 13:08:40 +0000 (16:08 +0300)]
os/bluestore: introduce 'fix_on_mount' mode for no per pool tolerance.

Signed-off-by: Igor Fedotov <ifedotov@suse.com>
(cherry picked from commit 52af6cda58409d4e90363d1bd741485683f54395)

 Conflicts:
src/os/bluestore/BlueStore.cc
        - trivial

5 years agoos/bluestore: parallelize quick-fix running.
Igor Fedotov [Sun, 8 Sep 2019 22:37:13 +0000 (01:37 +0300)]
os/bluestore: parallelize quick-fix running.

Signed-off-by: Igor Fedotov <ifedotov@suse.com>
(cherry picked from commit c432f2268db60eb701fd9b17618537513f5d4eea)

 Conflicts:
src/os/bluestore/BlueStore.cc
        - trivial

5 years agocommon/work_queue: make ThreadPool/WorkQueue more reusable.
Igor Fedotov [Sun, 8 Sep 2019 22:15:50 +0000 (01:15 +0300)]
common/work_queue: make ThreadPool/WorkQueue more reusable.

Some tricks to be able to derive from ThreadPool.

Signed-off-by: Igor Fedotov <ifedotov@suse.com>
(cherry picked from commit e72801074c9d464044be3e981728c99618797984)

5 years agoos/bluestore: pass containers by ptr in FSCK_ObjectCtx
Igor Fedotov [Fri, 6 Sep 2019 12:49:13 +0000 (15:49 +0300)]
os/bluestore: pass containers by ptr in FSCK_ObjectCtx

Signed-off-by: Igor Fedotov <ifedotov@suse.com>
(cherry picked from commit 799d54125584c2f7cb42d110b53b1e33e7b9bacb)

 Conflicts:
src/os/bluestore/BlueStore.cc
        - lacking per-pool omap

5 years agoos/bluestore: another split out for fsck logic blocks.
Igor Fedotov [Fri, 6 Sep 2019 11:56:50 +0000 (14:56 +0300)]
os/bluestore: another split out for fsck logic blocks.

Signed-off-by: Igor Fedotov <ifedotov@suse.com>
(cherry picked from commit c6ab317fff7e28a938de40644d714a51bdb73bf3)

5 years agoos/bluestore: reorder blocks within fsck_check_objects.
Igor Fedotov [Fri, 6 Sep 2019 10:26:45 +0000 (13:26 +0300)]
os/bluestore: reorder blocks within fsck_check_objects.

The rationale is to to have better locality for shallow checks which can
later run in a multithreaded manner.

Signed-off-by: Igor Fedotov <ifedotov@suse.com>
(cherry picked from commit d63fc8f86e0609ad03c9679a42b7dd3021e3111d)

 Conflicts:
src/os/bluestore/BlueStore.cc
        - lacking per-pool omap

5 years agoos/bluestore: split out object checking from _fsck.
Igor Fedotov [Fri, 6 Sep 2019 09:09:45 +0000 (12:09 +0300)]
os/bluestore: split out object checking from _fsck.

Signed-off-by: Igor Fedotov <ifedotov@suse.com>
(cherry picked from commit d713d4b6eedb50a0923c21bd173509b3f011caed)

 Conflicts:
src/os/bluestore/BlueStore.cc
src/os/bluestore/BlueStore.h
        - lacking warnings and per-pool omap support

5 years agoos/bluestore: fsck: int64_t for error count
Sage Weil [Thu, 8 Aug 2019 21:31:01 +0000 (16:31 -0500)]
os/bluestore: fsck: int64_t for error count

Just to be on the safe side.

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit dee8f8cb7e906596693f8c6e22ff74f815169c87)

 Conflicts:
src/os/bluestore/BlueStore.cc
        - trivial

5 years agoos/bluestore: introduce shallow (quick-fix) mode for bluestore fsck/repair.
Igor Fedotov [Thu, 5 Sep 2019 14:43:40 +0000 (17:43 +0300)]
os/bluestore: introduce shallow (quick-fix) mode for bluestore fsck/repair.

Signed-off-by: Igor Fedotov <ifedotov@suse.com>
(cherry picked from commit ca2c4e5d6956a32a7ce83f28a01c825dde1ee117)

 Conflicts:
src/os/bluestore/BlueStore.cc
        - caused by lack of perpool omap support
src/os/bluestore/bluestore_tool.cc
        - lacking allocator fragmentation analysis commands

5 years agoos/bluestore: do not collect onodes when doing fsck.
Igor Fedotov [Thu, 5 Sep 2019 12:18:53 +0000 (15:18 +0300)]
os/bluestore: do not collect onodes when doing fsck.

This both saves RAM and cpu cycles making fsck process faster.

Signed-off-by: Igor Fedotov <ifedotov@suse.com>
(cherry picked from commit 4b23bae6a2412ad752543d2aa5e0f7bf053306d2)

 Conflicts:
src/os/bluestore/BlueStore.cc
 std::shared_lock vs. RWLock::RLocker mismatch

5 years agoMerge pull request #30144 from ifed01/wip-ifed-gc-blobs-nau
Yuri Weinstein [Sat, 16 Nov 2019 16:07:30 +0000 (08:07 -0800)]
Merge pull request #30144 from ifed01/wip-ifed-gc-blobs-nau

nautilus: os/bluestore: apply garbage collection against excessive blob count growth

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #31397 from jan--f/wip-41460-nautilus
Yuri Weinstein [Sat, 16 Nov 2019 16:06:12 +0000 (08:06 -0800)]
Merge pull request #31397 from jan--f/wip-41460-nautilus

nautilus: os/bluestore/KernelDevice: fix RW_IO_MAX constant

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
5 years agoMerge pull request #30774 from smithfarm/wip-42144-nautilus
Yuri Weinstein [Sat, 16 Nov 2019 16:04:29 +0000 (08:04 -0800)]
Merge pull request #30774 from smithfarm/wip-42144-nautilus

nautilus: mgr/prometheus: Fix KeyError in get_mgr_status

5 years agoMerge pull request #30624 from tchaikov/wip-nautilus-41983
Yuri Weinstein [Sat, 16 Nov 2019 16:03:33 +0000 (08:03 -0800)]
Merge pull request #30624 from tchaikov/wip-nautilus-41983

nautilus: mgr: set hostname in DeviceState::set_metadata()

5 years agoMerge pull request #30622 from smithfarm/wip-42083-nautilus
Yuri Weinstein [Sat, 16 Nov 2019 16:02:53 +0000 (08:02 -0800)]
Merge pull request #30622 from smithfarm/wip-42083-nautilus

nautilus: pybind/rados: fix set_omap() crash on py3

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
5 years agoMerge pull request #30390 from pdvian/wip-41804-nautilus
Yuri Weinstein [Sat, 16 Nov 2019 16:01:49 +0000 (08:01 -0800)]
Merge pull request #30390 from pdvian/wip-41804-nautilus

nautilus: mgr: do not reset reported if a new metric is not collected

5 years agoMerge pull request #30370 from pdvian/wip-41766-nautilus
Yuri Weinstein [Sat, 16 Nov 2019 16:01:15 +0000 (08:01 -0800)]
Merge pull request #30370 from pdvian/wip-41766-nautilus

nautilus: ceph.spec.in: reserve 2500MB per build job

5 years agoMerge pull request #30360 from yuvalif/allow_gcc9_compilation
Yuri Weinstein [Sat, 16 Nov 2019 16:00:37 +0000 (08:00 -0800)]
Merge pull request #30360 from yuvalif/allow_gcc9_compilation

 nautilus: build/ops: cmake/BuildDPDK: ignore gcc8/9 warnings

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
5 years agoMerge pull request #30261 from smithfarm/wip-41724-nautilus
Yuri Weinstein [Sat, 16 Nov 2019 15:59:33 +0000 (07:59 -0800)]
Merge pull request #30261 from smithfarm/wip-41724-nautilus

nautilus: build/ops: fix build fail related to PYTHON_EXECUTABLE variable

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #30215 from sebastian-philipp/nautilus-k8sevents
Yuri Weinstein [Sat, 16 Nov 2019 15:58:39 +0000 (07:58 -0800)]
Merge pull request #30215 from sebastian-philipp/nautilus-k8sevents

nautilus: mgr/k8sevents: Initial ceph -> k8s events integration

Reviewed-by: Boris Ranto <branto@redhat.com>
Reviewed-by: Yuri Weinstein <yweinste@redhat.com>
Reviewed-by: Paul Cuzner <pcuzner@redhat.com>
5 years agoMerge pull request #30016 from smithfarm/wip-41509-nautilus
Yuri Weinstein [Sat, 16 Nov 2019 15:56:17 +0000 (07:56 -0800)]
Merge pull request #30016 from smithfarm/wip-41509-nautilus

nautilus: mgr/zabbix: encode string for Python 3 compatibility

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #30006 from smithfarm/wip-40043-nautilus
Yuri Weinstein [Sat, 16 Nov 2019 15:54:43 +0000 (07:54 -0800)]
Merge pull request #30006 from smithfarm/wip-40043-nautilus

nautilus: mgr/zabbix: Fix typo in key name for PGs in backfill_wait state

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
5 years agoMerge pull request #29949 from smithfarm/wip-41282-nautilus
Yuri Weinstein [Sat, 16 Nov 2019 15:52:47 +0000 (07:52 -0800)]
Merge pull request #29949 from smithfarm/wip-41282-nautilus

nautilus: bluestore: tool to check fragmentation

5 years agoMerge pull request #30046 from smithfarm/wip-40270-nautilus
Yuri Weinstein [Sat, 16 Nov 2019 15:51:46 +0000 (07:51 -0800)]
Merge pull request #30046 from smithfarm/wip-40270-nautilus

nautilus: build/ops: make patch build dependency explicit

5 years agoMerge pull request #30089 from tchaikov/wip-nautilus-gcc-8
Yuri Weinstein [Sat, 16 Nov 2019 15:50:55 +0000 (07:50 -0800)]
Merge pull request #30089 from tchaikov/wip-nautilus-gcc-8

nautilus: build/ops: use gcc-8

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge PR #30008 into nautilus
Sage Weil [Fri, 15 Nov 2019 23:17:07 +0000 (17:17 -0600)]
Merge PR #30008 into nautilus

* refs/pull/30008/head:
mgr/pg_autoscaler: fix race with pool deletion

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
5 years agoMerge PR #30851 into nautilus
Sage Weil [Fri, 15 Nov 2019 23:16:43 +0000 (17:16 -0600)]
Merge PR #30851 into nautilus

* refs/pull/30851/head:
doc/mgr/crash: document missing commands, options
qa/suites/rados/singleton/all/test-crash: whitelist RECENT_CRASH
qa/suites/rados/mgr/tasks/insights: whitelist RECENT_CRASH
qa/tasks/mgr/test_insights: crash module now rejects bad crash reports
mgr/crash: don't make these methods static
mgr/BaseMgrModule: handle unicode health detail strings
mgr/crash: verify timestamp is valid
qa/suites/mgr: whitelist RECENT_CRASH
mgr/crash: remove unused var
mgr/crash: remove unused import 'six'
qa/workunits/rados/test_crash: health check
mgr/crash: improve validation on post
mgr/crash: automatically prune old crashes after a year
mgr/crash: raise RECENT_CRASH warning for recent (new) crashes
mgr/crash: add 'crash ls-new'
mgr/crash: add option and serve infra
mgr/crash: keep copy of crashes in memory
mgr/pg_autoscaler: adjust style to match built-in tables
mgr/crash: make 'crash ls' a nice table with a NEW column
mgr/crash: nicely format 'crash info' output
mgr/crash: add 'crash archive <id>', 'crash archive-all' commands

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge PR #30849 into nautilus
Sage Weil [Fri, 15 Nov 2019 23:16:30 +0000 (17:16 -0600)]
Merge PR #30849 into nautilus

* refs/pull/30849/head:
mgr/dashboard: fix mgr module API tests
qa/tasks/mgr/dashboard/test_mgr_module: remove enable/disable test from MgrModuleTelemetryTest
qa/tasks/mgr/dashboard/test_mgr_module: sync w/ telemetry
mgr/dashboard/qa: add more fields to report
Merge branch 'nautilus' into wip-device-telemetry-nautilus
PendingReleaseNotes: fix typo
PendingReleaseNotes: remove kludge
mgr/telemetry: add stats about crush map
mgr/telemetry: add rgw metadata
mgr/telemetry: include fs size (files, bytes, snaps)
mds: report r{files,bytes,snaps} via perfcounters
mgr/telemetry: mds cache stats
mgr/telemetry: add some rbd metadata
mgr/telemetry: note whether osd cluster_network is in use
mgr/telemetry: add host counts
mgr/telemetry: add more pool metadata
mgr/telemetry: remove crush rule name
mgr/telemetry: include min_mon_release and msgr v1 vs v2 addr count
mgr/telemetry: add CephFS metadata
mgr/telemetry: include balancer info (active=true/false, mode)
mgr/telemetry: include per-pool pg_autoscale info
mgr/telemetry: dict.pop() errs on nonexistent key
mgr/telemetry: send device telemetry via per-host POST to device endpoint
mgr/telemetry: fix remote into crash do_ls()
mgr/telemetry: clear the event after being awaken by it
mgr/telemetry: bump content revision and add a release note
telemetry/server: add device report endpoint
mgr/telemetry: include device telemetry
mgr/telemetry: salt osd ids too
mgr/telemetry: obscure entity_name with a salt
mgr/telemetry: force re-opt-in if the report contents change
mgr/telemetry: less noise in the log
mgr/telemetry: wake up serve on config change
mgr/telemetry: track telemetry report revisions
qa/tasks/mgr/dashboard/test_mgr_module: adjust expected schema
mgr/telemetry: separate out cluster config vs running daemons
mgr/telemetry: include any config options that are customized
mgr/telemetry: specify license when opting in
doc/mgr/telemetry: update
mgr/telemetry: move contact info to an 'ident' channel
mgr/telemetry: accept channel list to 'telemetry show'
mgr/telemetry: always generate new report for 'telemetry show'
mgr/telemetry: add 'device' channel and call out to devicehealth module
mgr/telemetry: add telemetry channel 'device'
mgr/telemetry: add separate channels
mgr/devicehealth: pull out MAX_SAMPLES

Reviewed-by: Wido den Hollander <wido@42on.com>
5 years agoMerge pull request #31605 from rhcs-dashboard/42795-fixtypo
Nathan Cutler [Fri, 15 Nov 2019 22:47:24 +0000 (23:47 +0100)]
Merge pull request #31605 from rhcs-dashboard/42795-fixtypo

nautilus: common: fix typo in rgw_user_max_buckets option long description.

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
5 years agoMerge pull request #31334 from LongDuncan/nautilus
Yuri Weinstein [Fri, 15 Nov 2019 22:41:10 +0000 (14:41 -0800)]
Merge pull request #31334 from LongDuncan/nautilus

nautilus: mgr/restful: requests api adds support multiple commands

Reviewed-by: Boris Ranto <branto@redhat.com>
5 years agoMerge pull request #31304 from smithfarm/wip-42545-nautilus
Yuri Weinstein [Fri, 15 Nov 2019 22:40:30 +0000 (14:40 -0800)]
Merge pull request #31304 from smithfarm/wip-42545-nautilus

nautilus: qa/tasks/cbt: run stop-all.sh while shutting down

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #31040 from smithfarm/wip-41495-nautilus
Yuri Weinstein [Fri, 15 Nov 2019 22:39:58 +0000 (14:39 -0800)]
Merge pull request #31040 from smithfarm/wip-41495-nautilus

nautilus: tests: add debugging failed osd-release setting

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
5 years agoMerge pull request #31019 from ifed01/wip-42041-nautilus
Yuri Weinstein [Fri, 15 Nov 2019 22:39:31 +0000 (14:39 -0800)]
Merge pull request #31019 from ifed01/wip-42041-nautilus

nautilus: core: os/bluestore: fix objectstore_blackhole read-after-write

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
5 years agoMerge pull request #30983 from tchaikov/wip-nautilus-42363
Yuri Weinstein [Fri, 15 Nov 2019 22:39:02 +0000 (14:39 -0800)]
Merge pull request #30983 from tchaikov/wip-nautilus-42363

nautilus: build/ops: python3-cephfs should provide python36-cephfs

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
5 years agoMerge pull request #31097 from smithfarm/wip-42395-nautilus
Yuri Weinstein [Fri, 15 Nov 2019 22:38:21 +0000 (14:38 -0800)]
Merge pull request #31097 from smithfarm/wip-42395-nautilus

nautilus: common/ceph_context: avoid unnecessary wait during service thread shutdown

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
5 years agoMerge pull request #29592 from penglaiyxy/wip-simple-messenger
Yuri Weinstein [Fri, 15 Nov 2019 22:35:06 +0000 (14:35 -0800)]
Merge pull request #29592 from penglaiyxy/wip-simple-messenger

nautilus: msg/simple: reset in_seq_acked to zero when session is reset

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agomgr/dashboard: fix mgr module API tests 30849/head
alfonsomthd [Tue, 13 Aug 2019 10:15:38 +0000 (12:15 +0200)]
mgr/dashboard: fix mgr module API tests

Signed-off-by: alfonsomthd <almartin@redhat.com>
(cherry picked from commit 6e6711a1e217042390b379f98c0ec064ab4e2702)

5 years agoqa/tasks/mgr/dashboard/test_mgr_module: remove enable/disable test from MgrModuleTele...
Kefu Chai [Tue, 13 Aug 2019 01:54:24 +0000 (09:54 +0800)]
qa/tasks/mgr/dashboard/test_mgr_module: remove enable/disable test from MgrModuleTelemetryTest

telemetry is always enabled since 2d62d71cd46d791294b3803e034c0995fef08b33

Fixes: https://tracker.ceph.com/issues/41186
Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit cc3ae85b05b759fd6ac955d2e798d5fe3a109294)

5 years agoqa/tasks/mgr/dashboard/test_mgr_module: sync w/ telemetry
Kefu Chai [Wed, 7 Aug 2019 07:23:19 +0000 (15:23 +0800)]
qa/tasks/mgr/dashboard/test_mgr_module: sync w/ telemetry

* use primitive types instead of `JLeaf(the_type)` as they are
  equivalent in this context
* remove fields which are added only if certain channels are
  activated.
* allow unknown fields, as we are including various stuff
  in the report, for instance, osdmap, usage, crash info, etc.

Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit 3303116f5681f317dee53988e1de9d840d250884)

5 years agomgr/dashboard/qa: add more fields to report
Kefu Chai [Fri, 26 Jul 2019 17:50:30 +0000 (01:50 +0800)]
mgr/dashboard/qa: add more fields to report

to be in sync with #28847

Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit d6170e70b6d1d634be6af5540d85572a9c425d0c)

5 years agomgr: Improve balancer module status 31682/head
David Zafman [Thu, 24 Oct 2019 00:00:14 +0000 (17:00 -0700)]
mgr: Improve balancer module status

Add balancer status fields so that slow optimizations can be detected

Signed-off-by: David Zafman <dzafman@redhat.com>
(cherry picked from commit f04c505b9dc128bdfbcca49d82f8aac4abf8b56f)

5 years agotest: Test balancer module commands
David Zafman [Wed, 23 Oct 2019 23:38:48 +0000 (16:38 -0700)]
test: Test balancer module commands

Signed-off-by: David Zafman <dzafman@redhat.com>
(cherry picked from commit 3a0e2c8ff1cce44bf44b139572f4d1bd9bbfb766)

5 years agomgr: Release GIL before calling OSDMap::calc_pg_upmaps()
David Zafman [Tue, 22 Oct 2019 22:24:05 +0000 (15:24 -0700)]
mgr: Release GIL before calling OSDMap::calc_pg_upmaps()

Prevent optimize and execute commands from running with active balancer

Fixes: https://tracker.ceph.com/issues/42432
Signed-off-by: David Zafman <dzafman@redhat.com>
(cherry picked from commit e2a35e8c8e9f381a635ad0ca01326a2c512590a9)

5 years agoqa/mgr/balancer: Add cram based test for altering target_max_misplaced_ratio setting
Shyukri Shyukriev [Thu, 26 Sep 2019 08:24:08 +0000 (11:24 +0300)]
qa/mgr/balancer: Add cram based test for altering target_max_misplaced_ratio setting

Signed-off-by: Shyukri Shyukriev <shshyukriev@suse.com>
(cherry picked from commit 37a45deb5bb435afd056a05d09cf691bb36f2086)

5 years agorgw: use explicit to_string() overload for boost::string_ref 31650/head
Casey Bodley [Tue, 7 May 2019 18:08:25 +0000 (14:08 -0400)]
rgw: use explicit to_string() overload for boost::string_ref

Fixes: http://tracker.ceph.com/issues/39611
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit 04c326795d2afe63c679f2542565763fee6acc09)

Conflicts:
    src/rgw/rgw_json_enc.cc
Signed-off-by: Ulrich Weigand <ulrich.weigand@de.ibm.com>
5 years agodoc/mgr/crash: document missing commands, options 30851/head
Sage Weil [Wed, 24 Jul 2019 17:57:18 +0000 (12:57 -0500)]
doc/mgr/crash: document missing commands, options

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 1ea7570bb1b637a436c209dcc4559e206a20ad42)

5 years agoqa/suites/rados/singleton/all/test-crash: whitelist RECENT_CRASH
Sage Weil [Mon, 22 Jul 2019 22:13:30 +0000 (17:13 -0500)]
qa/suites/rados/singleton/all/test-crash: whitelist RECENT_CRASH

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 9257175f086e7ca36189badbac192522856dbcce)

5 years agoqa/suites/rados/mgr/tasks/insights: whitelist RECENT_CRASH
Sage Weil [Fri, 19 Jul 2019 19:10:22 +0000 (14:10 -0500)]
qa/suites/rados/mgr/tasks/insights: whitelist RECENT_CRASH

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 209ce4ec6889a0a012fb862238c454738adb4ff2)

5 years agoqa/tasks/mgr/test_insights: crash module now rejects bad crash reports
Sage Weil [Thu, 18 Jul 2019 14:31:09 +0000 (09:31 -0500)]
qa/tasks/mgr/test_insights: crash module now rejects bad crash reports

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 3bddcc5ddf1a96413a9efa439b167a471eee362d)

5 years agomgr/crash: don't make these methods static
Sage Weil [Wed, 17 Jul 2019 22:00:57 +0000 (17:00 -0500)]
mgr/crash: don't make these methods static

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 32a4b510aa93664f2beaadecedc9ce6e8e87b931)

5 years agomgr/BaseMgrModule: handle unicode health detail strings
Sage Weil [Wed, 17 Jul 2019 16:48:50 +0000 (11:48 -0500)]
mgr/BaseMgrModule: handle unicode health detail strings

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 52875c6cb2c615d1070a456d0e1dcc708d5fd5db)

5 years agomgr/crash: verify timestamp is valid
Sage Weil [Wed, 17 Jul 2019 16:11:01 +0000 (11:11 -0500)]
mgr/crash: verify timestamp is valid

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 277d974b4a74fa40d0305bdc5afc66e2f2186576)

5 years agoqa/suites/mgr: whitelist RECENT_CRASH
Sage Weil [Wed, 17 Jul 2019 15:55:33 +0000 (10:55 -0500)]
qa/suites/mgr: whitelist RECENT_CRASH

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit e2ff58ba166efb42836466c745a4b9d136810a00)

5 years agomgr/crash: remove unused var
Sage Weil [Wed, 17 Jul 2019 14:36:11 +0000 (09:36 -0500)]
mgr/crash: remove unused var

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 37a8f2d66ac8330ca72d7a13dd2864529a87edbb)

5 years agomgr/crash: remove unused import 'six'
Sage Weil [Wed, 17 Jul 2019 14:35:57 +0000 (09:35 -0500)]
mgr/crash: remove unused import 'six'

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 5b2cbb3a10f8011fbc3d5245801009557404ddc5)

5 years agoqa/workunits/rados/test_crash: health check
Sage Weil [Tue, 16 Jul 2019 14:26:21 +0000 (09:26 -0500)]
qa/workunits/rados/test_crash: health check

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit f6e0894902a6646e73e3db123d48fe2fac9570ea)

5 years agomgr/crash: improve validation on post
Sage Weil [Tue, 16 Jul 2019 14:18:50 +0000 (09:18 -0500)]
mgr/crash: improve validation on post

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 422871d63ea8069453c435bd5559bea68f942eaf)

5 years agomgr/crash: automatically prune old crashes after a year
Sage Weil [Sun, 14 Jul 2019 16:31:56 +0000 (11:31 -0500)]
mgr/crash: automatically prune old crashes after a year

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit b2e20858f42e3775adda4bd054fc8fa15e205453)

5 years agomgr/crash: raise RECENT_CRASH warning for recent (new) crashes
Sage Weil [Thu, 10 Oct 2019 17:46:36 +0000 (12:46 -0500)]
mgr/crash: raise RECENT_CRASH warning for recent (new) crashes

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit c885ee7f0c9c7c232fda81bfd6f9eca0e182ee3d)

# Conflicts:
# doc/rados/operations/health-checks.rst
- TELEMETRY_CHANGED alert order in doc

5 years agomgr/crash: add 'crash ls-new'
Sage Weil [Sun, 14 Jul 2019 16:26:41 +0000 (11:26 -0500)]
mgr/crash: add 'crash ls-new'

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit bebb1c31006ff3cba67831879b34699cf111f945)

5 years agomgr/crash: add option and serve infra
Sage Weil [Sat, 13 Jul 2019 16:06:41 +0000 (11:06 -0500)]
mgr/crash: add option and serve infra

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 7cbaa5ac563bf0be7dd2227ef8a1ae7d0ae20143)

5 years agomgr/crash: keep copy of crashes in memory
Sage Weil [Sat, 13 Jul 2019 15:39:41 +0000 (10:39 -0500)]
mgr/crash: keep copy of crashes in memory

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 6ae4c42bae80c732391e200d56f512d4ea639504)

5 years agomgr/pg_autoscaler: adjust style to match built-in tables
Sage Weil [Sat, 13 Jul 2019 13:35:01 +0000 (08:35 -0500)]
mgr/pg_autoscaler: adjust style to match built-in tables

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 44a99f2f7692e2ab2a74f8a0df983a81a3dea299)

5 years agomgr/crash: make 'crash ls' a nice table with a NEW column
Sage Weil [Fri, 12 Jul 2019 21:34:37 +0000 (16:34 -0500)]
mgr/crash: make 'crash ls' a nice table with a NEW column

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit c691f2f8763a9db081a0b61294c5eedf4e9c2cee)