]>
git.apps.os.sepia.ceph.com Git - ceph.git/log
Or Friedmann [Thu, 2 Jan 2020 09:51:00 +0000 (11:51 +0200)]
cls/rgw: when object is versioned and lc transition it, the object is becoming non-current
when object is versioned and lc transition it, the object is becoming non-current
Signed-off-by: Or Friedmann <ofriedma@redhat.com>
Fixes: https://tracker.ceph.com/issues/43444
(cherry picked from commit
5f37ca283141df76a6f698ae4d7a23772b8b9e1b )
Casey Bodley [Mon, 2 Dec 2019 21:59:05 +0000 (16:59 -0500)]
rgw: apply_olh_log ignores RGW_ATTR_OLH_VER decode error
this resolves test failures that return 400 Bad Request after:
apply_olh_log failed to decode olh ver ''
because olh_init_modification_impl() is writing an empty attribute:
bufferlist verbl;
op.setxattr(RGW_ATTR_OLH_VER, verbl);
on such decode errors, link_epoch will be set to 0, and will correctly
be overwritten by real epochs from the olh log
Fixes: https://tracker.ceph.com/issues/39142
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit
36c54a601c62894d0dccec49322cf7ea6bbb7d02 )
Casey Bodley [Fri, 1 Nov 2019 14:48:41 +0000 (10:48 -0400)]
rgw: allow apply_olh_log to rewrite the same olh version
if two zones write an object version with the same olh epoch,
apply_olh_log needs to be able to write the more-current instance at the
same epoch
Fixes: https://tracker.ceph.com/issues/39142
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit
d78aa3f4d4e283726d9c3b35a477b238df6b5af1 )
Casey Bodley [Fri, 1 Nov 2019 14:38:52 +0000 (10:38 -0400)]
rgw: apply_olh_log filters out older instances of same epoch
when apply_olh_log() detects multiple instances with the same epoch, we
only promote the one that the bucket index lists as more current
Fixes: https://tracker.ceph.com/issues/39142
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit
15aa3ad341ab0df128464d22cd97bd33f185e41a )
Casey Bodley [Fri, 22 Nov 2019 19:50:11 +0000 (14:50 -0500)]
rgw: factor out decode_olh_info()
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit
ef039b27df93bf89c95724d13ba82324813c3aae )
Casey Bodley [Wed, 30 Oct 2019 15:21:06 +0000 (11:21 -0400)]
cls/rgw: only promote instance entries if they sort after current instance
to support bidirectional replication, where each zone could create its
own instances with the same olh epoch, the sort order of those instances
should be used to determine whether an entry should be promoted over the
current instance
Fixes: https://tracker.ceph.com/issues/39142
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit
6f52900c817c536431f76de8f72ea9c94d5f2a99 )
Casey Bodley [Wed, 9 Oct 2019 15:43:23 +0000 (11:43 -0400)]
test/rgw: add test_concurrent_versioned_object_incremental_sync
Signed-off-by: Casey Bodley <cbodley@redhat.com>
(cherry picked from commit
a078120512260c6ccf74acefe6f9f50e78803996 )
Sébastien Han [Tue, 21 Jan 2020 16:34:20 +0000 (17:34 +0100)]
Merge pull request #32743 from leseb/fast-shutdown-bkp
nautilus: osd: add osd_fast_shutdown option (default true)
Jan Fajerski [Tue, 21 Jan 2020 13:28:45 +0000 (14:28 +0100)]
Merge pull request #31554 from jan--f/wip-42703-nautilus
nautilus: ceph-volume: reject disks smaller then 5GB in inventory
Jan Fajerski [Tue, 21 Jan 2020 13:27:44 +0000 (14:27 +0100)]
Merge pull request #31553 from jan--f/wip-42741-nautilus
nautilus: ceph-volume: use fsync for dd command
Sage Weil [Sat, 23 Nov 2019 14:55:00 +0000 (08:55 -0600)]
qa/standalone/ceph-helpers.sh: remove osd down check
A kill doesn't induce a mark-down of the OSD with osd_fast_shutdown=true.
Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit
3a62d166a7af5a62d5210417a5c10f101ce75229 )
Sage Weil [Wed, 20 Nov 2019 02:03:44 +0000 (20:03 -0600)]
qa/standalone/ceph-helpers.sh: destroy_osd: mark osd down
Stopping the OSD doesn't guarantee that it will be marked down.
Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit
ede1d3677310bd152b3493e8a84da1e648fd3ea9 )
Sage Weil [Fri, 15 Nov 2019 15:31:50 +0000 (09:31 -0600)]
osd: add osd_fast_shutdown option (default true)
If we get a SIGINT or SIGTERM or are deleted from the OSDMap, do a fast
shutdown by exiting immediately. This has a few important benefits:
- We immediately stop responding (binding) to any sockets, which means
other OSDs will immediately decide we are down (and dead!). This
minimizes IO interruption.
- We avoid the complex "clean" shutdown process, which is historically a
source of bugs.
In reality, the only purpose of the "clean" shutdown is to try to tear down
everything in memory so we can do memory leak checking with valgrind. Set
this option to false for valgrind QA runs so we can still do that.
Not that with the new read leases in octopus, we rely on the default
behavior that a ECONNREFUSED is taken to mean that the OSD is fully dead,
so that we don't have to wait for any leases to time out. This works in
sane environments with normal IP networks, but that behavior could
conceivably be a bad idea if there are some weird network shenanigans
going on. If osd_fast_fail_on_connection_refused were disabled, then this
fast shutdown procedure might be *worse* than the clean shutdown because
we would have to wait for the heartbeat timeout.
Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit
cf352c3ac0bd87d8b7e0c52ac724f94576ae5aa7 )
Yuri Weinstein [Mon, 20 Jan 2020 21:17:52 +0000 (13:17 -0800)]
Merge pull request #32078 from smithfarm/wip-43141-nautilus
nautilus: tools/cephfs: make 'cephfs-data-scan scan_links' fix dentry's first
Reviewed-by: Ramana Raja <rraja@redhat.com>
Yuri Weinstein [Mon, 20 Jan 2020 19:57:40 +0000 (11:57 -0800)]
Merge pull request #32077 from smithfarm/wip-43138-nautilus
nautilus: mds: remove unnecessary debug warning
Reviewed-by: Ramana Raja <rraja@redhat.com>
Yuri Weinstein [Mon, 20 Jan 2020 19:57:00 +0000 (11:57 -0800)]
Merge pull request #32075 from smithfarm/wip-43001-nautilus
nautilus: tests/cephfs: Ignore "ceph.dir.pin: No such attribute errors" in getfattr tests for old kernel client
Reviewed-by: Ramana Raja <rraja@redhat.com>
Yuri Weinstein [Mon, 20 Jan 2020 19:56:30 +0000 (11:56 -0800)]
Merge pull request #32073 from smithfarm/wip-42949-nautilus
nautilus: mds: properly evaluate unstable locks when evicting client
Reviewed-by: Ramana Raja <rraja@redhat.com>
Yuri Weinstein [Mon, 20 Jan 2020 19:55:55 +0000 (11:55 -0800)]
Merge pull request #32072 from smithfarm/wip-43170-nautilus
nautilus: tests/multimds: ignore RECENT_CRASH for multimds snapshot testing
Reviewed-by: Ramana Raja <rraja@redhat.com>
Laura Paduano [Mon, 20 Jan 2020 14:41:41 +0000 (15:41 +0100)]
Merge pull request #32233 from s0nea/wip-43159-nautilus
nautilus: mgr/dashboard: KeyError on dashboard reload
Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Yuri Weinstein <yweinste@redhat.com>
Reviewed-by: Patrick Seidensal <pseidensal@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Laura Paduano [Mon, 20 Jan 2020 09:50:20 +0000 (10:50 +0100)]
Merge pull request #31789 from rhcs-dashboard/wip-42808-nautilus
nautilus: mgr/dashboard: key-value-table doesn't render booleans
Reviewed-by: Ernesto Puertat <epuertat@redhat.com>
Reviewed-by: Patrick Seidensal <pseidensal@suse.com>
Yuri Weinstein [Sat, 18 Jan 2020 16:27:07 +0000 (08:27 -0800)]
Merge pull request #31741 from joscollin/wip-42886-nautilus
nautilus: mgr/volumes: allow setting uid, gid of subvolume and subvolume group during creation
Reviewed-by: Ramana Raja <rraja@redhat.com>
Yuri Weinstein [Sat, 18 Jan 2020 16:26:16 +0000 (08:26 -0800)]
Merge pull request #32071 from smithfarm/wip-42650-nautilus
nautilus: mds: no assert on frozen dir when scrub path
Reviewed-by: Ramana Raja <rraja@redhat.com>
Yuri Weinstein [Fri, 17 Jan 2020 21:49:16 +0000 (13:49 -0800)]
Merge pull request #31802 from batrick/i42943
nautilus: mds: free heap memory may grow too large for some workloads
Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
Reviewed-by: Mark Nelson <mnelson@redhat.com>
Yuri Weinstein [Fri, 17 Jan 2020 21:48:09 +0000 (13:48 -0800)]
Merge pull request #32065 from smithfarm/wip-42631-nautilus
nautilus: cephfs: client: add warning when cap != in->auth_cap.
Reviewed-by: Ramana Raja <rraja@redhat.com>
Yuri Weinstein [Fri, 17 Jan 2020 21:46:35 +0000 (13:46 -0800)]
Merge pull request #32012 from rhcs-dashboard/wip-43123-nautilus
nautilus: mgr/dashboard: Cross sign button not working for some modals
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Yuri Weinstein [Fri, 17 Jan 2020 21:45:14 +0000 (13:45 -0800)]
Merge pull request #32128 from votdev/issue_43079
nautilus: mgr/dashboard: Hardening accessing the metadata
Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Yuri Weinstein [Fri, 17 Jan 2020 20:27:25 +0000 (12:27 -0800)]
Merge pull request #31784 from rhcs-dashboard/wip-42773-nautilus
nautilus: mgr/dashboard: Remove compression mode unset in pool from
Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Yuri Weinstein [Fri, 17 Jan 2020 20:26:22 +0000 (12:26 -0800)]
Merge pull request #31999 from rhcs-dashboard/wip-43115-nautilus
nautilus: mgr/dashboard: grafana charts match time picker selection.
Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Kefu Chai [Thu, 16 Jan 2020 09:52:15 +0000 (17:52 +0800)]
Merge pull request #32658 from tchaikov/nautilus-remove-seastar-test
nautilus: cmake: remove seastar tests from "make check"
Reviewed-by: Yuri Weinstein <yweinste@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Yuri Weinstein [Wed, 15 Jan 2020 16:54:46 +0000 (08:54 -0800)]
Merge pull request #32063 from smithfarm/wip-42878-nautilus
nautilus: common/admin_socket: Increase socket timeouts
Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
Yuri Weinstein [Wed, 15 Jan 2020 16:42:52 +0000 (08:42 -0800)]
Merge pull request #31850 from smithfarm/wip-43007-nautilus
nautilus: common/options: remove unused ms_msgr2_{sign,encrypt}
Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Yuri Weinstein [Wed, 15 Jan 2020 16:42:03 +0000 (08:42 -0800)]
Merge pull request #32059 from smithfarm/wip-41954-nautilus
nautilus: tests/krbd: avoid hexdump skip and length options
Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
Yuri Weinstein [Wed, 15 Jan 2020 16:41:34 +0000 (08:41 -0800)]
Merge pull request #31848 from smithfarm/wip-42989-nautilus
nautilus: tests: kernel.sh: update for read-only changes
Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
Yuri Weinstein [Wed, 15 Jan 2020 16:41:01 +0000 (08:41 -0800)]
Merge pull request #31782 from rhcs-dashboard/wip-42809-nautilus
nautilus: mgr/dashboard: Handle always-on Ceph Manager modules correctly
Reviewed-by: Volker Theile <vtheile@suse.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Yuri Weinstein [Wed, 15 Jan 2020 16:39:17 +0000 (08:39 -0800)]
Merge pull request #31697 from k0ste/wip-42850-nautilus
nautilus: pybind/mgr: Cancel output color control
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
Kefu Chai [Wed, 15 Jan 2020 16:20:49 +0000 (00:20 +0800)]
cmake: remove seastar tests from "make check"
because crimson is released yet, it does not make sense to run seaetar
based tests in LTS branches.
Signed-off-by: Kefu Chai <kchai@redhat.com>
Conflicts: this change is not cherry-picked from master. as explained
in the commit message above. we need to use these seastar based
tests to verify that the crimson facilities are not broken in master.
but it does not help to run them in nautilus.
Patrick Seidensal [Thu, 7 Nov 2019 15:57:26 +0000 (15:57 +0000)]
mgr/dashboard: KeyError on dashboard reload
When reloading the dashboard using `ceph mgr module disable/enable
dashbaord`, the error is thrown shortly after the dashboard module has
been reactivated, because `dashboard` is not yet available in
`services`. A second attempt works.
Fixes: https://tracker.ceph.com/issues/42684
Signed-off-by: Patrick Seidensal <pseidensal@suse.com>
(cherry picked from commit
808f0bf5e0adf4abda192758edbccdee3d4113d2 )
Kefu Chai [Wed, 15 Jan 2020 15:37:19 +0000 (23:37 +0800)]
Merge pull request #32651 from tchaikov/nautilus-dts-8-on-arm64
nautilus: build/ops: install-deps,rpm: enable devtoolset-8 on aarch64 also
Reviewed-by: David Galloway <dgallowa@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
Laura Paduano [Wed, 15 Jan 2020 15:29:05 +0000 (16:29 +0100)]
Merge pull request #31791 from rhcs-dashboard/wip-42935-nautilus
nautilus: mgr/dashboard: sort monitors by open sessions correctly.
Reviewed-by: Ernesto Puertat <epuertat@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Kefu Chai [Wed, 3 Apr 2019 03:08:04 +0000 (11:08 +0800)]
install-deps,rpm: enable devtoolset-8 on aarch64 also
in
5ae3b06e , we left aarch64 with devtoolset-7, but aarch64 builders are
also suffering from http://tracker.ceph.com/issues/38892. so i installed
devtoolset-8 on all aarch64 builders manually from the rpm packages
downloaded from koji builder:
- https://cbs.centos.org/koji/buildinfo?buildID=24923
- https://cbs.centos.org/koji/buildinfo?buildID=24931
libasan5, libubsan1 are not installed.
Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit
00f19923b4225c25480ddb3c09a898a2444fbeb9 )
Yuri Weinstein [Tue, 14 Jan 2020 20:35:30 +0000 (12:35 -0800)]
Merge pull request #31646 from batrick/i42818
nautilus: global: disable THP for Ceph daemons
Yuri Weinstein [Tue, 14 Jan 2020 20:34:39 +0000 (12:34 -0800)]
Merge pull request #31082 from smithfarm/wip-42279-nautilus
nautilus: tests/ceph.py: tolerate ECONNRESET errcode during logrotate
Yuri Weinstein [Tue, 14 Jan 2020 20:33:59 +0000 (12:33 -0800)]
Merge pull request #30820 from liewegas/wip-alerts-nautilus
nautilus: mgr/alerts: simple health alerts
Yuri Weinstein [Tue, 14 Jan 2020 20:33:17 +0000 (12:33 -0800)]
Merge pull request #30765 from smithfarm/wip-42129-nautilus
nautilus: doc/ceph-fuse: mention -k option in ceph-fuse man page
Reviewed-by: Jan Fajerski <jfajerski@suse.com>
Yuri Weinstein [Tue, 14 Jan 2020 20:32:24 +0000 (12:32 -0800)]
Merge pull request #30739 from smithfarm/wip-41849-nautilus
nautilus: tools/setup-virtualenv.sh: do not default to python2.7
Reviewed-by: Kefu Chai <kchai@redhat.com>
Yuri Weinstein [Tue, 14 Jan 2020 20:14:40 +0000 (12:14 -0800)]
Merge pull request #30009 from smithfarm/wip-40126-nautilus
nautilus: mgr/zabbix: Adds possibility to send data to multiple zabbix servers.
Reviewed-by: Wido den Hollander <wido@widodh.nl>
Nathan Cutler [Fri, 27 Dec 2019 09:55:21 +0000 (10:55 +0100)]
make-dist: drop Python 2/3 autoselect
virtualenv will prefer Python 3 over Python 2 if both are available.
Signed-off-by: Nathan Cutler <ncutler@suse.com>
(cherry picked from commit
249bf81a32ff6d7046e525b947718d49b2314c13 )
Nathan Cutler [Fri, 13 Sep 2019 14:12:52 +0000 (16:12 +0200)]
tools/setup-virtualenv.sh: do not default to python2.7
This commit changes the script's behavior when run without a --python option.
Before, we were running virtualenv with "--python python2.7" in that case.
That is not a reasonable default in September 2019, given that Python 2 EOL is
coming on January 1, 2020. Also, it breaks setup-virtualenv.sh in py3-only
environments.
With this patch, the script will not pass any "--python" option to virtualenv
(i.e., it will let virtualenv do whatever it thinks is best) in this case.
Fixes: https://tracker.ceph.com/issues/41821
Signed-off-by: Nathan Cutler <ncutler@suse.com>
(cherry picked from commit
78468e49ab2110d69bc34333c0ce90acb832de1a )
Yuri Weinstein [Tue, 14 Jan 2020 01:09:14 +0000 (17:09 -0800)]
Merge pull request #32593 from trociny/wip-43500-nautilus
nautilus: rbd-mirror: make logrotate work
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Yuri Weinstein [Tue, 14 Jan 2020 01:08:33 +0000 (17:08 -0800)]
Merge pull request #32447 from trociny/wip-43428-nautilus
nautilus: rbd-mirror: fix 'rbd mirror status' asok command output
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Yuri Weinstein [Tue, 14 Jan 2020 01:07:51 +0000 (17:07 -0800)]
Merge pull request #32086 from dillaman/wip-42630-nautilus
nautilus: mgr: add 'rbd' profiles to support 'rbd_support' module commands
Reviewed-by: Mykola Golub <mgolub@mirantis.com>
Neha Ojha [Mon, 13 Jan 2020 17:45:45 +0000 (09:45 -0800)]
Merge pull request #32167 from rzarzynski/wip-fips-zeroize-memset_bzero_nautilus
nautilus: common: FIPS: audit and switch some memset & bzero users
Reviewed-by: Neha Ojha <nojha@redhat.com>
Yuri Weinstein [Mon, 13 Jan 2020 16:29:07 +0000 (08:29 -0800)]
Merge pull request #31332 from joscollin/wip-41182-nautilus
nautilus: mgr/volumes: fs subvolume resize command
Yuri Weinstein [Mon, 13 Jan 2020 16:28:18 +0000 (08:28 -0800)]
Merge pull request #31302 from smithfarm/wip-42142-nautilus
nautilus: mds: split the dir if the op makes it oversized, because some ops maybe in flight
Yuri Weinstein [Mon, 13 Jan 2020 16:27:47 +0000 (08:27 -0800)]
Merge pull request #31084 from smithfarm/wip-42424-nautilus
nautilus: tests: whitelist "Error recovering journal" for cephfs-data-scan
Yuri Weinstein [Mon, 13 Jan 2020 16:27:10 +0000 (08:27 -0800)]
Merge pull request #31083 from smithfarm/wip-42422-nautilus
nautilus: tests/cephfs.py: allow client mount to reset fully
Reviewed-by: Ramana Raja <rraja@redhat.com>
Yuri Weinstein [Mon, 13 Jan 2020 16:25:59 +0000 (08:25 -0800)]
Merge pull request #31081 from smithfarm/wip-42158-nautilus
nautilus: cephfs: osdc/objecter: Fix last_sent in scientific format and add age to ops
Reviewed-by: Ramana Raja <rraja@redhat.com>
Yuri Weinstein [Fri, 10 Jan 2020 20:19:41 +0000 (12:19 -0800)]
Merge pull request #30769 from smithfarm/wip-41888-nautilus
nautilus: cephfs: "client: fix lazyio_synchronize() to update file size" and "libcephfs: Add Tests for LazyIO"
Yuri Weinstein [Fri, 10 Jan 2020 20:18:54 +0000 (12:18 -0800)]
Merge pull request #30767 from smithfarm/wip-42147-nautilus
nautilus: cephfs: mds returns -5(EIO) error when the deleted file does not exist
Yuri Weinstein [Fri, 10 Jan 2020 20:18:13 +0000 (12:18 -0800)]
Merge pull request #30766 from smithfarm/wip-42145-nautilus
nautilus: cephfs: client: remove Inode.dir_contacts field and handle bad whence value to llseek gracefully
Yuri Weinstein [Fri, 10 Jan 2020 20:17:43 +0000 (12:17 -0800)]
Merge pull request #30764 from smithfarm/wip-42121-nautilus
nautilus: cephfs: client: add procession of SEEK_HOLE and SEEK_DATA in lseek
Yuri Weinstein [Fri, 10 Jan 2020 20:17:01 +0000 (12:17 -0800)]
Merge pull request #30763 from smithfarm/wip-42040-nautilus
nautilus: cephfs: client: _readdir_cache_cb() may use the readdir_cache already clear
Yuri Weinstein [Fri, 10 Jan 2020 20:16:26 +0000 (12:16 -0800)]
Merge pull request #30762 from smithfarm/wip-42035-nautilus
nautilus: cephfs: client: EINVAL may be returned when offset is 0
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Yuri Weinstein [Fri, 10 Jan 2020 20:15:42 +0000 (12:15 -0800)]
Merge pull request #30761 from smithfarm/wip-41899-nautilus
nautilus: mds: "apply configuration changes through MDSRank" and "recall caps from quiescent sessions" and "drive cap recall while dropping cache"
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Yuri Weinstein [Fri, 10 Jan 2020 16:13:59 +0000 (08:13 -0800)]
Merge pull request #31518 from trociny/wip-42726-nautilus
nautilus: rbd-mirror: clone v2 mirroring improvements
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Yuri Weinstein [Fri, 10 Jan 2020 16:13:03 +0000 (08:13 -0800)]
Merge pull request #32133 from dillaman/wip-43212-nautilus
nautilus: mgr/dashboard: block mirroring page results in internal server error
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Mykola Golub [Tue, 31 Dec 2019 10:01:31 +0000 (10:01 +0000)]
logrotate: also sighup rbd-mirror
Signed-off-by: Mykola Golub <mgolub@suse.com>
(cherry picked from commit
86424fc3c895995d1d45f067c7852e6dce993027 )
Conflicts:
src/cephadm/cephadm (does not exist)
Mykola Golub [Tue, 31 Dec 2019 09:57:15 +0000 (09:57 +0000)]
rbd-mirror: reopen all contexts logs on SIGHUP
Signed-off-by: Mykola Golub <mgolub@suse.com>
(cherry picked from commit
9ddf111506611a596c713ffe861a41aeda05e7a5 )
Conflicts:
src/tools/rbd_mirror/Mirror.cc (std::lock_guard vs Mutex::Locker)
src/tools/rbd_mirror/PoolReplayer.cc (std::lock_guard vs Mutex::Locker)
Mykola Golub [Sun, 5 Jan 2020 09:10:24 +0000 (09:10 +0000)]
rbd-mirror: delay local/remote rados initialization until context created
We rely on that if a rados ref is initialized it contains the
valid context.
Signed-off-by: Mykola Golub <mgolub@suse.com>
(cherry picked from commit
f3b49191771d2a3a20a7f55a14e0a7482ee96172 )
Jason Dillaman [Fri, 6 Dec 2019 15:16:38 +0000 (10:16 -0500)]
PendingReleaseNotes: reference new MGR profile cap support
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
Jason Dillaman [Sun, 27 Oct 2019 19:56:34 +0000 (15:56 -0400)]
pybind/mgr: use custom exception to handle authorization failures
Python2 does not include the PermissionError exception so use a
custom exception to support both versions.
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit
7683f5f259bbeb6fcfc6a18c8e1a9551e068e847 )
Jason Dillaman [Tue, 22 Oct 2019 15:19:14 +0000 (11:19 -0400)]
qa/workunits/rbd: add permission tests for mgr profile
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit
7cccdef25e3c35a743414d5a7a6e0b10b8878b9b )
Jason Dillaman [Tue, 22 Oct 2019 13:11:34 +0000 (09:11 -0400)]
mgr: added placeholder 'osd' and 'mds' profiles
CephFS documents a previously unhandled profile named 'mds' that
needs to be accepted as valid (but currently provides no caps).
Similarly, the 'osd' cap is deployed in several scenarios as well.
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit
2dc7a959509325f8da23d0baef2509174477398c )
Jason Dillaman [Mon, 14 Oct 2019 16:45:56 +0000 (12:45 -0400)]
doc/rbd: add new 'profile rbd' mgr caps to examples
Fixes: https://tracker.ceph.com/issues/42265
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit
5137cd80db7c9b699378ce22a91fbe25aba321f1 )
Conflicts:
doc/rbd/rbd-kubernetes.rst: doc does not exist
Jason Dillaman [Mon, 14 Oct 2019 16:34:35 +0000 (12:34 -0400)]
pybind/mgr: test session authorization against specific pools/namespaces
Use the optional "pool" and "namespace" constraints for the RBD cap
profiles to ensure the user has access to touch the specified
pool/namespace combo.
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit
cd71413f57fa2285e9349a07449e3fcf345eeb48 )
Jason Dillaman [Mon, 14 Oct 2019 14:39:54 +0000 (10:39 -0400)]
mgr: python modules can now perform authorization tests
In cases where the python service or individual python modules are
enabled via caps, the module might want to perform finer grained
tests to ensure specific commands are allowed. An example of this is
the 'rbd_support' module limiting access by pools and namespaces.
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit
282c31c383856b45caadcefb876a71e39fe4b219 )
Conflicts:
src/mgr/ActivePyModules.cc: tweaked due to changes introduced in
4878509652
src/mgr/DaemonServer.cc: tweaked due to changes introduced in
4878509652
src/mgr/MgrSession.h: trivial resolition
Jason Dillaman [Thu, 17 Oct 2019 13:37:13 +0000 (09:37 -0400)]
mgr: validate that profile caps are actually valid
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit
9193d8762347af65bebdaea673175113f7ccd01a )
Jason Dillaman [Mon, 14 Oct 2019 14:54:44 +0000 (10:54 -0400)]
mgr: added 'profile rbd/rbd-read-only' cap
These profiles can be further restricted via 'pool' and
'namespace' argument optionals.
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit
b0d73aed19a9f3f242d5a13757016759835c164c )
Conflicts:
doc/rados/operations/user-management.rst: trivial resolution
Jason Dillaman [Fri, 11 Oct 2019 16:44:01 +0000 (12:44 -0400)]
mgr: support optional arguments for module and profile caps
This allows an optional, arbitrary key/value constraint clauses to
be appended to "profile XYZ" and "allow module XYZ" caps. A module
can then provide additional validatation against these meta-arguments.
Example:
profile rbd pool=rbd
allow module rbd_support with pool=rbd
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit
cb534e0049afc4f9259812a6624744bbdbaabafa )
Jason Dillaman [Fri, 11 Oct 2019 15:25:56 +0000 (11:25 -0400)]
mgr: add new 'allow module' cap to MgrCap
This allows specific python add-on modules to be whitelisted instead
of manually adding each command exported by the module.
allow module {module-name} {access-spec}
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit
3463613bd43d5fb7f8094c3b9b8a3163325ff196 )
Jason Dillaman [Fri, 11 Oct 2019 14:45:15 +0000 (10:45 -0400)]
mon: dropped daemon type argument for MonCap
This was a placeholder for handling MGR caps within the MonCap
class. Now that the MGR has its own MgrCap class, this is no
longer required.
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit
dbb1b54d492134b677b4e239415c0579e34032b4 )
Conflicts:
src/mon/MonCap.h: trivial resolution
src/mon/Monitor.cc: trivial resolution
Jason Dillaman [Fri, 11 Oct 2019 14:30:03 +0000 (10:30 -0400)]
mgr: stop re-using MonCap for handling MGR caps
Use the existing MonCap as the basis for a new custom MgrCap
processor.
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit
6350bee5c873cb1cef0ca1345b89bff66817e0c1 )
Mykola Golub [Mon, 30 Dec 2019 15:44:32 +0000 (17:44 +0200)]
rbd-mirror: fix 'rbd mirror status' asok command output
This was broken by
def50d04796 , and implicitly fixed during
refactoring in the master (octopus) by
adf1486e46c , hence it is a
direct commit to nautilus branch.
Fixes: https://tracker.ceph.com/issues/43429
Signed-off-by: Mykola Golub <mgolub@suse.com>
Yuri Weinstein [Thu, 9 Jan 2020 16:56:51 +0000 (08:56 -0800)]
Merge pull request #32520 from sseshasa/wip-43495-nautilus
nautilus: mon/OSDMonitor: Don't update mon cache settings if rocksdb is not used
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Yuri Weinstein [Thu, 9 Jan 2020 16:55:00 +0000 (08:55 -0800)]
Merge pull request #32056 from smithfarm/wip-42735-nautilus
nautilus: rgw: allow reshard log entries for non-existent buckets to be cancelled
Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
Yuri Weinstein [Thu, 9 Jan 2020 16:54:36 +0000 (08:54 -0800)]
Merge pull request #32055 from smithfarm/wip-42733-nautilus
nautilus: rgw: auto-clean reshard queue entries for non-existent buckets
Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
Yuri Weinstein [Thu, 9 Jan 2020 16:54:12 +0000 (08:54 -0800)]
Merge pull request #31683 from smithfarm/wip-42840-nautilus
nautilus: rgw: when resharding store progress json
Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
Yuri Weinstein [Thu, 9 Jan 2020 16:53:36 +0000 (08:53 -0800)]
Merge pull request #32058 from smithfarm/wip-43161-nautilus
nautilus: rgw: url encode common prefixes for List Objects response
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Yuri Weinstein [Thu, 9 Jan 2020 00:13:09 +0000 (00:13 +0000)]
Merge remote-tracking branch 'origin/nautilus-saved' into nautilus
Jenkins Build Slave User [Wed, 8 Jan 2020 18:36:54 +0000 (18:36 +0000)]
14.2.6
Jos Collin [Sat, 26 Oct 2019 16:02:33 +0000 (21:32 +0530)]
doc: update inf/infinite option for subvolume resize
Fixes: https://tracker.ceph.com/issues/42479
Signed-off-by: Jos Collin <jcollin@redhat.com>
(cherry picked from commit
e5bad7d4a6fa598042e718924fadbddf9ac64e55 )
Jos Collin [Thu, 17 Oct 2019 14:25:47 +0000 (19:55 +0530)]
doc: fs subvolume resize command
Fixes: https://tracker.ceph.com/issues/41182
Signed-off-by: Jos Collin <jcollin@redhat.com>
(cherry picked from commit
04b6b737153940c852c4b6771fb53a74a0c73bbe )
Jos Collin [Sun, 27 Oct 2019 15:42:38 +0000 (21:12 +0530)]
doc: uid, gid for subvolume create and subvolumegroup create commands
Fixes: https://tracker.ceph.com/issues/40959
Signed-off-by: Jos Collin <jcollin@redhat.com>
(cherry picked from commit
596c1fef6bacfc336ce0d11b7452e4bdab9f4b51 )
Kefu Chai [Fri, 27 Dec 2019 11:03:24 +0000 (19:03 +0800)]
qa/tasks/cbt: install python3 deps
Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit
299375852a4b3210cf5b95d3559d69080f14339f )
Conflicts:
qa/tasks/cbt.py: install python36-* instead of python3-*
packages. as in EL7, python packages is still versioned using minor
version, and they don't "Provide" python3-*.
Sridhar Seshasayee [Fri, 3 Jan 2020 09:26:13 +0000 (14:56 +0530)]
mon/OSDMonitor: Don't update mon cache settings if rocksdb is not used
Currently any update to mon cache config settings like 'mon_memory_target'
or 'rocksdb_cache_size' will cause a crash in case rocksdb and priority
cache manager is not being used.
If rocksdb (and therefore priority cache manager) is not being used, then
the update to the mon caches is ignored. Also, reduce the log levels of
some important log messages to help in debugging.
Fixes: https://tracker.ceph.com/issues/43454
Signed-off-by: Sridhar Seshasayee <sseshasa@redhat.com>
(cherry picked from commit
b9e7a7af98ca284f4febc37fede58345ecb8a1d1 )
Kefu Chai [Tue, 7 Jan 2020 01:34:25 +0000 (09:34 +0800)]
Merge pull request #32436 from tchaikov/nautilus-cbt-py3
nautilus: qa/tasks/cbt: install python3 deps
Reviewed-by: Sage Weil <sage@redhat.com>
Kefu Chai [Fri, 27 Dec 2019 11:03:24 +0000 (19:03 +0800)]
qa/tasks/cbt: install python3 deps
Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit
299375852a4b3210cf5b95d3559d69080f14339f )
Conflicts:
qa/tasks/cbt.py: install python36-* instead of python3-*
packages. as in EL7, python packages is still versioned using minor
version, and they don't "Provide" python3-*.
Neha [Mon, 23 Dec 2019 18:12:59 +0000 (18:12 +0000)]
mon/PGMap.h: disable network stats in dump_osd_stats
Signed-off-by: Neha Ojha <nojha@redhat.com>
(cherry picked from commit
ffb8a2a904426c8a3d6fc2fd70266418a98623c5 )
Conflicts:
src/mon/PGMap.h - trivial resolution
David Zafman [Fri, 20 Dec 2019 23:53:49 +0000 (15:53 -0800)]
osd_stat_t::dump: Add option for ceph-mgr pythonn callers to skip ping network
Due to the overhead of this on large clusters, we removed the network
information was wasn't getting used anyway.
Fixes: https://tracker.ceph.com/issues/43364
Signed-off-by: David Zafman <dzafman@redhat.com>
(cherry picked from commit
1e2fe722c41d4cc34094afb157b3eb06b4a50972 )
Conflicts:
src/mon/PGMap.cc - trivial resolution
src/mon/PGMap.h - trivial resolution
src/osd/osd_types.h - trivial resolution
Yuri Weinstein [Mon, 6 Jan 2020 23:24:37 +0000 (15:24 -0800)]
Merge pull request #32466 from neha-ojha/wip-43364-2-nautilus
nautilus: mon/PGMap.h: disable network stats in dump_osd_stats
Reviewed-by: Josh Durgin <jdurgin@redhat.com>