]>
git.apps.os.sepia.ceph.com Git - ceph.git/log
weixinwei [Fri, 29 May 2020 14:43:31 +0000 (22:43 +0800)]
blk:BlockDevice.cc: use pending_aios instead of iovec size as ios num
Signed-off-by: weixinwei <xinweiwei90@gmail.com>
(cherry picked from commit
64ce414b022b96b7a5c73d2c03393a877b30e508 )
Conflicts:
src/blk/BlockDevice.cc
- file does not exist in Nautilus; made the changes manually in
src/os/bluestore/BlockDevice.cc
Jan Fajerski [Wed, 21 Oct 2020 10:53:00 +0000 (12:53 +0200)]
Merge PR #37522 into nautilus
* refs/pull/37522/head:
ceph-volume: don't exit before empty report can be printed
PendingReleaseNotes: add note about batch refactor
ceph-volume batch: return valid empty json reports
ceph-volume: pass filter_for_batch as keyword argument
doc: drop references to drive_groups in batch doc
idempotency must result in the same outcome
doc: update ceph-volume lvm batch docs
ceph-volume batch: fix very_fast_allocation plan and add tests
ceph-volume: batch: call the right prepare method
ceph-volume inventory: add option to filter unwanted devices
ceph-volume: address review comments
ceph-volume: batch: fix size retrieval for lvs
ceph-volume: include encryption in batch report
ceph-volume lvm batch: use namedtuple instead of tuple
ceph-volume: address review comments, mostly tidying, clarification
ceph-volume: batch test should pass --journal-devices with filestore
ceph-volume: make --journal optional, add --journal-slots
ceph-volume batch: add deprecation warning for auto behaviour
ceph-volume batch: add ceph.conf mocking to pass tests
ceph-volume batch: use disk.Size for size args
ceph-volume batch: Fix osd_ids passing and improve plan formatting
ceph-volume batch: track rel_size in percent, more tests
ceph-volume batch: improve backwards compatibility
ceph-volume: batch - enable legacy auto behaviour
ceph-volume: batch - major refactor
ceph-volume: Device - available_lvm if 10 extents are free.
ceph-volume: Device - add vg_free property
ceph-volume: prepare/create - size args as Size class
ceph-volume: disk.Size - add cast to bool
ceph-volume: api/lvm - add VolumeGroup.free_percent property
ceph-volume: util.device - add vg_free_percent property
ceph-volume: api/lvm - query LV units in bytes
ceph-volume: lvm/common - refactor common arg specification
ceph-volume: batch: fix argument help message
Reviewed-by: Rishabh Dave <ridave@redhat.com>
Lenz Grimmer [Wed, 21 Oct 2020 09:52:38 +0000 (11:52 +0200)]
Merge pull request #37060 from callithea/wip-46971-nautilus
nautilus: mgr/dashboard: Proper format iSCSI target portals
Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
Jenkins Build Slave User [Mon, 19 Oct 2020 20:19:21 +0000 (20:19 +0000)]
14.2.12
Yuri Weinstein [Fri, 9 Oct 2020 16:03:26 +0000 (09:03 -0700)]
Merge pull request #37364 from wjwithagen/wjw-fix-lazyio.cc
nautilus: test: Do not use <sys/xattr.h> under non-Linux systems
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>
Yuri Weinstein [Fri, 9 Oct 2020 16:02:25 +0000 (09:02 -0700)]
Merge pull request #37232 from Vicente-Cheng/wip-47259-nautilus
nautilus: client: handle readdir reply without Fs cap
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Yuri Weinstein [Fri, 9 Oct 2020 16:01:47 +0000 (09:01 -0700)]
Merge pull request #37229 from Vicente-Cheng/wip-47252-nautilus
nautilus: cephfs: osdc/Journaler: do not call onsafe->complete() if onsafe is 0
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Yuri Weinstein [Fri, 9 Oct 2020 16:01:17 +0000 (09:01 -0700)]
Merge pull request #37228 from Vicente-Cheng/wip-47246-nautilus
nautilus: qa: ignore expected mds failover message
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Yuri Weinstein [Fri, 9 Oct 2020 16:00:38 +0000 (09:00 -0700)]
Merge pull request #37178 from batrick/i47088
nautilus: mds: recover files after normal session close
Reviewed-by: Nathan Cutler <ncutler@suse.com>
Yuri Weinstein [Fri, 9 Oct 2020 15:28:19 +0000 (08:28 -0700)]
Merge pull request #37301 from alvistack/nautilus-aio_graceful_reboot
nautilus: systemd: Support Graceful Reboot for AIO Node
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Yuri Weinstein [Fri, 9 Oct 2020 15:09:51 +0000 (08:09 -0700)]
Merge pull request #37558 from smithfarm/wip-47737-nautilus
nautilus: mgr/status: metadata is fetched async
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Jan Fajerski <jfajerski@suse.com>
Yuri Weinstein [Fri, 9 Oct 2020 15:08:33 +0000 (08:08 -0700)]
Merge pull request #37481 from smithfarm/wip-47605-nautilus
nautilus: mds: fix purge_queue's _calculate_ops is inaccurate
Reviewed-by: Ramana Raja <rraja@redhat.com>
Lenz Grimmer [Fri, 9 Oct 2020 11:45:37 +0000 (13:45 +0200)]
Merge pull request #37550 from rhcs-dashboard/wip-47753-nautilus
nautilus: mgr/dashboard: Don't use any xlf file when building the default language
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Sebastian Krah <skrah@suse.com>
Yuri Weinstein [Thu, 8 Oct 2020 18:01:22 +0000 (11:01 -0700)]
Merge pull request #37505 from rhcs-dashboard/fix-46815-nautilus
nautilus: mgr/dashboard: fix broken backporting
Reviewed-by: Nathan Cutler <ncutler@suse.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Yuri Weinstein [Thu, 8 Oct 2020 15:23:42 +0000 (08:23 -0700)]
Merge pull request #37479 from smithfarm/wip-46960-nautilus
nautilus: cephfs-journal-tool: fix incorrect read_offset when finding missing objects
Reviewed-by: Ramana Raja <rraja@redhat.com>
Yuri Weinstein [Thu, 8 Oct 2020 15:22:59 +0000 (08:22 -0700)]
Merge pull request #37231 from Vicente-Cheng/wip-47254-nautilus
nautilus: cephfs: client: make Client::open() pass proper cap mask to path_walk
Reviewed-by: Ramana Raja <rraja@redhat.com>
Yuri Weinstein [Thu, 8 Oct 2020 15:22:23 +0000 (08:22 -0700)]
Merge pull request #37179 from batrick/i47090
nautilus: mds: After restarting an mds, its standy-replay mds remained in the "resolve" state
Reviewed-by: Ramana Raja <rraja@redhat.com>
Yuri Weinstein [Thu, 8 Oct 2020 15:21:51 +0000 (08:21 -0700)]
Merge pull request #36965 from Vicente-Cheng/wip-46784-nautilus
nautilus: mds/CInode: Optimize only pinned by subtrees check
Reviewed-by: Ramana Raja <rraja@redhat.com>
Jan Fajerski [Thu, 8 Oct 2020 06:45:26 +0000 (08:45 +0200)]
ceph-volume: don't exit before empty report can be printed
get_plan() called exit in case of an empty plan. This prevented a report
being printed under these circumstances. Avoid exit in this case. Also
adds tests to ensure an empty report is printed.
Fixes: https://tracker.ceph.com/issues/47760
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit
0cc5604843b215709a681fa402145c9fa403b1dd )
Jan Fajerski [Wed, 7 Oct 2020 07:45:42 +0000 (09:45 +0200)]
PendingReleaseNotes: add note about batch refactor
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit
485f0d797e4b21ffb7ac742f0949e8c0a23d43f2 )
Conflicts:
PendingReleaseNotes
Sort new entry under >=15.2.6 heading
Michael Fritch [Thu, 25 Jun 2020 20:36:22 +0000 (14:36 -0600)]
mgr/mgr_module: metadata is fetched async
fetch metadata using a defaultdict
Signed-off-by: Michael Fritch <mfritch@suse.com>
(cherry picked from commit
f06e60b591d7921b0afdd40219f3866773b00683 )
Conflicts:
src/pybind/mgr/status/module.py
Michael Fritch [Thu, 25 Jun 2020 20:16:55 +0000 (14:16 -0600)]
mgr/status: metadata is fetched async
fix timing window during mds rejoin where metadata is not available
Fixes: https://tracker.ceph.com/issues/45633
Signed-off-by: Michael Fritch <mfritch@suse.com>
(cherry picked from commit
4006fff43856c851e7a07f7d8ff05364cbe03529 )
Conflicts:
src/pybind/mgr/status/module.py
Yuri Weinstein [Mon, 5 Oct 2020 15:44:36 +0000 (08:44 -0700)]
Merge pull request #37510 from rhcs-dashboard/wip-47717-nautilus
nautilus: mgr/dashboard: Fix pool renaming functionality
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
Yuri Weinstein [Mon, 5 Oct 2020 15:43:28 +0000 (08:43 -0700)]
Merge pull request #37241 from rhcs-dashboard/wip-47538-nautilus
nautilus: mgr/dashboard: Disabling the form inputs for the read_only modals
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Yuri Weinstein [Mon, 5 Oct 2020 15:41:26 +0000 (08:41 -0700)]
Merge pull request #37177 from batrick/i47017
nautilus: mds: kcephfs parse dirfrag's ndist is always 0
Reviewed-by: Ramana Raja <rraja@redhat.com>
Yuri Weinstein [Mon, 5 Oct 2020 15:40:57 +0000 (08:40 -0700)]
Merge pull request #37035 from smithfarm/wip-47317-nautilus
nautilus: mds: fix incorrect check for if dirfrag is being fragmented
Reviewed-by: Ramana Raja <rraja@redhat.com>
Yuri Weinstein [Mon, 5 Oct 2020 15:40:26 +0000 (08:40 -0700)]
Merge pull request #36967 from Vicente-Cheng/wip-46941-nautilus
nautilus: mds: place MDSGatherBuilder on the stack
Reviewed-by: Ramana Raja <rraja@redhat.com>
Yuri Weinstein [Mon, 5 Oct 2020 15:39:42 +0000 (08:39 -0700)]
Merge pull request #36966 from Vicente-Cheng/wip-46787-nautilus
nautilus: cephfs: client: fix extra open ref decrease
Reviewed-by: Ramana Raja <rraja@redhat.com>
Yuri Weinstein [Mon, 5 Oct 2020 15:39:05 +0000 (08:39 -0700)]
Merge pull request #36814 from smithfarm/wip-47081-nautilus
nautilus: messages,mds: Fix decoding of enum types on big-endian systems
Reviewed-by: Ramana Raja <rraja@redhat.com>
Yuri Weinstein [Mon, 5 Oct 2020 15:38:36 +0000 (08:38 -0700)]
Merge pull request #36168 from smithfarm/wip-46151-nautilus
nautilus: mds: do not defer incoming mgrmap when mds is laggy
Reviewed-by: Ramana Raja <rraja@redhat.com>
Yuri Weinstein [Mon, 5 Oct 2020 15:36:52 +0000 (08:36 -0700)]
Merge pull request #36968 from Vicente-Cheng/wip-46943-nautilus
nautilus: mds: resolve SIGSEGV in waiting for uncommitted fragments
Reviewed-by: Ramana Raja <rraja@redhat.com>
Yuri Weinstein [Mon, 5 Oct 2020 15:35:14 +0000 (08:35 -0700)]
Merge pull request #36963 from Vicente-Cheng/wip-46633-nautilus
nautilus: mds: fix mds forwarding request 'no_available_op_found'
Reviewed-by: Ramana Raja <rraja@redhat.com>
Mark Nelson [Fri, 24 Jul 2020 05:29:15 +0000 (05:29 +0000)]
mds/CInode: Optimize only pinned by subtrees check
Fixes: https://tracker.ceph.com/issues/46727
Signed-off-by: Mark Nelson <mnelson@redhat.com>
(cherry picked from commit
6a865f805b723525358ed8e79bb3d41709e98bf3 )
Conflicts:
src/mds/MDCache.cc
- use the nautilus code flow of trim instead master
Sebastian Krah [Tue, 19 Nov 2019 10:41:49 +0000 (11:41 +0100)]
mgr/dashboard: Don't use any xlf file when building the default language
The build-i18n script no longer uses a xlf file when building the default
language. This means that we don't need to keep the messages.en-US.xlf in the repository anymore.
Fixes: https://tracker.ceph.com/issues/42693
Signed-off-by: Sebastian Krah <skrah@suse.com>
(cherry picked from commit
5efe0a3ab25e26421001033bd7ea36c86aca2b02 )
Conflicts:
src/pybind/mgr/dashboard/frontend/src/locale/messages.en-US.xlf
- Deleted this file
Jan Fajerski [Sat, 3 Oct 2020 07:40:33 +0000 (09:40 +0200)]
ceph-volume batch: return valid empty json reports
Fixes: https://tracker.ceph.com/issues/47729
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit
ab59269a6ca5bb80c28e94beef0338f23fc10fff )
Jan Fajerski [Mon, 5 Oct 2020 10:56:26 +0000 (12:56 +0200)]
ceph-volume: pass filter_for_batch as keyword argument
This PR also removes an unused ctor argument in the Devices class.
Fixes: 7d168ad7bdbb6d6d5231a4ae540ab03040b49a38
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit
c5a711e5b6499915b7c2a7b7869f890fa7dc7e2d )
Yuri Weinstein [Fri, 2 Oct 2020 20:25:00 +0000 (13:25 -0700)]
Merge pull request #37435 from Vicente-Cheng/wip-47413-nautilus
nautilus: rgw: urlencode bucket name when forwarding request
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Jan Fajerski [Fri, 2 Oct 2020 10:08:26 +0000 (12:08 +0200)]
doc: drop references to drive_groups in batch doc
The drive_groups code is orchestrator specific and not present in
nautilus.
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
Volker Theile [Wed, 12 Aug 2020 10:54:07 +0000 (12:54 +0200)]
mgr/dashboard: Proper format iSCSI target portals
Proper format the 'Portals' and 'Images' columns.
Fixes: https://tracker.ceph.com/issues/46908
Signed-off-by: Volker Theile <vtheile@suse.com>
(cherry picked from commit
ac0b34a26777400226e263120e4b82644b2e0d51 )
Conflicts:
src/pybind/mgr/dashboard/frontend/src/app/ceph/block/iscsi-target-list/iscsi-target-list.component.ts
- Resolved import conflicts; Replaced JoinPipe with ListPipe since JoinPipe is
not available in nautilus
Jan Fajerski [Tue, 8 Sep 2020 12:11:15 +0000 (14:11 +0200)]
idempotency must result in the same outcome
...not should
Co-authored-by: Joshua Schmid <jschmid@suse.de>
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit
fcacd0b96ab195e939f6f879b0a0362a06385f9a )
Jan Fajerski [Mon, 29 Jun 2020 15:42:26 +0000 (17:42 +0200)]
doc: update ceph-volume lvm batch docs
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit
7695d1ec539f54b7b7cea8d19925f0c320223f03 )
Stephan Müller [Wed, 13 Nov 2019 12:16:55 +0000 (13:16 +0100)]
mgr/dashboard: Fix pool renaming functionality
The problem was that, if a pool was renamed the routine to update tried
to work on the old pool name and didn't used the info that the pool got
renamed, therefore an error occurred in the UI saying that the pool
could not be found.
Fixes: https://tracker.ceph.com/issues/42776
Signed-off-by: Stephan Müller <smueller@suse.com>
(cherry picked from commit
de933cd3c82b6a7d5c4ddfa77804509c9fcaa3db )
Conflicts:
qa/tasks/mgr/dashboard/test_pool.py:
- Ignore incoming quota test
Stephan Müller [Wed, 13 Nov 2019 12:15:42 +0000 (13:15 +0100)]
mgr/dashboard: Fix pg_num counts in pool API tests
To prevent the not a number of two cluster health warning, all created
pools now have a pg_num that is a power of two.
Fixes: https://tracker.ceph.com/issues/42776
Signed-off-by: Stephan Müller <smueller@suse.com>
(cherry picked from commit
ca46c9941bc6837f09aab7b4aaab799d8a9ebf48 )
Conflicts:
qa/tasks/mgr/dashboard/test_pool.py:
- Ignore quota tests and accept 8 PG number
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>
Stephan Müller [Wed, 13 Nov 2019 16:11:54 +0000 (17:11 +0100)]
mgr/dashboard: Refactor pool API tests
Renamed "__create_pool" to "__yield_pool" to make it's purpose clearer
and added a description.
Split up create pool test into three different tests.
Used "__yield_pool" for creation tests, too.
Fixes: https://tracker.ceph.com/issues/42776
Signed-off-by: Stephan Müller <smueller@suse.com>
(cherry picked from commit
96fd06b7db1d57b8384edc1af6cc39e4e532fb77 )
Conflicts:
qa/tasks/mgr/dashboard/test_pool.py:
- Ignore incoming pool quota tests
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>
Jan Fajerski [Fri, 25 Sep 2020 09:35:19 +0000 (11:35 +0200)]
ceph-volume batch: fix very_fast_allocation plan and add tests
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit
8178d5c48ac1a7f3915f0003abab6d625385bd78 )
Jan Fajerski [Wed, 16 Sep 2020 13:43:00 +0000 (15:43 +0200)]
ceph-volume: batch: call the right prepare method
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit
e75ef77f23ae07463510ec213ac4007f29cbe2da )
Jan Fajerski [Fri, 11 Sep 2020 14:35:00 +0000 (16:35 +0200)]
ceph-volume inventory: add option to filter unwanted devices
Some device we never want to pass to the batch subcommand. For now this
includes devices that have a partition or are mounted on the machine.
One goal is to filter the root device, so it is not included on a batch
command and thus would contribute to its implicit sizing calculation.
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit
7d168ad7bdbb6d6d5231a4ae540ab03040b49a38 )
- removed the lsmdisk import from src/ceph-volume/ceph_volume/util/device.py
Jan Fajerski [Fri, 11 Sep 2020 08:36:43 +0000 (10:36 +0200)]
ceph-volume: address review comments
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit
6f1592a1146529d352184c795aae8ce12f66e554 )
Jan Fajerski [Thu, 10 Sep 2020 14:45:34 +0000 (16:45 +0200)]
ceph-volume: batch: fix size retrieval for lvs
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit
24e4aa1296608ef861d4ea4b6a1892246a53ef76 )
Jan Fajerski [Wed, 9 Sep 2020 11:04:14 +0000 (13:04 +0200)]
ceph-volume: include encryption in batch report
Fixes: https://tracker.ceph.com/issues/44783
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit
fce184cf9b2d8f15543e1adee49e1fe6cc17437d )
Jan Fajerski [Wed, 9 Sep 2020 07:41:15 +0000 (09:41 +0200)]
ceph-volume lvm batch: use namedtuple instead of tuple
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit
98c991fc6fd17b18d5bfbebe4b8febe5ff8fa2f0 )
Jan Fajerski [Tue, 8 Sep 2020 14:53:53 +0000 (16:53 +0200)]
ceph-volume: address review comments, mostly tidying, clarification
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit
d0735ce1c90c952a6d2e1b805c1326d13ff7b06c )
Jan Fajerski [Mon, 7 Sep 2020 12:54:40 +0000 (14:54 +0200)]
ceph-volume: batch test should pass --journal-devices with filestore
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit
55ba8630176041dce898e8b979b5849f13e01ca5 )
Jan Fajerski [Mon, 7 Sep 2020 12:54:01 +0000 (14:54 +0200)]
ceph-volume: make --journal optional, add --journal-slots
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit
7f766846328aac82d75175ed2c1c0bf3438a99e0 )
Jan Fajerski [Fri, 26 Jun 2020 11:34:01 +0000 (13:34 +0200)]
ceph-volume batch: add deprecation warning for auto behaviour
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit
1239f77c8871a45e21bd1e3e81be8bb8854f24da )
Jan Fajerski [Tue, 23 Jun 2020 14:58:46 +0000 (16:58 +0200)]
ceph-volume batch: add ceph.conf mocking to pass tests
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit
eef9dc7a1da6d5dde0d1b02b71301c1d7b7926a9 )
Jan Fajerski [Fri, 19 Jun 2020 10:58:17 +0000 (12:58 +0200)]
ceph-volume batch: use disk.Size for size args
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit
0bc7f7424cdd0a2c5f2cd777467814dbb3959fb4 )
Jan Fajerski [Fri, 19 Jun 2020 09:22:28 +0000 (11:22 +0200)]
ceph-volume batch: Fix osd_ids passing and improve plan formatting
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit
2124aa57b355fb29dcfe13c643bc78b4011f15a6 )
Jan Fajerski [Tue, 9 Jun 2020 14:40:46 +0000 (16:40 +0200)]
ceph-volume batch: track rel_size in percent, more tests
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit
2327e92abae74518d463a55ef4d42dbb816c9200 )
Jan Fajerski [Wed, 29 Apr 2020 05:47:18 +0000 (07:47 +0200)]
ceph-volume batch: improve backwards compatibility
This restores legacy batch behavior and also adds some initial test and
adjusts existing tests to changes.
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit
a23a02df02ec4a8f65df0864f3224fb311d25b11 )
Jan Fajerski [Mon, 27 Apr 2020 10:26:20 +0000 (12:26 +0200)]
ceph-volume: batch - enable legacy auto behaviour
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit
d32e0e4320b54302ab989f0a93b57a0404e2094b )
Jan Fajerski [Mon, 27 Apr 2020 09:47:04 +0000 (11:47 +0200)]
ceph-volume: batch - major refactor
This completely refactors the batch code in order to make use of the
create/prepare code path for creating OSDs instead of having a second
code path doing this. This not only eases the maintenance burden but
also adds various features and fixes bugs. This subcommand can now
handle LVs, replace OSDs, reuse VGs and has a better notion of
idempotency.
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit
b0b797363fd66baa40eb54cf35dd6cfd11150be9 )
Jan Fajerski [Mon, 27 Apr 2020 09:35:51 +0000 (11:35 +0200)]
ceph-volume: Device - available_lvm if 10 extents are free.
This changes the available_lvm notion to only require 10 free extents
instead of 5GB.
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit
6cb0841658ae45f23c2457a8f6a489457012d93e )
Jan Fajerski [Mon, 27 Apr 2020 09:34:19 +0000 (11:34 +0200)]
ceph-volume: Device - add vg_free property
This new property returns the free space in any VGs present. If no VGs
are on the device we project how much space a VG will have.
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit
b34f130f30daeca034b6b2365cc5a832ba8faa56 )
Jan Fajerski [Mon, 27 Apr 2020 09:27:08 +0000 (11:27 +0200)]
ceph-volume: prepare/create - size args as Size class
This add the disk.Size class as all size related argument types. We
often create this class form args like this anyway and it enables users
to pass not only bytes but also strings like 50G.
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit
2ff37321640a614fd965d7df6e20d8f9d1430fa3 )
Jan Fajerski [Mon, 27 Apr 2020 09:45:26 +0000 (11:45 +0200)]
ceph-volume: disk.Size - add cast to bool
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit
e7cdeab9dee2684c06b3543a482dd44a1db83c16 )
Jan Fajerski [Mon, 27 Apr 2020 09:21:37 +0000 (11:21 +0200)]
ceph-volume: api/lvm - add VolumeGroup.free_percent property
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit
bad54e97817dfef0e7dfcb834753cbb728c3de46 )
Jan Fajerski [Mon, 27 Apr 2020 09:44:56 +0000 (11:44 +0200)]
ceph-volume: util.device - add vg_free_percent property
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit
f48d225454e3ec347952d85262aa03b71bfb9111 )
Jan Fajerski [Mon, 27 Apr 2020 09:44:20 +0000 (11:44 +0200)]
ceph-volume: api/lvm - query LV units in bytes
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit
de7d67603a135825d8b4e37a06dd4b6a12dbcf1c )
Jan Fajerski [Tue, 14 Apr 2020 13:34:30 +0000 (15:34 +0200)]
ceph-volume: lvm/common - refactor common arg specification
This makes it easier to create valid Namespace objects/arg lists when
programmatically calling create/prepare.
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit
fa62a7bf5f926db17dd2d7685878c175fc23500e )
Jan Fajerski [Wed, 26 Feb 2020 14:36:53 +0000 (15:36 +0100)]
ceph-volume: batch: fix argument help message
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit
51ca694bbe1552fd52b0385c43aad7e28fc5626f )
Jan Fajerski [Fri, 2 Oct 2020 07:20:18 +0000 (09:20 +0200)]
Merge pull request #37413 from jan--f/wip-47650-nautilus
nautilus: [ceph-volume]: remove unneeded call to get_devices()
Jan Fajerski [Fri, 2 Oct 2020 07:19:46 +0000 (09:19 +0200)]
Merge pull request #37377 from shyukri/wip-47283-nautilus
nautilus: ceph-volume: fix journal size argument not work
Patrick Donnelly [Thu, 1 Oct 2020 20:07:03 +0000 (13:07 -0700)]
Merge PR #37508 into nautilus
* refs/pull/37508/head:
nautilus: qa: stop using kclient testing branch builds
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Yuri Weinstein [Thu, 1 Oct 2020 16:54:25 +0000 (09:54 -0700)]
Merge pull request #37478 from smithfarm/wip-47345-nautilus
nautilus: qa/*/mon/mon-last-epoch-clean.sh: mark osd out instead of down
Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com>
Yuri Weinstein [Thu, 1 Oct 2020 16:53:56 +0000 (09:53 -0700)]
Merge pull request #37477 from smithfarm/wip-47250-nautilus
nautilus: tools/osdmaptool.cc: add ability to clean_temps
Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com>
Yuri Weinstein [Thu, 1 Oct 2020 16:53:20 +0000 (09:53 -0700)]
Merge pull request #37476 from smithfarm/wip-46965-nautilus
nautilus: mgr: decrease pool stats if pg was removed
Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com>
Yuri Weinstein [Thu, 1 Oct 2020 16:52:50 +0000 (09:52 -0700)]
Merge pull request #37475 from smithfarm/wip-46935-nautilus
nautilus: tools/rados: Set locator key when exporting or importing a pool
Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com>
Yuri Weinstein [Thu, 1 Oct 2020 16:52:22 +0000 (09:52 -0700)]
Merge pull request #37474 from smithfarm/wip-46738-nautilus
nautilus: mon: fix the 'Error ERANGE' message when conf "osd_objectstore" is filestore
Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com>
Yuri Weinstein [Thu, 1 Oct 2020 16:51:53 +0000 (09:51 -0700)]
Merge pull request #37473 from smithfarm/wip-46710-nautilus
nautilus: osd/PeeringState: prevent peer's num_objects going negative
Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com>
Yuri Weinstein [Thu, 1 Oct 2020 16:51:20 +0000 (09:51 -0700)]
Merge pull request #37470 from smithfarm/wip-46262-nautilus
nautilus: common, osd: add sanity checks around osd_scrub_max_preemptions
Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com>
Yuri Weinstein [Thu, 1 Oct 2020 16:38:39 +0000 (09:38 -0700)]
Merge pull request #37471 from smithfarm/wip-46461-nautilus
nautilus: pybind/mgr/balancer: use "==" and "!=" for comparing str
Reviewed-by: Kefu Chai <kchai@redhat.com>
Yuri Weinstein [Thu, 1 Oct 2020 16:37:57 +0000 (09:37 -0700)]
Merge pull request #37447 from badone/wip-nautilus-ca-ansible-to-2.9
nautilus: qa/ceph-ansible: Bump required ansible to 2.9
Reviewed-by: Yuri Weinstein <yweinste@redhat.com>
Ramana Raja [Thu, 1 Oct 2020 16:35:30 +0000 (22:05 +0530)]
nautilus: qa: stop using kclient testing branch builds
... in kcephfs and multimds suites.
This is a nautilus only fix. In master and octopus we still use
kclient testing branch builds.
Fixes: https://tracker.ceph.com/issues/47642
Signed-off-by: Ramana Raja <rraja@redhat.com>
Yuri Weinstein [Thu, 1 Oct 2020 15:06:07 +0000 (08:06 -0700)]
Merge pull request #37469 from smithfarm/wip-47459-nautilus
nautilus: qa/workunits/mon: fixed excessively large pool PG count
Reviewed-by: Mykola Golub <mgolub@mirantis.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Yuri Weinstein [Thu, 1 Oct 2020 15:05:17 +0000 (08:05 -0700)]
Merge pull request #37468 from smithfarm/wip-47417-nautilus
nautilus: rbd: include RADOS namespace in krbd symlinks
Reviewed-by: Mykola Golub <mgolub@mirantis.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
Ernesto Puerta [Thu, 1 Oct 2020 10:43:52 +0000 (12:43 +0200)]
mgr/dashboard: fix broken backporting
A [previous backport](https://github.com/ceph/ceph/pull/35367) from a
[master PR](https://github.com/ceph/ceph/pull/32829) changed the testing
condition for PG status from 'incomplete' to 'unknown'.
Fixes: https://tracker.ceph.com/issues/46815
Co-authored-by: Mykola Golub <mgolub@suse.com>
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>
Yuri Weinstein [Wed, 30 Sep 2020 17:30:32 +0000 (10:30 -0700)]
Merge pull request #37467 from smithfarm/wip-47322-nautilus
nautilus: rgw: replace '+' with "%20" in canonical query string for s3 v4 auth.
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Yuri Weinstein [Wed, 30 Sep 2020 17:30:07 +0000 (10:30 -0700)]
Merge pull request #37465 from smithfarm/wip-47318-nautilus
nautilus: rgw: Expiration days can't be zero and transition days can be zero
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Yuri Weinstein [Wed, 30 Sep 2020 17:29:39 +0000 (10:29 -0700)]
Merge pull request #37464 from smithfarm/wip-47315-nautilus
nautilus: rgw: radosgw-admin: period pull command is not always a raw_storage_op
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Yuri Weinstein [Wed, 30 Sep 2020 17:29:01 +0000 (10:29 -0700)]
Merge pull request #37463 from smithfarm/wip-46956-nautilus
nautilus: rgw: fix shutdown crash in RGWAsyncReadMDLogEntries
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Yuri Weinstein [Wed, 30 Sep 2020 17:28:30 +0000 (10:28 -0700)]
Merge pull request #37462 from smithfarm/wip-46950-nautilus
nautilus: rgw/cls: preserve olh entry's name on last unlink
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Yuri Weinstein [Wed, 30 Sep 2020 17:28:05 +0000 (10:28 -0700)]
Merge pull request #37461 from smithfarm/wip-46930-nautilus
nautilus: rgw: Empty reqs_change_state queue before unregistered_reqs
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Yuri Weinstein [Wed, 30 Sep 2020 17:27:37 +0000 (10:27 -0700)]
Merge pull request #37460 from smithfarm/wip-46594-nautilus
nautilus: rgw: add negative cache to the system object
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Yuri Weinstein [Wed, 30 Sep 2020 17:26:42 +0000 (10:26 -0700)]
Merge pull request #37459 from smithfarm/wip-47320-nautilus
nautilus: rgw: RGWObjVersionTracker tracks version over increments
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Yuri Weinstein [Wed, 30 Sep 2020 17:25:44 +0000 (10:25 -0700)]
Merge pull request #37438 from Vicente-Cheng/wip-47347-nautilus
nautilus: rgw: Swift API anonymous access should 401
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Neha Ojha [Tue, 29 Sep 2020 23:51:44 +0000 (16:51 -0700)]
Merge pull request #37472 from smithfarm/wip-46587-nautilus
nautilus: doc/rados: Fix osd_scrub_during_recovery default value
Reviewed-by: Neha Ojha <nojha@redhat.com>
Yanhu Cao [Tue, 8 Sep 2020 06:20:12 +0000 (14:20 +0800)]
mds: fix purge_queue's _calculate_ops is inaccurate
No need to account for removing (or zeroing) backtrace,
because if item.size is 0, num is already set to 1.
Fixes: https://tracker.ceph.com/issues/47353
Signed-off-by: Yanhu Cao <gmayyyha@gmail.com>
(cherry picked from commit
8a54e03f29e19af2072751fe2816b5313ff18abe )
wangyunqing [Thu, 16 Jul 2020 07:06:53 +0000 (15:06 +0800)]
mon: fix the 'Error ERANGE' message when conf "osd_objectstore" is filestore
Fixes: https://tracker.ceph.com/issues/37532
Signed-off-by: wangyunqing <wangyunqing@inspur.com>
(cherry picked from commit
4155a79f76b177ada79af746de4448773e07584a )
Conflicts:
src/mon/OSDMonitor.cc
- in nautilus, "cmd_getval()" needs cct as first argument
jhonxue [Thu, 30 Jul 2020 06:40:16 +0000 (14:40 +0800)]
cephfs-journal-tool: fix wrong read_offset when get missing objects
Fixes: https://tracker.ceph.com/issues/45575
Signed-off-by: Xue Yantao <jhonxue@tencent.com>
(cherry picked from commit
bfa63666bb40c7939aa4da3c2c8f43a7022a78e8 )