]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
5 years agoceph-volume: make get_pv() accepts list of PVs 31408/head
Rishabh Dave [Sat, 12 Oct 2019 11:32:33 +0000 (17:02 +0530)]
ceph-volume: make get_pv() accepts list of PVs

...so that the code calling it can pass its copy which would prevent
creating a new one within get_pv().

Signed-off-by: Rishabh Dave <ridave@redhat.com>
(cherry picked from commit 2cdf467f76ab3331c04bec2b9f0e198ff67dd2dd)

5 years agoceph-volume: make get_vg() accepts list of VGs
Rishabh Dave [Sat, 12 Oct 2019 11:29:57 +0000 (16:59 +0530)]
ceph-volume: make get_vg() accepts list of VGs

...so that the code calling it can pass its copy which would prevent
creating a new one within get_vg().

Signed-off-by: Rishabh Dave <ridave@redhat.com>
(cherry picked from commit cde092f4c7e89a67b6c94dcedd41525c11987ef3)

5 years agoceph-volume: rearrange api/lvm.py
Rishabh Dave [Sat, 12 Oct 2019 11:14:39 +0000 (16:44 +0530)]
ceph-volume: rearrange api/lvm.py

Move code for PVs, VGs and LVs, individually, next to each other.

Fixes: https://tracker.ceph.com/issues/42368
Signed-off-by: Rishabh Dave <ridave@redhat.com>
(cherry picked from commit f4b764b55fab611a075ad8e597f1e978e2752b7d)

5 years agonautilus: mgr/dashboard: Automatically use correct chromedrive… (#31371)
Lenz Grimmer [Tue, 5 Nov 2019 10:00:37 +0000 (10:00 +0000)]
nautilus: mgr/dashboard: Automatically use correct chromedrive… (#31371)

nautilus: mgr/dashboard: Automatically use correct chromedriver version

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
5 years agoMerge pull request #30532 from mikechristie/nautilus-rbd-nbd-netlink
Yuri Weinstein [Mon, 4 Nov 2019 21:04:37 +0000 (13:04 -0800)]
Merge pull request #30532 from mikechristie/nautilus-rbd-nbd-netlink

nautilus: rbd-nbd: add netlink support and nl resize

5 years agoMerge pull request #30661 from smithfarm/wip-41771-nautilus
Yuri Weinstein [Mon, 4 Nov 2019 21:04:01 +0000 (13:04 -0800)]
Merge pull request #30661 from smithfarm/wip-41771-nautilus

nautilus: common/config_proxy: hold lock while accessing mutable container

5 years agoMerge pull request #30464 from smithfarm/wip-41915-nautilus
Yuri Weinstein [Mon, 4 Nov 2019 21:03:00 +0000 (13:03 -0800)]
Merge pull request #30464 from smithfarm/wip-41915-nautilus

nautilus: qa: avoid page cache for krbd discard round off tests

5 years agoMerge pull request #30423 from smithfarm/wip-41545-nautilus
Yuri Weinstein [Mon, 4 Nov 2019 21:02:19 +0000 (13:02 -0800)]
Merge pull request #30423 from smithfarm/wip-41545-nautilus

nautilus: test/librbd: set nbd timeout due to newer kernels defaulting it on

5 years agoMerge pull request #30354 from pdvian/wip-41764-nautilus
Yuri Weinstein [Mon, 4 Nov 2019 21:01:35 +0000 (13:01 -0800)]
Merge pull request #30354 from pdvian/wip-41764-nautilus

nautilus: test/cls_rbd/test_cls_rbd: update TestClsRbd.sparsify

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
5 years agoMerge pull request #30120 from pdvian/wip-41620-nautilus
Yuri Weinstein [Mon, 4 Nov 2019 21:01:17 +0000 (13:01 -0800)]
Merge pull request #30120 from pdvian/wip-41620-nautilus

nautilus: tools/rbd-ggate: close log before running postfork

5 years agoMerge pull request #30697 from uweigand/nautilus-endian-fixes
Yuri Weinstein [Mon, 4 Nov 2019 21:00:27 +0000 (13:00 -0800)]
Merge pull request #30697 from uweigand/nautilus-endian-fixes

nautilus: backport endian fixes

Reviewed-by: Sage Weil <sage@redhat.com>
5 years agoMerge pull request #30048 from smithfarm/wip-41258-nautilus
Yuri Weinstein [Mon, 4 Nov 2019 20:53:19 +0000 (12:53 -0800)]
Merge pull request #30048 from smithfarm/wip-41258-nautilus

nautilus: bluestore: Don't forget sub kv_submitted_waiters

5 years agoMerge pull request #30007 from smithfarm/wip-41279-nautilus
Yuri Weinstein [Mon, 4 Nov 2019 20:52:27 +0000 (12:52 -0800)]
Merge pull request #30007 from smithfarm/wip-41279-nautilus

nautilus: mgr/prometheus: Cast collect_timeout (scrape_interval) to float

5 years agoMerge pull request #30000 from smithfarm/wip-41503-nautilus
Yuri Weinstein [Mon, 4 Nov 2019 20:51:36 +0000 (12:51 -0800)]
Merge pull request #30000 from smithfarm/wip-41503-nautilus

nautilus: osd/PeeringState: do not complain about past_intervals constrained by oldest epoch

5 years agoMerge pull request #29999 from smithfarm/wip-41501-nautilus
Yuri Weinstein [Mon, 4 Nov 2019 20:50:25 +0000 (12:50 -0800)]
Merge pull request #29999 from smithfarm/wip-41501-nautilus

nautilus: core: Improve health status for backfill_toofull and recovery_toofull and fix backfill_toofull seen on cluster where the most full OSD is at 1%

5 years agoMerge pull request #30050 from smithfarm/wip-41443-nautilus
Yuri Weinstein [Mon, 4 Nov 2019 20:49:36 +0000 (12:49 -0800)]
Merge pull request #30050 from smithfarm/wip-41443-nautilus

nautilus: core: osd: clear PG_STATE_CLEAN when repair object

5 years agoMerge pull request #30051 from smithfarm/wip-41456-nautilus
Yuri Weinstein [Mon, 4 Nov 2019 20:48:46 +0000 (12:48 -0800)]
Merge pull request #30051 from smithfarm/wip-41456-nautilus

nautilus: core: osd: merge replica log on primary need according to replica log's crt

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #30080 from pdvian/wip-41596-nautilus
Yuri Weinstein [Mon, 4 Nov 2019 20:48:15 +0000 (12:48 -0800)]
Merge pull request #30080 from pdvian/wip-41596-nautilus

nautilus: tools: ceph-objectstore-tool can't remove head with bad snapset

Reviewed-by: David Zafman <dzafman@redhat.com>
5 years agomgr/dashboard: Automatically use correct chromedriver version 31371/head
Tiago Melo [Mon, 4 Nov 2019 11:27:46 +0000 (10:27 -0100)]
mgr/dashboard: Automatically use correct chromedriver version

Every Chrome version requires a corresponding chromedriver version for the e2e
test to work.
Since we were using a fixed chromedriver version, each time chrome was updated
the e2e scripts stopped working.
With this new script we will check which version of Chrome is installed and
update chromedriver to the correct version.

Fixes: https://tracker.ceph.com/issues/42607
Signed-off-by: Alfonso Martínez <almartin@redhat.com>
Signed-off-by: Tiago Melo <tmelo@suse.com>
(cherry picked from commit 242e76e8840b5d9085239a6fa55a29a093792ee3)

Conflicts:
src/pybind/mgr/dashboard/frontend/package.json
- use "e2e:dev" in nautilus, instead of "e2e:ci"

5 years agoMerge pull request #31228 from jan--f/wip-42540-nautilus
Jan Fajerski [Sat, 2 Nov 2019 14:20:46 +0000 (15:20 +0100)]
Merge pull request #31228 from jan--f/wip-42540-nautilus

nautilus: ceph-volume: api/lvm: check if list of LVs is empty

5 years agoMerge pull request #29994 from smithfarm/wip-41448-nautilus
Yuri Weinstein [Fri, 1 Nov 2019 19:12:14 +0000 (12:12 -0700)]
Merge pull request #29994 from smithfarm/wip-41448-nautilus

nautilus: osd/PrimaryLogPG: Avoid accessing destroyed references in finish_degr…

5 years agoMerge pull request #29992 from smithfarm/wip-40084-nautilus
Yuri Weinstein [Fri, 1 Nov 2019 19:11:20 +0000 (12:11 -0700)]
Merge pull request #29992 from smithfarm/wip-40084-nautilus

nautilus: osd: Better error message when OSD count is less than osd_pool_default_size

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #29991 from smithfarm/wip-39700-nautilus
Yuri Weinstein [Fri, 1 Nov 2019 19:09:04 +0000 (12:09 -0700)]
Merge pull request #29991 from smithfarm/wip-39700-nautilus

nautilus: core: If the nodeep-scrub/noscrub flags are set in pools instead of global cluster. List the pool names in the ceph status

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #29988 from smithfarm/wip-39682-nautilus
Yuri Weinstein [Fri, 1 Nov 2019 19:05:18 +0000 (12:05 -0700)]
Merge pull request #29988 from smithfarm/wip-39682-nautilus

nautilus: core: filestore pre-split may not split enough directories

5 years agoMerge pull request #29979 from smithfarm/wip-41341-nautilus
Yuri Weinstein [Fri, 1 Nov 2019 19:04:24 +0000 (12:04 -0700)]
Merge pull request #29979 from smithfarm/wip-41341-nautilus

nautilus: tests: "CMake Error" in test_envlibrados_for_rocksdb.sh

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #29997 from smithfarm/wip-41453-nautilus
Yuri Weinstein [Fri, 1 Nov 2019 19:03:42 +0000 (12:03 -0700)]
Merge pull request #29997 from smithfarm/wip-41453-nautilus

nautilus: core: mon: C_AckMarkedDown has not handled the Callback Arguments

5 years agoMerge pull request #29998 from smithfarm/wip-41491-nautilus
Yuri Weinstein [Fri, 1 Nov 2019 19:03:02 +0000 (12:03 -0700)]
Merge pull request #29998 from smithfarm/wip-41491-nautilus

nautilus: core: osd/OSDCap: Check for empty namespace

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #30805 from jan--f/wip-42236-nautilus
Jan Fajerski [Fri, 1 Nov 2019 13:38:35 +0000 (14:38 +0100)]
Merge pull request #30805 from jan--f/wip-42236-nautilus

nautilus: ceph-volume: PVolumes.filter shouldn't purge itself

5 years agoMerge pull request #30807 from jan--f/wip-42234-nautilus
Jan Fajerski [Fri, 1 Nov 2019 13:38:21 +0000 (14:38 +0100)]
Merge pull request #30807 from jan--f/wip-42234-nautilus

nautilus: ceph-volume: VolumeGroups.filter shouldn't purge itself

5 years agoMerge pull request #31290 from idryomov/wip-krbd-unmap-msgr1-nautilus
Nathan Cutler [Fri, 1 Nov 2019 07:42:54 +0000 (08:42 +0100)]
Merge pull request #31290 from idryomov/wip-krbd-unmap-msgr1-nautilus

nautilus: qa/suites/krbd: run unmap subsuite with msgr1 only

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
5 years agoqa/suites/krbd: run unmap subsuite with msgr1 only 31290/head
Ilya Dryomov [Tue, 29 Oct 2019 15:19:14 +0000 (16:19 +0100)]
qa/suites/krbd: run unmap subsuite with msgr1 only

pre-single-major.yaml kernel doesn't have any of the monitor client
fixes that came in 4.6.  If the connection is closed, it closes the
session and retries only after 10 seconds.  On top of that, there is
nothing to prevent it from picking the same monitor when reconnecting.
This means that when given both v1 and v2 ports (which look like two
different monitors), it is susceptible to mount_timeout (60 seconds):

  $ sudo rbd map img
  rbd: sysfs write failed
  In some cases useful info is found in syslog - try "dmesg | tail".
  rbd: map failed: (5) Input/output error

  [  822.242313] libceph: mon0 172.21.15.132:3300 socket closed (con state CONNECTING)
  [  832.265494] libceph: mon0 172.21.15.132:3300 socket closed (con state CONNECTING)
  [  842.296175] libceph: mon0 172.21.15.132:3300 socket closed (con state CONNECTING)
  [  852.326924] libceph: mon0 172.21.15.132:3300 socket closed (con state CONNECTING)
  [  862.357611] libceph: mon0 172.21.15.132:3300 socket closed (con state CONNECTING)
  [  872.388373] libceph: mon0 172.21.15.132:3300 socket closed (con state CONNECTING)
  [  882.676136] libceph: mon0 172.21.15.132:3300 socket closed (con state CONNECTING)

Unlike newer kernels that return ETIMEDOUT, it returns EIO.

Newer kernels are much more aggressive about retries and will pick
a different monitor when reconnecting, hence they are always able to
establish the session in time.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 5011cc926cd434a6c095bab57e4b0658f98f5657)

5 years agoMerge pull request #31210 from sebastian-philipp/nautilus-ceph-volume-device_id
Jan Fajerski [Thu, 31 Oct 2019 10:48:15 +0000 (11:48 +0100)]
Merge pull request #31210 from sebastian-philipp/nautilus-ceph-volume-device_id

nautilus: ceph-volume: add Ceph's device id to inventory

5 years agoMerge pull request #31259 from jan--f/wip-41290-nautilus
Nathan Cutler [Thu, 31 Oct 2019 10:20:56 +0000 (11:20 +0100)]
Merge pull request #31259 from jan--f/wip-41290-nautilus

nautilus: doc: update bluestore cache settings and clarify data fraction

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
5 years agodoc: update bluestore cache settings and clarify data fraction 31259/head
Jan Fajerski [Mon, 29 Apr 2019 12:52:27 +0000 (14:52 +0200)]
doc: update bluestore cache settings and clarify data fraction

Fixes: http://tracker.ceph.com/issues/39522
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit 9d8336a7f418fe2bb11361dd74a214403b1e5be7)

5 years agoapi/lvm: rewrite a condition 31228/head
Rishabh Dave [Tue, 3 Sep 2019 13:06:23 +0000 (18:36 +0530)]
api/lvm: rewrite a condition

Create the list of logical volumes if the list passed in arguments is
empty and rewrite the condition to make it more readable.

Fixes: https://tracker.ceph.com/issues/41649
Signed-off-by: Rishabh Dave <ridave@redhat.com>
(cherry picked from commit d1f1bfd3635501090f4069be59e0bcde94dd64ec)

5 years agoceph-volume: add Ceph's device id to inventory 31210/head
Sebastian Wagner [Fri, 18 Oct 2019 11:59:44 +0000 (13:59 +0200)]
ceph-volume: add Ceph's device id to inventory

This will benefit the orchestrator and dashboard to show a unified view of devices with SMART data

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
(cherry picked from commit e70d6041c1a093ed5c2b77abe17e1ede533d9659)

5 years agoMerge pull request #31074 from smithfarm/wip-42417-nautilus
Nathan Cutler [Wed, 23 Oct 2019 14:01:24 +0000 (16:01 +0200)]
Merge pull request #31074 from smithfarm/wip-42417-nautilus

nautilus: doc/rbd: s/guess/xml/ for codeblock lexer

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
5 years agodoc/rbd: s/guess/xml/ for codeblock lexer 31074/head
Kefu Chai [Wed, 16 Oct 2019 04:34:19 +0000 (12:34 +0800)]
doc/rbd: s/guess/xml/ for codeblock lexer

this change silences the warning of

```
doc/rbd/qemu-rbd.rst:174: WARNING: Pygments lexer name 'guess' is not
known
```

see http://pygments.org/docs/lexers/, we should use "xml" for XML .

Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit df226da996e468d2707b08eb012d54b4e37ffdc6)

5 years agoMerge pull request #31009 from SUSE/wip-doc-telemetry-default-interval-nautilus
Nathan Cutler [Mon, 21 Oct 2019 20:22:21 +0000 (22:22 +0200)]
Merge pull request #31009 from SUSE/wip-doc-telemetry-default-interval-nautilus

nautilus: doc/mgr/telemetry: update default interval

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
5 years agodoc/mgr/telemetry: update default interval 31009/head
Tim Serong [Mon, 21 Oct 2019 07:11:35 +0000 (18:11 +1100)]
doc/mgr/telemetry: update default interval

Commit 712987d533 changed the default interval to 24h;
updating the docs to match (this also should go to
the Nautilus branch as that commit landed there too
in https://github.com/ceph/ceph/pull/27709)

Signed-off-by: Tim Serong <tserong@suse.com>
(cherry picked from commit 3c8793c4bd077db2796b512a3b59cd6a01cb3a8c)

5 years agoosd: Rename backfill reservation reject names to reflect too full use 29999/head
David Zafman [Fri, 23 Aug 2019 15:54:28 +0000 (08:54 -0700)]
osd: Rename backfill reservation reject names to reflect too full use

The only reason for a reject is in a too full condition.  Now that we
have two types of revoke, let's make this clearer.

Signed-off-by: David Zafman <dzafman@redhat.com>
(cherry picked from commit 0115595c1d1366cb3633e9dc6730496b9e5cf5c4)

Conflicts:
src/osd/PeeringEvent.h
- file does not exist in nautilus due to refactoring: made the changes manually to src/osd/PGPeeringEvent.h
src/osd/PeeringState.cc
src/osd/PeeringState.h
- files do not exist in nautilus due to refactoring: made the changes manually to src/osd/PG.{cc,h}
  by doing:
      s/RejectRemoteReservation/RejectTooFullRemoteReservation/g
      s/RemoteReservationRejected/RemoteReservationRejectedTooFull/g

5 years agoosd: Rename MBackfillReserve::TOOFULL to what it does in particular (revoke)
David Zafman [Thu, 22 Aug 2019 17:30:01 +0000 (10:30 -0700)]
osd: Rename MBackfillReserve::TOOFULL to what it does in particular (revoke)

Signed-off-by: David Zafman <dzafman@redhat.com>
(cherry picked from commit 7810ee584cc0fe9ca1b819d2a807dfc7cd13d292)

Conflicts:
src/osd/PeeringState.cc
- file does not exist in nautilus due to refactoring: made the changes manually
  to src/osd/PG.cc

5 years agoosd: Don't set backfill_toofull in RemoteReservationRevoked path
David Zafman [Fri, 23 Aug 2019 15:52:39 +0000 (08:52 -0700)]
osd: Don't set backfill_toofull in RemoteReservationRevoked path

We shouldn't set backfill_toofull when a revoke occurs in the non-toofull
case.

Fixes: https://tracker.ceph.com/issues/41255
Signed-off-by: David Zafman <dzafman@redhat.com>
(cherry picked from commit fa569ecfecc43ce685b29e0456f62cb085788f25)

Conflicts:
src/osd/PeeringState.cc
- file does not exist in nautilus due to refactoring: made the changes manually
  to src/osd/PG.cc
- no "DECLARE_LOCALS" in nautilus

5 years agoceph-volume: update tests since VolumeGroups.filter returns a list 30807/head
Rishabh Dave [Thu, 3 Oct 2019 12:14:37 +0000 (17:44 +0530)]
ceph-volume: update tests since VolumeGroups.filter returns a list

VolumeGroups.filter returns VolumeGroups object that contains VGs
matching the filter. Update the tests to hold the list returned by the
Volumes.filter() call.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
(cherry picked from commit da58d239a0e067cd3ea5fd26aac24a2551b871c1)

5 years agoceph-volume: VolumeGroups.filter shouldn't purge itself
Rishabh Dave [Thu, 3 Oct 2019 12:09:37 +0000 (17:39 +0530)]
ceph-volume: VolumeGroups.filter shouldn't purge itself

VolumeGroups.filter remove VGs from the list that do no match filter.
Instead of doing that, return a new list that contains VGs that match
the fiter so that VolumeGroups object held by code calling it is not
modified.

Fixes: https://tracker.ceph.com/issues/42171
Signed-off-by: Rishabh Dave <ridave@redhat.com>
(cherry picked from commit 028757813282f764ebcce05572f9e4b76ea4e552)

5 years agoceph-volume: allow creating empty VolumeGroup objects
Rishabh Dave [Thu, 3 Oct 2019 12:10:37 +0000 (17:40 +0530)]
ceph-volume: allow creating empty VolumeGroup objects

Signed-off-by: Rishabh Dave <ridave@redhat.com>
(cherry picked from commit 2dc4f7de96e51c8117b719640ec4c09388a1412e)

5 years agoceph-volume: update tests since PVolumes.filter returns a list 30805/head
Rishabh Dave [Thu, 3 Oct 2019 11:30:38 +0000 (17:00 +0530)]
ceph-volume: update tests since PVolumes.filter returns a list

...returns a list of filtered PVs instead of removing the items that do
not match the filters from itself.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
(cherry picked from commit 38ccfe089a86f86b6e48b9a60286f26bb2444596)

5 years agoceph-volume: PVolumes.filter shouldn't purge itself
Rishabh Dave [Thu, 3 Oct 2019 11:18:46 +0000 (16:48 +0530)]
ceph-volume: PVolumes.filter shouldn't purge itself

PVolumes.filter removes the PVs that do not match the filters from its
list. This approach is problematic since the code calling this method
has to create a copy beforehand. Therefore, it's better to return a new
object that contains PVs that matches the filters.

Fixes: https://tracker.ceph.com/issues/42170
Signed-off-by: Rishabh Dave <ridave@redhat.com>
(cherry picked from commit fcec33ee50457d43add844aef3b81bbf9dd2ad58)

5 years agoceph-volume: allow creating empty PVolumes objects
Rishabh Dave [Thu, 3 Oct 2019 11:14:35 +0000 (16:44 +0530)]
ceph-volume: allow creating empty PVolumes objects

Signed-off-by: Rishabh Dave <ridave@redhat.com>
(cherry picked from commit 384aaee8fd2b0de7120e58efc3ebbd2a520d709f)

5 years agoMerge pull request #30676 from sobelek/wip-42050-nautilus
Jan Fajerski [Wed, 9 Oct 2019 11:15:12 +0000 (13:15 +0200)]
Merge pull request #30676 from sobelek/wip-42050-nautilus

nautilus: ceph-volume: fix warnings raised by pytest

5 years agoMerge pull request #29965 from smithfarm/wip-41272-nautilus
Yuri Weinstein [Tue, 8 Oct 2019 19:51:20 +0000 (12:51 -0700)]
Merge pull request #29965 from smithfarm/wip-41272-nautilus

nautilus: rgw: rgw-log issues the wrong message when decompression fails

5 years agoMerge pull request #29969 from smithfarm/wip-41446-nautilus
Yuri Weinstein [Tue, 8 Oct 2019 19:50:35 +0000 (12:50 -0700)]
Merge pull request #29969 from smithfarm/wip-41446-nautilus

nautilus: rgw_file: readdir: do not construct markers w/leading '/'

5 years agoMerge pull request #29970 from smithfarm/wip-41459-nautilus
Yuri Weinstein [Tue, 8 Oct 2019 19:50:09 +0000 (12:50 -0700)]
Merge pull request #29970 from smithfarm/wip-41459-nautilus

nautilus: rgw: Put User Policy is sensitive to whitespace

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #29972 from smithfarm/wip-41482-nautilus
Yuri Weinstein [Tue, 8 Oct 2019 19:49:41 +0000 (12:49 -0700)]
Merge pull request #29972 from smithfarm/wip-41482-nautilus

nautilus: rgw: potential realm watch lost

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #29974 from smithfarm/wip-41493-nautilus
Yuri Weinstein [Tue, 8 Oct 2019 19:49:06 +0000 (12:49 -0700)]
Merge pull request #29974 from smithfarm/wip-41493-nautilus

nautilus: rgw: multisite: radosgw-admin bucket sync status incorrectly reports "caught up" during full sync

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #29963 from smithfarm/wip-41267-nautilus
Yuri Weinstein [Tue, 8 Oct 2019 19:46:39 +0000 (12:46 -0700)]
Merge pull request #29963 from smithfarm/wip-41267-nautilus

nautilus: rgw: beast frontend throws an exception when running out of FDs

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #29971 from smithfarm/wip-41479-nautilus
Yuri Weinstein [Tue, 8 Oct 2019 19:45:43 +0000 (12:45 -0700)]
Merge pull request #29971 from smithfarm/wip-41479-nautilus

nautilus: rgw: dns name is not case sensitive

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #30037 from smithfarm/wip-41588-nautilus
Yuri Weinstein [Tue, 8 Oct 2019 19:44:56 +0000 (12:44 -0700)]
Merge pull request #30037 from smithfarm/wip-41588-nautilus

nautilus: rgw: fix a bug that lifecycle expiraton generates delete marker continuously

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #30068 from smithfarm/wip-41485-nautilus
Yuri Weinstein [Tue, 8 Oct 2019 19:44:30 +0000 (12:44 -0700)]
Merge pull request #30068 from smithfarm/wip-41485-nautilus

nautilus: rgw: fix list bucket with delimiter wrongly skip some special keys

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #30160 from pdvian/wip-41624-nautilus
Yuri Weinstein [Tue, 8 Oct 2019 19:44:05 +0000 (12:44 -0700)]
Merge pull request #30160 from pdvian/wip-41624-nautilus

nautilus: rgw/rgw_op: Remove get_val from hotpath via legacy options

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #30748 from smithfarm/wip-42194
Nathan Cutler [Tue, 8 Oct 2019 14:06:22 +0000 (16:06 +0200)]
Merge pull request #30748 from smithfarm/wip-42194

nautilus: tools: ceph-backport.sh: add deprecation warning

Reviewed-by: Mykola Golub <mgolub@suse.com>
5 years agoMerge pull request #29591 from pdvian/wip-40894-nautilus
Yuri Weinstein [Mon, 7 Oct 2019 19:41:03 +0000 (12:41 -0700)]
Merge pull request #29591 from pdvian/wip-40894-nautilus

nautilus: mds: cleanup truncating inodes when standby replay mds trim log segments

Reviewed-by: Venky Shankar <vshankar@redhat.com>
5 years agoMerge pull request #29878 from pdvian/wip-41096-nautilus
Yuri Weinstein [Mon, 7 Oct 2019 19:40:38 +0000 (12:40 -0700)]
Merge pull request #29878 from pdvian/wip-41096-nautilus

nautilus: cephfs: avoid map been inserted by mistake

Reviewed-by: Venky Shankar <vshankar@redhat.com>
5 years agoMerge pull request #29879 from pdvian/wip-41099-nautilus
Yuri Weinstein [Mon, 7 Oct 2019 19:40:17 +0000 (12:40 -0700)]
Merge pull request #29879 from pdvian/wip-41099-nautilus

nautilus: cephfs: fix a memory leak

Reviewed-by: Venky Shankar <vshankar@redhat.com>
5 years agoMerge pull request #29938 from pdvian/wip-41107-nautilus
Yuri Weinstein [Mon, 7 Oct 2019 19:39:57 +0000 (12:39 -0700)]
Merge pull request #29938 from pdvian/wip-41107-nautilus

nautilus: mds: delay exporting directory whose pin value exceeds max rank id

Reviewed-by: Venky Shankar <vshankar@redhat.com>
5 years agoMerge pull request #29983 from pdvian/wip-41128-nautilus
Yuri Weinstein [Mon, 7 Oct 2019 19:39:35 +0000 (12:39 -0700)]
Merge pull request #29983 from pdvian/wip-41128-nautilus

nautilus: qa: power off still resulted in client sending session close

Reviewed-by: Venky Shankar <vshankar@redhat.com>
5 years agoMerge pull request #30026 from smithfarm/wip-40895-nautilus
Yuri Weinstein [Mon, 7 Oct 2019 19:38:20 +0000 (12:38 -0700)]
Merge pull request #30026 from smithfarm/wip-40895-nautilus

nautilus: pybind/cephfs: Modification to error message

Reviewed-by: Venky Shankar <vshankar@redhat.com>
5 years agoMerge pull request #30030 from smithfarm/wip-40887-nautilus
Yuri Weinstein [Mon, 7 Oct 2019 19:37:04 +0000 (12:37 -0700)]
Merge pull request #30030 from smithfarm/wip-40887-nautilus

nautilus: ceph_volume_client: convert string to bytes object

Reviewed-by: Venky Shankar <vshankar@redhat.com>
5 years agoMerge pull request #30031 from smithfarm/wip-40900-nautilus
Yuri Weinstein [Mon, 7 Oct 2019 19:36:21 +0000 (12:36 -0700)]
Merge pull request #30031 from smithfarm/wip-40900-nautilus

nautilus: mds: evict an unresponsive client only when another client wants its caps

Reviewed-by: Venky Shankar <vshankar@redhat.com>
5 years agoMerge pull request #30032 from smithfarm/wip-41113-nautilus
Yuri Weinstein [Mon, 7 Oct 2019 19:35:56 +0000 (12:35 -0700)]
Merge pull request #30032 from smithfarm/wip-41113-nautilus

nautilus: cephfs: client: more precise CEPH_CLIENT_CAPS_PENDING_CAPSNAP

Reviewed-by: Venky Shankar <vshankar@redhat.com>
5 years agoMerge pull request #30038 from smithfarm/wip-41276-nautilus
Yuri Weinstein [Mon, 7 Oct 2019 19:35:29 +0000 (12:35 -0700)]
Merge pull request #30038 from smithfarm/wip-41276-nautilus

nautilus: tests: cephfs: fix malformed qa suite config

Reviewed-by: Venky Shankar <vshankar@redhat.com>
5 years agoMerge pull request #30039 from smithfarm/wip-41465-nautilus
Yuri Weinstein [Mon, 7 Oct 2019 19:34:56 +0000 (12:34 -0700)]
Merge pull request #30039 from smithfarm/wip-41465-nautilus

nautilus: cephfs: mount.ceph: properly handle -o strictatime

Reviewed-by: Venky Shankar <vshankar@redhat.com>
5 years agoMerge pull request #30040 from smithfarm/wip-41467-nautilus
Yuri Weinstein [Mon, 7 Oct 2019 19:34:26 +0000 (12:34 -0700)]
Merge pull request #30040 from smithfarm/wip-41467-nautilus

nautilus: mds: trim cache on regular schedule

Reviewed-by: Venky Shankar <vshankar@redhat.com>
5 years agoMerge pull request #30041 from smithfarm/wip-41477-nautilus
Yuri Weinstein [Mon, 7 Oct 2019 19:34:00 +0000 (12:34 -0700)]
Merge pull request #30041 from smithfarm/wip-41477-nautilus

nautilus: mds: fix InoTable::force_consume_to()

5 years agoMerge pull request #30057 from varshar16/wip-nautilus-cephfs-shell-path-conversion
Yuri Weinstein [Mon, 7 Oct 2019 19:33:34 +0000 (12:33 -0700)]
Merge pull request #30057 from varshar16/wip-nautilus-cephfs-shell-path-conversion

nautilus: cephfs-shell: Convert paths type from string to bytes

Reviewed-by: Venky Shankar <vshankar@redhat.com>
5 years agoMerge pull request #30418 from pdvian/wip-41851-nautilus
Yuri Weinstein [Mon, 7 Oct 2019 19:33:07 +0000 (12:33 -0700)]
Merge pull request #30418 from pdvian/wip-41851-nautilus

nautilus: mds: make MDSIOContextBase delete itself when shutting down

Reviewed-by: Venky Shankar <vshankar@redhat.com>
5 years agoMerge pull request #30442 from pdvian/wip-41855-nautilus
Yuri Weinstein [Mon, 7 Oct 2019 19:32:39 +0000 (12:32 -0700)]
Merge pull request #30442 from pdvian/wip-41855-nautilus

nautilus: client: nfs-ganesha with cephfs client, removing dir reports not empty

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>
5 years agoMerge pull request #30455 from smithfarm/wip-41889-nautilus
Yuri Weinstein [Mon, 7 Oct 2019 19:29:43 +0000 (12:29 -0700)]
Merge pull request #30455 from smithfarm/wip-41889-nautilus

nautilus: mgr/volumes: handle exceptions in purge thread with retry

Reviewed-by: Venky Shankar <vshankar@redhat.com>
5 years agoMerge pull request #30508 from ukernel/nautilus-41948
Yuri Weinstein [Mon, 7 Oct 2019 19:28:52 +0000 (12:28 -0700)]
Merge pull request #30508 from ukernel/nautilus-41948

nautilus: mds: wake up lock waiters after forcibly changing lock state

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
5 years agoceph-backport.sh: add deprecation warning 30748/head
Nathan Cutler [Mon, 7 Oct 2019 10:49:33 +0000 (12:49 +0200)]
ceph-backport.sh: add deprecation warning

The script is not maintained in the stable versions of Ceph.

This commit is not a cherry-pick from master, because the script is maintained
in master. It is unmaintained only in the stable versions, like "nautilus".

Also add a --version option which, in this case, will also indicate to the
user that this is an outdated, deprecated version of the script.

Fixes: https://tracker.ceph.com/issues/42194
Signed-off-by: Nathan Cutler <ncutler@suse.com>
5 years agoMerge pull request #30325 from theanalyst/wip-41498-nautilus
Yuri Weinstein [Thu, 3 Oct 2019 20:07:01 +0000 (13:07 -0700)]
Merge pull request #30325 from theanalyst/wip-41498-nautilus

nautilus: rgw: fix the bug of rgw not doing necessary checking to website configuration

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #30437 from smithfarm/wip-41846-nautilus
Yuri Weinstein [Thu, 3 Oct 2019 20:06:38 +0000 (13:06 -0700)]
Merge pull request #30437 from smithfarm/wip-41846-nautilus

nautilus: rgw: increase beast parse buffer size to 64k

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #30604 from vumrao/wip-vumrao-41976
Yuri Weinstein [Thu, 3 Oct 2019 20:06:15 +0000 (13:06 -0700)]
Merge pull request #30604 from vumrao/wip-vumrao-41976

nautilus: radosgw-admin: add --uid check in bucket list command

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #30651 from pdvian/wip-41970-nautilus
Yuri Weinstein [Thu, 3 Oct 2019 20:05:52 +0000 (13:05 -0700)]
Merge pull request #30651 from pdvian/wip-41970-nautilus

nautilus: rgw: ldap auth: S3 auth failure should return InvalidAccessKeyId

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #30680 from pdvian/wip-41974-nautilus
Yuri Weinstein [Thu, 3 Oct 2019 20:05:28 +0000 (13:05 -0700)]
Merge pull request #30680 from pdvian/wip-41974-nautilus

nautilus: rgw: add minssing admin property when sync user info.

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #30247 from pdvian/wip-41631-nautilus
Yuri Weinstein [Thu, 3 Oct 2019 19:58:18 +0000 (12:58 -0700)]
Merge pull request #30247 from pdvian/wip-41631-nautilus

nautilus: rgw: fixed "unrecognized arg" error when using "radosgw-admin zone rm".

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #30248 from pdvian/wip-41627-nautilus
Yuri Weinstein [Thu, 3 Oct 2019 19:57:45 +0000 (12:57 -0700)]
Merge pull request #30248 from pdvian/wip-41627-nautilus

nautilus: rgw: RGWCoroutine::call(nullptr) sets retcode=0

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #30252 from smithfarm/wip-41707-nautilus
Yuri Weinstein [Thu, 3 Oct 2019 19:56:57 +0000 (12:56 -0700)]
Merge pull request #30252 from smithfarm/wip-41707-nautilus

nautilus: rgw: fix cls_bucket_list_unordered() partial results

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
5 years agoMerge pull request #30509 from pdvian/wip-41898-nautilus
Yuri Weinstein [Thu, 3 Oct 2019 19:55:32 +0000 (12:55 -0700)]
Merge pull request #30509 from pdvian/wip-41898-nautilus

nautilus: rgw: fix data sync start delay if remote haven't init data_log

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #30472 from pdvian/wip-41858-nautilus
Yuri Weinstein [Thu, 3 Oct 2019 19:54:58 +0000 (12:54 -0700)]
Merge pull request #30472 from pdvian/wip-41858-nautilus

nautilus: rgw: fix memory growth while deleteing objects with

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #29716 from xiexingguo/wip-build-push-segv-for-n
Yuri Weinstein [Thu, 3 Oct 2019 19:53:24 +0000 (12:53 -0700)]
Merge pull request #29716 from xiexingguo/wip-build-push-segv-for-n

nautilus: core: osd/ReplicatedBackend: check against empty data_included before enabling crc

5 years agoMerge pull request #29928 from smithfarm/wip-41534-nautilus
Yuri Weinstein [Thu, 3 Oct 2019 19:52:42 +0000 (12:52 -0700)]
Merge pull request #29928 from smithfarm/wip-41534-nautilus

nautilus: tests: valgrind: UninitCondition in ceph::crypto::onwire::AES128GCM_OnWireRxHandler::authenticated_decrypt_update_final()

5 years agoMerge pull request #29946 from smithfarm/wip-39412-nautilus
Yuri Weinstein [Thu, 3 Oct 2019 19:51:50 +0000 (12:51 -0700)]
Merge pull request #29946 from smithfarm/wip-39412-nautilus

nautilus: core: pool_stat.dump() - value of num_store_stats is wrong

5 years agoMerge pull request #30278 from pdvian/wip-41703-nautilus
Yuri Weinstein [Thu, 3 Oct 2019 19:51:12 +0000 (12:51 -0700)]
Merge pull request #30278 from pdvian/wip-41703-nautilus

nautilus: osd/PrimaryLogPG: update oi.size on write op implicitly truncating ob…

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
5 years agoMerge pull request #30605 from vumrao/wip-vumrao-41963
Yuri Weinstein [Thu, 3 Oct 2019 19:50:20 +0000 (12:50 -0700)]
Merge pull request #30605 from vumrao/wip-vumrao-41963

nautilus: tools/rados: call pool_lookup() after rados is connected

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #30607 from vumrao/wip-vumrao-41960
Yuri Weinstein [Thu, 3 Oct 2019 19:49:15 +0000 (12:49 -0700)]
Merge pull request #30607 from vumrao/wip-vumrao-41960

nautilus: tools/rados: add --pgid in help

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #30708 from smithfarm/wip-epel-release-snafu-nautilus
Yuri Weinstein [Thu, 3 Oct 2019 19:31:35 +0000 (12:31 -0700)]
Merge pull request #30708 from smithfarm/wip-epel-release-snafu-nautilus

nautilus: build/ops: install-deps: do not install if rpm already installed and ceph.spec.in: s/pkgversion/version_nodots/

Reviewed-by: Yuri Weinstein <yweinste@redhat.com>
5 years agoceph.spec.in: fix Cython package dependency for Fedora 30708/head
Jeff Layton [Thu, 26 Sep 2019 11:50:28 +0000 (07:50 -0400)]
ceph.spec.in: fix Cython package dependency for Fedora

Fedora distros do not have python3?-Cython packages, but they do have
python3-Cython ones. Fix the BuildRequires so that we only use the
python3_version_nodots based version string for RHEL.

Fixes: https://tracker.ceph.com/issues/42032
Signed-off-by: Jeff Layton <jlayton@redhat.com>
(cherry picked from commit 40c5a18f81c67c96f6a35e592ac3141b87c19701)

5 years agoceph.spec.in: s/pkgversion/version_nodots/
Kefu Chai [Fri, 30 Aug 2019 11:49:28 +0000 (19:49 +0800)]
ceph.spec.in: s/pkgversion/version_nodots/

`python3_pkgversion` is now defined as 3, while we don't have packages
like python3-Cython yet in EPEL7. but we do have `python36-Cython`. so
let's use `python3_version_nodots` instead.

Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit 6d2f66846d1b84595cfdf8ac13a7ed4e1ae608ce)

5 years agoinstall-deps: do not install if rpm already installed
Kefu Chai [Fri, 27 Sep 2019 02:26:54 +0000 (10:26 +0800)]
install-deps: do not install if rpm already installed

there is chance that the system already have epel-release-latest-7.noarch.rpm
installed, in that case, install-deps.sh should not fail.

Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit 45a4173bcfe15a9bf56f6aeb6e6c35386a00d1c5)