]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
5 years agoosd: Make encode/decode of osd_stat_t compatible with version 14 30195/head
David Zafman [Wed, 30 Oct 2019 23:59:28 +0000 (16:59 -0700)]
osd: Make encode/decode of osd_stat_t compatible with version 14

Signed-off-by: David Zafman <dzafman@redhat.com>
5 years agotest: Ignore OSD_SLOW_PING_TIME* if injecting socket failures
David Zafman [Thu, 3 Oct 2019 16:09:10 +0000 (09:09 -0700)]
test: Ignore OSD_SLOW_PING_TIME* if injecting socket failures

Fixes: https://tracker.ceph.com/issues/41743
Signed-off-by: David Zafman <dzafman@redhat.com>
(cherry picked from commit ded58ef91d6c8a68de49fa2c6b6e01636515c59b)

5 years agotest: Allow fractional milliseconds to make test possible
David Zafman [Fri, 6 Sep 2019 18:20:10 +0000 (11:20 -0700)]
test: Allow fractional milliseconds to make test possible

Fixes: https://tracker.ceph.com/issues/41689
Signed-off-by: David Zafman <dzafman@redhat.com>
(cherry picked from commit 6d2e4cb109caff8dae5e5e18563b6305131b488b)

Conflicts:
src/common/options.cc (trivial)

5 years agodoc: Document network performance monitoring
David Zafman [Wed, 4 Sep 2019 18:38:09 +0000 (18:38 +0000)]
doc: Document network performance monitoring

Signed-off-by: David Zafman <dzafman@redhat.com>
(cherry picked from commit 71015b94abdf669695754a598a05a4a1c5d46f83)

Conflicts:
doc/rados/operations/monitoring.rst (trivial)

5 years agoosd doc mon mgr: To milliseconds for config value, user input and threshold out
David Zafman [Wed, 4 Sep 2019 17:13:32 +0000 (17:13 +0000)]
osd doc mon mgr: To milliseconds for config value, user input and threshold out

Signed-off-by: David Zafman <dzafman@redhat.com>
(cherry picked from commit 5f83a6158b29944cf8f5a069c50edba3e172cdcc)

Conflicts:
src/common/options.cc (trivial)

5 years agoosd mon mgr: Convert all network ping time output to milliseconds
David Zafman [Tue, 6 Aug 2019 03:57:48 +0000 (20:57 -0700)]
osd mon mgr: Convert all network ping time output to milliseconds

To output milliseconds (usec / 1000), treat as fixed point integers

Signed-off-by: David Zafman <dzafman@redhat.com>
(cherry picked from commit 9d02e5d39d7b5e2806a5d98bdde24f4584e70528)

Conflicts:
src/mon/PGMap.cc (trivial)

5 years agocommon: Add support routines to generate strings for fixed point
David Zafman [Fri, 9 Aug 2019 01:06:43 +0000 (18:06 -0700)]
common: Add support routines to generate strings for fixed point

Signed-off-by: David Zafman <dzafman@redhat.com>
(cherry picked from commit 8ac1562b4988fc3d52f92f15eb58075de0bcf27e)

5 years agotest: Add basic test for network ping tracking
David Zafman [Sat, 13 Jul 2019 02:35:04 +0000 (19:35 -0700)]
test: Add basic test for network ping tracking

Signed-off-by: David Zafman <dzafman@redhat.com>
(cherry picked from commit 4fb42ea27e7b6acefd081b7b287d38347a6085ce)

5 years agoosd: Add debug_heartbeat_testing_span to allow quicker testing
David Zafman [Wed, 24 Jul 2019 21:19:43 +0000 (14:19 -0700)]
osd: Add debug_heartbeat_testing_span to allow quicker testing

Signed-off-by: David Zafman <dzafman@redhat.com>
(cherry picked from commit 573aea2bb1d48237df5182a6e4421e15c1eea88c)

5 years agoosd: Add debug_disable_randomized_ping config for use in testing
David Zafman [Wed, 24 Jul 2019 01:10:46 +0000 (18:10 -0700)]
osd: Add debug_disable_randomized_ping config for use in testing

Signed-off-by: David Zafman <dzafman@redhat.com>
(cherry picked from commit f2b26d88f0a0727f0362ccd8b287f8bb3f41dc3c)

Conflicts:
src/osd/OSD.cc (trivial)

5 years agoosd mgr: Add osd_mon_heartbeat_stat_stale option to time out ping info
David Zafman [Mon, 22 Jul 2019 18:52:41 +0000 (11:52 -0700)]
osd mgr: Add osd_mon_heartbeat_stat_stale option to time out ping info
after 1 hour

Signed-off-by: David Zafman <dzafman@redhat.com>
(cherry picked from commit 048f8096265dd3a647adb970255e4b11c9617b2e)

5 years agomon: Indicate when an osd with slow ping time is down
David Zafman [Fri, 19 Jul 2019 04:29:49 +0000 (21:29 -0700)]
mon: Indicate when an osd with slow ping time is down

Signed-off-by: David Zafman <dzafman@redhat.com>
(cherry picked from commit 5ab145d6402a2525d69296de95b36214bc4c7431)

5 years agoosd mon: Add last_update to osd_stat_t heartbeat info
David Zafman [Fri, 19 Jul 2019 04:28:16 +0000 (21:28 -0700)]
osd mon: Add last_update to osd_stat_t heartbeat info

Ignore old heartbeat info which hasn't updated

Signed-off-by: David Zafman <dzafman@redhat.com>
(cherry picked from commit ea20d3522aaf644cef989c565e11dd781e420e18)

5 years agoosd: After first interval populate vectors so 5min/15min values aren't 0
David Zafman [Tue, 16 Jul 2019 19:02:43 +0000 (12:02 -0700)]
osd: After first interval populate vectors so 5min/15min values aren't 0

Signed-off-by: David Zafman <dzafman@redhat.com>
(cherry picked from commit 6555699d289769a44e9840424192a1be1a6ba00d)

5 years agoosd mgr: Store last pingtime for possible graphing
David Zafman [Mon, 15 Jul 2019 20:23:53 +0000 (13:23 -0700)]
osd mgr: Store last pingtime for possible graphing

Signed-off-by: David Zafman <dzafman@redhat.com>
(cherry picked from commit 3f846d7c806b7f62ead08f0e9fb2ba927ffe0592)

5 years agoosd mgr: Add minimum and maximum tracking to network ping time
David Zafman [Fri, 12 Jul 2019 01:06:23 +0000 (01:06 +0000)]
osd mgr: Add minimum and maximum tracking to network ping time

Signed-off-by: David Zafman <dzafman@redhat.com>
(cherry picked from commit 297a0e7b1de410c094fc9a6e42be14813d6dac5e)

5 years agodoc: Add documentation and release notes
David Zafman [Thu, 11 Jul 2019 00:05:47 +0000 (00:05 +0000)]
doc: Add documentation and release notes

Signed-off-by: David Zafman <dzafman@redhat.com>
(cherry picked from commit f4a0be2e8707f921d65bf22a6c1090e402905ad3)

Conflicts:
PendingReleaseNotes (trivial)

5 years agoosd mgr mon: Add mon_warn_on_slow_ping_ratio config as 5% of osd_heartbeat_grace
David Zafman [Thu, 11 Jul 2019 21:24:12 +0000 (21:24 +0000)]
osd mgr mon: Add mon_warn_on_slow_ping_ratio config as 5% of osd_heartbeat_grace

Compute network ping threshold based on ratio (5% of 20 seconds is 1 second)
Make the threshold value used part of dump_osd_network for osd and mgr
Keep mon_warn_on_slow_ping_time (default 0) to optionally override the ratio

Signed-off-by: David Zafman <dzafman@redhat.com>
(cherry picked from commit 0d1bbd34e96e2da2027861229b376805d5ea8aa6)

5 years agomgr: Add "dump_osd_network" mgr admin request to get a sorted report
David Zafman [Tue, 9 Jul 2019 17:22:12 +0000 (17:22 +0000)]
mgr: Add "dump_osd_network" mgr admin request to get a sorted report

Signed-off-by: David Zafman <dzafman@redhat.com>
(cherry picked from commit 5d3c1856415f8b66e31361a0a7b9c75edc46e49e)

Conflicts:
src/mgr/ClusterState.cc (trivial)

5 years agoosd: Add "dump_osd_network" osd admin request to get a sorted report
David Zafman [Wed, 10 Jul 2019 18:15:44 +0000 (18:15 +0000)]
osd: Add "dump_osd_network" osd admin request to get a sorted report

Signed-off-by: David Zafman <dzafman@redhat.com>
(cherry picked from commit 025b10a5329127734367a6899543f51cd8580d43)

5 years agoosd mon: Track heartbeat ping times and report health warning
David Zafman [Wed, 26 Jun 2019 02:59:06 +0000 (02:59 +0000)]
osd mon: Track heartbeat ping times and report health warning

Fixes: http://tracker.ceph.com/issues/40640
Signed-off-by: David Zafman <dzafman@redhat.com>
(cherry picked from commit 66d44e7f911a57100d650ad7df9445f88ec70140)

Conflicts:
src/common/options.cc (trivial)
src/mon/PGMap.cc (trivial)
src/osd/OSD.cc (trivial)
src/osd/OSD.h (trivial)
src/osd/osd_types.cc (trivial)

src/mon/PGMap.cc manually get rid of extra argument to checks->add
src/osd/OSD.cc rename ping_stamp to stamp for backport

5 years agoMerge pull request #30532 from mikechristie/nautilus-rbd-nbd-netlink
Yuri Weinstein [Mon, 4 Nov 2019 21:04:37 +0000 (13:04 -0800)]
Merge pull request #30532 from mikechristie/nautilus-rbd-nbd-netlink

nautilus: rbd-nbd: add netlink support and nl resize

5 years agoMerge pull request #30661 from smithfarm/wip-41771-nautilus
Yuri Weinstein [Mon, 4 Nov 2019 21:04:01 +0000 (13:04 -0800)]
Merge pull request #30661 from smithfarm/wip-41771-nautilus

nautilus: common/config_proxy: hold lock while accessing mutable container

5 years agoMerge pull request #30464 from smithfarm/wip-41915-nautilus
Yuri Weinstein [Mon, 4 Nov 2019 21:03:00 +0000 (13:03 -0800)]
Merge pull request #30464 from smithfarm/wip-41915-nautilus

nautilus: qa: avoid page cache for krbd discard round off tests

5 years agoMerge pull request #30423 from smithfarm/wip-41545-nautilus
Yuri Weinstein [Mon, 4 Nov 2019 21:02:19 +0000 (13:02 -0800)]
Merge pull request #30423 from smithfarm/wip-41545-nautilus

nautilus: test/librbd: set nbd timeout due to newer kernels defaulting it on

5 years agoMerge pull request #30354 from pdvian/wip-41764-nautilus
Yuri Weinstein [Mon, 4 Nov 2019 21:01:35 +0000 (13:01 -0800)]
Merge pull request #30354 from pdvian/wip-41764-nautilus

nautilus: test/cls_rbd/test_cls_rbd: update TestClsRbd.sparsify

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
5 years agoMerge pull request #30120 from pdvian/wip-41620-nautilus
Yuri Weinstein [Mon, 4 Nov 2019 21:01:17 +0000 (13:01 -0800)]
Merge pull request #30120 from pdvian/wip-41620-nautilus

nautilus: tools/rbd-ggate: close log before running postfork

5 years agoMerge pull request #30697 from uweigand/nautilus-endian-fixes
Yuri Weinstein [Mon, 4 Nov 2019 21:00:27 +0000 (13:00 -0800)]
Merge pull request #30697 from uweigand/nautilus-endian-fixes

nautilus: backport endian fixes

Reviewed-by: Sage Weil <sage@redhat.com>
5 years agoMerge pull request #30048 from smithfarm/wip-41258-nautilus
Yuri Weinstein [Mon, 4 Nov 2019 20:53:19 +0000 (12:53 -0800)]
Merge pull request #30048 from smithfarm/wip-41258-nautilus

nautilus: bluestore: Don't forget sub kv_submitted_waiters

5 years agoMerge pull request #30007 from smithfarm/wip-41279-nautilus
Yuri Weinstein [Mon, 4 Nov 2019 20:52:27 +0000 (12:52 -0800)]
Merge pull request #30007 from smithfarm/wip-41279-nautilus

nautilus: mgr/prometheus: Cast collect_timeout (scrape_interval) to float

5 years agoMerge pull request #30000 from smithfarm/wip-41503-nautilus
Yuri Weinstein [Mon, 4 Nov 2019 20:51:36 +0000 (12:51 -0800)]
Merge pull request #30000 from smithfarm/wip-41503-nautilus

nautilus: osd/PeeringState: do not complain about past_intervals constrained by oldest epoch

5 years agoMerge pull request #29999 from smithfarm/wip-41501-nautilus
Yuri Weinstein [Mon, 4 Nov 2019 20:50:25 +0000 (12:50 -0800)]
Merge pull request #29999 from smithfarm/wip-41501-nautilus

nautilus: core: Improve health status for backfill_toofull and recovery_toofull and fix backfill_toofull seen on cluster where the most full OSD is at 1%

5 years agoMerge pull request #30050 from smithfarm/wip-41443-nautilus
Yuri Weinstein [Mon, 4 Nov 2019 20:49:36 +0000 (12:49 -0800)]
Merge pull request #30050 from smithfarm/wip-41443-nautilus

nautilus: core: osd: clear PG_STATE_CLEAN when repair object

5 years agoMerge pull request #30051 from smithfarm/wip-41456-nautilus
Yuri Weinstein [Mon, 4 Nov 2019 20:48:46 +0000 (12:48 -0800)]
Merge pull request #30051 from smithfarm/wip-41456-nautilus

nautilus: core: osd: merge replica log on primary need according to replica log's crt

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #30080 from pdvian/wip-41596-nautilus
Yuri Weinstein [Mon, 4 Nov 2019 20:48:15 +0000 (12:48 -0800)]
Merge pull request #30080 from pdvian/wip-41596-nautilus

nautilus: tools: ceph-objectstore-tool can't remove head with bad snapset

Reviewed-by: David Zafman <dzafman@redhat.com>
5 years agoMerge pull request #31228 from jan--f/wip-42540-nautilus
Jan Fajerski [Sat, 2 Nov 2019 14:20:46 +0000 (15:20 +0100)]
Merge pull request #31228 from jan--f/wip-42540-nautilus

nautilus: ceph-volume: api/lvm: check if list of LVs is empty

5 years agoMerge pull request #29994 from smithfarm/wip-41448-nautilus
Yuri Weinstein [Fri, 1 Nov 2019 19:12:14 +0000 (12:12 -0700)]
Merge pull request #29994 from smithfarm/wip-41448-nautilus

nautilus: osd/PrimaryLogPG: Avoid accessing destroyed references in finish_degr…

5 years agoMerge pull request #29992 from smithfarm/wip-40084-nautilus
Yuri Weinstein [Fri, 1 Nov 2019 19:11:20 +0000 (12:11 -0700)]
Merge pull request #29992 from smithfarm/wip-40084-nautilus

nautilus: osd: Better error message when OSD count is less than osd_pool_default_size

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #29991 from smithfarm/wip-39700-nautilus
Yuri Weinstein [Fri, 1 Nov 2019 19:09:04 +0000 (12:09 -0700)]
Merge pull request #29991 from smithfarm/wip-39700-nautilus

nautilus: core: If the nodeep-scrub/noscrub flags are set in pools instead of global cluster. List the pool names in the ceph status

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #29988 from smithfarm/wip-39682-nautilus
Yuri Weinstein [Fri, 1 Nov 2019 19:05:18 +0000 (12:05 -0700)]
Merge pull request #29988 from smithfarm/wip-39682-nautilus

nautilus: core: filestore pre-split may not split enough directories

5 years agoMerge pull request #29979 from smithfarm/wip-41341-nautilus
Yuri Weinstein [Fri, 1 Nov 2019 19:04:24 +0000 (12:04 -0700)]
Merge pull request #29979 from smithfarm/wip-41341-nautilus

nautilus: tests: "CMake Error" in test_envlibrados_for_rocksdb.sh

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #29997 from smithfarm/wip-41453-nautilus
Yuri Weinstein [Fri, 1 Nov 2019 19:03:42 +0000 (12:03 -0700)]
Merge pull request #29997 from smithfarm/wip-41453-nautilus

nautilus: core: mon: C_AckMarkedDown has not handled the Callback Arguments

5 years agoMerge pull request #29998 from smithfarm/wip-41491-nautilus
Yuri Weinstein [Fri, 1 Nov 2019 19:03:02 +0000 (12:03 -0700)]
Merge pull request #29998 from smithfarm/wip-41491-nautilus

nautilus: core: osd/OSDCap: Check for empty namespace

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #30805 from jan--f/wip-42236-nautilus
Jan Fajerski [Fri, 1 Nov 2019 13:38:35 +0000 (14:38 +0100)]
Merge pull request #30805 from jan--f/wip-42236-nautilus

nautilus: ceph-volume: PVolumes.filter shouldn't purge itself

5 years agoMerge pull request #30807 from jan--f/wip-42234-nautilus
Jan Fajerski [Fri, 1 Nov 2019 13:38:21 +0000 (14:38 +0100)]
Merge pull request #30807 from jan--f/wip-42234-nautilus

nautilus: ceph-volume: VolumeGroups.filter shouldn't purge itself

5 years agoMerge pull request #31290 from idryomov/wip-krbd-unmap-msgr1-nautilus
Nathan Cutler [Fri, 1 Nov 2019 07:42:54 +0000 (08:42 +0100)]
Merge pull request #31290 from idryomov/wip-krbd-unmap-msgr1-nautilus

nautilus: qa/suites/krbd: run unmap subsuite with msgr1 only

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
5 years agoqa/suites/krbd: run unmap subsuite with msgr1 only 31290/head
Ilya Dryomov [Tue, 29 Oct 2019 15:19:14 +0000 (16:19 +0100)]
qa/suites/krbd: run unmap subsuite with msgr1 only

pre-single-major.yaml kernel doesn't have any of the monitor client
fixes that came in 4.6.  If the connection is closed, it closes the
session and retries only after 10 seconds.  On top of that, there is
nothing to prevent it from picking the same monitor when reconnecting.
This means that when given both v1 and v2 ports (which look like two
different monitors), it is susceptible to mount_timeout (60 seconds):

  $ sudo rbd map img
  rbd: sysfs write failed
  In some cases useful info is found in syslog - try "dmesg | tail".
  rbd: map failed: (5) Input/output error

  [  822.242313] libceph: mon0 172.21.15.132:3300 socket closed (con state CONNECTING)
  [  832.265494] libceph: mon0 172.21.15.132:3300 socket closed (con state CONNECTING)
  [  842.296175] libceph: mon0 172.21.15.132:3300 socket closed (con state CONNECTING)
  [  852.326924] libceph: mon0 172.21.15.132:3300 socket closed (con state CONNECTING)
  [  862.357611] libceph: mon0 172.21.15.132:3300 socket closed (con state CONNECTING)
  [  872.388373] libceph: mon0 172.21.15.132:3300 socket closed (con state CONNECTING)
  [  882.676136] libceph: mon0 172.21.15.132:3300 socket closed (con state CONNECTING)

Unlike newer kernels that return ETIMEDOUT, it returns EIO.

Newer kernels are much more aggressive about retries and will pick
a different monitor when reconnecting, hence they are always able to
establish the session in time.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
(cherry picked from commit 5011cc926cd434a6c095bab57e4b0658f98f5657)

5 years agoMerge pull request #31210 from sebastian-philipp/nautilus-ceph-volume-device_id
Jan Fajerski [Thu, 31 Oct 2019 10:48:15 +0000 (11:48 +0100)]
Merge pull request #31210 from sebastian-philipp/nautilus-ceph-volume-device_id

nautilus: ceph-volume: add Ceph's device id to inventory

5 years agoMerge pull request #31259 from jan--f/wip-41290-nautilus
Nathan Cutler [Thu, 31 Oct 2019 10:20:56 +0000 (11:20 +0100)]
Merge pull request #31259 from jan--f/wip-41290-nautilus

nautilus: doc: update bluestore cache settings and clarify data fraction

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
5 years agodoc: update bluestore cache settings and clarify data fraction 31259/head
Jan Fajerski [Mon, 29 Apr 2019 12:52:27 +0000 (14:52 +0200)]
doc: update bluestore cache settings and clarify data fraction

Fixes: http://tracker.ceph.com/issues/39522
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
(cherry picked from commit 9d8336a7f418fe2bb11361dd74a214403b1e5be7)

5 years agoapi/lvm: rewrite a condition 31228/head
Rishabh Dave [Tue, 3 Sep 2019 13:06:23 +0000 (18:36 +0530)]
api/lvm: rewrite a condition

Create the list of logical volumes if the list passed in arguments is
empty and rewrite the condition to make it more readable.

Fixes: https://tracker.ceph.com/issues/41649
Signed-off-by: Rishabh Dave <ridave@redhat.com>
(cherry picked from commit d1f1bfd3635501090f4069be59e0bcde94dd64ec)

5 years agoceph-volume: add Ceph's device id to inventory 31210/head
Sebastian Wagner [Fri, 18 Oct 2019 11:59:44 +0000 (13:59 +0200)]
ceph-volume: add Ceph's device id to inventory

This will benefit the orchestrator and dashboard to show a unified view of devices with SMART data

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
(cherry picked from commit e70d6041c1a093ed5c2b77abe17e1ede533d9659)

5 years agoMerge pull request #31074 from smithfarm/wip-42417-nautilus
Nathan Cutler [Wed, 23 Oct 2019 14:01:24 +0000 (16:01 +0200)]
Merge pull request #31074 from smithfarm/wip-42417-nautilus

nautilus: doc/rbd: s/guess/xml/ for codeblock lexer

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
5 years agodoc/rbd: s/guess/xml/ for codeblock lexer 31074/head
Kefu Chai [Wed, 16 Oct 2019 04:34:19 +0000 (12:34 +0800)]
doc/rbd: s/guess/xml/ for codeblock lexer

this change silences the warning of

```
doc/rbd/qemu-rbd.rst:174: WARNING: Pygments lexer name 'guess' is not
known
```

see http://pygments.org/docs/lexers/, we should use "xml" for XML .

Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit df226da996e468d2707b08eb012d54b4e37ffdc6)

5 years agoMerge pull request #31009 from SUSE/wip-doc-telemetry-default-interval-nautilus
Nathan Cutler [Mon, 21 Oct 2019 20:22:21 +0000 (22:22 +0200)]
Merge pull request #31009 from SUSE/wip-doc-telemetry-default-interval-nautilus

nautilus: doc/mgr/telemetry: update default interval

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
5 years agodoc/mgr/telemetry: update default interval 31009/head
Tim Serong [Mon, 21 Oct 2019 07:11:35 +0000 (18:11 +1100)]
doc/mgr/telemetry: update default interval

Commit 712987d533 changed the default interval to 24h;
updating the docs to match (this also should go to
the Nautilus branch as that commit landed there too
in https://github.com/ceph/ceph/pull/27709)

Signed-off-by: Tim Serong <tserong@suse.com>
(cherry picked from commit 3c8793c4bd077db2796b512a3b59cd6a01cb3a8c)

5 years agoosd: Rename backfill reservation reject names to reflect too full use 29999/head
David Zafman [Fri, 23 Aug 2019 15:54:28 +0000 (08:54 -0700)]
osd: Rename backfill reservation reject names to reflect too full use

The only reason for a reject is in a too full condition.  Now that we
have two types of revoke, let's make this clearer.

Signed-off-by: David Zafman <dzafman@redhat.com>
(cherry picked from commit 0115595c1d1366cb3633e9dc6730496b9e5cf5c4)

Conflicts:
src/osd/PeeringEvent.h
- file does not exist in nautilus due to refactoring: made the changes manually to src/osd/PGPeeringEvent.h
src/osd/PeeringState.cc
src/osd/PeeringState.h
- files do not exist in nautilus due to refactoring: made the changes manually to src/osd/PG.{cc,h}
  by doing:
      s/RejectRemoteReservation/RejectTooFullRemoteReservation/g
      s/RemoteReservationRejected/RemoteReservationRejectedTooFull/g

5 years agoosd: Rename MBackfillReserve::TOOFULL to what it does in particular (revoke)
David Zafman [Thu, 22 Aug 2019 17:30:01 +0000 (10:30 -0700)]
osd: Rename MBackfillReserve::TOOFULL to what it does in particular (revoke)

Signed-off-by: David Zafman <dzafman@redhat.com>
(cherry picked from commit 7810ee584cc0fe9ca1b819d2a807dfc7cd13d292)

Conflicts:
src/osd/PeeringState.cc
- file does not exist in nautilus due to refactoring: made the changes manually
  to src/osd/PG.cc

5 years agoosd: Don't set backfill_toofull in RemoteReservationRevoked path
David Zafman [Fri, 23 Aug 2019 15:52:39 +0000 (08:52 -0700)]
osd: Don't set backfill_toofull in RemoteReservationRevoked path

We shouldn't set backfill_toofull when a revoke occurs in the non-toofull
case.

Fixes: https://tracker.ceph.com/issues/41255
Signed-off-by: David Zafman <dzafman@redhat.com>
(cherry picked from commit fa569ecfecc43ce685b29e0456f62cb085788f25)

Conflicts:
src/osd/PeeringState.cc
- file does not exist in nautilus due to refactoring: made the changes manually
  to src/osd/PG.cc
- no "DECLARE_LOCALS" in nautilus

5 years agoceph-volume: update tests since VolumeGroups.filter returns a list 30807/head
Rishabh Dave [Thu, 3 Oct 2019 12:14:37 +0000 (17:44 +0530)]
ceph-volume: update tests since VolumeGroups.filter returns a list

VolumeGroups.filter returns VolumeGroups object that contains VGs
matching the filter. Update the tests to hold the list returned by the
Volumes.filter() call.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
(cherry picked from commit da58d239a0e067cd3ea5fd26aac24a2551b871c1)

5 years agoceph-volume: VolumeGroups.filter shouldn't purge itself
Rishabh Dave [Thu, 3 Oct 2019 12:09:37 +0000 (17:39 +0530)]
ceph-volume: VolumeGroups.filter shouldn't purge itself

VolumeGroups.filter remove VGs from the list that do no match filter.
Instead of doing that, return a new list that contains VGs that match
the fiter so that VolumeGroups object held by code calling it is not
modified.

Fixes: https://tracker.ceph.com/issues/42171
Signed-off-by: Rishabh Dave <ridave@redhat.com>
(cherry picked from commit 028757813282f764ebcce05572f9e4b76ea4e552)

5 years agoceph-volume: allow creating empty VolumeGroup objects
Rishabh Dave [Thu, 3 Oct 2019 12:10:37 +0000 (17:40 +0530)]
ceph-volume: allow creating empty VolumeGroup objects

Signed-off-by: Rishabh Dave <ridave@redhat.com>
(cherry picked from commit 2dc4f7de96e51c8117b719640ec4c09388a1412e)

5 years agoceph-volume: update tests since PVolumes.filter returns a list 30805/head
Rishabh Dave [Thu, 3 Oct 2019 11:30:38 +0000 (17:00 +0530)]
ceph-volume: update tests since PVolumes.filter returns a list

...returns a list of filtered PVs instead of removing the items that do
not match the filters from itself.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
(cherry picked from commit 38ccfe089a86f86b6e48b9a60286f26bb2444596)

5 years agoceph-volume: PVolumes.filter shouldn't purge itself
Rishabh Dave [Thu, 3 Oct 2019 11:18:46 +0000 (16:48 +0530)]
ceph-volume: PVolumes.filter shouldn't purge itself

PVolumes.filter removes the PVs that do not match the filters from its
list. This approach is problematic since the code calling this method
has to create a copy beforehand. Therefore, it's better to return a new
object that contains PVs that matches the filters.

Fixes: https://tracker.ceph.com/issues/42170
Signed-off-by: Rishabh Dave <ridave@redhat.com>
(cherry picked from commit fcec33ee50457d43add844aef3b81bbf9dd2ad58)

5 years agoceph-volume: allow creating empty PVolumes objects
Rishabh Dave [Thu, 3 Oct 2019 11:14:35 +0000 (16:44 +0530)]
ceph-volume: allow creating empty PVolumes objects

Signed-off-by: Rishabh Dave <ridave@redhat.com>
(cherry picked from commit 384aaee8fd2b0de7120e58efc3ebbd2a520d709f)

5 years agoMerge pull request #30676 from sobelek/wip-42050-nautilus
Jan Fajerski [Wed, 9 Oct 2019 11:15:12 +0000 (13:15 +0200)]
Merge pull request #30676 from sobelek/wip-42050-nautilus

nautilus: ceph-volume: fix warnings raised by pytest

5 years agoMerge pull request #29965 from smithfarm/wip-41272-nautilus
Yuri Weinstein [Tue, 8 Oct 2019 19:51:20 +0000 (12:51 -0700)]
Merge pull request #29965 from smithfarm/wip-41272-nautilus

nautilus: rgw: rgw-log issues the wrong message when decompression fails

5 years agoMerge pull request #29969 from smithfarm/wip-41446-nautilus
Yuri Weinstein [Tue, 8 Oct 2019 19:50:35 +0000 (12:50 -0700)]
Merge pull request #29969 from smithfarm/wip-41446-nautilus

nautilus: rgw_file: readdir: do not construct markers w/leading '/'

5 years agoMerge pull request #29970 from smithfarm/wip-41459-nautilus
Yuri Weinstein [Tue, 8 Oct 2019 19:50:09 +0000 (12:50 -0700)]
Merge pull request #29970 from smithfarm/wip-41459-nautilus

nautilus: rgw: Put User Policy is sensitive to whitespace

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #29972 from smithfarm/wip-41482-nautilus
Yuri Weinstein [Tue, 8 Oct 2019 19:49:41 +0000 (12:49 -0700)]
Merge pull request #29972 from smithfarm/wip-41482-nautilus

nautilus: rgw: potential realm watch lost

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #29974 from smithfarm/wip-41493-nautilus
Yuri Weinstein [Tue, 8 Oct 2019 19:49:06 +0000 (12:49 -0700)]
Merge pull request #29974 from smithfarm/wip-41493-nautilus

nautilus: rgw: multisite: radosgw-admin bucket sync status incorrectly reports "caught up" during full sync

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #29963 from smithfarm/wip-41267-nautilus
Yuri Weinstein [Tue, 8 Oct 2019 19:46:39 +0000 (12:46 -0700)]
Merge pull request #29963 from smithfarm/wip-41267-nautilus

nautilus: rgw: beast frontend throws an exception when running out of FDs

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #29971 from smithfarm/wip-41479-nautilus
Yuri Weinstein [Tue, 8 Oct 2019 19:45:43 +0000 (12:45 -0700)]
Merge pull request #29971 from smithfarm/wip-41479-nautilus

nautilus: rgw: dns name is not case sensitive

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #30037 from smithfarm/wip-41588-nautilus
Yuri Weinstein [Tue, 8 Oct 2019 19:44:56 +0000 (12:44 -0700)]
Merge pull request #30037 from smithfarm/wip-41588-nautilus

nautilus: rgw: fix a bug that lifecycle expiraton generates delete marker continuously

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #30068 from smithfarm/wip-41485-nautilus
Yuri Weinstein [Tue, 8 Oct 2019 19:44:30 +0000 (12:44 -0700)]
Merge pull request #30068 from smithfarm/wip-41485-nautilus

nautilus: rgw: fix list bucket with delimiter wrongly skip some special keys

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #30160 from pdvian/wip-41624-nautilus
Yuri Weinstein [Tue, 8 Oct 2019 19:44:05 +0000 (12:44 -0700)]
Merge pull request #30160 from pdvian/wip-41624-nautilus

nautilus: rgw/rgw_op: Remove get_val from hotpath via legacy options

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #30748 from smithfarm/wip-42194
Nathan Cutler [Tue, 8 Oct 2019 14:06:22 +0000 (16:06 +0200)]
Merge pull request #30748 from smithfarm/wip-42194

nautilus: tools: ceph-backport.sh: add deprecation warning

Reviewed-by: Mykola Golub <mgolub@suse.com>
5 years agoMerge pull request #29591 from pdvian/wip-40894-nautilus
Yuri Weinstein [Mon, 7 Oct 2019 19:41:03 +0000 (12:41 -0700)]
Merge pull request #29591 from pdvian/wip-40894-nautilus

nautilus: mds: cleanup truncating inodes when standby replay mds trim log segments

Reviewed-by: Venky Shankar <vshankar@redhat.com>
5 years agoMerge pull request #29878 from pdvian/wip-41096-nautilus
Yuri Weinstein [Mon, 7 Oct 2019 19:40:38 +0000 (12:40 -0700)]
Merge pull request #29878 from pdvian/wip-41096-nautilus

nautilus: cephfs: avoid map been inserted by mistake

Reviewed-by: Venky Shankar <vshankar@redhat.com>
5 years agoMerge pull request #29879 from pdvian/wip-41099-nautilus
Yuri Weinstein [Mon, 7 Oct 2019 19:40:17 +0000 (12:40 -0700)]
Merge pull request #29879 from pdvian/wip-41099-nautilus

nautilus: cephfs: fix a memory leak

Reviewed-by: Venky Shankar <vshankar@redhat.com>
5 years agoMerge pull request #29938 from pdvian/wip-41107-nautilus
Yuri Weinstein [Mon, 7 Oct 2019 19:39:57 +0000 (12:39 -0700)]
Merge pull request #29938 from pdvian/wip-41107-nautilus

nautilus: mds: delay exporting directory whose pin value exceeds max rank id

Reviewed-by: Venky Shankar <vshankar@redhat.com>
5 years agoMerge pull request #29983 from pdvian/wip-41128-nautilus
Yuri Weinstein [Mon, 7 Oct 2019 19:39:35 +0000 (12:39 -0700)]
Merge pull request #29983 from pdvian/wip-41128-nautilus

nautilus: qa: power off still resulted in client sending session close

Reviewed-by: Venky Shankar <vshankar@redhat.com>
5 years agoMerge pull request #30026 from smithfarm/wip-40895-nautilus
Yuri Weinstein [Mon, 7 Oct 2019 19:38:20 +0000 (12:38 -0700)]
Merge pull request #30026 from smithfarm/wip-40895-nautilus

nautilus: pybind/cephfs: Modification to error message

Reviewed-by: Venky Shankar <vshankar@redhat.com>
5 years agoMerge pull request #30030 from smithfarm/wip-40887-nautilus
Yuri Weinstein [Mon, 7 Oct 2019 19:37:04 +0000 (12:37 -0700)]
Merge pull request #30030 from smithfarm/wip-40887-nautilus

nautilus: ceph_volume_client: convert string to bytes object

Reviewed-by: Venky Shankar <vshankar@redhat.com>
5 years agoMerge pull request #30031 from smithfarm/wip-40900-nautilus
Yuri Weinstein [Mon, 7 Oct 2019 19:36:21 +0000 (12:36 -0700)]
Merge pull request #30031 from smithfarm/wip-40900-nautilus

nautilus: mds: evict an unresponsive client only when another client wants its caps

Reviewed-by: Venky Shankar <vshankar@redhat.com>
5 years agoMerge pull request #30032 from smithfarm/wip-41113-nautilus
Yuri Weinstein [Mon, 7 Oct 2019 19:35:56 +0000 (12:35 -0700)]
Merge pull request #30032 from smithfarm/wip-41113-nautilus

nautilus: cephfs: client: more precise CEPH_CLIENT_CAPS_PENDING_CAPSNAP

Reviewed-by: Venky Shankar <vshankar@redhat.com>
5 years agoMerge pull request #30038 from smithfarm/wip-41276-nautilus
Yuri Weinstein [Mon, 7 Oct 2019 19:35:29 +0000 (12:35 -0700)]
Merge pull request #30038 from smithfarm/wip-41276-nautilus

nautilus: tests: cephfs: fix malformed qa suite config

Reviewed-by: Venky Shankar <vshankar@redhat.com>
5 years agoMerge pull request #30039 from smithfarm/wip-41465-nautilus
Yuri Weinstein [Mon, 7 Oct 2019 19:34:56 +0000 (12:34 -0700)]
Merge pull request #30039 from smithfarm/wip-41465-nautilus

nautilus: cephfs: mount.ceph: properly handle -o strictatime

Reviewed-by: Venky Shankar <vshankar@redhat.com>
5 years agoMerge pull request #30040 from smithfarm/wip-41467-nautilus
Yuri Weinstein [Mon, 7 Oct 2019 19:34:26 +0000 (12:34 -0700)]
Merge pull request #30040 from smithfarm/wip-41467-nautilus

nautilus: mds: trim cache on regular schedule

Reviewed-by: Venky Shankar <vshankar@redhat.com>
5 years agoMerge pull request #30041 from smithfarm/wip-41477-nautilus
Yuri Weinstein [Mon, 7 Oct 2019 19:34:00 +0000 (12:34 -0700)]
Merge pull request #30041 from smithfarm/wip-41477-nautilus

nautilus: mds: fix InoTable::force_consume_to()

5 years agoMerge pull request #30057 from varshar16/wip-nautilus-cephfs-shell-path-conversion
Yuri Weinstein [Mon, 7 Oct 2019 19:33:34 +0000 (12:33 -0700)]
Merge pull request #30057 from varshar16/wip-nautilus-cephfs-shell-path-conversion

nautilus: cephfs-shell: Convert paths type from string to bytes

Reviewed-by: Venky Shankar <vshankar@redhat.com>
5 years agoMerge pull request #30418 from pdvian/wip-41851-nautilus
Yuri Weinstein [Mon, 7 Oct 2019 19:33:07 +0000 (12:33 -0700)]
Merge pull request #30418 from pdvian/wip-41851-nautilus

nautilus: mds: make MDSIOContextBase delete itself when shutting down

Reviewed-by: Venky Shankar <vshankar@redhat.com>
5 years agoMerge pull request #30442 from pdvian/wip-41855-nautilus
Yuri Weinstein [Mon, 7 Oct 2019 19:32:39 +0000 (12:32 -0700)]
Merge pull request #30442 from pdvian/wip-41855-nautilus

nautilus: client: nfs-ganesha with cephfs client, removing dir reports not empty

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>
5 years agoMerge pull request #30455 from smithfarm/wip-41889-nautilus
Yuri Weinstein [Mon, 7 Oct 2019 19:29:43 +0000 (12:29 -0700)]
Merge pull request #30455 from smithfarm/wip-41889-nautilus

nautilus: mgr/volumes: handle exceptions in purge thread with retry

Reviewed-by: Venky Shankar <vshankar@redhat.com>
5 years agoMerge pull request #30508 from ukernel/nautilus-41948
Yuri Weinstein [Mon, 7 Oct 2019 19:28:52 +0000 (12:28 -0700)]
Merge pull request #30508 from ukernel/nautilus-41948

nautilus: mds: wake up lock waiters after forcibly changing lock state

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
5 years agoceph-backport.sh: add deprecation warning 30748/head
Nathan Cutler [Mon, 7 Oct 2019 10:49:33 +0000 (12:49 +0200)]
ceph-backport.sh: add deprecation warning

The script is not maintained in the stable versions of Ceph.

This commit is not a cherry-pick from master, because the script is maintained
in master. It is unmaintained only in the stable versions, like "nautilus".

Also add a --version option which, in this case, will also indicate to the
user that this is an outdated, deprecated version of the script.

Fixes: https://tracker.ceph.com/issues/42194
Signed-off-by: Nathan Cutler <ncutler@suse.com>
5 years agoMerge pull request #30325 from theanalyst/wip-41498-nautilus
Yuri Weinstein [Thu, 3 Oct 2019 20:07:01 +0000 (13:07 -0700)]
Merge pull request #30325 from theanalyst/wip-41498-nautilus

nautilus: rgw: fix the bug of rgw not doing necessary checking to website configuration

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #30437 from smithfarm/wip-41846-nautilus
Yuri Weinstein [Thu, 3 Oct 2019 20:06:38 +0000 (13:06 -0700)]
Merge pull request #30437 from smithfarm/wip-41846-nautilus

nautilus: rgw: increase beast parse buffer size to 64k

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #30604 from vumrao/wip-vumrao-41976
Yuri Weinstein [Thu, 3 Oct 2019 20:06:15 +0000 (13:06 -0700)]
Merge pull request #30604 from vumrao/wip-vumrao-41976

nautilus: radosgw-admin: add --uid check in bucket list command

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #30651 from pdvian/wip-41970-nautilus
Yuri Weinstein [Thu, 3 Oct 2019 20:05:52 +0000 (13:05 -0700)]
Merge pull request #30651 from pdvian/wip-41970-nautilus

nautilus: rgw: ldap auth: S3 auth failure should return InvalidAccessKeyId

Reviewed-by: Casey Bodley <cbodley@redhat.com>