]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
5 years agoqa/tasks/cephfs/test_volumes: to make sure the size is int type 34726/head
Xiubo Li [Fri, 24 Apr 2020 01:08:23 +0000 (21:08 -0400)]
qa/tasks/cephfs/test_volumes: to make sure the size is int type

Fix "Error EINVAL: invalid size option '4915200.0'".

In pytho2 int/2 will get a int type result, but in python3 it maybe
a float type.

Fixes: https://tracker.ceph.com/issues/45247
Signed-off-by: Xiubo Li <xiubli@redhat.com>
5 years agoqa/tasks/cephfs/mount: to make sure that the count/seek are int type
Xiubo Li [Thu, 23 Apr 2020 21:31:24 +0000 (17:31 -0400)]
qa/tasks/cephfs/mount: to make sure that the count/seek are int type

To fix "stderr:dd: invalid number: '5.0'".

Fixes: https://tracker.ceph.com/issues/45247
Signed-off-by: Xiubo Li <xiubli@redhat.com>
5 years agoqa/tasks/cephfs/cephfs_test_case: switch 'dict_keys' object to list
Xiubo Li [Thu, 23 Apr 2020 13:23:31 +0000 (09:23 -0400)]
qa/tasks/cephfs/cephfs_test_case: switch 'dict_keys' object to list

Fix the "TypeError: 'dict_keys' object does not support indexing" under
py3.

Signed-off-by: Xiubo Li <xiubli@redhat.com>
5 years agoMerge pull request #33769 from lxbsz/qa_vstart_runner_os
Kefu Chai [Fri, 24 Apr 2020 07:41:54 +0000 (15:41 +0800)]
Merge pull request #33769 from lxbsz/qa_vstart_runner_os

qa/vstart_runner.py: add os and arch properties support

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoqa/tasks/vstart_runner: make remote.sh return str as default 33769/head
Xiubo Li [Thu, 23 Apr 2020 23:14:36 +0000 (19:14 -0400)]
qa/tasks/vstart_runner: make remote.sh return str as default

To address the issue in https://github.com/ceph/teuthology/pull/1459.

Signed-off-by: Xiubo Li <xiubli@redhat.com>
5 years agoqa/vstart_runner.py: add os and arch properties support
Xiubo Li [Fri, 6 Mar 2020 01:10:47 +0000 (20:10 -0500)]
qa/vstart_runner.py: add os and arch properties support

Fixes: https://tracker.ceph.com/issues/44456
Signed-off-by: Xiubo Li <xiubli@redhat.com>
5 years agoMerge pull request #34685 from lxbsz/vstart_runner
Kefu Chai [Fri, 24 Apr 2020 01:09:49 +0000 (09:09 +0800)]
Merge pull request #34685 from lxbsz/vstart_runner

qa/tasks/cephfs/mount: switch to StringIO to fix TypeErrors

Reviewed-by: Kiefer Chang <kiefer.chang@suse.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoqa/tasks/cephfs/mount: switch to StringIO to fix TypeErrors 34685/head
Xiubo Li [Wed, 22 Apr 2020 12:34:05 +0000 (08:34 -0400)]
qa/tasks/cephfs/mount: switch to StringIO to fix TypeErrors

TypeError: cannot use a string pattern on a bytes-like object

Fixes: https://tracker.ceph.com/issues/45175
Signed-off-by: Xiubo Li <xiubli@redhat.com>
5 years agoqa/vstart_runner: remove the debug info
Xiubo Li [Wed, 22 Apr 2020 12:03:27 +0000 (08:03 -0400)]
qa/vstart_runner: remove the debug info

Fixes: https://tracker.ceph.com/issues/45175
Signed-off-by: Xiubo Li <xiubli@redhat.com>
5 years agoMerge pull request #34570 from cbodley/wip-bucket-layout-json
Casey Bodley [Thu, 23 Apr 2020 15:16:55 +0000 (11:16 -0400)]
Merge pull request #34570 from cbodley/wip-bucket-layout-json

rgw: bucket layout fixes

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
5 years agoMerge pull request #34645 from cbodley/wip-rgw-reshard-target-layout
Casey Bodley [Thu, 23 Apr 2020 15:16:44 +0000 (11:16 -0400)]
Merge pull request #34645 from cbodley/wip-rgw-reshard-target-layout

rgw: use target bucket layout for reshard

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
5 years agoMerge pull request #33937 from changchengx/unsigned_compare
Jason Dillaman [Thu, 23 Apr 2020 14:48:33 +0000 (10:48 -0400)]
Merge pull request #33937 from changchengx/unsigned_compare

librbd: fix unsigned value compared with zero

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
5 years agoMerge pull request #34694 from mikechristie/ceph-iscsi-selinux-fixes
Boris Ranto [Thu, 23 Apr 2020 11:52:36 +0000 (13:52 +0200)]
Merge pull request #34694 from mikechristie/ceph-iscsi-selinux-fixes

ceph-iscsi:  selinux fixes

Reviewed-by: Boris Ranto <branto@redhat.com>
5 years agoMerge pull request #34678 from sebastian-philipp/doc-cephadm-install-fix-placement
Sebastian Wagner [Thu, 23 Apr 2020 10:20:30 +0000 (12:20 +0200)]
Merge pull request #34678 from sebastian-philipp/doc-cephadm-install-fix-placement

doc/cephadm: install.rst: fix placement spec.

Reviewed-by: Alexandra Settle <asettle@suse.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
5 years agoMerge pull request #34674 from sebastian-philipp/cephadm-ceph-volume-lock-if-fsid
Sebastian Wagner [Thu, 23 Apr 2020 10:09:22 +0000 (12:09 +0200)]
Merge pull request #34674 from sebastian-philipp/cephadm-ceph-volume-lock-if-fsid

cephadm: Aquire lock, if fsid != None

Reviewed-by: Michael Fritch <mfritch@suse.com>
5 years agoMerge pull request #34620 from mgfritch/cephadm-timeout-test-fixup
Sebastian Wagner [Thu, 23 Apr 2020 10:03:20 +0000 (12:03 +0200)]
Merge pull request #34620 from mgfritch/cephadm-timeout-test-fixup

qa/workunits/cephadm/test_cephadm.sh: extend timeout test

5 years agoMerge pull request #34600 from dsavineau/issue_45120
Sebastian Wagner [Thu, 23 Apr 2020 10:02:31 +0000 (12:02 +0200)]
Merge pull request #34600 from dsavineau/issue_45120

cephadm: fix adopt prometheus command

Reviewed-by: Michael Fritch <mfritch@suse.com>
5 years agoMerge pull request #34688 from sebastian-philipp/qa-test-cephadm-octopus-version
Sebastian Wagner [Thu, 23 Apr 2020 10:01:48 +0000 (12:01 +0200)]
Merge pull request #34688 from sebastian-philipp/qa-test-cephadm-octopus-version

qa/workunits/cephadm/test_cephadm: Also test octopus

Reviewed-by: Michael Fritch <mfritch@suse.com>
5 years agoMerge pull request #34691 from sebastian-philipp/cephadm-ssk-keyring-check_call
Sebastian Wagner [Thu, 23 Apr 2020 10:01:20 +0000 (12:01 +0200)]
Merge pull request #34691 from sebastian-philipp/cephadm-ssk-keyring-check_call

mgr/cephadm: use check_call  for `ssh-keygen`

Reviewed-by: Kiefer Chang <kiefer.chang@suse.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
5 years agoMerge pull request #33065 from ifed01/wip-ifed-spurious-readerr-alert
Igor Fedotov [Thu, 23 Apr 2020 08:32:25 +0000 (11:32 +0300)]
Merge pull request #33065 from ifed01/wip-ifed-spurious-readerr-alert

os/bluestore: introduce health alert on spurious read errors.

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
5 years agoMerge pull request #34666 from rhcs-dashboard/44405-test-totp-increase-time
Laura Paduano [Thu, 23 Apr 2020 07:47:58 +0000 (09:47 +0200)]
Merge pull request #34666 from rhcs-dashboard/44405-test-totp-increase-time

mgr/dashboard: fix tasks.mgr.dashboard.test_rgw.RgwBucketTest.test_all

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
5 years agoMerge pull request #34483 from dabukalam/master
Kefu Chai [Thu, 23 Apr 2020 07:33:06 +0000 (15:33 +0800)]
Merge pull request #34483 from dabukalam/master

doc/rados: Remove obsolete placement group note from EC pool creation

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #33916 from aclamk/fix-bs-avl-memaccounting
Kefu Chai [Thu, 23 Apr 2020 07:22:19 +0000 (15:22 +0800)]
Merge pull request #33916 from aclamk/fix-bs-avl-memaccounting

os/bluestore: Adds shutdown in destructor of AvlAllocator

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #34559 from tchaikov/wip-19076-refactor
Kefu Chai [Thu, 23 Apr 2020 02:34:26 +0000 (10:34 +0800)]
Merge pull request #34559 from tchaikov/wip-19076-refactor

mon/OSDMonitor: refactor loops for better readability

Reviewed-by: Joao Eduardo Luis <joao@suse.de>
Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
5 years agoMerge pull request #34328 from liewegas/cpatch
Josh Durgin [Thu, 23 Apr 2020 01:34:36 +0000 (18:34 -0700)]
Merge pull request #34328 from liewegas/cpatch

script/cpatch: initial version

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
5 years agoMerge pull request #34430 from yison/rwl-image-writeback-cache-seq4
Jason Dillaman [Wed, 22 Apr 2020 23:28:17 +0000 (19:28 -0400)]
Merge pull request #34430 from yison/rwl-image-writeback-cache-seq4

rbd/cache: Replicated Write Log core codes part 4

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
5 years agoselinux: Fix ceph-iscsi etc access 34694/head
Mike Christie [Thu, 9 Jan 2020 00:37:15 +0000 (18:37 -0600)]
selinux: Fix ceph-iscsi etc access

This fixes the selinux errors like this for /etc/target

-----------------------------------
Additional Information:
Source Context                system_u:system_r:ceph_t:s0
Target Context                system_u:object_r:targetd_etc_rw_t:s0
Target Objects                target [ dir ]
Source                        rbd-target-api
Source Path                   rbd-target-api
Port                          <Unknown>
Host                          ans8
Source RPM Packages
Target RPM Packages
Policy RPM                    selinux-policy-3.14.3-20.el8.noarch
Selinux Enabled               True
Policy Type                   targeted
Enforcing Mode                Enforcing
Host Name                     ans8
Platform                      Linux ans8 4.18.0-147.el8.x86_64 #1 SMP
Thu Sep 26
                              15:52:44 UTC 2019 x86_64 x86_64
Alert Count                   1
First Seen                    2020-01-08 18:39:48 EST
Last Seen                     2020-01-08 18:39:48 EST
Local ID                      9a13ee18-eaf2-4f2a-872f-2809ee4928f6

Raw Audit Messages
type=AVC msg=audit(1578526788.148:69): avc:  denied  { search } for
pid=995 comm="rbd-target-api" name="target" dev="sda1" ino=52198
scontext=system_u:system_r:ceph_t:s0
tcontext=system_u:object_r:targetd_etc_rw_t:s0 tclass=dir permissive=1

Hash: rbd-target-api,ceph_t,targetd_etc_rw_t,dir,search

which are a result of the rtslib library the ceph-iscsi daemons use
accessing /etc/target to read/write a file which stores meta data the
target uses.

Signed-off-by: Mike Christie <mchristi@redhat.com>
5 years agoselinux: Fix ceph-iscsi configfs access
Mike Christie [Thu, 9 Jan 2020 00:03:40 +0000 (18:03 -0600)]
selinux: Fix ceph-iscsi configfs access

This fixes the the following selinux error when using ceph-iscsi's
rbd-target-api daemon (rbd-target-gw has the same issue). They are
a result of the a python library, rtslib, which the daemons use.

Additional Information:
Source Context                system_u:system_r:ceph_t:s0
Target Context                system_u:object_r:configfs_t:s0
Target Objects
/sys/kernel/config/target/iscsi/iqn.2003-01.com.re
                              dhat:ceph-iscsi/tpgt_1/attrib/authentication
[
                              file ]
Source                        rbd-target-api
Source Path                   /usr/libexec/platform-python3.6
Port                          <Unknown>
Host                          ans8
Source RPM Packages           platform-python-3.6.8-15.1.el8.x86_64
Target RPM Packages
Policy RPM                    selinux-policy-3.14.3-20.el8.noarch
Selinux Enabled               True
Policy Type                   targeted
Enforcing Mode                Enforcing
Host Name                     ans8
Platform                      Linux ans8 4.18.0-147.el8.x86_64 #1 SMP
Thu Sep 26
                              15:52:44 UTC 2019 x86_64 x86_64
Alert Count                   1
First Seen                    2020-01-08 18:39:47 EST
Last Seen                     2020-01-08 18:39:47 EST
Local ID                      6f8c3415-7a50-4dc8-b3d2-2621e1d00ca3

Raw Audit Messages
type=AVC msg=audit(1578526787.577:68): avc:  denied  { ioctl } for
pid=995 comm="rbd-target-api"
path="/sys/kernel/config/target/iscsi/iqn.2003-01.com.redhat:ceph-iscsi/tpgt_1/attrib/authentication"
dev="configfs" ino=25703 ioctlcmd=0x5401
scontext=system_u:system_r:ceph_t:s0
tcontext=system_u:object_r:configfs_t:s0 tclass=file permissive=1

type=SYSCALL msg=audit(1578526787.577:68): arch=x86_64 syscall=ioctl
success=no exit=ENOTTY a0=34 a1=5401 a2=7ffd4f8f1f60 a3=3052cd2d95839b96
items=0 ppid=1 pid=995 auid=4294967295 uid=0 gid=0 euid=0 suid=0 fsuid=0
egid=0 sgid=0 fsgid=0 tty=(none) ses=4294967295 comm=rbd-target-api
exe=/usr/libexec/platform-python3.6 subj=system_u:system_r:ceph_t:s0
key=(null)

Hash: rbd-target-api,ceph_t,configfs_t,file,ioctl

Signed-off-by: Mike Christie <mchristi@redhat.com>
5 years agoMerge pull request #34669 from yuvalif/remove_queue_dependency
Casey Bodley [Wed, 22 Apr 2020 14:35:48 +0000 (10:35 -0400)]
Merge pull request #34669 from yuvalif/remove_queue_dependency

cls/2pc_queue: remove the dependency of cls_2pc_queue with cls_queue

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #34664 from yuvalif/clarify_topic_creation_format
Casey Bodley [Wed, 22 Apr 2020 14:35:28 +0000 (10:35 -0400)]
Merge pull request #34664 from yuvalif/clarify_topic_creation_format

rgw/doc: clarify topic creation format

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agomgr/cephadm: use check_call for `ssh-keygen` 34691/head
Sebastian Wagner [Wed, 22 Apr 2020 14:10:27 +0000 (16:10 +0200)]
mgr/cephadm: use check_call  for `ssh-keygen`

Mainly to provide any reasonable error

Fixes: https://tracker.ceph.com/issues/44832
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
5 years agoMerge pull request #34613 from cbodley/wip-44661
Casey Bodley [Wed, 22 Apr 2020 14:06:06 +0000 (10:06 -0400)]
Merge pull request #34613 from cbodley/wip-44661

rgw: use DEFER_DROP_PRIVILEGES flag unconditionally

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
5 years agoqa/workunits/cephadm/test_cephadm: Also test octopus 34688/head
Sebastian Wagner [Wed, 22 Apr 2020 13:31:19 +0000 (15:31 +0200)]
qa/workunits/cephadm/test_cephadm: Also test octopus

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
5 years agoMerge pull request #34621 from mgfritch/cephadm-test-cleanup
Sebastian Wagner [Wed, 22 Apr 2020 12:38:16 +0000 (14:38 +0200)]
Merge pull request #34621 from mgfritch/cephadm-test-cleanup

qa/workunits/cephadm/test_cephadm.sh: add CLEANUP var

5 years agoMerge pull request #34568 from sebastian-philipp/orch-upgrade-usage
Sebastian Wagner [Wed, 22 Apr 2020 12:37:55 +0000 (14:37 +0200)]
Merge pull request #34568 from sebastian-philipp/orch-upgrade-usage

mgr/orch: upgrade: better input validation

Reviewed-by: Joshua Schmid <jschmid@suse.de>
Reviewed-by: Michael Fritch <mfritch@suse.com>
5 years agoMerge pull request #34565 from SUSE/wip-fix-45095
Sebastian Wagner [Wed, 22 Apr 2020 12:37:04 +0000 (14:37 +0200)]
Merge pull request #34565 from SUSE/wip-fix-45095

cephadm: handle adopting offline OSDs

Reviewed-by: Michael Fritch <mfritch@suse.com>
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
5 years agoMerge pull request #34442 from tspmelo/wip-fix-rgw-bucket-checkbox
Lenz Grimmer [Wed, 22 Apr 2020 11:31:49 +0000 (13:31 +0200)]
Merge pull request #34442 from tspmelo/wip-fix-rgw-bucket-checkbox

Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
5 years agodoc/cephadm: install.rst: fix placement spec. 34678/head
Sebastian Wagner [Wed, 22 Apr 2020 10:38:13 +0000 (12:38 +0200)]
doc/cephadm: install.rst: fix placement spec.

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
5 years agocephadm: Aquire lock, if fsid != None 34674/head
Sebastian Wagner [Wed, 22 Apr 2020 09:51:49 +0000 (11:51 +0200)]
cephadm: Aquire lock, if fsid != None

Fixes:

```
Traceback (most recent call last):
  File "./cephadm", line 4494, in <module>
    r = args.func()
  File "./cephadm", line 1077, in _infer_fsid
    return func()
  File "./cephadm", line 1103, in _infer_image
    return func()
  File "./cephadm", line 2813, in command_ceph_volume
    l = FileLock(args.fsid)
  File "./cephadm", line 560, in __init__
    self._lock_file = os.path.join(LOCK_DIR, name + '.lock')
TypeError: unsupported operand type(s) for +: 'NoneType' and 'str'
```

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
5 years agoMerge pull request #33479 from simon-rock/simon_split_stray
Yan, Zheng [Wed, 22 Apr 2020 06:55:57 +0000 (14:55 +0800)]
Merge pull request #33479 from simon-rock/simon_split_stray

mds : enable fragmentation of stray dir when conditions are met

5 years agoMerge pull request #34561 from kotreshhr/ceph-fs-status-output
Gregory Farnum [Wed, 22 Apr 2020 05:17:42 +0000 (22:17 -0700)]
Merge pull request #34561 from kotreshhr/ceph-fs-status-output

mgr/status: Fix "ceph fs status" json format writing to stderr

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
5 years agoMerge pull request #34546 from varshar16/wip-flake8-cephfs-shell
Gregory Farnum [Wed, 22 Apr 2020 05:16:43 +0000 (22:16 -0700)]
Merge pull request #34546 from varshar16/wip-flake8-cephfs-shell

cephfs-shell: Fix multiple flake8 errors

Reviewed-by: Rishabh Dave <ridave@redhat.com>
5 years agoMerge pull request #34534 from ajarr/fix-43061
Gregory Farnum [Wed, 22 Apr 2020 05:15:23 +0000 (22:15 -0700)]
Merge pull request #34534 from ajarr/fix-43061

mon/FSCommands: Fix 'add_data_pool' command and 'fs new' command

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
5 years agoMerge pull request #34164 from ukernel/wip-44382
Gregory Farnum [Wed, 22 Apr 2020 05:14:10 +0000 (22:14 -0700)]
Merge pull request #34164 from ukernel/wip-44382

qa/cephfs: update TestClusterFull:test_barrier

Reviewed-by: Jeff Layton <jlayton@redhat.com>
5 years agoMerge pull request #33576 from lxbsz/fuse
Gregory Farnum [Wed, 22 Apr 2020 05:12:37 +0000 (22:12 -0700)]
Merge pull request #33576 from lxbsz/fuse

unshare-ns-mount: add isolating netns for mount helper support

Reviewed-by: Jeff Layton <jlayton@redhat.com>
5 years agoMerge pull request #34121 from ADI10HERO/flake8_fix1
Gregory Farnum [Wed, 22 Apr 2020 05:10:59 +0000 (22:10 -0700)]
Merge pull request #34121 from ADI10HERO/flake8_fix1

cephfs-shell: Fix flake8 errors (F841, E302, E502, E128, E305 and E222)

Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Varsha Rao <varao@redhat.com>
5 years agoMerge pull request #34531 from lxbsz/libfuse3
Gregory Farnum [Wed, 22 Apr 2020 05:08:15 +0000 (22:08 -0700)]
Merge pull request #34531 from lxbsz/libfuse3

ceph-fuse: link to libfuse3 and pass `-o big_writes` to libfuse if libfuse < 3.0.0

Reviewed-by: "Yan, Zheng" <zyan@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #34274 from ukernel/wip-44801
Gregory Farnum [Wed, 22 Apr 2020 05:07:06 +0000 (22:07 -0700)]
Merge pull request #34274 from ukernel/wip-44801

client: reset requested_max_size if file write is not wanted

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
5 years agocls/2pc_queue: remove the dependency of cls_2pc_queue with cls_queue 34669/head
Yuval Lifshitz [Tue, 21 Apr 2020 16:15:42 +0000 (19:15 +0300)]
cls/2pc_queue: remove the dependency of cls_2pc_queue with cls_queue

both queues share the same code base, however, cls_2pc_queue should work
even if cls_queue objectclass is not loaded into the osd

Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>
5 years agomgr/dashboard: fix tasks.mgr.dashboard.test_rgw.RgwBucketTest.test_all 34666/head
Alfonso Martínez [Tue, 21 Apr 2020 13:27:06 +0000 (15:27 +0200)]
mgr/dashboard: fix tasks.mgr.dashboard.test_rgw.RgwBucketTest.test_all

Increased the time for getting 2nd TOTP.

Fixes: https://tracker.ceph.com/issues/44405
Signed-off-by: Alfonso Martínez <almartin@redhat.com>
5 years agoMerge pull request #34612 from zdover23/wip-doc-tshooting-ssh-errors-44905
Sebastian Wagner [Tue, 21 Apr 2020 13:22:15 +0000 (15:22 +0200)]
Merge pull request #34612 from zdover23/wip-doc-tshooting-ssh-errors-44905

doc/cephadm: Add troubleshooting guidance for ssh connection failures. [cephadm]

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
5 years agoMerge pull request #34661 from wjwithagen/wjw-fix-rgw_bucket_sync_cache.h
Casey Bodley [Tue, 21 Apr 2020 12:21:43 +0000 (08:21 -0400)]
Merge pull request #34661 from wjwithagen/wjw-fix-rgw_bucket_sync_cache.h

rgw: remove noexcept from function definition

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #34614 from theanalyst/rgw/reshard-num-check
Casey Bodley [Tue, 21 Apr 2020 11:59:55 +0000 (07:59 -0400)]
Merge pull request #34614 from theanalyst/rgw/reshard-num-check

rgw: reshard: skip stale bucket id entries from reshard queue

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agorgw: remove noexcept from function definition 34661/head
Willem Jan Withagen [Tue, 21 Apr 2020 11:13:32 +0000 (11:13 +0000)]
rgw: remove noexcept from function definition

Clang complains:
src/rgw/rgw_bucket_sync_cache.h:88:3: error: exception specification of explicitly defaulted copy co
nstructor does not match the calculated one
  Handle(const Handle&) noexcept = default;
  ^
1 error generated.

And a reference that I found for this:
    https://github.com/mapnik/mapnik/issues/3274
Suggesting that the noexcept is inherited from the first definition.

Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
5 years agorgw/doc: clarify topic creation format 34664/head
Yuval Lifshitz [Tue, 21 Apr 2020 11:08:28 +0000 (14:08 +0300)]
rgw/doc: clarify topic creation format

also, fix some typos, and 'push-endpoint' parameter

Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>
5 years agoqa/cephfs: add test case for fragmenting stray dirs 33479/head
Yan, Zheng [Mon, 20 Apr 2020 11:16:47 +0000 (19:16 +0800)]
qa/cephfs: add test case for fragmenting stray dirs

Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
5 years agoMerge pull request #34605 from tchaikov/wip-45113
Kefu Chai [Tue, 21 Apr 2020 01:23:39 +0000 (09:23 +0800)]
Merge pull request #34605 from tchaikov/wip-45113

qa/suites/*/rados_cls_all.yaml: load all classes

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agomds: automatically fragment stray dirs
Simon Gao [Sat, 22 Feb 2020 02:26:57 +0000 (10:26 +0800)]
mds: automatically fragment stray dirs

Signed-off-by: Simon Gao <simon29rock@gmail.com>
5 years agoMerge pull request #34655 from ceph/wip-yuriw-remove-wip-master
Josh Durgin [Mon, 20 Apr 2020 23:37:32 +0000 (16:37 -0700)]
Merge pull request #34655 from ceph/wip-yuriw-remove-wip-master

qa/tests: removed tests 'client-upgrade-octopus-pacific'

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
5 years agoqa/tests: removed tests 'client-upgrade-octopus-pacific' 34655/head
Yuri Weinstein [Mon, 20 Apr 2020 22:59:19 +0000 (15:59 -0700)]
qa/tests: removed tests 'client-upgrade-octopus-pacific'

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
5 years agoMerge pull request #34651 from ceph/wip-yuriw-crontab-master
Josh Durgin [Mon, 20 Apr 2020 22:32:11 +0000 (15:32 -0700)]
Merge pull request #34651 from ceph/wip-yuriw-crontab-master

qa/tests: fixed typo

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
5 years agoqa/tests: fixed typo 34651/head
Yuri Weinstein [Mon, 20 Apr 2020 20:57:10 +0000 (13:57 -0700)]
qa/tests: fixed typo

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
5 years agoMerge pull request #34649 from ceph/wip-yuriw-crontab-master
Yuri Weinstein [Mon, 20 Apr 2020 20:45:41 +0000 (13:45 -0700)]
Merge pull request #34649 from ceph/wip-yuriw-crontab-master

qa/tests: added new clients upgrade tests `client-upgrade-octopus-pacific`

5 years agoqa/tests: added new clients upgrade tests 34649/head
Yuri Weinstein [Mon, 20 Apr 2020 19:41:34 +0000 (12:41 -0700)]
qa/tests: added new clients upgrade tests

`client-upgrade-octopus-pacific` for future 'pacific' release

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
5 years agoMerge pull request #34642 from ceph/wip-yuriw-octopus-client-upgrade-octopus-pacific
Yuri Weinstein [Mon, 20 Apr 2020 19:35:32 +0000 (12:35 -0700)]
Merge pull request #34642 from ceph/wip-yuriw-octopus-client-upgrade-octopus-pacific

qa/tests: initial checkin for clients upgrades tests for future relea…

5 years agorgw: use target bucket layout for reshard 34645/head
Casey Bodley [Mon, 20 Apr 2020 19:23:14 +0000 (15:23 -0400)]
rgw: use target bucket layout for reshard

Signed-off-by: Casey Bodley <cbodley@redhat.com>
5 years agoqa/tests: initial checkin for clients upgrades tests for future release of pacific 34642/head
Yuri Weinstein [Mon, 20 Apr 2020 17:45:44 +0000 (10:45 -0700)]
qa/tests: initial checkin for clients upgrades tests for future release of pacific

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
5 years agoMerge pull request #34608 from trociny/wip-journal-append-stripe-width 34647/head
Jason Dillaman [Mon, 20 Apr 2020 17:27:35 +0000 (13:27 -0400)]
Merge pull request #34608 from trociny/wip-journal-append-stripe-width

cls/journal: use EC pool stripe width for padding appends

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
5 years agoqa/rgw: allow 'ceph' user to read vault token 34613/head
Casey Bodley [Mon, 20 Apr 2020 14:50:00 +0000 (10:50 -0400)]
qa/rgw: allow 'ceph' user to read vault token

Signed-off-by: Casey Bodley <cbodley@redhat.com>
5 years agomgr/orch: upgrade: better input validation 34568/head
Sebastian Wagner [Wed, 15 Apr 2020 13:23:05 +0000 (15:23 +0200)]
mgr/orch: upgrade: better input validation

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
5 years agoMerge pull request #34636 from tchaikov/wip-vstart-runner-py3
Kefu Chai [Mon, 20 Apr 2020 13:23:43 +0000 (21:23 +0800)]
Merge pull request #34636 from tchaikov/wip-vstart-runner-py3

qa/tasks/vstart_runner,doc: be compatible with python3

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Xiubo Li <xiubli@redhat.com>
5 years agocephadm: fix adopt prometheus command 34600/head
Dimitri Savineau [Thu, 16 Apr 2020 20:30:27 +0000 (16:30 -0400)]
cephadm: fix adopt prometheus command

Create the target directory before copy the prometheus configuration.

Closes: https://tracker.ceph.com/issues/45120
Signed-off-by: Dimitri Savineau <dsavinea@redhat.com>
5 years agoqa/tasks/cephfs/fuse_mount.py: by python3 compatible 34636/head
Kefu Chai [Mon, 20 Apr 2020 11:50:02 +0000 (19:50 +0800)]
qa/tasks/cephfs/fuse_mount.py: by python3 compatible

pass `StringIO()` to capture stdout whose value will be interpreted as a
string later on

Signed-off-by: Kefu Chai <kchai@redhat.com>
5 years agoAdd troubleshooting guidance for ssh connection failures. 34612/head
Zac Dover [Fri, 17 Apr 2020 04:12:37 +0000 (14:12 +1000)]
Add troubleshooting guidance for ssh connection failures.

For more thorough information about this commit, see:
https://tracker.ceph.com/issues/44905

Signed-off-by: Zac Dover <zac.dover@gmail.com>
Update doc/cephadm/troubleshooting.rst

Co-Authored-By: Michael Fritch <mfritch@suse.com>
ibid

Signed-off-by: Zac Dover <zac.dover@gmail.com>
Update doc/cephadm/troubleshooting.rst

Co-Authored-By: Sebastian Wagner <sebastian@spawnhost.de>
Update doc/cephadm/troubleshooting.rst

Co-Authored-By: Sebastian Wagner <sebastian@spawnhost.de>
Added mgfritch's suggestion regarding checking to see if the public key
is listed in the authorized_keys file.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
5 years agopybind/mgr/dashboard/run-backend-api-tests.sh: use python3 by default
Kefu Chai [Mon, 20 Apr 2020 11:13:52 +0000 (19:13 +0800)]
pybind/mgr/dashboard/run-backend-api-tests.sh: use python3 by default

since vstart_runner.py is now py3, let's use python3 by default

Signed-off-by: Kefu Chai <kchai@redhat.com>
5 years agoqa/tasks/vstart_runner.py: be python3 compatible
Kefu Chai [Mon, 20 Apr 2020 10:27:58 +0000 (18:27 +0800)]
qa/tasks/vstart_runner.py: be python3 compatible

differentiate `str` and `bytes` instances, and drop python2 support from
vstart_runner.py, as we've moved to python3 already

Signed-off-by: Kefu Chai <kchai@redhat.com>
5 years agoqa/suites/*/rados_cls_all.yaml: load all classes 34605/head
Kefu Chai [Fri, 17 Apr 2020 07:15:52 +0000 (15:15 +0800)]
qa/suites/*/rados_cls_all.yaml: load all classes

the intention to add the whitelist was to test "sdk" class, but if we
add new classes to the list, and add tests exercising them, the tests
fail if we fail to update these `rados_cls_all.yaml` accordingly.

so in this change, the list is now '*' which allows OSD to load all
classes found in the specified directory

Fixes: https://tracker.ceph.com/issues/45113
Signed-off-by: Kefu Chai <kchai@redhat.com>
5 years agodoc/dev/developer_guide: use python3 to launch vstart_runner.py
Kefu Chai [Mon, 20 Apr 2020 10:26:27 +0000 (18:26 +0800)]
doc/dev/developer_guide: use python3 to launch vstart_runner.py

as vstart_runner.py is compatible with python3, and so is the tests
under `qa/` directory.

and use `pip` to install teuthology, simpler this way.

Signed-off-by: Kefu Chai <kchai@redhat.com>
5 years agomds: make MDCache::scan_stray_dir() handle dir fragmentation
Yan, Zheng [Tue, 3 Mar 2020 07:37:59 +0000 (15:37 +0800)]
mds: make MDCache::scan_stray_dir() handle dir fragmentation

Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
5 years agomds: don't add null dentry to frozen stray dir
Yan, Zheng [Tue, 3 Mar 2020 03:52:29 +0000 (11:52 +0800)]
mds: don't add null dentry to frozen stray dir

Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
5 years agomds: auth pin stray dir when purging stray inode
Yan, Zheng [Tue, 3 Mar 2020 03:30:45 +0000 (11:30 +0800)]
mds: auth pin stray dir when purging stray inode

After stray inode gets added to purge queue, mds deletes stray dentry.
MDS needs to make sure stray dir is not being fragmented.

Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
5 years agoceph: allow 'dirfrag split' asok command to operate on stray dirs
Yan, Zheng [Tue, 3 Mar 2020 03:16:13 +0000 (11:16 +0800)]
ceph: allow 'dirfrag split' asok command to operate on stray dirs

Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
5 years agoMerge pull request #34432 from optimistyzy/47_upstream
Kefu Chai [Mon, 20 Apr 2020 06:51:33 +0000 (14:51 +0800)]
Merge pull request #34432 from optimistyzy/47_upstream

os/bluestore/NVMEDevice.cc: use slist for tracking mempool

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoNVMEDevice: Remove the performance counter 34432/head
Ziye Yang [Tue, 7 Apr 2020 21:09:56 +0000 (05:09 +0800)]
NVMEDevice: Remove the performance counter

Compared with other approach (KernelDevice, iouring), it does not
have such feature, so remove it to simplify the code and improve
the performance. Because, each thread will call the logger and calculate
the time, it is very time consuming. And the upper layer in bluestore has
the feature to track each I/O task.

And it is not readable if we add ifdef configure to enable this feature,
so in my mind that I suggest removing this latency track. And the
latency benefit demonstrated by SPDK is already approved, so we do not
need to tracking every I/O time when invoking SPDK driver.

Signed-off-by: Ziye Yang <ziye.yang@intel.com>
5 years agoNVMEDevice.cc: Remove the data_buf_mempool
Ziye Yang [Tue, 7 Apr 2020 15:23:46 +0000 (23:23 +0800)]
NVMEDevice.cc: Remove the data_buf_mempool

Use the linked list is enough.

Signed-off-by: Ziye Yang <ziye.yang@intel.com>
5 years agolibrbd: add aio_flush test case 34430/head
Yuan Lu [Thu, 5 Mar 2020 05:46:57 +0000 (13:46 +0800)]
librbd: add aio_flush test case

Signed-off-by: Peterson, Scott <scott.d.peterson@intel.com>
Signed-off-by: Li, Xiaoyan <xiaoyan.li@intel.com>
Signed-off-by: Lu, Yuan <yuan.y.lu@intel.com>
Signed-off-by: Chamarthy, Mahati <mahati.chamarthy@intel.com>
5 years agolibrbd: add aio_flush
Yuan Lu [Tue, 7 Apr 2020 05:09:35 +0000 (13:09 +0800)]
librbd: add aio_flush

Signed-off-by: Peterson, Scott <scott.d.peterson@intel.com>
Signed-off-by: Li, Xiaoyan <xiaoyan.li@intel.com>
Signed-off-by: Lu, Yuan <yuan.y.lu@intel.com>
Signed-off-by: Chamarthy, Mahati <mahati.chamarthy@intel.com>
5 years agoMerge pull request #34615 from dillaman/wip-45072
Mykola Golub [Sun, 19 Apr 2020 07:57:49 +0000 (10:57 +0300)]
Merge pull request #34615 from dillaman/wip-45072

rbd-mirror: image replayer stop might race with instance replayer shut down

Reviewed-by: Mykola Golub <mgolub@suse.com>
5 years agoceph-fuse: link to libfuse3 if fuse3 is installed 34531/head
Xiubo Li [Wed, 15 Apr 2020 06:21:44 +0000 (02:21 -0400)]
ceph-fuse: link to libfuse3 if fuse3 is installed

Fixes: https://tracker.ceph.com/issues/44891
Signed-off-by: Xiubo Li <xiubli@redhat.com>
5 years agorbd-fuse: remove FUSE_CAP_BIG_WRITES when linking to libfuse3
Xiubo Li [Fri, 17 Apr 2020 09:46:24 +0000 (05:46 -0400)]
rbd-fuse: remove FUSE_CAP_BIG_WRITES when linking to libfuse3

The big-writes is enabled as default from 3.0.

Fixes: https://tracker.ceph.com/issues/44891
Signed-off-by: Xiubo Li <xiubli@redhat.com>
5 years agorbd-fuse: switch to use utimens instead
Xiubo Li [Fri, 17 Apr 2020 09:33:55 +0000 (05:33 -0400)]
rbd-fuse: switch to use utimens instead

The utime is deprecated.

Fixes: https://tracker.ceph.com/issues/44891
Signed-off-by: Xiubo Li <xiubli@redhat.com>
5 years agoMerge pull request #34576 from jdurgin/wip-object-corpus
Kefu Chai [Sat, 18 Apr 2020 03:59:55 +0000 (11:59 +0800)]
Merge pull request #34576 from jdurgin/wip-object-corpus

ceph-object-corpus: update to octopus

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #34535 from changchengx/refine_build_liburing
Kefu Chai [Sat, 18 Apr 2020 03:39:32 +0000 (11:39 +0800)]
Merge pull request #34535 from changchengx/refine_build_liburing

cmake: refactor liburing support

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoceph-fuse: enable the big writes as default
Xiubo Li [Thu, 16 Apr 2020 10:13:17 +0000 (06:13 -0400)]
ceph-fuse: enable the big writes as default

When the libfuse version < 3, without the big_writes options enabled
the write perf is very poor.

Fixes: https://tracker.ceph.com/issues/44885
Signed-off-by: Xiubo Li <xiubli@redhat.com>
5 years agocstart.sh: work with docker or podman 34328/head
Sage Weil [Fri, 17 Apr 2020 22:05:26 +0000 (18:05 -0400)]
cstart.sh: work with docker or podman

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agosrc/script/cpatch: complete globs in correct paths
Josh Durgin [Sat, 4 Apr 2020 00:33:49 +0000 (20:33 -0400)]
src/script/cpatch: complete globs in correct paths

Otherwise none of these libs are copied

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
5 years agosrc/script/cpatch: include cython libs and cephadm
Josh Durgin [Sat, 4 Apr 2020 00:32:32 +0000 (20:32 -0400)]
src/script/cpatch: include cython libs and cephadm

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
5 years agosrc/cstart.sh: initial version
Sage Weil [Tue, 31 Mar 2020 22:47:21 +0000 (18:47 -0400)]
src/cstart.sh: initial version

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoscript/cpatch: initial version
Sage Weil [Tue, 31 Mar 2020 16:25:45 +0000 (12:25 -0400)]
script/cpatch: initial version

Based on kubejacker.

- copy + strip (tar compress is sloooow)
- avoid touching build artifacts
- by default, patch "everything"
- optionally do actual build as root
- lump rbd and cephfs into core because mgr needs to dynamically link
  them and c++ ABI is fragile.

Signed-off-by: Sage Weil <sage@redhat.com>
5 years agoqa/workunits/cephadm/test_cephadm.sh: extend timeout test 34620/head
Michael Fritch [Fri, 17 Apr 2020 20:35:30 +0000 (14:35 -0600)]
qa/workunits/cephadm/test_cephadm.sh: extend timeout test

test occasionally fails when the container is slow to start

Signed-off-by: Michael Fritch <mfritch@suse.com>