]> git.apps.os.sepia.ceph.com Git - ceph.git/log
ceph.git
5 years agoqa/tasks/ceph.conf: do not warn on TOO_FEW_OSDS 30841/head
Sage Weil [Fri, 10 May 2019 19:45:22 +0000 (14:45 -0500)]
qa/tasks/ceph.conf: do not warn on TOO_FEW_OSDS

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 0483c1c3e7ffdfa6a6f65c5ef000c45d2f096428)

5 years agoqa/tasks/ceph.py: move methods from teuthology.git into ceph.py directly; support...
Sage Weil [Fri, 7 Dec 2018 19:16:31 +0000 (13:16 -0600)]
qa/tasks/ceph.py: move methods from teuthology.git into ceph.py directly; support mon bind * options

Having these live in teuthology.git is silly, since they are only consumed
by the ceph task, and it is hard to revise the behavior.

Revise the behavior by adding mon_bind_* options.

Signed-off-by: Sage Weil <sage@redhat.com>
(cherry picked from commit 1ab352dd3105d320bd7ad2c0b37e5de750879dd5)

Conflicts:
    qa/tasks/ceph.py
- the nautilus version of "get_mons()" includes msgr V2 code which is not needed
  in mimic

5 years agoMerge pull request #29609 from jtlayton/wip-40162-mimic
Yuri Weinstein [Wed, 9 Oct 2019 19:12:11 +0000 (12:12 -0700)]
Merge pull request #29609 from jtlayton/wip-40162-mimic

mimic: cephfs: client: fix bad error handling in _lookup_parent

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Yan, Zheng <zyan@redhat.com>
5 years agoMerge pull request #29751 from pdvian/wip-41088-mimic
Yuri Weinstein [Wed, 9 Oct 2019 19:11:38 +0000 (12:11 -0700)]
Merge pull request #29751 from pdvian/wip-41088-mimic

mimic: qa: sleep briefly after resetting kclient

Reviewed-by: Venky Shankar <vshankar@redhat.com>
5 years agoMerge pull request #29812 from pdvian/wip-41094-mimic
Yuri Weinstein [Wed, 9 Oct 2019 19:11:01 +0000 (12:11 -0700)]
Merge pull request #29812 from pdvian/wip-41094-mimic

mimic: qa: ignore expected MDS_CLIENT_LATE_RELEASE warning

Reviewed-by: Venky Shankar <vshankar@redhat.com>
5 years agoMerge pull request #29833 from pdvian/wip-41097-mimic
Yuri Weinstein [Wed, 9 Oct 2019 19:10:40 +0000 (12:10 -0700)]
Merge pull request #29833 from pdvian/wip-41097-mimic

mimic: cephfs: avoid map been inserted by mistake

Reviewed-by: Venky Shankar <vshankar@redhat.com>
5 years agoMerge pull request #29915 from pdvian/wip-41100-mimic
Yuri Weinstein [Wed, 9 Oct 2019 19:10:18 +0000 (12:10 -0700)]
Merge pull request #29915 from pdvian/wip-41100-mimic

mimic: cephfs: fix a memory leak

Reviewed-by: Venky Shankar <vshankar@redhat.com>
5 years agoMerge pull request #29940 from pdvian/wip-41108-mimic
Yuri Weinstein [Wed, 9 Oct 2019 19:09:57 +0000 (12:09 -0700)]
Merge pull request #29940 from pdvian/wip-41108-mimic

mimic: mds: delay exporting directory whose pin value exceeds max rank id

Reviewed-by: Venky Shankar <vshankar@redhat.com>
5 years agoMerge pull request #30108 from smithfarm/wip-40442-mimic
Yuri Weinstein [Wed, 9 Oct 2019 19:09:32 +0000 (12:09 -0700)]
Merge pull request #30108 from smithfarm/wip-40442-mimic

mimic: cephfs: client: set snapdir's link count to 1

Reviewed-by: Venky Shankar <vshankar@redhat.com>
5 years agoMerge pull request #30228 from smithfarm/wip-40841-mimic
Yuri Weinstein [Wed, 9 Oct 2019 19:08:47 +0000 (12:08 -0700)]
Merge pull request #30228 from smithfarm/wip-40841-mimic

mimic: cephfs: client: support the fallocate() when fuse version >= 2.9

Reviewed-by: Venky Shankar <vshankar@redhat.com>
5 years agoMerge pull request #30678 from sobelek/wip-42048-mimic
Jan Fajerski [Wed, 9 Oct 2019 11:13:56 +0000 (13:13 +0200)]
Merge pull request #30678 from sobelek/wip-42048-mimic

mimic: ceph-volume: fix warnings raised by pytest

5 years agoMerge pull request #30135 from smithfarm/wip-41126-mimic
Yuri Weinstein [Tue, 8 Oct 2019 20:09:49 +0000 (13:09 -0700)]
Merge pull request #30135 from smithfarm/wip-41126-mimic

mimic: rgw: swift: refrain from corrupting static large objects when using nginx as a GET cache

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #30134 from smithfarm/wip-41103-mimic
Yuri Weinstein [Tue, 8 Oct 2019 20:05:57 +0000 (13:05 -0700)]
Merge pull request #30134 from smithfarm/wip-41103-mimic

mimic: rgw: mitigate bucket list with max-entries excessively high

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
5 years agoMerge pull request #30140 from smithfarm/wip-41131-mimic
Yuri Weinstein [Tue, 8 Oct 2019 20:04:54 +0000 (13:04 -0700)]
Merge pull request #30140 from smithfarm/wip-41131-mimic

mimic: rgw: Fix bucket versioning vs. swift metadata bug.

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #30141 from smithfarm/wip-41625-mimic
Yuri Weinstein [Tue, 8 Oct 2019 20:04:29 +0000 (13:04 -0700)]
Merge pull request #30141 from smithfarm/wip-41625-mimic

mimic: rgw/rgw_op: Remove get_val from hotpath via legacy options

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
5 years agoMerge pull request #30154 from smithfarm/wip-41265-mimic
Yuri Weinstein [Tue, 8 Oct 2019 20:03:59 +0000 (13:03 -0700)]
Merge pull request #30154 from smithfarm/wip-41265-mimic

mimic: rgw: don't throw when accept errors are happening on frontend

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #30156 from smithfarm/wip-41270-mimic
Yuri Weinstein [Tue, 8 Oct 2019 20:03:32 +0000 (13:03 -0700)]
Merge pull request #30156 from smithfarm/wip-41270-mimic

mimic: rgw: Fix rgw decompression log-print

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #30157 from smithfarm/wip-41342-mimic
Yuri Weinstein [Tue, 8 Oct 2019 20:03:06 +0000 (13:03 -0700)]
Merge pull request #30157 from smithfarm/wip-41342-mimic

mimic: rgw_file: readdir: do not construct markers w/leading '/'

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
5 years agoMerge pull request #30159 from pdvian/wip-41628-mimic
Yuri Weinstein [Tue, 8 Oct 2019 20:02:38 +0000 (13:02 -0700)]
Merge pull request #30159 from pdvian/wip-41628-mimic

mimic: rgw: RGWCoroutine::call(nullptr) sets retcode=0

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #30165 from smithfarm/wip-41381-mimic
Yuri Weinstein [Tue, 8 Oct 2019 20:01:56 +0000 (13:01 -0700)]
Merge pull request #30165 from smithfarm/wip-41381-mimic

mimic: rgw: housekeeping of reset stats operation in radosgw-admin and cls back-end

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
5 years agoMerge pull request #30166 from smithfarm/wip-41478-mimic
Yuri Weinstein [Tue, 8 Oct 2019 20:01:22 +0000 (13:01 -0700)]
Merge pull request #30166 from smithfarm/wip-41478-mimic

mimic: rgw: make dns hostnames matching case insensitive

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #30167 from smithfarm/wip-41483-mimic
Yuri Weinstein [Tue, 8 Oct 2019 20:00:53 +0000 (13:00 -0700)]
Merge pull request #30167 from smithfarm/wip-41483-mimic

mimic: rgw: fix potential realm watch lost

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #30168 from smithfarm/wip-41484-mimic
Yuri Weinstein [Tue, 8 Oct 2019 19:59:11 +0000 (12:59 -0700)]
Merge pull request #30168 from smithfarm/wip-41484-mimic

mimic: rgw: fix list bucket with delimiter wrongly skip some special keys

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #30510 from pdvian/wip-41897-mimic
Yuri Weinstein [Tue, 8 Oct 2019 19:58:50 +0000 (12:58 -0700)]
Merge pull request #30510 from pdvian/wip-41897-mimic

mimic: rgw: fix data sync start delay if remote haven't init data_log

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #30170 from smithfarm/wip-41494-mimic
Yuri Weinstein [Tue, 8 Oct 2019 19:56:14 +0000 (12:56 -0700)]
Merge pull request #30170 from smithfarm/wip-41494-mimic

mimic: radosgw-admin: bucket sync status not 'caught up' during full sync

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #30171 from smithfarm/wip-41578-mimic
Yuri Weinstein [Tue, 8 Oct 2019 19:55:51 +0000 (12:55 -0700)]
Merge pull request #30171 from smithfarm/wip-41578-mimic

mimic: rgw: fix CreateBucket with BucketLocation parameter failed under default zonegroup

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #30172 from smithfarm/wip-41632-mimic
Yuri Weinstein [Tue, 8 Oct 2019 19:55:29 +0000 (12:55 -0700)]
Merge pull request #30172 from smithfarm/wip-41632-mimic

mimic: rgw: fixed "unrecognized arg" error when using "radosgw-admin zone rm".

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #30173 from smithfarm/wip-41638-mimic
Yuri Weinstein [Tue, 8 Oct 2019 19:55:07 +0000 (12:55 -0700)]
Merge pull request #30173 from smithfarm/wip-41638-mimic

mimic: rgw: gc remove tag after all sub io finish

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #30253 from smithfarm/wip-41708-mimic
Yuri Weinstein [Tue, 8 Oct 2019 19:54:41 +0000 (12:54 -0700)]
Merge pull request #30253 from smithfarm/wip-41708-mimic

mimic: rgw: fix cls_bucket_list_unordered() partial results

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
5 years agoMerge pull request #30340 from smithfarm/wip-39014-mimic
Yuri Weinstein [Tue, 8 Oct 2019 19:53:54 +0000 (12:53 -0700)]
Merge pull request #30340 from smithfarm/wip-39014-mimic

mimic: rgw admin: disable stale instance delete in a multiste env

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #30450 from smithfarm/wip-41847-mimic
Yuri Weinstein [Tue, 8 Oct 2019 19:53:32 +0000 (12:53 -0700)]
Merge pull request #30450 from smithfarm/wip-41847-mimic

mimic: rgw: increase beast parse buffer size to 64k

Reviewed-by: Casey Bodley <cbodley@redhat.com>
5 years agoMerge pull request #30652 from pdvian/wip-41971-mimic
Yuri Weinstein [Tue, 8 Oct 2019 19:52:53 +0000 (12:52 -0700)]
Merge pull request #30652 from pdvian/wip-41971-mimic

mimic: rgw: ldap auth: S3 auth failure should return InvalidAccessKeyId

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
5 years agoMerge pull request #30660 from smithfarm/wip-40626-mimic
Yuri Weinstein [Tue, 8 Oct 2019 19:52:04 +0000 (12:52 -0700)]
Merge pull request #30660 from smithfarm/wip-40626-mimic

mimic: rgw_file: advance_mtime() should consider namespace expiration

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
5 years agoMerge pull request #28125 from dillaman/wip-39429-mimic
Yuri Weinstein [Tue, 8 Oct 2019 15:23:24 +0000 (08:23 -0700)]
Merge pull request #28125 from dillaman/wip-39429-mimic

mimic: rbd: librbd: async open/close should free ImageCtx before issuing callback

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
5 years agoMerge pull request #29294 from dillaman/wip-40234-mimic
Yuri Weinstein [Tue, 8 Oct 2019 15:22:54 +0000 (08:22 -0700)]
Merge pull request #29294 from dillaman/wip-40234-mimic

mimic: rbd/action: fix error getting positional argument

5 years agoMerge pull request #29565 from pdvian/wip-40881-mimic
Yuri Weinstein [Tue, 8 Oct 2019 15:22:20 +0000 (08:22 -0700)]
Merge pull request #29565 from pdvian/wip-40881-mimic

mimic: rbd: Reduce log level for cls/journal and cls/rbd expected errors

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
5 years agoMerge pull request #29872 from trociny/wip-41284-mimic
Yuri Weinstein [Tue, 8 Oct 2019 15:21:55 +0000 (08:21 -0700)]
Merge pull request #29872 from trociny/wip-41284-mimic

mimic: rbd-mirror: don't overwrite status error returned by replay

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
5 years agoMerge pull request #29873 from trociny/wip-41423-mimic
Yuri Weinstein [Tue, 8 Oct 2019 15:21:08 +0000 (08:21 -0700)]
Merge pull request #29873 from trociny/wip-41423-mimic

mimic: qa/workunits/rbd: stress test `rbd mirror pool status --verbose`

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
5 years agoMerge pull request #30117 from smithfarm/wip-41438-mimic
Yuri Weinstein [Tue, 8 Oct 2019 15:20:36 +0000 (08:20 -0700)]
Merge pull request #30117 from smithfarm/wip-41438-mimic

mimic: rbd-mirror: ignore errors relating to parsing the cluster config file

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
5 years agoMerge pull request #30121 from pdvian/wip-41622-mimic
Yuri Weinstein [Tue, 8 Oct 2019 15:20:04 +0000 (08:20 -0700)]
Merge pull request #30121 from pdvian/wip-41622-mimic

mimic: tools/rbd-ggate: close log before running postfork

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
5 years agoMerge pull request #30176 from smithfarm/wip-39316-mimic
Yuri Weinstein [Tue, 8 Oct 2019 15:19:37 +0000 (08:19 -0700)]
Merge pull request #30176 from smithfarm/wip-39316-mimic

mimic: krbd: fix rbd map hang due to udev return subsystem unordered

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
5 years agoMerge pull request #30177 from smithfarm/wip-40380-mimic
Yuri Weinstein [Tue, 8 Oct 2019 15:18:53 +0000 (08:18 -0700)]
Merge pull request #30177 from smithfarm/wip-40380-mimic

mimic: rbd: librbd: avoid dereferencing an empty container during deep-copy

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
5 years agoMerge pull request #30178 from smithfarm/wip-40500-mimic
Yuri Weinstein [Tue, 8 Oct 2019 15:18:11 +0000 (08:18 -0700)]
Merge pull request #30178 from smithfarm/wip-40500-mimic

mimic: rbd: use the ordered throttle for the export action

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
5 years agoMerge pull request #30424 from smithfarm/wip-41543-mimic
Yuri Weinstein [Tue, 8 Oct 2019 15:16:57 +0000 (08:16 -0700)]
Merge pull request #30424 from smithfarm/wip-41543-mimic

mimic: test/librbd: set nbd timeout due to newer kernels defaulting it on

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
5 years agoMerge pull request #30569 from pdvian/wip-41955-mimic
Yuri Weinstein [Tue, 8 Oct 2019 15:16:18 +0000 (08:16 -0700)]
Merge pull request #30569 from pdvian/wip-41955-mimic

mimic: rbd/tests: avoid hexdump skip and length options in krbd test

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
5 years agoMerge pull request #30718 from smithfarm/wip-epel-release-snafu-mimic 30786/head
Yuri Weinstein [Mon, 7 Oct 2019 19:46:22 +0000 (12:46 -0700)]
Merge pull request #30718 from smithfarm/wip-epel-release-snafu-mimic

mimic: build/ops: backport miscellaneous install-deps.sh and ceph.spec.in fixes from master

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Yuri Weinstein <yweinste@redhat.com>
5 years agoMerge pull request #29241 from smithfarm/wip-38206-mimic
Yuri Weinstein [Mon, 7 Oct 2019 19:31:15 +0000 (12:31 -0700)]
Merge pull request #29241 from smithfarm/wip-38206-mimic

mimic: core: osds allows to partially start more than N+2

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
5 years agoMerge PR #29225 into mimic
Patrick Donnelly [Mon, 7 Oct 2019 19:30:10 +0000 (12:30 -0700)]
Merge PR #29225 into mimic

* refs/pull/29225/head:
common/secret.c: fix key parsing when doing a remount

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
5 years agorbd: use the ordered throttle for the export action 30178/head
Jason Dillaman [Wed, 19 Jun 2019 15:09:54 +0000 (11:09 -0400)]
rbd: use the ordered throttle for the export action

This allows exports to STDOUT to use multiple concurrent operations
and also fixes a potential race condition with concurrent callbacks
and file seeking.

Fixes: http://tracker.ceph.com/issues/40435
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
(cherry picked from commit 751bf6957020ad02b3a29b005b9792b9c6547f96)

Conflicts:
src/tools/rbd/action/Export.cc
- mimic has g_conf->get_val and int64_t "rbd_concurrent_management_ops"

5 years agoMerge pull request #30291 from tchaikov/wip-mimic-41447
Yuri Weinstein [Mon, 7 Oct 2019 19:26:08 +0000 (12:26 -0700)]
Merge pull request #30291 from tchaikov/wip-mimic-41447

mimic: osd/PrimaryLogPG: Avoid accessing destroyed references in finish_degr…

Reviewed-by: David Zafman <dzafman@redhat.com>
5 years agoMerge pull request #30447 from tchaikov/wip-mimic-37866
Yuri Weinstein [Mon, 7 Oct 2019 19:25:38 +0000 (12:25 -0700)]
Merge pull request #30447 from tchaikov/wip-mimic-37866

mimic: mgr/localpool: pg_num is an int arg to 'osd pool create'

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #30481 from pdvian/wip-41863-mimic
Yuri Weinstein [Mon, 7 Oct 2019 19:25:03 +0000 (12:25 -0700)]
Merge pull request #30481 from pdvian/wip-41863-mimic

mimic: mon: ensure prepare_failure() marks no_reply on op

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #30485 from sobelek/wip-41922-mimic
Yuri Weinstein [Mon, 7 Oct 2019 19:24:03 +0000 (12:24 -0700)]
Merge pull request #30485 from sobelek/wip-41922-mimic

mimic: mon: show pool id in pool ls command

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #30543 from smithfarm/wip-39317-mimic
Yuri Weinstein [Mon, 7 Oct 2019 19:22:14 +0000 (12:22 -0700)]
Merge pull request #30543 from smithfarm/wip-39317-mimic

mimic: mgr/dashboard: RGW proxy can't handle self-signed SSL certificates

Reviewed-by: Volker Theile <vtheile@suse.com>
5 years agoMerge pull request #30275 from pdvian/wip-41704-mimic
Yuri Weinstein [Mon, 7 Oct 2019 19:21:29 +0000 (12:21 -0700)]
Merge pull request #30275 from pdvian/wip-41704-mimic

 mimic: osd/PrimaryLogPG: update oi.size on write op implicitly truncating ob…

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
5 years agoceph.spec.in: fix Cython package dependency for Fedora 30718/head
Jeff Layton [Thu, 26 Sep 2019 11:50:28 +0000 (07:50 -0400)]
ceph.spec.in: fix Cython package dependency for Fedora

Fedora distros do not have python3?-Cython packages, but they do have
python3-Cython ones. Fix the BuildRequires so that we only use the
python3_version_nodots based version string for RHEL.

Fixes: https://tracker.ceph.com/issues/42032
Signed-off-by: Jeff Layton <jlayton@redhat.com>
(cherry picked from commit 40c5a18f81c67c96f6a35e592ac3141b87c19701)

5 years agoceph.spec.in: s/pkgversion/version_nodots/
Kefu Chai [Fri, 30 Aug 2019 11:49:28 +0000 (19:49 +0800)]
ceph.spec.in: s/pkgversion/version_nodots/

`python3_pkgversion` is now defined as 3, while we don't have packages
like python3-Cython yet in EPEL7. but we do have `python36-Cython`. so
let's use `python3_version_nodots` instead.

Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit 6d2f66846d1b84595cfdf8ac13a7ed4e1ae608ce)

5 years agorpm: make Python build deps somewhat less confusing
Nathan Cutler [Tue, 15 Jan 2019 14:34:42 +0000 (15:34 +0100)]
rpm: make Python build deps somewhat less confusing

Signed-off-by: Nathan Cutler <ncutler@suse.com>
(cherry picked from commit 0b79741a770acb5cee6de2dd88022cd2c5d15ef5)

Conflicts:
ceph.spec.in

5 years agorpm: Install python2-Cython in python2 environment
Brad Hubbard [Mon, 4 Mar 2019 02:38:25 +0000 (12:38 +1000)]
rpm: Install python2-Cython in python2 environment

do_cmake.sh tests for Cython module version in python2

Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
(cherry picked from commit 6de7111e735683f2c73d4c013d9611fc02b68985)

Conflicts:
ceph.spec.in

5 years agoinstall-deps: do not install if rpm already installed
Kefu Chai [Fri, 27 Sep 2019 02:26:54 +0000 (10:26 +0800)]
install-deps: do not install if rpm already installed

there is chance that the system already have epel-release-latest-7.noarch.rpm
installed, in that case, install-deps.sh should not fail.

Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit 45a4173bcfe15a9bf56f6aeb6e6c35386a00d1c5)

5 years agoinstall-deps.sh: add EPEL repo for non-x86_64 archs as well
Nathan Cutler [Tue, 24 Sep 2019 19:48:27 +0000 (21:48 +0200)]
install-deps.sh: add EPEL repo for non-x86_64 archs as well

Fixes: https://tracker.ceph.com/issues/42023
Signed-off-by: Kefu Chai <kchai@redhat.com>
Signed-off-by: Nathan Cutler <ncutler@suse.com>
(cherry picked from commit 49d740118f9a0ee6b6bb82954630c654946f1751)

5 years agoinstall-deps.sh: extract munge_debian_control()
Kefu Chai [Wed, 13 Feb 2019 11:56:00 +0000 (19:56 +0800)]
install-deps.sh: extract munge_debian_control()

this function will uncomment necessary dependencies on demand.

Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit 4fd179654e3c37c837899372859959283479cee6)

Conflicts:
install-deps.sh

5 years agoinstall-deps.sh: use latest setuptools
Kefu Chai [Sat, 26 Jan 2019 17:20:53 +0000 (01:20 +0800)]
install-deps.sh: use latest setuptools

this change reverts "install-deps.sh: workaround setuptools' dependency on six"

This reverts commit 30ce5e55460e333e1240704112a16fae68b3325f.

tl;dr: this change addresses the failures of "make check" runs on arm64
builders when they try to build `mgr-dashboard-test-venv` target.

long story: without this change, we will fail to pull in
setuptools >= 36, and as a result pip will fail to import
`setuptools.build_meta` in `pip/_vendor/pep517/_in_process.py`. and will
a `BackendUnavailable` exception thrown by `_call_hook()` in
`pip/_vendor/pep517/wrappers.py`. since the issue addressed by 30ce5e55
has been addressed since setuptools >= 36.0.1, we should be safe to
upgrade to the latest setuptools now.

Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit 8b55b47cc75e43ef683cd230f792cd92f1c46fa7)

5 years agoinstall-deps.sh: skip unavailable repos
Kefu Chai [Wed, 19 Dec 2018 08:37:55 +0000 (16:37 +0800)]
install-deps.sh: skip unavailable repos

as centos-sclo-rh-source leads us to 404 at this moment. and we are not
using the source repo for building ceph. so we can just skip any
unavailable repo.

Fixes: http://tracker.ceph.com/issues/37707
Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
(cherry picked from commit aa2b9e9a643441d9a2891e17920677a7725754c4)

5 years agoinstall-deps.sh: correct gcc version info as major.minor.patch
Changcheng Liu [Fri, 26 Oct 2018 06:32:09 +0000 (14:32 +0800)]
install-deps.sh: correct gcc version info as major.minor.patch

On ubuntu 18.04, "gcc -dumpversion" output "7", it result in
that below check will return false:
    dpkg --compare-versions 7 ge 7.0
Then, this script will install other gcc.

Actully, the full gcc version "gcc -dumpfullversion" output is
"7.3.0", than below check will turn true:
    dpkg --compare-version 7.3.0 ge 7.0
So, there's no need to install other gcc.

In case of hitting error on ubuntu16.04, use below parameter:
   gcc -dumpfullversion -dumpversion

Signed-off-by: Changcheng Liu <changcheng.liu@intel.com>
(cherry picked from commit ab7344e61755b357c558aef3630e1479d5dcc7b3)

5 years agoinstall-deps: install setuptools before upgrading virtualenv
Kefu Chai [Sat, 10 Nov 2018 21:33:43 +0000 (13:33 -0800)]
install-deps: install setuptools before upgrading virtualenv

this should address the failures when running install-deps.sh, like

Downloading/unpacking virtualenv
  Running setup.py egg_info for package virtualenv
    /usr/lib64/python2.7/distutils/dist.py:267: UserWarning: Unknown
distribution option: 'python_requires'
      warnings.warn(msg)
    error in virtualenv setup command: 'extras_require' must be a
dictionary whose values are strings or lists of strings containing valid
project/version requirement specifiers.
    Complete output from command python setup.py egg_info:
    /usr/lib64/python2.7/distutils/dist.py:267: UserWarning: Unknown
distribution option: 'python_requires'

  warnings.warn(msg)

error in virtualenv setup command: 'extras_require' must be a dictionary
whose values are strings or lists of strings containing valid
project/version requirement specifiers.

this only happens on very old virtualenv shipped with RHEL7.4

Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit 95386752ab2635f56e1d38b50de7144e2135b323)

5 years agoinstall-deps.sh: dashboard frontend needs git
Sebastian Wagner [Wed, 10 Oct 2018 12:21:04 +0000 (14:21 +0200)]
install-deps.sh: dashboard frontend needs git

Running `npm install` for the dashboard pulls dependenies with git.
Under some setups, git was not installed when building the frontend.

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
(cherry picked from commit d8de543b7e8f815f46e6a967fb5df4620f1cfbc4)

5 years agoinstall-deps: do not specify unknown options
Kefu Chai [Fri, 28 Sep 2018 03:45:03 +0000 (11:45 +0800)]
install-deps: do not specify unknown options

per apt.conf(5), and
https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=550564,
"Acquire::Translation" is not documented and will be deprecated. it
would be better to use "Acquire::Languages" solely. and it's consistent
with https://github.com/ceph/ceph-build/pull/1137 .

Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit 3911a7c7d068fde7c1ea7b1a2af0063e1249d697)

5 years agobuild/ops: unify command substitution in install-deps.sh
Nathan Cutler [Wed, 1 Aug 2018 10:33:58 +0000 (12:33 +0200)]
build/ops: unify command substitution in install-deps.sh

The $() form is preferable to `` because folks (like me) might be using
` as a keyboard shortcut to GNU Screen, causing havoc to ensue whenever
copy-pasting the ` character.

Signed-off-by: Nathan Cutler <ncutler@suse.com>
(cherry picked from commit e0042dd617269934bf51efee5bab7e4485875576)

5 years agoinstall-deps.sh: import ubuntu-toolchain-r's key without keyserver
Kefu Chai [Tue, 10 Jul 2018 12:23:48 +0000 (20:23 +0800)]
install-deps.sh: import ubuntu-toolchain-r's key without keyserver

we are running into following error recently

gpg: requesting key BA9EF27F from hkp server keyserver.ubuntu.com
gpgkeys: key 1E9377A2BA9EF27F can't be retrieved
gpg: no valid OpenPGP data found.
gpg: Total number processed: 0
gpg: keyserver communications error: keyserver helper general error
gpg: keyserver communications error: unknown pubkey algorithm
gpg: keyserver receive failed: unknown pubkey algorithm

so use the local copy of the pubkey instead

Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit b94e3790c88d599821b71bc76b20755c9580c081)

5 years agoinstall-deps: check the exit status for the $builddepcmd
Yunchuan Wen [Sun, 24 Jun 2018 01:48:50 +0000 (09:48 +0800)]
install-deps: check the exit status for the $builddepcmd

in some case, the $builddepcmd will failed without any "error:" output.
so we should check the exit status to handle it.

Signed-off-by: Yunchuan Wen <yunchuan.wen@kylin-cloud.com>
(cherry picked from commit 46e33d15a4132772a6bd11cd49f4181081bcdd55)

5 years agoinstall-deps: fix installing gcc on ubuntu when no old compiler
Tomasz Setkowski [Sat, 14 Apr 2018 15:23:58 +0000 (15:23 +0000)]
install-deps: fix installing gcc on ubuntu when no old compiler

Signed-off-by: Tomasz Setkowski <tom@ai-traders.com>
(cherry picked from commit 0d8d0cf6f7594f4f97677a2069998331998bdfa9)

5 years agoinstall-deps.sh: support install gcc7 in xenial aarch64
Yunchuan Wen [Thu, 7 Jun 2018 07:51:31 +0000 (15:51 +0800)]
install-deps.sh: support install gcc7 in xenial aarch64

Signed-off-by: Yunchuan Wen <yunchuan.wen@kylin-cloud.com>
(cherry picked from commit f92f256f4503d19f41b7c300a4df46b189e81a9b)

5 years agoinstall-deps: nuke wheelhouse if it's stale
Kefu Chai [Wed, 16 May 2018 11:41:52 +0000 (19:41 +0800)]
install-deps: nuke wheelhouse if it's stale

otherwise, if we update *requirements.txt, and the wheelhouse fails to
offer the newly added dependency, the setup-virtualenv.sh will fail the
build.

Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit ed0ca70707439f44779ca7093461182d73db1a77)

5 years agoinstall-deps.sh: Fixes for RHEL 7
Zack Cerza [Fri, 1 Feb 2019 00:36:17 +0000 (00:36 +0000)]
install-deps.sh: Fixes for RHEL 7

Signed-off-by: Zack Cerza <zack@redhat.com>
(cherry picked from commit a1a3e7960cf2c792ac8c9c71e68caa0ebada8933)

Conflicts:
install-deps.sh

5 years agoMerge pull request #29242 from smithfarm/wip-38277-mimic
Yuri Weinstein [Thu, 3 Oct 2019 23:45:27 +0000 (16:45 -0700)]
Merge pull request #29242 from smithfarm/wip-38277-mimic

mimic: core: mon,osd: limit MOSDMap messages by size as well as map count

Reviewed-by: David Zafman <dzafman@redhat.com>
5 years agoMerge pull request #29249 from smithfarm/wip-38852-mimic
Yuri Weinstein [Thu, 3 Oct 2019 23:39:33 +0000 (16:39 -0700)]
Merge pull request #29249 from smithfarm/wip-38852-mimic

mimic: core: .mgrstat failed to decode mgrstat state; luminous dev version?

Reviewed-by: David Zafman <dzafman@redhat.com>
5 years agoMerge pull request #29247 from smithfarm/wip-38437-mimic
Yuri Weinstein [Thu, 3 Oct 2019 23:37:50 +0000 (16:37 -0700)]
Merge pull request #29247 from smithfarm/wip-38437-mimic

mimic: core: crc cache should be invalidated when posting preallocated rx buffers

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
5 years agoMerge pull request #29593 from pdvian/wip-40884-mimic
Yuri Weinstein [Thu, 3 Oct 2019 23:37:05 +0000 (16:37 -0700)]
Merge pull request #29593 from pdvian/wip-40884-mimic

mimic: mon/MgrMonitor: fix null deref when invalid formatter is specified

5 years agoMerge pull request #29732 from pdvian/wip-40949-mimic
Yuri Weinstein [Thu, 3 Oct 2019 23:36:34 +0000 (16:36 -0700)]
Merge pull request #29732 from pdvian/wip-40949-mimic

mimic: Better default value for osd_snap_trim_sleep

5 years agoMerge pull request #29741 from smithfarm/wip-41287-mimic
Yuri Weinstein [Thu, 3 Oct 2019 23:35:57 +0000 (16:35 -0700)]
Merge pull request #29741 from smithfarm/wip-41287-mimic

mimic: core: ceph daemon mon.a config set mon_health_to_clog false cause leader mon assert

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #29976 from dzafman/wip-38450
Yuri Weinstein [Thu, 3 Oct 2019 23:35:17 +0000 (16:35 -0700)]
Merge pull request #29976 from dzafman/wip-38450

mimic: osd: make project_pg_history handle concurrent osdmap publish

Reviewed-by: Sage Weil <sage@redhat.com>
5 years agoMerge pull request #30081 from pdvian/wip-41595-mimic
Yuri Weinstein [Thu, 3 Oct 2019 23:34:50 +0000 (16:34 -0700)]
Merge pull request #30081 from pdvian/wip-41595-mimic

mimic: ceph-objectstore-tool can't remove head with bad snapset

Reviewed-by: David Zafman <dzafman@redhat.com>
5 years agoMerge pull request #30180 from smithfarm/wip-40083-mimic
Yuri Weinstein [Thu, 3 Oct 2019 23:34:18 +0000 (16:34 -0700)]
Merge pull request #30180 from smithfarm/wip-40083-mimic

mimic: osd: Better error message when OSD count is less than osd_pool_default_size

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #30181 from smithfarm/wip-40732-mimic
Yuri Weinstein [Thu, 3 Oct 2019 23:32:39 +0000 (16:32 -0700)]
Merge pull request #30181 from smithfarm/wip-40732-mimic

mimic: mon/AuthMonitor: fix initial creation of rotating keys

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #30182 from smithfarm/wip-41291-mimic
Yuri Weinstein [Thu, 3 Oct 2019 23:32:11 +0000 (16:32 -0700)]
Merge pull request #30182 from smithfarm/wip-41291-mimic

mimic: os/filestore: assure sufficient leaves in pre-split

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #30183 from smithfarm/wip-41351-mimic
Yuri Weinstein [Thu, 3 Oct 2019 23:31:35 +0000 (16:31 -0700)]
Merge pull request #30183 from smithfarm/wip-41351-mimic

mimic: cmake,run-make-check.sh: disable SPDK by default

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #30214 from smithfarm/wip-41490-mimic
Yuri Weinstein [Thu, 3 Oct 2019 23:31:10 +0000 (16:31 -0700)]
Merge pull request #30214 from smithfarm/wip-41490-mimic

mimic: osd/OSDCap: Check for empty namespace

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #30222 from smithfarm/wip-41502-mimic
Yuri Weinstein [Thu, 3 Oct 2019 23:30:38 +0000 (16:30 -0700)]
Merge pull request #30222 from smithfarm/wip-41502-mimic

mimic: osd/PeeringState: do not complain about past_intervals constrained by oldest epoch

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #30243 from smithfarm/wip-41442-mimic
Yuri Weinstein [Thu, 3 Oct 2019 23:30:06 +0000 (16:30 -0700)]
Merge pull request #30243 from smithfarm/wip-41442-mimic

mimic: core: osd: clear PG_STATE_CLEAN when repair object

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: David Zafman <dzafman@redhat.com>
5 years agoMerge pull request #30391 from pdvian/wip-41805-mimic
Yuri Weinstein [Thu, 3 Oct 2019 23:29:28 +0000 (16:29 -0700)]
Merge pull request #30391 from pdvian/wip-41805-mimic

mimic: mgr: do not reset reported if a new metric is not collected

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoMerge pull request #29253 from smithfarm/wip-40464-mimic
Yuri Weinstein [Thu, 3 Oct 2019 23:27:05 +0000 (16:27 -0700)]
Merge pull request #29253 from smithfarm/wip-40464-mimic

mimic: core: osd beacon sometimes has empty pg list

Reviewed-by: Neha Ojha <nojha@redhat.com>
5 years agoMerge pull request #29245 from smithfarm/wip-38351-mimic
Yuri Weinstein [Thu, 3 Oct 2019 23:25:52 +0000 (16:25 -0700)]
Merge pull request #29245 from smithfarm/wip-38351-mimic

mimic: tests: Limit loops waiting for force-backfill/force-recovery to happen

Reviewed-by: David Zafman <dzafman@redhat.com>
5 years agoMerge pull request #29250 from smithfarm/wip-38856-mimic
Yuri Weinstein [Thu, 3 Oct 2019 23:23:55 +0000 (16:23 -0700)]
Merge pull request #29250 from smithfarm/wip-38856-mimic

mimic: core: should set EPOLLET flag on del_event()

5 years agoMerge pull request #29251 from smithfarm/wip-40179-mimic
Yuri Weinstein [Thu, 3 Oct 2019 23:23:23 +0000 (16:23 -0700)]
Merge pull request #29251 from smithfarm/wip-40179-mimic

mimic: tests: qa/standalone/scrub/osd-scrub-snaps.sh sometimes fails

Reviewed-by: David Zafman <dzafman@redhat.com>
5 years agoMerge pull request #29765 from smithfarm/wip-40130-mimic
Nathan Cutler [Wed, 2 Oct 2019 13:13:13 +0000 (15:13 +0200)]
Merge pull request #29765 from smithfarm/wip-40130-mimic

mimic: doc: Document behaviour of fsync-after-close

Reviewed-by: Jeff Layton <jlayton@redhat.com>
5 years agoMerge pull request #30687 from smithfarm/wip-42104-mimic
Nathan Cutler [Wed, 2 Oct 2019 12:33:56 +0000 (14:33 +0200)]
Merge pull request #30687 from smithfarm/wip-42104-mimic

mimic: build/ops: admin/build-doc: use python3

Reviewed-by: Kefu Chai <kchai@redhat.com>
5 years agoadmin/build-doc: use python3 (follow-on fix) 30687/head
Nathan Cutler [Wed, 2 Oct 2019 10:05:47 +0000 (12:05 +0200)]
admin/build-doc: use python3 (follow-on fix)

Unfortunately, a5127318cf2feb12b5fd61aeed35b48bc31b4e34 (first attempt to
cherry-pick ace8cb15a600daf5261c0ab349b43010a238a1d9) was incomplete.

Signed-off-by: Nathan Cutler <ncutler@suse.com>
(partial manual cherry-pick of ace8cb15a600daf5261c0ab349b43010a238a1d9)

5 years agodoc: fix urls in posix.rst 29765/head
Jos Collin [Thu, 25 Jul 2019 04:33:12 +0000 (10:03 +0530)]
doc: fix urls in posix.rst

Signed-off-by: Jos Collin <jcollin@redhat.com>
(cherry picked from commit c5c5f031f77f778af73f8659b01695b88f158807)

5 years agodoc: cephfs: add section on fsync error reporting to posix.rst
Jeff Layton [Wed, 29 May 2019 18:35:11 +0000 (14:35 -0400)]
doc: cephfs: add section on fsync error reporting to posix.rst

Fixes: http://tracker.ceph.com/issues/24641
Signed-off-by: Jeff Layton <jlayton@redhat.com>
(cherry picked from commit b52d85c2a71950db222e3649d5265e5891368ba1)