ceph-build.git
3 hours agoMerge pull request #1834 from ceph/wip-c8-vagrant master
Guillaume Abrioux [Mon, 14 Jun 2021 18:28:14 +0000 (20:28 +0200)]
Merge pull request #1834 from ceph/wip-c8-vagrant

ansible: Update centos8-vagrant playbook to work for CentOS8.4

3 hours agoMerge pull request #1833 from ceph/wip-feature_branches-master
David Galloway [Mon, 14 Jun 2021 18:11:59 +0000 (14:11 -0400)]
Merge pull request #1833 from ceph/wip-feature_branches-master

pr-api: trigger on feature branches

4 hours agoansible: Update centos8-vagrant playbook to work for CentOS8.4 1834/head
David Galloway [Mon, 14 Jun 2021 17:44:24 +0000 (13:44 -0400)]
ansible: Update centos8-vagrant playbook to work for CentOS8.4

Signed-off-by: David Galloway <dgallowa@redhat.com>
3 days agopr-api: trigger on feature branches 1833/head
Ernesto Puerta [Fri, 11 Jun 2021 11:41:26 +0000 (13:41 +0200)]
pr-api: trigger on feature branches

While other Jenkins jobs don't filter by specific branches, the API
tests do, so we need to support 'feature-*' branch syntax.

Signed-off-by: Ernesto Puerta <epuertat@redhat.com>
9 days agoMerge pull request #1831 from tchaikov/wip-build-deb-mem
Kefu Chai [Sat, 5 Jun 2021 00:52:51 +0000 (08:52 +0800)]
Merge pull request #1831 from tchaikov/wip-build-deb-mem

scripts/build_utils: increase mem per job to 3000 MiB

9 days agoMerge pull request #1832 from tchaikov/wip-no-master-on-bionic
Kefu Chai [Sat, 5 Jun 2021 00:22:09 +0000 (08:22 +0800)]
Merge pull request #1832 from tchaikov/wip-no-master-on-bionic

ceph-dev-cron: remove leap15 from comment for job building master

9 days agoceph-dev-cron: remove leap15 from comment for job building master 1832/head
Kefu Chai [Sat, 5 Jun 2021 00:17:39 +0000 (08:17 +0800)]
ceph-dev-cron: remove leap15 from comment for job building master

as we don't build master on leap15 anymore

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
9 days agoceph-dev-cron: do not build master on bionic
Kefu Chai [Sat, 5 Jun 2021 00:16:58 +0000 (08:16 +0800)]
ceph-dev-cron: do not build master on bionic

see also 2cbeb00308051188337773b587ea5e2913a42b56

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
10 days agoscripts/build_utils: increase mem per job to 3000 MiB 1831/head
Kefu Chai [Fri, 4 Jun 2021 16:12:58 +0000 (00:12 +0800)]
scripts/build_utils: increase mem per job to 3000 MiB

see also https://github.com/ceph/ceph/pull/41677

Signed-off-by: Kefu Chai <kchai@redhat.com>
10 days agoMerge pull request #1830 from tchaikov/wip-no-bionic-on-master
Kefu Chai [Fri, 4 Jun 2021 14:55:59 +0000 (22:55 +0800)]
Merge pull request #1830 from tchaikov/wip-no-bionic-on-master

ceph-dev-*-trigger: stop building master on bionic

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
Reviewed-by: David Galloway <dgallowa@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
10 days agoceph-dev-trigger: remove leap15 from comment for job building master 1830/head
Kefu Chai [Fri, 4 Jun 2021 12:07:53 +0000 (20:07 +0800)]
ceph-dev-trigger: remove leap15 from comment for job building master

as we don't build master on leap15 anymore

Signed-off-by: Kefu Chai <kchai@redhat.com>
10 days agoscripts/build_utils: always pass -DALLOCATOR
Kefu Chai [Fri, 4 Jun 2021 08:23:09 +0000 (16:23 +0800)]
scripts/build_utils: always pass -DALLOCATOR

this change reverts 901fe2e097548707350bc89c7650e0f72c45d994 and
17b40974b1cb10d1d8ba0373dbf578fb0e82f036.

since we don't need to buld master (quincy and up) on bionic anymore,
there is no need to worry about the FTBFS when compiling with a buggy
gperftools (<2.6.2) shipped along with bionic.

Signed-off-by: Kefu Chai <kchai@redhat.com>
10 days agoceph-dev-*-trigger: stop building master on bionic
Kefu Chai [Fri, 4 Jun 2021 06:57:00 +0000 (14:57 +0800)]
ceph-dev-*-trigger: stop building master on bionic

in short, we don't need to test on bionic anymore for couple reasons:

- for accessing newer GCC
- for accessing more packages

see the discussion at
https://lists.ceph.io/hyperkitty/list/dev@ceph.io/thread/BW5NKQ4KTOPV7OYUBUHVDVCSH72LVIEO/

the only qa suite referencing ubuntu 18.04 is the qa/suites/orch/rook/smoke,
but it deploys ceph using Rook, and the container image of Ceph is
based on CentOS, so stop building on ubuntu/bionic does not
break it, despite the fact that 18.04 is included by
qa/suites/orch/rook/smoke/0-distro.

Signed-off-by: Kefu Chai <kchai@redhat.com>
11 days agoMerge pull request #1829 from tchaikov/wip-viva-la-venv
Guillaume Abrioux [Thu, 3 Jun 2021 09:30:01 +0000 (11:30 +0200)]
Merge pull request #1829 from tchaikov/wip-viva-la-venv

*/build/teardown: create venv for running teardown_vagrant_tests()

11 days agoceph-volume-nightly: do not set $scenarios 1829/head
Kefu Chai [Thu, 3 Jun 2021 09:25:46 +0000 (17:25 +0800)]
ceph-volume-nightly: do not set $scenarios

teardown_vagrant_tests() takes care of this already.

Signed-off-by: Kefu Chai <kchai@redhat.com>
11 days ago*/build/teardown: create venv for running teardown_vagrant_tests()
Kefu Chai [Thu, 3 Jun 2021 09:23:59 +0000 (17:23 +0800)]
*/build/teardown: create venv for running teardown_vagrant_tests()

to address the regression introduced by
e302eaabb977f3e93b1a7005c879f4b2eba581fc, which failed to create venv
after removing the global `$(mktemp -td venv.XXXXXXXXXX)` call.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2 weeks agoMerge pull request #1826 from dmick/wip-ceph-grafana
David Galloway [Thu, 27 May 2021 20:27:36 +0000 (16:27 -0400)]
Merge pull request #1826 from dmick/wip-ceph-grafana

Add ceph-grafana job

2 weeks agoAdd ceph-grafana job to build ceph-grafana container. 1826/head
Dan Mick [Tue, 4 May 2021 22:03:38 +0000 (15:03 -0700)]
Add ceph-grafana job to build ceph-grafana container.

This job builds from the ceph workspace based on a ceph branch and an
architecture (x86_64 or arm64).  A parent job calls this job for
branches or architectures.  More versions etc. could be parameterized,
but for now they're hardcoded in the ceph branch in
monitoring/grafana/build/Makefile.

2 weeks agoMerge pull request #1825 from ceph/wip-kernel-sha
Andrew Schoen [Tue, 25 May 2021 20:24:13 +0000 (15:24 -0500)]
Merge pull request #1825 from ceph/wip-kernel-sha

kernel: Export sha1 as an env variable so shaman build URLs work

2 weeks agokernel: Export sha1 as an env variable so shaman build URLs work wip-kernel-sha 1825/head
David Galloway [Tue, 25 May 2021 19:54:35 +0000 (15:54 -0400)]
kernel: Export sha1 as an env variable so shaman build URLs work

Signed-off-by: David Galloway <dgallowa@redhat.com>
2 weeks agoMerge pull request #1824 from ceph/wip-oklist
adam kraitman [Tue, 25 May 2021 18:17:59 +0000 (21:17 +0300)]
Merge pull request #1824 from ceph/wip-oklist

ceph-website: Allow Pete-Robelou to build beta.ceph.io

2 weeks agoceph-website: Allow Pete-Robelou to build beta.ceph.io 1824/head
David Galloway [Tue, 25 May 2021 18:12:37 +0000 (14:12 -0400)]
ceph-website: Allow Pete-Robelou to build beta.ceph.io

Signed-off-by: David Galloway <dgallowa@redhat.com>
3 weeks agoMerge pull request #1821 from tchaikov/wip-teuthology-pull-requests
Kefu Chai [Fri, 21 May 2021 14:38:21 +0000 (22:38 +0800)]
Merge pull request #1821 from tchaikov/wip-teuthology-pull-requests

teuthology-pull-requests: call create_venv_dir()

3 weeks agoteuthology-pull-requests: call create_venv_dir() 1821/head
Kefu Chai [Fri, 21 May 2021 14:34:46 +0000 (22:34 +0800)]
teuthology-pull-requests: call create_venv_dir()

it was an oversight in e302eaabb977f3e93b1a7005c879f4b2eba581fc

Signed-off-by: Kefu Chai <kchai@redhat.com>
3 weeks agoMerge pull request #1820 from ceph/create_venv_ca_syntax_check
Guillaume Abrioux [Fri, 21 May 2021 12:06:41 +0000 (14:06 +0200)]
Merge pull request #1820 from ceph/create_venv_ca_syntax_check

ceph-ansible-syntax: create virtualenv after dir creation

3 weeks agoceph-ansible-syntax: create virtualenv after dir creation 1820/head
Guillaume Abrioux [Fri, 21 May 2021 12:02:58 +0000 (14:02 +0200)]
ceph-ansible-syntax: create virtualenv after dir creation

add back venv creation that has been removed accidentally by
commit 3d832da831f0b938faa6f845617b0257bda184f4

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>
3 weeks agoMerge pull request #1819 from ceph/fix_ca_syntax
Guillaume Abrioux [Fri, 21 May 2021 11:53:18 +0000 (13:53 +0200)]
Merge pull request #1819 from ceph/fix_ca_syntax

ceph-ansible-syntax: fix broken job

3 weeks agoceph-ansible-syntax: fix broken job 1819/head
Guillaume Abrioux [Fri, 21 May 2021 11:45:35 +0000 (13:45 +0200)]
ceph-ansible-syntax: fix broken job

commit b09f6470745a09ce4fce0265cb7a22a56b049886 supposed to fix
regression introduced by e302eaabb977f3e93b1a7005c879f4b2eba581fc missed
the ceph-ansible-pr-syntax-check job, so the CI is still failing like
following:

```
[ceph-ansible-pr-syntax-check] $ /bin/bash /tmp/jenkins6031146002439656501.sh
+ set -e
+ virtualenv
You must provide a DEST_DIR
Usage: virtualenv [OPTIONS] DEST_DIR
```

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>
3 weeks agoMerge pull request #1818 from tchaikov/wip-ansible
Kefu Chai [Thu, 20 May 2021 17:16:07 +0000 (01:16 +0800)]
Merge pull request #1818 from tchaikov/wip-ansible

ceph-ansible*: pass $TEMPVENV to start_tox

Reviewed-by: Guillaume Abrioux <gabrioux@redhat.com>
3 weeks agoceph-ansible*: pass $TEMPVENV to start_tox 1818/head
Kefu Chai [Thu, 20 May 2021 17:08:50 +0000 (01:08 +0800)]
ceph-ansible*: pass $TEMPVENV to start_tox

to address the regression introduced by e302eaabb977f3e93b1a7005c879f4b2eba581fc

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
3 weeks agoMerge pull request #1816 from ceph/wip-kernel-deb-source-name
Ilya Dryomov [Thu, 20 May 2021 13:02:33 +0000 (15:02 +0200)]
Merge pull request #1816 from ceph/wip-kernel-deb-source-name

kernel: specify KDEB_SOURCENAME for make bindeb-pkg

3 weeks agokernel: specify KDEB_SOURCENAME for make bindeb-pkg 1816/head
Ilya Dryomov [Thu, 20 May 2021 10:48:03 +0000 (12:48 +0200)]
kernel: specify KDEB_SOURCENAME for make bindeb-pkg

Undo the damage caused by linux.git commit 82526ef43399 ("kbuild:
deb-pkg: change the source package name to linux-upstream").

We don't build a source package, but the source package name gets
embedded in the package metadata and ends up affecting the paths in
the repository generated by chacra.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
3 weeks agoMerge pull request #1815 from tchaikov/wip-venv-dir
Kefu Chai [Thu, 20 May 2021 07:01:53 +0000 (15:01 +0800)]
Merge pull request #1815 from tchaikov/wip-venv-dir

*: use create_venv_dir() helper

Reviewed-by: David Galloway <dgallowa@redhat.com>
3 weeks ago*: use create_venv_dir() helper 1815/head
Kefu Chai [Wed, 19 May 2021 13:59:34 +0000 (21:59 +0800)]
*: use create_venv_dir() helper

* define create_venv_dir() helper to
  1. create a temp dir
  2. set a trap to clean it up upon exit
* use create_venv_dir() in all scripts where
  TEMPVENV and/or VENV variables are used.

this change can help us to avoid creating a tempdir in /tmp,
and keep the tempdir forever.

Signed-off-by: Kefu Chai <kchai@redhat.com>
3 weeks agoMerge pull request #1813 from tchaikov/wip-venv-cleanup
Kefu Chai [Wed, 19 May 2021 07:45:40 +0000 (15:45 +0800)]
Merge pull request #1813 from tchaikov/wip-venv-cleanup

scripts/build_utils.sh: pass VENV to helper functions

Reviewed-by: David Galloway <dgallowa@redhat.com>
4 weeks agoMerge pull request #1699 from tchaikov/wip-ceph-pr-commits-cleanup
David Galloway [Mon, 17 May 2021 15:20:23 +0000 (11:20 -0400)]
Merge pull request #1699 from tchaikov/wip-ceph-pr-commits-cleanup

ceph-pr-commits: wrap lines over 79 chars

4 weeks agoMerge pull request #1812 from ceph/wip-sunilkumarn417
David Galloway [Mon, 17 May 2021 15:17:03 +0000 (11:17 -0400)]
Merge pull request #1812 from ceph/wip-sunilkumarn417

teuthology-pull-requests: Allowlist sunilkumarn417

4 weeks agoMerge pull request #1814 from tchaikov/wip-allocator-tcmalloc
Kefu Chai [Sat, 15 May 2021 12:57:32 +0000 (20:57 +0800)]
Merge pull request #1814 from tchaikov/wip-allocator-tcmalloc

ceph-dev-*-setup: do not specify ALLOCATOR

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
4 weeks agoceph-dev-*-setup: do not specify ALLOCATOR 1814/head
Kefu Chai [Sat, 15 May 2021 11:32:11 +0000 (19:32 +0800)]
ceph-dev-*-setup: do not specify ALLOCATOR

$DIST env variable is not set by ceph-dev-new-setup, as it prepares
the dist tarball for building on different distros. to build with
tcmalloc if gperftools 2.6.2 is available, we leave it to cmake to
decide the allocator to use. because, if ALLOCATOR is not specified,
cmake first tries to find gperftools, and falls back to JeMalloc, and
the libc allocator. after quincy, the fix for gperftools <2.6.2 is
dropped, and gperftools >= 2.6.2 is required, so it's safe. before
quincy, the fix gperftools <2.6.2 is still included, so it's also safe.

Signed-off-by: Kefu Chai <kchai@redhat.com>
4 weeks agoMerge pull request #1811 from tchaikov/wip-no-tcmalloc-bionic
Kefu Chai [Sat, 15 May 2021 09:55:10 +0000 (17:55 +0800)]
Merge pull request #1811 from tchaikov/wip-no-tcmalloc-bionic

ceph-dev-*-setup: use libc allocator when building quincy on bionic

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
4 weeks agoceph-dev-*-setup: use libc allocator when building quincy on bionic 1811/head
Kefu Chai [Fri, 14 May 2021 14:37:08 +0000 (22:37 +0800)]
ceph-dev-*-setup: use libc allocator when building quincy on bionic

see also https://tracker.ceph.com/issues/39703, to silence the warning
std::allocator<void> is deprecated in C++17 and will be removed in
C++20, so stop using allocator<void> in quincy and up.

but the libtcmalloc shipped by bionic is still buggy (v2.5), so we should not
build qunincy and up with tcmalloc on this distro.

after this change, we only build quincy and up with tcmalloc on non-bionic distro.

Signed-off-by: Kefu Chai <kchai@redhat.com>
4 weeks agoscripts/build_utils.sh: pass VENV to helper functions 1813/head
Kefu Chai [Sat, 15 May 2021 03:15:01 +0000 (11:15 +0800)]
scripts/build_utils.sh: pass VENV to helper functions

pass VENV to following functions explicitly:

* teardown_vagrant_tests()
* start_tox()
* build_debs()
* install_python_packages()
* install_python_packages_no_binary()
* pip_download()
* check_binary_existence()

prepare for the cleanup to avoid creating TEMPVENV everytime the script
is included.

Signed-off-by: Kefu Chai <kchai@redhat.com>
4 weeks agoscripts/build_utils.sh: reindent start_tox()
Kefu Chai [Sat, 15 May 2021 03:07:14 +0000 (11:07 +0800)]
scripts/build_utils.sh: reindent start_tox()

for better readability

Signed-off-by: Kefu Chai <kchai@redhat.com>
4 weeks agoteuthology-pull-requests: Allowlist sunilkumarn417 1812/head
David Galloway [Fri, 14 May 2021 19:28:28 +0000 (15:28 -0400)]
teuthology-pull-requests: Allowlist sunilkumarn417

https://github.com/ceph/teuthology/pull/1646#issuecomment-841353102

Signed-off-by: David Galloway <dgallowa@redhat.com>
4 weeks agoMerge pull request #1810 from ceph/update_cephadm-ansible
Guillaume Abrioux [Fri, 14 May 2021 12:06:14 +0000 (14:06 +0200)]
Merge pull request #1810 from ceph/update_cephadm-ansible

cephadm-ansible: update scripts

4 weeks agocephadm-ansible: update scripts 1810/head
Guillaume Abrioux [Fri, 14 May 2021 11:57:59 +0000 (13:57 +0200)]
cephadm-ansible: update scripts

This updates the build and teardown scripts so the playbook in
cephadm-ansible repository can be tested with the upstream ci.

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>
5 weeks agoMerge pull request #1809 from ceph/cephadm-ansible
Guillaume Abrioux [Mon, 10 May 2021 06:53:54 +0000 (08:53 +0200)]
Merge pull request #1809 from ceph/cephadm-ansible

cephadm-ansible: add initial job

5 weeks agocephadm-ansible: add initial job 1809/head
Guillaume Abrioux [Fri, 7 May 2021 12:09:52 +0000 (14:09 +0200)]
cephadm-ansible: add initial job

This adds a job definition for cephadm-ansible.
For now it doesn't run anything, it's just adding the definition into
jenkins so we can start setting up the corresponding repository
(cephadm-ansible).

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>
5 weeks agoMerge pull request #1807 from mgfritch/opensuse-leap-15.3
Kefu Chai [Thu, 6 May 2021 03:12:53 +0000 (11:12 +0800)]
Merge pull request #1807 from mgfritch/opensuse-leap-15.3

ceph-dev-build: update {build,setup}_osc

Reviewed-by: Kyr Shatskyy <kyrylo.shatskyy@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
5 weeks agoMerge pull request #1808 from tchaikov/wip-ceph-pr-docs-check
Kefu Chai [Wed, 5 May 2021 12:50:24 +0000 (20:50 +0800)]
Merge pull request #1808 from tchaikov/wip-ceph-pr-docs-check

ceph-pr-docs: add annotation to build result

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
5 weeks agoceph-pr-docs: add annotation to build result 1808/head
Kefu Chai [Tue, 4 May 2021 05:47:53 +0000 (13:47 +0800)]
ceph-pr-docs: add annotation to build result

* do not "set -e", so the script does not exit immediately. instead
  use a variable of "succeed" to store true if the document is built
  successfully, and false otherwise
* feed the output of the sphinx-build to github-check tool, so it
  is able to parse and call the GitHub Check API to update the
  Check web page on the PR if the test fails.

Signed-off-by: Kefu Chai <kchai@redhat.com>
5 weeks agoMerge pull request #1684 from tchaikov/wip-cbt-lint
Kefu Chai [Tue, 4 May 2021 02:44:43 +0000 (10:44 +0800)]
Merge pull request #1684 from tchaikov/wip-cbt-lint

ceph-cbt-lint: add cbt lint test

Reviewed-by: David Galloway <dgallowa@redhat.com>
5 weeks agoceph-dev-build: update {build,setup}_osc 1807/head
Michael Fritch [Mon, 3 May 2021 22:16:12 +0000 (16:16 -0600)]
ceph-dev-build: update {build,setup}_osc

use openSUSE Leap 15.3 repository for pacific and quincy

Fixes: https://tracker.ceph.com/issues/50563
Signed-off-by: Michael Fritch <mfritch@suse.com>
6 weeks agoMerge pull request #1777 from ceph/drop_luminous_from_cv_nightly
Guillaume Abrioux [Wed, 28 Apr 2021 17:50:37 +0000 (19:50 +0200)]
Merge pull request #1777 from ceph/drop_luminous_from_cv_nightly

ceph-volume-nightly: remove luminous

6 weeks agoMerge pull request #1806 from ceph/fix_ganesha_builds
Guillaume Abrioux [Wed, 28 Apr 2021 14:23:41 +0000 (16:23 +0200)]
Merge pull request #1806 from ceph/fix_ganesha_builds

nfs-ganesha: fix broken builds

6 weeks agonfs-ganesha: fix broken builds 1806/head
Guillaume Abrioux [Wed, 28 Apr 2021 14:02:15 +0000 (16:02 +0200)]
nfs-ganesha: fix broken builds

This job must be updated due to recent chances in nfs-ganesha (CMakeLists.txt)

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>
6 weeks agoMerge pull request #1805 from tchaikov/wip-debug-build-of-crimson
Kefu Chai [Wed, 28 Apr 2021 08:24:39 +0000 (16:24 +0800)]
Merge pull request #1805 from tchaikov/wip-debug-build-of-crimson

scripts/build_utils.sh: build Debug builds for crimson flavor

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
6 weeks agoscripts/build_utils.sh: build Debug builds for crimson flavor 1805/head
Kefu Chai [Wed, 28 Apr 2021 06:16:52 +0000 (14:16 +0800)]
scripts/build_utils.sh: build Debug builds for crimson flavor

for ease of testing.

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 weeks agoscripts/build_utils.sh: use "+=" for appending string to a variable
Kefu Chai [Wed, 28 Apr 2021 06:14:58 +0000 (14:14 +0800)]
scripts/build_utils.sh: use "+=" for appending string to a variable

less repeating this way.

Signed-off-by: Kefu Chai <kchai@redhat.com>
6 weeks agoceph-dev-*setup: extract ceph_build_args_from_flavor() out
Kefu Chai [Wed, 28 Apr 2021 06:12:14 +0000 (14:12 +0800)]
ceph-dev-*setup: extract ceph_build_args_from_flavor() out

so this helper can be shared by ceph-dev-new-setup and ceph-dev-setup
jobs.

Signed-off-by: Kefu Chai <kchai@redhat.com>
7 weeks agoMerge pull request #1793 from ceph/wip-1772
Kefu Chai [Sat, 24 Apr 2021 07:31:31 +0000 (15:31 +0800)]
Merge pull request #1793 from ceph/wip-1772

sync-push: Use sort -V

Reviewed-by: Kefu Chai <kchai@redhat.com>
7 weeks agoMerge pull request #1804 from tchaikov/wip-no-ppa-on-bionic
Kefu Chai [Thu, 22 Apr 2021 17:08:11 +0000 (01:08 +0800)]
Merge pull request #1804 from tchaikov/wip-no-ppa-on-bionic

scripts/build_utils.sh: do not use ppa on bionic

Reviewed-by: Casey Bodley <cbodley@redhat.com>
7 weeks agoscripts/build_utils.sh: do not use ppa on bionic 1804/head
Kefu Chai [Thu, 22 Apr 2021 06:17:46 +0000 (14:17 +0800)]
scripts/build_utils.sh: do not use ppa on bionic

Signed-off-by: Kefu Chai <kchai@redhat.com>
7 weeks agoMerge pull request #1803 from tchaikov/wip-pr-docs-cleanup
Sage Weil [Wed, 21 Apr 2021 13:48:39 +0000 (08:48 -0500)]
Merge pull request #1803 from tchaikov/wip-pr-docs-cleanup

ceph-pr-docs: remove more leftover source.list

7 weeks agoceph-pr-docs: remove more leftover source.list 1803/head
Kefu Chai [Wed, 21 Apr 2021 13:28:51 +0000 (21:28 +0800)]
ceph-pr-docs: remove more leftover source.list

Signed-off-by: Kefu Chai <kchai@redhat.com>
8 weeks agoMerge pull request #1801 from ceph/guits-add-ca-nightly-fs2bs
Guillaume Abrioux [Fri, 16 Apr 2021 14:40:57 +0000 (16:40 +0200)]
Merge pull request #1801 from ceph/guits-add-ca-nightly-fs2bs

ceph-ansible: add a nightly job

8 weeks agoceph-ansible: add a nightly job 1801/head
Guillaume Abrioux [Thu, 15 Apr 2021 13:04:49 +0000 (15:04 +0200)]
ceph-ansible: add a nightly job

This adds a missing nightly job 'filestore_to_bluestore'

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>
2 months agoMerge pull request #1800 from rzarzynski/wip-crimson-only-builds
Kefu Chai [Wed, 14 Apr 2021 07:27:26 +0000 (15:27 +0800)]
Merge pull request #1800 from rzarzynski/wip-crimson-only-builds

ceph-dev-new-trigger: add a crimson-only building variant.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2 months agoceph-dev-new-trigger: add a crimson-only building variant. 1800/head
Radoslaw Zarzynski [Tue, 13 Apr 2021 13:13:36 +0000 (13:13 +0000)]
ceph-dev-new-trigger: add a crimson-only building variant.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2 months agoMerge pull request #1799 from dmick/wip-nfs-ganesha
Dan Mick [Fri, 9 Apr 2021 19:55:14 +0000 (12:55 -0700)]
Merge pull request #1799 from dmick/wip-nfs-ganesha

nfs-ganesha: change patch to sed, drop some older distro/releases

2 months agonfs-ganesha: remove centos7 and xenial, build arm64 (centos8 only) 1799/head
Dan Mick [Fri, 9 Apr 2021 02:42:34 +0000 (19:42 -0700)]
nfs-ganesha: remove centos7 and xenial, build arm64 (centos8 only)

Signed-off-by: Dan Mick <dmick@redhat.com>
2 months agonfs-ganesha: fix patch for debian/rules
Dan Mick [Fri, 9 Apr 2021 02:40:24 +0000 (19:40 -0700)]
nfs-ganesha: fix patch for debian/rules

Some branches of nfs-ganesha-debian don't have the right format for
the patch file to work (Cmake features can be turned on or off
with various words, ON/OFF, YES/NO, etc.).  Use sed instead to be
more resilient to such chicanery.

Signed-off-by: Dan Mick <dmick@redhat.com>
2 months agoMerge pull request #1797 from dmick/wip-build-utils
Kefu Chai [Thu, 8 Apr 2021 02:04:42 +0000 (10:04 +0800)]
Merge pull request #1797 from dmick/wip-build-utils

Wrong variable use / shell syntax errors in build_utils.sh

Reviewed-by: Kefu Chai <kchai@redhat.com>
2 months agobuild_utils.sh: delete unescaped newlines in sources.list addition 1797/head
Dan Mick [Thu, 8 Apr 2021 01:47:51 +0000 (18:47 -0700)]
build_utils.sh: delete unescaped newlines in sources.list addition

Signed-off-by: Dan Mick <dmick@redhat.com>
2 months agobuild_utils.sh: check correct version of variable for distro
Dan Mick [Thu, 8 Apr 2021 01:47:16 +0000 (18:47 -0700)]
build_utils.sh: check correct version of variable for distro

Signed-off-by: Dan Mick <dmick@redhat.com>
2 months agoMerge pull request #1796 from ceph/wip-unattende
adam kraitman [Wed, 7 Apr 2021 19:28:52 +0000 (22:28 +0300)]
Merge pull request #1796 from ceph/wip-unattende

ansible: Remove unattended-upgrades after package install

2 months agoansible: Remove unattended-upgrades after package install 1796/head
David Galloway [Wed, 7 Apr 2021 15:35:22 +0000 (11:35 -0400)]
ansible: Remove unattended-upgrades after package install

One of the packages we *do* want to install (software-properties-common maybe) pulls in unattended upgrades.  It's not a strict dependency so we can remove it after package install.  It's the only package that gets removed.

Signed-off-by: David Galloway <dgallowa@redhat.com>
2 months agoMerge pull request #1795 from tchaikov/wip-hookdir
Kefu Chai [Wed, 7 Apr 2021 14:44:11 +0000 (22:44 +0800)]
Merge pull request #1795 from tchaikov/wip-hookdir

scripts/build_utils.sh: set hookdir using pbuilderrc

Reviewed-by: David Galloway <dgallowa@redhat.com>
2 months agoscripts/build_utils.sh: set hookdir using pbuilderrc 1795/head
Kefu Chai [Wed, 7 Apr 2021 13:09:57 +0000 (21:09 +0800)]
scripts/build_utils.sh: set hookdir using pbuilderrc

per our testing, --hookdir does not work even the pbuilderrc(5) puts

> HOOKDIR=/usr/lib/pbuilder/hooks
>    Specifies the default location for the user hooks directory.  This is overridden with the option --hookdir.

so let use HOOKDIR as we did before e81fd7baa0e49242cef2db66eeb3fe6dc4269905

Signed-off-by: Kefu Chai <kchai@redhat.com>
2 months agoscripts/build_utils.sh: no need to update repo if ppa repo is not used
Kefu Chai [Wed, 7 Apr 2021 12:43:56 +0000 (20:43 +0800)]
scripts/build_utils.sh: no need to update repo if ppa repo is not used

Signed-off-by: Kefu Chai <kchai@redhat.com>
2 months agoscripts/build_utils.sh: make user script executable
Kefu Chai [Wed, 7 Apr 2021 12:41:50 +0000 (20:41 +0800)]
scripts/build_utils.sh: make user script executable

as per pbuilder(8),

> The  scripts  must be executable and may be either binaries or
> interpreted scripts.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2 months agosync-push: Use sort -V 1793/head
David Galloway [Mon, 5 Apr 2021 15:41:14 +0000 (11:41 -0400)]
sync-push: Use sort -V

Signed-off-by: David Galloway <dgallowa@redhat.com>
2 months agoMerge pull request #1792 from tchaikov/wip-updates
Dan Mick [Fri, 2 Apr 2021 19:07:53 +0000 (12:07 -0700)]
Merge pull request #1792 from tchaikov/wip-updates

scripts/build_utils.sh: install gnupg before ppa packages

2 months agoscripts/build_utils: use -security and -updates repo 1792/head
Kefu Chai [Fri, 2 Apr 2021 05:09:50 +0000 (13:09 +0800)]
scripts/build_utils: use -security and -updates repo

Signed-off-by: Kefu Chai <kchai@redhat.com>
2 months agoMerge pull request #1790 from tchaikov/wip-no-quotes-thanks
Dan Mick [Fri, 2 Apr 2021 03:20:39 +0000 (20:20 -0700)]
Merge pull request #1790 from tchaikov/wip-no-quotes-thanks

scripts/build_utils.sh: should not quote --mirror option

2 months agoscripts/build_utils.sh: should not quote --mirror option 1790/head
Kefu Chai [Fri, 2 Apr 2021 03:16:59 +0000 (11:16 +0800)]
scripts/build_utils.sh: should not quote --mirror option

otherwise the URL is not reachable with quotes in it.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2 months agoMerge pull request #1781 from dmick/wip-nfs-ganesha-arm64
Dan Mick [Thu, 1 Apr 2021 21:27:57 +0000 (14:27 -0700)]
Merge pull request #1781 from dmick/wip-nfs-ganesha-arm64

Fix up nfs-ganesha for arm64/centos8 builds

2 months agoMerge pull request #1788 from tchaikov/wip-xunit-thresholds
Kefu Chai [Wed, 31 Mar 2021 15:40:47 +0000 (23:40 +0800)]
Merge pull request #1788 from tchaikov/wip-xunit-thresholds

ceph-pull-requests: specify threshold for a failure

Reviewed-by: David Galloway <dgallowa@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2 months agoMerge pull request #1789 from ceph/wip-allow-focal
David Galloway [Wed, 31 Mar 2021 14:26:34 +0000 (10:26 -0400)]
Merge pull request #1789 from ceph/wip-allow-focal

multiple PR jobs: Run on any Ubuntu node

2 months agomultiple PR jobs: Run on any Ubuntu node 1789/head
David Galloway [Wed, 31 Mar 2021 14:14:13 +0000 (10:14 -0400)]
multiple PR jobs: Run on any Ubuntu node

All of Jenkins builders are running Ubuntu Focal.  They all have the bionic label.  They also have the xenial label but that's only because we're still building packages *for* Xenial.  But not *on* Xenial.

Signed-off-by: David Galloway <dgallowa@redhat.com>
2 months agoceph-pull-requests: specify threshold for a failure 1788/head
Kefu Chai [Wed, 31 Mar 2021 09:15:11 +0000 (17:15 +0800)]
ceph-pull-requests: specify threshold for a failure

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2 months agoMerge pull request #1785 from tchaikov/wip-pbuilder
Kefu Chai [Wed, 31 Mar 2021 00:37:43 +0000 (08:37 +0800)]
Merge pull request #1785 from tchaikov/wip-pbuilder

scripts/build_utils: write settings to /root/.pbuilderrc

Reviewed-by: David Galloway <dgallowa@redhat.com>
2 months agoscripts/build_utils: write settings to /root/.pbuilderrc 1785/head
Kefu Chai [Tue, 30 Mar 2021 15:06:43 +0000 (23:06 +0800)]
scripts/build_utils: write settings to /root/.pbuilderrc

according to pbuilder(8)

> ${HOME}/.pbuilderrc
>       The personal configuration file for pbuilder, which overrides settings set in other configuration files.
>
>       Note that ${HOME} is usually /root (if you are running pbuilder through sudo).

since we always call `pbuilder` via `sudo`, we should overwrite
/root/.pbuilderrc with $HOME/.pbuilderrc.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2 months agoscripts/build_utils: use "pbuilder clean"
Kefu Chai [Tue, 30 Mar 2021 15:04:18 +0000 (23:04 +0800)]
scripts/build_utils: use "pbuilder clean"

"clean" is now a command instead of an option.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2 months agoscript/build_utils.sh: use a single variable for pbuilder options
Kefu Chai [Tue, 30 Mar 2021 14:43:38 +0000 (22:43 +0800)]
script/build_utils.sh: use a single variable for pbuilder options

for better maintainability

Signed-off-by: Kefu Chai <kchai@redhat.com>
2 months agoMerge pull request #1780 from dmick/wip-xunit-skip
Kefu Chai [Tue, 30 Mar 2021 17:03:20 +0000 (01:03 +0800)]
Merge pull request #1780 from dmick/wip-xunit-skip

ceph-pull-requests: skip xunit publisher if no test files present

Reviewed-by: Kefu Chai <kchai@redhat.com>
2 months agoMerge pull request #1782 from tchaikov/wip-gcc-9-bionic
David Galloway [Tue, 30 Mar 2021 15:07:30 +0000 (11:07 -0400)]
Merge pull request #1782 from tchaikov/wip-gcc-9-bionic

scripts/build_utils.sh: use gcc-9 from ppa on bionic

2 months agoMerge pull request #1784 from tchaikov/wip-dashboard-py3
Kefu Chai [Tue, 30 Mar 2021 13:04:11 +0000 (21:04 +0800)]
Merge pull request #1784 from tchaikov/wip-dashboard-py3

ceph-dashboard-pull-requests: install python3 packages only

Reviewed-by: Laura Paduano <lpaduano@suse.com>
2 months agoceph-dashboard-pull-requests: install python3 packages only 1784/head
Kefu Chai [Tue, 30 Mar 2021 11:59:00 +0000 (19:59 +0800)]
ceph-dashboard-pull-requests: install python3 packages only

since we've moved to ubuntu focal for running "make check", "ceph-dashboard-pull-requests"
and "ceph-pr-api" tests. and ubuntu focal does not package python2 packages
for python-scipy or python-routes. let's just install the python3
packages.

this change is related to nautilus builds. because nautilus is the last
release which supports python2.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2 months agoMerge pull request #1783 from tchaikov/wip-api-test-python2
Kefu Chai [Tue, 30 Mar 2021 08:51:44 +0000 (16:51 +0800)]
Merge pull request #1783 from tchaikov/wip-api-test-python2

ceph-{api-nightly,pr-api}: install python3 packages on debian derivat…

Reviewed-by: Laura Paduano <lpaduano@suse.com>