ceph-dev-new-trigger: "fix" conditional step for all other branches

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #1470 from dmick/master

ceph-dev-new-build: allow containers on centos 7 or 8

ceph-dev-new-build: allow containers on centos 7 or 8

Signed-off-by: Dan Mick <dan.mick@redhat.com>

Merge pull request #1459 from ceph/wip-jjbyamlwtf

Update build matrices

Merge pull request #1469 from ceph/wip-cpr

ceph-pull-requests: Do NOT run on pbuilder hosts

ceph-pull-requests: Do NOT run on pbuilder hosts

pbuilder hosts are running Xenial.  We still want to be able to build Bionic packages on Xenial but we do not want make check to run on *all* slaves with the "bionic" label.

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #1468 from ceph/wip-bionic-slaves

ansible: Support Ubuntu Bionic slaves

ceph-pull-requests: Only run make check on Bionic

1) Bionic should have python2 and python3
2) All builds should run on Bionic but no other distro

Signed-off-by: David Galloway <dgallowa@redhat.com>

ansible: Support Ubuntu Bionic slaves

https://askubuntu.com/a/381527/906620

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #1467 from ceph/wip-tcmu-runner-el8

tcmu-runner: fixed creation of chroot cfg file

tcmu-runner: fixed creation of chroot cfg file

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #1466 from ceph/wip-tcmu-runner-el8

tcmu-runner: second attempt at getting mock to use shaman repo

tcmu-runner: second attempt at getting mock to use shaman repo

It was falling back to the BaseOS repo which includes an older
version of librados/librbd.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #1465 from ceph/wip-tcmu-runner-el8

tcmu-runner: fix environment variable typo

tcmu-runner: fix environment variable typo

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #1464 from ceph/wip-tcmu-runner-el8

tcmu-runner: copy shaman.repo into mock build chroot

tcmu-runner: copy shaman.repo into mock build chroot

The el8 mock chroot environment templates now use special include
directives which makes it difficult to inject the shaman repos into
them before initializing the chroot environment. Therefore, just
directly copy the repo file.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #1463 from ceph/wip-c8-master

ceph-dev-build: setup_rpm Support for CentOS8

ceph-dev-build: setup_rpm Support for CentOS8

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #1462 from ceph/wip-cdlol

ceph-dev-build: Don't try to cd into tarballs

ceph-dev-build: Don't try to cd into tarballs

Fixes:

```
+ cd dist
+ tar xzf ceph_15.0.0-8623-g8a4458f.orig.tar.gz
+ cd ceph-15.0.0-8623-g8a4458f ceph-15.0.0-8623-g8a4458f.tar.bz2 ceph-15.0.0-8623-g8a4458f.tar.gz
/tmp/jenkins8482303231462049247.sh: line 1064: cd: too many arguments
```

Signed-off-by: David Galloway <dgallowa@redhat.com>

ceph-dev*trigger: Set correct distro/flavor combos based on release

Based on https://pad.ceph.com/p/py3

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #1461 from ceph/wip-tcmu-runner-el8

tcmu-runner: add centos8 to the available distros

tcmu-runner: add centos8 to the available distros

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #1460 from ceph/wip-master-c8

ceph-dev-build: Build master on centos8

ceph-dev-build: Build ceph.git master on centos8

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #1458 from ceph/wip-ceph-iscsi-el8

ceph-iscsi: switch to huge centos builders

ceph-iscsi: switch to huge centos builders

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #1457 from ceph/wip-ceph-iscsi-el8

ceph-iscsi: add centos8 distro for dev builds

ceph-iscsi: add centos8 distro for dev builds

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #1456 from ceph/wip-equals

ansible: Adjust `when` statements to put EL8 repos on EL8 only

ansible: Adjust `when` statements to put EL8 repos on EL8 only

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #1455 from ceph/wip-notc-8

ceph-dev{-new}: Build notcmalloc dev packages for centos8

ceph-dev{-new}: Build notcmalloc dev packages for centos8

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #1454 from ceph/wip-c8-slaves

ansible: Install lab-extras and copr repos on EL8

ansible: Install lab-extras and copr repos on EL8

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #1450 from ceph/createrepo-flags

scripts: use --no-database flag for createrepo

Merge pull request #1448 from callithea/wip-ceph-dashboard-pull-requests-dependencies

ceph-dashboard-pull-requests: Update dependencies

Reviewed-by: Kefu Chai kchai@redhat.com

Merge pull request #1452 from ceph/centos8-dev-builds

ceph-dev-new-trigger: build centos8 from ceph-ci

ceph-dev-new-trigger: build centos8 from ceph-ci

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #1451 from toabctl/ceph-dev-build-opensuse-15.2

ceph-dev-build: Use correct OBS repo octopus on openSUSE Leap

ceph-dev-build: Use correct OBS repo octopus on openSUSE Leap

We want to build against openSUSE Leap 15.2 for octopus. So use the
correct repo.

Signed-off-by: Thomas Bechtold <tbechtold@suse.com>

scripts: use --no-database flag for createrepo

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #1449 from toabctl/chacra-pull-requests-ansible-fix

chacra-pull-requests: Replace ansible sudo with become

chacra-pull-requests: Replace ansible sudo with become

"become" is the correct ansible keyword for priv escalation in newer
versions. So use that.
This will fix at least the ansible-playbook setup.yml call which
previously failed.

Signed-off-by: Thomas Bechtold <tbechtold@suse.com>

ceph-dashboard-pull-requests: Update dependencies

Signed-off-by: Laura Paduano <lpaduano@suse.com>

Merge pull request #1416 from ceph/wip-no-c8-lum

Build mimic/nautilus on CentOS8

Merge pull request #1447 from ceph/guits-add_job

ceph-ansible-prs: add filestore_to_bluestore job

ceph-ansible-prs: add filestore_to_bluestore job

This commit adds a new job for testing the filestore-to-bluestore.yml
playbook.

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>

Merge pull request #1446 from ceph/guits-ceph-disk_3.2

ceph-ansible-prs: introduce back ceph-disk testing (3.2 only)

ceph-ansible-prs: introduce back ceph-disk testing (3.2 only)

Related ceph-ansible PR: ceph/ceph-ansible#4824

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>

Merge pull request #1445 from ceph/pin_ansible_lint_on_stable_3.2

ceph-ansible-pr-syntax-check: pin ansible-lint

ceph-ansible-pr-syntax-check: pin ansible-lint

Latest ansible-lint release (4.2.0) drops ansible 2.6 support so the
syntax-check job isn't compatible with the ceph-ansible stable-3.2
branch which uses ansible 2.6.

Signed-off-by: Dimitri Savineau <dsavinea@redhat.com>

Merge pull request #1443 from rhcs-dashboard/dashboard-nightly

project config: ceph-api-nightly

Reviewed-by: Kefu Chai kchai@redhat.com
Reviewed-by: Alfredo Deza <adeza@redhat.com>
Reviewed-by: Ernesto Puertat <epuertat@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>

project config: ceph-api-nightly

Project: run backend API + E2E tests on a daily basis
against master & nautilus.

No mention to dashboard in project name as API is key
to the whole ceph project.

Signed-off-by: Alfonso Martínez <almartin@redhat.com>

Merge pull request #1444 from ceph/ceph_ansible_doc_stable_4.0

ceph-ansible-docs: build doc for stable-4.0

ceph-ansible-docs: build doc for stable-4.0

Let's build the upstream documentation for stable-4.0

Closes: https://github.com/ceph/ceph-ansible/issues/4794
Signed-off-by: Dimitri Savineau <dsavinea@redhat.com>

Merge pull request #1442 from badone/wip-disable-lizardfs-fsal-follow-up

nfs-ganesha: Remove lizardFSAL patch

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #1441 from ceph/revert-1440-wip-disable-lizardfs-fsal-follow-up

Revert "nfs-ganesha: dpkg commit source after lizardFSAL patch"

nfs-ganesha: Remove lizardFSAL patch

This is a follow-up to 888793c4 to 'commit' the patch.

Signed-off-by: Brad Hubbard <bhubbard@redhat.com>

Revert "nfs-ganesha: dpkg commit source after lizardFSAL patch"

Merge pull request #1440 from badone/wip-disable-lizardfs-fsal-follow-up

nfs-ganesha: dpkg commit source after lizardFSAL patch

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

nfs-ganesha: dpkg commit source after lizardFSAL patch

This is a follow-up to 888793c4 to 'commit' the patch.

Signed-off-by: Brad Hubbard <bhubbard@redhat.com>

Merge pull request #1439 from badone/wip-disable-lizardfs-fsal

nfs-ganesha: Disable LizardFS FSAL for debian

Reviewed-by: Jeff Layton <jlayton@redhat.com>

nfs-ganesha: Disable LizardFS FSAL for debian

LizardFS FSAL has been added in [1] and it's enabled by default. This
is currently failing in the CI for Bionic. 338d18e resolved this for rpm
builds, but not for debs.

CMake Error at CMakeLists.txt:595 (message):
    STRICT_PACKAGE: Cannot find LizardFS client lib.  Disabling lizardfs
    fsal

This patch configures the USE_FSAL_LIZARDFS option to OFF.

[1] nfs-ganesha/nfs-ganesha@884ec97

Signed-off-by: Brad Hubbard <bhubbard@redhat.com>

Merge pull request #1438 from ceph/guits-add_auto_discovery_prs

ceph-ansible-prs: add lvm_auto_discovery job

ceph-ansible-prs: add lvm_auto_discovery job

Add the possibility to trigger `lvm_auto_discovery` job on ceph-ansible PR

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>

Merge pull request #1437 from dmick/wip-quay-short-tags

quay-pruner/build/prune-quay.py: handle new "short tags"

Merge pull request #1436 from ceph/ceph_ansible_prs_docs_only_condition

ceph-ansible-prs: update docs skip condition

quay-pruner/build/prune-quay.py: handle new "short tags"

There are two new tags proposed for each image: "branchname" and "full
sha1".  Branchname is currently being created.  When pruning image tags,
we need to prune the associated short tags as well.

This also fixes a current bug where, because branchname tags are being
created, the current unaware prune script deletes them because it
treats "can't parse tagname" as equivalent to "can't find in shaman".

Signed-off-by: Dan Mick <dan.mick@redhat.com>

ceph-ansible-prs: update docs skip condition

When a PR can't be merged due to conflicts then we can't check if the
last commit is a merge commit.

Commit message: "Merge xxxx into xxxx"

In this case we only checkout the latest commit in the PR without the
previous one if any.

Signed-off-by: Dimitri Savineau <dsavinea@redhat.com>

Merge pull request #1435 from dmick/wip-ceph-ci

ceph-dev-new, quay-pruner: cephci/daemon-base -> ceph-ci/ceph

ceph-dev-new, quay-pruner: cephci/daemon-base -> ceph-ci/ceph

name change requested by @liewegas

Signed-off-by: Dan Mick <dan.mick@redhat.com>

Merge pull request #1430 from dmick/quay-pruner

Add "quay-pruner" to prune stale quay.io container images

Add "quay-pruner" to prune stale quay.io container images

Signed-off-by: Dan Mick <dan.mick@redhat.com>

Merge pull request #1434 from ceph/wip-waitlonger

sepia-fog-images: Wait longer for lab to quiet down

sepia-fog-images: Wait longer for lab to quiet down

30min wasn't enough for jobs to stop scheduling Deploy tasks.

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #1433 from ceph/bionic-updates-2

scripts: use main and universe directly

scripts: use main and universe directly

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #1432 from ceph/bionic-updates

scripts: add bionic-updates to pbuilderrc for gcc 7.4.0

scripts: add bionic-updates to pbuilderrc for gcc 7.4.0

Fixes: https://tracker.ceph.com/issues/42596
Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #1428 from ceph/ceph_ansible_prs_add_mon_osd

ceph-ansible-prs: re-add add_xxx jobs

ceph-ansible-prs: re-add add_xxx jobs

This includes:
  - add_mdss
  - add_mgrs
  - add_mons
  - add_osds
  - add_rbdmirrors
  - add_rgws

Signed-off-by: Dimitri Savineau <dsavinea@redhat.com>

Merge pull request #1429 from ceph/fix_ansible_2.9_syntax

ansible: replace sudo by become

ansible: replace sudo by become

Since ansible 2.9 sudo statements have been removed and we should use
become instead.

"All previously deprecated sudo/su and module locale global settings have
been removed." [1]

[1] https://github.com/ansible/ansible/blob/stable-2.9/changelogs/CHANGELOG-v2.9.rst

Signed-off-by: Dimitri Savineau <dsavinea@redhat.com>

Merge pull request #1427 from toabctl/paddles-pr-testing

paddles-pull-requests: adds a job to test paddles PRs

paddles-pull-requests: adds a job to test paddles PRs

Signed-off-by: Thomas Bechtold <tbechtold@suse.com>

Merge pull request #1426 from tchaikov/ceph-perf-pull-requests/pullid

ceph-*-pull-requests*: use ghprbPullId to define branches

ceph-*-pull-requests*: use ghprbPullId to define branches

* add "ghprbPullId" param, simpler to use than "sha1"
* instead of using "sha1", use "ghprbPullId" to define branches to build,
  more consistent this way. as we pull the refs using
  `+refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/*`
  and after the change, the ref to build is specified using
  `origin/pr/${ghprbPullId}/merge`. also, by removing "sha1",
  we can specify a single parameter when rebuilding/building a branch
  on jenkins instead of two parameters.

Signed-off-by: Kefu Chai <kchai@redhat.com>

Merge pull request #1425 from ceph/cv-rm-xenial

ceph-volume-ansible-prs: remove xenial from PR testing

Merge pull request #1422 from ceph/wip-no-more-dupes

ansible: Just use the example

Merge pull request #1375 from ceph/wip-ceph-iscsi-stable

ceph-iscsi-stable: revert to production chacra instance

Merge pull request #1424 from ceph/wip-pr-docs

ceph-pr-render-docs: Clean up old doc renders

ceph-pr-render-docs: Clean up old doc renders

Since these don't get stored on the larger volume attached to docs.ceph.com, they can fill up the root disk without being cleaned up.

Signed-off-by: David Galloway <dgallowa@redhat.com>

ceph-volume-ansible-prs: remove xenial from PR testing

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #1423 from ceph/wip-arm64-centos

ceph-pull-requests-arm64: Don't make check on CentOS8 yet

ceph-pull-requests-arm64: Don't make check on CentOS8 yet

Until deps are in epel8 or we figure out an alternative

Signed-off-by: David Galloway <dgallowa@redhat.com>

ansible: Just use the example

In our setup, the example is the canonical playbook that works.  If, for some reason, ceph-build.git is used by someone else, they can rm the symlink and create their own `ansible/slave.yml` but for our purposes, there's no need to keep separate playbooks as it just creates confusion when modifying the playbooks.

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #1421 from ceph/wip-ansible-examples-leap15

ansible/examples/slave: add leap15

ansible/examples/slave: add leap15

Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@suse.com>