Merge pull request #1483 from ceph/wip-no-tar

ceph-build: Apply e8bdd639

Reviewed-by: Kefu Chai <kchai@redhat.com>

ceph-build: Apply e8bdd639

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #1481 from ceph/wip-no-hostname

ansible: Set hostname on OpenSUSE

Merge pull request #1482 from tchaikov/wip-cd

ceph-build: apply 604882e9 to ceph-build

ceph-build: apply 604882e9 to ceph-build

to address following failure

+ cd ceph-14.2.6 ceph-14.2.6.tar.bz2 ceph-14.2.6.tar.gz
/tmp/jenkins10747333749307639424.sh: line 1058: cd: too many arguments

Signed-off-by: Kefu Chai <kchai@redhat.com>

ansible: Set hostname on OpenSUSE

Now that we're using system-provided ansible packages (https://github.com/ceph/mita/pull/135), we're at the mercy of the version provided.

OpenSUSE Leap 15.1 gives us ansible 2.8.1 which has this bug: https://github.com/ansible/ansible/issues/42726

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #1480 from ceph/guits-add_docker2podman

ceph-ansible: use dedicated tox for docker2podman job

ceph-ansible: use dedicated tox for docker2podman job

This commit makes tox using a dedicated tox ini file for the
docker_to_podman job.

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>

Merge pull request #1477 from ceph/wip-suse-sepia

sepia-fog-images: Support openSUSE

Merge pull request #1479 from ceph/guits-add_docker2podman

ceph-ansible-prs: add docker2podman scenario

ceph-ansible-prs: add docker2podman scenario

This commit adds a new 'docker2podman' job for the ceph-ansible CI.

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>

Merge pull request #1478 from ceph/wip-kernel-centos8

kernel: add centos8 builds

kernel: drop invalid axis

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>

kernel: drop distros we don't build for

We don't use and don't have build agents for any of these.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>

kernel: add centos8 builds

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>

sepia-fog-images: Support openSUSE

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #1453 from callithea/wip-dashboard-prs-install-deps

ceph-dashboard-*,ceph-api-nightly: Remove conditional-step; Replaced dir and script name

Reviewed-by: Kefu Chai <kchai@redhat.com>

ceph-dashboard-*, ceph-api-nightly: Remove conditional-step; Replaced dir name; split-up
scripts

Split up the script which installs dependencies, since e2e and backend API tests require
different packages. Adapt all jobs to use the dedicated scripts.
Also remove the conditional step to not only execute the script that installs dependencies
for e2e test environments

Signed-off-by: Laura Paduano <lpaduano@suse.com>

Merge pull request #1474 from ceph/wip-pythonvirt

ansible: Install distro-appropriate virtualenv package version

Merge pull request #1475 from tchaikov/wip-dpkg-source-x

ceph-dev*-build: do not unpack source tar ball

ceph-dev*-build: do not unpack source tar ball

the uncompressed tarball is not used, moreover, the build fails on
bionic when `dpkg-source -x` the source package. because we've been
relying on a bug on xenial. see
https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=826334;msg=31

and on bionic, the bug was fixed. so `dpkg-source -x` started to
fail.

Signed-off-by: Kefu Chai <kchai@redhat.com>

ansible: Install distro-appropriate virtualenv package version

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #1473 from ceph/wip-noxenial

ceph-dev-new: Don't build master/wip on xenial

ceph-dev-new: Don't build master/wip on xenial

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #1471 from ceph/wip-ugh-echo

ceph-dev-new-trigger: "fix" conditional step for all other branches

ceph-dev-new-trigger: "fix" conditional step for all other branches

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #1470 from dmick/master

ceph-dev-new-build: allow containers on centos 7 or 8

ceph-dev-new-build: allow containers on centos 7 or 8

Signed-off-by: Dan Mick <dan.mick@redhat.com>

Merge pull request #1459 from ceph/wip-jjbyamlwtf

Update build matrices

Merge pull request #1469 from ceph/wip-cpr

ceph-pull-requests: Do NOT run on pbuilder hosts

ceph-pull-requests: Do NOT run on pbuilder hosts

pbuilder hosts are running Xenial.  We still want to be able to build Bionic packages on Xenial but we do not want make check to run on *all* slaves with the "bionic" label.

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #1468 from ceph/wip-bionic-slaves

ansible: Support Ubuntu Bionic slaves

ceph-pull-requests: Only run make check on Bionic

1) Bionic should have python2 and python3
2) All builds should run on Bionic but no other distro

Signed-off-by: David Galloway <dgallowa@redhat.com>

ansible: Support Ubuntu Bionic slaves

https://askubuntu.com/a/381527/906620

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #1467 from ceph/wip-tcmu-runner-el8

tcmu-runner: fixed creation of chroot cfg file

tcmu-runner: fixed creation of chroot cfg file

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #1466 from ceph/wip-tcmu-runner-el8

tcmu-runner: second attempt at getting mock to use shaman repo

tcmu-runner: second attempt at getting mock to use shaman repo

It was falling back to the BaseOS repo which includes an older
version of librados/librbd.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #1465 from ceph/wip-tcmu-runner-el8

tcmu-runner: fix environment variable typo

tcmu-runner: fix environment variable typo

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #1464 from ceph/wip-tcmu-runner-el8

tcmu-runner: copy shaman.repo into mock build chroot

tcmu-runner: copy shaman.repo into mock build chroot

The el8 mock chroot environment templates now use special include
directives which makes it difficult to inject the shaman repos into
them before initializing the chroot environment. Therefore, just
directly copy the repo file.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #1463 from ceph/wip-c8-master

ceph-dev-build: setup_rpm Support for CentOS8

ceph-dev-build: setup_rpm Support for CentOS8

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #1462 from ceph/wip-cdlol

ceph-dev-build: Don't try to cd into tarballs

ceph-dev-build: Don't try to cd into tarballs

Fixes:

```
+ cd dist
+ tar xzf ceph_15.0.0-8623-g8a4458f.orig.tar.gz
+ cd ceph-15.0.0-8623-g8a4458f ceph-15.0.0-8623-g8a4458f.tar.bz2 ceph-15.0.0-8623-g8a4458f.tar.gz
/tmp/jenkins8482303231462049247.sh: line 1064: cd: too many arguments
```

Signed-off-by: David Galloway <dgallowa@redhat.com>

ceph-dev*trigger: Set correct distro/flavor combos based on release

Based on https://pad.ceph.com/p/py3

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #1461 from ceph/wip-tcmu-runner-el8

tcmu-runner: add centos8 to the available distros

tcmu-runner: add centos8 to the available distros

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #1460 from ceph/wip-master-c8

ceph-dev-build: Build master on centos8

ceph-dev-build: Build ceph.git master on centos8

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #1458 from ceph/wip-ceph-iscsi-el8

ceph-iscsi: switch to huge centos builders

ceph-iscsi: switch to huge centos builders

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #1457 from ceph/wip-ceph-iscsi-el8

ceph-iscsi: add centos8 distro for dev builds

ceph-iscsi: add centos8 distro for dev builds

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #1456 from ceph/wip-equals

ansible: Adjust `when` statements to put EL8 repos on EL8 only

ansible: Adjust `when` statements to put EL8 repos on EL8 only

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #1455 from ceph/wip-notc-8

ceph-dev{-new}: Build notcmalloc dev packages for centos8

ceph-dev{-new}: Build notcmalloc dev packages for centos8

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #1454 from ceph/wip-c8-slaves

ansible: Install lab-extras and copr repos on EL8

ansible: Install lab-extras and copr repos on EL8

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #1450 from ceph/createrepo-flags

scripts: use --no-database flag for createrepo

Merge pull request #1448 from callithea/wip-ceph-dashboard-pull-requests-dependencies

ceph-dashboard-pull-requests: Update dependencies

Reviewed-by: Kefu Chai kchai@redhat.com

Merge pull request #1452 from ceph/centos8-dev-builds

ceph-dev-new-trigger: build centos8 from ceph-ci

ceph-dev-new-trigger: build centos8 from ceph-ci

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #1451 from toabctl/ceph-dev-build-opensuse-15.2

ceph-dev-build: Use correct OBS repo octopus on openSUSE Leap

ceph-dev-build: Use correct OBS repo octopus on openSUSE Leap

We want to build against openSUSE Leap 15.2 for octopus. So use the
correct repo.

Signed-off-by: Thomas Bechtold <tbechtold@suse.com>

scripts: use --no-database flag for createrepo

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #1449 from toabctl/chacra-pull-requests-ansible-fix

chacra-pull-requests: Replace ansible sudo with become

chacra-pull-requests: Replace ansible sudo with become

"become" is the correct ansible keyword for priv escalation in newer
versions. So use that.
This will fix at least the ansible-playbook setup.yml call which
previously failed.

Signed-off-by: Thomas Bechtold <tbechtold@suse.com>

ceph-dashboard-pull-requests: Update dependencies

Signed-off-by: Laura Paduano <lpaduano@suse.com>

Merge pull request #1416 from ceph/wip-no-c8-lum

Build mimic/nautilus on CentOS8

Merge pull request #1447 from ceph/guits-add_job

ceph-ansible-prs: add filestore_to_bluestore job

ceph-ansible-prs: add filestore_to_bluestore job

This commit adds a new job for testing the filestore-to-bluestore.yml
playbook.

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>

Merge pull request #1446 from ceph/guits-ceph-disk_3.2

ceph-ansible-prs: introduce back ceph-disk testing (3.2 only)

ceph-ansible-prs: introduce back ceph-disk testing (3.2 only)

Related ceph-ansible PR: ceph/ceph-ansible#4824

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>

Merge pull request #1445 from ceph/pin_ansible_lint_on_stable_3.2

ceph-ansible-pr-syntax-check: pin ansible-lint

ceph-ansible-pr-syntax-check: pin ansible-lint

Latest ansible-lint release (4.2.0) drops ansible 2.6 support so the
syntax-check job isn't compatible with the ceph-ansible stable-3.2
branch which uses ansible 2.6.

Signed-off-by: Dimitri Savineau <dsavinea@redhat.com>

Merge pull request #1443 from rhcs-dashboard/dashboard-nightly

project config: ceph-api-nightly

Reviewed-by: Kefu Chai kchai@redhat.com
Reviewed-by: Alfredo Deza <adeza@redhat.com>
Reviewed-by: Ernesto Puertat <epuertat@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>

project config: ceph-api-nightly

Project: run backend API + E2E tests on a daily basis
against master & nautilus.

No mention to dashboard in project name as API is key
to the whole ceph project.

Signed-off-by: Alfonso Martínez <almartin@redhat.com>

Merge pull request #1444 from ceph/ceph_ansible_doc_stable_4.0

ceph-ansible-docs: build doc for stable-4.0

ceph-ansible-docs: build doc for stable-4.0

Let's build the upstream documentation for stable-4.0

Closes: https://github.com/ceph/ceph-ansible/issues/4794
Signed-off-by: Dimitri Savineau <dsavinea@redhat.com>

Merge pull request #1442 from badone/wip-disable-lizardfs-fsal-follow-up

nfs-ganesha: Remove lizardFSAL patch

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

Merge pull request #1441 from ceph/revert-1440-wip-disable-lizardfs-fsal-follow-up

Revert "nfs-ganesha: dpkg commit source after lizardFSAL patch"

nfs-ganesha: Remove lizardFSAL patch

This is a follow-up to 888793c4 to 'commit' the patch.

Signed-off-by: Brad Hubbard <bhubbard@redhat.com>

Revert "nfs-ganesha: dpkg commit source after lizardFSAL patch"

Merge pull request #1440 from badone/wip-disable-lizardfs-fsal-follow-up

nfs-ganesha: dpkg commit source after lizardFSAL patch

Reviewed-by: Josh Durgin <jdurgin@redhat.com>

nfs-ganesha: dpkg commit source after lizardFSAL patch

This is a follow-up to 888793c4 to 'commit' the patch.

Signed-off-by: Brad Hubbard <bhubbard@redhat.com>

Merge pull request #1439 from badone/wip-disable-lizardfs-fsal

nfs-ganesha: Disable LizardFS FSAL for debian

Reviewed-by: Jeff Layton <jlayton@redhat.com>

nfs-ganesha: Disable LizardFS FSAL for debian

LizardFS FSAL has been added in [1] and it's enabled by default. This
is currently failing in the CI for Bionic. 338d18e resolved this for rpm
builds, but not for debs.

CMake Error at CMakeLists.txt:595 (message):
    STRICT_PACKAGE: Cannot find LizardFS client lib.  Disabling lizardfs
    fsal

This patch configures the USE_FSAL_LIZARDFS option to OFF.

[1] nfs-ganesha/nfs-ganesha@884ec97

Signed-off-by: Brad Hubbard <bhubbard@redhat.com>

Merge pull request #1438 from ceph/guits-add_auto_discovery_prs

ceph-ansible-prs: add lvm_auto_discovery job

ceph-ansible-prs: add lvm_auto_discovery job

Add the possibility to trigger `lvm_auto_discovery` job on ceph-ansible PR

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>

Merge pull request #1437 from dmick/wip-quay-short-tags

quay-pruner/build/prune-quay.py: handle new "short tags"

Merge pull request #1436 from ceph/ceph_ansible_prs_docs_only_condition

ceph-ansible-prs: update docs skip condition

quay-pruner/build/prune-quay.py: handle new "short tags"

There are two new tags proposed for each image: "branchname" and "full
sha1".  Branchname is currently being created.  When pruning image tags,
we need to prune the associated short tags as well.

This also fixes a current bug where, because branchname tags are being
created, the current unaware prune script deletes them because it
treats "can't parse tagname" as equivalent to "can't find in shaman".

Signed-off-by: Dan Mick <dan.mick@redhat.com>

ceph-ansible-prs: update docs skip condition

When a PR can't be merged due to conflicts then we can't check if the
last commit is a merge commit.

Commit message: "Merge xxxx into xxxx"

In this case we only checkout the latest commit in the PR without the
previous one if any.

Signed-off-by: Dimitri Savineau <dsavinea@redhat.com>

Merge pull request #1435 from dmick/wip-ceph-ci

ceph-dev-new, quay-pruner: cephci/daemon-base -> ceph-ci/ceph

ceph-dev-new, quay-pruner: cephci/daemon-base -> ceph-ci/ceph

name change requested by @liewegas

Signed-off-by: Dan Mick <dan.mick@redhat.com>

Merge pull request #1430 from dmick/quay-pruner

Add "quay-pruner" to prune stale quay.io container images

Add "quay-pruner" to prune stale quay.io container images

Signed-off-by: Dan Mick <dan.mick@redhat.com>