Merge pull request #930 from ceph/wip-kernel-ceph-iscsi

kernel: added 'ceph-iscsi*' branches to trigger list

kernel: added 'ceph-iscsi*' branches to trigger list

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #928 from tchaikov/wip-only-build-newer-releases-with-gcc-7

setup_pbuilder: only use ppa on newer releases

setup_pbuilder: only use ppa on newer releases

* only use GCC-7 offered by ppa repo on mimic and newer release.
  we are dropping the support of trusty in mimic and newer releases,
  but we still need to use the old toolchain shipped with trusty to
  build jewel and luminous. so, only use GCC-7 on trusty for building
  mimic and up. as it should be safe to use the new GCC ABI on the
  supported distros, like xenial.
* extract the ppa setup related code into build_utils.sh, so the
  setup_pbuilder scripts can reuse it.

Signed-off-by: Kefu Chai <kchai@redhat.com>

Merge pull request #927 from ceph/wip-fog-fix

sepia-fog-image: couple fixes

sepia-fog-images: Build workspace for failure too

Signed-off-by: David Galloway <dgallowa@redhat.com>

sepia-fog-image: Remove ubuntu@ for teuthology-update-inventory

Cuz it doesn't work like that.

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #922 from ceph/wip-sepia-fog

sepia-fog-images: Job creation

sepia-fog-images: Job creation

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #926 from ceph/lvm-tests

ceph-ansible-prs: adds lvm tests for the luminous release

ceph-ansible-prs: adds lvm tests for the luminous release

ceph-volume can now be used in luminous, so we should be able to
test PRs for ceph-volume against luminous.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #914 from tchaikov/wip-gcc-7-on-trusty

setup_pbuilder: point gcc to gcc-7 on trusty

setup_pbuilder: point gcc to gcc-7 on trusty

Signed-off-by: Kefu Chai <kchai@redhat.com>

Merge pull request #924 from ceph/mimic-dev

ceph-dev-trigger support mimic* branches, to include mimic-dev

ceph-dev-trigger support mimic* branches, to include mimic-dev

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #923 from ceph/wip-kernel-install-libelf

kernel: install libelf

kernel: install libelf

ORC unwinder (default on x86 since 4.15) requires it.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>

Merge pull request #919 from ceph/jewel_stable3

ceph-ansible-prs: enable github-hooks for oldstable-trigger

ceph-ansible-prs: enable github-hooks for oldstable-trigger

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>

Merge pull request #918 from ceph/jewel_stable3

ceph-ansible-prs: fix wrong syntax in trigger-phrase

ceph-ansible-prs: fix wrong syntax in trigger-phrase

`stable-2.2` is not a correct syntax because it is interpreted as a regexp.

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>

Merge pull request #917 from ceph/jewel_stable3

ceph-ansible-prs: change trigger-phrase

ceph-ansible-prs: change trigger-phrase

fix ceph-ansible-2.2-prs template because it triggers jobs that
shouldn't for backport to stable-2.2 PRs.

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>

Merge pull request #915 from ceph/jewel_stable3

ceph-ansible-nightly: couple of fixes

ceph-ansible-prs: add testing for stable-2.2

When submitting a backport PR to stable-2.2 branch, the jobs that are
auto triggered don't exist in job templates because they have changed
between `stable-2.2` and `stable-3.0`

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>

ceph-ansible-nightly: Remove inconsistency test

This way of testing is a bit dangerous and make the jobs inconsistents.

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>

Merge pull request #916 from ceph/wip-ghprb-vars

ceph-colume-ansible-prs: add injected ghprb vars to help manual triggering

ceph-colume-ansible-prs: add injected ghprb vars to help manual triggering

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #911 from ceph/jewel_stable3

ceph-ansible: set CEPH_STABLE_RELEASE in start_tox()

ceph-ansible: set CEPH_STABLE_RELEASE in start_tox()

according to ceph/ceph-ansible#2165 we need to set `CEPH_STABLE_RELEASE`
in ceph/ceph-build.

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>

Merge pull request #913 from ceph/ceph-volume-tests

ceph-volume-ansible-prs: use subcommand to build the testing path

ceph-volume-ansible-prs: use subcommand to build the testing path

When using test_path jjb was rendering $TEST_PATH as a list. I'm unsure
exactly why, but using $SUBCOMMAND we can easily build the test path.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #910 from ceph/ceph-volume-tests

ceph-volume: adds pr tests for the simple subcommand

ceph-volume: adds pr tests for the simple subcommand

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #909 from tchaikov/wip-scl-for-devtoolset

ceph{-,dev-,dev-new-}build: install centos-release-scl repo

ceph{-,dev-,dev-new-}build: remove handling of non RHEL distros

Signed-off-by: Kefu Chai <kchai@redhat.com>

ceph{-,dev-,dev-new-}build: install centos-release-scl repo

enable/install centos-release-scl on rhel7/centos7, so we can use
newer gcc/toolchain offered by Software Collections (scl)'s devtoolset
see https://www.softwarecollections.org/en/scls/rhscl/devtoolset-7/

Signed-off-by: Kefu Chai <kchai@redhat.com>

Merge pull request #908 from ceph/update_ceph-ansible_nightly

ceph-ansible-nightly: add project for jewel/stable3.0

ceph-ansible-nightly: add project for jewel/stable3.0

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>

Merge pull request #907 from ceph/update_ceph-ansible_nightly

ceph-ansible-nightly: update project name

ceph-ansible-nightly: update project name

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>

Merge pull request #904 from ceph/update_ceph-ansible_nightly

ceph-ansible: restore stable-2.2 scenarios for ceph-ansible

ceph-ansible-nightly: restore stable-2.2 scenarios

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>

Merge pull request #906 from ceph/wip-jewel-bluestore

ceph-container: Get rid of jewel bluestore tests

ceph-container: Get rid of jewel bluestore tests

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #905 from ceph/rename-ceph-docker

ceph-container: update project name

ceph-container: update project name

roject name has been changed from `ceph-docker` to `ceph-container`

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>

Merge pull request #899 from ceph/wip-jq

Install jq on slaves and document JJB job cleanup

doc: Add docs for config/JENKINS_URL override

Signed-off-by: David Galloway <dgallowa@redhat.com>

jenkins-job-builder: Set JJB_CONFIG var back after looping through jobs

Signed-off-by: David Galloway <dgallowa@redhat.com>

jenkins-job-builder: do not install jq libs via pip

Signed-off-by: David Galloway <dgallowa@redhat.com>

ansible: install distro-provided jq

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #893 from ceph/wip-docker-nightly

ceph-docker-nightly: nightlies run on centos now

ceph-docker-nightly: nightlies run on centos now

Related: https://github.com/ceph/ceph-build/pull/886

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #903 from ceph/wip-update-slavejar

ansible: always update slave.jar

ansible: always update slave.jar

Makes sure latest version of JNLP is being used.  Primarily useful when
re-running the playbook against a static slave.

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #902 from ceph/update_ceph-ansible_nightly

ceph-ansible-nightlies: update nightlies test to fit new needs

ceph-ansible-nightlies: update nightlies test to fit new needs

update ceph-ansible-nightlies according to new needs for downstream
product

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>

Merge pull request #901 from ceph/ceph-volume-tests

ceph-volume-ansible-prs: adds the bluestore testing scenario

ceph-volume-ansible-prs: adds the objectstore factor

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

ceph-volume-ansible-prs: adds the bluestore testing scenario

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #900 from ceph/update_ceph-ansible_nightly

ceph-ansible-nightlies: followup on 3adf56e

ceph-ansible-nightlies: followup on 3adf56e

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>

Merge pull request #880 from ceph/wip-cleanup-jobs

jenkins-job-builder: Delete stale jobs

jenkins-job-builder: Delete stale jobs

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #896 from ceph/update_ceph-ansible_nightly

ceph-ansible-nightly: add more nightly tests

ceph-ansible-nightly: add more nightly tests

jewel:
- stable-2.2
- stable-3.0
- master

luminous:
- stable3.0
- master

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>

Merge pull request #898 from ceph/update_ceph-ansible-nightly

ceph-ansible-nightly: test against ansible2.2/2.4

ceph-ansible-nightly: test against ansible2.2/2.4

test nightlies against ansible2.2 and 2.4 for ceph-ansible

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>

Merge pull request #897 from ceph/ansible-prs

ceph-ansible-prs: test against ansible2.4 on pull requests

ceph-ansible-prs: test against ansible2.4 on pull requests

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #895 from ceph/ansible-prs

ceph-ansible-prs: adds the dev-ansible2.3-bluestore_lvm_osds

ceph-ansible-prs: adds the dev-ansible2.3-bluestore_lvm_osds

This must be a dev scenario for now as the functionality for ceph-volume
to create bluestore osds is not in a luminous release yet.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #894 from ceph/wip-iproute

ansible: add iproute to centos libvirt slave deps

ansible: add iproute to centos libvirt slave deps

Required by https://github.com/ceph/ceph-docker/blob/master/tests/tox.sh#L77

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #891 from ceph/followup

ceph-ansible-prs: split purge_cluster test

ceph-ansible-nightly: split purge_cluster test

accordingly to 0f74f02

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>

ceph-ansible-prs: split purge_cluster test

we need to test purge_cluster for filestore and for bluestore.

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>

Merge pull request #892 from ceph/wip-ansidocker-centos

ceph-{ansible,docker}: Run jobs on centos7 slaves

ceph-{ansible,docker}: Run jobs on centos7 slaves

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #890 from ceph/wip-prado-sync

ansible: slave playbook overhaul (update and format)

ansible: Fix slave playbook conditional. string -> int

Signed-off-by: David Galloway <dgallowa@redhat.com>

ansible: Update example playbooks to match in-use playbooks

Signed-off-by: David Galloway <dgallowa@redhat.com>

ansible: Support CentOS libvirt ephemeral slaves

Signed-off-by: David Galloway <dgallowa@redhat.com>

ansible: s/sudo/become

Signed-off-by: David Galloway <dgallowa@redhat.com>

ansible: Readable formatting in playbooks

Signed-off-by: David Galloway <dgallowa@redhat.com>

ansible: Bring ceph-build playbooks up to date with prado

The playbooks on prado.ceph.com have been manually manipulated a few
times but didn't get updated in ceph-build.git.  This commit mainly
includes:

 - Support for multiple Jenkins masters
 - Using Google DNS instead of OVH's (due to random DNS failures)

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #888 from ceph/wip-nfs-ganesha-cmake-options

nfs-ganesha: update cmake options for rpms

nfs-ganesha: update cmake options for rpms

Signed-off-by: Ali Maredia <amaredia@redhat.com>

Merge pull request #889 from ceph/osd-nightly

ceph-ansible-nightly: add new scenarios to nightly

ceph-ansible-nightly: add new scenarios to nightly

For ceph-ansible and ceph-docker.

Signed-off-by: Sébastien Han <seb@redhat.com>

Merge pull request #887 from ceph/osd-scenarios

DNM: ceph-ansible-prs: simply osd scenarios

ceph-ansible-prs: simply osd scenarios

* introduces new osd scenarios to reduce amount of osds
* do not run update jobs by default

Signed-off-by: Sébastien Han <seb@redhat.com>

Merge pull request #886 from ceph/clean_ceph-dockers-prs_build

ceph-docker-prs: make build script compatible with centos

ceph-docker-prs: clean code on build script

docker installation is already handled in
https://github.com/ceph/ceph-docker/blob/master/tests/tox.sh#L26-L38

using `sg docker` to run tox is no longer necessary because of:
https://github.com/ceph/ceph-docker/blob/master/tests/tox.sh#L37

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>

Merge pull request #885 from ceph/wip-fix-scripts

scripts: Fix libvirt cleanup script from previous PR

scripts: Fix libvirt cleanup script from previous PR

https://github.com/ceph/ceph-build/pull/884

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #884 from ceph/wip-centos-static

Support CentOS static libvirt slaves & update playbook

ansible: python-jenkins fixed upstream. use it.

Signed-off-by: David Galloway <dgallowa@redhat.com>

ansible: Support multiple masters. Default to 2.jenkins

We only have static libvirt slaves on 2.jenkins.ceph.com for now

Signed-off-by: David Galloway <dgallowa@redhat.com>