doc: Add docs for config/JENKINS_URL override

Signed-off-by: David Galloway <dgallowa@redhat.com>

jenkins-job-builder: Set JJB_CONFIG var back after looping through jobs

Signed-off-by: David Galloway <dgallowa@redhat.com>

jenkins-job-builder: do not install jq libs via pip

Signed-off-by: David Galloway <dgallowa@redhat.com>

ansible: install distro-provided jq

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #893 from ceph/wip-docker-nightly

ceph-docker-nightly: nightlies run on centos now

ceph-docker-nightly: nightlies run on centos now

Related: https://github.com/ceph/ceph-build/pull/886

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #903 from ceph/wip-update-slavejar

ansible: always update slave.jar

ansible: always update slave.jar

Makes sure latest version of JNLP is being used.  Primarily useful when
re-running the playbook against a static slave.

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #902 from ceph/update_ceph-ansible_nightly

ceph-ansible-nightlies: update nightlies test to fit new needs

ceph-ansible-nightlies: update nightlies test to fit new needs

update ceph-ansible-nightlies according to new needs for downstream
product

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>

Merge pull request #901 from ceph/ceph-volume-tests

ceph-volume-ansible-prs: adds the bluestore testing scenario

ceph-volume-ansible-prs: adds the objectstore factor

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

ceph-volume-ansible-prs: adds the bluestore testing scenario

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #900 from ceph/update_ceph-ansible_nightly

ceph-ansible-nightlies: followup on 3adf56e

ceph-ansible-nightlies: followup on 3adf56e

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>

Merge pull request #880 from ceph/wip-cleanup-jobs

jenkins-job-builder: Delete stale jobs

jenkins-job-builder: Delete stale jobs

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #896 from ceph/update_ceph-ansible_nightly

ceph-ansible-nightly: add more nightly tests

ceph-ansible-nightly: add more nightly tests

jewel:
- stable-2.2
- stable-3.0
- master

luminous:
- stable3.0
- master

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>

Merge pull request #898 from ceph/update_ceph-ansible-nightly

ceph-ansible-nightly: test against ansible2.2/2.4

ceph-ansible-nightly: test against ansible2.2/2.4

test nightlies against ansible2.2 and 2.4 for ceph-ansible

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>

Merge pull request #897 from ceph/ansible-prs

ceph-ansible-prs: test against ansible2.4 on pull requests

ceph-ansible-prs: test against ansible2.4 on pull requests

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #895 from ceph/ansible-prs

ceph-ansible-prs: adds the dev-ansible2.3-bluestore_lvm_osds

ceph-ansible-prs: adds the dev-ansible2.3-bluestore_lvm_osds

This must be a dev scenario for now as the functionality for ceph-volume
to create bluestore osds is not in a luminous release yet.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #894 from ceph/wip-iproute

ansible: add iproute to centos libvirt slave deps

ansible: add iproute to centos libvirt slave deps

Required by https://github.com/ceph/ceph-docker/blob/master/tests/tox.sh#L77

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #891 from ceph/followup

ceph-ansible-prs: split purge_cluster test

ceph-ansible-nightly: split purge_cluster test

accordingly to 0f74f02

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>

ceph-ansible-prs: split purge_cluster test

we need to test purge_cluster for filestore and for bluestore.

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>

Merge pull request #892 from ceph/wip-ansidocker-centos

ceph-{ansible,docker}: Run jobs on centos7 slaves

ceph-{ansible,docker}: Run jobs on centos7 slaves

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #890 from ceph/wip-prado-sync

ansible: slave playbook overhaul (update and format)

ansible: Fix slave playbook conditional. string -> int

Signed-off-by: David Galloway <dgallowa@redhat.com>

ansible: Update example playbooks to match in-use playbooks

Signed-off-by: David Galloway <dgallowa@redhat.com>

ansible: Support CentOS libvirt ephemeral slaves

Signed-off-by: David Galloway <dgallowa@redhat.com>

ansible: s/sudo/become

Signed-off-by: David Galloway <dgallowa@redhat.com>

ansible: Readable formatting in playbooks

Signed-off-by: David Galloway <dgallowa@redhat.com>

ansible: Bring ceph-build playbooks up to date with prado

The playbooks on prado.ceph.com have been manually manipulated a few
times but didn't get updated in ceph-build.git.  This commit mainly
includes:

 - Support for multiple Jenkins masters
 - Using Google DNS instead of OVH's (due to random DNS failures)

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #888 from ceph/wip-nfs-ganesha-cmake-options

nfs-ganesha: update cmake options for rpms

nfs-ganesha: update cmake options for rpms

Signed-off-by: Ali Maredia <amaredia@redhat.com>

Merge pull request #889 from ceph/osd-nightly

ceph-ansible-nightly: add new scenarios to nightly

ceph-ansible-nightly: add new scenarios to nightly

For ceph-ansible and ceph-docker.

Signed-off-by: Sébastien Han <seb@redhat.com>

Merge pull request #887 from ceph/osd-scenarios

DNM: ceph-ansible-prs: simply osd scenarios

ceph-ansible-prs: simply osd scenarios

* introduces new osd scenarios to reduce amount of osds
* do not run update jobs by default

Signed-off-by: Sébastien Han <seb@redhat.com>

Merge pull request #886 from ceph/clean_ceph-dockers-prs_build

ceph-docker-prs: make build script compatible with centos

ceph-docker-prs: clean code on build script

docker installation is already handled in
https://github.com/ceph/ceph-docker/blob/master/tests/tox.sh#L26-L38

using `sg docker` to run tox is no longer necessary because of:
https://github.com/ceph/ceph-docker/blob/master/tests/tox.sh#L37

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>

Merge pull request #885 from ceph/wip-fix-scripts

scripts: Fix libvirt cleanup script from previous PR

scripts: Fix libvirt cleanup script from previous PR

https://github.com/ceph/ceph-build/pull/884

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #884 from ceph/wip-centos-static

Support CentOS static libvirt slaves & update playbook

ansible: python-jenkins fixed upstream. use it.

Signed-off-by: David Galloway <dgallowa@redhat.com>

ansible: Support multiple masters. Default to 2.jenkins

We only have static libvirt slaves on 2.jenkins.ceph.com for now

Signed-off-by: David Galloway <dgallowa@redhat.com>

ansible: Support centos static libvirt slaves

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #883 from ceph/wip-static-zesty

ansible: Set jenkins_group on Zesty and later

ansible: Set jenkins_group on Zesty and later

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #882 from ceph/disable_ansible-lint

syntax-check: temporary disable ansible-lint

syntax-check: temporary disable ansible-lint

We better to stabilize existing jobs before adding new like this one.

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>

Merge pull request #881 from ceph/wip-limit-smithi

ceph-ansible-prs: limit certain scenarios to smithi nodes

ceph-ansible-prs: limit certain scenarios to smithi nodes

Requested by leseb:
* luminous-ansible2.3-xenial_cluster
* luminous-ansible2.3-centos7_cluster
* luminous-ansible2.3-docker_cluster
* luminous-ansible2.3-purge_cluster
* luminous-ansible2.3-update_cluster
* luminous-ansible2.3-cluster
* luminous-ansible2.3-update_docker_cluster
* luminous-ansible2.3-switch_to_containers
* luminous-ansible2.3-purge_docker_cluster

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #879 from ceph/wip-docker-nightly

ceph-docker-nightly: Update definition to match PR scenarios

ceph-docker-nightly: Set 3h timeout for nightly tests too

Signed-off-by: David Galloway <dgallowa@redhat.com>

ceph-docker-nightly: Update definition to match PR scenarios

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #878 from ceph/wip-kernel-tcm-user

(re)enable TCM user kernel module

(re)enable TCM user kernel module

The 4.1 release renamed the TCM user kernel module config
option from TCM_USER to TCM_USER2.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #877 from ceph/ceph-ansible-nightly

ceph-ansible-nightly: test all luminous scenarios

ceph-ansible-nightly: test all luminous scenarios

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #876 from ceph/wip-vagrant-typo

scripts: Fix typo

scripts: Fix typo

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #875 from ceph/wip-vagrant-update

Update vagrant boxes and fix libvirt image cleanup script

scripts: Fix cleanup of old libvirt images

rm -rf /var/lib/libvirt/images/*.img wasn't working.

We also need to clean up the .disk files that are getting left behind.

Signed-off-by: David Galloway <dgallowa@redhat.com>

scripts: Keep vagrant boxes up to date on static libvirt slaves

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #874 from ceph/defaultscenar

ceph-ansible-prs: add two default scenarios

ceph-ansible-prs: add two default scenarios

Adding update_cluster and docker_cluster to test by default on each new
PR.

Signed-off-by: Sébastien Han <seb@redhat.com>

Merge pull request #873 from ceph/collocation-ceph-ansible

ceph-ansible-prs: add collocation scenario

ceph-ansible-prs: add collocation scenario

Add collocation scenario for containers.

Signed-off-by: Sébastien Han <seb@redhat.com>

Merge pull request #872 from ceph/ceph-ansible-prs-update

ceph-ansible-prs: setting only-trigger-phrase with a var did not work

ceph-ansible-prs: trigger phrase is now a regex

You can trigger a job by using the individiual scenario name or by
commenting with 'jenkins test all' to run all the scenarios.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

ceph-ansible-prs: setting only-trigger-phrase with a var did not work

I tried setting the value of only-trigger-phrase as a variable on the
project so we didn't have to duplicate the job template but that didn't
seem to work. Duplicating the job template does allow us to create jobs
that do not auto start when PRs are created.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #871 from ceph/ceph-ansible-prs-update

ceph-ansible-prs: allow for tests to be auto started or only triggered

ceph-ansible-prs: allow for tests to be auto started or only triggered

This creates two different projects, one which lists scenarios that will
auto start on every PR and another which lists scenarios that will only
start if a comment is made on the PR with its trigger phrase.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #870 from ceph/fix_teardown_leftover

ceph-ansible-prs: fix leftover

ceph-ansible-prs: fix leftover

sometimes, it happens that the Jenkins Slave processes crashes before
teardown is executed (ie. `java.io.EOFException`), it means we keep
leftofver from previous build. This commit ensures before the test is
launched that no fetch directory from previous build is present.

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>

Merge pull request #869 from ceph/ansible-lint

ceph-ansible-pr-syntax-check: use ansible-lint

ceph-ansible-pr-syntax-check: use ansible-lint

Enhance the ceph-ansible-pr-syntax-check job by running ansible-lint as
well.

Signed-off-by: Sébastien Han <seb@redhat.com>

Merge pull request #868 from ceph/skip-tests

ceph-ansible-prs: skip-build-phrase must be a regex

ceph-ansible-prs: skip-build-phrase must be a regex

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #867 from ceph/skip-tests

ceph-ansible-prs: adds skip-build-phrase

ceph-ansible-prs: adds skip-build-phrase

Adding the string 'no-tests' to either the PR title
or description will keep CI jobs from triggering on PR updates or
creation.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #866 from ceph/shrink-cont

ceph-ansible-prs: add shrink mon/osd for container

ceph-ansible-prs: add shrink mon/osd for container

Signed-off-by: Sébastien Han <seb@redhat.com>

Merge pull request #865 from ceph/ansible-docs

ceph-ansible-docs: adds the stable-2.2 and stable-3.0 branches

ceph-ansible-docs: adds the stable-2.2 and stable-3.0 branches

The stable-3.0 branch has not been created yet, but putting this in
place now will ensure we get docs built when it is.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #864 from ceph/docker-tests

ceph-docker-nightly: update scenarios

ceph-docker-nightly: update scenarios

There is no ceph_ansible2.3 factor, we shouldn't need to test kraken
anymore and luminous needed to be added.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #863 from ceph/ansible-dev-tests

ceph-ansible-prs: only run lvm_osd tests on ceph@master

ceph-ansible-prs: only run lvm_osd tests on ceph@master

These lvm_osd tests won't pass until 12.2.1 is released, but if we have
them use ceph@master then they should pass. After 12.2.1 is out we can
move these back to be a 'luminous' test.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #788 from ceph/improve_teardown

ceph-ansible-prs: improve teardown

ceph-ansible-prs: improve teardown

Delete with force any `fetch/` directories that could have been left after a
build.

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>

Merge pull request #862 from ceph/rm-bs-cluster

ceph-ansible-prs: remove bluestore_docker_cluster

ceph-ansible-prs: remove bluestore_docker_cluster

We don't need to bootstrap a full cluster to bootstrap bluestore. We
have individual scenarios for that.

Signed-off-by: Sébastien Han <seb@redhat.com>