ceph-pr-docs: install cython, remove python-sphinx

cython is needed for generating docs from pyx docstrings and
python-sphinx is not needed because it is installed in a virtualenv by
the admin/build-doc script

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #812 from ceph/wip-nfs-ganesha-stable

nfs-ganesha-stable: add seperate libntirpc packages

nfs-ganesha-stable: debian builds using external ntirpc

- add option to switch nfs-ganesha-debian branch on
nfs-ganesha builds for shaman
- change build_debian to use an external ntirpc for
it's builds

Signed-off-by: Ali Maredia <amaredia@redhat.com>

Merge pull request #823 from ceph/wip-multimaster

Move ceph-ansible and ceph-docker builds to 2.jenkins.ceph.com

Move ceph-ansible and ceph-docker builds to 2.jenkins.ceph.com

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #835 from ceph/pr-docs-concurrent

ceph-pr-docs: make build concurrent

ceph-pr-docs: make build concurrent

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #834 from ceph/enforce-ceph-docs

Enforce ceph doc checks on all Ceph prs

ceph-pr-docs: always run on all Ceph prs, disable trigger-only phrase

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ceph-pr-docs: update the build script to build only, not publish

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ceph-pr-render-docs: create a new job to render html docs from PRs

This is needed because doc builds will now be enforced on all Ceph PRs
but unlike this 'render' job, those will just build, not publish the
HTML anywhere

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #833 from ceph/wip-version-cephmetrics

cephmetrics: Add support for versioning with git tags

cephmetrics: Add support for versioning with git tags

This will try to use git describe to get the current version and release
and fall back to the old method if HEAD is not part of any tag.

Signed-off-by: Boris Ranto <branto@redhat.com>

Merge pull request #832 from ceph/ceph-pr-docs-build-id

ceph-pr-docs: include the pull request ID for the url as a comment

ceph-pr-docs: include the pull request ID for the url as a comment

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #831 from ceph/ceph-docs-pr

Ceph docs for prs on docs.ceph.com

ceph-pr-docs: remove htmlplublisher section, no longer needed

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ceph-pr-docs: use the docs server

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ceph-pr-docs: assume running on the docs node

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #830 from ceph/wip-nfs-ganesha

nfs-ganesha: fix timer

nfs-ganesha: fix timer

Signed-off-by: Ali Maredia <amaredia@redhat.com>

Merge pull request #809 from ceph/ceph-volume-fixes

Ceph volume fixes for PRs

ceph-volume-ansible-prs: use the ghprb plugin's vars first, fallback to regular git afterwards

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ceph-volume-pr: define only the sha1 of pull requests so that it doesn't build everything

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ceph-volume-pr: do not try to use py36, only flake8, 2.7, and 3.5

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #828 from ceph/ceph-ansible-nightly

ceph-ansible-nightly: run tests against jewel and ansible2.2 and 2.3

ceph-ansible-nightly: run tests against jewel and ansible2.2 and 2.3

These tests are scheduled to be run automatically by jenkins daily. They can
also be triggered manually and given a branch of ceph-ansible to test
against.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #826 from ceph/wip-lab-cop

adds a tool to check node usage in the labs

remove branches since there are no triggers

Signed-off-by: Gregory Meno <gmeno@redhat.com>

adds a tool to check node usage in the labs

Signed-off-by: Gregory Meno <gmeno@redhat.com>

Merge pull request #827 from ceph/ansible2.3-testing

ceph-ansible-prs: test against ansible2.3 and luminous only

ceph-ansible-prs: test against ansible2.3 and luminous only

This drops support for testing jewel on PRs and changes the ansible
version to 2.3. If we want to continue testing against jewel we can
schedule nightly tests that run against master. With this approach we
can still get the same coverage and reduce a lot of demand on the CI
caused by PR testing.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #824 from ceph/ceph-volume-ansible-git-branch

ceph-volume-ansible-prs: fallback on sha1 to get remote branch

ceph-volume-ansible-prs: fallback on sha1 to get remote branch

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #822 from ceph/ceph-volume-pr-fixes

Ceph volume pr fixes

ceph-volume-ansible-prs: improve the build script for remote branch detection

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ceph-volume-ansible-prs: fix scm section to point to ceph.git

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #821 from ceph/ceph-volume-ansible-prs

ceph-volume-ansible-prs: do not use raw xml, use the jjb option for ghprb

ceph-volume-ansible-prs: do not use raw xml, use the jjb option for ghprb

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #820 from ceph/ceph-volume-ansible-prs

ceph-volume-ansible-prs: create job template(s)

ceph-volume-ansible-prs: create job template(s)

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #819 from ceph/wip-cancel

Abort build on updated PR

Pin jenkins-job-builder to beta version for now

Allows us to use github-pull-request cancel-builds-on-update option

Signed-off-by: David Galloway <dgallowa@redhat.com>

Use new cancel-builds-on-update parameter

Need to update/pin JJB to the beta >2.0.0 for now

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #818 from ceph/abort_on_updated_PR

Abort on updated pr

Add CancelOnUpdate option in raw/xml format

The option `cancel-builds-on-update` doesn't work in job template
because we are not using a recent version of JJB, therefore we had to
revert the previous commit.

This commit adds the cancel-builds-on-update option but in raw/xml
format instead.

Fixes: #817
Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>

Revert "Abort builds on update"

This reverts commit 18a1bbc24552ca0466500b6121818292e645f41b.

Merge pull request #816 from ceph/wip-lockfiles

scripts: Don't sync any lockfiles leftover by reprepro

scripts: Don't sync any lockfiles leftover by reprepro

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #815 from ceph/revert-813-naginator

Revert "ceph-ansible-prs: add naginator configuration"

Revert "ceph-ansible-prs: add naginator configuration"

Merge pull request #814 from ceph/reset-workspace

ceph-ansible-scenario: wipe the workspace before each job

ceph-ansible-scenario: wipe the workspace before each job

In testing I noticed that without this set sometimes the latest sha1 from the
ceph-ansible branch wasn't fetched if the jenkins slave had already been
used for this job.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #813 from ceph/naginator

ceph-ansible-prs: add naginator configuration

ceph-docker-prs: add naginator configuration

Auto-restart failed builds 3 times with 60 seconds interval.

Signed-off-by: Sébastien Han <seb@redhat.com>

ceph-ansible-prs: add naginator configuration

Auto-restart failed builds 3 times with 60 seconds interval.

Signed-off-by: Sébastien Han <seb@redhat.com>

Merge pull request #811 from ceph/ceph-pr-docs-fixes

ceph-pr-docs: only get triggered on prs

ceph-pr-docs: only get triggered on prs

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #810 from ceph/rm-ceph-volume-docs

ceph-volume-docs: removal

ceph-volume-docs: removal

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #808 from ceph/wip-chacra-pull-requests-repo-cleanup

chcacra-pull-requests: cleanup repos before ansible runs

chcacra-pull-requests: cleanup repos before ansible runs

Signed-off-by: Ali Maredia <amaredia@redhat.com>

Merge pull request #807 from ceph/wip-disable-nfs-ganesha

nfs-ganesha: build only twice a day, change nfs-ganesha-debian branch

Merge branch 'master' into wip-disable-nfs-ganesha

nfs-ganesha: build only twice a day, change nfs-ganesha-debian branch

Also removed commened out triggers code for
nfs-ganesha and samba

Signed-off-by: Ali Maredia <amaredia@redhat.com>

Merge pull request #801 from ceph/wip-qa-skip-build

Add option to skip build for qa scripts/yaml changes

Add option to skip build for qa/doc changes

Signed-off-by: Vasu Kulkarni <vasu@redhat.com>

Add option to skip build for qa tests/yaml changes

Signed-off-by: Vasu Kulkarni <vasu@redhat.com>

Merge pull request #806 from ceph/ceph-volume-fixes

ceph-volume-pr: only get triggered on phrases

ceph-volume-pr: only get triggered on phrases

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #805 from ceph/ceph-volume-prs

ceph-volume-pr: create a job for manual triggering of ceph-volume tox runs

ceph-volume-pr: create a job for manual triggering of ceph-volume tox runs

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #804 from ceph/abort_on_updated_PR

Abort builds on update

Abort builds on update

When a PR is updated, jobs that were launched by the previous PR are not
aborted. It can even happen that you update a PR several times in a
short time. So it's n*x jenkins slave locked until they end.

Adding `cancel-builds-on-update` to the jobs templates force the job to be
aborted to free a jenkins slave quicker.

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>

Merge pull request #803 from ceph/wip-ceph-iscsi-config

ceph-iscsi: added builder for ceph-iscsi-tools

ceph-iscsi: added builder for ceph-iscsi-tools

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #802 from ceph/wip-ceph-iscsi-config

ceph-iscsi: fixed chacra rpm path

ceph-iscsi: fixed chacra rpm path

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #800 from ceph/wip-ceph-iscsi-config

ceph-iscsi-config: alternate attempt to build source tarball

ceph-iscsi: alternate attempt to build source tarball

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #799 from ceph/wip-ceph-iscsi-config

ceph-iscsi: additional jenkins tweaks

ceph-iscsi-cli: initial build scripts

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

ceph-iscsi-*: added triggers for remaining ceph-iscsi repos

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #798 from ceph/wip-ceph-iscsi-config

ceph-iscsi-ansible: fix mock chroot name

ceph-iscsi-ansible: fix mock chroot name

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #797 from ceph/wip-ceph-iscsi-config

ceph-iscsi-config: additional RPM build fixes

ceph-iscsi-config: additional RPM build fixes

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #794 from ceph/switch_to_yakkety

ceph-ansible-prs: Change group for jenkins_user

ceph-ansible-prs: Change group for jenkins_user

Required to switch to Ubuntu 16.10.
The group `libvirtd` seems to have been renamed to `libvirt`.

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>

Merge pull request #796 from ceph/wip-ceph-iscsi-config

ceph-iscsi-config: corrected sed replacements

ceph-iscsi-config: corrected sed replacements

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #795 from ceph/wip-ceph-iscsi-config

ceph-iscsi-config: initial rpm package testing

ceph-iscsi-config: initial rpm package testing

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #793 from ceph/dev-testing

ceph-ansible-scenario: adds the CEPH_DEV_BRANCH and CEPH_DEV_SHA1 params

ceph-ansible-scenario: adds the CEPH_DEV_BRANCH and CEPH_DEV_SHA1 params

With these parameters, if you are using a dev-* testing scenario, you can
control which ceph branch and sha1 is deployed and tested.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #792 from ceph/shaman-apt-fix

Shaman apt fix

shaman-pull-requests: update to postgresql 9.5

Signed-off-by: Alfredo Deza <adeza@redhat.com>

shaman-pull-requests: use become: true in playbooks

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #791 from ceph/no-patched-jenkins

ansible: use python-jenkins 0.4.15

ansible: use python-jenkins 0.4.15

This upstream version has support for creating nodes with "+" in the
names.

I don't feel great about continuing to pin to an exact version, but
let's take the short-term defensive route for now.