Only test using ansible 2.3

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #851 from ceph/shrink

ceph-ansible-prs: add shrink mon and osd scenario

ceph-ansible-prs: add shrink mon and osd scenario

Signed-off-by: Sébastien Han <seb@redhat.com>

Merge pull request #849 from ceph/add-switch-to-containers

ceph-ansible-prs: add switch_to_containers scenario

ceph-ansible-prs: add switch_to_containers scenario

The CI will now test migration from non-containerized to containerized
scenario.

Signed-off-by: Sébastien Han <seb@redhat.com>

Merge pull request #848 from ceph/wip-tcmu-runner

tcmu-runner: removed duplicate DIST axis

tcmu-runner: cleanup shaman.repo using bash trap

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

tcmu-runner: removed duplicate DIST axis

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #847 from ceph/wip-tcmu-runner

tcmu-runner: updated libtcmu package contents

tcmu-runner: updated libtcmu package contents

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #846 from ceph/wip-tcmu-runner

tcmu-runner: added missing distro release

tcmu-runner: added missing distro release

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #845 from ceph/wip-tcmu-runner

tcmu-runner: remove shaman repo file after build

tcmu-runner: remove shaman repo file after build

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #844 from ceph/wip-tcmu-runner

tcmu-runner: remove UAPI patch and add Ceph repo for build

tcmu-runner: remove UAPI patch and add Ceph repo for build

Signed-off-by: Jason Dillaman <dillaman@redhat.com>

Merge pull request #843 from ceph/wip-hudsonurl

ceph-docker: run flake8 and lint jobs on 2.jenkins

ceph-docker: just check if jenkins HUDSON_URL var is set

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #842 from ceph/disk-auto

ceph-ansible-prs: add disk autodiscovery scenario

ceph-ansible-prs: add disk autodiscovery scenario

Seconds https://github.com/ceph/ceph-ansible/pull/1803

Signed-off-by: Sébastien Han <seb@redhat.com>

Merge pull request #839 from ceph/wip-nfs-ganesha-stable

nfs-ganesha-stable: fixes to get build scripts working

Merge branch 'master' into wip-nfs-ganesha-stable

nfs-ganesha-stable: fixes to get build scripts working

-ntirpc scm wasn't applying properly
-clean up ntirpc directory
-various pbuilder related fixes
-directory ownership fix for creating local ntirpc repo

Signed-off-by: Ali Maredia <amaredia@redhat.com>

Merge pull request #841 from ktdreyer/readme-test

README: more context for what "jenkins-jobs test" does

README: more context for what "jenkins-jobs test" does

Give developers a hint about what to look for in the output of
"jenkins-jobs test".

Merge pull request #840 from ceph/ansible-pr-scenarios

ceph-ansible-prs: adds the lvm_osds and purge_lvm_osds scenarios

ceph-ansible-prs: adds the lvm_osds and purge_lvm_osds scenarios

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #825 from ceph/wip-jenkins-refactor

Updates to ansible-jenkins role

ansible: Manage Jenkins service defaults w/ ansible

Signed-off-by: David Galloway <dgallowa@redhat.com>

ansible: Add README for ansible-jenkins role

Signed-off-by: David Galloway <dgallowa@redhat.com>

ansible: jenkins-cli no longer deemed secure

Signed-off-by: David Galloway <dgallowa@redhat.com>

ansible: Add warning about restarting Jenkins to playbook

Signed-off-by: David Galloway <dgallowa@redhat.com>

ansible: Manage Jenkins auth with github-oauth

Signed-off-by: David Galloway <dgallowa@redhat.com>

ansible: Update Jenkins plugins tasks

 - Have to enable CLI to use jenkins-cli
 - Now compatible with ansible > v2

Signed-off-by: David Galloway <dgallowa@redhat.com>

ansible: Add ufw to jenkins masters

The jenkins-cli is used to initially configure the Jenkins service.  As
of recent versions, however, anonymous cli access isn't allowed unless
useSecurity is set to false in Jenkins' config.xml.  This opens Jenkins
to the world of course.

By creating some firewall rules, we can just disable nginx, turn of
auth, allow only localhost access to port 8080 and safely make changes using
jenkins-cli.

Signed-off-by: David Galloway <dgallowa@redhat.com>

ansible: Force jenkins nginx symlink

Signed-off-by: David Galloway <dgallowa@redhat.com>

ansible: Add letsencrypt support for jenkins master role

Signed-off-by: David Galloway <dgallowa@redhat.com>

ansible: Update jenkins nginx reverse proxy config

Signed-off-by: David Galloway <dgallowa@redhat.com>

ansible: Remove SSL stuff.  We'll do this with letsencrypt

Signed-off-by: David Galloway <dgallowa@redhat.com>

ansible: Unnecessary config for ssh user

Role assumes the jenkins_master target has been configured with the
ceph-sepia-secrets ansible_managed and common roles.  These roles create
a cm user and already set up TTY-less sudo access.

Signed-off-by: David Galloway <dgallowa@redhat.com>

ansible: Rename ansible-reserved port var to jenkins_port

Signed-off-by: David Galloway <dgallowa@redhat.com>

ansible: Refactor jenkins master role

- Spacing/tabs/syntax/quoting
- Updated for compatibility with ansible > v2
- Only support Ubuntu Xenial for now

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #836 from ceph/wip-docs-override

Build ceph-ansible docs on jenkins.ceph.com

Build ceph-ansible docs on jenkins.ceph.com

Because docs.ceph.com is a slave of jenkins.ceph.com

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #838 from ceph/wip-kernel-no-tags

kernel: do not fetch git tags

kernel: do not fetch git tags

After a recent jenkins/plugins update, jenkins started listing tags and
attempting git rev-parse ^{commit} on them:

  Seen branch in repository origin/wip-tighter-types
  Seen 39 remote branches
  > git tag -l # timeout=10
  > git rev-parse refs/tags/v4.7-rc7^{commit} # timeout=10
  > git rev-parse refs/tags/v2.6.30-rc7^{commit} # timeout=10

On the Linux kernel repo, this eventually fails with:

  > git rev-parse refs/tags/v2.6.11^{commit} # timeout=10
  FATAL: Command "git rev-parse refs/tags/v2.6.11^{commit}" returned status code 128:
  stdout: refs/tags/v2.6.11^{commit}
  stderr: error: refs/tags/v2.6.11^{commit}: expected commit type, but
  the object dereferences to tree type

Only "trigger" jobs seem to be affected, but we don't really need tags,
so don't fetch them for both kernel-trigger and kernel.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>

Merge pull request #837 from ceph/pr-docs-cython

ceph-pr-docs: install cython, remove python-sphinx

ceph-pr-docs: install cython, remove python-sphinx

cython is needed for generating docs from pyx docstrings and
python-sphinx is not needed because it is installed in a virtualenv by
the admin/build-doc script

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #812 from ceph/wip-nfs-ganesha-stable

nfs-ganesha-stable: add seperate libntirpc packages

nfs-ganesha-stable: debian builds using external ntirpc

- add option to switch nfs-ganesha-debian branch on
nfs-ganesha builds for shaman
- change build_debian to use an external ntirpc for
it's builds

Signed-off-by: Ali Maredia <amaredia@redhat.com>

Merge pull request #823 from ceph/wip-multimaster

Move ceph-ansible and ceph-docker builds to 2.jenkins.ceph.com

Move ceph-ansible and ceph-docker builds to 2.jenkins.ceph.com

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #835 from ceph/pr-docs-concurrent

ceph-pr-docs: make build concurrent

ceph-pr-docs: make build concurrent

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #834 from ceph/enforce-ceph-docs

Enforce ceph doc checks on all Ceph prs

ceph-pr-docs: always run on all Ceph prs, disable trigger-only phrase

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ceph-pr-docs: update the build script to build only, not publish

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ceph-pr-render-docs: create a new job to render html docs from PRs

This is needed because doc builds will now be enforced on all Ceph PRs
but unlike this 'render' job, those will just build, not publish the
HTML anywhere

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #833 from ceph/wip-version-cephmetrics

cephmetrics: Add support for versioning with git tags

cephmetrics: Add support for versioning with git tags

This will try to use git describe to get the current version and release
and fall back to the old method if HEAD is not part of any tag.

Signed-off-by: Boris Ranto <branto@redhat.com>

Merge pull request #832 from ceph/ceph-pr-docs-build-id

ceph-pr-docs: include the pull request ID for the url as a comment

ceph-pr-docs: include the pull request ID for the url as a comment

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #831 from ceph/ceph-docs-pr

Ceph docs for prs on docs.ceph.com

ceph-pr-docs: remove htmlplublisher section, no longer needed

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ceph-pr-docs: use the docs server

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ceph-pr-docs: assume running on the docs node

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #830 from ceph/wip-nfs-ganesha

nfs-ganesha: fix timer

nfs-ganesha: fix timer

Signed-off-by: Ali Maredia <amaredia@redhat.com>

Merge pull request #809 from ceph/ceph-volume-fixes

Ceph volume fixes for PRs

ceph-volume-ansible-prs: use the ghprb plugin's vars first, fallback to regular git afterwards

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ceph-volume-pr: define only the sha1 of pull requests so that it doesn't build everything

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ceph-volume-pr: do not try to use py36, only flake8, 2.7, and 3.5

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #828 from ceph/ceph-ansible-nightly

ceph-ansible-nightly: run tests against jewel and ansible2.2 and 2.3

ceph-ansible-nightly: run tests against jewel and ansible2.2 and 2.3

These tests are scheduled to be run automatically by jenkins daily. They can
also be triggered manually and given a branch of ceph-ansible to test
against.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #826 from ceph/wip-lab-cop

adds a tool to check node usage in the labs

remove branches since there are no triggers

Signed-off-by: Gregory Meno <gmeno@redhat.com>

adds a tool to check node usage in the labs

Signed-off-by: Gregory Meno <gmeno@redhat.com>

Merge pull request #827 from ceph/ansible2.3-testing

ceph-ansible-prs: test against ansible2.3 and luminous only

ceph-ansible-prs: test against ansible2.3 and luminous only

This drops support for testing jewel on PRs and changes the ansible
version to 2.3. If we want to continue testing against jewel we can
schedule nightly tests that run against master. With this approach we
can still get the same coverage and reduce a lot of demand on the CI
caused by PR testing.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #824 from ceph/ceph-volume-ansible-git-branch

ceph-volume-ansible-prs: fallback on sha1 to get remote branch

ceph-volume-ansible-prs: fallback on sha1 to get remote branch

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #822 from ceph/ceph-volume-pr-fixes

Ceph volume pr fixes

ceph-volume-ansible-prs: improve the build script for remote branch detection

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ceph-volume-ansible-prs: fix scm section to point to ceph.git

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #821 from ceph/ceph-volume-ansible-prs

ceph-volume-ansible-prs: do not use raw xml, use the jjb option for ghprb

ceph-volume-ansible-prs: do not use raw xml, use the jjb option for ghprb

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #820 from ceph/ceph-volume-ansible-prs

ceph-volume-ansible-prs: create job template(s)

ceph-volume-ansible-prs: create job template(s)

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #819 from ceph/wip-cancel

Abort build on updated PR

Pin jenkins-job-builder to beta version for now

Allows us to use github-pull-request cancel-builds-on-update option

Signed-off-by: David Galloway <dgallowa@redhat.com>

Use new cancel-builds-on-update parameter

Need to update/pin JJB to the beta >2.0.0 for now

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #818 from ceph/abort_on_updated_PR

Abort on updated pr

Add CancelOnUpdate option in raw/xml format

The option `cancel-builds-on-update` doesn't work in job template
because we are not using a recent version of JJB, therefore we had to
revert the previous commit.

This commit adds the cancel-builds-on-update option but in raw/xml
format instead.

Fixes: #817
Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>

Revert "Abort builds on update"

This reverts commit 18a1bbc24552ca0466500b6121818292e645f41b.

Merge pull request #816 from ceph/wip-lockfiles

scripts: Don't sync any lockfiles leftover by reprepro

scripts: Don't sync any lockfiles leftover by reprepro

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #815 from ceph/revert-813-naginator

Revert "ceph-ansible-prs: add naginator configuration"

Revert "ceph-ansible-prs: add naginator configuration"

Merge pull request #814 from ceph/reset-workspace

ceph-ansible-scenario: wipe the workspace before each job

ceph-ansible-scenario: wipe the workspace before each job

In testing I noticed that without this set sometimes the latest sha1 from the
ceph-ansible branch wasn't fetched if the jenkins slave had already been
used for this job.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>