Merge pull request #113 from ktdreyer/wip-ice-setup

import ice-setup

import ice-setup

Migrate the ice-setup job from our internal jenkins-calamari server to
jenkins.ceph.com.

Merge pull request #112 from ceph/rm-i386

remove i386 from ceph-build

remove i386 from ceph-build

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #111 from ceph/cdep-rm-nodes

remove sles and suse from the builders list

remove sles and suse from the builders list

Signed-off-by: Alfredo Deza <adeza@redhat.com>

slap the hosts IP to the name when registering them in Jenkins

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #110 from ktdreyer/jjb-github-trigger

jjb: accept change notifications from GitHub

jjb: accept change notifications from GitHub

In commit fac5ec4127ac1178b40ce0bd8bd176af355aadce I slowed down the Git
SCM polling for the JJB management job, with the reasoning that the
GitHub webhook would be a more responsive and efficient method of
triggering builds.

However, this was not entirely sufficient because the JJB job itself
must also be explicitly configured to accept the GitHub webhook
notifications.

Add "github" to the list of triggers for the JJB job. (This setting
corresponds to the "Build when a change is pushed to GitHub" checkbox in
Jenkins web UI.)

jjb: use randomized time in cron

It doesn't matter whether we run at the top of the hour, or at any time
close to there. Use the recommended "H" setting.

ceph-setup: handle install-deps.sh absence

Prior to this commit, if Jenkins could not find ./install-deps.sh in the
tree, the ceph-setup task would fail.

Older versions of Ceph (such as ceph-0.80.8.x) have no install-deps.sh
script. In these cases, simply continue on with the build.

Merge pull request #109 from ceph/is-tar

check if we have valid tars for pbuilder

check if we have valid tars for pbuilder

Signed-off-by: Alfredo Deza <adeza@redhat.com>

fix incorrect name for sudoing without prompt

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #107 from ceph/ceph-setup-unpin

Ceph setup unpin

comment the current pinning of the job to trusty

Signed-off-by: Alfredo Deza <adeza@redhat.com>

install-deps.sh should run before configure as it checks deps

Signed-off-by: Alfredo Deza <adeza@redhat.com>

more dependencies needed for deb slaves

Signed-off-by: Alfredo Deza <adeza@redhat.com>

remove backrefs from sudoers change

Signed-off-by: Alfredo Deza <adeza@redhat.com>

more build tools that need to be installed

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ensure six is updated and libtool is installed

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #106 from ceph/rm-bindir

remove references/tests for bindir

remove references/tests for bindir

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ensure that the owner of the build dir can write to it

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ensure device is mounted, not only present

Signed-off-by: Alfredo Deza <adeza@redhat.com>

use ext3 and force and overwrite

Signed-off-by: Alfredo Deza <adeza@redhat.com>

fix wrong variable references

Signed-off-by: Alfredo Deza <adeza@redhat.com>

note the formatting is very environment specific

Signed-off-by: Alfredo Deza <adeza@redhat.com>

format and mount the ephemeral filesystem

Signed-off-by: Alfredo Deza <adeza@redhat.com>

bring parity for slave playbook

Signed-off-by: Alfredo Deza <adeza@redhat.com>

create the template for slaves

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #105 from ceph/sudo-cdp

remove quotes on yum install

Reviewed-by: Travis Rhoden <trhoden@redhat.com>

remove quotes on yum install

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #104 from ceph/sudo-cdp

fix lack of SUDO in ceph-deploy setup script

Reviewed-by: Travis Rhoden <trhoden@redhat.com>

fix lack of SUDO in ceph-deploy setup script

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #102 from tchaikov/wip-fix-jessie

add jessie to deb_dists

add jessie to deb_dists

to add definition of jessie to conf/distributions so reprepro is
able to include the jessie packages.

Signed-off-by: Kefu Chai <kchai@redhat.com>

Merge pull request #101 from ceph/master-ansible

master and slave roles for jenkins

slave files should be at the top

Signed-off-by: Alfredo Deza <adeza@redhat.com>

move the ansible-jenkins to the roles dir

Signed-off-by: Alfredo Deza <adeza@redhat.com>

move the playbook files to the top dir

Signed-off-by: Alfredo Deza <adeza@redhat.com>

add the jenkins-build public key

Signed-off-by: Alfredo Deza <adeza@redhat.com>

document the init yml file

Signed-off-by: Alfredo Deza <adeza@redhat.com>

use lineinfile to get jenkins-build permissions

Signed-off-by: Alfredo Deza <adeza@redhat.com>

move the init module to the top level

Signed-off-by: Alfredo Deza <adeza@redhat.com>

normalize in lower case for triggering handlers

Signed-off-by: Alfredo Deza <adeza@redhat.com>

include nginx module when setting up jenkins

Signed-off-by: Alfredo Deza <adeza@redhat.com>

enabling nginx means started, not restarted

Signed-off-by: Alfredo Deza <adeza@redhat.com>

create the jenkins-build user

Signed-off-by: Alfredo Deza <adeza@redhat.com>

add github oauth plugin

Signed-off-by: Alfredo Deza <adeza@redhat.com>

install jdk and git in slaves

Signed-off-by: Alfredo Deza <adeza@redhat.com>

remove cli.yml - ported to config.yml

Signed-off-by: Alfredo Deza <adeza@redhat.com>

move cli.yml into config.yml

Signed-off-by: Alfredo Deza <adeza@redhat.com>

add a task for nginx

Signed-off-by: Alfredo Deza <adeza@redhat.com>

add the handlers to bounce nginx

Signed-off-by: Alfredo Deza <adeza@redhat.com>

templates for nginx

Signed-off-by: Alfredo Deza <adeza@redhat.com>

fix xml errors in jenkins job builder xml

Signed-off-by: Alfredo Deza <adeza@redhat.com>

use a non standard port for master.yml

Signed-off-by: Alfredo Deza <adeza@redhat.com>

create an init.yml for initial setup of a public master

Signed-off-by: Alfredo Deza <adeza@redhat.com>

define the default location for jobs

Signed-off-by: Alfredo Deza <adeza@redhat.com>

add ansible_managed to the jjb config file

Signed-off-by: Alfredo Deza <adeza@redhat.com>

add the one job we need for the master: jenkins-job-builder

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #100 from ceph/basedir

fix some issues with `$WORKSPACE` being overwritten

use basedir to avoid overwriting the WORKSPACE

Signed-off-by: Alfredo Deza <adeza@redhat.com>

remove the need for REPO_CACHE and cloning in a script

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #99 from ceph/extra-repos

try to get multiple repos for ceph-deploy-pull-requests

Merge pull request #97 from ktdreyer/ceph-deploy-whitelist-updates

update user whitelist for ceph-deploy PRs

try to get multiple repos for ceph-deploy-pull-requests

Signed-off-by: Alfredo Deza <adeza@redhat.com>

teach how to generate a jessie version string

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #98 from ktdreyer/rm-green-balls-plugin

ansible: rm green balls plugin

ansible: rm green balls plugin

This plugin is not color-blind friendly. It is possible to turn it off
on a per-user setting, but that requires logging into Jenkins. Let's
just turn it off entirely so we're fully accessible for people who
aren't logged in.

update user whitelist for ceph-deploy PRs

These users have contributed patches to ceph-deploy. Whitelist their PRs
going forward so we don't have to manually approve testing each one.

mbroz: Milan Broz <mbroz@redhat.com>
ddiss: David Disseldorp <ddiss@suse.de>
osynge: Owen Synge <osynge@suse.com>

Merge pull request #96 from ktdreyer/add-ivotron-teuthology-prs

whitelist Ivo for teuthology PRs

whitelist Ivo for teuthology PRs

Ivo Jimenez <ivo.jimenez@gmail.com> is a Red Hat intern working on
teuthology. Whitelist his account so we don't have to manually approve
testing his PRs.

Merge pull request #95 from ktdreyer/rm-toplevel-jenkins-dir

rm top-level "jenkins" directory

rm top-level "jenkins" directory

Prior to the introduction of Jenkins Job Builder for configuring our
jobs, we stored each of Ceph's build instructions in a "jenkins"
directory. This was a first crude step towards versioning our build
instructions.

These "jenkins/*" scripts are no longer necessary because the JJB job
definitions contain the same steps (and these scripts are no longer
used). Clean them up.

Merge pull request #93 from ceph/master-ansible

initial work for a master jenkins role for centos

formatting for cli.yml

Signed-off-by: Alfredo Deza <adeza@redhat.com>

include ansible_managed on files

Signed-off-by: Alfredo Deza <adeza@redhat.com>

format nicely the args in cli.yml

Signed-off-by: Alfredo Deza <adeza@redhat.com>

after installing the dependencies start nginx

Signed-off-by: Alfredo Deza <adeza@redhat.com>

add a handler to restart nginx

Signed-off-by: Alfredo Deza <adeza@redhat.com>

epel is required for installing nginx

Signed-off-by: Alfredo Deza <adeza@redhat.com>

we require nginx to proxy jenkins

Signed-off-by: Alfredo Deza <adeza@redhat.com>

add the master playbook

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #94 from ceph/wip-teuthology-pr-setup

teuthology-pull-requests: pass the 'install' command to ./bootstrap

teuthology-pull-requests: pass the 'install' command to ./bootstrap

This is a flag used to tell the bootstrap script to install any missing
packages it finds needed for the bootstrap process.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

initial work for a master jenkins role

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #92 from ceph/wip-teuthology-pr-setup

teuthology-pull-requests: wipe workspace on each run

teuthology-pull-requests: wipe workspace on each run

If we don't do this pip breaks. See:

http://jenkins.ceph.com/job/teuthology-pull-requests/1560/console

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #91 from ceph/wip-teuthology-pr-setup

teuthology-pull-requests: run the teuthology bootstrap on setup

teuthology-pull-requests: run the teuthology bootstrap on setup

This will setup the jenkins slaves properly to successfully run the tox
tests on pull requests.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #90 from ktdreyer/ceph-setup-wipe-workspace

ceph-setup: wipe workspace

ceph-setup: wipe workspace

The ceph-setup task occasionally gets weird errors that can only be
fixed by wiping the workspace.

The latest example:

    tardir=ceph-0.94.1.3 && ${TAR-tar} chof - "$tardir" | GZIP=--best gzip -c >ceph-0.94.1.3.tar.gz
    tar: ceph-0.94.1.3/src/gmock/gtest/xcode/Samples/FrameworkSample/WidgetFramework.xcodeproj/project.pbxproj: file name is too long (max 99); not dumped
    tar: ceph-0.94.1.3/src/test/ubuntu-12.04/debian: File removed before we read it
    tar: ceph-0.94.1.3/src/test/ubuntu-14.04/debian: File removed before we read it
    tar: ceph-0.94.1.3/src/test/debian-jessie/debian: File removed before we read it
    tar: Exiting with failure status due to previous errors

... btw, <3 the comment in this job's description, "The clear workspace
before checkout box for the git plugin is used."

Signed-off-by: Ken Dreyer <kdreyer@redhat.com>

Merge pull request #89 from ktdreyer/prs-rm-cron

pull requests: rm "cron" settings

pull requests: rm "cron" settings

From the Jenkins GitHub Pull Requests plugin docs on "useGitHubHooks":

  Checking this option will disable regular polling (cron) for changes
  in GitHub and will try to create a GitHub hook. Creating a GitHub hook
  requires that the user which is specified in the GitHub Pull Request
  Builder configuration has admin rights to the specified repository.

Based on the documentation above, since our PR jobs have "github-hooks:
true", the "cron" values have no effect and can be removed.

Merge pull request #88 from ceph/slaves

push a work-in-progress for setting up slaves with ansible

push a work-in-progress for setting up slaves with ansible

Signed-off-by: Alfredo Deza <adeza@redhat.com>

use new item syntax

Signed-off-by: Alfredo Deza <adeza@redhat.com>

is update_cache not update-cache

Signed-off-by: Alfredo Deza <adeza@redhat.com>