use basedir to avoid overwriting the WORKSPACE

Signed-off-by: Alfredo Deza <adeza@redhat.com>

remove the need for REPO_CACHE and cloning in a script

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #99 from ceph/extra-repos

try to get multiple repos for ceph-deploy-pull-requests

Merge pull request #97 from ktdreyer/ceph-deploy-whitelist-updates

update user whitelist for ceph-deploy PRs

try to get multiple repos for ceph-deploy-pull-requests

Signed-off-by: Alfredo Deza <adeza@redhat.com>

teach how to generate a jessie version string

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #98 from ktdreyer/rm-green-balls-plugin

ansible: rm green balls plugin

ansible: rm green balls plugin

This plugin is not color-blind friendly. It is possible to turn it off
on a per-user setting, but that requires logging into Jenkins. Let's
just turn it off entirely so we're fully accessible for people who
aren't logged in.

update user whitelist for ceph-deploy PRs

These users have contributed patches to ceph-deploy. Whitelist their PRs
going forward so we don't have to manually approve testing each one.

mbroz: Milan Broz <mbroz@redhat.com>
ddiss: David Disseldorp <ddiss@suse.de>
osynge: Owen Synge <osynge@suse.com>

Merge pull request #96 from ktdreyer/add-ivotron-teuthology-prs

whitelist Ivo for teuthology PRs

whitelist Ivo for teuthology PRs

Ivo Jimenez <ivo.jimenez@gmail.com> is a Red Hat intern working on
teuthology. Whitelist his account so we don't have to manually approve
testing his PRs.

Merge pull request #95 from ktdreyer/rm-toplevel-jenkins-dir

rm top-level "jenkins" directory

rm top-level "jenkins" directory

Prior to the introduction of Jenkins Job Builder for configuring our
jobs, we stored each of Ceph's build instructions in a "jenkins"
directory. This was a first crude step towards versioning our build
instructions.

These "jenkins/*" scripts are no longer necessary because the JJB job
definitions contain the same steps (and these scripts are no longer
used). Clean them up.

Merge pull request #93 from ceph/master-ansible

initial work for a master jenkins role for centos

formatting for cli.yml

Signed-off-by: Alfredo Deza <adeza@redhat.com>

include ansible_managed on files

Signed-off-by: Alfredo Deza <adeza@redhat.com>

format nicely the args in cli.yml

Signed-off-by: Alfredo Deza <adeza@redhat.com>

after installing the dependencies start nginx

Signed-off-by: Alfredo Deza <adeza@redhat.com>

add a handler to restart nginx

Signed-off-by: Alfredo Deza <adeza@redhat.com>

epel is required for installing nginx

Signed-off-by: Alfredo Deza <adeza@redhat.com>

we require nginx to proxy jenkins

Signed-off-by: Alfredo Deza <adeza@redhat.com>

add the master playbook

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #94 from ceph/wip-teuthology-pr-setup

teuthology-pull-requests: pass the 'install' command to ./bootstrap

teuthology-pull-requests: pass the 'install' command to ./bootstrap

This is a flag used to tell the bootstrap script to install any missing
packages it finds needed for the bootstrap process.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

initial work for a master jenkins role

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #92 from ceph/wip-teuthology-pr-setup

teuthology-pull-requests: wipe workspace on each run

teuthology-pull-requests: wipe workspace on each run

If we don't do this pip breaks. See:

http://jenkins.ceph.com/job/teuthology-pull-requests/1560/console

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #91 from ceph/wip-teuthology-pr-setup

teuthology-pull-requests: run the teuthology bootstrap on setup

teuthology-pull-requests: run the teuthology bootstrap on setup

This will setup the jenkins slaves properly to successfully run the tox
tests on pull requests.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #90 from ktdreyer/ceph-setup-wipe-workspace

ceph-setup: wipe workspace

ceph-setup: wipe workspace

The ceph-setup task occasionally gets weird errors that can only be
fixed by wiping the workspace.

The latest example:

    tardir=ceph-0.94.1.3 && ${TAR-tar} chof - "$tardir" | GZIP=--best gzip -c >ceph-0.94.1.3.tar.gz
    tar: ceph-0.94.1.3/src/gmock/gtest/xcode/Samples/FrameworkSample/WidgetFramework.xcodeproj/project.pbxproj: file name is too long (max 99); not dumped
    tar: ceph-0.94.1.3/src/test/ubuntu-12.04/debian: File removed before we read it
    tar: ceph-0.94.1.3/src/test/ubuntu-14.04/debian: File removed before we read it
    tar: ceph-0.94.1.3/src/test/debian-jessie/debian: File removed before we read it
    tar: Exiting with failure status due to previous errors

... btw, <3 the comment in this job's description, "The clear workspace
before checkout box for the git plugin is used."

Signed-off-by: Ken Dreyer <kdreyer@redhat.com>

Merge pull request #89 from ktdreyer/prs-rm-cron

pull requests: rm "cron" settings

pull requests: rm "cron" settings

From the Jenkins GitHub Pull Requests plugin docs on "useGitHubHooks":

  Checking this option will disable regular polling (cron) for changes
  in GitHub and will try to create a GitHub hook. Creating a GitHub hook
  requires that the user which is specified in the GitHub Pull Request
  Builder configuration has admin rights to the specified repository.

Based on the documentation above, since our PR jobs have "github-hooks:
true", the "cron" values have no effect and can be removed.

Merge pull request #88 from ceph/slaves

push a work-in-progress for setting up slaves with ansible

push a work-in-progress for setting up slaves with ansible

Signed-off-by: Alfredo Deza <adeza@redhat.com>

use new item syntax

Signed-off-by: Alfredo Deza <adeza@redhat.com>

is update_cache not update-cache

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ignore if file exist when installing with pip from cache

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #87 from ceph/requirement-support

Requirement support

Reviewed-by: Ken Dreyer <kdreyer@redhat.com>
Reviewed-by: Travis Rhoden <trhoden@redhat.com>

configure the job so it uses the new setup for builds

Signed-off-by: Alfredo Deza <adeza@redhat.com>

rename build to setup script

Signed-off-by: Alfredo Deza <adeza@redhat.com>

initial take on supporting declarative requirements per job

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #86 from ceph/wip-trigger-phrase

teuthology-pull-requests: remove empty trigger-phrase

teuthology-pull-requests: remove empty trigger-phrase

This should be defaulted by the plugin and is unneeded here.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #85 from ceph/wip-teuthology-pr-testing

Ports the teuthology-pull-requests job to JJB

Ports the teuthology-pull-requests job to JJB

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #84 from ceph/cdep-deps

Install ceph-deploy dependencies.

use the new setup script in the config

Signed-off-by: Alfredo Deza <adeza@redhat.com>

create a setup script to install rpm deps

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #80 from ktdreyer/ceph-build-better-suse-detection

ceph-build: better SUSE detection

Merge pull request #82 from ceph/rm-386

remove wheezy i386 builds

remove wheezy i386 builds

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #81 from ceph/cd-dir

cd to $WORKSPACE

cd to $WORKSPACE

Otherwise we will fail to be in the right directory to copy the
artifacts

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ceph-build: better SUSE detection

As was done in 18890d5a0351ffe4fc495e0d47e3a86e0a9cb7ad for
radosgw-agent, update ceph-build's SUSE detection so we check for the
"zypper" file directly on-disk.

jjb: poll GitHub more slowly

I've enabled the "Jenkins (Git plugin)" service / hook. GitHub should
now send a signal to http://jenkins.ceph.com/git/notifyCommit that new
commits have been pushed to the repo.

Accordin to the documentation this allows us to poll more slowly (or not
at all, eventually?)

radosgw-agent: better SUSE detection

We might have mis-understood the use of "hash". "hash zypper" can return
nothing if zypper has never been run. Tested on
itbuilder-cdep-rpm-sles11sp2-amd64-basic.

Just test the presence of /usr/bin/zypper.

radosgw-agent: update RPM conditional for RHEL or SUSE

We want to check *either* RHEL *or* SUSE.

Prior to this change, neither system was succeeding builds.

radosgw-agent: fix rhel conditional

Commit b0d187aaf22eb01804a27ddf6688a1fca1f9f96a changed the OS-type
derivation logic from "based on hostname" to a heuristic based on the
files on the system itself.

The conditional for detecting RHEL was inverted. If we *do* have a
/etc/redhat-release file, we want to build RPMs. Update the conditional
to reflect this.

radosgw-agent: remove "date" command

No need to print the date out; this is recorded elsewhere in Jenkins.

skip-tag in all git scm jobs

It would be nice if this mis-feature was off by default :(

radosgw-agent: remove dependency on host naming scheme

Don't use the hostname to determine the type of OS or build (Deb/RPM) to
do.

Instead, determine the OS type using the same code that we're using in
ceph-build.

radosgw-agent: rm squeeze from matrix

In commit 57823f809a2fd1bfb7052cf5f7f82577580b5165 we removed squeeze
from the build matrix for simplicity. Do the same for radosgw-agent.

Merge pull request #79 from ktdreyer/rm-precise-dreamcompute

switch "precise" jobs to build on trusty

switch "precise" jobs to build on trusty

The DreamCompute builders (including the Precise builder) are no longer
available to us.

Switch the jobs that used the DreamCompute Precise builder to use the
trusty label instead.

Merge pull request #76 from ktdreyer/ceph-setup-rm-exit-code-checking

ceph-setup: rm exit code checking

ceph-setup: rm exit code checking

Now that we "set -e" in ceph-setup, we can drop the bits that check exit
codes "$?" throughout the ceph-setup task.

Merge pull request #78 from ceph/ceph-setup-fix

port release_tarballs.sh to ceph-setup/build/build

Merge pull request #77 from ceph/is-suse-fix

use -eq to really tell if this is suse

port release_tarballs.sh to ceph-setup/build/build

Signed-off-by: Alfredo Deza <adeza@redhat.com>

use -eq to really tell if this is suse

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #75 from ktdreyer/ceph-setup-shebang

ceph-setup: use bash, not sh

ceph-setup: use bash, not sh

/bin/sh is dash on Ubuntu/Debian. Switch to bash for uniformity with RPM
systems.

Merge pull request #74 from ceph/wip-fix-ceph-setup-script

Three fixes to ceph-setup/build/build:

Three fixes to ceph-setup/build/build:

1) invoke sh with -ex for verbosity and exit-on-error

2) fix syntax error with [] (missing space before ])

3) restore commented-out mv before dpkg-source -b.
I'm not sure why the copy copies to release/$vers and then
later moves to ceph-$vers, but something has to put it in
ceph-$vers.

Signed-off-by: Dan Mick <dan.mick@redhat.com>

Merge pull request #73 from ceph/use-bash

Use bash and set -e and -x

set -ex on setup

Signed-off-by: Alfredo Deza <adeza@redhat.com>

set -ex on build_rpm

Signed-off-by: Alfredo Deza <adeza@redhat.com>

set -ex on build_deb

Signed-off-by: Alfredo Deza <adeza@redhat.com>

use bin/bash in build_rpm

Signed-off-by: Alfredo Deza <adeza@redhat.com>

use bin/bash in build_deb

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #72 from ceph/suse-check

Suse check

check both redhat and suse, not OR

Signed-off-by: Alfredo Deza <adeza@redhat.com>

rename build1 to setup

Signed-off-by: Alfredo Deza <adeza@redhat.com>

do not extract verbosely from tar

Signed-off-by: Alfredo Deza <adeza@redhat.com>

treat suse as valid rpm distro

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #71 from ceph/rpm-fix

rpm script runs only in rpm systems

rpm script runs only in rpm systems

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #70 from ktdreyer/rm-ceph-build-build2

ceph-build: rm build2

ceph-build: rm build2

Commit ed6f67c4b2984ddc1623884500ac602df1557c44 removed this script from
the configuration. Delete it from the tree as well.

Merge pull request #69 from ceph/build-rpm

port the build_rpm scripts

include the build_rpm script in the config

Signed-off-by: Alfredo Deza <adeza@redhat.com>

remove the need for bindir to build rpms

Signed-off-by: Alfredo Deza <adeza@redhat.com>

port rpm scripts to build_rpm

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #68 from ceph/DIST

make setup_pbuilder use DIST

use sudo to create the buildir

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ensure that basedir exists for pbuilder images

Signed-off-by: Alfredo Deza <adeza@redhat.com>

make setup_pbuilder use \$DIST

So that it avoids building every distro on every server on
every build

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #67 from ceph/relabel

use the 'trusty' label

use the 'trusty' label

Signed-off-by: Alfredo Deza <adeza@redhat.com>