ceph-build: better SUSE detection

As was done in 18890d5a0351ffe4fc495e0d47e3a86e0a9cb7ad for
radosgw-agent, update ceph-build's SUSE detection so we check for the
"zypper" file directly on-disk.

jjb: poll GitHub more slowly

I've enabled the "Jenkins (Git plugin)" service / hook. GitHub should
now send a signal to http://jenkins.ceph.com/git/notifyCommit that new
commits have been pushed to the repo.

Accordin to the documentation this allows us to poll more slowly (or not
at all, eventually?)

radosgw-agent: better SUSE detection

We might have mis-understood the use of "hash". "hash zypper" can return
nothing if zypper has never been run. Tested on
itbuilder-cdep-rpm-sles11sp2-amd64-basic.

Just test the presence of /usr/bin/zypper.

radosgw-agent: update RPM conditional for RHEL or SUSE

We want to check *either* RHEL *or* SUSE.

Prior to this change, neither system was succeeding builds.

radosgw-agent: fix rhel conditional

Commit b0d187aaf22eb01804a27ddf6688a1fca1f9f96a changed the OS-type
derivation logic from "based on hostname" to a heuristic based on the
files on the system itself.

The conditional for detecting RHEL was inverted. If we *do* have a
/etc/redhat-release file, we want to build RPMs. Update the conditional
to reflect this.

radosgw-agent: remove "date" command

No need to print the date out; this is recorded elsewhere in Jenkins.

skip-tag in all git scm jobs

It would be nice if this mis-feature was off by default :(

radosgw-agent: remove dependency on host naming scheme

Don't use the hostname to determine the type of OS or build (Deb/RPM) to
do.

Instead, determine the OS type using the same code that we're using in
ceph-build.

radosgw-agent: rm squeeze from matrix

In commit 57823f809a2fd1bfb7052cf5f7f82577580b5165 we removed squeeze
from the build matrix for simplicity. Do the same for radosgw-agent.

Merge pull request #79 from ktdreyer/rm-precise-dreamcompute

switch "precise" jobs to build on trusty

switch "precise" jobs to build on trusty

The DreamCompute builders (including the Precise builder) are no longer
available to us.

Switch the jobs that used the DreamCompute Precise builder to use the
trusty label instead.

Merge pull request #76 from ktdreyer/ceph-setup-rm-exit-code-checking

ceph-setup: rm exit code checking

ceph-setup: rm exit code checking

Now that we "set -e" in ceph-setup, we can drop the bits that check exit
codes "$?" throughout the ceph-setup task.

Merge pull request #78 from ceph/ceph-setup-fix

port release_tarballs.sh to ceph-setup/build/build

Merge pull request #77 from ceph/is-suse-fix

use -eq to really tell if this is suse

port release_tarballs.sh to ceph-setup/build/build

Signed-off-by: Alfredo Deza <adeza@redhat.com>

use -eq to really tell if this is suse

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #75 from ktdreyer/ceph-setup-shebang

ceph-setup: use bash, not sh

ceph-setup: use bash, not sh

/bin/sh is dash on Ubuntu/Debian. Switch to bash for uniformity with RPM
systems.

Merge pull request #74 from ceph/wip-fix-ceph-setup-script

Three fixes to ceph-setup/build/build:

Three fixes to ceph-setup/build/build:

1) invoke sh with -ex for verbosity and exit-on-error

2) fix syntax error with [] (missing space before ])

3) restore commented-out mv before dpkg-source -b.
I'm not sure why the copy copies to release/$vers and then
later moves to ceph-$vers, but something has to put it in
ceph-$vers.

Signed-off-by: Dan Mick <dan.mick@redhat.com>

Merge pull request #73 from ceph/use-bash

Use bash and set -e and -x

set -ex on setup

Signed-off-by: Alfredo Deza <adeza@redhat.com>

set -ex on build_rpm

Signed-off-by: Alfredo Deza <adeza@redhat.com>

set -ex on build_deb

Signed-off-by: Alfredo Deza <adeza@redhat.com>

use bin/bash in build_rpm

Signed-off-by: Alfredo Deza <adeza@redhat.com>

use bin/bash in build_deb

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #72 from ceph/suse-check

Suse check

check both redhat and suse, not OR

Signed-off-by: Alfredo Deza <adeza@redhat.com>

rename build1 to setup

Signed-off-by: Alfredo Deza <adeza@redhat.com>

do not extract verbosely from tar

Signed-off-by: Alfredo Deza <adeza@redhat.com>

treat suse as valid rpm distro

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #71 from ceph/rpm-fix

rpm script runs only in rpm systems

rpm script runs only in rpm systems

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #70 from ktdreyer/rm-ceph-build-build2

ceph-build: rm build2

ceph-build: rm build2

Commit ed6f67c4b2984ddc1623884500ac602df1557c44 removed this script from
the configuration. Delete it from the tree as well.

Merge pull request #69 from ceph/build-rpm

port the build_rpm scripts

include the build_rpm script in the config

Signed-off-by: Alfredo Deza <adeza@redhat.com>

remove the need for bindir to build rpms

Signed-off-by: Alfredo Deza <adeza@redhat.com>

port rpm scripts to build_rpm

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #68 from ceph/DIST

make setup_pbuilder use DIST

use sudo to create the buildir

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ensure that basedir exists for pbuilder images

Signed-off-by: Alfredo Deza <adeza@redhat.com>

make setup_pbuilder use \$DIST

So that it avoids building every distro on every server on
every build

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #67 from ceph/relabel

use the 'trusty' label

use the 'trusty' label

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #66 from ceph/backtick-fix

use $DIST properly

This fixes a few issues:

- a variable that was not set properly because of backticks
- use of $DIST, replacing the hard-coded $dists
- removes hardcoded DEBEMAIL

remove hardcoded DEBEMAIL

Signed-off-by: Alfredo Deza <adeza@redhat.com>

use the Jenkins  variable

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #65 from ceph/rm-raring

remove raring from pbuilder setup

comment that this dists list needs to be fixed

Signed-off-by: Alfredo Deza <adeza@redhat.com>

remove other distros we don't build too

Signed-off-by: Alfredo Deza <adeza@redhat.com>

remove raring from pbuilder setup

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #64 from ceph/sudo-fix

Sudo fix

add sudo for pbuilder in build_deb

Signed-off-by: Alfredo Deza <adeza@redhat.com>

pbuilder needs to be called with sudo

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #63 from ceph/debian-setup

Debian setup

point out the filename where the contents were extracted

Signed-off-by: Alfredo Deza <adeza@redhat.com>

use the new build_deb in the config

Signed-off-by: Alfredo Deza <adeza@redhat.com>

remove bindir! no more /src/ceph-build to build debs

Signed-off-by: Alfredo Deza <adeza@redhat.com>

port gen_debian_version into build_deb

Signed-off-by: Alfredo Deza <adeza@redhat.com>

build_debs.sh now lives in build_deb

Signed-off-by: Alfredo Deza <adeza@redhat.com>

get rid of rpm stuff in build_deb

Signed-off-by: Alfredo Deza <adeza@redhat.com>

create a build_deb build script

Signed-off-by: Alfredo Deza <adeza@redhat.com>

place the pbuilder setup script before the actual build step

Signed-off-by: Alfredo Deza <adeza@redhat.com>

remove the check for /srv/debian-base

Because we are now ensuring this will exist in a previous build
step.

Signed-off-by: Alfredo Deza <adeza@redhat.com>

name the file setup_pbuilder to reflect what it actually does

Signed-off-by: Alfredo Deza <adeza@redhat.com>

only run on debian hosts

Signed-off-by: Alfredo Deza <adeza@redhat.com>

build pbuilders without calling other scripts

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #62 from ceph/cdep-trusty

add trusty to list of deb distros

add trusty to list of deb distros

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #61 from ktdreyer/ceph-deploy-build-bash

ceph-deploy: build with bash, not /bin/sh

ceph-deploy: build with bash, not /bin/sh

/bin/sh is dash on Ubuntu/Debian. Switch to bash for uniformity with RPM
systems.

Merge pull request #60 from ceph/cdep-build-script

fix/improve ceph-deploy build script

use  to loop over DEB or RPM cases

Signed-off-by: Alfredo Deza <adeza@redhat.com>

create a list of valid DIST targets

Signed-off-by: Alfredo Deza <adeza@redhat.com>

remove hard-coded DEBEMAIL as we now set it when building

Signed-off-by: Alfredo Deza <adeza@redhat.com>

fix indentation error that caused EOF issue

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #59 from ceph/cdep-port

port ceph-deploy scripts to jjb build script

include the new contents of the script into the Jenkins UI

Signed-off-by: Alfredo Deza <adeza@redhat.com>

port all scripts to build/build in ceph-deploy

Signed-off-by: Alfredo Deza <adeza@redhat.com>

remove dream compute from ceph-build-prs

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #58 from ceph/nix-dcompute

Nix dcompute

remove dream compute from ceph-deploy-docs

Signed-off-by: Alfredo Deza <adeza@redhat.com>

remove dream compute from ceph-deploy PRs

Signed-off-by: Alfredo Deza <adeza@redhat.com>

remove precise froteuthology docs

Signed-off-by: Alfredo Deza <adeza@redhat.com>

remove precise from ceph-qa-suite-pull-requests

Signed-off-by: Alfredo Deza <adeza@redhat.com>

remove precise from jjb

Signed-off-by: Alfredo Deza <adeza@redhat.com>

change node for setup to trusty

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #57 from ktdreyer/rm-fedora20

remove fedora20 Jenkins slave

remove fedora20 Jenkins slave

Remove the Fedora 20 build slave from the job configs.

We're having trouble resurrecting
gitbuilder-cdep-rpm-cloud-fedora20-amd64-basic.cloud.sepia.ceph.com in
DreamCompute, and Fedora 20 itself is going EOL in a month or so.

This is the only Fedora builder we have, and this VM does build packages
for http://ceph.com/rpm-hammer/fc20/, so it would be nice to get fresh
Fedora build slaves set up eventually. But in the meantime, since this
one is giving us trouble, just remove it.

Merge pull request #56 from ktdreyer/drop-old-rpm-distros

Drop old rpm distros

remove old EOL fedora references

Fedora 18 and 19 are end of life and we should not support them any
more. Remove them from the ceph-release-rpm build script and "rpm_hosts"
lists.

ceph-release-rpm: update EL6 references to "6.5"

This was an older job that didn't get updated often, so when we added
the "6.5" builders, this job was neglected.

Update all the "6.3" references to "6.5" so we can drop the old "6.3"
buildslaves. EL 6.5 has been EOL for a while now and is no longer
receiving security updates.

drop old rhel6 and centos6 versions

These are old versions of EL6 that are no longer getting security
updates. Users should not be running them.

Merge pull request #55 from ktdreyer/ceph-deploy-fix-archives

unquote archive settings

Reviewed-by: Dan Mick <dmick@redhat.com>

unquote archive settings

Prior to this commit the archive settings for ceph-deploy and
radosgw-agent were quoted 'false' or 'true' instead of simply the
boolean types that YAML expects.

jenkins-jobs interpreted these strings to be "true", so we ended up with
the following XML:

  <latestOnly>true</latestOnly>

This meant that Jenkins deleted all the older archived ceph-deploy
packages each time a new version was built.  When 1.5.22.1 was built,
the "older" 1.5.23 package was deleted.

Unquote the boolean values so JJB will properly interpret them.

Signed-off-by: Ken Dreyer <kdreyer@redhat.com>

Merge pull request #54 from ceph/remove-squeeze

remove squeeze from matrix

remove squeeze from matrix

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #53 from ktdreyer/import-ceph-release-rpm

import ceph-release-rpm jjb task