get rid of rpm stuff in build_deb

Signed-off-by: Alfredo Deza <adeza@redhat.com>

create a build_deb build script

Signed-off-by: Alfredo Deza <adeza@redhat.com>

place the pbuilder setup script before the actual build step

Signed-off-by: Alfredo Deza <adeza@redhat.com>

remove the check for /srv/debian-base

Because we are now ensuring this will exist in a previous build
step.

Signed-off-by: Alfredo Deza <adeza@redhat.com>

name the file setup_pbuilder to reflect what it actually does

Signed-off-by: Alfredo Deza <adeza@redhat.com>

only run on debian hosts

Signed-off-by: Alfredo Deza <adeza@redhat.com>

build pbuilders without calling other scripts

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #62 from ceph/cdep-trusty

add trusty to list of deb distros

add trusty to list of deb distros

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #61 from ktdreyer/ceph-deploy-build-bash

ceph-deploy: build with bash, not /bin/sh

ceph-deploy: build with bash, not /bin/sh

/bin/sh is dash on Ubuntu/Debian. Switch to bash for uniformity with RPM
systems.

Merge pull request #60 from ceph/cdep-build-script

fix/improve ceph-deploy build script

use  to loop over DEB or RPM cases

Signed-off-by: Alfredo Deza <adeza@redhat.com>

create a list of valid DIST targets

Signed-off-by: Alfredo Deza <adeza@redhat.com>

remove hard-coded DEBEMAIL as we now set it when building

Signed-off-by: Alfredo Deza <adeza@redhat.com>

fix indentation error that caused EOF issue

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #59 from ceph/cdep-port

port ceph-deploy scripts to jjb build script

include the new contents of the script into the Jenkins UI

Signed-off-by: Alfredo Deza <adeza@redhat.com>

port all scripts to build/build in ceph-deploy

Signed-off-by: Alfredo Deza <adeza@redhat.com>

remove dream compute from ceph-build-prs

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #58 from ceph/nix-dcompute

Nix dcompute

remove dream compute from ceph-deploy-docs

Signed-off-by: Alfredo Deza <adeza@redhat.com>

remove dream compute from ceph-deploy PRs

Signed-off-by: Alfredo Deza <adeza@redhat.com>

remove precise froteuthology docs

Signed-off-by: Alfredo Deza <adeza@redhat.com>

remove precise from ceph-qa-suite-pull-requests

Signed-off-by: Alfredo Deza <adeza@redhat.com>

remove precise from jjb

Signed-off-by: Alfredo Deza <adeza@redhat.com>

change node for setup to trusty

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #57 from ktdreyer/rm-fedora20

remove fedora20 Jenkins slave

remove fedora20 Jenkins slave

Remove the Fedora 20 build slave from the job configs.

We're having trouble resurrecting
gitbuilder-cdep-rpm-cloud-fedora20-amd64-basic.cloud.sepia.ceph.com in
DreamCompute, and Fedora 20 itself is going EOL in a month or so.

This is the only Fedora builder we have, and this VM does build packages
for http://ceph.com/rpm-hammer/fc20/, so it would be nice to get fresh
Fedora build slaves set up eventually. But in the meantime, since this
one is giving us trouble, just remove it.

Merge pull request #56 from ktdreyer/drop-old-rpm-distros

Drop old rpm distros

remove old EOL fedora references

Fedora 18 and 19 are end of life and we should not support them any
more. Remove them from the ceph-release-rpm build script and "rpm_hosts"
lists.

ceph-release-rpm: update EL6 references to "6.5"

This was an older job that didn't get updated often, so when we added
the "6.5" builders, this job was neglected.

Update all the "6.3" references to "6.5" so we can drop the old "6.3"
buildslaves. EL 6.5 has been EOL for a while now and is no longer
receiving security updates.

drop old rhel6 and centos6 versions

These are old versions of EL6 that are no longer getting security
updates. Users should not be running them.

Merge pull request #55 from ktdreyer/ceph-deploy-fix-archives

unquote archive settings

Reviewed-by: Dan Mick <dmick@redhat.com>

unquote archive settings

Prior to this commit the archive settings for ceph-deploy and
radosgw-agent were quoted 'false' or 'true' instead of simply the
boolean types that YAML expects.

jenkins-jobs interpreted these strings to be "true", so we ended up with
the following XML:

  <latestOnly>true</latestOnly>

This meant that Jenkins deleted all the older archived ceph-deploy
packages each time a new version was built.  When 1.5.22.1 was built,
the "older" 1.5.23 package was deleted.

Unquote the boolean values so JJB will properly interpret them.

Signed-off-by: Ken Dreyer <kdreyer@redhat.com>

Merge pull request #54 from ceph/remove-squeeze

remove squeeze from matrix

remove squeeze from matrix

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #53 from ktdreyer/import-ceph-release-rpm

import ceph-release-rpm jjb task

import ceph-release-rpm jjb task

This imports the current settings for "ceph-release-rpm" as YAML.

This is an import of the job previously defined in Jenkins' own data
store (ie /home2/jenkins/jobs/ceph-release-rpm/config.xml)

Signed-off-by: Ken Dreyer <kdreyer@redhat.com>

Merge pull request #52 from ktdreyer/wip-radosgw-agent-name

radosgw-agent: remove wip display name

radosgw-agent: remove wip display name

It doesn't make sense to name this job "wip", since we're using it to
build releases.

Merge pull request #51 from ceph/remove-make-check

removed ceph make check

Merge pull request #50 from ceph/remote-bindings

remove python-bindings

removed ceph make check

Signed-off-by: Alfredo Deza <adeza@redhat.com>

remove python-bindings

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #49 from ceph/wip-ceph-setup-skip-tag

ceph-setup: skip tagging each build

ceph-setup: skip tagging each build

Jenkins (un)helpfully tags each build. Don't do this in the ceph-setup
task.

Unfortunately the change in dd5d14520a6fc37337f3a092ca8afc241b2fbacc did
not seem to cover this case, so we need to re-examine why.

Signed-off-by: Ken Dreyer <kdreyer@redhat.com>

revert: mistakingly disabled wrong project

Signed-off-by: Alfredo Deza <adeza@redhat.com>

disabling this other ceph pull request job for now

Signed-off-by: Alfredo Deza <adeza@redhat.com>

disable this test-job that seems stale

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #45 from ktdreyer/wip-ceph-build-pr-noverbose

ceph-build-pull-requests: quiet output

Merge pull request #48 from ktdreyer/wip-fix-ceph-package-job-name

ceph-package: fix display name

Reviewed-by: Dan Mick <dmick@redhat.com>

ceph-package: fix display name

Commit f8d03a28c00e8ad6b2c496e069de6492791496ba fixed the internal
Jenkins job name, this fixes the display name as well.

Signed-off-by: Ken Dreyer <kdreyer@redhat.com>

Merge pull request #47 from ktdreyer/wip-fix-ceph-package-job-name

ceph-package: fix job name

ceph-package: fix job name

When I imported the ceph-package job, I made a bad copy & paste in the
name - it was erroneously named "ceph-build".

Update the job's name to the correct value.

Signed-off-by: Ken Dreyer <kdreyer@redhat.com>

Merge pull request #43 from ktdreyer/rpm-unpackaged-files

build_rpms.sh: terminate on unpackaged files

Merge pull request #46 from ceph/wip-ceph-rm-do-autogen

ceph-setup: remove do_autogen.sh

ceph-setup: remove do_autogen.sh

Remove do_autogen.sh from the ceph-setup task. Run ./autogen.sh and
./configure instead.

I've copied this long ./configure argument list from a prior run of
./do_autogen.sh so that we're using the same arguments. We can adjust it
as needed.

One of the reasons for making this change is that ./do_autogen.sh takes
an argument ("-L") depending on whether we're building a Hammer or
Firefly release. The goal of this change is to use a more stable
interface for doing the builds.

As background, from Sage on IRC yesterday:

  sage: i'm surprised jenkins is using do_autogen.sh at all actually?
  ktdreyer: what should it use?
  sage: ./autogen.sh and then pass the args explicitly to ./configure
        that it wants?
  sage: it doesn't really matter i guess, but do_autogen.sh piles a
        bunch of random stuff in there
  ktdreyer: I was just looking at autobuild-ceph.git's build-ceph.sh
  ktdreyer: it does what you're suggesting
  ktdreyer: cool
  sage: do_autogen.sh in my mind is for developers.  if it makes sense
        for relase that's ok, but that's not how i've treated it

Merge pull request #44 from ktdreyer/wip-import-ceph

import ceph task

ceph-setup: remove debugging "pwd" command

This was just for debugging and can be removed. It is also redundant
with the

  echo "  PWD=$(pwd)"

line that the build script already runs.

Reported-by: Alfredo Deza <adeza@redhat.com>
Signed-off-by: Ken Dreyer <kdreyer@redhat.com>

import ceph-package jjb task

This imports the current settings for "ceph-package" as YAML.

This is an import of the job previously defined in Jenkins' own data
store (ie /home2/jenkins/jobs/ceph-package/config.xml)

Signed-off-by: Ken Dreyer <kdreyer@redhat.com>

import ceph-build jjb task

This imports the current settings for "ceph-build" as YAML.

This is an import of the job previously defined in Jenkins' own data
store (ie /home2/jenkins/jobs/ceph-build/config.xml)

Signed-off-by: Ken Dreyer <kdreyer@redhat.com>

import ceph-setup jjb task

This imports the current settings for "ceph-setup" as YAML.

This is an import of the job previously defined in Jenkins' own data
store (ie /home2/jenkins/jobs/ceph-setup/config.xml)

Signed-off-by: Ken Dreyer <kdreyer@redhat.com>

import ceph jjb task

This imports the current settings for "ceph" as YAML.

This is an import of the job previously defined in Jenkins' own data
store (ie /home2/jenkins/jobs/ceph/config.xml)

Signed-off-by: Ken Dreyer <kdreyer@redhat.com>

ceph-build-pull-requests: quiet output

Running the pull requests script with -x is very noisy. The script
already prints a lot of information with "echo", so just silence the
debugging outupt.

Signed-off-by: Ken Dreyer <kdreyer@redhat.com>

build_rpms.sh: terminate on unpackaged files

As Ceph changes and new files get installed by default, we need to
ensure that the commits which create these files also update the
packaging files lists as well.

One way to do this is to tell Gitbuilder to stop skipping unpackaged
files in the RPMs. This will cause Gitbuilder builds to indicate a
failure when new files get added without packaging updates.

Signed-off-by: Ken Dreyer <kdreyer@redhat.com>

add more ceph-org members to avoid buggy permissions

Signed-off-by: Alfredo Deza <adeza@redhat.com>

more removal off scm polling for pull request jobs

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #42 from ceph/pollscm

remove poll scm option for pull request jobs

Reviewed-by: Ken Dreyer <kdreyer@redhat.com>

remove poll scm option for pull request jobs

Signed-off-by: Alfredo Deza <adeza@redhat.com>

fix permissions on ceph-qa-suite

Signed-off-by: Alfredo Deza <adeza@redhat.com>

initial take on ceph-qa-suite pull request support

Signed-off-by: Alfredo Deza <adeza@redhat.com>

make sure the right key is used when releasing

Signed-off-by: Alfredo Deza <adeza@redhat.com>

move files from the parent dir, not the cwd

Signed-off-by: Alfredo Deza <adeza@redhat.com>

do not use build dir, use KEYID

Signed-off-by: Alfredo Deza <adeza@redhat.com>

remove cd to build

Signed-off-by: Alfredo Deza <adeza@redhat.com>
(cherry picked from commit f4c8c4ad732ddd05786b000083c1fcefaed8cef7)

Merge pull request #41 from ceph/radosgw-agent

initial take on radosgw-agent task

initial take on radosgw-agent task

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #40 from dachary/wip-disable-github

disable github triggers for ceph-pull-requests

disable github triggers for ceph-pull-requests

Signed-off-by: Loic Dachary <loic@dachary.org>

Merge pull request #38 from dachary/wip-loic

add dachary to the list of admins for ceph-pull-requests

add dachary to the list of admins for ceph-pull-requests

Signed-off-by: Loic Dachary <loic@dachary.org>

Merge pull request #37 from dachary/wip-ceph-mirror

use ceph mirror instead of github

use ceph mirror instead of github

Signed-off-by: Loic Dachary <loic@dachary.org>

Merge pull request #35 from dachary/wip-10046-make-check

run make check on pull requests

run make check on pull requests

Signed-off-by: Loic Dachary <loic@dachary.org>

Merge pull request #31 from ktdreyer/doc-documentation-jobs

doc: add notes about "documentation" jobs

Merge pull request #34 from andrewschoen/ceph-deploy-docs

port the ceph-deploy-docs job to yaml

port the ceph-deploy-docs job to yaml

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #33 from andrewschoen/teuthology-docs

actually delete the teuthology-docs-build directory

actually delete the teuthology-docs-build directory

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #32 from andrewschoen/teuthology-docs

Teuthology docs

rename teuthology-docs-build to teuthology-docs. fix encoding in rsync command

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

doc: add notes about "documentation" jobs

Add a bit of documentation regarding "documentation" jobs in Jenkins.
This records our lessons learned during Andrew's work to create the
"teuthology-docs-build" job configuration and get that particular one
running.

create job to build and push teuthology docs

Create a job to build teuthology docs and push them to
ceph.com/teuthology/docs

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
Reviewed-by: Ken Dreyer <kdreyer@redhat.com>

Create a job to build teuthology docs and push them to ceph.com/teuthology/docs

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #29 from ktdreyer/readme-pull-requests

doc: add section for configuring pull request jobs

doc: add section for configuring pull request jobs

Describe the requirements for setting up a new job that will build pull
requests.

Merge pull request #28 from ktdreyer/jenkins-slave-chef-github-url

jenkins-slave-chef-pull-requests: add GitHub URL

jenkins-slave-chef-pull-requests: add GitHub URL

Configure the GitHub plugin for the jenkins-slave-chef-pull-requests job.

(Ideally this will allow the job to recognize the pull request web
hooks that come in from GitHub.)