ceph-dev-setup: add back the dch -v command

Without this command the dsc artifacts are not created correctly and
ceph-dev-build fails to find them, resulting in errors like:

"dpkg-source: error: cannot read ceph_10.2.2-508-g9bfc0cf-1.dsc: No such
file or directory"

From:
https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=xenial,DIST=xenial,MACHINE_SIZE=huge/492/console

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #475 from ceph/wip-calamari-clients

calamari-clients: Add calamari-clients jenkins build jobs

calamari-clients: Add calamari-clients jenkins build jobs

Signed-off-by: Boris Ranto <branto@redhat.com>

Merge pull request #474 from ceph/fix-deb-binary-names

ceph-dev: fix debian binary names

ceph-dev-setup: do not call dch -v during the build

This is unneeded and setting an incorrect version number

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

ceph-dev-build: ensure the binaries have the distro version in them

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #473 from ceph/ceph-spec-vers-sed

ceph-dev-build: further massage ceph.spec to insist on using sha1 in version name

ceph-dev-build: further massage ceph.spec to insist on using sha1 in version name

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #472 from ceph/dev-setup-utils

ceph-dev-setup: include the build utils when building

ceph-dev-setup: include the build utils when building

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #469 from ceph/jjb-node

jenkins-job-builder: should not use the master node

jenkins-job-builder: should not use the master node

master is not setup for building anything and does not have virtualenv
installed which this job needs. In general, we don't want jobs that do
any "building' to use master.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #471 from ceph/jnlp-slave-ansible

ansible: support registering slaves with jnlp

ansible: support registering slaves with jnlp

This adds a use_jnlp flag to slave.yml which provides support to
register the slave with jnlp instead of ssh if use_jnlp: true

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #470 from ceph/if-else-autogen

ceph-dev-setup: call autogen only when not using cmake

ceph-dev-setup: call autogen only when not using cmake

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #466 from ceph/filter-branches

Filter slashes out of branches

ceph-dev-setup: use the new utility for slashes in branches

Signed-off-by: Alfredo Deza <adeza@redhat.com>

scripts: create a branch filtering for slashes

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ceph-dev-build: filter branches with slashes when building RPMs

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ceph-dev-build: filter branches with slashes when building DEBs

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #468 from ceph/ceph-dev-trigger-master

pin jobs to master that used to use huge_xenial_builder`

ceph-dev: pin to master

We want this to run on master until we can get another huge executor
setup by mita.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

ceph-dev-build: pin to master

We want this to run on master until we can get another huge executor
setup by mita.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

ceph-dev-trigger: pin to the master node

We want to pin to master until we can get another huge executor online
by mita.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #467 from ceph/ansible-executors

ansible: allow for setting the number of executors on a slave

ansible: allow for setting the number of executors on a slave

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #462 from ceph/sed-autosetup

ceph-dev-build: modify autosetup when setup is not defined in spec file

ceph-dev-build: copy whatever tar.bz2 file was built so rpmbuild can find it

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ceph-dev-build: modify autosetup when setup is not defined in spec file

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #461 from ceph/jenkins-node-exc

ansible/library fix wrong exc object references

ansible/library fix wrong exc object references

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #456 from ceph/ceph-gitconfig

define a .gitconfig for slaves

ansible: slave playbook should define a global gitconfig that makes sense for user and email

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ansible: add the debian Jessie keys

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ansible: slave should ensure the home dir exists before creating .ssh

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #465 from ceph/wip-calamari

calamari: Add initial files for jenkins build

calamari: Add initial files for jenkins build

Signed-off-by: Boris Ranto <branto@redhat.com>

Merge pull request #464 from ceph/wip-diamond

diamond-setup: Handle VERSION properly

diamond-setup: Handle VERSION properly

Signed-off-by: Boris Ranto <branto@redhat.com>

Merge pull request #463 from ceph/wip-diamond

diamond: Redesign + fixes

diamond: Redesign + fixes

Signed-off-by: Boris Ranto <branto@redhat.com>

Merge pull request #460 from ceph/rpm-yum-versions

parse and set a correct representation of 'version' for RPMs using the spec file

ceph-dev-build: parse and set a correct representation of 'version' for RPMs using the spec file

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #458 from ceph/split-slashes

further fixing for spliting branches on forward slashes

ceph-dev-setup: prevent building branches that have slashes in their name

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ceph-dev-setup: get the last part of the branch

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #459 from ceph/wip-diamond

Add initial diamond jenkins job

Add initial diamond jenkins job

Signed-off-by: Boris Ranto <branto@redhat.com>

Merge pull request #457 from ceph/ceph-dev-trigger

adds a ceph-dev-trigger job

ceph-dev-setup: fix parsing of GIT_BRANCH

A branch name can also contain a '/' so make sure not
to exclude that.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

ceph-dev-build: use the huge_xenial_builder node

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

ceph-dev: use the huge_xenial_builder node

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

ceph-dev-build: inject BRANCH value from ceph-dev-setup

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

ceph-dev-setup: parse the value of GIT_COMMIT and make an artifact

GIT_COMMIT will be in the format origin/$branch, so parse that
and write it to an artifact so ceph-dev-build can consume it.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

adds a new ceph-dev-trigger job

This job responds to pushes to the ceph repo and triggers ceph-dev jobs

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #454 from ceph/wip-teuth-commit-status

teuthology PRs: require a huge Trusty host

Require a huge Trusty host

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #455 from ceph/fix-deb-package-manager-version

ceph-dev-build: fix the value for package_manager_version for DEB

ceph-dev-build: fix the value for package_manager_version for DEB

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #453 from ceph/git-diff

Git diff reporting

ceph-setup: do tell what git diff reported before bailing

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ceph-dev-setup: do tell what git diff reported before bailing

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #452 from ceph/repo-extra

ceph-dev-build: adds a new package_manager_version field to repo extra

ceph-dev-build: adds a new package_manager_version field to repo extra

For DEB repos there is a different version that apt uses, this
allows the API to provide that information as well as the project
version.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #451 from ceph/repo-extra

ceph-dev-build: fix the chacra url when posting repo-extra.json

ceph-dev-build: fix the chacra url when posting repo-extra.json

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #450 from ceph/node-for-ceph-dev

ceph-dev: specify a laxed pinning for nodes

ceph-dev-build: specify a laxed pinning for nodes

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ceph-dev: specify a laxed pinning for nodes

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #448 from ceph/repo-extra

ceph-dev-build: remove trailing comma from repo extra json

ceph-dev-build: remove trailing comma from repo extra json

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #445 from ceph/repo-extra

ceph-dev-build: post repo build info to chacra

ceph-dev-build: post repo build info to chacra

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #446 from ceph/local-hostname

ansible: if 127.0.1.1 add it and map it to ansible_hostname

ansible: if 127.0.1.1 add it and map it to ansible_hostname

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #447 from ceph/wip-chacra

calamari-server-trusty: pass the passwords for chacra upload

calamari-server-trusty: pass the passwords for chacra upload

Signed-off-by: Boris Ranto <branto@redhat.com>

Merge pull request #444 from ceph/ceph-dev-updates

support for concurrent ceph-dev-setup and ceph-dev-build jobs

ceph-dev-build: copy artifacts from last multijob-build

When we have multiple ceph-dev-setup jobs running we need to tell
ceph-dev-build more specificially which job to copy artifacts from.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

set concurrent: true in ceph-dev-setup and ceph-dev-build

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #442 from ceph/ceph-build-updates

ceph-dev-build: add centos6, precise, and wheezy to available distros

ceph-dev-build: add centos6, precise, and wheezy to available distros

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #441 from ceph/ceph-build-updates

Ceph build updates

ceph-build: add scripts to validate distro type

This will make sure a build script fails early if it will not work on
the distro being built for. Doing this early avoids duplicate calls to
the build_utils and setup scripts.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

adds support for dynamic DISTROS and ARCHS

We will now be able to define with distros and archs we
wish to build for.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #440 from ceph/workspace-cd

cd to $WORKSPACE before building

Reviewed-by: Dan Mick <dmick@redhat.com>

ceph-build: cd to WORKSPACE when building RPMs

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ceph-build: cd to WORKSPACE when building DEBs

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #439 from ceph/ceph-build-setup-fix

ceph-build: setup must be performed for both deb and rpm

ceph-build: setup must be performed for both deb and rpm

If we do setup in it's own -shell then the virtualenv created there will
not be used in the other two -shell sections. This is because we
switched from using a standard venv to using one created in a temp
directory.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #438 from ceph/shaman-url

ceph-dev-build: print the shaman url for the repo on success

ceph-dev-build: print the shaman url for the repo on success

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #437 from ceph/ensure-debian-dir

ceph-dev-setup: ensure that the debian dir exists before copying

ceph-dev-setup: ensure that the debian dir exists before copying

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #436 from ceph/wip-chacra

calamari-server-trusty: Upload the packages to chacra

calamari-server-trusty: Upload the packages to chacra

Signed-off-by: Boris Ranto <branto@redhat.com>

Merge pull request #435 from ceph/ceph-dev-cmake

ceph-dev-setup: produce the tarball with cmake if make-dist exists

ceph-dev-setup: produce the tarball with cmake if make-dist exists

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #434 from ceph/wip-calamari-trusty

calamari-server-trusty: fix environmental issues