ansible: enable pipelining in ssh

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ansible: add a sample playbook

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ansible: create a graphite role

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #409 from ceph/ceph-setup-params

Make the sha1 from the current build available in the build scripts

ceph-build: inject the sha1 properties file from ceph-setup

This will make the SHA1 environment variable available to the build
scripts.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

ceph-setup: write the current sha1 being built to a file

This file will be archived and injected into ceph-build

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

ceph-setup: print the SHA1 being built

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #408 from ceph/ceph-tag-branch

ceph-tag: always use the master branch of ceph-build

ceph-tag: always use the master branch of ceph-build

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #406 from ceph/default-branch

radosgw-agent: have some defaults to prevent null var references

radosgw-agent: have some defaults to prevent null var references

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #405 from ceph/wip-xenial

Add xenial

Add xenial

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #403 from ceph/wip-teuth-docs

teuthology-docs: Move package dependencies into the job definition

teuthology-docs: Add libvirt-dev dependency

Signed-off-by: Zack Cerza <zack@redhat.com>

teuthology-docs: Don't actually install deps

We don't have tty-less sudo on docs.ceph.com. Dependencies must be
installed manually.

Signed-off-by: Zack Cerza <zack@redhat.com>

Install pkg-config for teuthology-docs

Fixes: "Exception: pkg-config binary is required to compile
libvirt-python"

Signed-off-by: Zack Cerza <zack@redhat.com>

Move teuthology-docs deps out of slave.yml

If other jobs don't need them, let's not make them take the time to
install them.

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #402 from ceph/ssh-creds-revert

add ssh creds back to be able to push tags

Revert "ceph-tag: remove ssh credentials to prevent github auth conflicts"

This reverts commit f4398ab8df10e6fef419e742afc9547634c1c214.

Merge pull request #401 from ceph/docs-update

fix the example in the README on how to test and update jobs

fix the example in the README on how to test and update jobs

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #400 from ceph/remove-github-publisher

removes the deprecated github-notifier publisher from all jobs

removes the deprecated github-notifier publisher from all jobs

This publisher is not needed as the github-pull-requests trigger takes care of
updating the status on the pull request.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #399 from ceph/radosgw-pr-fix

radosgw-agent-pull-requests: remove github-notifier

radosgw-agent-pull-requests: remove github-notifier as it may cause build to fail to notify

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #398 from ceph/evelu-ccache

ceph-pull-request: Increasing ccache size

ceph-pull-requests: Showing ccache stats after the build.

When the build is completed, let's print the actual usage of ccache

ceph-pull-requests: Increasing ccache size

By default, ccache is now configured and uses only 1G of space.
While monitoring the build it appears that if we would have a larger cache, more
hits could be done making a faster build process.

This patch simply makes the ccache bigger up to 5G which is fine regarding the
openstack flavor we have.

Merge pull request #397 from ceph/mita-local-deploy

local deploys for mita

restrict it to run on master only

Signed-off-by: Alfredo Deza <adeza@redhat.com>

further specify this is a local ansible execution

Signed-off-by: Alfredo Deza <adeza@redhat.com>

since this runs on master use localhost for ssh

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #396 from ceph/mita-deploy-name

mita-deploy: change the job name to mita-deploy

mita-deploy: change the job name to mita-deploy

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #395 from ceph/mita-deploy

create a job to deploy mita

create a job to deploy mita

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #394 from ceph/evelu-ansible-rights

ansible: Enforce rights on /home/jenkins-build

ansible: Enforce rights on /home/jenkins-build

On a fresh new image, the /home/jenkins-build relies to root.root making ccache
failing at creating a file here.

That means that anything trying to write a file in the home dir will fail.

This patch simply enfore the user/group of the home dir

Merge pull request #391 from ceph/ssh-conflicts

Remove ssh-agent credentials

ceph-tag: remove ssh credentials to prevent github auth conflicts

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ceph-setup: remove ssh credentials to prevent github auth conflicts

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #390 from ktdreyer/jenkins-https-public-cert

import Jenkins' HTTP public cert

import Jenkins' HTTP public cert

In case we have to rebuild jenkins.ceph.com, this is one less manual
step.

Merge pull request #389 from ceph/detect-debian

ceph-build: map the DIST to distro to properly detect ubuntu vs debian

ceph-build: map the DIST to distro to properly detect ubuntu vs debian

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #371 from ErwanAliasr1/evelu-perf

ceph-pull-requests: Override processor numbers

ceph-pull-requests: Override processor numbers

By default, run-make-check divide by 2 the number of processors to be used
during the make process.

When building a PR on our build farm, we need to use the full potential of the
build hosts.

By overriding NPROC with the actual number of processors, we speedup the build
process and use in a more efficient way the build hosts.

Merge pull request #388 from ceph/xenial-interface

ceph-ansible-pull-requests: use the ens3 monitor interface with xenial

ceph-ansible-pull-requests: use the ens3 monitor interface with xenial

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #387 from ceph/jessie-pbuilder-fixes

add debootstrapopts for Debian to point to the correct keyring location

Reviewed-by: Dan Mick <dmick@redhat.com>

add debootstrapopts for Debian to point to the correct keyring location

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #386 from ceph/ceph-setup-tag

ceph-setup: build from tag, not from branch

Reviewed-by: Dan Mick <dmick@redhat.com>

ceph-setup: build from tag, not from branch

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #385 from ceph/rm-jdk7

slave.yml: remove openjdk7 from default install list

slave.yml: remove openjdk7 from default install list

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #384 from ceph/jdk-xenial

slave.yml: condition opnjdk installs for xenial

slave.yml: condition opnjdk installs for xenial

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #383 from ceph/xenial-for-ansible

ceph-ansible-pull-requests: add a xenial instance when testing

Reviewed-by: Dan Mick <dmick@redhat.com>

ceph-ansible-pull-requests: add a xenial instance when testing

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #382 from ceph/newer-setuptools

Newer setuptools across all python-using jobs

teuthology-pull-requests: include build_utils in shell builder

Signed-off-by: Alfredo Deza <adeza@redhat.com>

teuthology-docs: include build_utils in shell builder

Signed-off-by: Alfredo Deza <adeza@redhat.com>

merfi-pull-requests: include build_utils in shell builder

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ceph-tag: include build_utils in shell builder

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ceph-qa-suite-pull-requests: include build_utils in shell builder

Signed-off-by: Alfredo Deza <adeza@redhat.com>

jenkins-job-builder: include build_utils in shell builder

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ceph-deploy-docs: include build_utils in shell builder

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ceph-build-pull-requests: include build_utils in shell builder

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ceph-tag: use build_utils

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ceph-qa-suite-pull-requests: use build_utils

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ceph-build-pull-requests: use build_utils

Signed-off-by: Alfredo Deza <adeza@redhat.com>

teuthology-pull-requests: use build_utils

Signed-off-by: Alfredo Deza <adeza@redhat.com>

teuthology-docs: use build_utils

Signed-off-by: Alfredo Deza <adeza@redhat.com>

merfi-pull-requests: use build_utils

Signed-off-by: Alfredo Deza <adeza@redhat.com>

jenkins-job-builder: use build_utils

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ceph-deploy-docs: use build_utils

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ensure setuptools is update for all consumers of the build_utils script

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #380 from ceph/libssl

install dev packges for libssl and libffi on rpm and deb sytems

install dev packges for libssl and libffi on rpm and deb sytems

These are needed to pip install ansible.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #381 from ceph/upgrade-setuptools

upgrade setuptools for ceph-build-pull-requests

upgrade setuptools for ceph-build-pull-requests

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #379 from ceph/jessie-id

use the correct ID for the Jessie key

use the correct ID for the Jessie key

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #378 from ceph/typo-jessie-key

typo fix on debian gpg key for jessie

Reviewed-by: Dan Mick <dmick@redhat.com>

typo fix on debian gpg key for jessie

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #377 from ceph/fix-hostname

ensure the current hostname is defined in /etc/hosts

ensure the current hostname is defined in /etc/hosts

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #376 from ceph/add-jessie-key

Add Debian Jessie GPG Key

Add Debian Jessie GPG Key

Regardless of the machine, since we are usually building on Trusty, this will
allow that type of server to build and avoid the "Release signed by unknown
key" issue.

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #375 from ceph/wip-calamari-trusty

need to checkout calamari source

need to checkout calamari source

Signed-off-by: Gregory Meno <gmeno@redhat.com>

Merge pull request #373 from ceph/archive-ring

install the debian keys so pbuilder will work with newer distros

install the debian keys so pbuilder will work with newer distros

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #374 from ceph/extra-vars

Use --extra-vars instead of Mako templating for the prado playbook

rename slave.yml.j2 to slave.yml

There is no need to have two different playbooks anymore now that we're not
using mako templating in prado.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

use jinja2 vars instead of mako in slave.yml.j2

We're going to pass --extra-vars in the prado command now so there is no
need to do extra templateting with mako.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #372 from ceph/revert-combination-filter

Revert combination filter

Revert "define a new label axis for generic builders"

This reverts commit 2670b50fee7b317ebfdbe2926dc4074ba0001096.

Revert "filter out trusty-pbuilder for centos7 and centos6"

This reverts commit 566263e6baada5544343dece3c30093bde36f3d1.