calamari-server-trusty: pass the passwords for chacra upload

Signed-off-by: Boris Ranto <branto@redhat.com>

Merge pull request #444 from ceph/ceph-dev-updates

support for concurrent ceph-dev-setup and ceph-dev-build jobs

ceph-dev-build: copy artifacts from last multijob-build

When we have multiple ceph-dev-setup jobs running we need to tell
ceph-dev-build more specificially which job to copy artifacts from.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

set concurrent: true in ceph-dev-setup and ceph-dev-build

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #442 from ceph/ceph-build-updates

ceph-dev-build: add centos6, precise, and wheezy to available distros

ceph-dev-build: add centos6, precise, and wheezy to available distros

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #441 from ceph/ceph-build-updates

Ceph build updates

ceph-build: add scripts to validate distro type

This will make sure a build script fails early if it will not work on
the distro being built for. Doing this early avoids duplicate calls to
the build_utils and setup scripts.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

adds support for dynamic DISTROS and ARCHS

We will now be able to define with distros and archs we
wish to build for.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #440 from ceph/workspace-cd

cd to $WORKSPACE before building

Reviewed-by: Dan Mick <dmick@redhat.com>

ceph-build: cd to WORKSPACE when building RPMs

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ceph-build: cd to WORKSPACE when building DEBs

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #439 from ceph/ceph-build-setup-fix

ceph-build: setup must be performed for both deb and rpm

ceph-build: setup must be performed for both deb and rpm

If we do setup in it's own -shell then the virtualenv created there will
not be used in the other two -shell sections. This is because we
switched from using a standard venv to using one created in a temp
directory.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #438 from ceph/shaman-url

ceph-dev-build: print the shaman url for the repo on success

ceph-dev-build: print the shaman url for the repo on success

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #437 from ceph/ensure-debian-dir

ceph-dev-setup: ensure that the debian dir exists before copying

ceph-dev-setup: ensure that the debian dir exists before copying

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #436 from ceph/wip-chacra

calamari-server-trusty: Upload the packages to chacra

calamari-server-trusty: Upload the packages to chacra

Signed-off-by: Boris Ranto <branto@redhat.com>

Merge pull request #435 from ceph/ceph-dev-cmake

ceph-dev-setup: produce the tarball with cmake if make-dist exists

ceph-dev-setup: produce the tarball with cmake if make-dist exists

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #434 from ceph/wip-calamari-trusty

calamari-server-trusty: fix environmental issues

calamari-server-trusty: fix environmental issues

The sudo command resets the enviroment by default so we never passed the
WORKSPACE variable to salt. This made salt default to HOME instead.

Also, we store the packages in pkgs/ subdir of WORKSPACE dir, fixing
that as well.

Signed-off-by: Boris Ranto <branto@redhat.com>

Merge pull request #432 from ceph/ceph-dev-flavors

flavor support for ceph-dev builds

ceph-dev-build: use chacra endpoints with flavors for building DEBs

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ceph-dev-build: use chacra endpoints with flavors

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ceph-dev: remove string-based parameter for FLAVOR

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ceph-dev: first item in choice needs to be the default

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ceph-dev-setup: detect flavor options to extend configure args

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ceph-dev: add choice parameters for FLAVORS

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #433 from ceph/wip-trust-build

calamari-server-trusty: Install multitee before we use it

calamari-server-trusty: Install multitee before we use it

Signed-off-by: Boris Ranto <branto@redhat.com>

Merge pull request #431 from ceph/cdp-tag-node

ceph-deploy-tag: restrict the job to trusty and small, avoiding docs server

ceph-deploy-tag: restrict the job to trusty and small, avoiding docs server

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #430 from ceph/ceph-dev-release-fixes

ceph-release url fixes (for ceph-dev)

ceph-dev define a FLAVOR parameter for the build

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ceph-dev-build add flavor var to ceph-release urls

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ceph-dev-build: fix invalid chacra_url variable, removing trailing slash

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #429 from ceph/ceph-release-dev

ceph-dev-build: create ceph-release configuration and build steps

ceph-dev-build: create ceph-release configuration and build steps

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #428 from ceph/arch-selection

ceph-dev: gives the ability to select with architectures to build for

ceph-dev: gives the ability to select with architectures to build for

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #427 from ceph/distro-checks

ceph-dev-build: add scripts to validate distro type

ceph-dev-build: add scripts to validate distro type

This will make sure a build script fails early if it will not work on
the distro being built for. Doing this early avoids duplicate calls to
the build_utils and setup scripts.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #426 from ceph/repo-creation

ceph-dev: various updates to make the build work

ceph-dev-build: rename the bz2 file using the raw version when copying

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ceph-dev: allow the build to be concurrent

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ceph-dev-build: make the spec file look for the right source dir, using sed

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ceph-dev-build: the build scripts need to start in $WORKSPACE

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

ceph-dev-build: setup must be performed for both dev and rpm

If we do setup in it's own -shell then the virtualenv created there will
not be used in the other two -shell sections. This is because we
switched from using a standard venv to using one created in a temp
directory.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

ceph-dev: fixes for debian ceph version

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #425 from ceph/renewal-fix

ansible: use letsencrypt renew vs. asking for a new cert every 12 hours

ansible: letsencrypt should agree tos and set the email

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ansible: use letsencrypt renew vs. asking for a new cert every 12 hours

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #424 from ceph/ssl-no-verify

scripts: disable chacractl ssl verification temporarily

scripts: disable chacractl ssl verification temporarily

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #423 from ceph/repo-creation

use the value of VENV from build_utils.sh everywhere

start repo creation after all binaries are uploaded

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

ceph-deploy-pull-requests: create a build/build script

We need to do it this way so that we can access the value of
VENV from build_utils.sh

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

always use the value of VENV set in build_utils.sh

We need to do this because that is not created in a temp directory.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #422 from ceph/ceph-dev

ceph-dev: provide the ability to choose which distros are used

use mktemp when creating the venv directory

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

ceph-dev: provide a better description for DISTROS

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

ceph-dev-build: fail when the curl to shaman doesn't return a 200

We want to stop the build immediately if there is no healthy chacra
nodes to use.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

ceph-dev: remove the VERSION parameter

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

create the virtualenv at /tmp/jenkins-venv

The $WORKSPACE path is getting to long and causing an
exception to be thrown with the message:

"bad interpreter: No such file or directory"

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

ceph-dev-setup: add || true when moving the *.diff.gz

This file is not always guaranteed to be there.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

ceph-dev: adds the ability to specify which distros to build for

This adds a DISTROS property that can be passed a space delimeted list
of labels that controls which distros will be included in the matrix.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #421 from ceph/ceph-dev

creates a ceph-dev job for testing builds

ask shaman.ceph.com which chacra instance to use for ceph-dev-build

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

make_chacractl_config now accepts a url as an argument

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

adds a ceph-dev-build job

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

ceph-dev: remove the TEST parameter

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

adds a ceph-dev-setup job

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

adds a ceph-dev job for building testing binaries

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #420 from ceph/release-playbook

move release.yml to ansible/ from ansible/examples/

copy release.yml into examples/ for PR testing

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

move release.yml from ansible/examples to ansible/

Move the playbook back here so that the ceph-tag and
ceph-deploy-tag jobs can both use it.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #419 from ceph/letsencrypt

Letsencrypt support for load balanced Shaman

ansible: grafana ini template should condition github api configuration

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ansible: split the ssl work in the nginx role for dev vs. prod

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ansible: nginx.conf template should use consume the upstreams var

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ansible: add self signed ssl cert default paths

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ansible: add a tmp site config file for nginx on letsencrypt support

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ansible: update the grafana deployment example playbook

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ansible: overload the nginx configuration in vars file

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ansible: remove load_balance nginx site config

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ansible: make nginx_site template accommodate load balanced apps

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ansible: create an ssl task

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ansible: create a letsencrypt task

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ansible: create defaults for nginx role for letsencrypt support

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #407 from ceph/chacra-sha1

include the sha1 when uploading binaries to chacra

ceph-deploy-build and radosgw-agent should use GIT_COMMIT

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

include the sha1 when uploading binaries to chacra

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #418 from ceph/yaml-moved

ceph-build-pull-requests: yaml files moved; update location

ceph-build-pull-requests: copy roles too

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ansible: fix unquoted path vars in nginx role

Signed-off-by: Alfredo Deza <adeza@redhat.com>

ceph-build-pull-requests: yaml files moved; update location

Signed-off-by: Alfredo Deza <adeza@redhat.com>

Merge pull request #415 from ceph/nginx-balancer

Load Balance support for Nginx