Do not specify a version when upgrading ceph on rpm-based systems.

Because of the split of ceph-devel, upgrading ceph-devel with an
explicit version does not allow check_obsoletes to work.

For, http://tracker.ceph.com/issues/10936

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #427 from ceph/travisci

add Travis CI integration

Merge pull request #446 from ceph/wip-10926-andrew

Do not install packages with a specified version, fixes #10926

Do not install packages with a specified version, fixes #10926

Now that we've got yum setup to check for obsoletes we don't need to
specify a version. Specifying the version actually keeps yum from
checking for obsoletes.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #445 from ceph/hadoop

hadoop: clean-up and sigkill delay fix

hadoop: add yarn sigkill delay hack

This instructs yarn to wait more time (10sec) than the default (250ms)
before killing containers to give ceph clients time to properly
shutdown.

Signed-off-by: Noah Watkins <noahwatkins@gmail.com>

hadoop: use dict-to-conf converter

Signed-off-by: Noah Watkins <noahwatkins@gmail.com>

Merge pull request #443 from ceph/wip-10910

Allow Remote.get_file() to use original filename

Allow Remote.get_file() to use original filename

If dest_dir != '/tmp', attempt to use the original filename.

Signed-off-by: Zack Cerza <zack@redhat.com>

Update out-of-date integration test

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #442 from ceph/wip-7364

Don't fail just because apt-get update does

Don't fail just because apt-get update does

If we fail later anyway, fine. If not, yay!

Signed-off-by: Zack Cerza <zack@redhat.com>

Don't fail if task runs twice

This was happening because _yum_unset_check_obsoletes() was failing

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #440 from ceph/wip-10893

Set check_obsoletes = 1 in yum's priorities.conf

Set check_obsoletes = 1 in yum's priorities.conf

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #439 from ceph/pytest-better-errors

put test failures in failure_reason; skip test_correct_os_version for debian

Make an exception for debian in tests.test_correct_os_version

This is because of a known issue where downburst gives us 7.1 when we
ask for 7.0.  We're ok with this behavior for now. See: issue #10878

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Include test failures in ctx.summary['failure_reason']

I also added a new line to make reading the log nicer

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #438 from ceph/wip-10879

Avoid race condition in find_stale_locks()

Avoid race condition in find_stale_locks()

Because of the way we were checking nodes against running jobs, it was
possible to falsely report nodes as stale if they were part of a job
that was transitioning from the waiting to running state.

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #437 from ceph/pytest-noterminalreporter

Fixes the issue of pytest failing with scheduled jobs

Remove the pytest default TerminalReporter in the tests task

This fixes the issue of pytest IO Error failure in a scheduled job

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

If there is an error running pytest, mark job as dead

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #435 from ceph/wip-10856

Safer vps unlocking

Pass a description to unlock_one()

Signed-off-by: Zack Cerza <zack@redhat.com>

Add optional description arg to unlock_one()

It gets passed to the lock server.

Signed-off-by: Zack Cerza <zack@redhat.com>

Add optional description arg to destroy_if_vm()

If it is passed and doesn't match the one received from the lock server,
don't destroy the VM.

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #436 from ceph/wip-hadoop-linter

hadoop: remove parallel from import; fixes linter warning

hadoop: remove parallel from import; fixes linter warning

Signed-off-by: Greg Farnum <gfarnum@redhat.com>

Merge pull request #434 from ceph/hadoop

Hadoop 2.0 Task

This will need more updating, but pulling it in-tree gets better in-situ testing, and the hadoop task is isolated.

Merge pull request #432 from ceph/pytest-stdout

Make pytest capture stdout when running the tests task

Make pytest capture stdout when running the tests task

This makes the logs easier to read.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

hadoop: separate ceph/hdfs config actions

Signed-off-by: Noah Watkins <noahwatkins@gmail.com>

hadoop: support cephfs

Signed-off-by: Noah Watkins <noahwatkins@gmail.com>

hadoop: easier config creation

Signed-off-by: Noah Watkins <noahwatkins@gmail.com>

misc: create prepend_lines helper

Signed-off-by: Noah Watkins <noahwatkins@gmail.com>

hadoop: 2x

Signed-off-by: Noah Watkins <noahwatkins@gmail.com>

Merge pull request #431 from ceph/wip-10825

Smarter sources.list/.repo removal

Tweak _remove_sources_list_{deb,rpm}()

Make their implementations more concise, their logging more verbose, and
avoid running apt-get update if no sources list was removed.

Signed-off-by: Zack Cerza <zack@redhat.com>

Don't run two apt-get updates in parallel

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #430 from tchaikov/fix-readme

README: update with teuthology-suite

README: update with teuthology-suite

* replace sample usage of deprecated schedule_suite.sh with that of
  teuthology-suite
* add a pointer to `teuthology-suite --help`

Fixes: #8678
Signed-off-by: Kefu Chai <kchai@redhat.com>

Merge pull request #429 from ceph/tests-task-cleanup

Adds a machine_type property to orchestra.remote.Remote

Adds a machine_type property to orchestra.remote.Remote

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #428 from ceph/wip-10774

Don't unlock VMs before destroying them

Don't destroy a vps that is owned by someone else

This only affects the unlock_one() codepath at this point.

Signed-off-by: Zack Cerza <zack@redhat.com>

Destroy VMs before unlocking, not after

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #426 from ceph/wip-10736

create a teuthology integration test task

Correctly pull the default machine_type if machine_type is not defined explicitly

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Do not log skipped tests as failed

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Added integration tests to ensure locking is working correctly

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Moved task.tests into it's own module and created tests.test_run

This sets up the basic structure for teuthology integration testing.
Any tests put in teuthology/task/tests will be autodiscovered and run
when 'tests' is in the task list of a job's config.

Each test will be given ctx and config and it's output will be logged
using our logger.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Use pytest to auto discover and run tests in task.tests

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

install: include libcephfs-jni in .deb list as well as RPM one

Signed-off-by: Greg Farnum <gfarnum@redhat.com>
Reviewed-by: Zack Cerza <zack@redhat.com>

add Travis CI integration

This will allow Travis CI to run tox to check for test failures.

Merge pull request #425 from ceph/wip-10753

Add a label to the ceph-qa-chef run in task.internal

Add a label to the ceph-qa-chef run in task.internal

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #423 from ceph/teuth-testing

Add a label to run.run

Added a 'tests' task that we can use to test teuthology features

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Add a label kwarg to run.run

This can be used to label or annotate commands to remotes so we can
print a meaningful log message if the command fails.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Make 'branch' a tag in Sentry

Signed-off-by: Zack Cerza <zack@redhat.com>

Add branch to Sentry info

Signed-off-by: Zack Cerza <zack@redhat.com>

Fix bug in submitting Sentry events

It wasn't working for non-scheduled jobs

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #422 from ceph/wip-10622

If the version file is empty, complain.

If the version file is empty, complain.

We *could* work around this, but I don't want to mask bugs in the build
system.

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #420 from ceph/wip-10625

deprecate support for a custom downburst config

Remove support for a custom downburst config in teuthology.provision

Will log a warning message if a custom downburst config is found in
ctx.config. Removes unused --downburst-conf option from teuthology-lock.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Removed downburst config support in get_distro and get_distro_version

We believe that nobody is using custom downburst configs anymore so
we're planning to deprecate this feature.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Merge pull request #421 from ceph/wip-tunables

ceph.conf: mon warn on legacy tunables = false

ceph.conf: mon warn on legacy tunables = false

so we can test legacy tunables

Signed-off-by: Sage Weil <sage@redhat.com>

Fix typo in libvirt.conf path

Signed-off-by: Zack Cerza <zack@redhat.com>

Add error message when SMTP server is unreachable

This only happens when scheduling fails.

Signed-off-by: Zack Cerza <zack@redhat.com>

Fix typo in --machine-type flag

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #417 from ceph/wip-10561

Enable kernel installs from brew

Adding unit test coverage to teuthology.packaging

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Only install the kernel from koji if needed.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Move koji related functions into teuthology.packaging

We can now use these functions in other places in teuthology.

I've also made the urls for koji configurable with the
teuthology config.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Enable kernel installs from koji

This enables a kernel to be installed from koji by putting the
following stanza under 'kernel' in your yaml config, 'koji: <build_id>'.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Don't allow calling teuthology-nuke with no args

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #419 from ceph/wip-wait

DaemonState: add wait()

Merge pull request #418 from ceph/wip-10621

Make teuthology-lock respect --os-type

Make teuthology-lock respect --os-type

This fixes the regression in issue #10621

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

DaemonState: add wait()

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #416 from ceph/wip-10610

rpm codepath cleanup

Less hardcoding of 'ceph' project in rpm codepath

Signed-off-by: Zack Cerza <zack@redhat.com>

Ensure yum repo file exists before tweaking it

Signed-off-by: Zack Cerza <zack@redhat.com>

Use yum localinstall to install ceph-release

Partly, do this so that if ceph-release is already installed, we don't
get an error.

Signed-off-by: Zack Cerza <zack@redhat.com>

Fix regression in non-ceph project handling

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #413 from ceph/extras-doc-update

Added some comments clarifying functionality in the install task.

Added some comments clarifying functionality in the install task.

I also put in a couple TODO comments for things to look at later.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Add cephfs-java to rpm packages

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #411 from ceph/wip-10580

Remove duplicate package list from install task

Merge pull request #412 from ceph/wip-10578

Change default results_timeout to 12h

Remove unncessary 'global' declaration

Signed-off-by: Zack Cerza <zack@redhat.com>

Change default results_timeout to 12h

Signed-off-by: Zack Cerza <zack@redhat.com>

Remove duplicate package list from install task

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #409 from ceph/wip-10573

Don't suppress stdout for most apt-get ops

Merge pull request #410 from ceph/print-teuth-command

Log the teuthology command being ran at the debug level

Log the teuthology command being ran at the debug level

Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Don't suppress stdout for most apt-get ops

Signed-off-by: Zack Cerza <zack@redhat.com>