Rename suite_base to suite_dir

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Add --suite-branch and --suite-base

The former lets you specify a specific ceph-qa-suite branch to use for
testing. The latter lets you specify an as-is directory to use, for
example if you want ro run tests that you don't want to commit yet.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Use a test-specific name/email for the git calls

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Add more unit tests

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Add a basic validation of the branch value

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Run unit tests offline

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Split up repo helper into separate functions

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Document checkout_repo()

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Drop a "fix" for a bug that probably never existed

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Add a note about teuthology scheduling

Specifically, that we always schedule using the master branch.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Improve missing branch detection and logging

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Add unit tests for repo_utils

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Use 'ceph-qa-suite.git' for the repo name

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Also handle teuthology repo checkouts

Our shell script did this also.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Handle ceph-qa-suite checkouts

Previously we had an internally-maintained shell script that did this.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Generalize error message

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Fix linter errors

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Move repo checkout code to new module repo_utils

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Use a more informative variable name for dest_path

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Merge pull request #274 from dachary/wip-facet

document how to specify a facet in teuthology-suite

document how to specify a facet in teuthology-suite

Signed-off-by: Loic Dachary <loic@dachary.org>

Only delete jobs that match the pattern

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Swap order of job_id and run_name when deleting

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Skip the kernel stanza if the branch passed is '-'

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Add more docstrings

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

No need to explicitly return None here

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Update unit tests to reflect renamed function

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Add a few more docstrings and a debug statement

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Fix a couple linter errors

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Remove schedule_suite.sh

Its entire functionality is now provided by teuthology-schedule.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Fix bug where the base yaml wasn't being merged

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

With dry_run, quote any individual args

So that individual commands can be copied and pasted
in order to execute them individually.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Add lots of unit tests for teuthology.suite

More to come...

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Raise ScheduleFailError even if not sending email

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Do everything that schedule_suite.sh does

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Add default results_email

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Don't schedule an email job if email isn't set

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Split prepare_and_schedule() out of main()

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Use the return value of schedule_suite()

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Organize arguments into logical sections

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Tweak usage formatting

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Don't reread the entire yaml file...

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Remove unused functions

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

'and' is a thing

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Take machine_type instead of worker

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Add functions for querying gitbuilder repos

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Silence connection pool logging

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Remove 'template' feature

Neither Sage nor I could find anything that used it

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Only allow scheduling one suite per call.

Also remove all traces of the extra and confusing term 'collection'

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Port to docopt

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Refactor collection scheduling out of main()

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

If archive_base is None, use config's

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Merge pull request #272 from ceph/release

Create a python package for teuthology

Update setup.py

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Allow killing jobs by passing a 'jobspec'.

See teuthology-kill --help

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Add a couple tests for teuthology.schedule

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Make conf_file optional

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Add .ropeproject to .gitignore

I use a vim plugin that creates lots of directories with that name

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Add [--] to usage statement

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Automatically watch 'multi' tube if tube_name

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Merge pull request #270 from ceph/wip-schedule-suite

Refactor teuthology.schedule...

Refactor teuthology.schedule...

... to separate the assembling of the job config from the scheduling of
the job. Also port its argument parsing to docopt.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Remote 'delete' and 'show' features

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Remove unused import

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Merge pull request #268 from ceph/wip-5400

Support installing ceph kernels from gitbuilder on rpm machines.

Better variable names.

As suggested by review.

Signed-off-by: Sandon Van Ness <sandon@inktank.com>

Disable "fix" for corrupt repo detection

It's causing more problems than it's solving at this point

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Use correct cwd

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Merge pull request #269 from ceph/wip-radosfix

rados: Add hit_set_list missing from possible op weights

Update to reflect relocated get_jobs()

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

rados: Add hit_set_list missing from possible op weights

For the future help keep in sync with test/osd/TestRados.cc by listing
in order of op_types in that code.

Signed-off-by: David Zafman <david.zafman@inktank.com>

Move teuthology-ls's implementation to ls.py

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Fix corrupt repo detection

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Added requested comment.

Signed-off-by: Sandon Van Ness <sandon@inktank.com>

Remove unused variables and functions.

Signed-off-by: Sandon Van Ness <sandon@inktank.com>

Remove unused import

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Update --help output

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Support installing ceph kernels from gitbuilder on rpm machines.

Signed-off-by: Sandon Van Ness <sandon@inktank.com>

Merge pull request #267 from ceph/wip-runxfstests

wip-runxfstests

Reviewed-by: Josh Durgin <josh.durgin@inktank.com>

Add a timeout for unmounting

Ten minutes seems like it might be longer than necessary, but I doubt
it's too short.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Merge pull request #265 from ceph/wip-orchestra

Refactor teuthology.orchestra.run

Remove some duplicate code.

Well, not exactly duplicate, but functionally compatible. No sense in
maintaining two "walk the filesystem to assemble job information"
utilities.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Try a different approach to zombie prevention

The previous method I had committed had the unfortunate side-effect of
preventing teuthology job processes from giving their returncode to the
worker process. This method shouldn't do that.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

radosgw-admin: adjust bucket link interface

Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>

rbd: change test_script to run_xfstests_krbd.sh

Invoke run_xfstests.sh through a wrapper, which supplies an exclusion
list, in order to skip tests we don't want to run.

Signed-off-by: Ilya Dryomov <ilya.dryomov@inktank.com>

rbd: recognize 'randomize' parameter

randomize (default: false) randomizes xfstests test order.

Signed-off-by: Ilya Dryomov <ilya.dryomov@inktank.com>

Merge pull request #266 from ceph/wip-8489

Give daemons a five-minute timeout for stopping

Reviewed-by: Sage Weil <sage@inktank.com>

Give daemons a five-minute timeout for stopping

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Add RemoteProcess.__repr__()

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Update users of the teuthology.orchestra.run APIs

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Refactor teuthology.orchestra.run

RemoteProcess behaves more like subprocess.Popen, with some important
differences.

A summary of the API changes:
* RemoteProcess.exitstatus is either an int or None; it is never a callable
  nor a gevent.AsyncResult.
* New method: RemoteProcess.execute()
* New method: RemoteProcess.poll()
* New method: RemoteProcess.wait()
* New attribute: RemoteProcess.returncode - alias to exitstatus
* New property: RemoteProcess.finished - added because returncode can be None
  if the connection was interrupted
* run.execute() is removed.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Avoid piles of zombies

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Add comment explaining 'preexec_fn=os.setpgrp'

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Check for broken repos before updating

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

More verbose logging for daemon restarts

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Bump log level to info

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Don't block on teuthology-results processes

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Correct logging when running teuthology-results

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Merge pull request #263 from qakapil/patch-two

updated the get_system_type function

updated the get_system_type function

updated the get_system_type function
to add the rpm condition for SUSE.

Signed-off-by: ksharma@suse.com