Use uname -m instead of uname -p

Debian hosts were reporting as 'unknown'

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

All BaseExceptions should hit failure codepath

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Move VersionNotFoundError to exceptions module

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Move ScheduleFailError to exceptions module

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Use os_type and os_version in lock_machines()

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Query os_type and os_version in lock_many()

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Remove default for --os-type

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Add OS.__repr__() and OS.to_dict()

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Move OS class to its own files

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

tasks/nfs: sync before unmounting or unexporting nfs clients/servers

We have some hope that this will resolve #8576 in the Ceph tracker.

Signed-off-by: Greg Farnum <greg@inktank.com>
Reviewed-by: Sage Weil <sage@redhat.com>

Bump requests version to >= 2.3.0

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Allow mixing of bare-metal machine_types

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Merge pull request #335 from ceph/wip-kernel-downgrade

Fix RPM kernel downgrade.

nfs: more lsof output, on clients too

Signed-off-by: Greg Farnum <greg@inktank.com>

Revert "Move default os_type to misc.get_distro()"

This reverts commit 3675a2e25c5d9a370922b714871492f31ed1783d.

Revert "Add os_type and os_version args to lock_many()"

This reverts commit f39b6958c4dd94f7e682833f4cf3122c4537dcde.

Merge pull request #337 from ceph/wip-9597

lock.py: Log failing os-version if it doesn't validate

lock.py: Log failing os-version if it doesn't validate

Fixes: #9597
Signed-off-by: Dan Mick <dan.mick@inktank.com>

Add 'lsb_release -a' parsing back to remote.OS

It can now parse either that or /etc/os-release, and remote.Remote will
attempt the latter first.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Add os_type and os_version args to lock_many()

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Move default os_type to misc.get_distro()

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Merge pull request #336 from ceph/wip-nfs

enable lsof when unmounting nfs clients

enable lsof when unmounting nfs clients

Because the lsof interface is strange, use the verbose flag so we get
some output even if there is no use, and ignore errors because it will
return 1 if there's no filesystem use.

Signed-off-by: Greg Farnum <greg@inktank.com>

Fix RPM kernel downgrade.

Force even if an older version or existing.

Signed-off-by: Sandon Van Ness <sandon@inktank.com>

Merge pull request #334 from ceph/wip-9519-wusui

Handle list-json downburst failure.

Refuse to schedule jobs with 'multi' machine_type

That's not a real machine_type - it's a beanstalkd tube that is used
when a machine_type like 'plana,mira,burnupi' is used.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Raise ConnectionLostError when the socket dies

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Handle list-json downburst failure.

Use check_output instead of Popen and communicate()
Fixes: #9519
Signed-off-by: Warren Usui <warren.usui@inktank.com>

Improve os-release parsing

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Rewrite teuthology-updatekeys

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Skip hostname test

Due to the workaround put in place recently

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Re-implement Distribution as OS

It now uses /etc/os-release instead of lsb_release, like the cool kids
are doing.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Merge pull request #328 from ceph/wip-8700-wusui

Use docopts to parse daemon-helper

Merge pull request #333 from ceph/wip-9495-wusui

Run chef before operations that need it.

Merge pull request #331 from ceph/wip-transport-none

orchestra: fix ConnectionLostError path in wait()

Add a workaround for Remote.hostname

Since 'hostname --fqdn' isn't working reliably

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Run chef before operations that need it.

Chef, if it is needed, should be run before kernel tasks
and before all other user defined tasks.  It should not be
run by default.

Fixes: 9495
Signed-off-by: Warren Usui <warren.usui@inktank.com>

Fix daemon-helper argument parsing.

Fixes: 8700
Signed-off-by: Warren Usui <warren.usui@inktank.com>

Merge pull request #332 from ceph/wip-yaml-path

teuthology-suite: fix handling of extra YAML files

teuthology-suite: fix handling of extra YAML files

Previously these had to be absolute paths, or relative
paths had to be present in the pwd and in ceph-qa-suite.

With this change you can now pass a relative path
like 'debug/mds_client.yaml' to reference a debug
fragment from ceph-qa-suite.

Signed-off-by: John Spray <john.spray@redhat.com>

orchestra: fix ConnectionLostError path in wait()

Sometimes it would generate AttributeError instead
when it tried to call is_active() on None.

Signed-off-by: John Spray <john.spray@redhat.com>

Merge pull request #326 from ceph/wip-9318-wusui

Avoid running chef automatically.

Merge pull request #297 from ceph/wip-8712-wusui

Check os-type and os-version for vps

Make push_inventory() a regular function

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Avoid running chef automatically

teuthology --lock formerly automatically ran chef on startup of
virtual machines. This covered up a bug where ceph-deploy would
not install properly. These changes remove the automatic running
of chef, and fixed some related issues when setting up keys on
virtual machines.

Fixes 9318:
Signed-off-by: Warren Usui <warren.usui@inktank.com>

Use teuthology.task.internal.push_inventory

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Add push_inventory() subtask

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Add lock.update_inventory()

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Add Remote.inventory_info

A property that returns a dict of attributes in the format that the
paddles lock server likes.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Add Remote.host_key

Turns out we can easily grab the ssh key from paramiko once a connection
is established.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Set Remote.hostname by asking the host itself

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Add Remote.arch

Returns the result of 'uname -p'

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Add caching lsb_release parser

In far too many places do we remotely exec lsb_release in some form,
then parse the output. In shifting to a more stable interface between
teuthology and its tasks, this seemed important to me.

Remote objects now have a 'distro' property that, when first accessed,
calls 'lsb_release -a' remotely and parses the results.

I've included tests and documentation.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Check os-type and os-version for vps

Fixes: 8712
Signed-off-by: Warren Usui warren.usui@inktank.com

Merge pull request #327 from dachary/wip-exec-documentation

documentation: updates to the exec tasks

documentation: updates to the exec tasks

* Quoting is important
* Behavior on error

Signed-off-by: Loic Dachary <loic-201408@dachary.org>

In Remote.run(), attempt to reconnect if necessary

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Move more exceptions

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

valgrind: suppress tcmalloc crap for centos 6.5

Fixes: #9336
Signed-off-by: Sage Weil <sage@redhat.com>

Remove unnecessary filter in do_update_keys()

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Don't explode if get_status fails

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Merge pull request #325 from ceph/wip-valgrind

valgrind: use --time-stamp=yes

valgrind: adjust suppressions for wheezy

Signed-off-by: Sage Weil <sage@redhat.com>

valgrind: use --time-stamp=yes

This doesn't help on the precise version, but maybe it will on
future versions... because if so, it would be really helpful
it matching valgrind errors to daemon logs!

In any case, though, I verified it is at worse harmless.

Signed-off-by: Sage Weil <sage@redhat.com>

Update downburst docs.

Signed-off-by: Sandon Van Ness <sandon@inktank.com>

Merge pull request #324 from ceph/wip-hadoop-nuke

nuke: kill hadoop processes

nuke: kill hadoop processes

Signed-off-by: John Spray <john.spray@redhat.com>

Drop --allow-hosts None

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Use setuptools, not distribute

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Merge pull request #323 from ceph/pypi

Prepare for PyPI

Reviewed-by: Sage Weil <sage@redhat.com>

Add install_requires and tests_require

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Add MANIFEST.in

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Add LICENSE

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Merge pull request #308 from ceph/wip-6146-wusui

Add ability to update with ceph-deploy

Merge pull request #314 from ceph/wip-8923

Speed up teuthology-kill.

Add more info in comments.

Signed-off-by: Sandon Van Ness <sandon@inktank.com>

Merge pull request #319 from ceph/wip-8231

remote: Add ability to push a file to a remote machine

Merge pull request #299 from ceph/wip-7810

Wip 7810

orchestra: more docstring

Signed-off-by: John Spray <john.spray@redhat.com>

orchestra: fine tune docstrings.

Signed-off-by: John Spray <john.spray@redhat.com>

Don't explode on ConnectionError in list_locks()

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

remote: Add ability to push a file to a remote machine

Add put_file() and _sftp_put_file() without sudo support

Signed-off-by: David Zafman <dzafman@redhat.com>

Merge pull request #317 from dachary/wip-nuke-on-error

convert nuke-on-error to boolean

Merge pull request #321 from ceph/wip-install

install libcephfs-java

Only pass lists to ssh_keyscan()

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

More hostname normalization

This time, for ssh_keyscan()

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

For clones, look for error regardless of exit code

This fixes a bug on older git versions, where it would happily cloen a
repo and give you the wrong branch if the one you requested did not
exist.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Normalize input hostnames in various functions

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

task/install: install libcephfs-java (deb)

Accidentally removed in 0c75c6b1f7654b5a9b45d73c6b6aa47a523e1841

Signed-off-by: Sage Weil <sage@redhat.com>

task/install: move package list to top of file

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #320 from ceph/wip-sort-brief

lock.py: sort --brief output by status['name']

lock.py: sort --brief output by status['name']

Signed-off-by: Dan Mick <dan.mick@inktank.com>

Fix a linter error

Wasn't much of a bug, but still.

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Fix module reference

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Hostname handling for updatekeys

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Exit with code already returned by lock.main()

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Less dangerous hostname mangling

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Fix --unlock

Note to self: clean up user/ctx.owner confusion

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Return old-style hostnames from lock_many()

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>

Don't "import misc as teuthology"

Signed-off-by: Zack Cerza <zack.cerza@inktank.com>