remove pdb

remove pdb

Fix

I'm an idjyut.  Backout previous change

remove twiddle refs.

Move trace

pdb

add comma

redirect ls

more changes

As ls for debugging

cd to right place

cd to ~/ceph-ansible

debug info

Add debugs for rhbuild

fix

Restored old setuptools and ansible_ver text.

broke up command and added log info

Fix typo in last change

Fix problem mentioned in 19425
run.Raw('"setuptools>=11.3"') needed to keep redirection from happening.

log and sleep

Add pdb for debug.

pdb debug step

Merge pull request #1124 from tchaikov/wip-more-mon-mgr-mkfs-grace

ceph.conf: prolong "mon mgr mkfs grace" to 2 minutes

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>

ceph.conf: prolong "mon mgr mkfs grace" to 2 minutes

it might take longer than 1 minutes to:
1. create a monmap
2. create the auth keyrings
3. prepare the osd devices and activate OSDs (fdisk,mkfs.xfs,ceph-osd --mkfs)
4. prepare the monitors (mkfs), and start them
5. start monitor

Signed-off-by: Kefu Chai <kchai@redhat.com>

Merge pull request #1121 from ceph/wip-cephmetrics

Add a cephmetrics task

ceph_ansible: Support custom cluster names

Signed-off-by: Zack Cerza <zack@redhat.com>

Add cephmetrics task

Deploys, then runs integration tests via tox.

Signed-off-by: Zack Cerza <zack@redhat.com>

ansible: Optional suffix for inventory filenames

So we can support e.g. YAML inventories.

Signed-off-by: Zack Cerza <zack@redhat.com>

ceph_ansible: Don't collect logs on non-Ceph hosts

If a job uses machines for something other than to install Ceph, avoid
attempting to collect Ceph logs - the job will fail.

Signed-off-by: Zack Cerza <zack@redhat.com>

Upgrade ansible

Signed-off-by: Zack Cerza <zack@redhat.com>

Upgrade pip-tools

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #1120 from ceph/wip-ansible-purge-fixc

update ansible package from ansible PPA

remove dependency packages the task added from testnode

Signed-off-by: Vasu Kulkarni <vasu@redhat.com>
F

Signed-off-by: Vasu Kulkarni <vasu@redhat.com>

update ansible package from ansible PPA

Signed-off-by: Vasu Kulkarni <vasu@redhat.com>

Merge pull request #1118 from ceph/wip-21737-shutdown-assert

ceph.conf: enable debug asserts on shutdown

Reviewed-by: Sage Weil <sage@redhat.com>

Merge pull request #934 from ceph/wip-daemon-helper-systemd

Changes for orchestra.daemon to work with systemd

DaemonGroup: Avoid using systemd by default

To use systemd, any tasks which create a DaemonGroup object must pass
use_systemd=True. This could be accomplished by looking for a flag in
the job config. Note that this option is mainly for regression testing;
it may be removed in the future, where the default is to use systemd
when possible.

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #1119 from ceph/wip-dbrst

downburst: Explicitly type our user-data

downburst: Explicitly type our user-data

Something broke for us in cloud-init 0.7.9. Turns out our user-data was
being interpreted as an octet-stream, as opposed to a cloud-config. Mark
it as a cloud-config, so that cloud-init will do the right thing once
more.

Signed-off-by: Zack Cerza <zack@redhat.com>

ceph.conf: enable debug asserts on shutdown

Signed-off-by: Greg Farnum <gfarnum@redhat.com>

Merge pull request #1117 from ceph/wip-umount-varlib

More work to allow mounting /var/lib/ceph to a testnode device

internal: Be okay with an empty /var/lib/ceph dir

Signed-off-by: David Galloway <dgallowa@redhat.com>

install: Always try to unmount /var/lib/ceph

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #1116 from ceph/wip-var-lib-ceph

install: Unmount /var/lib/ceph itself if needed

install: Unmount /var/lib/ceph itself if needed

We plan to mount a small logical volume to /var/lib/ceph.

Fixes: http://tracker.ceph.com/issues/20910
Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #1113 from ceph/wip-debug-shutdown

ceph.conf: osd_debug_shutdown=true

Merge pull request #1110 from ceph/wip-ceph-ansible-rgw-interface

[task/ceph-ansible]: Add required radosgw_interface due to ceph-ansible upstream changes

Merge pull request #1112 from ceph/wip-set-ansible-lib

task/ceph-ansible: copy purge-cluster to top-level directory for it to work

copy purge-cluster to top level dir for the playbook to work

Signed-off-by: Vasu Kulkarni <vasu@redhat.com>

ceph.conf: osd_debug_shutdown=true

The extra logging during osd shutdown is becoming optional; enable it in
qa.

Signed-off-by: Sage Weil <sage@redhat.com>

SystemDState: Use correct output_cmd for rgw

We had this right for systemctl commands, but not for the journalctl
command.

Signed-off-by: Zack Cerza <zack@redhat.com>

DaemonGroup.add_daemon(): Properly start daemons

For some reason we weren't calling restart() inside add_daemons() for
systemd.

Signed-off-by: Zack Cerza <zack@redhat.com>

SystemDState: Tweak logging

Signed-off-by: Zack Cerza <zack@redhat.com>

DaemonGroup: Don't use systemd with valgrind

Signed-off-by: Zack Cerza <zack@redhat.com>

DaemonGroup: Detect and use systemd

Don't rely on a configuration item to tell us whether or not to use
systemd.

Signed-off-by: Zack Cerza <zack@redhat.com>

Remote: add init_system property

So far, this only exists to answer the question: "does this host use
systemd?" - in which case it will return 'systemd'. Else it will return
None.

Signed-off-by: Zack Cerza <zack@redhat.com>

SystemDState: Treat PIDs as strings when killing

Signed-off-by: Zack Cerza <zack@redhat.com>

Split DaemonState in two

Put systemd stuff in SystemDState

Signed-off-by: Zack Cerza <zack@redhat.com>

orchestra/daemon: Convert to a subpackage

Signed-off-by: Zack Cerza <zack@redhat.com>

DaemonState: Raise on startup failure

Signed-off-by: Zack Cerza <zack@redhat.com>

DaemonState: Use consistent daemon IDs

Signed-off-by: Zack Cerza <zack@redhat.com>

DaemonState.check_status(): support systemd

Signed-off-by: Zack Cerza <zack@redhat.com>

DaemonState: Drop use of self.id

... we already had self.id_

Signed-off-by: Zack Cerza <zack@redhat.com>

DaemonGroup: Simplify setting self.use_init

Signed-off-by: Zack Cerza <zack@redhat.com>

orchestra/daemon: Tweak logging

Signed-off-by: Zack Cerza <zack@redhat.com>

DaemonState: Factor out PID discovery

Signed-off-by: Zack Cerza <zack@redhat.com>

DaemonState: Don't needlessly reset self.id

Signed-off-by: Zack Cerza <zack@redhat.com>

orchestra/daemon: Fix linter errors

Signed-off-by: Zack Cerza <zack@redhat.com>

DaemonState: factor out command generation

Signed-off-by: Zack Cerza <zack@redhat.com>

Changes for daemon-helper to work with systemd

when cluster is setup using ceph-ansible or ceph-deploy
use systemd commands to kill/revive deamons.

Signed-off-by: Vasu Kulkarni <vasu@redhat.com>

Add required radosgw_interface due to ceph-ansible upstream changes

Signed-off-by: Vasu Kulkarni <vasu@redhat.com>

Merge pull request #1111 from ceph/wip-pg-limit

ceph.conf: set new pg max per osd limit

ceph.conf: set new pg max per osd limit

This is replacing the old one, but we need to keep the old one for
upgrades etc.

Signed-off-by: Sage Weil <sage@redhat.com>

Merge pull request #1091 from ceph/wip-fix-cephlab-overrides

[ansible-doc-fix]: correct the doc to fix the overrides name

Merge pull request #1109 from ceph/wip-openstack-log

task/internal/syslog: blacklist openstack datasource log

task/internal/syslog: blacklist openstack datasource log

Caused OVH node jobs to fail when it shouldn't have

Signed-off-by: David Galloway <dgallowa@redhat.com>

Merge pull request #1107 from ceph/wip-prune-fail

prune: Optionally remove failed jobs entirely

prune: Use summary.yaml to determine age of job

If a job has been partially pruned, its directory's mtime will get
bumped, causing total removal to be delayed by potentially months.
Looking at the mtime of summary.yaml should provide results that are
more intuitive.

Signed-off-by: Zack Cerza <zack@redhat.com>

prune: Optionally remove failed jobs entirely

This works exactly like --pass, except it defaults to being disabled

Signed-off-by: Zack Cerza <zack@redhat.com>

Merge pull request #1101 from ceph/wip-ansible-fixes

[tasks/ceph-ansible]: use site.yml from the ceph-ansible repo

handle libselinux init issues similar to one seen in
https://bugzilla.redhat.com/show_bug.cgi?id=1364703

Signed-off-by: Vasu Kulkarni <vasu@redhat.com>

Default ansible version to 2.3.2

Signed-off-by: Vasu Kulkarni <vasu@redhat.com>

needs system-site-package since libselinux modules not available
from within virtualenv

Signed-off-by: Vasu Kulkarni <vasu@redhat.com>

Create rbd pool since it doesn't exist by default for luminous+ builds

Signed-off-by: Vasu Kulkarni <vasu@redhat.com>

use site.yml from the ceph-ansible repo

we have been using custome site.yml from within the task which is not
accurate when compared to the file provided by ceph-ansible repo, instead
use the sample file as the main playbook for tests.

Signed-off-by: Vasu Kulkarni <vasu@redhat.com>

Merge pull request #1106 from ceph/wip-remove-rwg-timeout

Removed default_idle_timeout

Removed default_idle_timeout

Fixes http://tracker.ceph.com/issues/21140

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>

Merge pull request #1093 from rzarzynski/wip-cwd-in-remote-process

RemoteProcess: command can be now executed in specified directory.

RemoteProcess: add an unit test for the cwd parameter.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>

Merge pull request #1102 from zenglg/master

Supprted for CentOS

python-pip --> python2-pip

In CentOS, Fedora and Redhat, there is only python2-pip, no python-pip.

Supported for CentOS

Merge pull request #1096 from batrick/usage-fix

misc. doc/usage improvements

Merge pull request #1100 from ceph/wip-vps-disk

downburst: Decrease disk size to 100GB

downburst: Decrease disk size to 100GB

The first VPS on every VPSHOST runs off the VPSHOST root drive.  Because
of this, the root drive is filling up due to the addition of another OSD
drive: https://github.com/ceph/teuthology/pull/1099

This not only results in nagios alerts but could also result in needless
job failures.  OSD drives/partitions are already only 100G on smithi so
this should be fine.

Signed-off-by: David Galloway <dgallowa@redhat.com>

correct the doc to fix the overrides name

Signed-off-by: Vasu Kulkarni <vasu@redhat.com>

Merge pull request #1099 from ceph/wip-vps-add-osd

[teuthology/provision]: Increase number of drives for vps to 4

Increase number of drives to 4 per vm

Signed-off-by: Vasu Kulkarni <vasu@redhat.com>

ceph.conf: do not warn on mon_osd_down_out_interval=0

Signed-off-by: Sage Weil <sage@redhat.com>