qa: timeout thrasher if fs does not stabilize

After 5 minutes of waiting, it's reasonable to stop as the cluster is
probably stuck.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>

diff --git a/qa/tasks/mds_thrash.py b/qa/tasks/mds_thrash.py
index c9f25451da0c3339a1c348408995fbc3f09ddd24..b697125d6f837bd96fb46557e7375cda627639d3 100644 (file)
--- a/qa/tasks/mds_thrash.py
+++ b/qa/tasks/mds_thrash.py
@@ -187,7 +187,9 @@ class MDSThrasher(Greenlet):
                     self.log('mds cluster has {count} alive and active, now stable!'.format(count = count))
                     return status, None
             itercount = itercount + 1
-            if itercount > 10:
+            if itercount > 300/2: # 5 minutes
+                 raise RuntimeError('timeout waiting for cluster to stabilize')
+            elif itercount > 10:
                 self.log('mds map: {status}'.format(status=self.fs.status()))
             time.sleep(2)
             status = self.fs.status()