From: Patrick Donnelly Date: Tue, 10 Sep 2019 19:39:56 +0000 (-0700) Subject: doc/dev: add teuthology priority recommendations X-Git-Tag: v15.1.0~1614^2 X-Git-Url: http://git.apps.os.sepia.ceph.com/?a=commitdiff_plain;h=3bb68e89f4b385e61473151bb4584a65d173554f;p=ceph-ci.git doc/dev: add teuthology priority recommendations Signed-off-by: Patrick Donnelly --- diff --git a/doc/dev/developer_guide/index.rst b/doc/dev/developer_guide/index.rst index fe07ffbc938..c95aaa105b3 100644 --- a/doc/dev/developer_guide/index.rst +++ b/doc/dev/developer_guide/index.rst @@ -842,6 +842,36 @@ test results URL and in the first column of the Pulpito dashboard. The results are also reported on the `ceph-qa mailing list `_ for analysis. +Testing Priority +---------------- + +The ``teuthology-suite`` command includes an almost mandatory option ``-p `` +which specifies the priority of the jobs submitted to the queue. The lower +the value of ``N``, the higher the priority. The option is almost mandatory because +the default is ``1000`` which matches the priority of the nightlies. Nightlies +are often half-finished and cancelled due to the volume of testing done so your +jobs may never finish. Therefore, it is common to select a priority less than +1000. + +Any priority may be selected when submitting jobs. But, in order to be +sensitive to the workings of other developers that also need to do testing, +the following recommendations should be followed: + +* **Priority < 10:** Use this if the sky is falling and some group of tests must be run ASAP. + +* **10 <= Priority < 50:** Use this if your tests are urgent and blocking other important development. + +* **50 <= Priority < 75:** Use this if you are testing a particular feature/fix and running fewer than about 25 jobs. + +* **75 <= Priority < 100:** Tech Leads will regularly schedule integration tests with this priority to verify pull requests against master. + +* **100 <= Priority < 150:** This priority is to be used for release QA. + +* **150 <= Priority < 200:** Use this priority for 100 jobs or fewer of a particular feature/fix that you'd like results on in a day or so. + +* **200 <= Priority < 1000:** Use this priority for large test runs that can be done over the course of a week. + + Suites inventory ^^^^^^^^^^^^^^^^