Merge pull request #38853 from dzafman/wip-48843

osd: Try other PGs when reservation failures occur

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>

diff --cc PendingReleaseNotes
index 5840d027631fb8706ecc91c1606a282a708e70e8,a2395da4430765e9960b3411d410913945e9db4a..77ba3c8fa6d7be3bb7b5e083e2ce3a410475cfe8
--- 1/PendingReleaseNotes
--- 2/PendingReleaseNotes
+++ b/PendingReleaseNotes
@@@ -83,11 -83,10 +83,14 @@@
    the OSD to notify the monitor it is shutting down even if ``osd_fast_shutdown``
    is enabled. This helps with the monitor logs on larger clusters, that may get
    many 'osd.X reported immediately failed by osd.Y' messages, and confuse tools.
 +* rgw/kms/vault: the transit logic has been revamped to better use
 +  the transit engine in vault.  To take advantage of this new
 +  functionality configuration changes are required.  See the current
 +  documentation (radosgw/vault) for more details.
  
+ * Scubs are more aggressive in trying to find more simultaneous possible PGs within osd_max_scrubs limitation.
+   It is possible that increasing osd_scrub_sleep may be necessary to maintain client responsiveness.
+ 
  >=15.0.0
  --------