git-server-git.apps.pok.os.sepia.ceph.com Git

author	liubingrun <liubr1@chinatelecom.cn>
	Sun, 3 Sep 2023 18:29:47 +0000 (14:29 -0400)
committer	Casey Bodley <cbodley@redhat.com>
	Mon, 2 Oct 2023 20:22:01 +0000 (16:22 -0400)
commit	e629b717b42fe75ec14d90d825578729de9dbab2
tree	822f7635984935fa27d9a21516225aded77021c6	tree \| snapshot
parent	7cd99ce428fa36b28345615983ecfd3d24e90eba	commit \| diff

rgw: improve the efficiency of buffer list utilization of chunk upload

Reduced waste of buffer::ptr by receiving multiple chunks and filling them into the buffer

AWSv4ComplMulti::recv_body() just receive one chunk and fill it into buffer.
Each 4MB buffer is actually only utilizing 64KB, leading to frequent buffer allocations.
~800GB virtual memory consumption has been observed.

Signed-off-by: liubingrun <liubr1@chinatelecom.cn>
(cherry picked from commit e47bb22f69ee83479431994ce6514bb739f5dd98)

src/rgw/rgw_auth_s3.cc		diff \| blob \| history
src/rgw/rgw_auth_s3.h		diff \| blob \| history