]> git-server-git.apps.pok.os.sepia.ceph.com Git - ceph.git/commit
projects / ceph.git / commit
? search:
summary | shortlog | log | commit | commitdiff | tree
(parent: c837584) | patch
rgw: improve the efficiency of buffer list utilization of chunk upload 53266/head
authorliubingrun <liubr1@chinatelecom.cn>
Sun, 3 Sep 2023 18:29:47 +0000 (14:29 -0400)
committerliubingrun <liubr1@chinatelecom.cn>
Sun, 24 Sep 2023 19:43:18 +0000 (15:43 -0400)
commite47bb22f69ee83479431994ce6514bb739f5dd98
tree6985a1b412e810c0438ed231d1a640659cc9c26btree | snapshot
parentc8375842074b713c14a0768a018b27ccbdbbd0d0commit | diff
rgw: improve the efficiency of buffer list utilization of chunk upload

Reduced waste of buffer::ptr by receiving multiple chunks and filling them into the buffer

AWSv4ComplMulti::recv_body() just receive one chunk and fill it into buffer.
Each 4MB buffer is actually only utilizing 64KB, leading to frequent buffer allocations.
~800GB virtual memory consumption has been observed.

Signed-off-by: liubingrun <liubr1@chinatelecom.cn>
src/rgw/rgw_auth_s3.cc diff | blob | history
src/rgw/rgw_auth_s3.h diff | blob | history
Unnamed repository; edit this file 'description' to name the repository.