Richael Zhuang 9bff828f99 sock: introduce dynamic zerocopy according to data size ... MSG_ZEROCOPY is not always effective as mentioned in https://www.kernel.org/doc/html/v4.15/networking/msg_zerocopy.html. Currently in spdk, once we enable sendmsg zerocopy, then all data transferred through _sock_flush are sent with zerocopy, and vice versa. Here dynamic zerocopy is introduced to allow data sent with MSG_ZEROCOPY or not according to its size, which can be enabled by setting "enable_dynamic_zerocopy" as true. Test with 16 P4610 NVMe SSD, 2 initiators, target's and initiators' configurations are the same as spdk report: https://ci.spdk.io/download/performance-reports/SPDK_tcp_perf_report_2104.pdf For posix socket, rw_percent=0(randwrite), it has 1.9%~8.3% performance boost tested with target 1~40 cpu cores and qdepth=128,256,512. And it has no obvious influence when read percentage is greater than 50%. For uring socket, rw_percent=0(randwrite), it has 1.8%~7.9% performance boost tested with target 1~40 cpu cores and qdepth=128,256,512. And it still has 1%~7% improvement when read percentage is greater than 50%. The following is part of the detailed data. posix: qdepth=128 rw_percent 0 | 30 cpu origin thisPatch opt | origin thisPatch opt 1 286.5 298.5 4.19% 307 304.15 -0.93% 4 1042.5 1107 6.19% 1135.5 1136 0.04% 8 1952.5 2058 5.40% 2170.5 2170.5 0.00% 12 2658.5 2879 8.29% 3042 3046 0.13% 16 3247.5 3460.5 6.56% 3793.5 3775 -0.49% 24 4232.5 4459.5 5.36% 4614.5 4756.5 3.08% 32 4810 5095 5.93% 4488 4845 7.95% 40 5306.5 5435 2.42% 4427.5 4902 10.72% qdepth=512 rw_percent 0 | 30 cpu origin thisPatch opt | origin thisPatch opt 1 275 287 4.36% 294.4 295.45 0.36% 4 979 1041 6.33% 1073 1083.5 0.98% 8 1822.5 1914.5 5.05% 2030.5 2018.5 -0.59% 12 2441 2598.5 6.45% 2808.5 2779.5 -1.03% 16 2920.5 3109.5 6.47% 3455 3411.5 -1.26% 24 3709 3972.5 7.10% 4483.5 4502.5 0.42% 32 4225.5 4532.5 7.27% 4463.5 4733 6.04% 40 4790.5 4884.5 1.96% 4427 4904.5 10.79% uring: qdepth=128 rw_percent 0 | 30 cpu origin thisPatch opt | origin thisPatch opt 1 270.5 287.5 6.28% 295.75 304.75 3.04% 4 1018.5 1089.5 6.97% 1119.5 1156.5 3.31% 8 1907 2055 7.76% 2127 2211.5 3.97% 12 2614 2801 7.15% 2982.5 3061.5 2.65% 16 3169.5 3420 7.90% 3654.5 3781.5 3.48% 24 4109.5 4414 7.41% 4691.5 4750.5 1.26% 32 4752.5 4908 3.27% 4494 4825.5 7.38% 40 5233.5 5327 1.79% 4374.5 4891 11.81% qdepth=512 rw_percent 0 | 30 cpu origin thisPatch opt | origin thisPatch opt 1 259.95 276 6.17% 286.65 294.8 2.84% 4 955 1021 6.91% 1070.5 1100 2.76% 8 1772 1903.5 7.42% 1992.5 2077.5 4.27% 12 2380.5 2543.5 6.85% 2752.5 2860 3.91% 16 2920.5 3099 6.11% 3391.5 3540 4.38% 24 3697 3912 5.82% 4401 4637 5.36% 32 4256.5 4454.5 4.65% 4516 4777 5.78% 40 4707 4968.5 5.56% 4400.5 4933 12.10% Signed-off-by: Richael Zhuang <richael.zhuang@arm.com> Change-Id: I730dcf89ed2bf3efe91586421a89045fc11c81f0 Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/12210 Community-CI: Broadcom CI <spdk-ci.pdl@broadcom.com> Community-CI: Mellanox Build Bot Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Aleksey Marchuk <alexeymar@nvidia.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>		2022-04-28 07:29:28 +00:00
..
accel_engine	test/accel_engine: add more test cases	2021-09-01 07:34:02 +00:00
app	test/llvm_nvme_fuzz: add nvm reservation command test cases	2022-04-20 08:20:14 +00:00
bdev	test/bdevio: Update reset test	2022-04-20 08:21:15 +00:00
blobfs	test/blobfs: update rocksdb version	2021-12-14 13:23:30 +00:00
blobstore	blob: blobcli should use hex for blob IDs	2022-02-01 20:05:13 +00:00
common	pkgdep/centos: fix centos routines for installing the packages	2022-04-26 07:47:27 +00:00
compress	test/nvmf: use recommended nvmf_create_subsystem rpc	2021-05-20 15:00:22 +00:00
cpp_headers	queue_extras: use SPDK_CONTAINEROF	2019-10-07 15:06:01 +00:00
dd	test/dd: Simple tests utilizing uring RPCs	2021-12-20 08:46:13 +00:00
dma	bdev: pull/push data if bdev doesn't support	2022-04-04 09:57:56 +00:00
dpdk_memory_utility	check_format: Ignore shellcheck's SC2128 and SC2178 directives	2021-06-30 22:43:05 +00:00
env	env/memory: fix unregistration of memory after memory registration issue	2022-03-09 09:06:30 +00:00
event	scripts: move python modules to python directory	2022-04-05 14:40:47 +00:00
external_code	autobuild.sh: do not use sudo to run make in external code test	2022-03-14 08:43:50 +00:00
ftl	autotest: Skip use of any zoned nvme devices	2021-12-06 08:34:46 +00:00
fuzz	nvme_fuzz: pass trid on command line only	2021-09-27 10:55:34 +00:00
interrupt	scripts: move python modules to python directory	2022-04-05 14:40:47 +00:00
ioat	build: Example applications build to build/example	2020-06-15 15:27:16 +00:00
iscsi_tgt	test/iscsi_tgt: add iptables entry to forward packets	2022-04-19 08:17:19 +00:00
json_config	scripts: move python modules to python directory	2022-04-05 14:40:47 +00:00
lvol	spelling: test	2021-12-03 08:13:22 +00:00
make	so_ver: increase all major versions	2022-01-31 15:29:56 +00:00
nvme	scripts: fix PYTHONPATH references to scripts/ directory	2022-04-18 17:22:09 +00:00
nvmf	nvme/rdma: Add async set/get registers	2022-04-22 09:44:57 +00:00
ocf	ocf/rpc: Add RPC method to manage sequential cutoff	2022-04-01 08:31:32 +00:00
openstack	test/openstack: restart whole devstack before tests	2021-12-23 08:36:21 +00:00
pmem	spelling: test	2021-12-03 08:13:22 +00:00
rpc	scripts: move python modules to python directory	2022-04-05 14:40:47 +00:00
rpc_client	build: use DEPDIRS variables to build SPDK_LIB_LIST	2020-12-18 09:40:01 +00:00
rpc_plugins	autotest: Use rpc_cmd() for rpc plugin-based tests	2021-04-02 08:22:42 +00:00
scheduler	test/scheduler: Don't fail if cgroups don't exist in move_cgroup_procs()	2022-03-09 08:02:55 +00:00
setup	scripts/setup: Skip devices which have any valid data present	2022-04-06 07:21:17 +00:00
spdkcli	test/nvmf: Remove support for soft-RoCE setups	2022-03-22 16:01:54 +00:00
thread	test/thread: Add poller_perf to evaluate cost to run poller	2021-08-20 07:29:42 +00:00
unit	sock: introduce dynamic zerocopy according to data size	2022-04-28 07:29:28 +00:00
vfio_user	test/vfio_user: Remove subsystem listener while VM is connected, issue #2246 autotest.	2022-02-18 00:00:22 +00:00
vhost	test/vhost: Fix vhost migration tc1 test	2022-04-15 08:24:59 +00:00
vmd	test: replace VMD_WHITELIST with VMD_ALLOWED	2020-12-03 09:41:07 +00:00
Makefile	test/dma: Add functional test to verify DMA	2021-09-24 07:37:45 +00:00
spdk_cunit.h	test: remove leftover spdk_cunit declaration	2018-07-06 22:47:56 +00:00