ivampiresp/Spdk
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
549be9ad81
Spdk/mk/spdk.lib_deps.mk

188 lines
5.7 KiB
Makefile
Raw Normal View History

Replace most BSD 3-clause license text with SPDX identifier. Many open source projects have moved to using SPDX identifiers to specify license information, reducing the amount of boilerplate code in every source file. This patch replaces the bulk of SPDK .c, .cpp and Makefiles with the BSD-3-Clause identifier. Almost all of these files share the exact same license text, and this patch only modifies the files that contain the most common license text. There can be slight variations because the third clause contains company names - most say "Intel Corporation", but there are instances for Nvidia, Samsung, Eideticom and even "the copyright holder". Used a bash script to automate replacement of the license text with SPDX identifier which is checked into scripts/spdx.sh. Signed-off-by: Jim Harris <james.r.harris@intel.com> Change-Id: Iaa88ab5e92ea471691dc298cfe41ebfb5d169780 Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/12904 Community-CI: Broadcom CI <spdk-ci.pdl@broadcom.com> Community-CI: Mellanox Build Bot Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Aleksey Marchuk <alexeymar@nvidia.com> Reviewed-by: Changpeng Liu <changpeng.liu@intel.com> Reviewed-by: Dong Yi <dongx.yi@intel.com> Reviewed-by: Konrad Sztyber <konrad.sztyber@intel.com> Reviewed-by: Paul Luse <paul.e.luse@intel.com> Reviewed-by: <qun.wan@intel.com>
2022-06-03 19:15:11 +00:00
# SPDX-License-Identifier: BSD-3-Clause
update Intel copyright notices per Intel policy to include file commit date using git cmd below. The policy does not apply to non-Intel (C) notices. git log --follow -C90% --format=%ad --date default <file> | tail -1 and then pull just the 4 digit year from the result. Intel copyrights were not added to files where Intel either had no contribution ot the contribution lacked substance (ie license header updates, formatting changes, etc). Contribution date used "--follow -C95%" to get the most accurate date. Note that several files in this patch didn't end the license/(c) block with a blank comment line so these were added as the vast majority of files do have this last blank line. Simply there for consistency. Signed-off-by: paul luse <paul.e.luse@intel.com> Change-Id: Id5b7ce4f658fe87132f14139ead58d6e285c04d4 Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/15192 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Community-CI: Mellanox Build Bot
2022-11-01 20:26:26 +00:00
# Copyright (C) 2015 Intel Corporation.
module/accel: Add accel_dpdk_cryptodev The new module replaces functionality in vbdev_crypto. This module is bdev agnostic, so some inernal parts were reworked. io_channel: contains a qp of every configured DPDK PMD crypto key: for mlx5_pci we register a key on each available device since keys are bound to Protection Domain. Signed-off-by: Alexey Marchuk <alexeymar@nvidia.com> Change-Id: If1845cb87eadacbb921c593ba82207a97f2209a3 Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/14859 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Paul Luse <paul.e.luse@intel.com> Reviewed-by: Shuhei Matsumoto <smatsumoto@nvidia.com>
2022-10-04 19:18:18 +00:00
# Copyright (c) 2022 NVIDIA CORPORATION & AFFILIATES
mk: add a lib deps file. By adding this file and modifying the way we define a couple of variables in the makefiles, we can actually avoid having to redefine the library dependencies on a per file basis. Change-Id: Ieab4aa1021b0341fc21e3b65677a9ad7f70559c2 Signed-off-by: Seth Howell <seth.howell@intel.com> Reviewed-on: https://review.gerrithub.io/c/spdk/spdk/+/466063 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Broadcom SPDK FC-NVMe CI <spdk-ci.pdl@broadcom.com>
2019-08-22 17:26:08 +00:00
# All rights reserved.
#
make: start adding inter-lib dependencies. This will make it much easier to link against some subset of spdk libraries when building SPDK applications. Change-Id: I8ad95a001965288a8b5e38eb252391fef68d7138 Signed-off-by: Seth Howell <seth.howell@intel.com> Reviewed-on: https://review.gerrithub.io/c/spdk/spdk/+/465194 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2019-08-12 22:46:38 +00:00
# A quick note on organization:
#
# Each grouping is independent from itself. it depends only on libraries
# in the grouping above it. All dependencies are listed alphabetically within
# groups. The only exception to this is the JSON_LIBS grouping which is a special
# case since they almost always occur together.
JSON_LIBS := json jsonrpc rpc
lib/mk: update OCF build. The OCF build was broken by some of the recent changes to the Makefiles. This change aims to fix that by separating out the ocf environment from the ocf bdev. Change-Id: Id445340033898e9ae70a4bcfc799951110762d55 Signed-off-by: Seth Howell <seth.howell@intel.com> Reviewed-on: https://review.gerrithub.io/c/spdk/spdk/+/465808 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2019-08-20 16:58:45 +00:00
DEPDIRS-env_ocf :=
make: start adding inter-lib dependencies. This will make it much easier to link against some subset of spdk libraries when building SPDK applications. Change-Id: I8ad95a001965288a8b5e38eb252391fef68d7138 Signed-off-by: Seth Howell <seth.howell@intel.com> Reviewed-on: https://review.gerrithub.io/c/spdk/spdk/+/465194 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2019-08-12 22:46:38 +00:00
DEPDIRS-log :=
make: add dependencies for the rte_vhost build. The dependencies between vhost and rte_vhost were not added during earlier changes. This change moves the rte_vhost directory up to the level of the other libraries and adds the proper dependencies for when it is linked. Change-Id: I089de1cd945062b64975a0011887700c0e38bb0f Signed-off-by: Seth Howell <seth.howell@intel.com> Reviewed-on: https://review.gerrithub.io/c/spdk/spdk/+/467700 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Paul Luse <paul.e.luse@intel.com> Reviewed-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2019-09-06 16:34:34 +00:00
DEPDIRS-rte_vhost :=
make: start adding inter-lib dependencies. This will make it much easier to link against some subset of spdk libraries when building SPDK applications. Change-Id: I8ad95a001965288a8b5e38eb252391fef68d7138 Signed-off-by: Seth Howell <seth.howell@intel.com> Reviewed-on: https://review.gerrithub.io/c/spdk/spdk/+/465194 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2019-08-12 22:46:38 +00:00
build: fix missing dependency for env_dpdk Signed-off-by: Jacek Kalwas <jacek.kalwas@intel.com> Change-Id: I414a7bdb63990df6ae411b8b03f055b9ffecd41f Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/9009 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Community-CI: Mellanox Build Bot Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Changpeng Liu <changpeng.liu@intel.com> Reviewed-by: Aleksey Marchuk <alexeymar@mellanox.com>
2021-07-30 13:46:25 +00:00
DEPDIRS-env_dpdk := log util
build: add missing log dep for env_dpdk Signed-off-by: Jacek Kalwas <jacek.kalwas@intel.com> Change-Id: Ieab3a3851eea9c6c9db2ddbf74d59b17128c3f0f Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/6403 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Community-CI: Mellanox Build Bot
2021-02-12 18:34:35 +00:00
make: start adding inter-lib dependencies. This will make it much easier to link against some subset of spdk libraries when building SPDK applications. Change-Id: I8ad95a001965288a8b5e38eb252391fef68d7138 Signed-off-by: Seth Howell <seth.howell@intel.com> Reviewed-on: https://review.gerrithub.io/c/spdk/spdk/+/465194 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2019-08-12 22:46:38 +00:00
DEPDIRS-ioat := log
idxd: Add support for vectored copy operations Change-Id: Icb650129488b3cea76cf9082c02667f5b13b5ab4 Signed-off-by: Ben Walker <benjamin.walker@intel.com> Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/10286 Community-CI: Broadcom CI <spdk-ci.pdl@broadcom.com> Community-CI: Mellanox Build Bot Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Changpeng Liu <changpeng.liu@intel.com>
2021-11-16 22:11:47 +00:00
DEPDIRS-idxd := log util
sock/rpc: Add sock_impl_get/set_options RPC methods Signed-off-by: Evgeniy Kochetov <evgeniik@mellanox.com> Change-Id: If1193ef647c85b045d7f14a03a9942783583f553 Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/612 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Community-CI: Broadcom CI Community-CI: Mellanox Build Bot Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2020-01-28 19:24:46 +00:00
DEPDIRS-sock := log $(JSON_LIBS)
make: start adding inter-lib dependencies. This will make it much easier to link against some subset of spdk libraries when building SPDK applications. Change-Id: I8ad95a001965288a8b5e38eb252391fef68d7138 Signed-off-by: Seth Howell <seth.howell@intel.com> Reviewed-on: https://review.gerrithub.io/c/spdk/spdk/+/465194 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2019-08-12 22:46:38 +00:00
DEPDIRS-util := log
env/pci: call driver callback in pci_hook_device Now that we have a attach_device() callback, the devices can be hooked during spdk_pci_device_attach(). With DPDK, driver->cb_fn() is called in pci_device_init(), so we need to do the same in spdk_pci_hook_device(). Signed-off-by: Konrad Sztyber <konrad.sztyber@intel.com> Change-Id: Iada8b83ce7592aa62561530192072a50ec3a904b Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/13884 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Tom Nabarro <tom.nabarro@intel.com> Reviewed-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com>
2022-08-04 07:29:01 +00:00
DEPDIRS-vmd := log util
dma: Introduce memory domain Memory domain is used to describe memory which belongs to another address space (e.g. GPU memory or host memory) Memory domain can be configured with callbacks to translate data to another memory domain and to fetch data to local buffers. Memory domains will be used in extended bdev/nvme API added in the following patches. Change-Id: I0dcc7108a4fbf416a11575aa5cf5d7ec501b3d8b Signed-off-by: Alexey Marchuk <alexeymar@mellanox.com> Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/8126 Community-CI: Broadcom CI <spdk-ci.pdl@broadcom.com> Community-CI: Mellanox Build Bot Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Paul Luse <paul.e.luse@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com> Reviewed-by: Ziye Yang <ziye.yang@intel.com>
2021-04-26 06:29:38 +00:00
DEPDIRS-dma := log
lib/trace_parser: map/unmap the trace file Copied code responsible for mapping/unmapping the trace file. The only modifications were related with tying it to the spdk_trace_parser object. Signed-off-by: Konrad Sztyber <konrad.sztyber@intel.com> Change-Id: Ia575101532c612b185bd971c69157623b52b9e81 Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/9429 Community-CI: Broadcom CI <spdk-ci.pdl@broadcom.com> Community-CI: Mellanox Build Bot Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2021-08-30 14:02:50 +00:00
DEPDIRS-trace_parser := log
vfio_user: remove CONFIG_VFIO_USER flag for client library The client vfio_user library doesn't require this flag as it is totally owned in SPDK, so remove it. Change-Id: I8f7b1df18017ceac24dbb8a0417871f25f6bee0d Signed-off-by: Changpeng Liu <changpeng.liu@intel.com> Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/13895 Community-CI: Mellanox Build Bot Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Konrad Sztyber <konrad.sztyber@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2022-07-28 07:42:43 +00:00
ifeq ($(OS),Linux)
NVMe/vfio-user: add initial version vfio-user transport to NVMe driver When NVMf target linked with vfio-user library, we can use vfio-user client library to connect to the target. Here is the three examples that can work with target: identify -r 'trtype:VFIOUSER traddr:/var/run/muser/domain/muser0/8' -g perf -r 'trtype:VFIOUSER traddr:/var/run/muser/domain/muser0/8' -g -q 1 -o 4096 -w read -t 10 reconnect -r 'trtype:VFIOUSER traddr:/var/run/muser/domain/muser0/8' -g -q 32 -o 4096 -w randrw \ -M 50 -t 10 -c 0xE You can run the following test script test/nvmf/target/nvmf_vfio_user.sh to have a quick test, currently enabled with NVMe Identify,Perf,Reconnect tools. Change-Id: Ieb9842b2f372184fffbf7f23e4aad26feb47c350 Signed-off-by: Changpeng Liu <changpeng.liu@intel.com> Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/3839 Community-CI: Broadcom CI Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com>
2020-08-19 15:35:38 +00:00
DEPDIRS-vfio_user := log
vfio_user: remove CONFIG_VFIO_USER flag for client library The client vfio_user library doesn't require this flag as it is totally owned in SPDK, so remove it. Change-Id: I8f7b1df18017ceac24dbb8a0417871f25f6bee0d Signed-off-by: Changpeng Liu <changpeng.liu@intel.com> Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/13895 Community-CI: Mellanox Build Bot Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Konrad Sztyber <konrad.sztyber@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2022-07-28 07:42:43 +00:00
endif
ifeq ($(CONFIG_VFIO_USER),y)
lib/vfu_tgt: add library for PCI device emulation Previously SPDK use libvfio-user library to provide emulated NVMe devices to VM, but it's limited to NVMe device type only. Here we add SPDK vfu_target library abstraction based on libvfio-user which supports more PCI device types. We will add virtio-blk and virtio-scsi devices emulation based on vfu_tgt library in following patches, actually this library can support NVMe emulation too, due to the fact that the NVMe emulation is already exist, so we will keep the NVMe emulation which based on libvfio-user directly as it is. Change-Id: Ib0ead6c6118fa62308355fe432003dd928a2fae9 Signed-off-by: Changpeng Liu <changpeng.liu@intel.com> Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/12597 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Community-CI: Mellanox Build Bot Reviewed-by: Konrad Sztyber <konrad.sztyber@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2022-04-12 08:51:29 +00:00
DEPDIRS-vfu_tgt := log util thread $(JSON_LIBS)
NVMe/vfio-user: add initial version vfio-user transport to NVMe driver When NVMf target linked with vfio-user library, we can use vfio-user client library to connect to the target. Here is the three examples that can work with target: identify -r 'trtype:VFIOUSER traddr:/var/run/muser/domain/muser0/8' -g perf -r 'trtype:VFIOUSER traddr:/var/run/muser/domain/muser0/8' -g -q 1 -o 4096 -w read -t 10 reconnect -r 'trtype:VFIOUSER traddr:/var/run/muser/domain/muser0/8' -g -q 32 -o 4096 -w randrw \ -M 50 -t 10 -c 0xE You can run the following test script test/nvmf/target/nvmf_vfio_user.sh to have a quick test, currently enabled with NVMe Identify,Perf,Reconnect tools. Change-Id: Ieb9842b2f372184fffbf7f23e4aad26feb47c350 Signed-off-by: Changpeng Liu <changpeng.liu@intel.com> Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/3839 Community-CI: Broadcom CI Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com>
2020-08-19 15:35:38 +00:00
endif
make: start adding inter-lib dependencies. This will make it much easier to link against some subset of spdk libraries when building SPDK applications. Change-Id: I8ad95a001965288a8b5e38eb252391fef68d7138 Signed-off-by: Seth Howell <seth.howell@intel.com> Reviewed-on: https://review.gerrithub.io/c/spdk/spdk/+/465194 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2019-08-12 22:46:38 +00:00
DEPDIRS-conf := log util
DEPDIRS-json := log util
nvme/rdma: Use RDMA provider API to create/destroy qpair This patch adds use of RDMA provider API to NVMEoF initiator. Makefiles have been updated with new RDMA lib dependency Change-Id: Ieaefeb12ee9681d3db2b618c5cf0c54dc52230af Signed-off-by: Alexey Marchuk <alexeymar@mellanox.com> Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/1657 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Community-CI: Mellanox Build Bot Community-CI: Broadcom CI Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com>
2020-03-14 09:20:44 +00:00
DEPDIRS-rdma := log util
make: start adding inter-lib dependencies. This will make it much easier to link against some subset of spdk libraries when building SPDK applications. Change-Id: I8ad95a001965288a8b5e38eb252391fef68d7138 Signed-off-by: Seth Howell <seth.howell@intel.com> Reviewed-on: https://review.gerrithub.io/c/spdk/spdk/+/465194 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2019-08-12 22:46:38 +00:00
DEPDIRS-reduce := log util
lib/thread: trace (get|put) IO channel calls The traces record calls to spdk_(get|put)_io_channel() and saves the reference count of the IO channel and its context. The context, instead of an IO channel pointer, was selected because the same pointer is often used in other traces (e.g. nvmf's poll group), so it makes it possible to match these traces together. Signed-off-by: Konrad Sztyber <konrad.sztyber@intel.com> Change-Id: I15fe982a89685d8f6e23d406d6d48f5c2d9d604b Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/7232 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Community-CI: Mellanox Build Bot Reviewed-by: Aleksey Marchuk <alexeymar@mellanox.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2021-04-02 09:49:21 +00:00
DEPDIRS-thread := log util trace
nvme/rdma: Use RDMA provider API to create/destroy qpair This patch adds use of RDMA provider API to NVMEoF initiator. Makefiles have been updated with new RDMA lib dependency Change-Id: Ieaefeb12ee9681d3db2b618c5cf0c54dc52230af Signed-off-by: Alexey Marchuk <alexeymar@mellanox.com> Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/1657 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Community-CI: Mellanox Build Bot Community-CI: Broadcom CI Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com>
2020-03-14 09:20:44 +00:00
nvme: add tracing to pcie request path John Kariuki tested this patch on a system with several Intel P5800X Optane SSDs, to determine the performance impact of adding these two spdk_trace_records() in the main NVMe I/O path. The pathological case (512B random reads on a single Xeon core) decreased from 13.10M to 12.88M, or 1.7%. Normal workloads (4KB+) would incur a smaller penalty since the I/O rate would be much lower - maybe even unnoticeable.. This is a really valuable tracepoint to have enabled by default, so I think this small amount of degradation is acceptable. Signed-off-by: Jim Harris <james.r.harris@intel.com> Change-Id: Ie2543cadf3541eb74398d31ac0f495522ab49ec0 Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/9303 Community-CI: Broadcom CI <spdk-ci.pdl@broadcom.com> Community-CI: Mellanox Build Bot Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Changpeng Liu <changpeng.liu@intel.com> Reviewed-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com>
2021-08-25 17:04:51 +00:00
DEPDIRS-nvme := log sock util trace
vfio_user: remove CONFIG_VFIO_USER flag for client library The client vfio_user library doesn't require this flag as it is totally owned in SPDK, so remove it. Change-Id: I8f7b1df18017ceac24dbb8a0417871f25f6bee0d Signed-off-by: Changpeng Liu <changpeng.liu@intel.com> Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/13895 Community-CI: Mellanox Build Bot Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Konrad Sztyber <konrad.sztyber@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2022-07-28 07:42:43 +00:00
ifeq ($(OS),Linux)
DEPDIRS-nvme += vfio_user
endif
nvme/rdma: Use RDMA provider API to create/destroy qpair This patch adds use of RDMA provider API to NVMEoF initiator. Makefiles have been updated with new RDMA lib dependency Change-Id: Ieaefeb12ee9681d3db2b618c5cf0c54dc52230af Signed-off-by: Alexey Marchuk <alexeymar@mellanox.com> Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/1657 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Community-CI: Mellanox Build Bot Community-CI: Broadcom CI Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com>
2020-03-14 09:20:44 +00:00
ifeq ($(CONFIG_RDMA),y)
nvme/rdma: Create memory domain per Protection Domain Add a global list of memory domains with reference counter. Memory domains are used by NVME RDMA qpairs. Also refactor ibv_resize_cq in nvme_rdma_ut.c to stub Signed-off-by: Alexey Marchuk <alexeymar@mellanox.com> Change-Id: Ie58b7e99fcb2c57c967f5dee0417e74845d9e2d1 Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/8127 Community-CI: Broadcom CI <spdk-ci.pdl@broadcom.com> Community-CI: Mellanox Build Bot Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Paul Luse <paul.e.luse@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com> Reviewed-by: Ziye Yang <ziye.yang@intel.com>
2021-05-19 09:36:18 +00:00
DEPDIRS-nvme += rdma dma
nvme/rdma: Use RDMA provider API to create/destroy qpair This patch adds use of RDMA provider API to NVMEoF initiator. Makefiles have been updated with new RDMA lib dependency Change-Id: Ieaefeb12ee9681d3db2b618c5cf0c54dc52230af Signed-off-by: Alexey Marchuk <alexeymar@mellanox.com> Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/1657 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Community-CI: Mellanox Build Bot Community-CI: Broadcom CI Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com>
2020-03-14 09:20:44 +00:00
endif
make: start adding inter-lib dependencies. This will make it much easier to link against some subset of spdk libraries when building SPDK applications. Change-Id: I8ad95a001965288a8b5e38eb252391fef68d7138 Signed-off-by: Seth Howell <seth.howell@intel.com> Reviewed-on: https://review.gerrithub.io/c/spdk/spdk/+/465194 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2019-08-12 22:46:38 +00:00
blob: Add readv/writev ext ops to spdk_bs_dev Introduce spdk_blob_ext_io_opts structure which is used in the new *_ext functions. Zeroes dev is updated with implementation of readv_ext which uses memory domains memzero or regular memset(). Signed-off-by: Alexey Marchuk <alexeymar@mellanox.com> Change-Id: Id94542196eff999827bf00591fd43804256fccb4 Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/11369 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Community-CI: Mellanox Build Bot Community-CI: Broadcom CI <spdk-ci.pdl@broadcom.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Shuhei Matsumoto <smatsumoto@nvidia.com>
2022-01-31 08:53:15 +00:00
DEPDIRS-blob := log util thread dma
dma: add "virtual" accel memory domain This domain is meant to represent data being transformed by accel engine. Users will be able to allocate buffers from that memory domain and use them when appending operations to an accel sequence. Since these buffers are only meant to be used as placeholders for actual buffers, none of the push/pull/translate callbacks are implemented. To access the data after it was transformed by accel, users should make sure that the final command's destination buffer isn't allocated from accel memory domain. Signed-off-by: Konrad Sztyber <konrad.sztyber@intel.com> Change-Id: Ia031c7b205e98792d0a93f01513101b86afa9faa Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/15744 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2022-10-21 14:09:30 +00:00
DEPDIRS-accel := log util thread json rpc jsonrpc dma
make: start adding inter-lib dependencies. This will make it much easier to link against some subset of spdk libraries when building SPDK applications. Change-Id: I8ad95a001965288a8b5e38eb252391fef68d7138 Signed-off-by: Seth Howell <seth.howell@intel.com> Reviewed-on: https://review.gerrithub.io/c/spdk/spdk/+/465194 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2019-08-12 22:46:38 +00:00
DEPDIRS-jsonrpc := log util json
virtio/vfio_user: add virtio_blk device support Add vfio-user transport support based on existing virtio client library. Test steps using bdevperf: Start `spdk_tgt` with created virtio_blk device: 1. build/bin/spdk_tgt 2. scripts/rpc.py bdev_malloc_create -b malloc0 $((512)) 512 3. scripts/rpc.py vfu_virtio_create_blk_endpoint vfu.0 --bdev-name malloc0 \ --cpumask=0x1 --num-queues=2 \ --qsize=256 --packed-ring Start `bdevperf`: 1. test/bdev/bdevperf/bdevperf -r /var/tmp/spdk.sock.1 -g -s 2048 -q 128 -o 4096 \ -w randread -t 30 -m 0x2 2. scripts/rpc.py -s /var/tmp/spdk.sock.1 bdev_virtio_attach_controller --dev-type blk \ --trtype vfio-user --traddr vfu.0 VirtioBlk0 3. test/bdev/bdevperf/bdevperf.py -s /var/tmp/spdk.sock.1 perform_tests Change-Id: I368c4becebbca57328a25fc750e41c353420e481 Signed-off-by: Changpeng Liu <changpeng.liu@intel.com> Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/13896 Community-CI: Mellanox Build Bot Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Konrad Sztyber <konrad.sztyber@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2022-07-13 08:19:01 +00:00
DEPDIRS-virtio := log util json thread vfio_user
make: start adding inter-lib dependencies. This will make it much easier to link against some subset of spdk libraries when building SPDK applications. Change-Id: I8ad95a001965288a8b5e38eb252391fef68d7138 Signed-off-by: Seth Howell <seth.howell@intel.com> Reviewed-on: https://review.gerrithub.io/c/spdk/spdk/+/465194 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2019-08-12 22:46:38 +00:00
DEPDIRS-lvol := log util blob
DEPDIRS-rpc := log util json jsonrpc
DEPDIRS-net := log util $(JSON_LIBS)
DEPDIRS-notify := log util $(JSON_LIBS)
DEPDIRS-trace := log util $(JSON_LIBS)
bdev: pull/push data if bdev doesn't support memory domains If bdev doesn't support any memory domain then allocate internal bounce buffer, pull data for write operation before IO submission, push data to memory domain once IO completes for read operation. Update test tool, add simple pull/push functions implementation. Signed-off-by: Alexey Marchuk <alexeymar@mellanox.com> Change-Id: Ie9b94463e6a818bcd606fbb898fb0d6e0b5d5027 Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/10069 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Community-CI: Broadcom CI <spdk-ci.pdl@broadcom.com> Community-CI: Mellanox Build Bot Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Shuhei Matsumoto <smatsumoto@nvidia.com>
2021-10-20 06:35:28 +00:00
DEPDIRS-bdev := log util thread $(JSON_LIBS) notify trace dma
util: Extract a common lib between iovs and buf. It's useful to add these APIs. spdk_copy_iovs_to_buf and spdk_copy_buf_to_iovs. It prepares that other ones can call these. We don't need to define them in static state repeatedly. And add corresponding unit tests. Change-Id: Ife40fec8d047a48af67b04e6c055e4932282abfb Signed-off-by: yidong0635 <dongx.yi@intel.com> Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/12075 Community-CI: Broadcom CI <spdk-ci.pdl@broadcom.com> Community-CI: Mellanox Build Bot Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Konrad Sztyber <konrad.sztyber@intel.com> Reviewed-by: Shuhei Matsumoto <smatsumoto@nvidia.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2022-05-16 12:02:38 +00:00
DEPDIRS-blobfs := log thread blob trace util
event: Shift subsystem initialization code to a separate library This is useful for applications even if they elect not to use the SPDK event framework. This doesn't shift everything in one go - just the subsystem initialization logic. Configuration file loading also needs to move in a separate patch later. Change-Id: Id419df1045442d416650ed90e5ee78adfdd623d7 Signed-off-by: Ben Walker <benjamin.walker@intel.com> Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/6641 Community-CI: Broadcom CI Community-CI: Mellanox Build Bot Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Aleksey Marchuk <alexeymar@mellanox.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Paul Luse <paul.e.luse@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com>
2021-02-26 22:00:03 +00:00
DEPDIRS-event := log util thread $(JSON_LIBS) trace init
event: Move json config loading to init Loading subsystems and restoring state from a JSON config file is useful outside of the SPDK application framework, so move it to lib/init. Change-Id: I7dd3ceace2e7b1b28eef83c91ce6a4eedc85740e Signed-off-by: Ben Walker <benjamin.walker@intel.com> Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/6645 Reviewed-by: Tom Nabarro <tom.nabarro@outlook.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Changpeng Liu <changpeng.liu@intel.com> Reviewed-by: Aleksey Marchuk <alexeymar@mellanox.com> Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Community-CI: Mellanox Build Bot
2021-03-02 19:34:25 +00:00
DEPDIRS-init := jsonrpc json log rpc thread util
make: start adding inter-lib dependencies. This will make it much easier to link against some subset of spdk libraries when building SPDK applications. Change-Id: I8ad95a001965288a8b5e38eb252391fef68d7138 Signed-off-by: Seth Howell <seth.howell@intel.com> Reviewed-on: https://review.gerrithub.io/c/spdk/spdk/+/465194 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2019-08-12 22:46:38 +00:00
ftl: I/O tracing Adds tracepoints in FTL. Signed-off-by: Artur Paszkiewicz <artur.paszkiewicz@intel.com> Signed-off-by: Kozlowski Mateusz <mateusz.kozlowski@intel.com> Change-Id: I661703e42b8b531822a2ba74a09cdc716daa1c46 Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/13391 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2022-05-25 13:12:52 +00:00
DEPDIRS-ftl := log util thread bdev trace
make: start adding inter-lib dependencies. This will make it much easier to link against some subset of spdk libraries when building SPDK applications. Change-Id: I8ad95a001965288a8b5e38eb252391fef68d7138 Signed-off-by: Seth Howell <seth.howell@intel.com> Reviewed-on: https://review.gerrithub.io/c/spdk/spdk/+/465194 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2019-08-12 22:46:38 +00:00
DEPDIRS-nbd := log util thread $(JSON_LIBS) bdev
ublk: add configure and event/subsystem ublk backend could support ublk driver with kernel. Specify configuration parameter to start it up. Signed-off-by: Yifan Bian <yifan.bian@intel.com> Co-authored-by: Xiaodong Liu <xiaodong.liu@intel.com> Change-Id: I55e7d757e04315b25e9bfab5fdcbb6621be3e29e Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/15680 Reviewed-by: Xiaodong Liu <xiaodong.liu@intel.com> Reviewed-by: Changpeng Liu <changpeng.liu@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Tested-by: SPDK CI Jenkins <sys_sgci@intel.com>
2022-11-29 05:56:56 +00:00
ifeq ($(CONFIG_UBLK),y)
DEPDIRS-ublk := log util thread $(JSON_LIBS) bdev
endif
lib/nvmf: Use the async function to caculate the crc32 for header_digest. In this patch, we will use the accel library to do the crc32 work for the header digest when sending the pdu in the target side. For data digest support, will consider in the further patch. Signed-off-by: Ziye Yang <ziye.yang@intel.com> Change-Id: I3169a158afd633f48bdbeb2cce1ed20e4141ae45 Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/5472 Community-CI: Broadcom CI Community-CI: Mellanox Build Bot Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Aleksey Marchuk <alexeymar@mellanox.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com>
2020-12-08 14:44:35 +00:00
DEPDIRS-nvmf := accel log sock util nvme thread $(JSON_LIBS) trace bdev
nvmf/rdma: Use RDMA provider API to create/destroy qpair This patch updates NVMF target to use RDMA provider API to create and destroy qpairs. Makefiles have been updated with new dependency on RDMA lib Change-Id: Iae35aea601380f8d1a6453a7fd6115f781e126f5 Signed-off-by: Alexey Marchuk <alexeymar@mellanox.com> Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/1656 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Community-CI: Mellanox Build Bot Community-CI: Broadcom CI Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com> Reviewed-by: Seth Howell <seth.howell@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2020-03-14 08:32:18 +00:00
ifeq ($(CONFIG_RDMA),y)
DEPDIRS-nvmf += rdma
endif
module/accel: Add mlx5 accel module The mlx5 accel module supports crypto operations. Data buffer is split into `block_size` chunks and each chunk is enrypted individually. mlx5 library contains some utility functions that will later be used by other libraries, this lib will be exntended later. Signed-off-by: Alexey Marchuk <alexeymar@nvidia.com> Change-Id: Iacdd8caaade477277d5a95cfd53e9910e280a73b Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/15420 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Paul Luse <paul.e.luse@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2022-10-10 08:53:49 +00:00
ifeq ($(CONFIG_RDMA_PROV),mlx5_dv)
DEPDIRS-mlx5 = log rdma util
endif
make: start adding inter-lib dependencies. This will make it much easier to link against some subset of spdk libraries when building SPDK applications. Change-Id: I8ad95a001965288a8b5e38eb252391fef68d7138 Signed-off-by: Seth Howell <seth.howell@intel.com> Reviewed-on: https://review.gerrithub.io/c/spdk/spdk/+/465194 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2019-08-12 22:46:38 +00:00
DEPDIRS-scsi := log util thread $(JSON_LIBS) trace bdev
iscsi: Allocate connections array from regular memory No longer required to allocate from shared memory. No tools use this anymore. This removes the final call to the event library from iscsi, so we also drop that dependency. Signed-off-by: Ben Walker <benjamin.walker@intel.com> Change-Id: I41a6877b782cb927d9ac7d206ccd36a8195efc42 Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/4346 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com> Reviewed-by: Aleksey Marchuk <alexeymar@mellanox.com>
2020-09-23 17:37:48 +00:00
DEPDIRS-iscsi := log sock util conf thread $(JSON_LIBS) trace scsi
lib/vhost: remove legacy config support This patch removes legacy config support in vhost_blk/scsi library. All options through the legacy config are already reflected in JSON. Signed-off-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Change-Id: Ia63651cdb7433267d1a8839a1739e68b436e5d08 Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/4621 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2020-10-12 10:47:00 +00:00
DEPDIRS-vhost = log util thread $(JSON_LIBS) bdev scsi
module: add shared lib deps for all modules. This will allow us to link individually against dpdk module libraries without having to define those libraries dependencies. Change-Id: Ief2140ec0fadd970aba990dab333d603dfb46317 Signed-off-by: Seth Howell <seth.howell@intel.com> Reviewed-on: https://review.gerrithub.io/c/spdk/spdk/+/465704 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Broadcom SPDK FC-NVMe CI <spdk-ci.pdl@broadcom.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2019-08-16 23:20:15 +00:00
# ------------------------------------------------------------------------
# Start module/ directory - This section extends the organizational pattern from
# above. However, it introduces several more groupings which may not strictly follow
# the ordering pattern above. These are used for convenience and to help quickly
# determine the unique dependencies of a given module. It is also grouped by directory.
BDEV_DEPS = log util $(JSON_LIBS) bdev
BDEV_DEPS_THREAD = $(BDEV_DEPS) thread
# module/blob
DEPDIRS-blob_bdev := log thread bdev
blobfs: add blobfs_detect RPC Add module blobfs_bdev as a general module to simplify the operations of blobfs on bdev. Then its functions can be utilized by other libraries or apps. blobfs_detect can be used to detect whether there is one blobfs on given bdev. Change-Id: Ib425574816061dc945fb652b539f791a44097a43 Signed-off-by: Xiaodong Liu <xiaodong.liu@intel.com> Reviewed-on: https://review.gerrithub.io/c/spdk/spdk/+/466486 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Paul Luse <paul.e.luse@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Changpeng Liu <changpeng.liu@intel.com>
2019-08-28 08:06:50 +00:00
# module/blobfs
DEPDIRS-blobfs_bdev := $(BDEV_DEPS_THREAD) blob_bdev blobfs
blobfs/fuse: add 'event' as dependency for blobfs_bdev This was missed in CI, due to disabled SPDK_TEST_BLOBFS test flag in UT job that performs check_so_deps.sh. Error seen when it is enabled: there was a dependency mismatch in the library blobfs_bdev The makefile lists: 'bdev blob_bdev blobfs json jsonrpc log rpc thread util' readelf outputs : 'bdev blob_bdev blobfs event json jsonrpc log rpc thread util' Temporary workarounds have been added, ignoring blobfs_dev in the abi check test. This will allow for better transition on CI side. After this patch is merged, UT job flags on CI will be updated to include SPDK_TEST_BLOBFS and abi reference repository will be recompiled with this flag. Next patch in series removes this workaround. It will be merged after work on CI side is done. Signed-off-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Change-Id: I4753a918d5760f154d4a59349747a0b1356e9c91 Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/3961 Community-CI: Broadcom CI Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2020-08-28 09:19:38 +00:00
ifeq ($(CONFIG_FUSE),y)
DEPDIRS-blobfs_bdev += event
endif
blobfs: add blobfs_detect RPC Add module blobfs_bdev as a general module to simplify the operations of blobfs on bdev. Then its functions can be utilized by other libraries or apps. blobfs_detect can be used to detect whether there is one blobfs on given bdev. Change-Id: Ib425574816061dc945fb652b539f791a44097a43 Signed-off-by: Xiaodong Liu <xiaodong.liu@intel.com> Reviewed-on: https://review.gerrithub.io/c/spdk/spdk/+/466486 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Paul Luse <paul.e.luse@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Changpeng Liu <changpeng.liu@intel.com>
2019-08-28 08:06:50 +00:00
global: rename copy to accel The copy engine library, modules and public APIs have been renamed. Use of the word `copy` has been replaced with the word `accel` short for accelerator in preparation for adding new capabilities in the future. Additionally, APIs for what was previously called the `memcpy` engine have been renamed to identify the engine as a software accelerator. Signed-off-by: paul luse <paul.e.luse@intel.com> Change-Id: Ia607aa718416146fbba1e6792b8de0f66bd8a5de Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/576 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com> Reviewed-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com>
2020-02-05 17:10:05 +00:00
# module/accel
ioat: remove whitelist/blacklist functionality This can be done via explicit options on the application command line instead. This has the added benefit of removing a usage of whitelist/blacklist which we are working to remove from the SPDK repository. Signed-off-by: Jim Harris <james.r.harris@intel.com> Change-Id: I5739e281f1c29fc8a5d175f5bbc916cd7d926fe4 Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/5274 Community-CI: Broadcom CI Community-CI: Mellanox Build Bot Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Changpeng Liu <changpeng.liu@intel.com> Reviewed-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com>
2020-11-25 18:37:40 +00:00
DEPDIRS-accel_ioat := log ioat thread jsonrpc rpc accel
modules/accel_dsa: update IDXD references to DSA where it makes sense IDXD has always been used everywhere but technically it stands for the driver, not the HW (Intel Data Streaming Accelerator Driver) where the X comes from "Streaming Accelerator" somehow. Anyway, the underlying hardware is just DSA. It doesn't matter much now but upcoming patches will add support for a new HW accelerator called the Intel In-Memory Analytics Accelerator which we'll call IAA and it will use the same (mostly) device driver (IDXD) as DSA. So, calling the HW what it is will lessen confusion when adding IAA support. This patch just does renaming for the accel_fw module and associated files (RPC, etc). Signed-off-by: paul luse <paul.e.luse@intel.com> Change-Id: Ib3b1f982cc60359ecfea5dbcbeeb33e4d69aee6a Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/11984 Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Community-CI: Broadcom CI <spdk-ci.pdl@broadcom.com> Community-CI: Mellanox Build Bot Tested-by: SPDK CI Jenkins <sys_sgci@intel.com>
2022-03-18 14:29:39 +00:00
DEPDIRS-accel_dsa := log idxd thread $(JSON_LIBS) accel trace
modules/accel/iaa: add IAA accel_fw module And associated RPC to enable. Signed-off-by: paul luse <paul.e.luse@intel.com> Change-Id: I06785bcd8b8957293ad41d13bab556fe62f29fd5 Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/12765 Community-CI: Broadcom CI <spdk-ci.pdl@broadcom.com> Community-CI: Mellanox Build Bot Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2022-05-20 19:08:38 +00:00
DEPDIRS-accel_iaa := log idxd thread $(JSON_LIBS) accel trace
module/accel: Add accel_dpdk_cryptodev The new module replaces functionality in vbdev_crypto. This module is bdev agnostic, so some inernal parts were reworked. io_channel: contains a qp of every configured DPDK PMD crypto key: for mlx5_pci we register a key on each available device since keys are bound to Protection Domain. Signed-off-by: Alexey Marchuk <alexeymar@nvidia.com> Change-Id: If1845cb87eadacbb921c593ba82207a97f2209a3 Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/14859 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Paul Luse <paul.e.luse@intel.com> Reviewed-by: Shuhei Matsumoto <smatsumoto@nvidia.com>
2022-10-04 19:18:18 +00:00
DEPDIRS-accel_dpdk_cryptodev := log thread $(JSON_LIBS) accel
module/accel: Add compressDev accel_module This is the port of the vbdev compress logic into the accel framework. It includes just one enhancement, to only fill each mbuf in either src or dst array with max "window size" param to avoid QAT errors. Note that DPDK ISAL PMD was not ported as we have native ISAL compression in accel now. Note: ISAL w/DPDK is still built w/this patch, that can't be removed until the vbdev module moves to accel fw as it still depends on DPDK ISAL PMD. Follow-on patches will include addition C API for PMD selection, this patch just gets equivalent functionality going. Upcoming patches will also convert the vbdev compress module to use the accel framework instead of talking directly to compressdev. More patches will also address comments on vbdev common code that addressed here would make the review challenging. This patch also fixes a bug in the ported code that needs to be fixed here to pass CI. Capability discovery was incorrect causing all devices to appear to not support chained mbufs, with the mbuf splitting code this is important to get right. Signed-off-by: paul luse <paul.e.luse@intel.com> Change-Id: I7f526404819b145ef26e40877122ba80a02fcf51 Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/15178 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Aleksey Marchuk <alexeymar@nvidia.com>
2022-10-28 21:56:55 +00:00
DEPDIRS-accel_dpdk_compressdev := log thread $(JSON_LIBS) accel util
module: add shared lib deps for all modules. This will allow us to link individually against dpdk module libraries without having to define those libraries dependencies. Change-Id: Ief2140ec0fadd970aba990dab333d603dfb46317 Signed-off-by: Seth Howell <seth.howell@intel.com> Reviewed-on: https://review.gerrithub.io/c/spdk/spdk/+/465704 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Broadcom SPDK FC-NVMe CI <spdk-ci.pdl@broadcom.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2019-08-16 23:20:15 +00:00
module/accel: Add mlx5 accel module The mlx5 accel module supports crypto operations. Data buffer is split into `block_size` chunks and each chunk is enrypted individually. mlx5 library contains some utility functions that will later be used by other libraries, this lib will be exntended later. Signed-off-by: Alexey Marchuk <alexeymar@nvidia.com> Change-Id: Iacdd8caaade477277d5a95cfd53e9910e280a73b Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/15420 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Paul Luse <paul.e.luse@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2022-10-10 08:53:49 +00:00
ifeq ($(CONFIG_RDMA_PROV),mlx5_dv)
DEPDIRS-accel_mlx5 := accel thread log mlx5 rdma util
endif
env_dpdk/rpc: add rpc to get memory stats. This will enable us to create a helper applciation to print memory statistics for a given SPDK application. Change-Id: I0ad5a8163166a5d67d9a5533303ec0858297ba6b Signed-off-by: Seth Howell <seth.howell@intel.com> Reviewed-on: https://review.gerrithub.io/c/spdk/spdk/+/477511 Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com> Community-CI: Broadcom SPDK FC-NVMe CI <spdk-ci.pdl@broadcom.com> Community-CI: SPDK CI Jenkins <sys_sgci@intel.com> Tested-by: SPDK CI Jenkins <sys_sgci@intel.com>
2019-12-10 23:29:37 +00:00
# module/env_dpdk
DEPDIRS-env_dpdk_rpc := log $(JSON_LIBS)
module: add shared lib deps for all modules. This will allow us to link individually against dpdk module libraries without having to define those libraries dependencies. Change-Id: Ief2140ec0fadd970aba990dab333d603dfb46317 Signed-off-by: Seth Howell <seth.howell@intel.com> Reviewed-on: https://review.gerrithub.io/c/spdk/spdk/+/465704 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Broadcom SPDK FC-NVMe CI <spdk-ci.pdl@broadcom.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2019-08-16 23:20:15 +00:00
# module/sock
sock/posix: Internally buffer reads. Do large reads from the socket and buffer into a pipe. Change-Id: I0a1bc5b356cb8c403048ab3b22a159332f085e6b Signed-off-by: Ben Walker <benjamin.walker@intel.com> Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/447 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2020-02-28 20:23:10 +00:00
DEPDIRS-sock_posix := log sock util
sock/uring: Add the async network I/O support for socket This patch is used to add the async network I/O support in sock layer. If code is configured with I/O uring, --with-uring, we can use io uring in Linux (version >=5.4-rc3). PS: We also make VPP's default priority > uring, because for the iSCSI or sock test linked with VPP. It tests VPP with a given address (which is not a special VPP can only open address), so using uring can also listen those address succefully. And if we make uring with priority > VPP, actually, VPP will not tested in those cases. Additionally, the current CI pool is not ready for test, we need wait for the CI system ready. And I test on my local platform, it works. Signed-off-by: Ziye Yang <ziye.yang@intel.com> Change-Id: Ie8ee3c8ddf8d2a7264f2b382376733e002816dcc Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/952 Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com> Tested-by: SPDK CI Jenkins <sys_sgci@intel.com>
2019-10-14 23:58:51 +00:00
DEPDIRS-sock_uring := log sock util
module: add shared lib deps for all modules. This will allow us to link individually against dpdk module libraries without having to define those libraries dependencies. Change-Id: Ief2140ec0fadd970aba990dab333d603dfb46317 Signed-off-by: Seth Howell <seth.howell@intel.com> Reviewed-on: https://review.gerrithub.io/c/spdk/spdk/+/465704 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Broadcom SPDK FC-NVMe CI <spdk-ci.pdl@broadcom.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2019-08-16 23:20:15 +00:00
scheduler: create public API and subsystem for scheduler/governor This patch moves schedueler and governor related API from the internal event.h to public scheduler.h. With this it is possible to create subsystem responsible for handling the schedulers. Three schedulers and a governor were moved to scheduler modules from event framework. This will allow next patch to add JSON RPC configuration to the whole subsystem. Along with easier addition of other schedulers. Removed debug logs from gscheduler, as they serve little purpose. Signed-off-by: Krzysztof Karas <krzysztof.karas@intel.com> Signed-off-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Change-Id: I98ca1ea4fb281beb71941656444267842a8875b7 Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/6995 Community-CI: Broadcom CI <spdk-ci.pdl@broadcom.com> Community-CI: Mellanox Build Bot Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com>
2021-08-06 09:17:16 +00:00
# module/scheduler
scheduler: create and parse JSON values for dynamic scheduler params Creates a JSON on scheduler side to return after .get_opts is called and parses a JSON on .set_opts call. The JSON passed to dynamic scheduler on .set_stats is a copy of a pointer already available during RPC framework_set_scheduler call. Getting and setting scheduler stats via RPC calls is going to be implemented in the next patch in this series. Change-Id: I62880a71066a140c74336a5725e7b10952008e5c Signed-off-by: Krzysztof Karas <krzysztof.karas@intel.com> Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/11448 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Community-CI: Broadcom CI <spdk-ci.pdl@broadcom.com> Community-CI: Mellanox Build Bot Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com>
2022-02-07 12:11:34 +00:00
DEPDIRS-scheduler_dynamic := event log thread util json
env/dpdk: simplify checks for rte_power dpdk_governor and gscheduler use rte_power, which is only available on Linux and when DPDK env is used. Rather than repeat those checks in each mk or Makefile, added DPDK_POWER flag directly to DPDK env. Signed-off-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Change-Id: I438caad8d333a4df697a79aa45de2930cce71d23 Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/12992 Community-CI: Mellanox Build Bot Community-CI: Broadcom CI <spdk-ci.pdl@broadcom.com> Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Konrad Sztyber <konrad.sztyber@intel.com> Reviewed-by: John Kariuki <John.K.Kariuki@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2022-06-02 07:42:58 +00:00
ifeq (y,$(DPDK_POWER))
scheduler: create public API and subsystem for scheduler/governor This patch moves schedueler and governor related API from the internal event.h to public scheduler.h. With this it is possible to create subsystem responsible for handling the schedulers. Three schedulers and a governor were moved to scheduler modules from event framework. This will allow next patch to add JSON RPC configuration to the whole subsystem. Along with easier addition of other schedulers. Removed debug logs from gscheduler, as they serve little purpose. Signed-off-by: Krzysztof Karas <krzysztof.karas@intel.com> Signed-off-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Change-Id: I98ca1ea4fb281beb71941656444267842a8875b7 Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/6995 Community-CI: Broadcom CI <spdk-ci.pdl@broadcom.com> Community-CI: Mellanox Build Bot Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com>
2021-08-06 09:17:16 +00:00
DEPDIRS-scheduler_dpdk_governor := event log
DEPDIRS-scheduler_gscheduler := event log
endif
module: add shared lib deps for all modules. This will allow us to link individually against dpdk module libraries without having to define those libraries dependencies. Change-Id: Ief2140ec0fadd970aba990dab333d603dfb46317 Signed-off-by: Seth Howell <seth.howell@intel.com> Reviewed-on: https://review.gerrithub.io/c/spdk/spdk/+/465704 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Broadcom SPDK FC-NVMe CI <spdk-ci.pdl@broadcom.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2019-08-16 23:20:15 +00:00
# module/bdev
FTL: Add FTL bdev module Signed-off-by: Kozlowski Mateusz <mateusz.kozlowski@intel.com> Signed-off-by: Artur Paszkiewicz <artur.paszkiewicz@intel.com> Change-Id: I8c40b96f0726d83d6a307e8b9a04b7c210b80255 Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/13299 Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Community-CI: Mellanox Build Bot Tested-by: SPDK CI Jenkins <sys_sgci@intel.com>
2022-06-21 09:20:47 +00:00
ifeq ($(OS),Linux)
FTL: Add bdev_ftl_create and delete rpc definitions Signed-off-by: Kozlowski Mateusz <mateusz.kozlowski@intel.com> Signed-off-by: Artur Paszkiewicz <artur.paszkiewicz@intel.com> Change-Id: I0837028fbe349e8df7f05fb3c9db1f4682f04679 Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/13301 Community-CI: Mellanox Build Bot Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2022-07-16 02:48:17 +00:00
DEPDIRS-bdev_ftl := $(BDEV_DEPS) ftl
FTL: Add FTL bdev module Signed-off-by: Kozlowski Mateusz <mateusz.kozlowski@intel.com> Signed-off-by: Artur Paszkiewicz <artur.paszkiewicz@intel.com> Change-Id: I8c40b96f0726d83d6a307e8b9a04b7c210b80255 Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/13299 Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Community-CI: Mellanox Build Bot Tested-by: SPDK CI Jenkins <sys_sgci@intel.com>
2022-06-21 09:20:47 +00:00
endif
module/gpt: remove legacy config support This patch removes legacy config support in GPT bdev module. Please note that disabling probing only for GPT partition does not have a corresponding RPC. Similar functionality is possible for all bdev modules at once via `bdev_set_options --disable-auto-examine` RPC then followed by `bdev_examine` RPC for particular bdev. Signed-off-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Change-Id: I9a106b3dc0953166264b11c2e95c4433163fcd3c Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/4624 Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Aleksey Marchuk <alexeymar@mellanox.com> Reviewed-by: Paul Luse <paul.e.luse@intel.com> Tested-by: SPDK CI Jenkins <sys_sgci@intel.com>
2020-10-12 10:57:37 +00:00
DEPDIRS-bdev_gpt := bdev json log thread util
module: add shared lib deps for all modules. This will allow us to link individually against dpdk module libraries without having to define those libraries dependencies. Change-Id: Ief2140ec0fadd970aba990dab333d603dfb46317 Signed-off-by: Seth Howell <seth.howell@intel.com> Reviewed-on: https://review.gerrithub.io/c/spdk/spdk/+/465704 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Broadcom SPDK FC-NVMe CI <spdk-ci.pdl@broadcom.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2019-08-16 23:20:15 +00:00
module/error: remove legacy config support This patch removes legacy config support in error bdev module. All options through the legacy config are already reflected in JSON. Signed-off-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Change-Id: I348c19f560057b46030aa03adcca073f0906de0a Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/4623 Community-CI: Broadcom CI Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com> Reviewed-by: Aleksey Marchuk <alexeymar@mellanox.com> Reviewed-by: Paul Luse <paul.e.luse@intel.com>
2020-10-12 10:55:13 +00:00
DEPDIRS-bdev_error := $(BDEV_DEPS)
module: add shared lib deps for all modules. This will allow us to link individually against dpdk module libraries without having to define those libraries dependencies. Change-Id: Ief2140ec0fadd970aba990dab333d603dfb46317 Signed-off-by: Seth Howell <seth.howell@intel.com> Reviewed-on: https://review.gerrithub.io/c/spdk/spdk/+/465704 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Broadcom SPDK FC-NVMe CI <spdk-ci.pdl@broadcom.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2019-08-16 23:20:15 +00:00
DEPDIRS-bdev_lvol := $(BDEV_DEPS) lvol blob blob_bdev
DEPDIRS-bdev_rpc := $(BDEV_DEPS)
module/split: remove legacy config support This patch removes legacy config support in split bdev module. All options through the legacy config are already reflected in JSON. Signed-off-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Change-Id: Iaa8e546bbd6357ba93af8164e2f3d8e497fcec06 Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/4634 Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Aleksey Marchuk <alexeymar@mellanox.com> Reviewed-by: Paul Luse <paul.e.luse@intel.com> Tested-by: SPDK CI Jenkins <sys_sgci@intel.com>
2020-10-12 11:25:43 +00:00
DEPDIRS-bdev_split := $(BDEV_DEPS)
module: add shared lib deps for all modules. This will allow us to link individually against dpdk module libraries without having to define those libraries dependencies. Change-Id: Ief2140ec0fadd970aba990dab333d603dfb46317 Signed-off-by: Seth Howell <seth.howell@intel.com> Reviewed-on: https://review.gerrithub.io/c/spdk/spdk/+/465704 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Broadcom SPDK FC-NVMe CI <spdk-ci.pdl@broadcom.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2019-08-16 23:20:15 +00:00
module/aio: remove legacy config support This patch removes legacy config support in AIO module. All options through the legacy config are already reflected in JSON. Signed-off-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Change-Id: I43655ab8d3ca787a7e92072b195f3b73fcf4fdbf Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/4620 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com> Reviewed-by: Aleksey Marchuk <alexeymar@mellanox.com>
2020-10-12 10:53:20 +00:00
DEPDIRS-bdev_aio := $(BDEV_DEPS_THREAD)
bdev/compress: Port to use accel_fw instead of compressdev directly This patch removes hardcoded compressdev code from the vbdev module and instead uses the accel_fw. The port required a few changes based on how things are plumbed and accessed, nothing that isn't be too obscure. CI tests were updated to run ISAL accel_fw module as well as DPDK compressdev with QAT. Unit tests for the new module will follow in a separate patch. Signed-off-by: paul luse <paul.e.luse@intel.com> Change-Id: I769cbc888658fb846d89f6f0bfeeb1a2a820767e Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/13610 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Reviewed-by: Konrad Sztyber <konrad.sztyber@intel.com>
2022-07-07 19:46:45 +00:00
DEPDIRS-bdev_compress := $(BDEV_DEPS_THREAD) reduce accel
bdev/crypto: Use accel framework All DPDK related code is removed, handling of RESET command was sligthly updated. Handling of -ENOMEM was updated for cases when accel API returns -ENOMEM Crypto tests in blockdev.sh were extended with more crypto_bdevs to verify NOMEM cases - that failed with original vbdev_crypto implementation Signed-off-by: Alexey Marchuk <alexeymar@nvidia.com> Change-Id: If1feba2449bee852c6c4daca4b3406414db6fded Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/14860 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Paul Luse <paul.e.luse@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2022-08-31 15:26:12 +00:00
DEPDIRS-bdev_crypto := $(BDEV_DEPS_THREAD) accel
module: add shared lib deps for all modules. This will allow us to link individually against dpdk module libraries without having to define those libraries dependencies. Change-Id: Ief2140ec0fadd970aba990dab333d603dfb46317 Signed-off-by: Seth Howell <seth.howell@intel.com> Reviewed-on: https://review.gerrithub.io/c/spdk/spdk/+/465704 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Broadcom SPDK FC-NVMe CI <spdk-ci.pdl@broadcom.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2019-08-16 23:20:15 +00:00
DEPDIRS-bdev_delay := $(BDEV_DEPS_THREAD)
bdev modules: remove legacy config support This patch removes legacy config support in: crypto bdev module - nvme bdev module - ocf bdev module - rbd bdev module - pmem bdev module - iscsi bdev module - raid bdev module All options through the legacy config are already reflected in JSON. Signed-off-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Change-Id: I00213365f52d3de1012493c14d4ea5fc537e595e Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/4673 Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Community-CI: Broadcom CI Tested-by: SPDK CI Jenkins <sys_sgci@intel.com>
2020-10-14 14:51:18 +00:00
DEPDIRS-bdev_iscsi := $(BDEV_DEPS_THREAD)
bdev/malloc: malloc IO channel It'll allow the malloc bdev to store per-thread data. For now, it's only used to keep the pointer to the accel library's IO channel, more fields will be added in subsequent patches. Signed-off-by: Konrad Sztyber <konrad.sztyber@intel.com> Change-Id: I604a38877ae8d6075b911f5a484d1793d4bc2ddb Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/10802 Community-CI: Broadcom CI <spdk-ci.pdl@broadcom.com> Reviewed-by: Aleksey Marchuk <alexeymar@mellanox.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Tested-by: SPDK CI Jenkins <sys_sgci@intel.com>
2021-12-16 08:28:25 +00:00
DEPDIRS-bdev_malloc := $(BDEV_DEPS_THREAD) accel
module/null: remove legacy config support This patch removes legacy config support in null bdev module. All options through the legacy config are already reflected in JSON. While here, added allocation failure check for g_null_read_buf. Signed-off-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Change-Id: I59a28a402e0c61e5636da623bc109e15b36f0584 Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/4626 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Aleksey Marchuk <alexeymar@mellanox.com>
2020-10-12 11:00:57 +00:00
DEPDIRS-bdev_null := $(BDEV_DEPS_THREAD)
bdev/nvme: add tracepoint support This will allow us to map spdk_bdev_io events to nvme_request events coming in a future patch. Since we pass the nvme_bdev_io to the nvme driver (not the spdk_bdev_io), we need to add tracepoints for the nvme_bdev_io so that spdk_trace can do the spdk_bdev_io->nvme_bdev_io->nvme_request mapping. An alternative would have been to pass the spdk_bdev_io as the cb_arg to the nvme driver, but that change seemed to invasive, and I think we will find other uses for the nvme_bdev_io events anyways. Signed-off-by: Jim Harris <james.r.harris@intel.com> Change-Id: Id7519e689b01875093359f41a1ca2af912061a8b Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/13994 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Aleksey Marchuk <alexeymar@nvidia.com> Reviewed-by: Jacek Kalwas <jacek.kalwas@intel.com> Reviewed-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com>
2022-08-11 00:04:56 +00:00
DEPDIRS-bdev_nvme = $(BDEV_DEPS_THREAD) accel nvme trace
bdev modules: remove legacy config support This patch removes legacy config support in: crypto bdev module - nvme bdev module - ocf bdev module - rbd bdev module - pmem bdev module - iscsi bdev module - raid bdev module All options through the legacy config are already reflected in JSON. Signed-off-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Change-Id: I00213365f52d3de1012493c14d4ea5fc537e595e Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/4673 Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Community-CI: Broadcom CI Tested-by: SPDK CI Jenkins <sys_sgci@intel.com>
2020-10-14 14:51:18 +00:00
DEPDIRS-bdev_ocf := $(BDEV_DEPS_THREAD)
module/passthru: remove legacy config support This patch removes legacy config support in passthru bdev module. All options through the legacy config are already reflected in JSON. Signed-off-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Change-Id: I53ee6e78d210c155a31ae6204472e89756e43e65 Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/4633 Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Aleksey Marchuk <alexeymar@mellanox.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Paul Luse <paul.e.luse@intel.com> Tested-by: SPDK CI Jenkins <sys_sgci@intel.com>
2020-10-12 11:05:46 +00:00
DEPDIRS-bdev_passthru := $(BDEV_DEPS_THREAD)
bdev modules: remove legacy config support This patch removes legacy config support in: crypto bdev module - nvme bdev module - ocf bdev module - rbd bdev module - pmem bdev module - iscsi bdev module - raid bdev module All options through the legacy config are already reflected in JSON. Signed-off-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Change-Id: I00213365f52d3de1012493c14d4ea5fc537e595e Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/4673 Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Community-CI: Broadcom CI Tested-by: SPDK CI Jenkins <sys_sgci@intel.com>
2020-10-14 14:51:18 +00:00
DEPDIRS-bdev_pmem := $(BDEV_DEPS_THREAD)
DEPDIRS-bdev_raid := $(BDEV_DEPS_THREAD)
DEPDIRS-bdev_rbd := $(BDEV_DEPS_THREAD)
module/uring: remove legacy config support This patch removes legacy config support in uring bdev module. All options through the legacy config are already reflected in JSON. Signed-off-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Change-Id: I79f9b4458af2fdf0e4683f9cd82b64e9658c5fcb Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/4672 Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Aleksey Marchuk <alexeymar@mellanox.com> Tested-by: SPDK CI Jenkins <sys_sgci@intel.com>
2020-10-14 14:35:07 +00:00
DEPDIRS-bdev_uring := $(BDEV_DEPS_THREAD)
module/virtio_blk/sci: remove legacy config support This patch removes legacy config support in virtio_blk and virtio_scsi bdev modules. Most of the options through the legacy config are already reflected in JSON. Exception to that is "[VirtioPci] Enable" option, which worked for virtio_blk and virtio_scsi. It then on initialization scanned virtio_pci devices for presence of blk/scsi. There is no RPC that scans it on demand, nor was it used in any of the tests. So this patch removes that functionality, if needed this can be reintroduced as new RPC (or two for each backend). Module initialization for bdev_virtio_scsi changed to be synchronous. Signed-off-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Change-Id: Ib0978a4a084795e94993bb9122bd73ed49e14b96 Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/4667 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Community-CI: Broadcom CI Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2020-10-12 12:05:56 +00:00
DEPDIRS-bdev_virtio := $(BDEV_DEPS_THREAD) virtio
bdev/zone: Register/unregister zoned bdev Add registration and unregistration of block zoned bdev. Attach it to the underlying bdev during creation and unattach at deletion. Signed-off-by: Mateusz Kozlowski <mateusz.kozlowski@intel.com> Change-Id: I773aff6c7609952f28c02dd1794f0529a781b2e1 Reviewed-on: https://review.gerrithub.io/c/spdk/spdk/+/468033 Community-CI: Broadcom SPDK FC-NVMe CI <spdk-ci.pdl@broadcom.com> Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com> Reviewed-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2019-08-21 08:38:53 +00:00
DEPDIRS-bdev_zone_block := $(BDEV_DEPS_THREAD)
test: Enable xnvme in autotest builds Signed-off-by: Michal Berger <michal.berger@intel.com> Change-Id: I32594d94eb397dfe1fcec867fd0caf67a07b208c Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/14118 Community-CI: Mellanox Build Bot Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Reviewed-by: Dong Yi <dongx.yi@intel.com> Reviewed-by: Konrad Sztyber <konrad.sztyber@intel.com> Tested-by: SPDK CI Jenkins <sys_sgci@intel.com>
2022-08-18 16:11:35 +00:00
DEPDIRS-bdev_xnvme := $(BDEV_DEPS_THREAD)
module: add shared lib deps for all modules. This will allow us to link individually against dpdk module libraries without having to define those libraries dependencies. Change-Id: Ief2140ec0fadd970aba990dab333d603dfb46317 Signed-off-by: Seth Howell <seth.howell@intel.com> Reviewed-on: https://review.gerrithub.io/c/spdk/spdk/+/465704 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Broadcom SPDK FC-NVMe CI <spdk-ci.pdl@broadcom.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2019-08-16 23:20:15 +00:00
# module/event
module/event: add subsystem interdependencies The SPDK application framework defines a list of event subsystem dependencies. When linking against individual shared libraries, it is useful for this dependency structure to be codified in the shared libraries themselves. For example, when linking a bdev based application against libspdk_bdev.so, one might wish to only specify this shared object at link time. However, when you actually run the application, it will fail to start because it is not linked to the copy and vmd subsystems. However, once thesedependencies are added, one can effectively link against only the exact subsystems they need and any dependent subsystems will be linked in automatically. Change-Id: Ic986281a162ac20b523486e9f8cccf4a0787afd7 Signed-off-by: Seth Howell <seth.howell@intel.com> Reviewed-on: https://review.gerrithub.io/c/spdk/spdk/+/466081 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Paul Luse <paul.e.luse@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2019-08-22 22:06:05 +00:00
# module/event/subsystems
# These depdirs include subsystem interdependencies which
# are not related to symbols, but are defined directly in
# the SPDK event subsystem code.
accel: add iobuf channel to accel channel It will be used for allocating buffers from accel domain and allocating bounce buffers to push/pull the data from memory domains for modules that don't support memory domains. Signed-off-by: Konrad Sztyber <konrad.sztyber@intel.com> Change-Id: Idbe4d2129d0aff87d9e517214e9f81e8470c5088 Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/15745 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com>
2022-11-29 11:51:22 +00:00
DEPDIRS-event_accel := init accel event_iobuf
vmd: method for removing devices behind VMD Added new RPC, vmd_remove_device, that allows users to remove a PCI device managed by the VMD library simulating a hot-remove. Signed-off-by: Konrad Sztyber <konrad.sztyber@intel.com> Change-Id: Ifb84818ce8d147d1d586b52590527e85fe9c10de Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/13957 Community-CI: Mellanox Build Bot Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Tom Nabarro <tom.nabarro@intel.com>
2022-07-05 08:50:42 +00:00
DEPDIRS-event_vmd := init vmd $(JSON_LIBS) log thread util
module/event: add subsystem interdependencies The SPDK application framework defines a list of event subsystem dependencies. When linking against individual shared libraries, it is useful for this dependency structure to be codified in the shared libraries themselves. For example, when linking a bdev based application against libspdk_bdev.so, one might wish to only specify this shared object at link time. However, when you actually run the application, it will fail to start because it is not linked to the copy and vmd subsystems. However, once thesedependencies are added, one can effectively link against only the exact subsystems they need and any dependent subsystems will be linked in automatically. Change-Id: Ic986281a162ac20b523486e9f8cccf4a0787afd7 Signed-off-by: Seth Howell <seth.howell@intel.com> Reviewed-on: https://review.gerrithub.io/c/spdk/spdk/+/466081 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Paul Luse <paul.e.luse@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2019-08-22 22:06:05 +00:00
bdev: replace internal buffer pools with iobuf The internal mempools were replaced with the newly added iobuf interface. To make sure we respect spdk_bdev_opts's (small|large)_buf_pool_size, we call spdk_iobuf_set_opts() from spdk_bdev_set_opts(). These two options are now deprecated and users should switch to spdk_iobuf_set_opts(). Signed-off-by: Konrad Sztyber <konrad.sztyber@intel.com> Change-Id: Ib1424dc5446796230d103104e272100fac649b42 Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/15328 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Community-CI: Mellanox Build Bot Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Shuhei Matsumoto <smatsumoto@nvidia.com>
2022-11-04 14:19:47 +00:00
DEPDIRS-event_bdev := init bdev event_accel event_vmd event_sock event_iobuf
module/event: add subsystem interdependencies The SPDK application framework defines a list of event subsystem dependencies. When linking against individual shared libraries, it is useful for this dependency structure to be codified in the shared libraries themselves. For example, when linking a bdev based application against libspdk_bdev.so, one might wish to only specify this shared object at link time. However, when you actually run the application, it will fail to start because it is not linked to the copy and vmd subsystems. However, once thesedependencies are added, one can effectively link against only the exact subsystems they need and any dependent subsystems will be linked in automatically. Change-Id: Ic986281a162ac20b523486e9f8cccf4a0787afd7 Signed-off-by: Seth Howell <seth.howell@intel.com> Reviewed-on: https://review.gerrithub.io/c/spdk/spdk/+/466081 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Paul Luse <paul.e.luse@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2019-08-22 22:06:05 +00:00
scheduler: add scheduler subsystem JSON configuration Added writing out JSON configuration for the scheduler subsystem. Signed-off-by: Krzysztof Karas <krzysztof.karas@intel.com> Signed-off-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Change-Id: I51b1f94b3f56d0bfb8a87127163c8e248d6846b6 Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/7119 Community-CI: Broadcom CI <spdk-ci.pdl@broadcom.com> Community-CI: Mellanox Build Bot Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com> Tested-by: SPDK CI Jenkins <sys_sgci@intel.com>
2021-03-25 10:46:22 +00:00
DEPDIRS-event_scheduler := event init json log
scheduler: create public API and subsystem for scheduler/governor This patch moves schedueler and governor related API from the internal event.h to public scheduler.h. With this it is possible to create subsystem responsible for handling the schedulers. Three schedulers and a governor were moved to scheduler modules from event framework. This will allow next patch to add JSON RPC configuration to the whole subsystem. Along with easier addition of other schedulers. Removed debug logs from gscheduler, as they serve little purpose. Signed-off-by: Krzysztof Karas <krzysztof.karas@intel.com> Signed-off-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Change-Id: I98ca1ea4fb281beb71941656444267842a8875b7 Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/6995 Community-CI: Broadcom CI <spdk-ci.pdl@broadcom.com> Community-CI: Mellanox Build Bot Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com>
2021-08-06 09:17:16 +00:00
event: Shift subsystem initialization code to a separate library This is useful for applications even if they elect not to use the SPDK event framework. This doesn't shift everything in one go - just the subsystem initialization logic. Configuration file loading also needs to move in a separate patch later. Change-Id: Id419df1045442d416650ed90e5ee78adfdd623d7 Signed-off-by: Ben Walker <benjamin.walker@intel.com> Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/6641 Community-CI: Broadcom CI Community-CI: Mellanox Build Bot Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Aleksey Marchuk <alexeymar@mellanox.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Paul Luse <paul.e.luse@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com>
2021-02-26 22:00:03 +00:00
DEPDIRS-event_nbd := init nbd event_bdev
ublk: add configure and event/subsystem ublk backend could support ublk driver with kernel. Specify configuration parameter to start it up. Signed-off-by: Yifan Bian <yifan.bian@intel.com> Co-authored-by: Xiaodong Liu <xiaodong.liu@intel.com> Change-Id: I55e7d757e04315b25e9bfab5fdcbb6621be3e29e Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/15680 Reviewed-by: Xiaodong Liu <xiaodong.liu@intel.com> Reviewed-by: Changpeng Liu <changpeng.liu@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Tested-by: SPDK CI Jenkins <sys_sgci@intel.com>
2022-11-29 05:56:56 +00:00
ifeq ($(CONFIG_UBLK),y)
DEPDIRS-event_ublk := init ublk event_bdev
endif
scheduler: create public API and subsystem for scheduler/governor This patch moves schedueler and governor related API from the internal event.h to public scheduler.h. With this it is possible to create subsystem responsible for handling the schedulers. Three schedulers and a governor were moved to scheduler modules from event framework. This will allow next patch to add JSON RPC configuration to the whole subsystem. Along with easier addition of other schedulers. Removed debug logs from gscheduler, as they serve little purpose. Signed-off-by: Krzysztof Karas <krzysztof.karas@intel.com> Signed-off-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Change-Id: I98ca1ea4fb281beb71941656444267842a8875b7 Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/6995 Community-CI: Broadcom CI <spdk-ci.pdl@broadcom.com> Community-CI: Mellanox Build Bot Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com>
2021-08-06 09:17:16 +00:00
DEPDIRS-event_nvmf := init nvmf event_bdev event_scheduler event_sock thread log bdev util $(JSON_LIBS)
event: Shift subsystem initialization code to a separate library This is useful for applications even if they elect not to use the SPDK event framework. This doesn't shift everything in one go - just the subsystem initialization logic. Configuration file loading also needs to move in a separate patch later. Change-Id: Id419df1045442d416650ed90e5ee78adfdd623d7 Signed-off-by: Ben Walker <benjamin.walker@intel.com> Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/6641 Community-CI: Broadcom CI Community-CI: Mellanox Build Bot Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Aleksey Marchuk <alexeymar@mellanox.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Paul Luse <paul.e.luse@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com>
2021-02-26 22:00:03 +00:00
DEPDIRS-event_scsi := init scsi event_bdev
module/event: add subsystem interdependencies The SPDK application framework defines a list of event subsystem dependencies. When linking against individual shared libraries, it is useful for this dependency structure to be codified in the shared libraries themselves. For example, when linking a bdev based application against libspdk_bdev.so, one might wish to only specify this shared object at link time. However, when you actually run the application, it will fail to start because it is not linked to the copy and vmd subsystems. However, once thesedependencies are added, one can effectively link against only the exact subsystems they need and any dependent subsystems will be linked in automatically. Change-Id: Ic986281a162ac20b523486e9f8cccf4a0787afd7 Signed-off-by: Seth Howell <seth.howell@intel.com> Reviewed-on: https://review.gerrithub.io/c/spdk/spdk/+/466081 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Paul Luse <paul.e.luse@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2019-08-22 22:06:05 +00:00
scheduler: create public API and subsystem for scheduler/governor This patch moves schedueler and governor related API from the internal event.h to public scheduler.h. With this it is possible to create subsystem responsible for handling the schedulers. Three schedulers and a governor were moved to scheduler modules from event framework. This will allow next patch to add JSON RPC configuration to the whole subsystem. Along with easier addition of other schedulers. Removed debug logs from gscheduler, as they serve little purpose. Signed-off-by: Krzysztof Karas <krzysztof.karas@intel.com> Signed-off-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Change-Id: I98ca1ea4fb281beb71941656444267842a8875b7 Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/6995 Community-CI: Broadcom CI <spdk-ci.pdl@broadcom.com> Community-CI: Mellanox Build Bot Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com>
2021-08-06 09:17:16 +00:00
DEPDIRS-event_iscsi := init iscsi event_scheduler event_scsi event_sock
event/vhost: separate vhost subsystem to scsi and blk Separate out SCSI and BLK vhost subsystems to later add virtio_blk transport abstraction. This allows for further changes to the vhost_blk, not affecting vhost_scsi. Signed-off-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Change-Id: Id1ecfeafeb936809a479a43c321e13f75cb3d5ad Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/9539 Community-CI: Broadcom CI <spdk-ci.pdl@broadcom.com> Community-CI: Mellanox Build Bot Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Changpeng Liu <changpeng.liu@intel.com> Reviewed-by: Konrad Sztyber <konrad.sztyber@intel.com>
2021-08-31 09:28:29 +00:00
DEPDIRS-event_vhost_blk := init vhost
DEPDIRS-event_vhost_scsi := init vhost event_scheduler event_scsi
event: Shift subsystem initialization code to a separate library This is useful for applications even if they elect not to use the SPDK event framework. This doesn't shift everything in one go - just the subsystem initialization logic. Configuration file loading also needs to move in a separate patch later. Change-Id: Id419df1045442d416650ed90e5ee78adfdd623d7 Signed-off-by: Ben Walker <benjamin.walker@intel.com> Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/6641 Community-CI: Broadcom CI Community-CI: Mellanox Build Bot Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Aleksey Marchuk <alexeymar@mellanox.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Paul Luse <paul.e.luse@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com>
2021-02-26 22:00:03 +00:00
DEPDIRS-event_sock := init sock
lib/vfu_tgt: add library for PCI device emulation Previously SPDK use libvfio-user library to provide emulated NVMe devices to VM, but it's limited to NVMe device type only. Here we add SPDK vfu_target library abstraction based on libvfio-user which supports more PCI device types. We will add virtio-blk and virtio-scsi devices emulation based on vfu_tgt library in following patches, actually this library can support NVMe emulation too, due to the fact that the NVMe emulation is already exist, so we will keep the NVMe emulation which based on libvfio-user directly as it is. Change-Id: Ib0ead6c6118fa62308355fe432003dd928a2fae9 Signed-off-by: Changpeng Liu <changpeng.liu@intel.com> Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/12597 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Community-CI: Mellanox Build Bot Reviewed-by: Konrad Sztyber <konrad.sztyber@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2022-04-12 08:51:29 +00:00
DEPDIRS-event_vfu_tgt := init vfu_tgt
module/iobuf: introduce iobuf module This gives us a place to initialize iobuf pools, specify subsystem dependencies, and execute RPCs to configure the sizes of the pools. We allow users to configure the size of the pools either through the options in spdk_bdev_opts or through the new RPC, iobuf_set_options. The second option has higher priority, so it will override the options set by the bdev layer. Signed-off-by: Konrad Sztyber <konrad.sztyber@intel.com> Change-Id: I7c45ace04bc71c8343658f98248fc7babcf24e5d Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/15765 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Community-CI: Mellanox Build Bot Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Shuhei Matsumoto <smatsumoto@nvidia.com> Reviewed-by: Aleksey Marchuk <alexeymar@nvidia.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2022-11-29 15:47:09 +00:00
DEPDIRS-event_iobuf := init log thread util $(JSON_LIBS)
module/vfu_device: add virtio-blk emulation Here we use vfu-tgt library and emulate a virtio-blk device as the first use case of vfu-tgt library. Usage example with QEMU: 1. build/bin/spdk_tgt 2. scripts/rpc.py bdev_malloc_create -b malloc0 $((512)) 512 3. scripts/rpc.py vfu_virtio_create_blk_endpoint vfu.0 --bdev-name malloc0 \ --cpumask=0x1 --num-queues=2 \ --qsize=256 --packed-ring 4. Start QEMU with '-device vfio-user-pci,socket=/spdk/vfu.0' Change-Id: I45e45360c669584583b0b8a3f83250ab6c48efec Signed-off-by: Changpeng Liu <changpeng.liu@intel.com> Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/12315 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Konrad Sztyber <konrad.sztyber@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Community-CI: Mellanox Build Bot
2022-05-07 05:44:36 +00:00
# module/vfu_device
ifeq ($(CONFIG_VFIO_USER),y)
module/vfu_device: add virtio-scsi emulation Here we use vfu_tgt library and emulate a virtio-scsi device as the next use case. Compared with vhost-user-scsi, the packed ring is supported with this patch. Example usage method: 1. scripts/rpc.py bdev_malloc_create -b malloc0 $((512)) 512 2. scripts/rpc.py vfu_virtio_create_scsi_endpoint vfu.0 --cpumask 0x1 --num-io-queues=4 \ --qsize=128 --packed-ring 3. scripts/rpc.py vfu_virtio_scsi_add_target vfu.0 --scsi-target-num=0 --bdev-name malloc0 4. Start QEMU with '-device vfio-user-pci,socket=/spdk/vfu.0' Change-Id: I8f35d1d21aaec34844d6ddb59dc997a64f141179 Signed-off-by: Changpeng Liu <changpeng.liu@intel.com> Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/12673 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Community-CI: Mellanox Build Bot Reviewed-by: Konrad Sztyber <konrad.sztyber@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com>
2022-05-12 01:53:08 +00:00
DEPDIRS-vfu_device := $(BDEV_DEPS_THREAD) scsi vfu_tgt
module/vfu_device: add virtio-blk emulation Here we use vfu-tgt library and emulate a virtio-blk device as the first use case of vfu-tgt library. Usage example with QEMU: 1. build/bin/spdk_tgt 2. scripts/rpc.py bdev_malloc_create -b malloc0 $((512)) 512 3. scripts/rpc.py vfu_virtio_create_blk_endpoint vfu.0 --bdev-name malloc0 \ --cpumask=0x1 --num-queues=2 \ --qsize=256 --packed-ring 4. Start QEMU with '-device vfio-user-pci,socket=/spdk/vfu.0' Change-Id: I45e45360c669584583b0b8a3f83250ab6c48efec Signed-off-by: Changpeng Liu <changpeng.liu@intel.com> Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/12315 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Konrad Sztyber <konrad.sztyber@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Community-CI: Mellanox Build Bot
2022-05-07 05:44:36 +00:00
endif
Reference in New Issue Copy Permalink