ivampiresp/Spdk
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
1b56233c0c
Spdk/test/external_code/test_make.sh

64 lines
2.7 KiB
Bash
Raw Normal View History

test/autobuild: verify external code can link to libs This test helps ensure that nothing about the way we build our shared objects changes in a way that breaks external applications or bdev modules trying to link to SPDK. Change-Id: I45ac36a2afc873b04eb237f4e633a9d84066737c Signed-off-by: Seth Howell <seth.howell@intel.com> Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/435 Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Community-CI: Broadcom CI
2020-01-21 17:18:46 +00:00
#!/usr/bin/env bash
test_root=$(readlink -f $(dirname $0))
rootdir="$test_root/../.."
source "$rootdir/test/common/autotest_common.sh"
set -e
SPDK_DIR=$1
test/external: Add setup call to test_make.sh This makes sure that we will have the hugepages we need even on systems that don't have them configured by default. Signed-off-by: Seth Howell <seth.howell@intel.com> Change-Id: I9a0d82e0abf6363c1c037732b543c05e8931f97e Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/2141 Community-CI: Mellanox Build Bot Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Paul Luse <paul.e.luse@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com>
2020-05-02 04:49:36 +00:00
# Skip all pci devices. These tests don't rely on them.
test/external_code: use default HUGEMEM in setup.sh Fixes #1382 System memory gets fragmented over time and repeated hugepage allocations fail, giving us intermittent failures on CI. Linux allocates those pages only when requested hugepage count is bigger than current hugepage count, so in order to prevent any additional allocations just stick to a single count all the time. autotest_common.sh already exports HUGEMEM=8G for Linux systems and 2G for BSD ones. `setup.sh reset` doesn't touch the hugepages, so practically only the first `setup.sh` will allocate memory now. The two setup.sh calls are run with sudo, so they need HUGEMEM="$HUGEMEM" to work. Change-Id: I48b4a720bad4e1da14e78313b4db0eb60a177c38 Signed-off-by: Darek Stojaczyk <dariusz.stojaczyk@intel.com> Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/2374 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com> Reviewed-by: Seth Howell <seth.howell@intel.com>
2020-05-11 13:41:24 +00:00
sudo PCI_WHITELIST="NONE" HUGEMEM="$HUGEMEM" $SPDK_DIR/scripts/setup.sh
test/external: Add setup call to test_make.sh This makes sure that we will have the hugepages we need even on systems that don't have them configured by default. Signed-off-by: Seth Howell <seth.howell@intel.com> Change-Id: I9a0d82e0abf6363c1c037732b543c05e8931f97e Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/2141 Community-CI: Mellanox Build Bot Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Paul Luse <paul.e.luse@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com>
2020-05-02 04:49:36 +00:00
test/autobuild: verify external code can link to libs This test helps ensure that nothing about the way we build our shared objects changes in a way that breaks external applications or bdev modules trying to link to SPDK. Change-Id: I45ac36a2afc873b04eb237f4e633a9d84066737c Signed-off-by: Seth Howell <seth.howell@intel.com> Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/435 Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Community-CI: Broadcom CI
2020-01-21 17:18:46 +00:00
$SPDK_DIR/configure --with-shared --without-isal --without-ocf --disable-asan
make -C $SPDK_DIR -j$(nproc)
export SPDK_HEADER_DIR="$SPDK_DIR/include"
export SPDK_LIB_DIR="$SPDK_DIR/build/lib"
test/common: consolidate test params for running with external DPDK Get rid of WITH_DPDK_DIR and SPDK_RUN_INSTALLED_DPDK, introduce SPDK_RUN_EXTERNAL_DPDK which can point to a DPDK dir. It's an empty string by default. Change-Id: Iff2b3773a4614db07f4196165087a79472e02b9a Signed-off-by: Darek Stojaczyk <dariusz.stojaczyk@intel.com> Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/867 Community-CI: Mellanox Build Bot Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com>
2020-02-12 12:19:18 +00:00
export DPDK_LIB_DIR="${SPDK_RUN_EXTERNAL_DPDK:-$SPDK_DIR/dpdk/build}/lib"
test/external_code: set LD_LIBRARY_PATH once. Just set it once instead of doing it over and over. This cleans up the code a lot. Signed-off-by: Seth Howell <seth.howell@intel.com> Change-Id: I91c6ea8c02d964693909b9c53795b0f1ee09c90f Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/2979 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Community-CI: Mellanox Build Bot Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Aleksey Marchuk <alexeymar@mellanox.com> Reviewed-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com>
2020-06-19 22:30:10 +00:00
export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:$SPDK_LIB_DIR:$DPDK_LIB_DIR:"$test_root/passthru"
test/autobuild: verify external code can link to libs This test helps ensure that nothing about the way we build our shared objects changes in a way that breaks external applications or bdev modules trying to link to SPDK. Change-Id: I45ac36a2afc873b04eb237f4e633a9d84066737c Signed-off-by: Seth Howell <seth.howell@intel.com> Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/435 Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Community-CI: Broadcom CI
2020-01-21 17:18:46 +00:00
# The default target is to make both the app and bdev and link them against the combined SPDK shared library libspdk.so.
run_test "external_make_tc1" make -C $test_root hello_world_bdev_shared_combo
test/external_code: modify some remaining parts for switching to json Change-Id: Ic79366a527e5aa23e4821ec88533b66e70eafde5 signed-off-by: wanghailiangx <hailiangx.e.wang@intel.com> Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/4475 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com> Reviewed-by: Aleksey Marchuk <alexeymar@mellanox.com> Reviewed-by: Changpeng Liu <changpeng.liu@intel.com>
2020-09-30 14:41:11 +00:00
run_test "external_run_tc1" $test_root/hello_world/hello_bdev --json $test_root/hello_world/bdev_external.json -b TestPT
test/autobuild: verify external code can link to libs This test helps ensure that nothing about the way we build our shared objects changes in a way that breaks external applications or bdev modules trying to link to SPDK. Change-Id: I45ac36a2afc873b04eb237f4e633a9d84066737c Signed-off-by: Seth Howell <seth.howell@intel.com> Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/435 Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Community-CI: Broadcom CI
2020-01-21 17:18:46 +00:00
make -C $test_root clean
# Make just the application linked against the combined SPDK shared library libspdk.so.
run_test "external_make_tc2" make -C $test_root hello_world_no_bdev_shared_combo
test/external_code: modify some remaining parts for switching to json Change-Id: Ic79366a527e5aa23e4821ec88533b66e70eafde5 signed-off-by: wanghailiangx <hailiangx.e.wang@intel.com> Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/4475 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com> Reviewed-by: Aleksey Marchuk <alexeymar@mellanox.com> Reviewed-by: Changpeng Liu <changpeng.liu@intel.com>
2020-09-30 14:41:11 +00:00
run_test "external_run_tc2" $test_root/hello_world/hello_bdev --json $test_root/hello_world/bdev.json -b Malloc0
test/autobuild: verify external code can link to libs This test helps ensure that nothing about the way we build our shared objects changes in a way that breaks external applications or bdev modules trying to link to SPDK. Change-Id: I45ac36a2afc873b04eb237f4e633a9d84066737c Signed-off-by: Seth Howell <seth.howell@intel.com> Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/435 Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Community-CI: Broadcom CI
2020-01-21 17:18:46 +00:00
make -C $test_root clean
# Make both the application and bdev against individual SPDK shared libraries.
run_test "external_make_tc3" make -C $test_root hello_world_bdev_shared_iso
test/external_code: modify some remaining parts for switching to json Change-Id: Ic79366a527e5aa23e4821ec88533b66e70eafde5 signed-off-by: wanghailiangx <hailiangx.e.wang@intel.com> Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/4475 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com> Reviewed-by: Aleksey Marchuk <alexeymar@mellanox.com> Reviewed-by: Changpeng Liu <changpeng.liu@intel.com>
2020-09-30 14:41:11 +00:00
run_test "external_run_tc3" $test_root/hello_world/hello_bdev --json $test_root/hello_world/bdev_external.json -b TestPT
test/autobuild: verify external code can link to libs This test helps ensure that nothing about the way we build our shared objects changes in a way that breaks external applications or bdev modules trying to link to SPDK. Change-Id: I45ac36a2afc873b04eb237f4e633a9d84066737c Signed-off-by: Seth Howell <seth.howell@intel.com> Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/435 Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Community-CI: Broadcom CI
2020-01-21 17:18:46 +00:00
make -C $test_root clean
# Make just the application linked against individual SPDK shared libraries.
run_test "external_make_tc4" make -C $test_root hello_world_no_bdev_shared_iso
test/external_code: modify some remaining parts for switching to json Change-Id: Ic79366a527e5aa23e4821ec88533b66e70eafde5 signed-off-by: wanghailiangx <hailiangx.e.wang@intel.com> Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/4475 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com> Reviewed-by: Aleksey Marchuk <alexeymar@mellanox.com> Reviewed-by: Changpeng Liu <changpeng.liu@intel.com>
2020-09-30 14:41:11 +00:00
run_test "external_run_tc4" $test_root/hello_world/hello_bdev --json $test_root/hello_world/bdev.json -b Malloc0
test/autobuild: verify external code can link to libs This test helps ensure that nothing about the way we build our shared objects changes in a way that breaks external applications or bdev modules trying to link to SPDK. Change-Id: I45ac36a2afc873b04eb237f4e633a9d84066737c Signed-off-by: Seth Howell <seth.howell@intel.com> Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/435 Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Community-CI: Broadcom CI
2020-01-21 17:18:46 +00:00
make -C $test_root clean
make -C $SPDK_DIR clean
$SPDK_DIR/configure --without-shared --without-isal --without-ocf --disable-asan
make -C $SPDK_DIR -j$(nproc)
# Make both the application and bdev against individual SPDK archives.
run_test "external_make_tc5" make -C $test_root hello_world_bdev_static
test/external_code: modify some remaining parts for switching to json Change-Id: Ic79366a527e5aa23e4821ec88533b66e70eafde5 signed-off-by: wanghailiangx <hailiangx.e.wang@intel.com> Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/4475 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com> Reviewed-by: Aleksey Marchuk <alexeymar@mellanox.com> Reviewed-by: Changpeng Liu <changpeng.liu@intel.com>
2020-09-30 14:41:11 +00:00
run_test "external_run_tc5" $test_root/hello_world/hello_bdev --json $test_root/hello_world/bdev_external.json -b TestPT
test/autobuild: verify external code can link to libs This test helps ensure that nothing about the way we build our shared objects changes in a way that breaks external applications or bdev modules trying to link to SPDK. Change-Id: I45ac36a2afc873b04eb237f4e633a9d84066737c Signed-off-by: Seth Howell <seth.howell@intel.com> Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/435 Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Community-CI: Broadcom CI
2020-01-21 17:18:46 +00:00
make -C $test_root clean
# Make just the application linked against individual SPDK archives.
run_test "external_make_tc6" make -C $test_root hello_world_no_bdev_static
test/external_code: modify some remaining parts for switching to json Change-Id: Ic79366a527e5aa23e4821ec88533b66e70eafde5 signed-off-by: wanghailiangx <hailiangx.e.wang@intel.com> Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/4475 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com> Reviewed-by: Aleksey Marchuk <alexeymar@mellanox.com> Reviewed-by: Changpeng Liu <changpeng.liu@intel.com>
2020-09-30 14:41:11 +00:00
run_test "external_run_tc6" $test_root/hello_world/hello_bdev --json $test_root/hello_world/bdev.json -b Malloc0
test/autobuild: verify external code can link to libs This test helps ensure that nothing about the way we build our shared objects changes in a way that breaks external applications or bdev modules trying to link to SPDK. Change-Id: I45ac36a2afc873b04eb237f4e633a9d84066737c Signed-off-by: Seth Howell <seth.howell@intel.com> Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/435 Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Community-CI: Broadcom CI
2020-01-21 17:18:46 +00:00
make -C $test_root clean
make -C $SPDK_DIR -j$(nproc) clean
test/external: Add setup call to test_make.sh This makes sure that we will have the hugepages we need even on systems that don't have them configured by default. Signed-off-by: Seth Howell <seth.howell@intel.com> Change-Id: I9a0d82e0abf6363c1c037732b543c05e8931f97e Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/2141 Community-CI: Mellanox Build Bot Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Paul Luse <paul.e.luse@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Tomasz Zawadzki <tomasz.zawadzki@intel.com>
2020-05-02 04:49:36 +00:00
test/external_code: use default HUGEMEM in setup.sh Fixes #1382 System memory gets fragmented over time and repeated hugepage allocations fail, giving us intermittent failures on CI. Linux allocates those pages only when requested hugepage count is bigger than current hugepage count, so in order to prevent any additional allocations just stick to a single count all the time. autotest_common.sh already exports HUGEMEM=8G for Linux systems and 2G for BSD ones. `setup.sh reset` doesn't touch the hugepages, so practically only the first `setup.sh` will allocate memory now. The two setup.sh calls are run with sudo, so they need HUGEMEM="$HUGEMEM" to work. Change-Id: I48b4a720bad4e1da14e78313b4db0eb60a177c38 Signed-off-by: Darek Stojaczyk <dariusz.stojaczyk@intel.com> Reviewed-on: https://review.spdk.io/gerrit/c/spdk/spdk/+/2374 Tested-by: SPDK CI Jenkins <sys_sgci@intel.com> Reviewed-by: Jim Harris <james.r.harris@intel.com> Reviewed-by: Ben Walker <benjamin.walker@intel.com> Reviewed-by: Shuhei Matsumoto <shuhei.matsumoto.xt@hitachi.com> Reviewed-by: Seth Howell <seth.howell@intel.com>
2020-05-11 13:41:24 +00:00
sudo PCI_WHITELIST="NONE" HUGEMEM="$HUGEMEM" $SPDK_DIR/scripts/setup.sh reset
Reference in New Issue Copy Permalink