maturin build fails on CentOS 7

[apepkuss]

Hi guys,

I am using PyO3 and maturin to prototype a project, in which I'd like to load a plugin, a .so file. When I use maturin develop or maturin develop -r to build and deploy the wheel, it works well and can print the count 1 and the name wasi_nn of the plugin library in the Python environment. When I use maturin build, however, it seems to not "find" the plugin library, printing the count 0. I did the test in CentOS Linux release 7.9.2009 (Core). Even though I did some investigations on it, I failed to find a way to solve it. Does anyone know what causes the issue and how to fix it? Thanks a lot!

The steps to reproduce the issue:

• Git clone test code

  Git clone test code and put it into a directory named, for example, workspace:

  cd workspace
  git clone https://github.com/apepkuss/load_plugin.git

  Docker pull wasmedge/wasmedge:manylinux2014_x86_64

  docker run --name="test-plugin" -it -v $HOME/workspace/:/root/workspace wasmedge/wasmedge:manylinux2014_x86_64

The steps below are run in the docker container:

• Download library file

  In the docker container, download and unzip the library file:

  cd load_plugin
  
  # download .so file
  curl -LO https://github.com/WasmEdge/WasmEdge/releases/download/0.13.5/WasmEdge-plugin-wasi_nn-ggml-0.13.5-manylinux2014_x86_64.tar.gz
  
  # unzip
  tar -xf WasmEdge-plugin-wasi_nn-ggml-0.13.5-manylinux2014_x86_64.tar.gz
  
  # set LD_LIBRARY_PATH
  export LD_LIBRARY_PATH=/root/workspace/test/load_plugin:$LD_LIBRARY_PATH

• Install WasmEdge Runtime

  curl -sSf https://raw.githubusercontent.com/WasmEdge/WasmEdge/master/utils/install.sh | bash -s -- -v 0.13.5

• Set up Python environment

  • Create a virtual environment

    cd load_plugin
    
    # create virtual env
    /opt/python/cp310-cp310/bin/python -m venv .env
    
    # activate env
    source .env/bin/activate

  • Install dependencies

    pip install maturin patchelf

• Build with maturin develop

  • Build

    maturin develop -r

  • Test

    (.env) [root@277f2e649aad load_plugin]# python
    Python 3.10.13 (main, Dec  5 2023, 08:22:38) [GCC 10.2.1 20210130 (Red Hat 10.2.1-11)] on linux
    Type "help", "copyright", "credits" or "license" for more information.
    >>> import load_plugin
    >>> load_plugin.run()
    Hello, world!
    Plugin count: 1
    Plugin names: ["wasi_nn"]

• Build with maturin build (Failed)

  • Uninstall the load_plugin package if there is one installed

    # uninstall `load_plugin` installed by `maturin develop`
    pip uninstall load_plugin

  • maturin build the load_plugin wheel:

    maturin build --compatibility manylinux2014 -i /root/workspace/test/load_plugin/.env/bin/python -r -o dist

  • Install the wheel

    pip install dist/load_plugin-0.1.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl

  • Test

    (.env) [root@277f2e649aad load_plugin]# python
    Python 3.10.13 (main, Dec  5 2023, 08:22:38) [GCC 10.2.1 20210130 (Red Hat 10.2.1-11)] on linux
    Type "help", "copyright", "credits" or "license" for more information.
    >>> import load_plugin
    >>> load_plugin.run()
    Hello, world!
    Plugin count: 0
    Plugin names: []
    >>>