English | 中文
FastDeploy supports CPU inference with ONNX Runtime and GPU inference with Nvidia TensorRT/Paddle Inference on Nvidia Jetson platform
Could not find a package configuration file provided by "Python" with any of the following names: PythonConfig.cmake python-config.cmake
, please try to upgrade cmake to 3.25 or newer version to solve the problem.Prerequisite for Compiling on NVIDIA Jetson:
If you need to integrate Paddle Inference backend(Support CPU/GPU),please download and decompress the prebuilt library in Paddle Inference prebuild libraries according to your develop envriment.
git clone https://github.com/PaddlePaddle/FastDeploy.git
cd FastDeploy
mkdir build && cd build
cmake .. -DBUILD_ON_JETSON=ON \
-DENABLE_VISION=ON \
-DENABLE_PADDLE_BACKEND=ON \ # This is optional, can be OFF if you don't need
-DPADDLEINFERENCE_DIRECTORY=/Download/paddle_inference_jetson \
-DCMAKE_INSTALL_PREFIX=${PWD}/installed_fastdeploy
make -j8
make install
Once compiled, the C++ inference library is generated in the directory specified by CMAKE_INSTALL_PREFIX
Prerequisite for Compiling on NVIDIA Jetson:
Notice the wheel
is required if you need to pack a wheel, execute pip install wheel
first.
If you need to integrate Paddle Inference backend(Support CPU/GPU),please download and decompress the prebuilt library in Paddle Inference prebuild libraries according to your develop envriment.
All compilation options are imported via environment variables
git clone https://github.com/PaddlePaddle/FastDeploy.git
cd FastDeploy/python
export BUILD_ON_JETSON=ON
export ENABLE_VISION=ON
# ENABLE_PADDLE_BACKEND & PADDLEINFERENCE_DIRECTORY are optional
export ENABLE_PADDLE_BACKEND=ON
export PADDLEINFERENCE_DIRECTORY=/Download/paddle_inference_jetson
python setup.py build
python setup.py bdist_wheel
The compiled wheel
package will be generated in the FastDeploy/python/dist
directory once finished. Users can pip-install it directly.
During the compilation, if developers want to change the compilation parameters, it is advisable to delete the build
and .setuptools-cmake-build
subdirectories in the FastDeploy/python
to avoid the possible impact from cache, and then recompile.
此处可能存在不合适展示的内容,页面不予展示。您可通过相关编辑功能自查并修改。
如您确认内容无涉及 不当用语 / 纯广告导流 / 暴力 / 低俗色情 / 侵权 / 盗版 / 虚假 / 无价值内容或违法国家有关法律法规的内容,可点击提交进行申诉,我们将尽快为您处理。