Topic: "tensorrt-conversion"
jolibrain/deepdetect
Deep Learning API and Server in C++14 support for PyTorch,TensorRT, Dlib, NCNN, Tensorflow, XGBoost and TSNE
Language: C++ - Size: 103 MB - Last synced at: 21 days ago - Pushed at: about 2 months ago - Stars: 2,529 - Forks: 560

SthPhoenix/InsightFace-REST
InsightFace REST API for easy deployment of face recognition services with TensorRT in Docker.
Language: Python - Size: 4.44 MB - Last synced at: 21 days ago - Pushed at: 6 months ago - Stars: 528 - Forks: 120

THU-MIG/torch-model-compression
针对pytorch模型的自动化模型结构分析和修改工具集,包含自动分析模型结构的模型压缩算法库
Language: Python - Size: 132 KB - Last synced at: 9 days ago - Pushed at: about 2 years ago - Stars: 250 - Forks: 41

ThomasVonWu/SparseEnd2End
End2EndPerception deployment solution based on vision sparse transformer paradigm is open sourced.
Language: Python - Size: 26.5 MB - Last synced at: 26 days ago - Pushed at: 4 months ago - Stars: 112 - Forks: 19

emptysoal/TensorRT-YOLOv8
Based on tensorrt v8.0+, deploy detect, pose, segment, tracking of YOLOv8 with C++ and python api.
Language: C++ - Size: 212 MB - Last synced at: 17 days ago - Pushed at: 17 days ago - Stars: 95 - Forks: 17

BlueMirrors/Yolov5-TensorRT
Yolov5 TensorRT Implementations
Language: Python - Size: 46.9 KB - Last synced at: 11 days ago - Pushed at: over 2 years ago - Stars: 67 - Forks: 13

emptysoal/tensorrt-experiment
Base on tensorrt version 8.2.4, compare inference speed for different tensorrt api.
Language: Python - Size: 92 MB - Last synced at: 24 days ago - Pushed at: 24 days ago - Stars: 42 - Forks: 4

col-in-coding/Tensorrt-CV
Using TensorRT for Inference Model Deployment.
Language: Cuda - Size: 90.9 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 38 - Forks: 9

YuzhouPeng/unet-tensorrt
this is a tensorrt version unet, inspired by tensorrtx
Language: C++ - Size: 32.2 KB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 35 - Forks: 11

gpastal24/ViTPose-Pytorch
VitPose without MMCV dependencies
Language: Python - Size: 152 MB - Last synced at: about 1 year ago - Pushed at: almost 2 years ago - Stars: 29 - Forks: 8

k9ele7en/Triton-TensorRT-Inference-CRAFT-pytorch
Advanced inference pipeline using NVIDIA Triton Inference Server for CRAFT Text detection (Pytorch), included converter from Pytorch -> ONNX -> TensorRT, Inference pipelines (TensorRT, Triton server - multi-format). Supported model format for Triton inference: TensorRT engine, Torchscript, ONNX
Language: Python - Size: 15.5 MB - Last synced at: about 2 years ago - Pushed at: over 3 years ago - Stars: 25 - Forks: 6

leandro-svg/SparseInst_TensorRT
The real-time Instance Segmentation Algorithm SparseInst running on TensoRT and ONNX
Language: Python - Size: 57.6 MB - Last synced at: almost 2 years ago - Pushed at: over 2 years ago - Stars: 18 - Forks: 3

thaitc-hust/Yolo-TensorRT
Convert yolo models to ONNX, TensorRT add NMSBatched.
Language: Python - Size: 5.46 MB - Last synced at: 12 months ago - Pushed at: about 1 year ago - Stars: 15 - Forks: 4

emptysoal/TensorRT-v8-YOLOv5-v5.0
Based on TensorRT v8.2, build network for YOLOv5-v5.0 by myself, speed up YOLOv5-v5.0 inferencing
Language: C++ - Size: 430 KB - Last synced at: 25 days ago - Pushed at: 25 days ago - Stars: 13 - Forks: 1

bnabis93/tensorrt-toy
tensorrt-toy code
Language: Python - Size: 56.6 KB - Last synced at: about 1 year ago - Pushed at: over 2 years ago - Stars: 8 - Forks: 0

k9ele7en/ONNX-TensorRT-Inference-CRAFT-pytorch 📦
Advance inference performance using TensorRT for CRAFT Text detection. Implemented modules to convert Pytorch -> ONNX -> TensorRT, with dynamic shapes (multi-size input) inference.
Language: Python - Size: 12.3 MB - Last synced at: about 2 years ago - Pushed at: over 3 years ago - Stars: 8 - Forks: 2

jinyeom/torchrt
Simple tool for PyTorch >> ONNX >> TensorRT conversion
Language: Python - Size: 10.7 KB - Last synced at: about 2 years ago - Pushed at: over 4 years ago - Stars: 7 - Forks: 1

CuteBoiz/TensorRT_Parser_Python
Export (from Onnx) and Inference TensorRT engine with Python
Language: Python - Size: 46.9 KB - Last synced at: about 2 years ago - Pushed at: over 3 years ago - Stars: 4 - Forks: 1

Nannigalaxy/jetson_tools
Tools for Nvidia Jetson Nano, TX2, Xavier.
Language: Python - Size: 14.6 KB - Last synced at: 25 days ago - Pushed at: almost 4 years ago - Stars: 4 - Forks: 2

MrLaki5/TensorRT-onnx-dockerized-inference
Dockerized TensorRT inference engine with ONNX model conversion tool and ResNet50 and Ultraface preprocess and postprocess C++ implementation
Language: C++ - Size: 897 KB - Last synced at: about 2 years ago - Pushed at: about 2 years ago - Stars: 3 - Forks: 0

k9ele7en/torch2tensorRT-dynamic-CRAFT-pytorch
Convenient Convert CRAFT Text detection pretrain Pytorch model into TensorRT engine directly, without ONNX step between
Language: Python - Size: 24.4 KB - Last synced at: about 2 years ago - Pushed at: over 3 years ago - Stars: 3 - Forks: 1

SarthakGarg19/Accelerating-Inference-in-Tensorflow-using-TensorRT
TensorRT optimises any Deep Learning model by not only making it lightweight but also by accelerating its inference speed with an idea to extract every ounce of performance from the model, making it perfect to be deployed at the edge. This repository helps you convert any Deep Learning model from TensorFlow to TensorRT!
Language: Jupyter Notebook - Size: 32 MB - Last synced at: about 2 years ago - Pushed at: almost 6 years ago - Stars: 2 - Forks: 1

ggluo/TensorRT-Cpp-Example
C++/C TensorRT Inference Example for models created with Pytorch/JAX/TF
Language: C++ - Size: 767 KB - Last synced at: 8 months ago - Pushed at: 8 months ago - Stars: 1 - Forks: 0

NusratNB/TensorRT_TF2.4
TensorRT implementation with Tensorflow 2
Language: Jupyter Notebook - Size: 207 KB - Last synced at: over 1 year ago - Pushed at: almost 4 years ago - Stars: 1 - Forks: 0

sasikiran/jetson_tx2_trt_ssd
Jetson TX2 compatible TensorFlow's ssd_mobilenet_v2_coco for TensorRT 6 / JetPack 4.3
Size: 29.3 MB - Last synced at: about 2 years ago - Pushed at: almost 5 years ago - Stars: 1 - Forks: 0

littletomatodonkey/model_inference
不同backend的模型转换与推理代码
Language: Python - Size: 48.8 KB - Last synced at: about 1 month ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

emrecanaltinsoy/keras2trt
A CLI tool to convert Keras models to ONNX models and TensorRT engines
Language: Python - Size: 153 KB - Last synced at: over 1 year ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0

makaveli10/cpptensorrtz
Convert popular Deep learning models to TensorRT using C++ API (preferably)
Language: C++ - Size: 83 KB - Last synced at: 26 days ago - Pushed at: about 4 years ago - Stars: 0 - Forks: 0

akki2503/Image_Classification_Experiments_using_Cifar10
Experimenting with Cifar-10 dataset to understand and implement various Deep Learning Techniques and CNN Architectures for Image Classification.
Language: Jupyter Notebook - Size: 2.7 MB - Last synced at: almost 2 years ago - Pushed at: over 4 years ago - Stars: 0 - Forks: 0
