GitHub topics: tensorrt-inference

Repositories

zubairmk83/ViTP

🌟 Pretrain domain-specific models using visual instructions to enhance accuracy and performance in specialized tasks with ViTP.

Language: Python - Size: 24 MB - Last synced at: about 6 hours ago - Pushed at: about 8 hours ago - Stars: 0 - Forks: 0

thillai-c/Vision-Language-Driving-Perception

Vision-Language Model fine-tuning pipeline for autonomous driving with distributed training, TensorRT optimization, and custom evaluation metrics.

Language: Python - Size: 1.71 MB - Last synced at: about 22 hours ago - Pushed at: about 23 hours ago - Stars: 0 - Forks: 0

HHX300/forward-collision-warning-system

ADAS 前车碰撞预警系统：True innovation does not come from closed barriers, but from sharing knowledge and lowering entry barriers so that more people can benefit.

Language: Python - Size: 67.8 MB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 4 - Forks: 0

asitiaf/llm-getting-started

Practical, beginner-friendly LLM projects using Python, LangChain, and LangSmith. Modular, reusable, and easy to run.

Language: Python - Size: 12.7 KB - Last synced at: 7 days ago - Pushed at: 8 days ago - Stars: 3 - Forks: 1

umitkacar/awesome-ai-edge-computing-tiny-embedded

Size: 376 KB - Last synced at: 10 days ago - Pushed at: 10 days ago - Stars: 20 - Forks: 0

laugh12321/TensorRT-YOLO

🚀 Easier & Faster YOLO Deployment Toolkit for NVIDIA 🛠️

Language: C++ - Size: 25.2 MB - Last synced at: 14 days ago - Pushed at: 15 days ago - Stars: 1,512 - Forks: 161

jolibrain/deepdetect

Deep Learning API and Server in C++14 support for PyTorch,TensorRT, Dlib, NCNN, Tensorflow, XGBoost and TSNE

Language: C++ - Size: 103 MB - Last synced at: 17 days ago - Pushed at: 17 days ago - Stars: 2,545 - Forks: 553

NVIDIA-ISAAC-ROS/isaac_ros_dnn_inference

NVIDIA-accelerated DNN model inference ROS 2 packages using NVIDIA Triton/TensorRT for both Jetson and x86_64 with CUDA-capable GPU

Language: C++ - Size: 336 KB - Last synced at: 24 days ago - Pushed at: 24 days ago - Stars: 121 - Forks: 15

emptysoal/YOLOv5-TensorRT-lib-Python

The code of YOLOv5 inferencing with TensorRT C++ api is packaged into a dynamic link library , then called through Python.

Language: Cuda - Size: 753 KB - Last synced at: 28 days ago - Pushed at: 28 days ago - Stars: 15 - Forks: 1

RenatoMaynard/Deepstream-Multistream-Layouts

Multi-camera DeepStream reference with dynamic layouts (mosaic, PiP, focus view), zero-copy paths, and latency-optimized settings. Includes config examples and layout switching without pipeline teardown.

Size: 2.93 KB - Last synced at: 18 days ago - Pushed at: 28 days ago - Stars: 0 - Forks: 0

emptysoal/tensorrt-experiment

Base on tensorrt version 8.2.4, compare inference speed for different tensorrt api.

Language: Python - Size: 92.1 MB - Last synced at: 30 days ago - Pushed at: 30 days ago - Stars: 50 - Forks: 4

lona-cn/vision-simple

a lightweight C++ cross-platform vision inference library,support YOLOv10 YOLOv11 PaddleOCR EasyOCR ,using ONNXRuntime/TVM with multiple exectuion providers.QQ群：364057904

Language: C++ - Size: 53.3 MB - Last synced at: about 1 month ago - Pushed at: 8 months ago - Stars: 35 - Forks: 3

emptysoal/TensorRT-YOLOv8

Based on tensorrt v8.0+, deploy detect, pose, segment, tracking of YOLOv8 with C++ and python api.

Language: C++ - Size: 212 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 123 - Forks: 25

emptysoal/Deepsort-YOLOv5-TensorRT

An object tracking project with YOLOv5-v5.0 and Deepsort, speed up by C++ and TensorRT.

Language: C++ - Size: 608 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 17 - Forks: 4

hamdiboukamcha/Yolo-V11-cpp-TensorRT

The YOLOv11 C++ TensorRT Project in C++ and optimized using NVIDIA TensorRT

Language: C++ - Size: 12 MB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 102 - Forks: 17

JoonHoonKim/cpp-TensorRT

TensorRT Inference Code by cpp

Language: C++ - Size: 79.5 MB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

WilliamZhang20/Transformer-from-Scratch

Inference acceleration of transformers implemented from scratch

Language: Jupyter Notebook - Size: 51.8 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

yuvraj108c/ComfyUI-Depth-Anything-Tensorrt

ComfyUI Depth Anything (v1/v2/distill-any-depth) Tensorrt Custom Node (up to 14x faster)

Language: Python - Size: 3.18 MB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 111 - Forks: 12

Sinapsis-AI/sinapsis-retina-face-trt

Sinapsis repo with templates for face detection, face recognition and face verification

Language: Python - Size: 1.17 MB - Last synced at: 22 days ago - Pushed at: 3 months ago - Stars: 10 - Forks: 6

ammarmalik17/Jetson-Yolo-Tracking-TensorRT

Language: Python - Size: 46.9 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

gpastal24/ViTPose-Pytorch

VitPose without MMCV dependencies

Language: Python - Size: 152 MB - Last synced at: 3 months ago - Pushed at: 4 months ago - Stars: 44 - Forks: 8

emptysoal/TensorRT-v8-YOLOv5-v5.0

Based on TensorRT v8.2, build network for YOLOv5-v5.0 by myself, speed up YOLOv5-v5.0 inferencing

Language: C++ - Size: 434 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 12 - Forks: 1

HenrikTrom/detection_inference

A high-performance, multi-threaded C++ pipeline for real-time multi-camera object detection using YOLOv8.

Language: C++ - Size: 7.32 MB - Last synced at: 3 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

emptysoal/TensorRT-YOLO11

Based on tensorrt v8.0+, deploy detection, pose, segment, tracking of YOLO11 with C++ and python api.

Language: C++ - Size: 133 MB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 224 - Forks: 37

bmycheez/EasyDemo

Video Denoising Demo in NVIDIA Jetson Xavier NX + Sony IMX462 Camera Sensor (2023)

Language: Python - Size: 43 KB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

Koldim2001/TrafficAnalyzer

Анализ трафика на круговом движении с использованием компьютерного зрения

Language: Python - Size: 401 MB - Last synced at: 4 months ago - Pushed at: 9 months ago - Stars: 94 - Forks: 7

PrinceP/tensorrt-sample-on-threads

A tutorial for getting started on running Tensorrt engine and Deep Learning Accelerator (DLA) models on threads

Language: C++ - Size: 2.93 KB - Last synced at: 28 days ago - Pushed at: about 1 year ago - Stars: 1 - Forks: 0

jagennath-hari/DepthStream-Accelerator-ROS2-Integrated-Monocular-Depth-Inference

DepthStream Accelerator: A TensorRT-optimized monocular depth estimation tool with ROS2 integration for C++. It offers high-speed, accurate depth perception, perfect for real-time applications in robotics, autonomous vehicles, and interactive 3D environments.

Language: C++ - Size: 10.9 MB - Last synced at: 3 months ago - Pushed at: 8 months ago - Stars: 22 - Forks: 0

MustaphaU/Simplify-Documentation-Review-on-Atlassian-Confluence-with-LLAMA2-and-NVIDIA-TensorRT-LLM

A simple project demonstrating LLM assisted review of documentation on Atlasssian Confluence.

Language: Python - Size: 927 KB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 0 - Forks: 0

Qengineering/YoloV8-TensorRT-Jetson_Nano

A lightweight C++ implementation of YoloV8 running on NVIDIAs TensorRT engine

Language: C++ - Size: 328 MB - Last synced at: 7 months ago - Pushed at: over 1 year ago - Stars: 18 - Forks: 1

mohamedsamirx/YOLOv12-TensorRT-CPP

YOLOv12 Inference Using CPP, Tensorrt, And CUDA

Language: C++ - Size: 1.98 MB - Last synced at: 8 months ago - Pushed at: 8 months ago - Stars: 32 - Forks: 1

fanpeace/dbnet_torch

you can use dbnet to detect word or bar code,Knowledge Distillation is provided,also python tensorrt inference is provided.

Language: Python - Size: 215 MB - Last synced at: 7 months ago - Pushed at: almost 5 years ago - Stars: 45 - Forks: 10

LCH1238/bevdet-tensorrt-cpp

BEVDet implemented by TensorRT, C++； Achieving real-time performance on Orin

Language: C++ - Size: 6.98 MB - Last synced at: 8 months ago - Pushed at: about 2 years ago - Stars: 253 - Forks: 45

liangxiansheng093/3d-sort

For 3d dynamic target detection and motion tracking includes target detection, 3D tracking program.

Language: C++ - Size: 11.1 MB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 0 - Forks: 0

NotAP0tato/awesome-ai-toolkit

An extensive curated list of AI tools, frameworks, and libraries to supercharge your artificial intelligence projects.

Size: 1.95 KB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 1 - Forks: 0

parlaynu/inference-tensorrt

Convert ONNX models to TensorRT engines and run inference in containerized environments

Language: Python - Size: 9.77 KB - Last synced at: 5 months ago - Pushed at: over 1 year ago - Stars: 10 - Forks: 1

xstongxue/TensorRT-Alpha-Plus

TensorRT for Web-RTDETR、Web-YOLOv8、RTDETR、YOLOv8、YOLOv8-Pose、YOLOv8-Seg、YOLOv8-Cls、YOLOv7、YOLOv6、YOLOv5......⭐

Language: C++ - Size: 106 MB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 0 - Forks: 0

mingj2021/segment-anything-tensorrt

Language: Jupyter Notebook - Size: 17.1 MB - Last synced at: 8 months ago - Pushed at: about 2 years ago - Stars: 77 - Forks: 9

kamalkraj/stable-diffusion-tritonserver

Deploy stable diffusion model with onnx/tenorrt + tritonserver

Language: Jupyter Notebook - Size: 2.62 MB - Last synced at: 7 months ago - Pushed at: over 2 years ago - Stars: 123 - Forks: 19

cuixing158/yolo-tensorRT-cpp

部署量化库，适合pc,jetson,int8量化， yolov3/v4/v5

Language: C++ - Size: 610 KB - Last synced at: 9 months ago - Pushed at: about 2 years ago - Stars: 1 - Forks: 0

spacewalk01/nanosam-cpp

C++ TensorRT Implementation of NanoSAM

Language: C++ - Size: 7.1 MB - Last synced at: about 1 year ago - Pushed at: almost 2 years ago - Stars: 30 - Forks: 3

ggluo/TensorRT-Cpp-Example

C++/C TensorRT Inference Example for models created with Pytorch/JAX/TF

Language: C++ - Size: 767 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 1 - Forks: 0

YuzhouPeng/unet-tensorrt

this is a tensorrt version unet, inspired by tensorrtx

Language: C++ - Size: 32.2 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 35 - Forks: 11

ce-dric/TensorRT-Batch

TensorRT capable of processing batch units

Language: Jupyter Notebook - Size: 145 KB - Last synced at: 2 months ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

djetshu/yolo_nas_trt_training

Anaconda environment to train YOLONAS, to convert yolonas.onnx to TensorRT model and to test it with webcam in real time.

Language: Jupyter Notebook - Size: 4.26 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

BlueMirrors/Yolov5-TensorRT

Yolov5 TensorRT Implementations

Language: Python - Size: 46.9 KB - Last synced at: 7 months ago - Pushed at: almost 3 years ago - Stars: 67 - Forks: 13

vossr/YOLOX-custom Fork of Megvii-BaseDetection/YOLOX

YOLOX TensorRT object detection

Language: Python - Size: 7.43 MB - Last synced at: about 1 month ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

Related Keywords

tensorrt-inference 75 tensorrt 50 pytorch 18 tensorrt-conversion 17 onnx 16 object-detection 13 tensorrt-engine 12 deep-learning 12 yolov5 10 python 9 cpp 8 yolo 8 yolov8 8 onnxruntime 8 jetson-nano 5 jetson 5 python3 5 ai 5 cuda 5 docker 5 nvidia 4 computer-vision 4 detection 4 tracking 4 real-time 4 yolo11 4 deeplearning 3 machine-learning 3 image-segmentation 3 edge-computing 3 triton-inference-server 3 ncnn 3 image-classification 3 pose-estimation 3 ultralytics 3 robotics 3 segmentation 3 object-tracking 3 quantization 2 streamlit 2 yolov3 2 tensorrt-llm 2 jetson-orin 2 jetson-orin-nano 2 mnist 2 gpu 2 nlp 2 yolox 2 jetpack 2 segment-anything 2 gpu-acceleration 2 nvidia-jetson 2 retinaface 2 face-recognition 2 ros2 2 triton 2 face-detection 2 fp16 2 cnn 2 cuda-programming 2 yolonas-tensorrt 2 bytetrack 2 unet 2 jetson-xavier 2 gpu-computing 2 2d-keypoints 2 instance-segmentation 2 annotation-tool 2 yolov11 2 jupyter-notebook 2 transformers 2 llm-inference 2 dynamic-shape 2 windows-10 1 visual-studio 1 sam 1 ptq 1 nanosam 1 onnx-tensorrt 1 onnx-torch 1 text-detection 1 yolov4 1 stablediffusion 1 inference 1 c 1 unet-tensorrt 1 docker-container 1 anaconda-environment 1 realtime 1 yolonas 1 post-training-quantization 1 model-compression 1 object-tracker 1 person-reid 1 person-reidentification 1 yolor-tensorrt 1 llama-index 1 llama2 1 trt 1 tensorrt-switch-gpu 1

GitHub topics: tensorrt-inference

vossr/YOLOX-custom Fork of Megvii-BaseDetection/YOLOX

k9ele7en/ONNX-TensorRT-Inference-CRAFT-pytorch 📦