facefusion/facefusion

Industry leading face manipulation platform

Language: Python - Size: 25.2 MB - Last synced at: 13 days ago - Pushed at: 14 days ago - Stars: 26,198 - Forks: 4,192

bytedance/LatentSync

Taming Stable Diffusion for Lip Sync!

Language: Python - Size: 9.19 MB - Last synced at: 4 months ago - Pushed at: 7 months ago - Stars: 4,894 - Forks: 788

numz/sd-wav2lip-uhq

Wav2Lip UHQ extension for Automatic1111

Language: Python - Size: 1.02 MB - Last synced at: 8 months ago - Pushed at: over 1 year ago - Stars: 1,371 - Forks: 182

Voine/ChatWaifu_Mobile

移动版二次元 AI 老婆聊天器

Language: C++ - Size: 415 MB - Last synced at: 8 months ago - Pushed at: over 2 years ago - Stars: 1,297 - Forks: 142

facefusion/facefusion-docker

Industry leading face manipulation platform

Size: 43 KB - Last synced at: 17 days ago - Pushed at: 20 days ago - Stars: 496 - Forks: 185

SamKhoze/ComfyUI-DeepFuze

DeepFuze is a state-of-the-art deep learning tool that seamlessly integrates with ComfyUI to revolutionize facial transformations, lipsyncing, Face Swapping, Lipsync Translation, video generation, and voice cloning.

Language: Python - Size: 50.1 MB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 423 - Forks: 52

asanchezyali/talking-avatar-with-ai

This project is a digital human that can talk and listen to you. It uses OpenAI's GPT to generate responses, OpenAI's Whisper to transcript the audio, Eleven Labs to generate voice and Rhubarb Lip Sync to generate the lip sync.

Language: JavaScript - Size: 30.8 MB - Last synced at: 4 months ago - Pushed at: over 1 year ago - Stars: 365 - Forks: 91

facefusion/facefusion-pinokio

Industry leading face manipulation platform

Language: JavaScript - Size: 316 KB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 346 - Forks: 109

huailiang/LipSync

LipSync for Unity3D 根据语音生成口型动画 支持fmod

Language: CMake - Size: 20.9 MB - Last synced at: about 2 years ago - Pushed at: over 5 years ago - Stars: 314 - Forks: 66

yuvraj108c/ComfyUI-FLOAT

Generative Motion Latent Flow Matching for Audio-driven Talking Portrait

Language: Python - Size: 49.8 KB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 196 - Forks: 19

hecomi/MMD4Mecanim-LipSync-Plugin

LipSync and TTS Plugin for MMD4Mecanim

Language: C# - Size: 381 MB - Last synced at: 9 months ago - Pushed at: over 7 years ago - Stars: 157 - Forks: 37

mowshon/lipsync

lipsync is a simple and updated Python library for lip synchronization, based on Wav2Lip. It synchronizes lips in videos and images based on provided audio, supports CPU/CUDA, and uses caching for faster processing.

Language: Python - Size: 223 KB - Last synced at: about 1 month ago - Pushed at: 12 months ago - Stars: 139 - Forks: 21

AaronComo/LipFD

[NeurIPS 2024] This is the official repo of the paper "Lips Are Lying: Spotting the Temporal Inconsistency between Audio and Visual in Lip-syncing DeepFakes".

Language: Python - Size: 5.44 MB - Last synced at: 5 months ago - Pushed at: 11 months ago - Stars: 117 - Forks: 10

indianajson/wav2lip-HD Fork of ajay-sainy/Wav2Lip-GFPGAN

Alternative to Flawless AI's TrueSync. Make lips in video match provided audio using the power of Wav2Lip and GFPGAN.

Language: Python - Size: 29.2 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 98 - Forks: 20

AnimaVR/NeuroSync_Player

The NeuroSync Player allows for real-time streaming of facial blendshapes into Unreal Engine 5 using LiveLink - enabling facial animation from audio input.

Language: Python - Size: 20.7 MB - Last synced at: 8 months ago - Pushed at: 8 months ago - Stars: 93 - Forks: 36

numz/wav2lip_uhq

Wav2Lip UHQ Improvement with ControlNet 1.1

Language: Python - Size: 73.9 MB - Last synced at: 9 months ago - Pushed at: over 2 years ago - Stars: 73 - Forks: 18

taherfattahi/nvidia-human-ai-lipsync

This project is a digital human that can talk to you and is animated based on your questions. It uses the Nvidia API endpoint Meta llama3-70b to generate responses, Eleven Labs to generate voice and Rhubarb Lip Sync to generate the lip sync.

Language: JavaScript - Size: 26.9 MB - Last synced at: 5 months ago - Pushed at: over 1 year ago - Stars: 61 - Forks: 12

viniciushelder/OVRLipSync-UE5

Oculus Lip Sync Compiled for Unreal 5

Language: C++ - Size: 120 MB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 58 - Forks: 6

talkr-app/gif-talkr Fork of buzzfeed/libgif-js

JavaScript library animating a GIF file to speech (or TTS)

Language: JavaScript - Size: 21.3 MB - Last synced at: 3 months ago - Pushed at: almost 6 years ago - Stars: 58 - Forks: 14

AnimaVR/NeuroSync_Local_API

Audio to face local inference helper code.

Language: Python - Size: 611 KB - Last synced at: 8 months ago - Pushed at: 8 months ago - Stars: 53 - Forks: 20

ReForge-Mode/Radish_Tools_Phoneme_Extractor

A phoneme extractor tool for a free lipsync workflow in Unity. This is not made by me. it is made by rmemr

Size: 12.8 MB - Last synced at: 7 months ago - Pushed at: almost 3 years ago - Stars: 39 - Forks: 6

AIFSH/ComfyUI-IP_LAP

the comfyui custom node of IP_LAP to make audio driven videos!

Language: Python - Size: 1.46 MB - Last synced at: 5 months ago - Pushed at: over 1 year ago - Stars: 34 - Forks: 10

makersmakingchange/LipSync-Classic

An open-source mouth operated sip and puff joystick that enables people with limited hand function emulate a mouse on their computer and/or smartphone.

Language: C++ - Size: 105 MB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 30 - Forks: 10

InuInu2022/KuchiPaku

A lip sync generator tool for YMM4.

Language: C# - Size: 313 KB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 26 - Forks: 3

ReForge-Mode/UniLipSync

Load your phoneme files and generate the lipsync animation from your recorded audio files. No video or webcam needed!

Language: C# - Size: 158 MB - Last synced at: 7 months ago - Pushed at: almost 3 years ago - Stars: 26 - Forks: 6

AnimaVR/NeuroSync_Trainer_Lite

A multi GPU audio2face blendshape AI model trainer for your iPhone ARKit data.

Language: Python - Size: 7.44 MB - Last synced at: 8 months ago - Pushed at: 8 months ago - Stars: 22 - Forks: 10

AIFSH/ComfyUI-MuseTalk_FSH

the comfyui custom node of MuseTalk to make audio driven videos!

Language: Python - Size: 2.52 MB - Last synced at: 4 months ago - Pushed at: over 1 year ago - Stars: 21 - Forks: 7

yamahigashi/Wav2Vec2FBX

Recognize speech from an audio file and convert it into animation FBX

Language: Python - Size: 199 KB - Last synced at: 7 months ago - Pushed at: almost 4 years ago - Stars: 21 - Forks: 3

Ashish-Patnaik/HanaVerse

HanaVerse is a interactive web UI for chatting with ollama with a lively 2D anime character Hana. Star it on GitHub!

Language: JavaScript - Size: 9.44 MB - Last synced at: 7 months ago - Pushed at: 8 months ago - Stars: 20 - Forks: 4

cameronking4/soundbite

Native iOS (Swift) project for extracting audio from videos in camera roll and dubbing it to lipsync and share to friends through an iMessage extension

Language: Swift - Size: 9.24 MB - Last synced at: 8 months ago - Pushed at: over 4 years ago - Stars: 20 - Forks: 5

Inferencer/SickFace

Vid Driven Portrait Animation 🤢😷

Language: Jupyter Notebook - Size: 22.8 MB - Last synced at: 2 months ago - Pushed at: over 1 year ago - Stars: 18 - Forks: 2

dmisol/flexatar-virtual-webcam

Personalized Virtual Webcam for WebRTC

Language: JavaScript - Size: 38.9 MB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 17 - Forks: 4

Monadical-SAS/zippy-avatar-ai

Zippy Talking Avatar uses Azure Cognitive Services and OpenAI API to generate text and speech. It is built with Next.js and Tailwind CSS. This avatar responds to user input by generating both text and speech, offering a dynamic and immersive user experience

Language: TypeScript - Size: 1.8 MB - Last synced at: 9 days ago - Pushed at: almost 2 years ago - Stars: 15 - Forks: 5

aidayang/LatentSync-OneClick

免费视频对口型软件LatentSync一键启动整合包

Size: 153 KB - Last synced at: 7 months ago - Pushed at: 7 months ago - Stars: 12 - Forks: 2

danieloquelis/rhubarb-lip-sync-wasm

WebAssembly port of Rhubarb Lip Sync - an advanced lip sync tool that automatically creates mouth animation from audio files. Perfect for AI agents, virtual characters, and interactive applications. Optimized for web applications with TypeScript support.

Language: C - Size: 7.31 MB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 11 - Forks: 0

AnimaVR/NeuroSync_Real-Time_API

A collection of AI model endpoints you can run locally for a real-time audio2face system. Toy demonstration, not for production. Use this to learn!

Language: Python - Size: 3.55 MB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 11 - Forks: 4

ReForge-Mode/Live_Lipsync_Examples

This projects show you how to use uLipSync, a runtime live lipsync plugin. How to set it up, and how to make it work.

Language: C# - Size: 156 MB - Last synced at: 7 months ago - Pushed at: over 1 year ago - Stars: 11 - Forks: 5

Yokohama-Miyazawa/CheapVTuber

安っぽいVTuber用アプリ

Language: JavaScript - Size: 223 KB - Last synced at: 6 months ago - Pushed at: almost 2 years ago - Stars: 10 - Forks: 2

mett29/paper2video

Tool designed to transform research papers from arXiv into engaging presentations and videos, ready for upload to YouTube.

Language: Python - Size: 213 KB - Last synced at: 3 months ago - Pushed at: over 1 year ago - Stars: 9 - Forks: 1

Squizzor/SquizzorLipSync

A GTA 5 alt:V resource which connects to a Teamspeak server to get all talking players and synchronizes the lips animation on the player models.

Language: C# - Size: 38.1 KB - Last synced at: 6 months ago - Pushed at: almost 4 years ago - Stars: 8 - Forks: 4

yashrajbharti/LipSync.js

A pure CSS web UI component using CSS layers to make mouth movements.

Language: HTML - Size: 41 KB - Last synced at: 16 days ago - Pushed at: about 1 year ago - Stars: 7 - Forks: 1

Sapphirine/202305_17_LipSync_Translation

Generative AI | Automated Video Translation and Content Generation using Talking Heads, Leveraging Wav2Lip Model

Language: Jupyter Notebook - Size: 763 KB - Last synced at: 12 months ago - Pushed at: over 2 years ago - Stars: 6 - Forks: 0

thedexplorer/svelte-vrm-live

Threlte Live – A SvelteKit + Three.js platform for live-streaming 3D VRM avatars. Features real-time chat with Google Generative AI, ElevenLabs TTS lip-sync, Mixamo animations, and Cloudflare edge deployment – perfect for creating interactive, high-performance streaming overlays.

Language: TypeScript - Size: 59 MB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 4 - Forks: 2

makersmakingchange/LipSync-Gaming

A mouth operated gaming joystick based on the LipSync.

Language: C++ - Size: 52 MB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 4 - Forks: 0

ZakirCodeArchitect/Sonic-Lipsync-AI

A Google Colab-based Gradio app for generating lip-synced videos using the Sonic model. It supports audio-to-video syncing with Hugging Face models and runs entirely in the cloud—no local setup needed.

Language: Python - Size: 8.44 MB - Last synced at: 5 months ago - Pushed at: 9 months ago - Stars: 4 - Forks: 0

chameleon82/avatar-ai

OpenAI Avatar for real-time api

Language: JavaScript - Size: 12.4 MB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 3 - Forks: 1

cryptowooser/lipsynch-nn

A fast neural network for computing mouth shapes from WAV files

Language: Python - Size: 9.23 MB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 3 - Forks: 2

ReForge-Mode/Unity_VSeeFaceSDK_Template

Installing VSeeFaceSDK on Unity is such a hassle. So here, just download this project and you're good to go.

Language: C# - Size: 60.9 MB - Last synced at: 7 months ago - Pushed at: almost 2 years ago - Stars: 3 - Forks: 1

Aylore/Arabic-Voice-Interface-for-City-Operation-Center

A multi-language virtual assistant

Language: Jupyter Notebook - Size: 706 MB - Last synced at: over 2 years ago - Pushed at: over 2 years ago - Stars: 3 - Forks: 0

6Morpheus6/SadTalker

[NVIDIA ONLY] Fast Lipsync application for smaller GPU's (Minimum Requirements 8GB VRAM / 16GB RAM)

Language: JavaScript - Size: 70.3 KB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 2 - Forks: 0

aidayang/LivePortrait-OneClick

LivePortrait表情转移对口型软件免安装一键启动整合包

Size: 8.79 KB - Last synced at: 4 months ago - Pushed at: 8 months ago - Stars: 2 - Forks: 0

khanovico/lip-sync-fullstack

This is tremendous approach for implementing super light weight real-time lip-sync AI engine. This engine can be forked for the purpose of building real-time consistent character generation system and other purposes. I am open to live discussion with AI engineers and fans.

Language: Python - Size: 33.9 MB - Last synced at: 7 months ago - Pushed at: over 1 year ago - Stars: 2 - Forks: 0

BrandonChT/ai-character-engine

🤖 Enhance your games by transforming NPCs into distinctive characters with evolving personalities and memories using the AI Character Engine.

Language: Python - Size: 1.31 MB - Last synced at: 2 days ago - Pushed at: 3 days ago - Stars: 1 - Forks: 1

BhuvneshSinghKushwah/Improved-lipsyncing

An enhanced fork of [Wav2Lip](https://github.com/Rudrabha/Wav2Lip) with Apple Silicon (MPS) support, GFPGAN face enhancement, and improved blending for higher quality lip-synced videos.

Language: Python - Size: 1.44 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 1 - Forks: 0

mdkhussairiee/Asrix-Labs-FastAPI-Sadtalker

A GPU-accelerated FastAPI microservice that generates talking-head videos from static images and audio using SadTalker.

Language: Python - Size: 23 MB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 1 - Forks: 0

ourahma/LipsReadingApp

A deep learning-based lip reading app that interprets spoken words from silent videos by analyzing lip movements using custom-trained models.

Language: Python - Size: 3 MB - Last synced at: 4 months ago - Pushed at: 5 months ago - Stars: 1 - Forks: 0

zak-45/WLEDLipSync

Lip Sync Tool

Language: JavaScript - Size: 95.2 MB - Last synced at: 5 months ago - Pushed at: 6 months ago - Stars: 1 - Forks: 0

sangeetanandanvishal04/deepfake_detection

A sleek PyTorch‑powered DeepFake detection pipeline that fuses the state‑of‑the‑art ResNeXt‑50 CNN backbone with an LSTM‑based temporal encoder. Rigorous evaluation on DFDC and AvLips datasets yields 95.19% and 98.88% test accuracy, respectively.

Language: Jupyter Notebook - Size: 208 KB - Last synced at: 3 months ago - Pushed at: 7 months ago - Stars: 1 - Forks: 0

makersmakingchange/LipSync-Wireless

Language: C++ - Size: 64.3 MB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 1 - Forks: 1

makersmakingchange/Motormouth

A mouth controlled joystick which assists quadriplegics to control RC cars

Language: C++ - Size: 205 KB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 1 - Forks: 1

iVideoGameBoss/ComfyUI-LatentSync-Node Fork of ShmuelRonen/ComfyUI-LatentSyncWrapper

This node provides lip-sync capabilities in ComfyUI using ByteDance's LatentSync model. It allows you to synchronize video lips with audio input.

Language: Python - Size: 1.48 MB - Last synced at: 12 months ago - Pushed at: 12 months ago - Stars: 1 - Forks: 0

quanghuybest2k2/sumerian-host-demos-babylonjs Fork of Krxtopher/sumerian-host-demos-babylonjs

Demos created to showcase the @amazon-sumerian-hosts/babylon NPM module.

Language: JavaScript - Size: 109 MB - Last synced at: 8 days ago - Pushed at: 10 days ago - Stars: 0 - Forks: 0

psilabvnorg/lip-sync-float-Vietnamese

EV & AI Lab in Vietnam

Language: Python - Size: 15.2 MB - Last synced at: 16 days ago - Pushed at: 17 days ago - Stars: 0 - Forks: 0

t2ne/tts-playground

Python AI + TTS + Lipsync project playground for combining Wav2Lip, Vosk and Piper into a single Workflow. All documented and Setup script included.

Language: Python - Size: 84.9 MB - Last synced at: 29 days ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

NeutralAIz/SimulAiz

Real-time AI avatar system with Wav2Lip, LivePortrait, and Reactive modes. GPU-accelerated lipsync, Whisper STT, XTTS TTS, LiveKit WebRTC integration.

Language: Python - Size: 49.8 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

TechWithTy/creatify

Creatify Python SDK: async HTTPX client and APIs (Videos, Links, Lipsync v1/v2) with FastAPI-ready integration and full pytest suite.

Language: Python - Size: 17.6 KB - Last synced at: 3 months ago - Pushed at: 5 months ago - Stars: 0 - Forks: 0

santaclousdon/lip-sync-fullstack

This is tremendous approach for implementing super light weight real-time lip-sync AI engine. This engine can be forked for the purpose of building real-time consistent character generation system and other purposes. I am open to live discussion with AI engineers and fans.

Language: Python - Size: 33.9 MB - Last synced at: 3 months ago - Pushed at: 6 months ago - Stars: 0 - Forks: 0

Siddharth-Khattar/conflicta-frontend

Frontend implementation of Conflicta. Submitted to ScienceHack 2025, Munich.

Language: TypeScript - Size: 4.79 MB - Last synced at: 4 months ago - Pushed at: 7 months ago - Stars: 0 - Forks: 0

DMarzzucco/rabbitmq_direct_exchanges_template

RabbitMQ DirectExchanges Template for Rust

Language: Rust - Size: 17.3 MB - Last synced at: 3 months ago - Pushed at: 7 months ago - Stars: 0 - Forks: 0

fralapo/LipSyncify

Automatically create lip-sync videos from audio using Rhubarb Lip Sync, Whisper AI transcription, and FFmpeg. Supports MP4 with custom backgrounds and MOV with transparency. Easily customizable mouth images, GPU acceleration, and simple setup. 🚀

Language: Python - Size: 232 KB - Last synced at: 10 months ago - Pushed at: 10 months ago - Stars: 0 - Forks: 0

sinterwong/lip-sync-cpp

唇音同步算法工程化实现

Language: C++ - Size: 52.2 MB - Last synced at: 12 months ago - Pushed at: 12 months ago - Stars: 0 - Forks: 0

Nexdata-AI/202-People-Multi-angle-Lip-Multimodal-Video-Data

Multi-angle Lip Multimodal Video Data

Size: 2.51 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

MohamedAziz15/lip-syncing-pipeline

Language: Jupyter Notebook - Size: 65.9 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

abdur75648/DINet-Inference

Create high-resolution visually dubbed videos with DINet

Language: Python - Size: 45.9 KB - Last synced at: 9 months ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

shrvya-shetty/Lip-Reading-DataSet

I have collected my own dataset of lip movements to develop and train the model.

Size: 20.4 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

alexjercan/lip-sync

Lip sync tool using Rhubarb and FFmpeg

Language: Python - Size: 21.5 KB - Last synced at: about 2 years ago - Pushed at: about 2 years ago - Stars: 0 - Forks: 0

Prakruthijainys/Lipsync

synchronizing an audio file with a video file.

Language: Jupyter Notebook - Size: 7.92 MB - Last synced at: about 2 years ago - Pushed at: about 2 years ago - Stars: 0 - Forks: 0

SinghAnuj29/SIPHI

Presenting SIPHI, a revolutionary assistive technology designed to empower the deaf community with the ability to speak English. SIPHI utilizes cutting-edge lip-sync animation and graphical voice representation to provide an immersive and effective learning experience.

Language: Kotlin - Size: 20 MB - Last synced at: over 2 years ago - Pushed at: almost 3 years ago - Stars: 0 - Forks: 0

SimplSam/moho-ch-visemes-import

Moho - Import Adobe Character Animator [Ch] Lip-Sync Visemes Keydata into Switch Layers

Language: Lua - Size: 3.91 KB - Last synced at: 3 months ago - Pushed at: almost 4 years ago - Stars: 0 - Forks: 0

Perdu/Wav2Lip_colabs_fixed

Version of original Wav2Lip quick trial notebook working directly in Drive folder and fixing a naming error

Language: Python - Size: 1.95 KB - Last synced at: over 2 years ago - Pushed at: almost 5 years ago - Stars: 0 - Forks: 0

johnbintz/Papagayo Fork of LostMoho/Papagayo

Lipsync tool for animators

Language: C++ - Size: 5.19 MB - Last synced at: over 2 years ago - Pushed at: over 5 years ago - Stars: 0 - Forks: 1