Topic: "speculative-sampling"
ai-glimpse/toyllm
ToyLLM: Learning LLM from Scratch
Language: Python - Size: 1.81 MB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 12 - Forks: 0
wtlow003/speculative-sampling
Implementation of Speculative Sampling in "Accelerating Large Language Model Decoding with Speculative Sampling"
Language: Python - Size: 30.3 KB - Last synced at: about 1 month ago - Pushed at: 9 months ago - Stars: 5 - Forks: 1
