GitHub / kyegomez / Hedgehog
Implementation of the model "Hedgehog" from the paper: "The Hedgehog & the Porcupine: Expressive Linear Attentions with Softmax Mimicry"
JSON API: http://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/kyegomez%2FHedgehog
PURL: pkg:github/kyegomez/Hedgehog
Stars: 14
Forks: 0
Open issues: 3
License: mit
Language: Python
Size: 2.16 MB
Dependencies parsed at: Pending
Created at: over 1 year ago
Updated at: about 2 months ago
Pushed at: over 1 year ago
Last synced at: 22 days ago
Topics: ai, attention, attention-is-all-you-need, attention-mechanisms, feedforward, ffns, ml, mlps, multi-modal, neural-nets, open-source, opensource-ai, softmax
Funding Links https://github.com/sponsors/kyegomez