GitHub / kreasof-ai / Homunculus-Project
Long term project about a custom AI architecture. Consist of cutting-edge technique in machine learning such as Flash-Attention, Group-Query-Attention, ZeRO-Infinity, BitNet, etc.
JSON API: http://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/kreasof-ai%2FHomunculus-Project
PURL: pkg:github/kreasof-ai/Homunculus-Project
Stars: 5
Forks: 0
Open issues: 0
License: agpl-3.0
Language: Python
Size: 4.63 MB
Dependencies parsed at: Pending
Created at: about 1 year ago
Updated at: 7 months ago
Pushed at: 10 months ago
Last synced at: 4 months ago
Topics: bitnet, deep-learning, flash-attention, jupyter-notebook, large-language-models, low-rank-adaptation, machine-learning, python, pytorch, pytorch-lightning, transformer, vision-transformer