GitHub / mikeendarson / Deepdive-llama3-from-scratch
Achieve the llama3 inference step-by-step, grasp the core concepts, master the process derivation, implement the code.
JSON API: http://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mikeendarson%2FDeepdive-llama3-from-scratch
PURL: pkg:github/mikeendarson/Deepdive-llama3-from-scratch
Stars: 0
Forks: 0
Open issues: 0
License: mit
Language: Jupyter Notebook
Size: 16.6 MB
Dependencies parsed at: Pending
Created at: 8 months ago
Updated at: 8 months ago
Pushed at: 8 months ago
Last synced at: 8 months ago
Topics: attention, attention-mechanism, gpt, inference, kv-cache, language-model, llama, llm-configuration, llms, mask, positional-encoding, rms, rope, rotary-position-encoding