GitHub / arrmansa / Basic-UI-for-GPT-J-6B-with-low-vram
A repository to run gpt-j-6b on low vram machines (4.2 gb minimum vram for 2000 token context, 3.5 gb for 1000 token context). Model loading takes 12gb free ram.
JSON API: http://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/arrmansa%2FBasic-UI-for-GPT-J-6B-with-low-vram
PURL: pkg:github/arrmansa/Basic-UI-for-GPT-J-6B-with-low-vram
Stars: 114
Forks: 12
Open issues: 4
License: apache-2.0
Language: Jupyter Notebook
Size: 48.8 KB
Dependencies parsed at: Pending
Created at: about 4 years ago
Updated at: 25 days ago
Pushed at: over 3 years ago
Last synced at: 24 days ago
Topics: gpt, gpt-neo, transformers