GitHub / seonglae / llama2gptq
Chat to LLaMa 2 that also provides responses with reference documents over vector database. Locally available model using GPTQ 4bit quantization.
JSON API: http://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/seonglae%2Fllama2gptq
PURL: pkg:github/seonglae/llama2gptq
Stars: 30
Forks: 0
Open issues: 5
License: mit
Language: Python
Size: 9.48 MB
Dependencies parsed at: Pending
Created at: over 2 years ago
Updated at: 2 months ago
Pushed at: almost 2 years ago
Last synced at: 1 day ago
Commit Stats
Commits: 63
Authors: 3
Mean commits per author: 21.0
Development Distribution Score: 0.19
More commit stats: https://commits.ecosyste.ms/hosts/GitHub/repositories/seonglae/llama2gptq
Topics: chatai, chatbot, chatgpt, cuda, gpt, langchain, llama-2, llama2, model-quantization, quantization, question-answering, rye, streamlit-chat, transformers
Funding Links https://github.com/sponsors/seonglae, https://paypal.me/seonglae, https://www.buymeacoffee.com/seongland