Data

Tools

Indexes

Applications

Experiments

Repos

An open API service providing repository metadata for many open source software ecosystems.

GitHub topics: chatbot-memory

aahouzi/llama2-chatbot-cpu

A LLaMA2-7b chatbot with memory running on CPU, and optimized using smooth quantization, 4-bit quantization or Intel® Extension For PyTorch with bfloat16.

Language: Python - Size: 30.3 MB - Last synced at: 2 days ago - Pushed at: over 1 year ago - Stars: 12 - Forks: 0

Related Keywords
4-bit-cpu 1 bfloat16 1 chatbot 1 chatbot-memory 1 chatgpt 1 cpu 1 huggingface 1 int8 1 intel 1 ipex 1 langchain 1 llama 1 llama2 1 meta 1 meta-ai 1 neural-compression 1 numa 1 optimization 1 smooth-quantization 1 streamlit 1