llm 17 quantization 8 langchain 7 python 6 transformers 6 ai 6 llama 6 gpt 5 chatgpt 4 pytorch 4 awq 4 ggml 4 openai 4 nlp 3 machine-learning 3 llms 3 huggingface 3 vicuna 3 mistral 3 bitsandbytes 3 deep-learning 3 llamacpp 3 large-language-models 3 exllama 2 llm-inference 2 quantization-aware-training 2 fastapi 2 huggingface-transformers 2 int4 2 torch 2 vllm 2 cerebras 2 deep-neural-networks 2 gpt-4 2 llama2 2 alpaca 2 gguf 2 sentence-transformers 2 faiss 2 cpu-compatible 1 tiff 1 stable-diffusion 1 safetensors 1 image-to-image 1 generative-ai 1 foundational-models 1 blip2 1 localllama 1 blender-python 1 blender 1 natural-language-processing 1 localllm 1 rounding 1 neural-compressor 1 groq 1 llama-index 1 mamba 1 mixtral 1 sglang 1 peft 1 optimum 1 sparsity 1 sparsegpt 1 smoothquant 1 pruning 1 post-training-quantization 1 cross-platform 1 mxformat 1 low-precision 1 inference 1 model-compression 1 knowledge-distillation 1 optimization 1 int8 1 colab-notebook 1 fp4 1 auto-tuning 1 zephyr 1 weights 1 reranker 1 kubernetes 1 helm 1 gpu 1 cuda 1 cloudnative 1 lora 1 zeropoint 1 ptq 1 absolute 1 absmax 1 tensorflow 1 loralib 1 gpt4 1 deepspeed 1 vector-database 1 retrieval-augmented-generation 1 reranking-mechanism 1 flask 1 wizardlm 1 language-model 1