speculative-decoding 25 llm-inference 10 llm 8 large-language-models 6 inference 4 efficiency 3 fast-inference 3 retrieval 2 nlp 2 large-language-model 2 acceleration 2 intel-optimized-llamacpp 1 habana 1 llm-cpu 1 neural-chat 1 neural-chat-7b 1 rag 1 gaudi3 1 streamingllm 1 artificial-intelligence 1 chatpdf 1 c 1 long-context 1 llama2 1 llamacpp 1 decoding 1 efficient-inference 1 speculative-execution 1 offloading 1 diffusion-models 1 deepmind 1 speculative-sampling 1 n-gram 1 ngram-decoding 1 prompt-lookup-decoding 1 japanese 1 non-autoregressive 1 early-exit 1 layer-drop 1 optimization 1 transformers 1 api-rest 1 cuda 1 inference-engine 1 inferentia 1 intel 1 lora 1 machine-learning 1 rocm 1 tpu 1 inference-optimization 1 awesome 1 papers 1 deepseek 1 llm-serving 1 llms 1 qwen 1 transformer 1 decoding-algorithm 1 process-reward-model 1 reasoning 1 4-bits 1 autoround 1 chatbot 1