Popular repositories Loading

1. xdp-bpf-acceleration xdp-bpf-acceleration Public

2. ipex-llm ipex-llm Public

   Forked from intel/ipex-llm

   Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discr…

   Python

3. dynamo dynamo Public

   Forked from ai-dynamo/dynamo

   A Datacenter Scale Distributed Inference Serving Framework

   Rust

4. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

5. llm-scaler llm-scaler Public

   Forked from intel/llm-scaler

   Python