Popular repositories Loading

1. helloworld helloworld Public

   A demo repo

   M4

2. Paddle Paddle Public

   Forked from PaddlePaddle/Paddle

   PArallel Distributed Deep LEarning （PaddlePaddle核心框架，高性能单机、分布式训练和跨平台部署）

   C++

3. vllm-fork vllm-fork Public

   Forked from HabanaAI/vllm-fork

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

4. neural-compressor neural-compressor Public

   Forked from intel/neural-compressor

   SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression techniques on PyTorch, TensorFlow, and ONNX Runtime

   Python

5. vllm-omni vllm-omni Public

   Forked from vllm-project/vllm-omni

   A framework for efficient model inference with omni-modality models

   Python

6. vllm-gaudi vllm-gaudi Public

   Forked from vllm-project/vllm-gaudi

   Community maintained hardware plugin for vLLM on Intel Gaudi

   Python