Popular repositories Loading

1. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

2. wjabbour wjabbour Public

3. fastsafetensors fastsafetensors Public

   Forked from foundation-model-stack/fastsafetensors

   High-performance safetensors model loader

   Python

4. humanLLM humanLLM Public

   Python

5. pytorch pytorch Public

   Forked from pytorch/pytorch

   Tensors and Dynamic neural networks in Python with strong GPU acceleration

   Python

6. ci-infra ci-infra Public

   Forked from vllm-project/ci-infra

   This repo hosts code for vLLM CI & Performance Benchmark infrastructure.

   Python