Pinned Loading

1. ai-dynamo/dynamo ai-dynamo/dynamo Public

   A Datacenter Scale Distributed Inference Serving Framework

   Rust 8k 1.6k

2. triton-inference-server/server triton-inference-server/server Public

   The Triton Inference Server provides an optimized cloud and edge inferencing solution.

   Python 11k 1.8k

3. triton-inference-server/core triton-inference-server/core Public

   The core library and APIs implementing the Triton Inference Server.

   C++ 181 143

4. triton-inference-server/python_backend triton-inference-server/python_backend Public

   Triton backend that enables pre-process, post-processing and other logic to be implemented in Python.

   C++ 682 203

5. triton-inference-server/vllm_backend triton-inference-server/vllm_backend Public

   Python 356 54

6. triton-inference-server/onnxruntime_backend triton-inference-server/onnxruntime_backend Public

   The Triton backend for the ONNX Runtime.

   C++ 186 86