Run generative AI models with ONNX Runtime C# demo

Download the model directly using the Hugging Face CLI

huggingface-cli download onnxruntime/DeepSeek-R1-Distill-ONNX --include deepseek-r1-distill-qwen-1.5B/cpu_and_mobile/* --local-dir .

For CUDA:

ConsoleDeepSeek.exe -m C:\deeplearning\huggingface\models\deepseek-r1-distill-qwen-1.5B\gpu\gpu-int4-rtn-block-32 -e cuda

For DirectML:

ConsoleDeepSeek.exe -m C:\deeplearning\huggingface\models\deepseek-r1-distill-qwen-1.5B\gpu\gpu-int4-rtn-block-32 -e dml

Export Hugging Face Models to ONNX

Hugging Face provides many options for exporting models to ONNX, including an ONNX Export Space for PyTorch models from the Hugging Face Model Hub.

Export PyTorch models to ONNX →

Other ONNX export options →