DeepSeekOct 20DeepSeek Open-Sources DeepInfer Framework for Large-Scale Model Inference
DeepSeek released DeepInfer, its in-house inference framework, as an open-source project. The framework powers DeepSeek-V4.1-Flash and includes optimized kernels, speculative decoding, and structured output support. Alongside it, DeepSeek published deepseek-recipe, a token encoding and decoding component that aligns with its official API logic. This release provides offline inference capabilities for large-scale deployments.
