DeepSeek open-sources DeepInfer, the inference engine behind its V4.1-Flash API
Released Oct 20 under Apache 2.0, DeepInfer runs DeepSeek-V4.1-Flash on NVIDIA SM100 GPUs or Huawei Ascend 950 NPUs with DeepSeek's own kernels, expert parallelism, speculative decoding, deterministic sampling, and structured outputs. It's offline batch inference only for now: KV-cache management, prefill/decode disaggregation, and load balancing stay internal (The New Stack).