DeepSeek open-sources DeepInfer, the engine that runs its AI models
The code runs on both Nvidia and Huawei chips. DeepSeek’s speed figures are its own, and nobody outside the company has independently tested them yet.
Via TNW | Artificial-intelligence
DeepSeek has open-sourced DeepInfer, the software it uses to run its AI models in production. The Chinese AI lab announced the release on X on Tuesday and published the code on GitHub under the Apache 2.0 licence. For now, it supports only DeepSeek-V4.1-Flash.
🚀 Introducing DeepInfer, our in-house inference framework, now fully open source!
Powering DeepSeek-V4.1-Flash at scale with high throughput and low latency. We’re sharing our production stack to help the community lower compute costs, reduce energy use, and…
Courtesy
This story was originally published by TNW | Artificial-intelligence. All rights belong to the original publisher.
Read the original on thenextweb.com ↗