Skip to content
Back to all stories
TechRadar

'The GPU never reads the same text twice': Belgian startup Corbenic wants to turn your server's SSD into AI memory, but its 14x speedup owes more to reading less

Galahad promises exact, encrypted KV cache reuse for vLLM, SGLang, and Llama.cpp

Tarun Mottlia

Via TechRadar

·Excerpt
'The GPU never reads the same text twice': Belgian startup Corbenic wants to turn your server's SSD into AI memory, but its 14x speedup owes more to reading less
Image: (Image credit: Corbenic.Ai)

(Image credit: Corbenic.Ai)

Corbenic AI's Galahad beta saves a model's KV cache to encrypted local NVMe so servers can skip rereading text after GPU memory is cleared or after a restart

Founder Sietse Schelpe tells TechRadar Pro no special hardware is needed, but the paper credits most of the 14x speedup to Blaise, a retrieval component, not SSD loading

LMCache, Nvidia Dynamo and CMX, WEKA and Phison already persist KV cache to storage; Galahad's edge is exact, fail-closed reuse in…

Continue reading on TechRadar ↗

Courtesy

This story was originally published by TechRadar. All rights belong to the original publisher.

Read the original on techradar.com ↗
Lazy Founder - Powered by Blogy.in

Contact us

Have a story tip, correction or partnership idea?

Write to us at tarun.kumar@blogy.in or talk to the founder directly. We read every message.

Contact us