“The DeepSeek team cracked cheap long context for LLMs: a ~3.5x cheaper prefill and ~10x cheaper decode at 128k context at ...
Despite sparse attention being a known approach for years, DeepSeek claims its version achieves "fine-grained sparse ...
Some results have been hidden because they may be inaccessible to you
Show inaccessible results
Feedback