
Homelabber runs 2.8-trillion-parameter Kimi K3 at 3.11 tokens per second with two RTX 3090s
A Reddit builder's Optane-based server now generates text from Moonshot AI's Kimi K3 at 3.11 tokens per second after adding two RTX 3090s and moving 414 GB of the model into a RAM drive, a 41% speed boost.