kimi-k2.6-eagle3-mla

by festr2 - opened 5 days ago

Hello, will you create also MLA version ?

LightSeek Foundation org 5 days ago

will do

lightseek changed discussion status to closed 5 days ago

The MLA version on 8x RTX is +20 tok/sec compared to the non mla and it is much easier to wire it on sm120. Thank you.

@lightseek when do you think you can release it?

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment