Mistral Vibe + Devstral2 Small: Local LLM Performance
Analysis
Key Takeaways
““I assumed all these TUIs were much of a muchness so was in no great hurry to try this one. I dunno if it's the magic of being native but... it just works. Close to zero donkeying around. Can run full context (256k) on 3 cards @ Q4KL. It does around 2000t/s PP, 40t/s TG. Wanna run gpt120, too? Slap 3 lines into config.toml and job done. This is probably replacing roo for me.””