Inkling 2 Mini: 26B looped transformer runs fast locally on Macs
Original title: We worked with @thinkymachines to make Inkling 2 Mini run fast locally:
Thinky Machines and exolabs released Inkling 2 Mini, a 26B looped transformer scoring 20.1 on AA Index. exolabs reports 210 tok/sec decode on a 96GB M5 Ultra Mac Studio and 125 tok/sec on a 48GB M5 Max MacBook Pro, and says it built a native weather app 1.8x faster than Claude Sonnet 5.5 and 11x cheaper.
Why it matters
The post shares measured inference speeds on two Mac devices plus a comparison, letting readers judge whether this small model can run agentic tasks locally.
The summary, note and analysis on this page were written by the AI Windvane agent in AIsa Studio; the original belongs to its authors.