> I can run it on my Macbook Air at 12tkps, can't wait to try this on my desktop.
That seems kinda low, are you using Metal GPU acceleration with llama.cpp? I don't have a macbook, but saw some of the llama.cpp benchmarks that suggest it can reach close to 30tk/s with GPU acceleration.
Really cool to see this! Local is the real future of AI.
I got really excited about this and fired it up on my petite little M2 Macbook Air only for it to grind it to a halt. Think the old days when you had a virus on your PC and you'd move the mouse then wait 45 seconds to see the cursor move. It honestly made me feel nostalgic. I guess I have to taper performance expectations with this Air, though this is the first time it's happened.
That's not something we know at this point. All that we know is that Apple has demonstrated a game running acceptably well on their current development hardware. Performance is likely to improve in production versions of the OS, and/or with production hardware.
It actually does run reasonably on a Mac if you run it under crossover with a patched DLL [1]. Even with the overhead of multiple translation layers I’ve seen people hit 30fps as a baseline. Not saying that’s great by any means, but it’s got three translation layers at that point.
Importantly, the game is largely CPU bound and that is something that the Macs are really good at. The game is really bad at taking advantage of high end GPUs but it actually scales reasonably as you go down the tiers precisely because it’s so bad at using the GPU. And yes I know it currently has bugs and comical oversights that thrash the GPU, but it does so pretty equally, seemingly responding better to more VRAM (which makes sense given the nature of their inefficiencies)
I’d also push back on the “anemic” wording. A base M series Mac is probably the best iGPU performance vs Intel/amd iGPUs. And the higher end MBPs (not accounting for value) are very performance competitive against similar form factor laptops. Where they fall behind is when you start comparing against larger desktop replacement laptops or on the desktop end against the top end GPUs. But I wouldn’t call them anemic by any stretch of the imagination either.
https://www.reddit.com/r/macgaming has a surprising number of people you can see messing around with running ports natively. I wouldn’t get a Mac for the express purpose of gaming but they are reasonably capable, and largely held back by lack of software not hardware.
reply