It certainly used to work fine with llvmpipe; I tested it when it first came out and it worked with no problems. Was pretty fast, too; it wasn't crippled by it though the stress tests (that do horribly in Firefox and Chrome) didn't do that well in it either (of course). This may have changed and broken it on llvmpipe.
In general we've not smoothed out this stuff so that you can fall back cleanly when a GPU doesn't exist.
yeah, but it's no longer current/supported as far as I can tell.. the actual project appears to be dead and I can't find it on the backports at all. Shame, because it looked promising for a while.
I'm a bit amazed that Nvidia isn't supporting this more, given y'know, SteamOS just around the corner.
I used this half a year ago, love the UX but it was not possible to accelerate the workloads using an AMD GPU. How's the support for AMD GPUs under Ollama today?
reply