Hacker Read

Filligree · 2023-11-24 11:06:51

Assuming you have Ollama installed, you can test this with `ollama run yi:34b`.

chpatrick | karma 1782 | avg karma 2.37 · | 2024-01-27 05:09:56

`ollama run mixtral:8x7b-instruct-v0.1-q3_K_L` works fast on my 3090 locally

wenc | karma 8549 | avg karma 3.38 · | 2023-12-10 08:09:21

What didn’t work? I run Ollama on my M2 Pro and all models work.

eurekin | karma 710 | avg karma 1.51 · | 2024-01-09 06:00:16

I'm using:

  ollama run dolphin-mixtral:8x7b-v2.5-q3_K_S

brandall10 | karma 3316 | avg karma 3.67 · | 2024-06-27 23:53:25

27b is working fine for me, hosted on ollama w/ continue.dev in VSCode.

reustle | karma 5618 | avg karma 3.57 · | 2023-10-06 00:24:29

Did you ever figure out why? I've been using Ollama on my M2 air for quite a few weeks now and have never had that issue. If it was your first time running, it should show the output of it downloading the model.

belorn | karma 17948 | avg karma 2.68 · | 2015-10-02 19:01:46

Thanks! I will test that out on my laptop.

kps | karma 7825 | avg karma 2.95 · | 2018-05-22 19:21:30+00:00

As long as <x-eudora-setting:319=32> works…

ekvintroj | karma 98 | avg karma 1.58 · | 2023-04-16 10:56:07

This does not work, that's the issue, try to run it.

mahkoh | karma 376 | avg karma 3.92 · | 2020-05-25 08:04:06+00:00

Please post an example showing that this works. I'll run the example with OS-mitigations disabled to confirm.

lawrencewu | karma 95 | avg karma 1.2 · | 2017-12-14 02:27:51+00:00

Oh god, thanks so much for this. I've literally just been testing on prod and praying that it works.

ilaksh | karma 9227 | avg karma 1.28 · | 2019-10-04 08:19:20+00:00

Yeah I tried that. Can't remember for sure if I was able to get it to work for my program or not but I think not.

CalRobert | karma 14333 | avg karma 3.16 · | 2022-10-13 08:34:16

Thanks! It works if I start an xorg session, at least.

corysama | karma 10761 | avg karma 4.62 · | 2024-02-23 23:10:01

Works on my machine. Alternative link: https://github.com/duxiaodan/intrinsic-lora

tokenizerrr | karma 2693 | avg karma 2.1 · | 2014-09-25 17:07:27

I think you screwed up your test, I have not managed to get it to work with the LD_PRELOAD workaround installed.

jaggs | karma 732 | avg karma 1.2 · | 2023-09-26 14:57:25

I entered in my OpenAI key and installed it properly. I don't use X.

jackcouch1 | karma 50 | avg karma 3.12 · | 2017-08-11 04:44:27

It works on El Cap too. But it's another config file. I'll dig up and post it shortly.

codercotton | karma 33 | avg karma 0.94 · | 2019-01-02 18:19:45+00:00

It should follow 302s, but some are not working. It's on my bug list :). Thanks for the comment.

ifoundthetao | karma 113 | avg karma 1.15 · | 2017-09-28 13:50:32

Hm, I wasn't able to replicate it. I'm using a Kali Linux VM. I'll try some other OSes and see if it works on there.

Was anyone else successful with the PoC code?

reply

pcunite | karma 1124 | avg karma 1.37 · | 2016-04-18 20:26:31+00:00

Try running 6.32.4 on that unit.