Hacker Read top | best | new | newcomments | leaders | about | bookmarklet login

I have yet to get any useful output out of the Q5_K_S version; haven't tried any others yet.


view as:

I used mistral-7b-v0.1.Q5_K_M.gguf and it responded to basic questions.

Linked is the base model. What you want is the instruct model (also on TheBloke's profile), which has been trained on following instructions.

Legal | privacy