#what is the recommended model to work with open interpreter?

8 messages · Page 1 of 1 (latest)

upper sundial
#

in my experience , gpt 3.5 or MoE 8*7B are not good enough. GPT 4 is OK. any other recommendation?

inner lagoon
#

gpt-4-0125-preview
claude-3-opus-20240229
gemini-1.5-pro
mistral-large-latest

these are all the top models right now
inflection-2 is also up there, but litellm doesn't list support for it yet

upper sundial
errant roost
# upper sundial what is the recommended open source models?

Question: What flavor of MoE 8x7b are you using?

Reason: If you are squeezing it into a 12gb card, 'which model' is probably not going to matter a whole lot.

Lots of good things about Miqu and MoE out there, but you do have to temper expectations compared to GPT-4.

upper sundial
errant roost
#

Haven't done inference native on a Mac, so I'm probably not a good reference. If you didn't like MOE 8x7b, and you are sure you have the templates right ... maybe try Miqu-1-70b.

#

Mixtral is very smart, but it is also a bit of a princess about it's prompt templates ...