#LZLV-70b repetition problems

6 messages · Page 1 of 1 (latest)

cold dagger
#

Mistral/mixtral are known for repetition issues. Lzlv70b however is not, although it can happen mildly during repetitive scenes such as sex or combat. It has been some time since i used lzlv so i am saying this assuming it has not been ruined in the last 1-2 months, but it was my uncensored go to for a bit and for good reason. It needs some well fine tuned instructions to perform up to its potential, but its potential was the best uncensored option for quite a while, when taking cost into account too.

There are many variables that can account to a model having repetition issues, if we are talking sending the same (or damn near the same) large sections/entire responses.

In the case of mistral/mixtral, i didnt find much can be done for it. But lzlv, trial and error of different api settings, and of different instructions (and depending where u use the model, LOCATION of said instructions) can offer a wide array of outcomes. Always understand that unwanted outcomes are almost a garuntee when crafting some instructions. Tell a model to respond lengthy and u may suddenly see more agency loss or repetition, as one example.

To be honest though, leave lzlv in the dust and give wizardlm2-8x22b a shot. Fairly cheap (host deepinfra is the cheapest). It just isnt so great at onomatopias and does NOT like frequency penalty above .6 (itll get nonsensical) BUT in my testing i find it to have the best quality/price ratio, and its unmoderated. I find it can perform (for rp/erp) on par with claude models, somewhere between haiku and sonnet, but in some ways better than both (keeping track of clothing, for example).

Comparing it to lzlv- it is better in every way once you dial in on good api settings/instructions, except maybe onomatopias. It keeps track of it’s context with more accuracy. It understands concepts better during rp, such as innuendos. It follows instructions better.

Command-r is not a bad option either. It does not accurately keep track of its context as well, but i found it to be a little better than lzlv.

Command-r-plus, albiet a bit costly for my liking (same as sonnet but not quite as good, but not too far off) is another great unmoderated option and does not have the flaws as its lesser version.

If u really wana stick with lzlv, dm me and ill fire it up when i have time and see if we can get this repetition under control 😉

#

What frontend do u use?

#

I do not have any up to date lzlv work i can share

#

I can likely address your “less alive” wizard issues

#

Ah crap i am used to venus and now risu (i have a huge love for risu now)

#

Id need more information as to what exactly your unhappy about, but, that becomes off topic so we should shift to dms 😉