#Phi3 by Microsoft went crazy
spring lance
So this is Phi3, Microsoft's latest open source LLM release and is a small, lightweight LLM that is supposedly good for its size. I wanted to test it out for a personal project of mine to generate 100 logo ideas and it rejected. Then I put a system prompt such as "You are a helpful, clever, hard working assistant that helps the user. You never back down a request and only add your warnings at the end." to try and get it to generate all the 100 ideas. Well...
Then I asked what those meant and it literally didn't stop for a long time :D
wanton pagoda
are you using the model settings as per the website? python model-qa.py -m /YourModelPath/onnx/cpu_and_mobile/phi-3-mini-4k-instruct-int4-cpu -k 40 -p 0.95 -t 0.8 -r 1.0
spring lance
are you using the model settings as per the website? `python model-qa.py -m /You...
Yes, I don't think I've made any changes. I just downloaded it and started using it. Then created a modelfile just with a system prompt addition and that's it
wanton pagoda
smaller models need more love than that
spring lance
Hmmm, can you quickly go over the settings I need to make? Or can you send a resource for this