Do Mistral-tiny and Mistral-medium Use the Mixture of Experts Model?

[royal relic]

Do Mistral-tiny and Mistral-medium use the Mixture of Experts model like Mistral-small does?

[midnight cosmos]

Mistral-tiny doesn't. It s also called mistral-7b and you can find more info on it on it's huggingface page and I believe there is also a technical paper on it. I dont think we have much info on medium...