Tulu-3-405B

[austere meteor]

Tulu-3-405B : Better than GPT-4o and DeepSeek V3
https://huggingface.co/allenai/Llama-3.1-Tulu-3-405B
https://allenai.org/blog/tulu-3-405B

405B version (Llama-3.1-Tulu-3-405B):

It is suitable for ultra-large-scale AI tasks and can compete with GPT-4o in knowledge question answering, reasoning, and programming tasks.

[lost marsh]

@austere meteor https://openrouter.ai/allenai/llama-3.1-tulu-3-405b

[dawn flower]

the To read more, click here. url within the description is 404ing

[lost marsh]

whoops ty

[dawn flower]

https://allenai.org/blog/tulu-3-405B

i think

[lost marsh]

yep https://allenai.org/blog/tulu-3-405B

should be fixt in a few mins

thanks again

[dawn flower]

also, the rate limit is being hit straight up

[astral forge]

Im rather surprised by how low the tk/s is for Sambanova

[lost marsh]

ah man - pinged them about this

[keen leaf]

For ERP use which of the benchmarks should we look at?

Because I read, in some cases, very slight improvements over Nous Hermes 3 405B but at an Anthropic Claude price.

[dawn flower]

https://huggingface.co/spaces/DontPlanToEnd/UGI-Leaderboard

[keen leaf]

If I understand this ranking correctly, it says gemini-exp-1206 is better than Hermes-3-Llama-3.1-405B for ERP because it is less censored.
Absolutely not true, I use both, the former is full of banned words and censorship regarding ERP.

[burnt token]

isnt that depend more on the creativity and human understanding of the model?

[dawn flower]

theyve updated the format to hide the subcategories, so in some cases it could be worse yes

just checking you do send the gemini BLOCK_NONE etc?

[pale fiber]

What is BLOCK_NONE?

[plucky kraken]

Tulu Llama = TuluL

[dawn flower]

https://ai.google.dev/gemini-api/docs/safety-settings#code-examples

[pale fiber]

How do u you do this through OR

[dawn flower]

you cannot, it is only possible via direct API

my paid gemini key allows me to send this

[keen leaf]

Sure, I use the free API from Google AI Studio and SillyTavern which has BLOCK _NONE by default.
But you try typing “little girl” during an ERP chat, for example, and see what happens?
They put blocks and filters on a lot of words and phrases.