#<think></think> using R1 locally using ollama.

1 messages · Page 1 of 1 (latest)

wet hill
#

I'm using R1 locally using ollama and I keep getting the <think></think> tags.
But according to the pull request linked bellow this has been addressed.

I updated my docker installation and ollama and tried installing everything form scratch again but I keep getting the <think></think> tags.

https://github.com/danny-avila/LibreChat/pull/5440

GitHub

Summary
Adds simple reasoning UI for LLMs that clearly distinguish reasoning tokens from standard generation tokens (only deepseek-reasoner for now)
Once migrated to new agent framework, will inclu...

noble coral
wet hill
#

I did a full fresh install and it still happens so it's not the cache.
and my browser clears everything every time I close so it's defiantly not the cache

noble condor
#

I have the same problem as well, is it because the <think> is not implemented into the frontend yet?

#

As I remember, when we use the Plugin endpoint, there's a button that shows the process of the LLM thinking and using the plugin

spring garnet
#

@noble condor @wet hill update ollama

wet hill
#

Just to be sure

noble coral
#

also, can you confirm that Markdown works correctly?

wet hill
spring garnet
#

did you try in a private window?

you may not have pulled the latest images if all is still not showing right

#

try this (linux):
docker images -a | grep "librechat" | awk '{print $3}' | xargs docker rmi

wet hill
#

I pulled it straight from GitHub

spring garnet
#

but you're using docker? container images and the codebase are not the same

#

docker compose pull is separate from git pull

wet hill
#

I'm on windows using docker desktop I pulled from github and then
docker compose up -d

#

Like i said I did a fresh install not an update to be 100% sure

spring garnet
#

for windows, try this in a powershell terminal:

docker images -a | findstr "librechat" | ForEach-Object { docker rmi $_.Split()[2] }
#

then follow the instructions above. you should also check your ollama version to be sure, sometimes it requires restart

#

just tested on windows again, using a private window, latest docker images

wet hill
noble coral
#

nice, next time you need to update LibreChat, make sure to remove the librechat image and then pull the new one

wet hill
#

Yeah for next time that what I will do.
I did a normal update first and it didn't work something must have gone wrong along the way.
Windows is headache

#

Thank you very much!

proper belfry
wet hill
proper belfry
#

Or should i do it from a new folder from the beginning

noble condor
#

btw but there is still a issue about the <think> tag

#

which is the title displays <think>

#

it displays something like

<think>Alright, so I need to generate a title for this conversation based on
dawn otter
#

I think the same happens when I use fireworks endpoint for deepseek reasoning. it displays <think> tag instead of thoughts

wet hill
#

so an update on this after updating to v0.7.7-rc1 the <think></think> tags are back

long aurora
#

Also on v0.7.7-rc1 and all my titles still show the <think> tag just as reported by @noble condor . Hoping for a fix soon.

noble condor
# long aurora Also on v0.7.7-rc1 and all my titles still show the <think> tag just as reporte...

Nah it was actually fixed, sorry for not mentioning the fix/solution here.
You say that you still have this problem, so I think you should be running on Docker instead of the NPM installation right?

Try to enable the line that uses the -dev image of LibreChat API container; if you already had it enabled, try to delete the image you are using now, and pull a new one
That should do the trick