#🔒 `pip install tokenizers==0.13.3` results in compilation error

14 messages · Page 1 of 1 (latest)

shadow hollyBOT
#

@frosty wharf

Python help channel opened

Remember to:

  • Ask your Python question, not if you can ask or if there's an expert who can help.
  • Show a code sample as text (rather than a screenshot) and the error message, if you've got one.
  • Explain what you expect to happen and what actually happens.

:warning: Do not pip install anything that isn't related to your question, especially if asked to over DMs.

Closes after a period of inactivity, or when you send !close.
frosty wharf
#

ah seems like it might just be a python version issue for some reason?

#

with 3.8 it works, with 3.12 it doesn't. Not sure how the python version comes into play here.

#

it also seems to not compile. Can someone explain this to me? It seems like pip might pull binaries sometimes and sometimes forces you to compile?

fluid patrol
#

!pypi tokenizers

shadow hollyBOT
fluid patrol
#

@frosty wharf for that version, the package owner(or creator) have created and uploaded the compiled whl file between python 3.7-3.11, where 3.12 is not built on that old version (persumable python 3.12 is not release when that version were)

#

you could try use the latest version or built from source yourself with the given instruction

frosty wharf
#

thanks I just gonna use a older version then

#

.close

calm saddleBOT
#
Did you mean:
frosty wharf
#

!close

shadow hollyBOT
#
Python help channel closed

This help channel has been closed and it's no longer possible to send messages here. If your question wasn't answered, feel free to create a new post in #1035199133436354600. To maximize your chances of getting a response, check out this guide on asking good questions.