#Porting the colab notebook to paperspace

12 messages · Page 1 of 1 (latest)

gloomy girder
#

Hey! Could someone help me port over the colab notebook to paperspace? It seems to have alot of wrong versions installed etc

#

Installing dependencies seem to be a problem, im currently running the notebook ill post any errors i get

#

Last time i tried it said something about incompatible gpu

# 
---------------------------------------------------------------------------
ImportError                               Traceback (most recent call last)
Cell In[4], line 1
----> 1 from unsloth import FastLanguageModel, PatchFastRL
      2 PatchFastRL("GRPO", FastLanguageModel)

File /usr/local/lib/python3.11/dist-packages/unsloth/__init__.py:73
     68     raise ImportError(
     69         "Unsloth: Pytorch is not installed. Go to https://pytorch.org/.\n"\
     70         "We have some installation instructions on our Github page."
     71     )
     72 except Exception as exception:
---> 73     raise exception
     74 pass
     76 # We support Pytorch 2
     77 # Fixes https://github.com/unslothai/unsloth/issues/38

File /usr/local/lib/python3.11/dist-packages/unsloth/__init__.py:66
     63 os.environ["UNSLOTH_IS_PRESENT"] = "1"
     65 try:
---> 66     import torch
     67 except ModuleNotFoundError:
     68     raise ImportError(
     69         "Unsloth: Pytorch is not installed. Go to https://pytorch.org/.\n"\
     70         "We have some installation instructions on our Github page."
     71     )

File /usr/local/lib/python3.11/dist-packages/torch/__init__.py:235
    233     if USE_GLOBAL_DEPS:
    234         _load_global_deps()
--> 235     from torch._C import *  # noqa: F403
    237 # Appease the type checker; ordinarily this binding is inserted by the
    238 # torch._C module initialization code in C
    239 if TYPE_CHECKING:

ImportError: /usr/local/lib/python3.11/dist-packages/torch/lib/../../nvidia/cusparse/lib/libcusparse.so.12: undefined symbol: __nvJitLinkAddData_12_1, version libnvJitLink.so.12
#

Would be nice to be able to run in paperspace

#

since its very cheap and has alot of gpu power

# 
%%capture
# Skip restarting message in Colab
import sys; modules = list(sys.modules.keys())
for x in modules: sys.modules.pop(x) if "PIL" in x or "google" in x else None

!pip install vllm
!pip install torch==2.12.0+cu121 -f https://download.pytorch.org/whl/torch_stable.html
!pip install --upgrade pip && pip install "unsloth[cu121-torch212] @ git+https://github.com/unslothai/unsloth.git"
!pip install --upgrade pillow
# If you are running this notebook on local, you need to install `diffusers` too
!pip install diffusers
# Temporarily install a specific TRL nightly version
!pip install git+https://github.com/huggingface/trl.git@e95f9fb74a3c3647b86f251b7e230ec51c64b72b```

Modified the first step of the notebook to this, trying to resolve the above issue^^
gloomy girder
#

Then try restarting

#

Also pretty sure you are gonna need transformers, dataset , accelerate , bitsandbytes and triton on paperspace

stoic atlas