sturdy mortar
Traceback (most recent call last):
File "/notebooks/text-generation-webui/modules/ui_model_menu.py", line 213, in load_model_wrapper
shared.model, shared.tokenizer = load_model(selected_model, loader)
File "/notebooks/text-generation-webui/modules/models.py", line 87, in load_model
output = load_func_maploader
File "/notebooks/text-generation-webui/modules/models.py", line 380, in ExLlamav2_loader
from modules.exllamav2 import Exllamav2Model
File "/notebooks/text-generation-webui/modules/exllamav2.py", line 5, in <module>
from exllamav2 import (
File "/workspace/miniconda3/envs/textgen/lib/python3.10/site-packages/exllamav2/init.py", line 3, in <module>
from exllamav2.model import ExLlamaV2
File "/workspace/miniconda3/envs/textgen/lib/python3.10/site-packages/exllamav2/model.py", line 16, in <module>
from exllamav2.config import ExLlamaV2Config
File "/workspace/miniconda3/envs/textgen/lib/python3.10/site-packages/exllamav2/config.py", line 2, in <module>
from exllamav2.fasttensors import STFile
File "/workspace/miniconda3/envs/textgen/lib/python3.10/site-packages/exllamav2/fasttensors.py", line 5, in <module>
from exllamav2.ext import exllamav2_ext as ext_c
File "/workspace/miniconda3/envs/textgen/lib/python3.10/site-packages/exllamav2/ext.py", line 15, in <module>
import exllamav2_ext
ImportError: /workspace/miniconda3/envs/textgen/lib/python3.10/site-packages/exllamav2_ext.cpython-310-x86_64-linux-gnu.so: undefined symbol: _ZN3c107WarningC1ENS_7variantIJNS0_11UserWarningENS0_18DeprecationWarningEEEERKNS_14SourceLocationESsb
This is what I got when I try to run exl model.
It was okay yesterday, but somehow it give me this error since today. Anyone have idea what's going on here?