用这个的话ExLlama_HF
Traceback (most recent call last):
File "G:\text-generation-webui-1.7\modules\ui_model_menu.py", line 201, in load_model_wrapper
shared.model, shared.tokenizer = load_model(shared.model_name, loader)
File "G:\text-generation-webui-1.7\modules\models.py", line 79, in load_model
output = load_func_map[loader](model_name)
File "G:\text-generation-webui-1.7\modules\models.py", line 333, in ExLlama_HF_loader
return ExllamaHF.from_pretrained(model_name)
File "G:\text-generation-webui-1.7\modules\exllama_hf.py", line 139, in from_pretrained
config = ExLlamaConfig(pretrained_model_name_or_path / 'config.json')
File "G:\text-generation-webui-1.7\installer_files\env\lib\site-packages\exllama\model.py", line 45, in init
with open(model_config_path) as f:
FileNotFoundError: [Errno 2] No such file or directory: 'models\LocalNSFW_RWKV-Claude\config.json'
用这个的话AutoGPTQ
Failed to load LocalNSFW_RWKV-Claude.