runtime error
Exit code: 1. Reason: ens.json: 100%|āāāāāāāāāā| 2.41k/2.41k [00:00<00:00, 16.5MB/s] special_tokens_map.json: 0%| | 0.00/614 [00:00<?, ?B/s][A special_tokens_map.json: 100%|āāāāāāāāāā| 614/614 [00:00<00:00, 4.29MB/s] š§ Loading base model (this may be slow)... config.json: 0%| | 0.00/1.53k [00:00<?, ?B/s][A config.json: 100%|āāāāāāāāāā| 1.53k/1.53k [00:00<00:00, 9.55MB/s] Traceback (most recent call last): File "/app/app.py", line 14, in <module> model = AutoModelForCausalLM.from_pretrained( File "/usr/local/lib/python3.10/site-packages/transformers/models/auto/auto_factory.py", line 604, in from_pretrained return model_class.from_pretrained( File "/usr/local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 277, in _wrapper return func(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 4822, in from_pretrained quantization_config, kwargs = BitsAndBytesConfig.from_dict( File "/usr/local/lib/python3.10/site-packages/transformers/utils/quantization_config.py", line 122, in from_dict config = cls(**config_dict) File "/usr/local/lib/python3.10/site-packages/transformers/utils/quantization_config.py", line 510, in __init__ self.post_init() File "/usr/local/lib/python3.10/site-packages/transformers/utils/quantization_config.py", line 568, in post_init if self.load_in_4bit and not version.parse(importlib.metadata.version("bitsandbytes")) >= version.parse( File "/usr/local/lib/python3.10/importlib/metadata/__init__.py", line 996, in version return distribution(distribution_name).version File "/usr/local/lib/python3.10/importlib/metadata/__init__.py", line 969, in distribution return Distribution.from_name(distribution_name) File "/usr/local/lib/python3.10/importlib/metadata/__init__.py", line 548, in from_name raise PackageNotFoundError(name) importlib.metadata.PackageNotFoundError: No package metadata was found for bitsandbytes
Container logs:
Fetching error logs...