runtime error

Exit code: 1. Reason: oundError: No module named 'flash_attn_2_cuda' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/home/user/app/app.py", line 10, in <module> "microsoft/Phi-3.5-vision-instruct": AutoModelForCausalLM.from_pretrained("microsoft/Phi-3.5-vision-instruct", trust_remote_code=True, torch_dtype="auto", _attn_implementation="flash_attention_2").cuda().eval() File "/usr/local/lib/python3.10/site-packages/transformers/models/auto/auto_factory.py", line 551, in from_pretrained model_class = get_class_from_dynamic_module( File "/usr/local/lib/python3.10/site-packages/transformers/dynamic_module_utils.py", line 514, in get_class_from_dynamic_module return get_class_in_module(class_name, final_module) File "/usr/local/lib/python3.10/site-packages/transformers/dynamic_module_utils.py", line 212, in get_class_in_module module_spec.loader.exec_module(module) File "<frozen importlib._bootstrap_external>", line 883, in exec_module File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed File "/home/user/.cache/huggingface/modules/transformers_modules/microsoft/Phi-3.5-vision-instruct/4a0d683eba9f1d0cbfb6151705d1ee73c25a80ca/modeling_phi3_v.py", line 59, in <module> from transformers import CLIPVisionConfig, CLIPVisionModel, PretrainedConfig File "<frozen importlib._bootstrap>", line 1075, in _handle_fromlist File "/usr/local/lib/python3.10/site-packages/transformers/utils/import_utils.py", line 1577, in __getattr__ value = getattr(module, name) File "/usr/local/lib/python3.10/site-packages/transformers/utils/import_utils.py", line 1576, in __getattr__ module = self._get_module(self._class_to_module[name]) File "/usr/local/lib/python3.10/site-packages/transformers/utils/import_utils.py", line 1588, in _get_module raise RuntimeError( RuntimeError: Failed to import transformers.models.clip.modeling_clip because of the following error (look up to see its traceback): No module named 'flash_attn_2_cuda'

Container logs:

Fetching error logs...