NETWORK ERROR DUE TO HIGH TRAFFIC. PLEASE REGENERATE OR REFRESH THIS PAGE.

[changquanyou]

错误信息如下：
2024-05-19 20:02:48 | WARNING | transformers.generation.utils | Setting pad_token_id to eos_token_id:128009 for open-end generation.
2024-05-19 20:02:48 | ERROR | stderr | Exception in thread Thread-3 (generate):
2024-05-19 20:02:48 | ERROR | stderr | Traceback (most recent call last):
2024-05-19 20:02:48 | ERROR | stderr | File "lib/python3.10/threading.py", line 1016, in _bootstrap_inner
2024-05-19 20:02:48 | ERROR | stderr | self.run()
2024-05-19 20:02:48 | ERROR | stderr | File "lib/python3.10/threading.py", line 953, in run
2024-05-19 20:02:48 | ERROR | stderr | self._target(*self._args, **self._kwargs)
2024-05-19 20:02:48 | ERROR | stderr | File "lib/python3.10/site-packages/torch/utils/_contextlib.py", line 115, in decorate_context
2024-05-19 20:02:48 | ERROR | stderr | return func(*args, **kwargs)
2024-05-19 20:02:48 | ERROR | stderr | File "lib/python3.10/site-packages/transformers/generation/utils.py", line 1592, in generate
2024-05-19 20:02:48 | ERROR | stderr | return self.sample(
2024-05-19 20:02:48 | ERROR | stderr | File "lib/python3.10/site-packages/transformers/generation/utils.py", line 2696, in sample
2024-05-19 20:02:48 | ERROR | stderr | outputs = self(
2024-05-19 20:02:48 | ERROR | stderr | File "lib/python3.10/site-packages/torch/nn/modules/module.py", line 1518, in _wrapped_call_impl
2024-05-19 20:02:48 | ERROR | stderr | return self._call_impl(*args, **kwargs)
2024-05-19 20:02:48 | ERROR | stderr | File "lib/python3.10/site-packages/torch/nn/modules/module.py", line 1527, in _call_impl
2024-05-19 20:02:48 | ERROR | stderr | return forward_call(*args, **kwargs)
2024-05-19 20:02:48 | ERROR | stderr | File "lib/python3.10/site-packages/accelerate/hooks.py", line 166, in new_forward
2024-05-19 20:02:48 | ERROR | stderr | output = module._old_forward(*args, **kwargs)
2024-05-19 20:02:48 | ERROR | stderr | File "/home/disk2/mobile_agent/360VL-master/qh360_vl/model/language_model/QH360_VL_llama.py", line 80, in forward
2024-05-19 20:02:48 | ERROR | stderr | outputs = self.model(
2024-05-19 20:02:48 | ERROR | stderr | File "lib/python3.10/site-packages/torch/nn/modules/module.py", line 1518, in _wrapped_call_impl
2024-05-19 20:02:48 | ERROR | stderr | return self._call_impl(*args, **kwargs)
2024-05-19 20:02:48 | ERROR | stderr | File "lib/python3.10/site-packages/torch/nn/modules/module.py", line 1527, in _call_impl
2024-05-19 20:02:48 | ERROR | stderr | return forward_call(*args, **kwargs)
2024-05-19 20:02:48 | ERROR | stderr | File "lib/python3.10/site-packages/transformers/models/llama/modeling_llama.py", line 993, in forward
2024-05-19 20:02:48 | ERROR | stderr | causal_mask = self._update_causal_mask(attention_mask, inputs_embeds)
2024-05-19 20:02:48 | ERROR | stderr | File "lib/python3.10/site-packages/transformers/models/llama/modeling_llama.py", line 1059, in _update_causal_mask
2024-05-19 20:02:48 | ERROR | stderr | if attention_mask is not None and 0.0 in attention_mask:
2024-05-19 20:02:48 | ERROR | stderr | File "lib/python3.10/site-packages/torch/_tensor.py", line 1059, in contains
2024-05-19 20:02:48 | ERROR | stderr | return (element == self).any().item() # type: ignore[union-attr]
2024-05-19 20:02:48 | ERROR | stderr | RuntimeError: CUDA error: device-side assert triggered
2024-05-19 20:02:48 | ERROR | stderr | CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect.
2024-05-19 20:02:48 | ERROR | stderr | For debugging consider passing CUDA_LAUNCH_BLOCKING=1.
2024-05-19 20:02:48 | ERROR | stderr | Compile with TORCH_USE_CUDA_DSA to enable device-side assertions.
2024-05-19 20:02:48 | ERROR | stderr |
2024-05-19 20:02:51 | INFO | model_worker | Send heart beat. Models: ['360VL-8B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 1
2024-05-19 20:03:03 | INFO | stdout | Caught Unknown Error
2024-05-19 20:03:03 | INFO | model_worker | Send heart beat. Models: ['360VL-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-05-19 20:03:06 | INFO | model_worker | Send heart beat. Models: ['360VL-8B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1

[binwang777]

Hi, I guess it is a problem with the transformers version. Please switch to 4.37.2 and try it.

[changquanyou]

current version is 4.38.2, and the demo is successed, I try the 4.37.2, it's failed too