runtime error
Exit code: 1. Reason: ][A model-00003-of-00004.safetensors: 84%|████████▎ | 4.11G/4.92G [00:21<00:02, 324MB/s][A model-00003-of-00004.safetensors: 96%|█████████▌| 4.71G/4.92G [00:22<00:00, 378MB/s][A model-00003-of-00004.safetensors: 100%|██████████| 4.92G/4.92G [00:22<00:00, 217MB/s] model-00004-of-00004.safetensors: 0%| | 0.00/1.17G [00:00<?, ?B/s][A model-00004-of-00004.safetensors: 6%|▌ | 67.7M/1.17G [00:01<00:30, 35.6MB/s][A model-00004-of-00004.safetensors: 20%|█▉ | 230M/1.17G [00:03<00:11, 83.0MB/s] [A model-00004-of-00004.safetensors: 31%|███ | 364M/1.17G [00:04<00:09, 83.3MB/s][A model-00004-of-00004.safetensors: 100%|██████████| 1.17G/1.17G [00:05<00:00, 291MB/s][A model-00004-of-00004.safetensors: 100%|██████████| 1.17G/1.17G [00:05<00:00, 202MB/s] Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s][A Loading checkpoint shards: 25%|██▌ | 1/4 [00:10<00:32, 10.97s/it][A Loading checkpoint shards: 50%|█████ | 2/4 [00:22<00:22, 11.28s/it][A Loading checkpoint shards: 75%|███████▌ | 3/4 [00:34<00:11, 11.52s/it][A Loading checkpoint shards: 100%|██████████| 4/4 [00:34<00:00, 8.57s/it] generation_config.json: 0%| | 0.00/143 [00:00<?, ?B/s][A generation_config.json: 100%|██████████| 143/143 [00:00<00:00, 239kB/s] Some parameters are on the meta device because they were offloaded to the cpu and disk. You shouldn't move a model that is dispatched using accelerate hooks. Traceback (most recent call last): File "/home/user/app/app.py", line 39, in <module> model.to(device) File "/usr/local/lib/python3.10/site-packages/accelerate/big_modeling.py", line 462, in wrapper raise RuntimeError("You can't move a model that has some modules offloaded to cpu or disk.") RuntimeError: You can't move a model that has some modules offloaded to cpu or disk.
Container logs:
Fetching error logs...