ERROR：Gemma3Config' object has no attribute 'vocab_size'
INFO 03-13 14:12:23 transformers.py:129] Using Transformers backend.
ERROR 03-13 14:12:23 engine.py:400] 'Gemma3Config' object has no attribute 'vocab_size'
ERROR 03-13 14:12:23 engine.py:400] Traceback (most recent call last):
ERROR 03-13 14:12:23 engine.py:400] File "/root/miniconda3/envs/vllm/lib/python3.12/site-packages/vllm/engine/multiprocessing/engine.py", line 391, in run_mp_engine
ERROR 03-13 14:12:23 engine.py:400] engine = MQLLMEngine.from_engine_args(engine_args=engine_args,
ERROR 03-13 14:12:23 engine.py:400] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
ERROR 03-13 14:12:23 engine.py:400] File "/root/miniconda3/envs/vllm/lib/python3.12/site-packages/vllm/engine/multiprocessing/engine.py", line 124, in from_engine_args
ERROR 03-13 14:12:23 engine.py:400] return cls(ipc_path=ipc_path,
ERROR 03-13 14:12:23 engine.py:400] ^^^^^^^^^^^^^^^^^^^^^^
ERROR 03-13 14:12:23 engine.py:400] File "/root/miniconda3/envs/vllm/lib/python3.12/site-packages/vllm/engine/multiprocessing/engine.py", line 76, in init
ERROR 03-13 14:12:23 engine.py:400] self.engine = LLMEngine(*args, **kwargs)
ERROR 03-13 14:12:23 engine.py:400] ^^^^^^^^^^^^^^^^^^^^^^^^^^
ERROR 03-13 14:12:23 engine.py:400] File "/root/miniconda3/envs/vllm/lib/python3.12/site-packages/vllm/engine/llm_engine.py", line 273, in init
ERROR 03-13 14:12:23 engine.py:400] self.model_executor = executor_class(vllm_config=vllm_config, )
ERROR 03-13 14:12:23 engine.py:400] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
ERROR 03-13 14:12:23 engine.py:400] File "/root/miniconda3/envs/vllm/lib/python3.12/site-packages/vllm/executor/executor_base.py", line 52, in init
ERROR 03-13 14:12:23 engine.py:400] self._init_executor()
ERROR 03-13 14:12:23 engine.py:400] File "/root/miniconda3/envs/vllm/lib/python3.12/site-packages/vllm/executor/uniproc_executor.py", line 47, in _init_executor
ERROR 03-13 14:12:23 engine.py:400] self.collective_rpc("load_model")
ERROR 03-13 14:12:23 engine.py:400] File "/root/miniconda3/envs/vllm/lib/python3.12/site-packages/vllm/executor/uniproc_executor.py", line 56, in collective_rpc
ERROR 03-13 14:12:23 engine.py:400] answer = run_method(self.driver_worker, method, args, kwargs)
ERROR 03-13 14:12:23 engine.py:400] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
ERROR 03-13 14:12:23 engine.py:400] File "/root/miniconda3/envs/vllm/lib/python3.12/site-packages/vllm/utils.py", line 2196, in run_method
ERROR 03-13 14:12:23 engine.py:400] return func(*args, **kwargs)
ERROR 03-13 14:12:23 engine.py:400] ^^^^^^^^^^^^^^^^^^^^^
ERROR 03-13 14:12:23 engine.py:400] File "/root/miniconda3/envs/vllm/lib/python3.12/site-packages/vllm/worker/worker.py", line 183, in load_model
ERROR 03-13 14:12:23 engine.py:400] self.model_runner.load_model()
ERROR 03-13 14:12:23 engine.py:400] File "/root/miniconda3/envs/vllm/lib/python3.12/site-packages/vllm/worker/model_runner.py", line 1112, in load_model
ERROR 03-13 14:12:23 engine.py:400] self.model = get_model(vllm_config=self.vllm_config)
ERROR 03-13 14:12:23 engine.py:400] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
ERROR 03-13 14:12:23 engine.py:400] File "/root/miniconda3/envs/vllm/lib/python3.12/site-packages/vllm/model_executor/model_loader/init.py", line 14, in get_model
ERROR 03-13 14:12:23 engine.py:400] return loader.load_model(vllm_config=vllm_config)
ERROR 03-13 14:12:23 engine.py:400] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
ERROR 03-13 14:12:23 engine.py:400] File "/root/miniconda3/envs/vllm/lib/python3.12/site-packages/vllm/model_executor/model_loader/loader.py", line 406, in load_model
ERROR 03-13 14:12:23 engine.py:400] model = _initialize_model(vllm_config=vllm_config)
ERROR 03-13 14:12:23 engine.py:400] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
ERROR 03-13 14:12:23 engine.py:400] File "/root/miniconda3/envs/vllm/lib/python3.12/site-packages/vllm/model_executor/model_loader/loader.py", line 125, in _initialize_model
ERROR 03-13 14:12:23 engine.py:400] return model_class(vllm_config=vllm_config, prefix=prefix)
ERROR 03-13 14:12:23 engine.py:400] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
ERROR 03-13 14:12:23 engine.py:400] File "/root/miniconda3/envs/vllm/lib/python3.12/site-packages/vllm/model_executor/models/transformers.py", line 135, in init
ERROR 03-13 14:12:23 engine.py:400] self.vocab_size = config.vocab_size
ERROR 03-13 14:12:23 engine.py:400] ^^^^^^^^^^^^^^^^^
ERROR 03-13 14:12:23 engine.py:400] File "/root/miniconda3/envs/vllm/lib/python3.12/site-packages/transformers/configuration_utils.py", line 214, in getattribute
ERROR 03-13 14:12:23 engine.py:400] return super().getattribute(key)
ERROR 03-13 14:12:23 engine.py:400] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
ERROR 03-13 14:12:23 engine.py:400] AttributeError: 'Gemma3Config' object has no attribute 'vocab_size'
Seems like you are trying to load this model as AutoModelForCausalLM. Gemma3 is multimodal and its submodule language_model belongs to this class.
same problem here too