Skip to content

ModuleNotFoundError: No module named 'vllm._C' #33

@VenomHzp

Description

@VenomHzp

(localgpt-vision) D:\Python_Project\python_project\localGPT-Vision-main>python app.py
INFO 06-14 19:30:20 [importing.py:17] Triton not installed or not compatible; certain GPU-related functions will not be available.
WARNING 06-14 19:30:20 [importing.py:29] Triton is not installed. Using dummy decorators. Install it via pip install triton to enable kernel compilation.
INFO 06-14 19:30:20 [init.py:244] Automatically detected platform cuda.
Traceback (most recent call last):
File "D:\Python_Project\python_project\localGPT-Vision-main\app.py", line 9, in
from models.responder import generate_response
File "D:\Python_Project\python_project\localGPT-Vision-main\models\responder.py", line 3, in
from models.model_loader import load_model, is_single_image_model
File "D:\Python_Project\python_project\localGPT-Vision-main\models\model_loader.py", line 7, in
from vllm.sampling_params import SamplingParams
File "D:\Anaconda\envs\localgpt-vision\lib\site-packages\vllm_init_.py", line 13, in
from vllm.engine.arg_utils import AsyncEngineArgs, EngineArgs
File "D:\Anaconda\envs\localgpt-vision\lib\site-packages\vllm\engine\arg_utils.py", line 22, in
from vllm.config import (BlockSize, CacheConfig, CacheDType, CompilationConfig,
File "D:\Anaconda\envs\localgpt-vision\lib\site-packages\vllm\config.py", line 37, in
from vllm.model_executor.layers.quantization import (QUANTIZATION_METHODS,
File "D:\Anaconda\envs\localgpt-vision\lib\site-packages\vllm\model_executor_init_.py", line 4, in
from vllm.model_executor.parameter import (BasevLLMParameter,
File "D:\Anaconda\envs\localgpt-vision\lib\site-packages\vllm\model_executor\parameter.py", line 10, in
from vllm.distributed import get_tensor_model_parallel_rank
File "D:\Anaconda\envs\localgpt-vision\lib\site-packages\vllm\distributed_init_.py", line 4, in
from .communication_op import *
File "D:\Anaconda\envs\localgpt-vision\lib\site-packages\vllm\distributed\communication_op.py", line 9, in
from .parallel_state import get_tp_group
File "D:\Anaconda\envs\localgpt-vision\lib\site-packages\vllm\distributed\parallel_state.py", line 150, in
from vllm.platforms import current_platform
File "D:\Anaconda\envs\localgpt-vision\lib\site-packages\vllm\platforms_init_.py", line 276, in getattr
current_platform = resolve_obj_by_qualname(
File "D:\Anaconda\envs\localgpt-vision\lib\site-packages\vllm\utils.py", line 2239, in resolve_obj_by_qualname
module = importlib.import_module(module_name)
File "D:\Anaconda\envs\localgpt-vision\lib\importlib_init
.py", line 126, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
File "D:\Anaconda\envs\localgpt-vision\lib\site-packages\vllm\platforms\cuda.py", line 18, in
import vllm._C # noqa
ModuleNotFoundError: No module named 'vllm._C'

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions