Open
Description
Your current environment
The output of `python collect_env.py`
Traceback (most recent call last):
File "/home/u2024001049/collect_env.py", line 17, in <module>
from vllm.envs import environment_variables
ModuleNotFoundError: No module named 'vllm'
How you are installing vllm
module load cuda/12.1.1
pip install -vvv vllmWhen I was installing vllm, the displayed information was as follows
Building wheels for collected packages: xformers
Created temporary directory: /tmp/pip-wheel-suvcw6uj
DEPRECATION: Building 'xformers' using the legacy setup.py bdist_wheel mechanism, which will be removed in a future version. pip 25.3 will enforce this behaviour change. A possible replacement is to use the standardized build interface by setting the `--use-pep517` option, (possibly combined with `--no-build-isolation`), or adding a `pyproject.toml` file to the source tree of 'xformers'. Discussion can be found at https://github.com/pypa/pip/issues/6334
Building wheel for xformers (setup.py) ... Destination directory: /tmp/pip-wheel-suvcw6uj
Running command python setup.py bdist_wheel
Looks like we are using CUDA 12.1 which segfaults when provided with the -generate-line-info flag. Disabling it.
fatal: Not a git repository (or any parent up to mount point /tmp)
Stopping at filesystem boundary (GIT_DISCOVERY_ACROSS_FILESYSTEM not set).
/home/u2024001049/.conda/envs/fei2/lib/python3.12/site-packages/setuptools/dist.py:759: SetuptoolsDeprecationWarning: License classifiers are deprecated.
!!
********************************************************************************
Please consider removing the following classifiers in favor of a SPDX license expression:
License :: OSI Approved :: BSD License
See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details.
********************************************************************************
!!
self._finalize_license_expression()
running bdist_wheel
running build
running build_py
creating build/lib.linux-x86_64-cpython-312/xformers
copying xformers/utils.py -> build/lib.linux-x86_64-cpython-312/xformers
copying xformers/test.py -> build/lib.linux-x86_64-cpython-312/xformers
copying xformers/info.py -> build/lib.linux-x86_64-cpython-312/xformers
copying xformers/checkpoint.py -> build/lib.linux-x86_64-cpython-312/xformers
copying xformers/attn_bias_utils.py -> build/lib.linux-x86_64-cpython-312/xformers
copying xformers/_deprecation_warning.py -> build/lib.linux-x86_64-cpython-312/xformers
copying xformers/_cpp_lib.py -> build/lib.linux-x86_64-cpython-312/xformers
copying xformers/__init__.py -> build/lib.linux-x86_64-cpython-312/xformers
creating build/lib.linux-x86_64-cpython-312/xformers/_flash_attn
copying xformers/_flash_attn/__init__.py -> build/lib.linux-x86_64-cpython-312/xformers/_flash_attn
......
Traceback (most recent call last):
File "<string>", line 2, in <module>
File "<pip-setuptools-caller>", line 35, in <module>
File "/tmp/pip-install-gwilihpi/xformers_d0a2b5a690ad4ebfa85fa19f1622276e/setup.py", line 691, in <module>
setuptools.setup(
File "/home/u2024001049/.conda/envs/fei2/lib/python3.12/site-packages/setuptools/__init__.py", line 117, in setup
return distutils.core.setup(**attrs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/u2024001049/.conda/envs/fei2/lib/python3.12/site-packages/setuptools/_distutils/core.py", line 186, in setup
return run_commands(dist)
^^^^^^^^^^^^^^^^^^
File "/home/u2024001049/.conda/envs/fei2/lib/python3.12/site-packages/setuptools/_distutils/core.py", line 202, in run_commands
dist.run_commands()
File "/home/u2024001049/.conda/envs/fei2/lib/python3.12/site-packages/setuptools/_distutils/dist.py", line 1002, in run_commands
self.run_command(cmd)
File "/home/u2024001049/.conda/envs/fei2/lib/python3.12/site-packages/setuptools/dist.py", line 1104, in run_command
super().run_command(command)
File "/home/u2024001049/.conda/envs/fei2/lib/python3.12/site-packages/setuptools/_distutils/dist.py", line 1021, in run_command
cmd_obj.run()
File "/home/u2024001049/.conda/envs/fei2/lib/python3.12/site-packages/setuptools/command/bdist_wheel.py", line 370, in run
self.run_command("build")
File "/home/u2024001049/.conda/envs/fei2/lib/python3.12/site-packages/setuptools/_distutils/cmd.py", line 357, in run_command
self.distribution.run_command(command)
File "/home/u2024001049/.conda/envs/fei2/lib/python3.12/site-packages/setuptools/dist.py", line 1104, in run_command
super().run_command(command)
File "/home/u2024001049/.conda/envs/fei2/lib/python3.12/site-packages/setuptools/_distutils/dist.py", line 1021, in run_command
cmd_obj.run()
File "/home/u2024001049/.conda/envs/fei2/lib/python3.12/site-packages/setuptools/_distutils/command/build.py", line 135, in run
self.run_command(cmd_name)
File "/home/u2024001049/.conda/envs/fei2/lib/python3.12/site-packages/setuptools/_distutils/cmd.py", line 357, in run_command
self.distribution.run_command(command)
File "/home/u2024001049/.conda/envs/fei2/lib/python3.12/site-packages/setuptools/dist.py", line 1104, in run_command
super().run_command(command)
File "/home/u2024001049/.conda/envs/fei2/lib/python3.12/site-packages/setuptools/_distutils/dist.py", line 1021, in run_command
cmd_obj.run()
File "/home/u2024001049/.conda/envs/fei2/lib/python3.12/site-packages/setuptools/command/build_ext.py", line 99, in run
_build_ext.run(self)
File "/home/u2024001049/.conda/envs/fei2/lib/python3.12/site-packages/setuptools/_distutils/command/build_ext.py", line 368, in run
self.build_extensions()
File "/tmp/pip-install-gwilihpi/xformers_d0a2b5a690ad4ebfa85fa19f1622276e/setup.py", line 648, in build_extensions
super().build_extensions()
File "/home/u2024001049/.conda/envs/fei2/lib/python3.12/site-packages/torch/utils/cpp_extension.py", line 900, in build_extensions
build_ext.build_extensions(self)
File "/home/u2024001049/.conda/envs/fei2/lib/python3.12/site-packages/setuptools/_distutils/command/build_ext.py", line 484, in build_extensions
self._build_extensions_serial()
File "/home/u2024001049/.conda/envs/fei2/lib/python3.12/site-packages/setuptools/_distutils/command/build_ext.py", line 510, in _build_extensions_serial
self.build_extension(ext)
File "/home/u2024001049/.conda/envs/fei2/lib/python3.12/site-packages/setuptools/command/build_ext.py", line 264, in build_extension
_build_ext.build_extension(self, ext)
File "/home/u2024001049/.conda/envs/fei2/lib/python3.12/site-packages/setuptools/_distutils/command/build_ext.py", line 565, in build_extension
objects = self.compiler.compile(
^^^^^^^^^^^^^^^^^^^^^^
File "/home/u2024001049/.conda/envs/fei2/lib/python3.12/site-packages/torch/utils/cpp_extension.py", line 713, in unix_wrap_ninja_compile
_write_ninja_file_and_compile_objects(
File "/home/u2024001049/.conda/envs/fei2/lib/python3.12/site-packages/torch/utils/cpp_extension.py", line 1869, in _write_ninja_file_and_compile_objects
_run_ninja_build(
File "/home/u2024001049/.conda/envs/fei2/lib/python3.12/site-packages/torch/utils/cpp_extension.py", line 2225, in _run_ninja_build
raise RuntimeError(message) from e
RuntimeError: Error compiling objects for extension
error: subprocess-exited-with-error
× python setup.py bdist_wheel did not run successfully.
│ exit code: 1
╰─> See above for output.
note: This error originates from a subprocess, and is likely not a problem with pip.
full command: /home/u2024001049/.conda/envs/fei2/bin/python3.12 -u -c '
exec(compile('"'"''"'"''"'"'
# This is <pip-setuptools-caller> -- a caller that pip uses to run setup.py
#
# - It imports setuptools before invoking setup.py, to enable projects that directly
# import from `distutils.core` to work with newer packaging standards.
# - It provides a clear error message when setuptools is not installed.
# - It sets `sys.argv[0]` to the underlying `setup.py`, when invoking `setup.py` so
# setuptools doesn'"'"'t think the script is `-c`. This avoids the following warning:
# manifest_maker: standard file '"'"'-c'"'"' not found".
# - It generates a shim setup.py, for handling setup.cfg-only projects.
import os, sys, tokenize, traceback
try:
import setuptools
except ImportError:
print(
"ERROR: Can not execute `setup.py` since setuptools failed to import in "
"the build environment with exception:",
file=sys.stderr,
)
traceback.print_exc()
sys.exit(1)
__file__ = %r
sys.argv[0] = __file__
if os.path.exists(__file__):
filename = __file__
with tokenize.open(__file__) as f:
setup_py_code = f.read()
else:
filename = "<auto-generated setuptools caller>"
setup_py_code = "from setuptools import setup; setup()"
exec(compile(setup_py_code, filename, "exec"))
'"'"''"'"''"'"' % ('"'"'/tmp/pip-install-gwilihpi/xformers_d0a2b5a690ad4ebfa85fa19f1622276e/setup.py'"'"',), "<pip-setuptools-caller>", "exec"))' bdist_wheel -d /tmp/pip-wheel-suvcw6uj
cwd: /tmp/pip-install-gwilihpi/xformers_d0a2b5a690ad4ebfa85fa19f1622276e/
error
ERROR: Failed building wheel for xformers
Running setup.py clean for xformers
Running command python setup.py clean
Looks like we are using CUDA 12.1 which segfaults when provided with the -generate-line-info flag. Disabling it.
fatal: Not a git repository (or any parent up to mount point /tmp)
Stopping at filesystem boundary (GIT_DISCOVERY_ACROSS_FILESYSTEM not set).
/home/u2024001049/.conda/envs/fei2/lib/python3.12/site-packages/setuptools/dist.py:759: SetuptoolsDeprecationWarning: License classifiers are deprecated.
!!
********************************************************************************
Please consider removing the following classifiers in favor of a SPDX license expression:
License :: OSI Approved :: BSD License
See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details.
********************************************************************************
!!
self._finalize_license_expression()
running clean
removing 'build/temp.linux-x86_64-cpython-312' (and everything under it)
removing 'build/lib.linux-x86_64-cpython-312' (and everything under it)
'build/bdist.linux-x86_64' does not exist -- can't clean it
'build/scripts-3.12' does not exist -- can't clean it
removing 'build'
Failed to build xformers
Remote version of pip: 25.1
Local version of pip: 25.1
Was pip installed by pip? False
ERROR: Failed to build installable wheels for some pyproject.toml based projects (xformers)
Exception information:
Traceback (most recent call last):
File "/home/u2024001049/.conda/envs/fei2/lib/python3.12/site-packages/pip/_internal/cli/base_command.py", line 105, in _run_wrapper
status = _inner_run()
^^^^^^^^^^^^
File "/home/u2024001049/.conda/envs/fei2/lib/python3.12/site-packages/pip/_internal/cli/base_command.py", line 96, in _inner_run
return self.run(options, args)
^^^^^^^^^^^^^^^^^^^^^^^
File "/home/u2024001049/.conda/envs/fei2/lib/python3.12/site-packages/pip/_internal/cli/req_command.py", line 68, in wrapper
return func(self, options, args)
^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/u2024001049/.conda/envs/fei2/lib/python3.12/site-packages/pip/_internal/commands/install.py", line 436, in run
raise InstallationError(
pip._internal.exceptions.InstallationError: Failed to build installable wheels for some pyproject.toml based projects (xformers)
Removed build tracker: '/tmp/pip-build-tracker-mxdx1jyj'
And when installing vllm in my other environments, it always shows that xformers wheel build fails