Skip to content

Instantly share code, notes, and snippets.

Show Gist options
  • Save russellballestrini/b1d17d8832859fbba8623c03069e61c2 to your computer and use it in GitHub Desktop.
Save russellballestrini/b1d17d8832859fbba8623c03069e61c2 to your computer and use it in GitHub Desktop.
error installing unsloth in python virtualenv
(env-unsloth) fox@ai:~$ pip install "unsloth[cu121_ampere] @ git+https://github.com/unslothai/unsloth.git"
Collecting unsloth[cu121_ampere]@ git+https://github.com/unslothai/unsloth.git
Cloning https://github.com/unslothai/unsloth.git to /tmp/pip-install-1v7p_k83/unsloth_c0bb12f6e08849a6afa66cb8e700f678
Running command git clone --filter=blob:none --quiet https://github.com/unslothai/unsloth.git /tmp/pip-install-1v7p_k83/unsloth_c0bb12f6e08849a6afa66cb8e700f678
Resolved https://github.com/unslothai/unsloth.git to commit c1ac4d2707574868767345e76ebe49c8353f9057
Installing build dependencies ... done
Getting requirements to build wheel ... done
Installing backend dependencies ... done
Preparing metadata (pyproject.toml) ... done
Collecting bitsandbytes (from unsloth[cu121_ampere]@ git+https://github.com/unslothai/unsloth.git)
Obtaining dependency information for bitsandbytes from https://files.pythonhosted.org/packages/9b/63/489ef9cd7a33c1f08f1b2be51d1b511883c5e34591aaa9873b30021cd679/bitsandbytes-0.42.0-py3-none-any.whl.metadata
Using cached bitsandbytes-0.42.0-py3-none-any.whl.metadata (9.9 kB)
Collecting flash-attn (from unsloth[cu121_ampere]@ git+https://github.com/unslothai/unsloth.git)
Using cached flash_attn-2.4.2.tar.gz (2.4 MB)
Installing build dependencies ... done
Getting requirements to build wheel ... error
error: subprocess-exited-with-error
× Getting requirements to build wheel did not run successfully.
│ exit code: 1
╰─> [20 lines of output]
Traceback (most recent call last):
File "/home/fox/env-unsloth/lib/python3.11/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 353, in <module>
main()
File "/home/fox/env-unsloth/lib/python3.11/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 335, in main
json_out['return_val'] = hook(**hook_input['kwargs'])
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/fox/env-unsloth/lib/python3.11/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 118, in get_requires_for_build_wheel
return hook(config_settings)
^^^^^^^^^^^^^^^^^^^^^
File "/tmp/pip-build-env-16c20w3x/overlay/lib/python3.11/site-packages/setuptools/build_meta.py", line 325, in get_requires_for_build_wheel
return self._get_build_requires(config_settings, requirements=['wheel'])
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/tmp/pip-build-env-16c20w3x/overlay/lib/python3.11/site-packages/setuptools/build_meta.py", line 295, in _get_build_requires
self.run_setup()
File "/tmp/pip-build-env-16c20w3x/overlay/lib/python3.11/site-packages/setuptools/build_meta.py", line 480, in run_setup
super(_BuildMetaLegacyBackend, self).run_setup(setup_script=setup_script)
File "/tmp/pip-build-env-16c20w3x/overlay/lib/python3.11/site-packages/setuptools/build_meta.py", line 311, in run_setup
exec(code, locals())
File "<string>", line 9, in <module>
ModuleNotFoundError: No module named 'packaging'
[end of output]
note: This error originates from a subprocess, and is likely not a problem with pip.
error: subprocess-exited-with-error
× Getting requirements to build wheel did not run successfully.
│ exit code: 1
╰─> See above for output.
note: This error originates from a subprocess, and is likely not a problem with pip.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment