No Module named Deepspeed #370

New Issue

pheonis · 2023-09-05T06:39:18Z

pheonis commented

2023-09-05 06:39:18 +00:00

Im trying to use the latest improvement "deepspeed". But so far its not working. When i turn this on in the settings,then i get this error

"Something went wrong
No module named 'deepspeed'"

I think its not properly implemented..and also im so eager to try this out.

Im trying to use the latest improvement "deepspeed". But so far its not working. When i turn this on in the settings,then i get this error ``` "Something went wrong No module named 'deepspeed'" ``` I think its not properly implemented..and also im so eager to try this out.

pheonis closed this issue

2023-09-05 07:10:47 +00:00

pheonis changed title from ~~Getting error starting ai voice cloning~~ to No Module named Deepspeed

2023-09-05 07:53:49 +00:00

pheonis reopened this issue

2023-09-05 07:58:03 +00:00

ken11o2 commented

2023-09-05 09:18:11 +00:00

u can install it with
pip install deepspeed==0.10.2

Tested on WSL Ubuntu 20.04

u can install it with `pip install deepspeed==0.10.2` Tested on WSL Ubuntu 20.04

pheonis commented

2023-09-05 14:50:04 +00:00

u can install it with
pip install deepspeed==0.10.2

Hi mate, Tried to install but got this error instead!

`Preparing metadata (setup.py) ... error
  error: subprocess-exited-with-error

  × python setup.py egg_info did not run successfully.
  │ exit code: 1
  ╰─> [15 lines of output]
      test.c
      LINK : fatal error LNK1181: cannot open input file 'aio.lib'
      Traceback (most recent call last):
        File "<string>", line 2, in <module>
        File "<pip-setuptools-caller>", line 34, in <module>
        File "C:\Users\Pheonis\AppData\Local\Temp\pip-install-l17dx40p\deepspeed_f32be1d725324d219cea55677ef48d99\setup.py", line 182, in <module>
          abort(f"Unable to pre-compile {op_name}")
        File "C:\Users\Pheonis\AppData\Local\Temp\pip-install-l17dx40p\deepspeed_f32be1d725324d219cea55677ef48d99\setup.py", line 52, in abort
          assert False, msg
      AssertionError: Unable to pre-compile async_io
      DS_BUILD_OPS=1
       [WARNING]  async_io requires the dev libaio .so object and headers but these were not found.
       [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found.
       [WARNING]  One can disable async_io with DS_BUILD_AIO=0
       [ERROR]  Unable to pre-compile async_io
      [end of output]

  note: This error originates from a subprocess, and is likely not a problem with pip.
error: metadata-generation-failed

× Encountered error while generating package metadata.
╰─> See above for output.

note: This is an issue with the package mentioned above, not pip.
hint: See above for details.`

> u can install it with > `pip install deepspeed==0.10.2` Hi mate, Tried to install but got this error instead! ``` `Preparing metadata (setup.py) ... error error: subprocess-exited-with-error × python setup.py egg_info did not run successfully. │ exit code: 1 ╰─> [15 lines of output] test.c LINK : fatal error LNK1181: cannot open input file 'aio.lib' Traceback (most recent call last): File "<string>", line 2, in <module> File "<pip-setuptools-caller>", line 34, in <module> File "C:\Users\Pheonis\AppData\Local\Temp\pip-install-l17dx40p\deepspeed_f32be1d725324d219cea55677ef48d99\setup.py", line 182, in <module> abort(f"Unable to pre-compile {op_name}") File "C:\Users\Pheonis\AppData\Local\Temp\pip-install-l17dx40p\deepspeed_f32be1d725324d219cea55677ef48d99\setup.py", line 52, in abort assert False, msg AssertionError: Unable to pre-compile async_io DS_BUILD_OPS=1 [WARNING] async_io requires the dev libaio .so object and headers but these were not found. [WARNING] If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found. [WARNING] One can disable async_io with DS_BUILD_AIO=0 [ERROR] Unable to pre-compile async_io [end of output] note: This error originates from a subprocess, and is likely not a problem with pip. error: metadata-generation-failed × Encountered error while generating package metadata. ╰─> See above for output. note: This is an issue with the package mentioned above, not pip. hint: See above for details.` ```

mrq commented

2023-09-05 18:00:44 +00:00

DeepSpeed isn't available on Windows natively without going through a nightmare of hoops to get it compiled and installed. The best bet is to have an environment under WSL2 but you're still under the overhead tax from operating under WSL2.

It's why I haven't included it as a dependency in requirements.txt, and why I marked it as disabled by default in the web UI.

DeepSpeed isn't available on Windows natively without going through a nightmare of hoops to get it compiled and installed. The best bet is to have an environment under WSL2 but you're still under the overhead tax from operating under WSL2. It's why I haven't included it as a dependency in requirements.txt, and why I marked it as disabled by default in the web UI.

Jarod commented

2023-09-09 00:50:59 +00:00

u can install it with
pip install deepspeed==0.10.2

Hi mate, Tried to install but got this error instead!

`Preparing metadata (setup.py) ... error
  error: subprocess-exited-with-error

  × python setup.py egg_info did not run successfully.
  │ exit code: 1
  ╰─> [15 lines of output]
      test.c
      LINK : fatal error LNK1181: cannot open input file 'aio.lib'
      Traceback (most recent call last):
        File "<string>", line 2, in <module>
        File "<pip-setuptools-caller>", line 34, in <module>
        File "C:\Users\Pheonis\AppData\Local\Temp\pip-install-l17dx40p\deepspeed_f32be1d725324d219cea55677ef48d99\setup.py", line 182, in <module>
          abort(f"Unable to pre-compile {op_name}")
        File "C:\Users\Pheonis\AppData\Local\Temp\pip-install-l17dx40p\deepspeed_f32be1d725324d219cea55677ef48d99\setup.py", line 52, in abort
          assert False, msg
      AssertionError: Unable to pre-compile async_io
      DS_BUILD_OPS=1
       [WARNING]  async_io requires the dev libaio .so object and headers but these were not found.
       [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found.
       [WARNING]  One can disable async_io with DS_BUILD_AIO=0
       [ERROR]  Unable to pre-compile async_io
      [end of output]

  note: This error originates from a subprocess, and is likely not a problem with pip.
error: metadata-generation-failed

× Encountered error while generating package metadata.
╰─> See above for output.

note: This is an issue with the package mentioned above, not pip.
hint: See above for details.`

As stated above, it can be a nightmare to get going. I run Windows and only need it for inference, so if that's the case for you, you can go to this issue here and use marcos pre-compiled wheels file: https://github.com/microsoft/DeepSpeed/issues/2588

Once you have it, it's a matter of pip installing it and it should work fine for inference. Though you need to be on Cu117 for this to work else you need to reinstall pytorch pacakges under 117.

Building the wheels yourself is a hell of a time sync and I don't recommend it. The author's instructions mostly work but I had to modify some of the steps to actually get it built.

> > u can install it with > > `pip install deepspeed==0.10.2` > > Hi mate, Tried to install but got this error instead! > ``` > `Preparing metadata (setup.py) ... error > error: subprocess-exited-with-error > > × python setup.py egg_info did not run successfully. > │ exit code: 1 > ╰─> [15 lines of output] > test.c > LINK : fatal error LNK1181: cannot open input file 'aio.lib' > Traceback (most recent call last): > File "<string>", line 2, in <module> > File "<pip-setuptools-caller>", line 34, in <module> > File "C:\Users\Pheonis\AppData\Local\Temp\pip-install-l17dx40p\deepspeed_f32be1d725324d219cea55677ef48d99\setup.py", line 182, in <module> > abort(f"Unable to pre-compile {op_name}") > File "C:\Users\Pheonis\AppData\Local\Temp\pip-install-l17dx40p\deepspeed_f32be1d725324d219cea55677ef48d99\setup.py", line 52, in abort > assert False, msg > AssertionError: Unable to pre-compile async_io > DS_BUILD_OPS=1 > [WARNING] async_io requires the dev libaio .so object and headers but these were not found. > [WARNING] If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found. > [WARNING] One can disable async_io with DS_BUILD_AIO=0 > [ERROR] Unable to pre-compile async_io > [end of output] > > note: This error originates from a subprocess, and is likely not a problem with pip. > error: metadata-generation-failed > > × Encountered error while generating package metadata. > ╰─> See above for output. > > note: This is an issue with the package mentioned above, not pip. > hint: See above for details.` > ``` > > As stated above, it can be a nightmare to get going. I run Windows and only need it for inference, so if that's the case for you, you can go to this issue here and use marcos pre-compiled wheels file: https://github.com/microsoft/DeepSpeed/issues/2588 Once you have it, it's a matter of pip installing it and it should work fine for inference. Though you need to be on Cu117 for this to work else you need to reinstall pytorch pacakges under 117. Building the wheels yourself is a hell of a time sync and I don't recommend it. The author's instructions mostly work but I had to modify some of the steps to actually get it built.

stilltravelling referenced this issue

2023-10-07 05:41:57 +00:00

Deepspeed - Windows (Yes I know) #404

Sign in to join this conversation.