MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:648: rocBlas error encountered #30

Closed
opened 2023-02-24 12:41:03 +00:00 by mrchucksneed · 4 comments
Reading from latent: ./voices/JayDee/cond_latents.pth
[1/1] Generating line: [redacted]
Generating autoregressive samples
Computing best candidates using CLVP
MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:648: rocBlas error encountered
MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:970: rocBlas error encountered
MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:970: rocBlas error encountered
Transforming autoregressive outputs into audio..
MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:970: rocBlas error encountered
MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:648: rocBlas error encountered
MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:970: rocBlas error encountered
MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:648: rocBlas error encountered
MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:970: rocBlas error encountered
MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:648: rocBlas error encountered
MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:648: rocBlas error encountered
MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:648: rocBlas error encountered
MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:648: rocBlas error encountered
MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:648: rocBlas error encountered
MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:648: rocBlas error encountered
MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:648: rocBlas error encountered
MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:648: rocBlas error encountered
MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:648: rocBlas error encountered
MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:648: rocBlas error encountered
MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:648: rocBlas error encountered
MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:648: rocBlas error encountered
MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:648: rocBlas error encountered
MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:648: rocBlas error encountered
MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:648: rocBlas error encountered
MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:648: rocBlas error encountered
MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:648: rocBlas error encountered
MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:648: rocBlas error encountered
MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:648: rocBlas error encountered
MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:648: rocBlas error encountered
MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:648: rocBlas error encountered
MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:648: rocBlas error encountered
MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:648: rocBlas error encountered
MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:648: rocBlas error encountered
MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:648: rocBlas error encountered
MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:648: rocBlas error encountered
MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:648: rocBlas error encountered
MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:648: rocBlas error encountered
MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:648: rocBlas error encountered
MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:648: rocBlas error encountered
MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:970: rocBlas error encountered
Generating line took 54.91849184036255 seconds
Generation took 54.91849184036255 seconds, saved to './results/JayDee//JayDee_00054.wav'

./results/JayDee//JayDee_00054.wav

Hi there, updated to latest version and started getting this filling up the console.

Also getting this sometimes when (re)Generating voice latents

Traceback (most recent call last):
  File "/home/linuxuser/Documents/ai-voice-cloning/venv/lib/python3.10/site-packages/gradio/routes.py", line 384, in run_predict
    output = await app.get_blocks().process_api(
  File "/home/linuxuser/Documents/ai-voice-cloning/venv/lib/python3.10/site-packages/gradio/blocks.py", line 1024, in process_api
    result = await self.call_function(
  File "/home/linuxuser/Documents/ai-voice-cloning/venv/lib/python3.10/site-packages/gradio/blocks.py", line 836, in call_function
    prediction = await anyio.to_thread.run_sync(
  File "/home/linuxuser/Documents/ai-voice-cloning/venv/lib/python3.10/site-packages/anyio/to_thread.py", line 31, in run_sync
    return await get_asynclib().run_sync_in_worker_thread(
  File "/home/linuxuser/Documents/ai-voice-cloning/venv/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 937, in run_sync_in_worker_thread
    return await future
  File "/home/linuxuser/Documents/ai-voice-cloning/venv/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 867, in run
    result = context.run(func, *args)
  File "/home/linuxuser/Documents/ai-voice-cloning/venv/lib/python3.10/site-packages/gradio/helpers.py", line 584, in tracked_fn
    response = fn(*args)
  File "/home/linuxuser/Documents/ai-voice-cloning/src/utils.py", line 430, in compute_latents
    conditioning_latents = tts.get_conditioning_latents(voice_samples, return_mels=not args.latents_lean_and_mean, progress=progress, slices=voice_latents_chunks, force_cpu=args.force_cpu_for_conditioning_latents)
  File "/home/linuxuser/Documents/ai-voice-cloning/tortoise-tts/tortoise/api.py", line 344, in get_conditioning_latents
    auto_latent = self.autoregressive.get_conditioning(auto_conds)
  File "/home/linuxuser/Documents/ai-voice-cloning/tortoise-tts/tortoise/models/autoregressive.py", line 413, in get_conditioning
    conds.append(self.conditioning_encoder(speech_conditioning_input[:, j]))
  File "/home/linuxuser/Documents/ai-voice-cloning/venv/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1194, in _call_impl
    return forward_call(*input, **kwargs)
  File "/home/linuxuser/Documents/ai-voice-cloning/tortoise-tts/tortoise/models/autoregressive.py", line 213, in forward
    h = self.init(x)
  File "/home/linuxuser/Documents/ai-voice-cloning/venv/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1194, in _call_impl
    return forward_call(*input, **kwargs)
  File "/home/linuxuser/Documents/ai-voice-cloning/venv/lib/python3.10/site-packages/torch/nn/modules/conv.py", line 313, in forward
    return self._conv_forward(input, self.weight, self.bias)
  File "/home/linuxuser/Documents/ai-voice-cloning/venv/lib/python3.10/site-packages/torch/nn/modules/conv.py", line 309, in _conv_forward
    return F.conv1d(input, weight, bias, self.stride,
RuntimeError: miopenStatusInternalError

Many thanks

``` Reading from latent: ./voices/JayDee/cond_latents.pth [1/1] Generating line: [redacted] Generating autoregressive samples Computing best candidates using CLVP MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:648: rocBlas error encountered MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:970: rocBlas error encountered MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:970: rocBlas error encountered Transforming autoregressive outputs into audio.. MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:970: rocBlas error encountered MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:648: rocBlas error encountered MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:970: rocBlas error encountered MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:648: rocBlas error encountered MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:970: rocBlas error encountered MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:648: rocBlas error encountered MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:648: rocBlas error encountered MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:648: rocBlas error encountered MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:648: rocBlas error encountered MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:648: rocBlas error encountered MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:648: rocBlas error encountered MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:648: rocBlas error encountered MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:648: rocBlas error encountered MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:648: rocBlas error encountered MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:648: rocBlas error encountered MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:648: rocBlas error encountered MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:648: rocBlas error encountered MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:648: rocBlas error encountered MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:648: rocBlas error encountered MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:648: rocBlas error encountered MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:648: rocBlas error encountered MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:648: rocBlas error encountered MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:648: rocBlas error encountered MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:648: rocBlas error encountered MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:648: rocBlas error encountered MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:648: rocBlas error encountered MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:648: rocBlas error encountered MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:648: rocBlas error encountered MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:648: rocBlas error encountered MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:648: rocBlas error encountered MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:648: rocBlas error encountered MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:648: rocBlas error encountered MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:648: rocBlas error encountered MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:648: rocBlas error encountered MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:648: rocBlas error encountered MIOpen(HIP): Error [EvaluateInvokers] /MIOpen/src/gemm_v2.cpp:970: rocBlas error encountered Generating line took 54.91849184036255 seconds Generation took 54.91849184036255 seconds, saved to './results/JayDee//JayDee_00054.wav' ./results/JayDee//JayDee_00054.wav ``` Hi there, updated to latest version and started getting this filling up the console. Also getting this sometimes when (re)Generating voice latents ``` Traceback (most recent call last): File "/home/linuxuser/Documents/ai-voice-cloning/venv/lib/python3.10/site-packages/gradio/routes.py", line 384, in run_predict output = await app.get_blocks().process_api( File "/home/linuxuser/Documents/ai-voice-cloning/venv/lib/python3.10/site-packages/gradio/blocks.py", line 1024, in process_api result = await self.call_function( File "/home/linuxuser/Documents/ai-voice-cloning/venv/lib/python3.10/site-packages/gradio/blocks.py", line 836, in call_function prediction = await anyio.to_thread.run_sync( File "/home/linuxuser/Documents/ai-voice-cloning/venv/lib/python3.10/site-packages/anyio/to_thread.py", line 31, in run_sync return await get_asynclib().run_sync_in_worker_thread( File "/home/linuxuser/Documents/ai-voice-cloning/venv/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 937, in run_sync_in_worker_thread return await future File "/home/linuxuser/Documents/ai-voice-cloning/venv/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 867, in run result = context.run(func, *args) File "/home/linuxuser/Documents/ai-voice-cloning/venv/lib/python3.10/site-packages/gradio/helpers.py", line 584, in tracked_fn response = fn(*args) File "/home/linuxuser/Documents/ai-voice-cloning/src/utils.py", line 430, in compute_latents conditioning_latents = tts.get_conditioning_latents(voice_samples, return_mels=not args.latents_lean_and_mean, progress=progress, slices=voice_latents_chunks, force_cpu=args.force_cpu_for_conditioning_latents) File "/home/linuxuser/Documents/ai-voice-cloning/tortoise-tts/tortoise/api.py", line 344, in get_conditioning_latents auto_latent = self.autoregressive.get_conditioning(auto_conds) File "/home/linuxuser/Documents/ai-voice-cloning/tortoise-tts/tortoise/models/autoregressive.py", line 413, in get_conditioning conds.append(self.conditioning_encoder(speech_conditioning_input[:, j])) File "/home/linuxuser/Documents/ai-voice-cloning/venv/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1194, in _call_impl return forward_call(*input, **kwargs) File "/home/linuxuser/Documents/ai-voice-cloning/tortoise-tts/tortoise/models/autoregressive.py", line 213, in forward h = self.init(x) File "/home/linuxuser/Documents/ai-voice-cloning/venv/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1194, in _call_impl return forward_call(*input, **kwargs) File "/home/linuxuser/Documents/ai-voice-cloning/venv/lib/python3.10/site-packages/torch/nn/modules/conv.py", line 313, in forward return self._conv_forward(input, self.weight, self.bias) File "/home/linuxuser/Documents/ai-voice-cloning/venv/lib/python3.10/site-packages/torch/nn/modules/conv.py", line 309, in _conv_forward return F.conv1d(input, weight, bias, self.stride, RuntimeError: miopenStatusInternalError ``` Many thanks
Author
MIOpen Error: /MIOpen/src/gemm_v2.cpp:648: rocBlas error encountered
Traceback (most recent call last):
  File "/home/linuxuser/Documents/ai-voice-cloning/src/webui.py", line 54, in run_generation
    sample, outputs, stats = generate(
  File "/home/linuxuser/Documents/ai-voice-cloning/src/utils.py", line 234, in generate
    gen, additionals = tts.tts(cut_text, **settings )
  File "/home/linuxuser/Documents/ai-voice-cloning/tortoise-tts/tortoise/api.py", line 654, in tts
    mel = do_spectrogram_diffusion(self.diffusion, diffuser, latents, diffusion_conditioning,
  File "/home/linuxuser/Documents/ai-voice-cloning/tortoise-tts/tortoise/api.py", line 172, in do_spectrogram_diffusion
    precomputed_embeddings = diffusion_model.timestep_independent(latents, conditioning_latents, output_seq_len, False)
  File "/home/linuxuser/Documents/ai-voice-cloning/tortoise-tts/tortoise/models/diffusion_decoder.py", line 239, in timestep_independent
    code_emb = self.latent_conditioner(aligned_conditioning)
  File "/home/linuxuser/Documents/ai-voice-cloning/venv/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1194, in _call_impl
    return forward_call(*input, **kwargs)
  File "/home/linuxuser/Documents/ai-voice-cloning/venv/lib/python3.10/site-packages/torch/nn/modules/container.py", line 204, in forward
    input = module(input)
  File "/home/linuxuser/Documents/ai-voice-cloning/venv/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1194, in _call_impl
    return forward_call(*input, **kwargs)
  File "/home/linuxuser/Documents/ai-voice-cloning/venv/lib/python3.10/site-packages/torch/nn/modules/conv.py", line 313, in forward
    return self._conv_forward(input, self.weight, self.bias)
  File "/home/linuxuser/Documents/ai-voice-cloning/venv/lib/python3.10/site-packages/torch/nn/modules/conv.py", line 309, in _conv_forward
    return F.conv1d(input, weight, bias, self.stride,
RuntimeError: miopenStatusInternalError

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/linuxuser/Documents/ai-voice-cloning/venv/lib/python3.10/site-packages/gradio/routes.py", line 384, in run_predict
    output = await app.get_blocks().process_api(
  File "/home/linuxuser/Documents/ai-voice-cloning/venv/lib/python3.10/site-packages/gradio/blocks.py", line 1024, in process_api
    result = await self.call_function(
  File "/home/linuxuser/Documents/ai-voice-cloning/venv/lib/python3.10/site-packages/gradio/blocks.py", line 836, in call_function
    prediction = await anyio.to_thread.run_sync(
  File "/home/linuxuser/Documents/ai-voice-cloning/venv/lib/python3.10/site-packages/anyio/to_thread.py", line 31, in run_sync
    return await get_asynclib().run_sync_in_worker_thread(
  File "/home/linuxuser/Documents/ai-voice-cloning/venv/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 937, in run_sync_in_worker_thread
    return await future
  File "/home/linuxuser/Documents/ai-voice-cloning/venv/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 867, in run
    result = context.run(func, *args)
  File "/home/linuxuser/Documents/ai-voice-cloning/venv/lib/python3.10/site-packages/gradio/helpers.py", line 584, in tracked_fn
    response = fn(*args)
  File "/home/linuxuser/Documents/ai-voice-cloning/src/webui.py", line 83, in run_generation
    raise gr.Error(message)
gradio.exceptions.Error: 'miopenStatusInternalError'

Here's another one with a slightly different final file accessed.

``` MIOpen Error: /MIOpen/src/gemm_v2.cpp:648: rocBlas error encountered Traceback (most recent call last): File "/home/linuxuser/Documents/ai-voice-cloning/src/webui.py", line 54, in run_generation sample, outputs, stats = generate( File "/home/linuxuser/Documents/ai-voice-cloning/src/utils.py", line 234, in generate gen, additionals = tts.tts(cut_text, **settings ) File "/home/linuxuser/Documents/ai-voice-cloning/tortoise-tts/tortoise/api.py", line 654, in tts mel = do_spectrogram_diffusion(self.diffusion, diffuser, latents, diffusion_conditioning, File "/home/linuxuser/Documents/ai-voice-cloning/tortoise-tts/tortoise/api.py", line 172, in do_spectrogram_diffusion precomputed_embeddings = diffusion_model.timestep_independent(latents, conditioning_latents, output_seq_len, False) File "/home/linuxuser/Documents/ai-voice-cloning/tortoise-tts/tortoise/models/diffusion_decoder.py", line 239, in timestep_independent code_emb = self.latent_conditioner(aligned_conditioning) File "/home/linuxuser/Documents/ai-voice-cloning/venv/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1194, in _call_impl return forward_call(*input, **kwargs) File "/home/linuxuser/Documents/ai-voice-cloning/venv/lib/python3.10/site-packages/torch/nn/modules/container.py", line 204, in forward input = module(input) File "/home/linuxuser/Documents/ai-voice-cloning/venv/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1194, in _call_impl return forward_call(*input, **kwargs) File "/home/linuxuser/Documents/ai-voice-cloning/venv/lib/python3.10/site-packages/torch/nn/modules/conv.py", line 313, in forward return self._conv_forward(input, self.weight, self.bias) File "/home/linuxuser/Documents/ai-voice-cloning/venv/lib/python3.10/site-packages/torch/nn/modules/conv.py", line 309, in _conv_forward return F.conv1d(input, weight, bias, self.stride, RuntimeError: miopenStatusInternalError During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/linuxuser/Documents/ai-voice-cloning/venv/lib/python3.10/site-packages/gradio/routes.py", line 384, in run_predict output = await app.get_blocks().process_api( File "/home/linuxuser/Documents/ai-voice-cloning/venv/lib/python3.10/site-packages/gradio/blocks.py", line 1024, in process_api result = await self.call_function( File "/home/linuxuser/Documents/ai-voice-cloning/venv/lib/python3.10/site-packages/gradio/blocks.py", line 836, in call_function prediction = await anyio.to_thread.run_sync( File "/home/linuxuser/Documents/ai-voice-cloning/venv/lib/python3.10/site-packages/anyio/to_thread.py", line 31, in run_sync return await get_asynclib().run_sync_in_worker_thread( File "/home/linuxuser/Documents/ai-voice-cloning/venv/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 937, in run_sync_in_worker_thread return await future File "/home/linuxuser/Documents/ai-voice-cloning/venv/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 867, in run result = context.run(func, *args) File "/home/linuxuser/Documents/ai-voice-cloning/venv/lib/python3.10/site-packages/gradio/helpers.py", line 584, in tracked_fn response = fn(*args) File "/home/linuxuser/Documents/ai-voice-cloning/src/webui.py", line 83, in run_generation raise gr.Error(message) gradio.exceptions.Error: 'miopenStatusInternalError' ``` Here's another one with a slightly different final file accessed.
Owner

mmm

I'm not too sure what would cause ROCm specific errors. Are you using the default model or a finetuned one? I'd imagine a finetuned one might throw some issues, but I wouldn't know.

mmm I'm not too sure what would cause ROCm specific errors. Are you using the default model or a finetuned one? I'd imagine a finetuned one *might* throw some issues, but I wouldn't know.
Author

mmm

I'm not too sure what would cause ROCm specific errors. Are you using the default model or a finetuned one? I'd imagine a finetuned one might throw some issues, but I wouldn't know.

Finetuned model, sorry for getting back so late, I've been on Wangdows doing other stuff.
Seems to be working after updating to the latest version thoughever.

> mmm > > I'm not too sure what would cause ROCm specific errors. Are you using the default model or a finetuned one? I'd imagine a finetuned one *might* throw some issues, but I wouldn't know. Finetuned model, sorry for getting back so late, I've been on Wangdows doing other stuff. Seems to be working after updating to the latest version thoughever.
Owner

Ah, I wonder what specifically caused it. Oh well, it's squashed with time.

Incidentally, I'm cobbling together a dedicated Linux + AMD system to do my GPU workloads on; I have a lead on another training optimization for it (Linux + AMD), so keep an eye and ear out for that in the coming few days.

Ah, I wonder what specifically caused it. Oh well, it's squashed with time. Incidentally, I'm cobbling together a dedicated Linux + AMD system to do my GPU workloads on; I have a lead on another training optimization for it (Linux + AMD), so keep an eye and ear out for that in the coming few days.
mrq closed this issue 2023-03-02 01:06:15 +00:00
Sign in to join this conversation.
No Milestone
No project
No Assignees
2 Participants
Notifications
Due Date
The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference: mrq/ai-voice-cloning#30
No description provided.