mrq/ai-voice-cloning
31
74
Fork 43
Code Issues 223 Pull Requests 5 Packages Projects Releases Wiki Activity

Using TPUs in Google Colab? #365

New Issue
Open
opened 2023-09-02 03:42:13 +00:00 by helloitsme · 2 comments
helloitsme commented 2023-09-02 03:42:13 +00:00
Copy Link

Is anyone using TPUs in Google Colab? If so, how can you do so? I'm assuming there might be different libraries that have to be installed, since simply selecting TPU runtime doesn't work. It would significantly speed up training and inference time. Thanks

Is anyone using TPUs in Google Colab? If so, how can you do so? I'm assuming there might be different libraries that have to be installed, since simply selecting TPU runtime doesn't work. It would significantly speed up training and inference time. Thanks
RahulBhalley commented 2023-10-15 12:32:54 +00:00
Copy Link

I used Kaggle last time i used TPU. Google how to setup TPU in Kaggle. Then you’ll have to modify this repo code to use XLA device from PyTorch to run your code on TPU. Better choice is using PyTorch Lightning library and automatically using TPU.

I used Kaggle last time i used TPU. Google how to setup TPU in Kaggle. Then you’ll have to modify this repo code to use XLA device from PyTorch to run your code on TPU. Better choice is using PyTorch Lightning library and automatically using TPU.
RahulBhalley commented 2023-10-15 12:34:30 +00:00
Copy Link

Btw TPU memory footprint is notorious. I trained EfficientNet on P100 (16 GB) successfully but on TPU I had to significantly reduce the batch size.

Btw TPU memory footprint is notorious. I trained EfficientNet on P100 (16 GB) successfully but on TPU I had to significantly reduce the batch size.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels   
bug

Something is not working

  
duplicate

This issue or pull request already exists

  
enhancement

New feature

  
help wanted

Need some help

  
insufficient info

Need more information

  
invalid

Something is wrong

  
news

To make up for a lack of a way to provide any news-like

  
not a bug

For non-bug things

  
question

More information is needed

  
wontfix

This won't be fixed

No Label
bug
duplicate
enhancement
help wanted
insufficient info
invalid
news
not a bug
question
wontfix
Milestone
Clear milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
No Assignees
2 Participants
Notifications
Due Date
The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference: mrq/ai-voice-cloning#365
No description provided.
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?