Commit Graph

10 Commits

Author SHA1 Message Date
Brett Kuprel ed91ab4a30 refactored to load models once and run multiple times 2022-06-29 09:42:12 -04:00
Adam Novak 28c812c832 Use all logical cores in Torch mode 2022-06-28 22:26:51 -04:00
Brett Kuprel 1fbb209623 fixed bug with cuda in detokenizer 2022-06-28 22:02:35 -04:00
Brett Kuprel 764b0bc685 cuda in detokenizer from previous commit broke colab flax model, fixed 2022-06-28 21:36:48 -04:00
Brett Kuprel 17c96fe110 works with cuda 2022-06-28 21:28:36 -04:00
Brett Kuprel 9d6b6dcc92 previous commit broke flax model, fixed now 2022-06-28 12:54:58 -04:00
Brett Kuprel 5aa6fe49bf use cuda if available 2022-06-28 12:47:11 -04:00
Brett Kuprel 8544f59576 use cuda if available 2022-06-28 12:38:31 -04:00
Brett Kuprel aef24ea157 torch.no_grad(), cleanup 2022-06-28 12:16:44 -04:00
Brett Kuprel e7001f063c simplified 2022-06-27 15:46:04 -04:00