Free self-hosted STT for VRChat. https://git.yummers.dev/TaSTT.git/atom?h=v0.0 2022-12-22T21:47:40+00:00 2022-12-22T21:47:40+00:00 yum yum.food.vr@gmail.com 2022-12-22T21:47:40+00:00 urn:sha1:9c6b3c43ddecca315cdba11ebd14f6926527fa8b 2022-12-01T21:39:49+00:00 yum yum.food.vr@gmail.com 2022-12-01T21:39:49+00:00 urn:sha1:f9bcee6acf6f8a418d2f96368941fc05e4b72252 Also decrease sync params & add a few more emotes. 2022-11-15T05:36:13+00:00 yum yum.food.vr@gmail.com 2022-11-15T05:30:50+00:00 urn:sha1:2505a5cc486cd913db50a475e45c3701b9710282 After re-reading the paper, I noticed that they apply a couple optimizations I wasn't using. Use the top-level `whisper.transcribe` method, which is a little slower, but more accurate than the one I was using. Although this method is slower, it has better temporal stability due to the increased quality, which I think should make for an overall more responsive UX. Lower transcription quality means the paging layer has to waste time updating earlier cells. Also, drop the auto-commit stuff and go back to string stitching. I think it's better to let the user manually commit. A rework of the hand controls is probably coming soon. Finally, update README. 2022-11-07T05:22:54+00:00 yum yum.food.vr@gmail.com 2022-11-07T05:22:54+00:00 urn:sha1:629c0f611de1622131bb0fa364c170219f6252ed 2022-11-06T20:50:38+00:00 yum yum.food.vr@gmail.com 2022-11-06T20:50:38+00:00 urn:sha1:7146acb9d4ad751fc5ced411a2990d0aad17d08f Add a `matchStrings` which does basically the same thing as `matchStringList` except it doesn't split the input at space boundaries. I think this should work better for Japanese and Chinese, since they don't use spaces. Doesn't seem to cause any accuracy regressions for English. Also update the README. 2022-11-05T19:14:12+00:00 yum yum.food.vr@gmail.com 2022-11-05T19:11:15+00:00 urn:sha1:7f930340e3aa94d6aca120d28436594427469373 Instead of generating one animation for every single character in our character set, we just generate 2: the lowest and the highest. We use blend trees to interpolate between these two extremes. This reduces the number of animations we have to generate by a factor of 80. It also clears the way for multi-language support (coming soon). It also means we don't have to reopen unity every time we generate a new animator. 2022-11-04T07:20:25+00:00 yum yum.food.vr@gmail.com 2022-11-04T07:20:25+00:00 urn:sha1:ca10de9a5cb2a9b360bc0cd2c357f8d0041f0fca 2022-10-30T22:33:38+00:00 yum yum.food.vr@gmail.com 2022-10-30T22:33:38+00:00 urn:sha1:0357119769154dbbfa77d317e6b575c9c337584f 2022-10-25T06:13:47+00:00 yum yum.food.vr@gmail.com 2022-10-25T06:08:11+00:00 urn:sha1:0102b725f60c91ca6d095c2b04de71db6d5b1fda While the board is clearing, you can keep talking, and it will be rendered when the board finishes clearing. * bugfix: STT only beeps when it's out 2022-10-17T05:36:56+00:00 yum yum.food.vr@gmail.com 2022-10-17T05:36:56+00:00 urn:sha1:6eb03b1e369286a3e0417b3229f50f00f5760e8a