Free self-hosted STT for VRChat. https://git.yummers.dev/TaSTT.git/atom?h=v0.7.0 2023-02-19T20:10:13+00:00 2023-02-19T20:10:13+00:00 yum yum.food.vr@gmail.com 2023-02-19T19:46:43+00:00 urn:sha1:52f743e43a9ef582e04d7a363fbda19824db6cc7 Allows sustained exponential backoff when not transcribing. Used to cap out at 1s. * Add more items to README TODO list * Adjust emote metadata * Emotes bugfix: Non-existent emote map doesn't cause transcription engine to bail out. 2023-02-13T22:36:25+00:00 yum yum.food.vr@gmail.com 2023-02-03T02:00:18+00:00 urn:sha1:1cb5bdfe8cba6fe4647448cd3cf0c63ecbd7dfc2 Emotes require 2 bytes per char. They're encoded into the region [0xE000, infinity). The texture is 4k, and uses 1k vertical pixels per emote segment, for a maximum of 32 segments. * Reduce volume of noise indicator by 90%. Quiet is probably better. Might want to add a volume slider idk. * Bugfix: emotes without a transparency channel now work * Address a couple Unity performance complaints about the shader 2023-02-13T22:36:20+00:00 yum yum.food.vr@gmail.com 2023-02-02T09:02:03+00:00 urn:sha1:7c6894614dcc3ebc5d4c8839b64f4da761b5ccf0 Done: * Users can add images to Fonts/Emotes/ * The basename of that image ('clueless.png' becomes 'clueless') is the keyword to make the image show up in game. * Fix a bug in the shader where letters on the 2nd texture and later would have UV outside of [0.0, 1.0] Not yet implemented: * transcribed words are encoded using emotes mapping 2023-02-04T23:26:41+00:00 yum yum.food.vr@gmail.com 2023-02-04T21:16:37+00:00 urn:sha1:92fea304613bacfa014e1fbaf9fddb82e4f33d62 * Reduce noise on/off indicator volume by 50% 2023-01-25T20:38:28+00:00 yum yum.food.vr@gmail.com 2023-01-25T20:38:28+00:00 urn:sha1:227ff7aa0ed2fd03c54ae53aa01430012ff3f7d0 We use a button to start/stop transcription. Previously this was hardcoded to left joystick. Now users can pick from {left, right} x {joystick, a, b}. 2023-01-22T23:35:00+00:00 yum yum.food.vr@gmail.com 2023-01-22T23:05:54+00:00 urn:sha1:1c056bf385d2c48f6e4f77da513060c04415252c VRChat exposes a built-in chatbox which can be seen by anyone who has it enabled. This was not the case when I started this project: the chatbox would only be visible to friends. Since this is clearly useful, enabling the STT on public models, let's enable sending data to it. Caveats: * The built-in chatbox has anti-spam tech which limits us to updating about once every 2 seconds. The custom chatbox has no such limitation and is thus typically much faster. 2023-01-04T18:03:39+00:00 yum yum.food.vr@gmail.com 2023-01-04T17:52:02+00:00 urn:sha1:66d311b3267620995e5c35b16f3fba18ed0c48f3 Previously, paths containing spaces would be interpreted by python's argument parser as multiple separate arguments, causing it to fail. Now we escape paths inside PythonWrapper using std::quoted(). * Improve PII filtering. Python output would contain multiple path separators (like C:\\Users\\foo\\), defeating the PII regex. * Silence compiler warning in PII filter. * Document usability improvements. * Transcription layer exponential backoff goes to ~infinity when paused. This is a hack, since we really don't need to transcribe at all when paused, but it lets us keep the code simple. Good enough until the next rewrite. * Shader only samples background when necessary. * Limit matchStrings() print()s to DEBUG mode 2023-01-02T05:45:56+00:00 yum yum.food.vr@gmail.com 2023-01-02T05:09:32+00:00 urn:sha1:6bed3a15edf134fa176ca4866b4346017bc97ada * Expose option to run transcription engine on CPU instead of GPU * Use embedded git when setting up the Python virtual environment 2022-12-30T10:33:07+00:00 yum yum.food.vr@gmail.com 2022-12-30T10:25:50+00:00 urn:sha1:d9a0224466189d0fe1d46f21d586fa8a1a58c687 Boards whose size is an even multiple of CHARS_PER_SYNC would lose the entire last region. * Attempt to fix runaway memory usage of GUI text frames, but this needs more work 2022-12-30T09:35:11+00:00 yum yum.food.vr@gmail.com 2022-12-30T09:35:11+00:00 urn:sha1:9a7190a04bbe6feba2abe4a1590eb8114c04f683 Users can pick longer transcription durations for accuracy-critical tasks, or shorter durations for latency-critical tasks.