Free self-hosted STT for VRChat. https://git.yummers.dev/TaSTT.git/atom?h=v0.4.0 2023-01-26T06:40:22+00:00 2023-01-26T06:40:22+00:00 yum yum.food.vr@gmail.com 2023-01-26T05:55:31+00:00 urn:sha1:e5da172a85368551954332836e52d2c98b37edec TaSTT shader now uses physically based rendering (PBR). Users can pick smoothness, metallic, and emissive. This implementation borrows heavily from catlikecoding.com's excellent tutorials, which are released under MIT No Attribution (MIT-0). https://catlikecoding.com/unity/tutorials/license/ To retain what little clarity remains in the shader, I have chosen not to attribute the code in the source itself. 2023-01-25T20:38:28+00:00 yum yum.food.vr@gmail.com 2023-01-25T20:38:28+00:00 urn:sha1:227ff7aa0ed2fd03c54ae53aa01430012ff3f7d0 We use a button to start/stop transcription. Previously this was hardcoded to left joystick. Now users can pick from {left, right} x {joystick, a, b}. 2023-01-25T19:45:22+00:00 yum yum.food.vr@gmail.com 2023-01-25T19:34:01+00:00 urn:sha1:b61b57eca9746078d3694cc4f9c047b776f7f9f8 This seems to be the canonical way of listing a Python app's dependencies. * Installing dependencies no longer hangs the GUI 2023-01-23T22:55:36+00:00 yum yum.food.vr@gmail.com 2023-01-23T22:55:36+00:00 urn:sha1:2bfee587d306402708221f2390fb02dedff6caea Whisper doesn't like 0.18.3, so downgrade to the last version. 2023-01-23T22:32:09+00:00 yum yum.food.vr@gmail.com 2023-01-23T22:28:53+00:00 urn:sha1:9fff496394dcd94c4084694ca96a5e07ab836274 Don't literally check in Python since it looks dodgy (rightfully so). Instead the build script just fetches it. * Update README, simplifying language and documenting other projects 2023-01-23T00:40:04+00:00 yum yum.food.vr@gmail.com 2023-01-23T00:40:04+00:00 urn:sha1:9329d64f991b8b3289af22e4c2eedb09a97c5640 2023-01-22T23:35:00+00:00 yum yum.food.vr@gmail.com 2023-01-22T23:05:54+00:00 urn:sha1:1c056bf385d2c48f6e4f77da513060c04415252c VRChat exposes a built-in chatbox which can be seen by anyone who has it enabled. This was not the case when I started this project: the chatbox would only be visible to friends. Since this is clearly useful, enabling the STT on public models, let's enable sending data to it. Caveats: * The built-in chatbox has anti-spam tech which limits us to updating about once every 2 seconds. The custom chatbox has no such limitation and is thus typically much faster. 2023-01-22T23:28:12+00:00 yum yum.food.vr@gmail.com 2023-01-22T23:28:12+00:00 urn:sha1:06160c37acb26cfac9bab568bd3759c2386fb175 I found that I tend to regenerate the animator on the same avatar a lot, requiring me to re-enter the same paths and parameters over and over again. Persist them across restarts. * Refactor Config classes * Use safe `get_if` instead of the exception-throwing `operator>>` when deserializing from YAML * Begin sketching out Log singleton * Put Quote() and Unquote() into their own little lib; they shouldn't hide inside PythonApp 2023-01-06T20:31:13+00:00 yum yum.food.vr@gmail.com 2023-01-06T20:31:13+00:00 urn:sha1:461714cc87549f3c0c3411bfe95f3936aca60f74 The configuration of the transcription app, such as the number of rows and columns in the text box, now persists across app restarts. I found that I would have to change from the defaults to my preferred config every time I started up in VR, which was annoying. Now we just start with the config that was set last time. * Add dependency on rapidyaml (MIT) * Serialize transcription config to file under Resources/ * Add Config class to wrap serializing/deserializing * Update build instructions * Simplify StartApp() API, taking Config struct instead of a ton of arguments 2023-01-04T18:03:39+00:00 yum yum.food.vr@gmail.com 2023-01-04T17:52:02+00:00 urn:sha1:66d311b3267620995e5c35b16f3fba18ed0c48f3 Previously, paths containing spaces would be interpreted by python's argument parser as multiple separate arguments, causing it to fail. Now we escape paths inside PythonWrapper using std::quoted(). * Improve PII filtering. Python output would contain multiple path separators (like C:\\Users\\foo\\), defeating the PII regex. * Silence compiler warning in PII filter. * Document usability improvements. * Transcription layer exponential backoff goes to ~infinity when paused. This is a hack, since we really don't need to transcribe at all when paused, but it lets us keep the code simple. Good enough until the next rewrite. * Shader only samples background when necessary. * Limit matchStrings() print()s to DEBUG mode