TaSTT.git/Scripts, branch v0.8.1

Bugfix: C++ transcription engine should not launch OSC layer

2023-02-27T00:24:10+00:00

Not ready yet.

Begin work on C++ custom chatbox

2023-02-26T22:27:22+00:00

Sort of a misnomer. The idea is to use C++ for transcription and Python for steamvr and OSC. Having issues getting output from multithreaded Python code. Not in the mood to figure this out today. * Hide unimplemented parts of C++ panel.

Revert "Apply previous window conditioning to decoding layer"

2023-02-23T05:54:39+00:00

This reverts commit cece1ee8f1b985c2a89adb661dd02c6d44787f67. This does *not* in fact result in improved temporal stability. It makes makes things so unstable that even single-sentence messages fail to ever stabilize.

Begin work on C++ implementation

2023-02-23T05:49:29+00:00

Use Const-me/Whisper to perform transcription. This implementation is vastly more efficient: CPU usage, memory usage, and VRAM usage are all dramatically reduced. It's slightly less accurate when comparing the same model (due to the lack of beam search decoding), but since you can use larger models, the impact is largely a wash.

Apply previous window conditioning to decoding layer

2023-02-23T05:49:22+00:00

Per the Whisper source code, this should result in better temporal stability.

Remove exponential backoff cap

2023-02-19T20:10:13+00:00

Allows sustained exponential backoff when not transcribing. Used to cap out at 1s. * Add more items to README TODO list * Adjust emote metadata * Emotes bugfix: Non-existent emote map doesn't cause transcription engine to bail out.

Add hack to reduce outlines around emotes

2023-02-13T22:36:59+00:00

Don't render any part of an emote with alpha < 0.5. Improves visual clarity in the common case at the cost of generality. * Emotes now use physically-based shading. * Use round() to denoise shader parameters instead of floor()

Finish emotes

2023-02-13T22:36:25+00:00

Emotes require 2 bytes per char. They're encoded into the region [0xE000, infinity). The texture is 4k, and uses 1k vertical pixels per emote segment, for a maximum of 32 segments. * Reduce volume of noise indicator by 90%. Quiet is probably better. Might want to add a volume slider idk. * Bugfix: emotes without a transparency channel now work * Address a couple Unity performance complaints about the shader

Begin work adding emotes

2023-02-13T22:36:20+00:00

Done: * Users can add images to Fonts/Emotes/ * The basename of that image ('clueless.png' becomes 'clueless') is the keyword to make the image show up in game. * Fix a bug in the shader where letters on the 2nd texture and later would have UV outside of [0.0, 1.0] Not yet implemented: * transcribed words are encoded using emotes mapping

Built-in chatbox no longer shows empty messages

2023-02-04T23:26:41+00:00

* Reduce noise on/off indicator volume by 50%