summaryrefslogtreecommitdiffstats
path: root/libunity.py
diff options
context:
space:
mode:
authoryum <yum.food.vr@gmail.com>2022-10-03 21:57:51 -0700
committeryum <yum.food.vr@gmail.com>2022-10-03 21:57:51 -0700
commit2fd5771ae4c8b7774b859422eb00216af07ef4fa (patch)
tree0b44b0f4736309836e103d38819082f5ee747c05 /libunity.py
parentd4556af258ae3911c83ece4b817335e8c5a2a2d2 (diff)
Introduce STT proof-of-concept
Using OpenAI's whisper neural network, we can do local STT. Translation quality is good, system resource usage is minimal (1 GB VRAM), latency is much lower than cloud-based translation. * Add transcribe.py * Creates 3 threads: * One saves mic audio to a buffer * One passes mic audio to the STT * One sends the transcribed text to the board * Main thread listens for input. Press enter to start a new message. * Add osc_ctrl.sendMessageLazy, a simple diff-based message sending utility. * A little complexity: it only sends 1 empty cell per call, allowing us to quickly say new things without having to wait for the whole buffer to clear.
Diffstat (limited to 'libunity.py')
0 files changed, 0 insertions, 0 deletions