<feed xmlns='http://www.w3.org/2005/Atom'>
<title>TaSTT.git/Scripts, branch v0.20.0</title>
<subtitle>Free self-hosted STT for VRChat.</subtitle>
<id>https://git.yummers.dev/TaSTT.git/atom?h=v0.20.0</id>
<link rel='self' href='https://git.yummers.dev/TaSTT.git/atom?h=v0.20.0'/>
<link rel='alternate' type='text/html' href='https://git.yummers.dev/TaSTT.git/'/>
<updated>2024-07-12T23:10:05+00:00</updated>
<entry>
<title>Another edge case: first commit should not get a leading space</title>
<updated>2024-07-12T23:10:05+00:00</updated>
<author>
<name>yum</name>
<email>yum.food.vr@gmail.com</email>
</author>
<published>2024-07-12T23:10:05+00:00</published>
<link rel='alternate' type='text/html' href='https://git.yummers.dev/TaSTT.git/commit/?id=59578a647c9e259b6eb70cd9bee5428fae2bd0b9'/>
<id>urn:sha1:59578a647c9e259b6eb70cd9bee5428fae2bd0b9</id>
<content type='text'>
</content>
</entry>
<entry>
<title>Edge case: initial preview should not have a space added in front of it</title>
<updated>2024-07-12T23:08:22+00:00</updated>
<author>
<name>yum</name>
<email>yum.food.vr@gmail.com</email>
</author>
<published>2024-07-12T23:08:22+00:00</published>
<link rel='alternate' type='text/html' href='https://git.yummers.dev/TaSTT.git/commit/?id=d7307f8b4d7a8871f08c5999e551b9f58d256c1c'/>
<id>urn:sha1:d7307f8b4d7a8871f08c5999e551b9f58d256c1c</id>
<content type='text'>
God this code is a fucking nightmare
</content>
</entry>
<entry>
<title>Translation shows original language by default</title>
<updated>2024-07-12T22:41:23+00:00</updated>
<author>
<name>yum</name>
<email>yum.food.vr@gmail.com</email>
</author>
<published>2024-07-12T22:41:23+00:00</published>
<link rel='alternate' type='text/html' href='https://git.yummers.dev/TaSTT.git/commit/?id=426d0139273a3112ed18f1b7c39eb75b9278fbe1'/>
<id>urn:sha1:426d0139273a3112ed18f1b7c39eb75b9278fbe1</id>
<content type='text'>
* Add checkbox to disable this feature if so desired.
* Delete old optimization code; can get it back from git if needed.
* Enforce that there's at least one space character ' ' between
  committed segments.
</content>
</entry>
<entry>
<title>Fix translation plugin</title>
<updated>2024-07-12T21:48:36+00:00</updated>
<author>
<name>yum</name>
<email>yum.food.vr@gmail.com</email>
</author>
<published>2024-07-12T21:48:36+00:00</published>
<link rel='alternate' type='text/html' href='https://git.yummers.dev/TaSTT.git/commit/?id=75069522ffc8863a356d95e509c81612a3703458'/>
<id>urn:sha1:75069522ffc8863a356d95e509c81612a3703458</id>
<content type='text'>
Translation needs torch to convert the nllb model, but the latest
version (2.3.1) has an embedded OMP dll which clashes with ctranslate2's
dll. Using the last minor version instead (2.2.2) doesn't clash.

Also propagate the device, quantization, and flash attention settings
to the translator. If you're using GPU, this is a HUUUUGE performance
uplift. Translation is basically instant. The bigger models are now
feasible to use.
</content>
</entry>
<entry>
<title>Bump CUDNN to v8.9.7</title>
<updated>2024-06-09T23:43:34+00:00</updated>
<author>
<name>yum</name>
<email>yum.food.vr@gmail.com</email>
</author>
<published>2024-06-09T23:43:34+00:00</published>
<link rel='alternate' type='text/html' href='https://git.yummers.dev/TaSTT.git/commit/?id=4fec36c3cc00bd649dfb3c9d7e9079b5c8685a0e'/>
<id>urn:sha1:4fec36c3cc00bd649dfb3c9d7e9079b5c8685a0e</id>
<content type='text'>
Also disable flash-attention when CPU mode is selected
</content>
</entry>
<entry>
<title>Add checkbox for flash-attention</title>
<updated>2024-06-09T22:54:30+00:00</updated>
<author>
<name>yum</name>
<email>yum.food.vr@gmail.com</email>
</author>
<published>2024-06-09T22:54:30+00:00</published>
<link rel='alternate' type='text/html' href='https://git.yummers.dev/TaSTT.git/commit/?id=f2b21dd5afebd6b76b5835168f7d1bd3bec21f5d'/>
<id>urn:sha1:f2b21dd5afebd6b76b5835168f7d1bd3bec21f5d</id>
<content type='text'>
Pre-3000 series GPUs don't support it. Oops!
</content>
</entry>
<entry>
<title>Upgrade faster-whisper with flash-attention2</title>
<updated>2024-06-06T01:15:47+00:00</updated>
<author>
<name>yum</name>
<email>yum.food.vr@gmail.com</email>
</author>
<published>2024-06-06T01:15:47+00:00</published>
<link rel='alternate' type='text/html' href='https://git.yummers.dev/TaSTT.git/commit/?id=4f0fb5b17de990517e3c1de7ffee5d0f3c9a8961'/>
<id>urn:sha1:4f0fb5b17de990517e3c1de7ffee5d0f3c9a8961</id>
<content type='text'>
This should be significantly more efficient than prior versions.

* add large-v3 &amp; distilled variant
* simplify model acquisition code now that distilled models are part of
  faster-whisper.
</content>
</entry>
<entry>
<title>Fix distilled models</title>
<updated>2024-03-15T01:03:54+00:00</updated>
<author>
<name>yum</name>
<email>yum.food.vr@gmail.com</email>
</author>
<published>2024-03-15T01:03:54+00:00</published>
<link rel='alternate' type='text/html' href='https://git.yummers.dev/TaSTT.git/commit/?id=5638d86c97041de31217e058e411034143e9c882'/>
<id>urn:sha1:5638d86c97041de31217e058e411034143e9c882</id>
<content type='text'>
These were broken due to some logic errors in the codepath which
acquires models from huggingface.

Distilled large-v2 seems promising as a new default model.
</content>
</entry>
<entry>
<title>Add "simple" text-to-text demo for the modular avatar chatbox</title>
<updated>2024-03-09T02:21:22+00:00</updated>
<author>
<name>yum</name>
<email>yum.food.vr@gmail.com</email>
</author>
<published>2024-03-09T02:21:22+00:00</published>
<link rel='alternate' type='text/html' href='https://git.yummers.dev/TaSTT.git/commit/?id=cdc079fb59832fce46708df36ac80ede6d2bd046'/>
<id>urn:sha1:cdc079fb59832fce46708df36ac80ede6d2bd046</id>
<content type='text'>
To use it:
$ python3 -m pip install python-osc pillow
$ cd Scripts
$ python3 ./text_to_text_demo.py
</content>
</entry>
<entry>
<title>Finish plumbing GPU compute type</title>
<updated>2024-02-10T01:51:53+00:00</updated>
<author>
<name>yum</name>
<email>yum.food.vr@gmail.com</email>
</author>
<published>2024-02-10T01:51:53+00:00</published>
<link rel='alternate' type='text/html' href='https://git.yummers.dev/TaSTT.git/commit/?id=5ef207d28f2a9d943384b9ec6872aedae2917ac0'/>
<id>urn:sha1:5ef207d28f2a9d943384b9ec6872aedae2917ac0</id>
<content type='text'>
</content>
</entry>
</feed>
