TaSTT.git/Scripts, branch v0.19.1

Bump CUDNN to v8.9.7

2024-06-09T23:43:34+00:00

Also disable flash-attention when CPU mode is selected

Add checkbox for flash-attention

2024-06-09T22:54:30+00:00

Pre-3000 series GPUs don't support it. Oops!

Upgrade faster-whisper with flash-attention2

2024-06-06T01:15:47+00:00

This should be significantly more efficient than prior versions. * add large-v3 & distilled variant * simplify model acquisition code now that distilled models are part of faster-whisper.

Fix distilled models

2024-03-15T01:03:54+00:00

These were broken due to some logic errors in the codepath which acquires models from huggingface. Distilled large-v2 seems promising as a new default model.

Add "simple" text-to-text demo for the modular avatar chatbox

2024-03-09T02:21:22+00:00

To use it: $ python3 -m pip install python-osc pillow $ cd Scripts $ python3 ./text_to_text_demo.py

Finish plumbing GPU compute type

2024-02-10T01:51:53+00:00

Add dropdown for GPU compute type

2024-02-10T01:21:46+00:00

Should enable compatibility with older GPUs.

Add another threshold to filter out common hallucinations

2024-02-06T01:40:37+00:00

The paper recommends filtering out segments with no_speech_prob > 0.6 and avg_logprob < -1. This is too loose of a bound for short-form audio which is not guaranteed to contain speech. I already have a tighter bound: no_speech > 0.6 and avg_logprob < -0.5 While listening to instrumental music I find that a lot of hallucinations sneak past that bound. So I added a second bound: no_speech > 0.15 and avg_logprob < -0.7 Basically we filter out things that look like speech but have a worse avg_logprob. Seems to not have false negatives. Requires testing. Also: dial back the default max segment length from 15 seconds to 10 seconds. This is done based on performance observations in desktop.

Verify that audio is clean after VAD segmentation

2024-02-06T01:02:23+00:00

Indeed it is. Bumped up the default max segment length to decrease error. Also add mic presets for beyond (the vr headset) and motu (my mic interface).

Revert "Begin experimenting with flash-attention"

2024-01-09T02:59:27+00:00

This reverts commit 921b92a69f36502dc5eefd14ba3487c1bb49bb9d.