yum-archive/TaSTT-Whisper

High-performance GPGPU inference of OpenAI's Whisper automatic speech recognition (ASR) model

git clone https://git.yummers.dev/yum-archive/TaSTT-Whisper

yumFix audio normalization5929750

master
11 folders13 files

files

API/
CPU/
D3D/
Hybrid/
MF/
ML/
Utils/
Whisper/
WhisperCLI/
source/
source.compat/
DllMain.cpp707 B
Readme.txt525 B
Resource.rc5.1 KiB
Whisper.vcxproj17.8 KiB
Whisper.vcxproj.filters9.9 KiB
misc.natvis2.6 KiB
modelFactory.cpp731 B
modelFactory.h304 B
resource.h388 B
stdafx.cpp19 B
stdafx.h1.6 KiB
whisper.def153 B
whisperCom.cpp37.4 KiB
This C++ project builds a DLL which actually does the heavy lifting of this project.

It implements the ML model, handles multimedia files with Media Foundation, captures audio (also with MF), does voice activity detection (custom code running on CPU), and a few smaller things.

The code requires C++/20, and only tested with Visual Studio 2022.

When running pure GPGPU model, the DLL requires SSE 4.1 instruction set.

When running a hybrid model, the DLL requires AVX1, FMA3, F16C, and BMI1 instruction set extensions.