yum-archive/TaSTT-Whisper

High-performance GPGPU inference of OpenAI's Whisper automatic speech recognition (ASR) model

git clone https://git.yummers.dev/yum-archive/TaSTT-Whisper

yumFix audio normalization5929750

master
13 files

files

CommandLineArgs.cpp964 B
CommandLineArgs.h141 B
Readme.txt574 B
TraceReader.cpp1.2 KiB
TraceReader.h778 B
compare.cpp10.0 KiB
compare.h101 B
compareTraces.cpp282 B
compareTraces.vcxproj4.7 KiB
compareTraces.vcxproj.filters684 B
stdafx.cpp541 B
stdafx.h898 B
testUtils.cpp5.8 KiB
This project builds a C++ console tool which compares debug traces of the model.

Tracing files easily exceed 1GB, and by default they’re disabled with a preprocessor macro in stdafx.h of the Whisper project.

When enabled, the main GPU implementation saves a trace into C:\Temp\2remove\Whisper\gpu.bin

The reference CPU implementation saves a trace into C:\Temp\2remove\Whisper\ref.bin

This code in this project is optimized for development speed. For this reason it requires AVX2 CPU, uses memory-mapped IO instead of proper parsing, and checks little to no errors.