yum-archive/TaSTT-Whisper
High-performance GPGPU inference of OpenAI's Whisper automatic speech recognition (ASR) model
git clone https://git.yummers.dev/yum-archive/TaSTT-Whisper
8c4603c
master
1This project builds a C++ console tool which compares debug traces of the model. 2 3Tracing files easily exceed 1GB, and by default they’re disabled with a preprocessor macro in stdafx.h of the Whisper project. 4 5When enabled, the main GPU implementation saves a trace into C:\Temp\2remove\Whisper\gpu.bin 6 7The reference CPU implementation saves a trace into C:\Temp\2remove\Whisper\ref.bin 8 9This code in this project is optimized for development speed. For this reason it requires AVX2 CPU, uses memory-mapped IO instead of proper parsing, and checks little to no errors.