yum-archive/TaSTT-Whisper

High-performance GPGPU inference of OpenAI's Whisper automatic speech recognition (ASR) model

git clone https://git.yummers.dev/yum-archive/TaSTT-Whisper

KonstantinSource codes8c4603c

master
574 B9 linesraw
1This project builds a C++ console tool which compares debug traces of the model.
2
3Tracing files easily exceed 1GB, and by default they’re disabled with a preprocessor macro in stdafx.h of the Whisper project.
4
5When enabled, the main GPU implementation saves a trace into C:\Temp\2remove\Whisper\gpu.bin
6
7The reference CPU implementation saves a trace into C:\Temp\2remove\Whisper\ref.bin
8
9This code in this project is optimized for development speed. For this reason it requires AVX2 CPU, uses memory-mapped IO instead of proper parsing, and checks little to no errors.