yum-archive/TaSTT-Whisper
High-performance GPGPU inference of OpenAI's Whisper automatic speech recognition (ASR) model
git clone https://git.yummers.dev/yum-archive/TaSTT-Whisper
5929750
master
files
| CommandLineArgs.cpp | 964 B |
| CommandLineArgs.h | 141 B |
| Readme.txt | 574 B |
| TraceReader.cpp | 1.2 KiB |
| TraceReader.h | 778 B |
| compare.cpp | 10.0 KiB |
| compare.h | 101 B |
| compareTraces.cpp | 282 B |
| compareTraces.vcxproj | 4.7 KiB |
| compareTraces.vcxproj.filters | 684 B |
| stdafx.cpp | 541 B |
| stdafx.h | 898 B |
| testUtils.cpp | 5.8 KiB |
This project builds a C++ console tool which compares debug traces of the model. Tracing files easily exceed 1GB, and by default they’re disabled with a preprocessor macro in stdafx.h of the Whisper project. When enabled, the main GPU implementation saves a trace into C:\Temp\2remove\Whisper\gpu.bin The reference CPU implementation saves a trace into C:\Temp\2remove\Whisper\ref.bin This code in this project is optimized for development speed. For this reason it requires AVX2 CPU, uses memory-mapped IO instead of proper parsing, and checks little to no errors.