yum-archive/TaSTT-Whisper
High-performance GPGPU inference of OpenAI's Whisper automatic speech recognition (ASR) model
git clone https://git.yummers.dev/yum-archive/TaSTT-Whisper
8c4603c
master
1This project compiles all the compute shaders which implement the model. 2 3Many shaders come in 2 versions, something.hlsl and something64.hlsl 4 5The version with the `64` suffix is used on AMD GPUs, the version without suffix is used on nVidia and Intel GPUs. 6 7Not all of these shaders are actually used for anything. 8Some of them are implementing binary compatibility for the reference CPU version, and not used unless messing with the `constexpr` flags in MlContext C++ class. 9Such shaders often require FP64 support, which is an optional feature in D3D11. 10CompressShaders tool detects such shaders by looking at the SFI0 chunk in the binary, and outputs a bitmap of the FP64 shaders. 11This way, missing FP64 hardware support shouldn’t break the library.