yum-archive/TaSTT-Whisper

High-performance GPGPU inference of OpenAI's Whisper automatic speech recognition (ASR) model

git clone https://git.yummers.dev/yum-archive/TaSTT-Whisper

KonstantinSource codes8c4603c

master
759 B11 linesraw
1This project compiles all the compute shaders which implement the model.
2
3Many shaders come in 2 versions, something.hlsl and something64.hlsl
4
5The version with the `64` suffix is used on AMD GPUs, the version without suffix is used on nVidia and Intel GPUs.
6
7Not all of these shaders are actually used for anything.
8Some of them are implementing binary compatibility for the reference CPU version, and not used unless messing with the `constexpr` flags in MlContext C++ class.
9Such shaders often require FP64 support, which is an optional feature in D3D11.
10CompressShaders tool detects such shaders by looking at the SFI0 chunk in the binary, and outputs a bitmap of the FP64 shaders.
11This way, missing FP64 hardware support shouldn’t break the library.