High-performance GPGPU inference of OpenAI's Whisper automatic speech recognition (ASR) model https://git.yummers.dev/TaSTT-Whisper.git/atom?h=master 2023-02-28T02:03:02+00:00 2023-02-28T02:03:02+00:00 yum yum.food.vr@gmail.com 2023-02-28T02:03:02+00:00 urn:sha1:4f967dbdb7972ec52039bd3e3ce3e1e4cbcf6545 * ContextImpl.h puts prompts, previous prompts, probabilities, and probability IDs into vectors of size 1 or N_BEAMS, depending on the decoding strategy. * Extend sampleBest and friends to return top N tokens, instead of just the top 1 token.