summaryrefslogtreecommitdiffstats
path: root/Designs
Commit message (Collapse)AuthorAge
* Begin work on beam search decodingyum2023-02-27
* ContextImpl.h puts prompts, previous prompts, probabilities, and probability IDs into vectors of size 1 or N_BEAMS, depending on the decoding strategy. * Extend sampleBest and friends to return top N tokens, instead of just the top 1 token.