diff options
| author | yum <yum.food.vr@gmail.com> | 2023-02-27 18:03:02 -0800 |
|---|---|---|
| committer | yum <yum.food.vr@gmail.com> | 2023-02-27 18:03:02 -0800 |
| commit | 4f967dbdb7972ec52039bd3e3ce3e1e4cbcf6545 (patch) | |
| tree | 158cf93f6ec626f32b961acc6d791bd2a2040b94 /ComLightLib | |
| parent | 1136acfc365f357d2df13a263714e8ae0614c4f9 (diff) | |
Begin work on beam search decoding
* ContextImpl.h puts prompts, previous prompts, probabilities, and
probability IDs into vectors of size 1 or N_BEAMS, depending on
the decoding strategy.
* Extend sampleBest and friends to return top N tokens, instead of
just the top 1 token.
Diffstat (limited to 'ComLightLib')
0 files changed, 0 insertions, 0 deletions