Decoding strategies for text generation and their use-cases

Decoding strategies for text generation
Free stock image from Canva by Author

If you have worked with text generation models you would have encountered several decoding strategies like Greedy Search, Beam Search, Diverse beam search, Topk Sampling, TopP sampling, TopKP sampling.

--

--

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store