Iterated pruning is a light Weight approach to nudging text generation

The few-shot regime enables extreme customization for text generation models. However, another method of nudging such models in a certain direction is by repeatedly pruning generated suggestions and generating more of them. In this iterated pruning approach, the style of the generated items is gently nudged in a user-defined direction, with minimal user intervention. It’s an online feedback mechanism for the model.

Resources

Backlinks