hi @kintaro,
run_generation.py
is used for auto-regressive generation which uses sampling.
no_repeat_ngram_size
is used for beam search so run_generation.py
doesn’t have that attribute since it only uses sampling for generation
hi @kintaro,
run_generation.py
is used for auto-regressive generation which uses sampling.
no_repeat_ngram_size
is used for beam search so run_generation.py
doesn’t have that attribute since it only uses sampling for generation