Hi,
I used your GitHub code for finetune the T5 for text generation.
I have a issue of partially generating the output.
I don’t know why the output is cropped.
For example this is the generated text:
“< pad > Kasun has 7 books and gave Nimal 2 of the books. How many book did Ka”
This is the full output.
-
This is not the full sentence and not end with < /s > token.
-
Output are maximum 17 words. Giving model.generate( . . . , min_length=30 ) is also not solved this issue.
-
only small amount of word contains sentence are giving full output sentence
Parameters I used:
max_src_len = 200
max_tgt_len = 512
Is that cause because of a parameter value which I pass to tokenizer or decoder?