Compatible Steamer with Beam Search

🀗Transformers
1

Currently, Streamer cannot work with Beam search as you will get an error: “ValueError: streamer cannot be used with Beam search (yet!). Make sure that num_beams is set to 1.”

Any workaround? I can build my own streamer if necessary. Thanks for your help!

2

I am also searching for a solution to stream with beam search, is there any work around?