Hi,
Can you please provide a more extensive reproducer as you’re not calling the pipeline in the snippet above. I also see a warning regarding Flash Attention which might explain the differences.
Hi,
Can you please provide a more extensive reproducer as you’re not calling the pipeline in the snippet above. I also see a warning regarding Flash Attention which might explain the differences.