I am considering a PEFT method for summarization. While LoRA is wildly popular, IA3 seems more efficient. I was wondering if there is a benchmark that objectively compares IA3 to LoRA. The results in IA3 paper are rather limited in that they provide results only on a few tasks with smaller models. Please point me to any resource that would be helpful in understanding this better. Thank you
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| PEFT fine-tuning as slow as full model fine-tuning | 3 | 1615 | December 6, 2023 | |
| Minimize number of transformers checkpoints for serving muliple client | 3 | 381 | March 9, 2023 | |
| QA based summarization and summary evaluation | 0 | 317 | November 9, 2023 | |
| Leveraging pre-trained checkpoints for summarization | 33 | 3167 | November 25, 2022 | |
| Llama 2 7B fine-tuned with IA3 errors when performing inference | 2 | 647 | January 16, 2024 |