Hello. I want to train my VLM using a large-scale image dataset with the Huggingface trainer. I initially planned to follow the method suggested by HuggingFace4M , which involves embedding PIL images within arrow files. However, I found this approach problematic when dealing with datasets like DocSt…

Handling Large-Scale Image Dataset

Ryoo72 February 9, 2025, 4:39am 5

Oh, that’s an actually great idea.

1 Like