Can anyone show me an example of using a DataCollator using native pytorch? I want to use it in a setting where I don’t want to be constrained by having to use it in a trainer class.
Related topics
Topic | Replies | Views | Activity | |
---|---|---|---|---|
Early stop with Trainer API under Pytorch | 0 | 388 | July 16, 2021 | |
Extra Dimension with DataCollatorFor LanguageModeling into BertForMaskedLM? | 7 | 2002 | January 16, 2024 | |
Training General Pytorch model with HuggingFace's Trainer | 0 | 372 | May 7, 2023 | |
How to use Dataset with Pytorch Lightning | 1 | 4076 | April 13, 2021 | |
Are there Pytorch Lighting wrappers for the most popular models? | 0 | 96 | March 28, 2024 |