Are there any docs or notebooks that show how to train GPT2 from scratch with a custom text corpus?
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| Continue pre-training GPT2 | 1 | 579 | March 10, 2025 | |
| Fine tune the text generation with gpt2 | 2 | 435 | February 22, 2023 | |
| How to pretrain randomized language model with custom dataset | 0 | 63 | May 15, 2024 | |
| How to train gpt-2 from scratch? (no fine-tuning) | 17 | 18626 | December 14, 2022 | |
| Train GPT2 on wikitext from scratch | 5 | 3765 | October 25, 2021 |