Active Learning code example

🤗Transformers
1

I am looking for an example code implementing supervised training with active learning for sentence classification using large transformer models such as meta-llama/Llama-2-7b-chat-hf.

I tried using the small-text library but it does not support large transformer model sizes. Unfortunately, small-text was not able to load and perform distributed training of large models.

Please let me know of any good code examples or good libraries which implement active learning with large transformers models.

2

https://github.com/NielsRogge/Transformers-Tutorials/blob/master/BERT/Fine_tuning_BERT_(and_friends)_for_multi_label_text_classification.ipynb https://huggingface.co/docs/transformers/main/en/model_doc/llama2#transformers.LlamaForSequenceClassification Hugging Face has sequence classification models that can be used interactively by adding user input into the fine-tuning.