Hugging Face Forums
What are the equivalent manner for using texts_to_sequences?
🤗Tokenizers
toyl
December 29, 2021, 11:19pm
1
what are the equivalent manner for using
seq = tokenizer.texts_to_sequences([desc])[0]
in bert
Related Topics
Topic
Replies
Views
Activity
All my sequences get tokenized the same
🤗Tokenizers
2
526
February 12, 2022
Combine multiple sentences together during tokenization
🤗Tokenizers
3
4972
February 4, 2022
Tokenizer decoding using BERT, RoBERTa, XLNet, GPT2
Beginners
7
5146
September 21, 2020
Custom Tokenizing?
🤗Tokenizers
0
79
March 19, 2024
Train tokenizer for seq2seq model
🤗Tokenizers
0
22
April 19, 2024