Hi, there! I am trying to get the embeddings from pre-trained wav2vec2 models (e.g., from jonatasgrosman/wav2vec2-large-xlsr-53-german) using my own dataset. My aim is to use these features for a downstream task (not specifically speech recognition). Namely, since the dataset is relatively small, …

Getting embeddings from wav2vec2 models

sriniu March 28, 2023, 8:58am 2

Hi, Thank you for posting this question. Were you successful to get the hidden states or embeddings from Wav2Vec2 model?

Topic		Replies	Views
Get last embedding layer from wav2vec Beginners	0	131	February 22, 2024
Single embedding from single wav file for wav2vec models? Beginners	0	518	September 29, 2023
Get output embedding of FeatureExtractor 🤗Transformers	1	705	April 20, 2021
How to extract embeddings in Wav2Vec2? Beginners	0	433	April 29, 2022
Wav2vec2 Acces Feature Layers Performance 🤗Transformers	1	456	May 7, 2025