Hi, there! I am trying to get the embeddings from pre-trained wav2vec2 models (e.g., from jonatasgrosman/wav2vec2-large-xlsr-53-german) using my own dataset. My aim is to use these features for a downstream task (not specifically speech recognition). Namely, since the dataset is relatively small, …

Getting embeddings from wav2vec2 models

synapse October 20, 2023, 9:27am 3

Hi, yes. The way I described in the post was indeed the correct way for getting the embeddings.

Topic		Replies	Views
Get last embedding layer from wav2vec Beginners	0	131	February 22, 2024
Single embedding from single wav file for wav2vec models? Beginners	0	518	September 29, 2023
Get output embedding of FeatureExtractor 🤗Transformers	1	705	April 20, 2021
How to extract embeddings in Wav2Vec2? Beginners	0	433	April 29, 2022
Wav2vec2 Acces Feature Layers Performance 🤗Transformers	1	456	May 7, 2025