Wav2vec2 for long audiofiles

Beginners
1

Hi,

I’m trying to apply wave2vec2 models on long audiofiles (~1h) for speech to text.
However processing the entire audio file at once is not feasible because it requires more than 16GB. How can I import a sound file as audio stream into the wave2vec models?

1 Like
2

Here is one way to do this with librosa.stream:

https://github.com/huggingface/transformers/issues/10366#issuecomment-786780983

3 Likes
3

This should actually now be extremely easy with the new chunking feature.

This blog post should help: Making automatic speech recognition work on large files with Wav2Vec2 in 🤗 Transformers

2 Likes