Bounty: replicate a plattform like heygen

Looking for someone to help building a simular plattfrom like heygen…
translating videos into other languages with lipsync video.
our research suggested to :
transscript with whisper →
translate with deepl →
modify audio with bark with learned audio model →
lipsync modify mp4 with new mp3(or wav) → still missing
merge mp3 and mp4 with ffmpeg

any suggestions ? lets discuss how big the bounty should be… to be noticed :slight_smile: 1k ? 2k ? 10k … offers are welcome

Hi,

I’d be happy to help you build a similar platform to Heygen.

Your approach looks solid, using Whisper for transcription, DeepL for translation, and Bark for audio modification. And of course, FFmpeg is a great tool for merging the audio and video.

I’m confident I can help you bring this project to life.

You can reach out to me on my email here

Colin