We’re planning to use ViT encoder, mBART decoder and train them end-to-end for image captioning in different languages. Model Pre-trained ViT , mBART (will be merged soon) can be leveraged for our task. Datasets Currently we’re thinking of using WIT . COCO dataset can also be used but it has capti…

Multilingual Image Captioning

tejas2811 July 6, 2021, 12:01pm 11

I would like to work on this Project too.

Topic		Replies	Views
Image captioning for Indonesia with pre-trained vision Flax/JAX Projects	4	486	June 29, 2021
Image captioning for French with pre-trained vision and text model Flax/JAX Projects	6	2159	January 4, 2022
Multilingual Visual Question Answering Flax/JAX Projects	8	905	July 2, 2021
Image captioning for Japanese with pre-trained vision and text model Flax/JAX Projects	0	1170	June 23, 2021
Image captioning for Spanish with pre-trained vision and text model Flax/JAX Projects	13	2486	July 19, 2021