After some brainstorming, we came with the following project ideas. Would love some feedback/opinion on the same. ViT + mBART - Multilingual Image Captioning (WIT pre-train) ViT + mBERT - Multilingual Visual Question Answering (WIT/COCO pre-train, test on VQA/GQA) Use CLIP/VQGAN for Image Synthesi…

Vision-Language Project Ideas

Vaibhavbrkn June 25, 2021, 1:26pm 2

@gchhablani very interesting ideas, I have experience in CV and NLP and would like to contribute in this project.

1 Like

Topic		Replies	Views
Multilingual Visual Question Answering Flax/JAX Projects	8	913	July 2, 2021
Multilingual Image Captioning Flax/JAX Projects	10	1300	July 6, 2021
CLIP like contrastive vision-language models for German with pre-traind text and vision models Flax/JAX Projects	5	1842	July 4, 2021
CLIP like contrastive vision-language models for Spanish with pre-trained text and vision models Flax/JAX Projects	4	400	June 29, 2021
Image captioning for Spanish with pre-trained vision and text model Flax/JAX Projects	13	2512	July 19, 2021