Hi, I have a dataset that consists of images, their captions (they are scientific figures) and some excerpts from the paper main text that references the figure. The goal of this is to for a given figure and its caption, can we understand the figure (the text in the paper). This is different from a…

Multimodal training

celalp March 21, 2025, 3:21pm 4

Oh wow thank @John6666 for the detailed answers. I will check the models and references out.

1 Like