Validation Loss for VITMAE

I’ve started using VITMAE, adapting code from the script run_mae.py.

I’m unable to get any validation loss - in spite of setting evaluation_strategy=epoch and providing an evaluation set to the trainer. I get Validation Loss: “No log” for all epochs. Specifying compute_metrics() results in an exception related to tensors

I’m wondering if this is because the trainer expects labels for evaluation, and the model doesn’t provide them during pre-training. Is there a workaround other than a custom training loop?

Thanks!