Ensemble Learning with various BERT models

I’m not sure about using the Trainer API. You could just build your own Decision Tree with the trained models This might help Multi-Model-Endpoint tutorial on Sagemaker.