Transformer-VAE Convert a T5 model into a variational autoencoder for text. I have already made a project that does this in PyTorch but its never been trained at scale. This project is to convert the autoencoder into Flax so it can be trained efficiently on a TPU to train the largest ever Transfo…

Train a VAE to interpolate on English sentences

Fraser June 28, 2021, 5:57pm 4

Topic		Replies	Views
Train the best ever transformer-VAE Flax/JAX Projects	15	6913	August 26, 2021
PreTrain T5 for Italian 🇮🇹 Flax/JAX Projects	3	610	July 7, 2021
Building an variational autoencoder with transformers Beginners	1	697	March 17, 2024
How does huggingface T5 flax pretraining script handles very long sentences? 🤗Transformers	0	360	May 4, 2022
Fine-tuning sentence-transformer for retrieval task makes things worse Beginners	0	1692	July 25, 2023