Transformer-VAE Convert a T5 model into a variational autoencoder for text. I have already made a project that does this in PyTorch but its never been trained at scale. This project is to convert the autoencoder into Flax so it can be trained efficiently on a TPU to train the largest ever Transfo…

Train a VAE to interpolate on English sentences

Fraser June 28, 2021, 5:57pm 4

Topic		Replies	Views
Train the best ever transformer-VAE Flax/JAX Projects	15	6302	August 26, 2021
How does huggingface T5 flax pretraining script handles very long sentences? 🤗Transformers	0	304	May 4, 2022
Generate answer to a query starting from Decoder Embeddings 🤗Transformers	0	143	February 1, 2024
How to use T5 for AutoEncoder tasks? Beginners	0	550	August 29, 2022
How do I construct a function to inference? Flax/JAX Projects	0	1184	September 13, 2022