About the Flax/JAX Projects category

[sgugger]

This category should be used to propose and join existing projects that make use of :jax: Flax/JAX and Transformers. Make sure that your project proposal includes all relevant information (as listed below) for people to join/comment/improve your idea.

Feel free to also post any questions you might have about Transformers flax examples. If you found issues in one of the flax examples, please submit an issue to the transformers repo instead.

Relevant information when proposing a :jax:/ project:

• Description: What is the project about? E.g. Train a CLIP model in Swedish for zero-shot image classification.
• Model: What model do you propose to use? E.g. openai/clip-vit-base-patch32 · Hugging Face in Flax/JAX
• Dataset: What dataset do you want to use? E.g. GitHub - google-research-datasets/wit: WIT (Wikipedia-based Image Text) Dataset is a large multimodal multilingual dataset comprising 37M+ image-text sets with 11M+ unique images across 100+ languages.
• Training scripts: What training scripts do you want to use? E.g. Training scripts will be created as part of the project
• Expected result: What do you expect the outcome of the project to be? E.g. A zero-shot image classification pipeline for CLIP

[skylord]

Hi - I wanted to propose a project. But the submitted projects are really interesting. Is it possible to join more than one ?

[valhalla]

Yes, you can join multiple projects!

[hugbump]

Just noticed this category, which has quite many topics already. Wow.
A stupid question, I see in README of JAX/Flax Examples:

“This folder contains actively maintained examples of Transformers using the JAX/Flax backend. Porting models and examples to JAX/Flax is an ongoing effort … In particular, these examples are all designed to run fast on Cloud TPUs, and we include step-by-step guides to getting started with Cloud TPU.”

I heard of JAX/Flax before in an nlp coursera class. My understanding is that it is a backend different from tensorflow or pytorch, but why making a big deal out of porting to JAX/Flax? What difference does it bring? I guess the difference and gain must be really big to worth the porting. Thank you very much!