[Nov 15th Event] Thomas Wolf: Transfer Learning and the birth of the Transformers library

Course
1

Use this topic to ask your questions to Thomas Wolf during his talk: Transfer Learning and the birth of the Transformers library

You can watch it on YouTube or on Twitch at 8am PST

Slides

1 Like
2

This is an example of test question. You can test the like button below.

3 Likes
3

Hello I have a question!

2 Likes
4

What are the best ways to do transfer learning on huge models? And what are the best ways to pick metrics for NLP models?

1 Like
5

Is Huggingface gradually becoming commercial from open source, there are many parts of API that are for paid now, e.g., model training, please help me understand the portion of open source vs paid.

1 Like
6

Is this presentation document going to be shared? Thanks!

7

Is this presentation document going to be shared? Thanks!

Yes, the slides will be shared after the talk :slight_smile:

3 Likes
8

Is there a systematic way to estimate how many annotated samples will be required to train a custom model (let’s say NER) by finetuning an existing model?

2 Likes
9

What does Thomas use to build/train models? notebooks? vscode? vim? other???

2 Likes
10

How did the name HuggingFace and the use of :hugs: come about?

2 Likes
11

This is answered at 17:15 on the main stream.

2 Likes
12

When explaining the reasons for the main revolution in 2018, you pointed out two separate points: (1) transfer learning and (2) transformers for increased efficiency. Does that mean that there is not inherent link between transfer learning and transformers? Transformers are only/mostly used because they are very efficient?

13

Will the video/recording also be shared later? (It is becoming late here…)

14

The same YouTube link for streaming will have the video I believe :slight_smile:

2 Likes
15

Will the video/recording also be shared later? (It is becoming late here…)

The live stream can be viewed at any time on YouTube, and we will also edit to share each talk in a separate YouTube video :slight_smile:

4 Likes
16

What about using Graph Neural networks (GNN) in NLP tasks? Graph structures could capture data with complex structures and relationships and GNN provide the opportunity to study and model complex data representation for NLP tasks…

4 Likes
17

looking into reply for gnn

18

Interesting! Looking into this reply

19

can you tell us about the distributed training efforts taken by the hf community?

20

What about using Graph Neural networks (GNN) in NLP tasks? Graph structures could capture data with complex structures and relationships and GNN provide the opportunity to study and model complex data representation for NLP tasks…

This is answered at 41:00 of the main stream.