|
About the DeepSpeed category
|
|
1
|
350
|
October 30, 2021
|
|
Does anyone have working code for training T5-11B on multi-gpu?
|
|
2
|
62
|
January 18, 2023
|
|
Manual pipeline parallelization with DeepSpeed
|
|
0
|
87
|
January 7, 2023
|
|
Setup for Deepspeed Multi GPU Training
|
|
2
|
534
|
December 7, 2022
|
|
Overflow when using DeepSpeed for GPT-J (training aborts)
|
|
1
|
842
|
December 5, 2022
|
|
[Maybe Bug] When using EarlyStopping Callbacks with Seq2SeqTraininer, training didn't stop
|
|
2
|
183
|
November 16, 2022
|
|
Questions about deepspeed multi-node training with sharding parameters inside a single 8-gpu machine
|
|
0
|
134
|
October 21, 2022
|
|
Is really Trainer class support TPU for faster training?
|
|
2
|
138
|
October 2, 2022
|
|
Issues with using DeepSpeed on multiple GPUs
|
|
2
|
255
|
September 9, 2022
|
|
What should I do if I want to use model from DeepSpeed
|
|
4
|
674
|
September 8, 2022
|
|
Fine-tuning a 16B CodeGen model with 256GB RAM+2xA6000s?
|
|
1
|
259
|
September 1, 2022
|
|
How to load T0pp into 40Gb of GPU memory using mixed precisoin?
|
|
2
|
464
|
July 21, 2022
|
|
The same hyperparameters with deepspeed is worse than without deepseepd
|
|
1
|
139
|
July 18, 2022
|
|
Memory efficiency when using softprompts
|
|
0
|
209
|
May 15, 2022
|
|
Issues with building extensions in Deepspeed
|
|
7
|
1741
|
May 14, 2022
|
|
Default param values for sacrebleu
|
|
0
|
171
|
May 5, 2022
|
|
Constantly running out of memory fine-tuning Wav2Vec2
|
|
1
|
590
|
April 28, 2022
|
|
Difference between accelerate/torch_distributed/deepspeed
|
|
0
|
327
|
April 25, 2022
|
|
Batch size in trainer eval loop
|
|
3
|
1210
|
April 22, 2022
|
|
`run_translation.py` example is erroring out with the recommended settings
|
|
1
|
401
|
April 4, 2022
|
|
Infrence time increase when using multi-GPU
|
|
0
|
232
|
April 1, 2022
|
|
Fnet with upper case
|
|
0
|
176
|
March 15, 2022
|
|
Is there a why to use all gpus while using pipeline with zero-shot classifer?
|
|
0
|
295
|
December 31, 2021
|
|
How to do that trained huggingface model speech recognation?
|
|
0
|
270
|
December 10, 2021
|
|
RAG Gradient Checking support
|
|
0
|
253
|
December 8, 2021
|
|
Is Int8 quantization training possible while using deepspeed?
|
|
0
|
300
|
December 1, 2021
|
|
Deepspeed ZeRO Inference
|
|
1
|
885
|
November 24, 2021
|
|
ValueError fp16 lm_head.weight
|
|
1
|
352
|
October 24, 2021
|
|
Issues saving and loading wav2vec2 models fine tuned using Deepspeed
|
|
0
|
674
|
October 22, 2021
|
|
How DeepSpeed interacts with Trainer optimizer
|
|
1
|
364
|
October 13, 2021
|