Error in finetuning File "/app/env/bin/accelerate"


I was trying to finetune a llm model but while loading the shards i am encountring the above error and all the process of downloading the model starts again.

File “/app/env/bin/accelerate” , line 8, in sys.exit (main ())
File “/app/env/lib/python3.10/site-packages/accelerate/commands/accelerate_clipy”,line 47, in
main args. func (args)
File “/app/env/lib/python3.10/site-packages/accelerate/commands/launch.py”, line 1017, in
launch_command simple_launcher (args)
File “/app/env/lib/python3.10/site-packages/accelerate/commands/launch.py”, line 637, in
simple_launcher raise subprocess. CalledProcessError (returncode=process.returncode,
cmd=cmd) subprocess. CalledProcessError: Command ‘[’/app/env/bin/python’, "-m’.
‘autotrain.trainers.cIm’, ‘–training_config’, ‘/tmp/model/training_params.json’]’ died with <Signals.SIGKILL:

memory error. need bigger gpu