Hi All, I ran the all the steps of this notebook and I am getting error . RuntimeError: mat1 and mat2 shapes cannot be multiplied (4096x5120 and 1x2560) philschmid/huggingface-llama-2-samples/blob/master/training/sagemaker-notebook.ipynb { "cells": [ { "attachments": {}, …

LLama2 Finetuning giving Error mat1 and mat2 shapes cannot be multiplied (4096x5120 and 1x2560)

philschmid July 20, 2023, 1:38pm 7

Also I am able to replicate this in Jupyter notebook . But using SFT Trainer I am able to train .

able to train with 13B model?

1 Like