I’m trying to figure out how to create a local installation on Win11. I got NodeJS up and running, went to the repo at GitHub - bigcode-project/starcoder: Home of StarCoder: fine-tuning & inference! and started following the Quick Start. I successfully installed the requirements from requirements.txt, and then got stuck.
I don’t know what to do with the following:
from transformers import AutoModelForCausalLM, AutoTokenizer
checkpoint = "bigcode/starcoder"
device = "cuda" # for GPU usage or "cpu" for CPU usage
...
It looks like it should be in a file somewhere, it doesn’t work in a Windows power shell. Are there any instructions either for Windows or that walk you through this in a way that someone not familiar with this code can understand? I work in a C style language and all this looks like some kind of scripting to me, but I really don’t know.
Thanks