Installation on Windows

I’m trying to figure out how to create a local installation on Win11. I got NodeJS up and running, went to the repo at GitHub - bigcode-project/starcoder: Home of StarCoder: fine-tuning & inference! and started following the Quick Start. I successfully installed the requirements from requirements.txt, and then got stuck.

I don’t know what to do with the following:

from transformers import AutoModelForCausalLM, AutoTokenizer

checkpoint = "bigcode/starcoder"
device = "cuda" # for GPU usage or "cpu" for CPU usage


It looks like it should be in a file somewhere, it doesn’t work in a Windows power shell. Are there any instructions either for Windows or that walk you through this in a way that someone not familiar with this code can understand? I work in a C style language and all this looks like some kind of scripting to me, but I really don’t know.


That is Python code you need to put into a file or paste and run with the Python interpreter.