Hi, I would like to deploy a Qwen2.5-coder 32b model and access it using ottodev (Bolt fork). This needs a URL for the model that the IDE will use to access it. Also I would want to setup a ModelFile to specify an increased context window size. Does anyone know if this is possible?
1 Like