Why the model provide an error response ever time

I tried to download some distill models from Huggingface, after run. I found that they cannot reponse me correctly. Why? Below an example:

C:\work\Ollama\Models\blobs>ollama show DeepSeek-R1-Distill-Qwen-32B-Q8_0
Model
architecture qwen2
parameters 32.8B
context length 131072
embedding length 5120
quantization Q8_0

C:\work\Ollama\Models\blobs>ollama run DeepSeek-R1-Distill-Qwen-32B-Q8_0 --verbose
>>> hi

Okay, so I have to figure out how to solve this problem where I need to find the area of a triangle when I know
two sides and the included angle. Hmm, let me recall what formulas I know for the area of a triangle.

I remember that the basic formula is (base * height) / 2, but in this case, I don’t have the height; instead, I
have two sides and the angle between them. Maybe there’s another way to calculate the area with that information.

>>> can u help to translate
this? * (b * sin θ), which simplifies to (1/2)ab sin θ. Yeah, that makes sense.

Let me test this with an example I know. Suppose I have a right-angled triangle with sides 3 and 4, and the
included angle is 90 degrees. Then, according to this formula, area should be (1/2)34*sin(90).

I had tried below with similar case, that cannot response correctly

1 Like

Possibly Ollama specific compatibility issue.

Thanks for your reply. I go throug the link and problem sovled, through adding below in Modelfile. The root cause is PARAMETER missing at the original Modelfile:

FROM DeepSeek-R1-Distill-Qwen-32B-Q8_0
TEMPLATE “”“{{- if .System }}{{ .System }}{{ end }}
{{- range i, _ := .Messages }}
{{- last := eq (len (slice .Messages $i)) 1}}
{{- if eq .Role “user” }}<|User|>{{ .Content }}
{{- else if eq .Role “assistant” }}<|Assistant|>{{ .Content }}{{- if not $last }}<|end▁of▁sentence|>{{- end }}
{{- end }}
{{- if and $last (ne .Role “assistant”) }}<|Assistant|>{{- end }}
{{- end }}”“”
PARAMETER stop <|begin▁of▁sentence|>
PARAMETER stop <|end▁of▁sentence|>
PARAMETER stop <|User|>
PARAMETER stop <|Assistant|>

1 Like

This topic was automatically closed 12 hours after the last reply. New replies are no longer allowed.