Newb here! I can run the 8b model ok but having problems with 70b. Am i spinning my wheels here ? PC with 7950x, 7900xtx, 64gb ram, 4 tb storage after loading and 25 minute wait time then terminating, I am using lmstudio…am i just not able to run it? System inadequate??
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| Help Needed: Installing Llama 2 70B, Llama 3 70B & LLaMA 2 30B (FP16) on Windows Locally | 1 | 426 | June 3, 2024 | |
| Llama 3 70b not among the list of models | 5 | 289 | June 4, 2024 | |
| Llama 2 70B on a cpu | 2 | 6788 | August 23, 2023 | |
| Issue in Model Loading | 0 | 55 | September 4, 2024 | |
| AI disappointment: Why Llama 3.2 (3b version) loses out to Chat-GPT - An analysis of the limitations of Llama 3.2 (3b version) compared to Chat-GPT | 5 | 2457 | December 12, 2024 |