Finetuning AI for politacl analysis nd strategising

Research
1

Hi, i am first of all political analist, and person with basic knowledge about AI.
I want to experiment with finetuning medium size AI model (for example Llama 3.3 70B) for politacl analysis and strategising. I plan to obtain Nvidia DGX Spark with 128G (or 2 devices with 256G) of memory for experimentation.
Have couple of question for the start:
-what models of medium size are best suited for politacl analysis and strategising?

  • Will some smaller model (around 30B) be strong enough for this delicate and nuanced reasoning?
  • Where to find datasets or just cases in the field of strategising/analysis/scenario-building etc?
  • Do you know some similar researches?
    Thank you, would really appreciate some assistance.
1 Like
2

If you don’t require human-like responses, a model with around 12B might work. Models known for their reasoning abilities tend to be around 32B in size, so that size range might also be a good choice. However, if resources allow, larger models will offer higher performance.

There seems to be a lot of data sets (inside, outside HF), but it will be quite difficult to organize them…