Hi, i am first of all political analist, and person with basic knowledge about AI.
I want to experiment with finetuning medium size AI model (for example Llama 3.3 70B) for political analysis and strategising. I plan to obtain Nvidia DGX Spark with 128G (or 2 devices with 256G) of memory for experimentation.
Have couple of question for the start:
- Foremost - should finetuning (LORAX) be used as such in this case with aim to finetune different adaptors on different functions (analysis, scenarios-building, strategising, risk assessment etc.) and orchestrate their cooperation - or good context engineering will do the job?
- What models of medium size are best suited for political analysis and strategising?
- Will some smaller model (around 30B) be strong enough for this delicate and nuanced reasoning?
- Where to find datasets or just cases in the field of strategising/analysis/scenario-building etc?
- Do you know some similar researches?
Thank you, would really appreciate some assistance.