Setting Up a Generative Text Model on Ubuntu Terminal

Beginners
1

I’m eager to set up a Generative text model on my Ubuntu terminal, following this guide. Since ChatGPT isn’t free, I’m exploring open-source alternatives to run locally on my PC.

Objective:
Primarily, I’ll seek Linux terminal-based assistance directly within the terminal itself and also address minor bugs in code.

System Specifications:

  • **Memory:** 16GiB System memory

  • **Processor:** Intel(R) Core(TM) i7-10750H CPU @ 2.60GHz

  • **Storage:** addlink M.2 PCIE G3x4 NVMe

  • **GPU:** GTX 1660 (Not set up for Ubuntu)

Display Details:

  1. NVIDIA Corporation TU117M:
  •     Description: VGA compatible controller

  •     Version: a1

  •     Width: 64 bits

  •     Clock: 33MHz

  •     Driver: nouveau
  1. Intel Corporation CometLake-H GT2 [UHD Graphics]:
  •    Description: VGA compatible controller

  •    Version: 05

  •    Width: 64 bits

  •    Clock: 33MHz

  •    Depth: 32

  •    Driver: i915

  •    Resolution: 1920x1080

Available Space:
I have approximately 10 - 15GB of space available on my machine for running this model.

Recommendations Needed:
What open-source models would you recommend for this purpose?