Question: Extracting information from sensitive data using lightweight LLM models in R

Beginners
1

I am trying to use lightweight LLM models in R to extract information from sensitive patient data locally on my computer. However, I am having some difficulty getting started. I am very comfortable with programming in R so I would prefer if this is possible, if not I will take this as a learning opportunity to learn another programming language.

I wonder if anyone else has experience using lightweight LLM models in R to extract information from sensitive data. If so, I would appreciate any help you can provide.

Specifically, I am interested in the following:

  • Which lightweight LLM models are available in R?
  • Are there any specific tips or tricks for using lightweight LLM models to analyze sensitive data?

Thank you for your time and consideration.

2

Hey! Have you done some work on this? I am dealing with the same issue!

3

Hi.
I think the best solution is install the models locally.
I’m watching videos by Matthew Berman. He has quite a few tutorials on this.
I have tested it yet, but it looks like the most promising route.