Implement pygmalion-6B in an app

Hi, I am very new on Hugging Face.
So far I have been playing a little bit with the Inference API.

I would like to use the pygmalion-6B model, and implement it in a mobile app.

Would anyone be able to tell me if it is possible to implement it? And if so, give me some advice on how to do it and where to start figuring it out?

Yes, this is possible. You have two options.

You would either need to self-host the model and write an inferencing API that is called from your app or pay a company to host and inference the model and integrate their API into your app.

Since you are asking this question, I doubt option 1 will be the route you take. Pricing - GooseAI I’ve never used GooseAI, but I’ve heard good things about them. Use their documents and pricing as references.

image