How to deploy a tar.gz model file?

I have a fine tuned 7B llama 2 model from a colleague in the form of this file format:

ft-110e70e2-3d71-4259-813f-d46f122e4ce5-2023-08-15-13-35-20.tar.zst

how can i deploy this model for inference now?

Thanks

1 Like