Good afternoon everybody. I’ve run into a problem connected with deploying my xxx.safetensors model(.bin also if necessary) to the kotlin app. Please advice solutions if anyone has encountered this. Maybe docker or converting file to .tflite or .pkl. The model is T5-base for seq2seq generation
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| How to Export a LLM as a .bin instead of Safetensors | 0 | 954 | December 1, 2023 | |
| Convert safetensors to TFlite | 2 | 768 | January 22, 2025 | |
| How convert the .bin files into .safetensors files? | 1 | 2666 | October 12, 2023 | |
| Unable to deploy Falcon 40b OASST1 model into SageMaker TGI container | 0 | 433 | July 29, 2023 | |
| How to convert the cached models back to one file format so that it can be used later and with other tools like ComfyUI | 0 | 339 | January 9, 2024 |