Now that there is official support for tgi in CohereForAI/c4ai-command-r-v01. How to use the chat template found in the tokenizer config for the ui. Or alternatively, is it possible to add in PROMPTS.md the correct template for cohere?
Related topics
Topic | Replies | Views | Activity | |
---|---|---|---|---|
Questions about Mistral and apply_chat_template with Text Generation Inference, openai API and messages API | 0 | 160 | May 15, 2024 | |
Multiple chat templates | 0 | 204 | June 20, 2024 | |
Model not replying | 1 | 215 | May 27, 2024 | |
Llama2 prompt template for finetuning on text summaraization/generation | 0 | 309 | March 20, 2024 | |
Alpaca prompt template for HuggingFace Chat Space | 0 | 1410 | April 10, 2024 |