Hugging Face Forums
How do I send system prompts using inference api serverless, llama3 8b instruct model
Beginners
marcoguerrap
April 28, 2024, 3:38pm
2
Hey I found this post that helped me:
show post in topic
Related Topics
Topic
Replies
Views
Activity
How to add a system prompt on HF Inference API for Llama 8B Instruct?
Beginners
0
86
April 25, 2024
Sending System and User Prompt in Deployed endpoint
Beginners
3
480
November 17, 2023
Formatting Inference API call for LLama 2
Inference Endpoints on the Hub
3
7726
November 23, 2023
Inference Model with API and Integrate to LM (Language Model)
🤗Transformers
0
509
June 7, 2022
Truncated un-finished response after deploying hugging-face models
Amazon SageMaker
0
246
January 19, 2024