Loading...
Streaming API Reference
The server hosts an OpenAI-compatible endpoint at `/v1/chat/completions`. Use the snippets below to execute streaming calls from external scripts:
cURL
Python
JavaScript
Loading snippet...
Inference Settings
Temperature
0.2
Max Completion Tokens
1024
System Prompt