Tutorials
Stream Tokens to a Browser with Server-Sent Events (Node and Python)
Relay a streaming LLM response from your server to the browser over SSE, keep the API key server-side, stop billing when the tab closes. Node and Python code.
8 min read
Blog
Streaming vs Non-Streaming LLM Responses: Timeouts, UX and SSE in Python and Node
Why long non-streaming LLM requests time out, how streaming improves perceived speed, and working SSE code for Python and Node in OpenAI and Anthropic formats.
8 min read