Guides
Glossary: Tokens, Context Windows, Cached Input, Streaming and Base URLs
Plain-language definitions of the LLM API terms on pricing pages and in SDK docs, with a worked cost example and the mistake each term commonly causes.
7 min read
Tutorials
Stream Tokens to a Browser with Server-Sent Events (Node and Python)
Relay a streaming LLM response from your server to the browser over SSE, keep the API key server-side, stop billing when the tab closes. Node and Python code.
8 min read
Blog
Streaming vs Non-Streaming LLM Responses: Timeouts, UX and SSE in Python and Node
Why long non-streaming LLM requests time out, how streaming improves perceived speed, and working SSE code for Python and Node in OpenAI and Anthropic formats.
8 min read