Skip to main content
Set stream: true to receive server-sent events. The OpenAI SDK parses events for you.

Chat completion stream

The gateway requests include_usage: true for all chat streams, even when the caller omits it or sets it to false. A usage chunk can have an empty choices array. Always check that a choice exists before reading its delta. At the wire level, events are data: {JSON} records separated by a blank line. Chat streams normally terminate with data: [DONE]. Network chunks do not necessarily align with event boundaries; use the SDK or a proper SSE parser.

DeepSeek reasoning deltas

With reasoning_effort: "high" (or another supported thinking level), DeepSeek sends reasoning in choices[0].delta.reasoning_content and the answer in choices[0].delta.content. Append each to a separate display. A chunk may contain only one of these fields, and reasoning can arrive before answer text. Both count toward the output-token budget. The Playground displays these separately and retains received partial content after Stop. See reasoning for JSON responses and conversation replay.

Responses stream

The Responses endpoint emits typed events. See stateless Responses for a complete example. Do not parse Responses events as chat choices chunks.

Handle interruption

When the gateway observes your client disconnect, it cancels generation. The backend may already have processed part of it. Test cancellation through your deployed client and proxy path: closing the local stream alone does not prove that the disconnect reached the gateway.
  • A final usage event may be absent after interruption. Missing token counts remain unknown in Activity.
  • HTTP 200 indicates that a stream started; it does not prove the full generation completed.
  • A failed stream can retain partial text. Decide whether your application should display, discard, or label it.
  • Do not replay a partial request automatically without considering duplicate generation and charges.
For an observed customer Stop/disconnect, confirmed final usage is charged normally. If final usage is unavailable, the gateway makes no customer charge and leaves the token counts unknown. Unknown usage from timeouts, service failures or platform shutdown can still require reconciliation. See billing. DeepSeek does not estimate a charge from the number of streamed events: final reported usage is charged; an observed cancellation without final usage has no customer charge. Closing a client does not guarantee that the engine stops immediately or that a request with reported usage is free. The streaming examples use the official OpenAI streaming interface. Limitless endpoint coverage is described in compatibility.

Messages and the console Playground

The Messages endpoint streams native Anthropic events. Its event names and content-block structure differ from Chat and Responses; use the matching SDK. The console Playground displays answer text and supported model reasoning as they arrive. Stop cancels the browser request and asks the backend to stop generation. Text already received stays visible and is marked as stopped or incomplete. Once the gateway observes the cancellation, it charges final reported usage or makes no customer charge if final usage is unavailable. Generation may take time to stop. Review Activity for the recorded outcome and Billing for the settled charge. Response policies can delay visible output while evaluation runs. This may make a policy-protected request look less incremental even though the client requested streaming.