New York Site views —Page views —
← All series

Getting started with LLM APIs

Make a first call, tune parameters and handle streaming, retries and rate limits.

Reading order

  1. Making your first language-model API call
  2. Choosing temperature, max_tokens and top_p
  3. Building a streaming command-line chat interface
  4. Retries, rate limits and graceful degradation for API failures