Tag

API

2 entries tagged API · 2 terms.

Dictionary

Default Model

The model that a chat product silently serves to users who have not specified one, rotating beneath them without notice as providers update their infrastructure.

Inference Tiering

The practice of routing AI API requests to different speed and cost tiers, paying less for work that can tolerate slower response times.