Tag
Inference
4 entries tagged Inference · 4 terms.
Dictionary
Adaptive Thinking
An inference behavior where a frontier model self-scales its reasoning depth and tool-use budget to match the complexity of the prompt, without the operator flipping a manual extended-thinking or test-time-compute switch.
Extended Reasoning
A deliberate, operator-or-product-selected mode in which a model runs a longer internal reasoning pass before answering, trading latency and cost for depth on hard problems.
In-Memory Compute
A processor architecture that performs calculations directly inside the memory cells holding the data, eliminating the round trip to a separate compute unit.
Wafer-Scale Engine
A processor built from an entire silicon wafer rather than smaller chips diced from one, integrating dramatically more on-chip memory and compute cores to eliminate the chip-to-chip communication bottleneck that limits conventional GPU clusters at inference time.