THE INFERENCE STACK

Tech Radar

A curated map of the inference stack, organized by layer.

View
Tile size
Default
Layer
Explore a project for research notes and official sources.13 projects

01Serving engines

4

Run the model.

02Kernels & compilers

3

Execute the computation.

03Systems & caching

3

Coordinate serving and state.

04Measurement & evaluation

3

Measure speed and quality.

Curated coverage. Inclusion is not a performance ranking.

KEPLERFOLD / RESEARCH