LAB NOTES / PUBLICATION FORMAT

What a result includes.

Enough context to inspect the claim and repeat the run.

Question and baseline

State the question, the comparison, and the latency or quality constraints before interpreting a result.

Complete setup

Model and tokenizer revisions, hardware and GPU count, precision, runtime commit, drivers, launch arguments, and relevant environment settings.

Workload and method

Input and output lengths, request rate or concurrency, warmup, cache state, repetitions, timing boundaries, and error handling.

Evidence and limits

Raw measurements, run commands, analysis code, and any available logs. Show variability, failed runs, and the conditions under which the result may not generalize.

Explicit status

A protocol describes a method. A proposed experiment describes work to do. A result describes a completed run with evidence. The current collection contains a protocol and proposed experiments.

Go to the source

← Back to Lab Notes