Methodology

Prefer repeatable observations

Every useful comparison starts with a defined task, fixed inputs, recorded model settings, and more than one run. Results should separate measured values from interpretation and state important limitations.

What we record

• Model and runtime versions.
• Prompt format and generation parameters.
• Hardware and memory constraints.
• Latency, throughput, and output variance.