Instruments

What is an Instrument?

An Instrument is a standardized contract that gives the buyer the right to consume inference and gives the seller the obligation to deliver it, from any model that meets or exceeds a defined minimum service level benchmark.

Each Instrument is governed by a Specification. It is a bundle of thresholds that all conforming models must meet, such as:

• Performance score on Artificial Analysis Intelligence Index.

• Throughput in tokens per second.

• Time to first token.

• Context window size.

• Maximum output length.

As long as a supplier model meets or exceeds the thresholds for an Instrument, they can deliver that Instrument. We manage our suppliers and monitor their performance to ensure that all suppliers meet these specifications.

Current Instruments

Today The Grid focuses on text to text Instruments, such as:

• Chat Fast: for low latency and high throughput

• Chat Prime: for higher reasoning quality and long outputs

Read more about our Current Instruments and Specifications here.

Several more Instruments are on the near term roadmap as the platform scales. If you have suggestions or feedback on the Instruments we should support, please contact [email protected]