On The Grid, you buy capacity by placing orders on a central limit order book, similar to a financial exchange.
Limit Orders
For example, buy 10 Units of Chat Prime at up to a given price per Unit. Limit orders can fill fully, partially, or rest on the book until they can fill. Limit orders are currently Good till Cancelled (GTC), and you can set a desired Max Slippage while submitting the order.
Market Orders
For example, buy 10 Units of Chat Fast at the best available prices. Market orders cross the spread and fill immediately against the best asks until they are complete or liquidity is exhausted.
Both order types purchase Units of standardized inference that you then consume through a single OpenAI compatible API.
To provide feedback and suggestions for enabling more order types, please reach out to us at support@thegrid.ai