Tokens and Metering

How tokens are tracked

Internally, The Grid uses a canonical metering system to track how many tokens each API call consumed and how that maps to your Units:

  • For every call, the platform counts input and output tokens using metering components that are specific to categories of models.

  • It subtracts the tokens from the oldest Lot (i.e. the lot that is closest to expiration) in your Consumption Account.

  • It records the mapping between the call, the Lot and the Unit to consume from, the trade that funded it, and the supplier that served it.

You can read more about our metering system here.

Last updated

Was this helpful?