sampling max tokens
- CURIE:
gmeow:samplingMaxTokens - IRI: https://blackcatinformatics.ca/gmeow/samplingMaxTokens
- Category: property
- Defined by:
gmeow:slices/ai - Box roles: RBox role (What is this?)
The output-length ceiling of this invocation.
Structure
Property shape: datatype property; gmeow:ModelInvocation -> xsd:positiveInteger
Practical Pattern
Use gmeow:samplingMaxTokens from gmeow:ModelInvocation to xsd:positiveInteger when the relationship itself belongs in the native GMEOW graph.
Common Companion Terms
Usage Advice
Use when
- Use to record the output-token ceiling of a
gmeow:ModelInvocation— provenance for whether an output may have been truncated.
Avoid when
- Avoid confusing it with the model's context window (that is
gmeow:modelContextWindowon the card, a model capability, not a per-call setting).
How to use
- Assert
gmeow:samplingMaxTokensas a positive integer on thegmeow:ModelInvocationalongside the other sampling parameters.
Examples
- ex:inv1
gmeow:samplingMaxTokens4096.