qinfeng722's picture
Upload 322 files
5caedb4 verified
raw
history blame contribute delete
278 Bytes
Determines whether to sample from the next token distribution instead of choosing the token with the highest probability. If turned **On**, the next token in a predicted sequence is sampled based on the probabilities. If turned **Off**, the highest probability is always chosen.