What is the best sampling config?
#1
by
pootow
- opened
What is the best value for temperature, top_k, top_p, etc.?
We recommend:
top_p
=0.95
temperature
=0.6
max_tokens
=64000
alpayariyak
changed discussion status to
closed