Evals?
#5
by
Impulse2000
- opened
I realise this is for educational use, either way i think it would be great if some evaluation of the models performance could be done, maybe as part of the pipeline, for future versions.
Would you consider this? Let me know what you think.
P.S: Great work!
Sincerely,
James Clarke
That's a good suggestion, and so far this is planned in the context of a different project. Having a model available to load easily for projects like these was actually one of the motivations why I put it here on HF.