Base / pretrained model
#5
by
mesh-ops
- opened
Base models are very useful for researchers, and also some of us just prefer the workflow of using base models over instruct models.
Please release the final pretrain checkpoint for this as well, we'd appreciate it a lot.
Definitely. For example, I use base models for dialogue, they're way more fun and less predictable even if dumb as bricks. They're more creative and less constrained, which I guess is the reason we're not getting it lol