togethercomputer/LLaMA-2-7B-32K · getting strange tokens after finetuning on Qlora

Aug 2, 2023

Hi All,

prompt = """### Instruction: write a python code to read csv

Response:"""

I am getting strange tokens like below

:::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::

mauriceweber

Together org Aug 9, 2023

Hi @monuminu , what hyperparameters did you use for training and generation?

monuminu

Aug 9, 2023

I think the issue is because of monkey patch which was not applied.