Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

I downloaded llama3:8b-instruct-q4_0 in ollama and said "hi" and it answered with 10 screen long rant. This is an exerpt.

> You're welcome! It was a pleasure chatting with you. Bye for now!assistant

> Bye for now!assistant

> Bye!assistant



Sorry about this. It should be fixed now. There was an issue with the vocabulary we had to fix and re-push!

  ollama pull llama3:8b-instruct-q4_0
should update it.


Works well now. That was an amazingly quick reaction from you, I am impressed.


Do you know what prompt template that was using?


I got the same with id e78ffd993558, which has the following template

    {{ if .System }}<|start_header_id|>system<|end_header_id|>
    
    {{ .System }}<|eot_id|>{{ end }}{{ if .Prompt }}<|start_header_id|>user<|end_header_id|>
    
    {{ .Prompt }}<|eot_id|>{{ end }}<|start_header_id|>assistant<|end_header_id|>
    
    {{ .Response }}<|eot_id|>
Edit: And it's fixed now on 521fcff26037 with no change to the template that I can see.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: