[BUG] Problem with escaped characters in LLM answers about alpaca-electron

[ItsPi3141]

Ok thanks for letting me know! I did not know that. I'll look into this and see what I can do.

[ItsPi3141]

I understand the problem here. However, most of the time, the AI isn't used to generate code. And the AI often doesn't use linebreaks in strings in the code that it generates. It would also be very hard to recognize if something is a quote for a string in a programming language or if it's a quote from other texts (e.g. book, news, etc)

[oderwat]

Well, I use AI (GPT-4) about 80% of the time to reason about or generate code, and it would be wonderful to be able to use it for that with actual private data (this is also why I don't want to send stuff to Duck Duck Go without being asked first).

But, I already tested and found that llama.cpp does not output the line feeds in the shell as \n anyway, while it does output escaped strings like the \n in the code perfectly fine. See this example generated with chat_mac_x64:

> write a go program that outputs the numbers 1 to 5 together with their written names
func main() {
    for i := 1; i <= 5; i++ {
        fmt.Printf("%d - %s\n", i, english[i-1])
    }
}

It seems as if you escape the output of the shell in a way that does not let the frontend distinguish between the actual LF and the normal strings. I understand that it is sometimes mind twisting to get all the escapes right. I guess you can fix that by looking into your pipeline processing and making some modifications to the escapes used.

Likewise, I may also look into that if you can't find a solution, I am pretty confident that this can be solved.