Feature request: Stream output about chatblade

[npiv]

Screen.Recording.2023-03-22.at.09.02.39.mov

[npiv]

Nice idea, this works pretty well. It is on this branch if you would like to play with it. https://github.com/npiv/chatblade/tree/feature/poc-streaming

just check out the branch and pip install .

I will test a few more things and merge to main in coming days.

[luthfielaroeha]

Wow cool man, it works!

Btw, is it possible to automatically output the result as markdown?

I just playing around with the Live feature from python Rich library, and seems like we can automatically output the result to markdown.

        with Live(console=Console(), auto_refresh=False) as live:
            for message in result:
                live.update(Markdown(message.content), refresh=True)
                ...

But I'm not sure if this will break another thing

[luthfielaroeha]

Sorry misclick

[npiv]

No worries, I've merged the streaming into main, and released it under 0.1.0. I might come back with some improvements in future depending on how it is received. Thanks for the suggestion.

Will close for now. I don't consider having valid markdown during streaming a high priority myself, but am happy to accept PRs if people care to look at it.