schneiderfelipe / chat-splitter

Split chat messages by maximum chat completion token count

Discover my latest contributions and projects on GitHub.

Explore more of my work at https://schneiderfelipe.github.io/.

chat-splitter's Issues

Support pruning chat messages

Receive a closure Fn(&M, &[M]) -> bool receiving the oldest message and all the next ones and indicating whether a single oldest message should be pruned. Call it and prune accordingly until it returns false or the total messages in the split is empty. Pruning here means advancing the split position by one unit.

Release v0.2.0

Provide a default implementation of IntoChatCompletionRequestMessage::into_tiktoken_rs

chat-splitter/src/lib.rs

Lines 259 to 261 in c287c0f

	/// Convert to [`tiktoken_rs` chat completion request message
	/// type](`tiktoken_rs::ChatCompletionRequestMessage`).
	fn into_tiktoken_rs(self) -> tiktoken_rs::ChatCompletionRequestMessage;

Review, correct and improve documentation

This includes comments in code. It would be nice to review for typos, rewording, etc.

Rename to chat-splitter

Just like text-splitter. This crate only splits chats.