Feature Request: Maintain Context Length for Title Generation Using Same Model for Chat about ollama-webui

[chrisoutwright]

The current workaround involves not defining the context length in Open WebUI via parameters (thus keeping it as default), but instead specifying it in the model's blob config file. However, this approach has a limitation: if the default context length is overridden via Open WebUI parameters, the context length specified in the config file will no longer be observed, and so the title generation will use size 2048 again compared to what has been defined higher in Open WebUI parameters.

[boshk0]

I found a workaround! :) You need to create your own modelfile using the Admin -> Models and then use it for chat and Title generation:

Deepseek-v2-4096

FROM deepseek-v2:16b
SYSTEM """Answer in English"""
PARAMETER num_ctx 4096
PARAMETER temperature 0.0