Assigning a "base_url" about llmware

[doberst]

@dtthan1971 - FYI, we added OpenChat support last week. This should enable you to support this use case. Please check out the example in Examples/Models in the file: using-open-chat-models.py - link

[doberst]

thanks for the feedback - which model are you trying to use?

[dtthanh1971]

If you use openai version >1.0

setup OPENAI_BASE_URL = "your base url"

Else (openai version == 0.27.7)
setup OPENAI_API_BASE = "your base url" # http://127.0.0.1:8000 my case using litellm as a Open AI proxy server

LLMware wappaped openai in its llm model.

Import openai # version 0.27.7

openai.api_base=os.environ.get("OPENAI_BASE_URL ") or
or
openai.api_base=os.environ.get("OPENAI_API_BASE")