Cannot change the OLLAMA_API_BASE_URL

[TheArKaID]

I might fails to understand, but how to make the cpu/astra-assistant-api to connect to ollama:11434 instead of localhost:11434?

In a glance, I'm looking for a drop-in replacement of the OpenAI Assistant, find astra-assistant-api. I wanna to use a model from Ollama, but fail in this step.

[phact]

OLLAMA_API_BASE_URL is the right env var.

Are you using patch() to create your client? If so, it should pick up the env var here

astra-assistants-api/client/astra_assistants/patch.py

Line 489 in d070f2f

headers["base_url"]= os.getenv("OLLAMA_API_BASE_URL")

[phact]

No, just wrap your SDK client. What language are you using?

[TheArKaID]

Ohh I see, unfortunately I use PHP (Laravel) for accessing thhe OpenAI Assistant.

[TheArKaID]

As far as I read the node version, it's just customize the headers (authorization, X-Model-Used, X-Embedding-Model-Used), isn't?

[phact]

Exactly. Yeah u could probably whip up your own php patch for your client. Is it this?
https://github.com/openai-php/client

[TheArKaID]

Yes, I use that