Is it possible to use an ollama running on a remote server?

[JonatanSahar]

Briefly describe what you are trying to do

I have an Ollam instance running on a remote machine with ollama run [model]. I haven't found a reference to this type of configuration in the manual - is it possible to give a username to access the machine (ssh keys are configured), or by some other method?
Thanks!

Additional context
Emacs version: 29
Operating system: ubuntu

[tusharhero]

Yes it is possible. Here is my configuration which does this.

my gptel configuration.

And to expand, you don't need to run ollama run [model] on your remote server. Just make sure the server is running (Its a systemd service by default, or just run ollama serve).

[karthink]

is it possible to give a username to access the machine (ssh keys are configured),

If ssh is the only way to access the machine, then you have to use ssh tunneling as @tusharhero does.

If the machine is on your local network, you can access it by IP and run Ollama like this:

OLLAMA_HOST=0.0.0.0 ollama run [model]

If the machine is elsewhere, you can set up a reverse proxy and access it by IP at whatever port you want.

---

In any case there's nothing special about the configuration in gptel -- you just provide the host and port to gptel-make-ollama, as usual.