How to Connect Chatbox to a Remote Ollama Service: A Step-by-Step Guide

Chatbox also supports connecting to Ollama services on remote machines, in addition to local connections.

For instance, you can run the Ollama service on your home computer and access it using the Chatbox application on your phone or another computer.

You need to ensure that the remote Ollama service is properly configured and exposed on the current network so that Chatbox can access it. By default, the remote Ollama service requires simple configuration.

How to Configure the Remote Ollama Service?

By default, the Ollama service runs locally and does not serve externally. To make the Ollama service available externally, you need to set the following two environment variables:

OLLAMA_HOST=0.0.0.0
OLLAMA_ORIGINS=*

Configuring on MacOS

1. Open the command line terminal and enter the following commands:

   launchctl setenv OLLAMA_HOST "0.0.0.0"
   launchctl setenv OLLAMA_ORIGINS "*"
   

2. Restart the Ollama application to apply the settings.

Configuring on Windows

On Windows, Ollama inherits your user and system environment variables.

1. Exit Ollama via the taskbar.

2. Open Settings (Windows 11) or Control Panel (Windows 10), and search for "Environment Variables".

3. Click to edit your account's environment variables.

   Edit or create a new variable OLLAMA_HOST for your user account, with the value 0.0.0.0; Edit or create a new variable OLLAMA_ORIGINS for your user account, with the value *.

4. Click OK/Apply to save the settings.

5. Launch the Ollama application from the Windows Start menu.

Configuring on Linux

If Ollama is running as a systemd service, use systemctl to set the environment variables:

1. Invoke systemctl edit ollama.service to edit the systemd service configuration. This will open an editor.

2. Under the [Service] section, add a line for each environment variable:

   [Service]
   Environment="OLLAMA_HOST=0.0.0.0"
   Environment="OLLAMA_ORIGINS=*"
   

3. Save and exit.

4. Reload systemd and restart Ollama:

   systemctl daemon-reload
   systemctl restart ollama
   

Service IP Address

After configuration, the Ollama service will be available on your current network (such as home WiFi). You can use the Chatbox client on other devices to connect to this service.

The IP address of the Ollama service is your computer's address on the current network, typically in the form:

192.168.XX.XX

In Chatbox, set the API Host to:

http://192.168.XX.XX:11434

Considerations

• You may need to allow the Ollama service port (default 11434) through your firewall, depending on your operating system and network environment.
• To avoid security risks, do not expose the Ollama service on public networks. A home WiFi network is a relatively safe environment.

References

• Ollama Service Configuration