Impossible to connect to ollama

[MatthewDlr]

Hey there,

Recently, I struggled to get connected to the web app to OLLAMA outside of localhost.
I get an error 500 every time I load the website: GET https://ollama/api/tags 500 (Internal Server Error)

I think this might have something to do with OLLAMA_ORIGINS, but the docs on this are not helpful.
By any chance, do you have tips to get connected to OLLAMA from your project?

Thanks!

[jakobhoeg]

Hi @MatthewDlr,

First off, sorry for the late response!
May I ask where the UI is hosted?

I just pushed some changes in #95, could you try updating and then change the .env from NEXT_PUBLIC_OLLAMA_URL to OLLAMA_URL? I also added a Docker guide in the readme.

[MatthewDlr]

No worries mate!

My UI is hosted here
I have not changed anything yet but I guess that from ollama you have to allow some origins right?

[jakobhoeg]

Ah, I see.
It won't work on a hosted instance, since the server api routes resolves 127.0.0.1 as the IP of hosted server’s own loopback interface, not your local machine.

I think to make it work, you'd have to probably host your Ollama server somewhere over HTTPS. For instance using Cloudflare Tunnel or Ngrok

[malteneuss]

My UI is hosted here I have not changed anything yet but I guess that from ollama you have to allow some origins right?

Ollama needs to be started with the environment variable OLLAMA_ORIGINS set and include all domains from which traffic will come, e.g.

OLLAMA_ORIGINS = "https://ollama.mydomain.com,https://ollama.mdelarue.dev/,http://localhost:*" ollama serve

otherwise it will reject serving those requests