Hi, you dont have GPU enabled to use, so into your docker-compose.yml file replace ollama service with this:


  ollama:
    image: ollama/ollama:latest
    ports:
      - 11434:11434
    volumes:
      - ./model_files:/model_files
      - .:/code
      - ./ollama:/root/.ollama
    container_name: ollama
    pull_policy: always
    tty: true
    restart: always
    entrypoint: ["/usr/bin/bash", "/model_files/run_ollama.sh"]
    networks:
      - iris-llm2-network

You need to enable https to your REST API. Follow these steps:

Use a proxy server to do that. Have a look at this git : https://github.com/grongierisc/Https-Proxy-IRIS-Docker or this one : https://github.com/lscalese/isc-webgateway-letsencrypt (thanks @Guillaume Rongier)

Steps (thanks @Eduard Lebedyuk )

1. Install public web server (Windows, Linux).

2. Connect it to InterSystems IRIS.

3. Enable HTTPS there. Easiest way is Let's Encrypt.