Configuration Guide

Environment Setup

Local/Hybrid Mode

Copy the example environment file:

cp local/.env.example local/.env   # For local mode
cp hybrid/.env.example hybrid/.env # For hybrid mode

AWS Mode

Copy the terraform variables template:

cp aws/terraform.tfvars.template aws/terraform.tfvars

Configuration Options

Model Configuration

The ollama_models variable in terraform.tfvars controls which models are automatically downloaded and installed when Ollama containers start:

ollama_models = "tinyllama,llama2,mistral"

Models are downloaded from Ollama’s model hub and cached in the EFS volume for persistence.

Database Settings

• POSTGRES_DB: Database name
• POSTGRES_USER: Database user
• POSTGRES_PASSWORD: Database password

Open WebUI Settings

• WEBUI_SECRET_KEY: Secret key for session management
• WEBUI_VERSION: Version of Open WebUI to use

Ollama Settings

• OLLAMA_USE_GPU: Enable/disable GPU support
• INSTALLED_MODELS: Comma-separated list of models to install

AWS Settings (Hybrid/AWS modes)

• AWS_REGION: AWS region for services
• BEDROCK_API_KEY: API key for Bedrock gateway

Advanced Configuration

See terraform.tfvars.template for full AWS deployment options

---

Horizons OmniChat by evereven