Skip to content

Fix Podman and Gunicorn compatibility issues on Windows in OCI GenAI Gateway docs #2584

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
dvlasako wants to merge 1 commit into
base: main
Choose a base branch
from
Open

Fix Podman and Gunicorn compatibility issues on Windows in OCI GenAI Gateway docs #2584

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
13 changes: 7 additions & 6 deletions ai/generative-ai-service/a-getting-started-guide/files/N8N-GenAIOCI-Connection.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -23,8 +23,9 @@ From the repo root:
```
For production (Linux only, with Gunicorn for scaling):
```bash
gunicorn app:app --workers 16 --worker-class uvicorn.workers.UvicornWorker --timeout 600 --bind 0.0.0.0:8088
gunicorn app:app --workers 16 --worker-class uvicorn.workers.UvicornWorker --timeout 600 --bind 0.0.0.0:8088
```
- **Note**: For Windows, Gunicorn is not natively supported; use Uvicorn directly with a process manager like PM2 (via Node.js) or NSSM for production scaling.

### Option 2: Run with Podman (Containerized Deployment)

Expand All @@ -36,9 +37,9 @@ From the repo root:
3. Build and run:
```bash
podman build -t oci_genai_gateway .
podman run -p 8088:8088 \
-v ~/.oci:/root/.oci:Z \
-it --name oci_genai_gateway oci_genai_gateway
podman run -p 8088:8088 \
-v ~/.oci:/root/.oci:Z \ # On Linux/macOS; on Windows, use an absolute path like -v C:/Users/<username>/.oci:/root/.oci:Z (ensure the directory is shared/mounted in Podman machine/VM)
-it --name oci_genai_gateway oci_genai_gateway
```
4. Verify: Open `http://localhost:8088` in a browser (should show a health check or API docs). Check logs with `podman logs oci_genai_gateway`.

Expand All @@ -51,7 +52,7 @@ In n8n, use the **OpenAI** node but point it to your local gateway as a custom e
2. Add an **OpenAI** node (under AI > Chat Models).
3. Configure credentials:
* **API Key:** Leave blank or use a dummy value (gateway uses OCI auth).
* **Base URL:** `http://host.docker.internal:8088/v1` (for Podman/Docker; use `http://localhost:8088/v1` if running natively).
* **Base URL**: `http://host.containers.internal:8088/v1` (preferred for Podman on Windows/macOS; fallback to `http://localhost:8088/v1` if running natively or use the gateway's explicit IP with `--add-host host.containers.internal:<gateway-ip>` in Podman run command).
* **Model:** Select or enter an OCI model (list available models via gateway docs or OCI Console).
n8n will now route requests through the gateway to OCI GenAI.

Expand Down Expand Up @@ -126,4 +127,4 @@ This example creates a workflow that triggers on a webhook (e.g., incoming email
## Troubleshooting & Tips
* **Authentication Errors:** Verify `~/.oci/config` permissions and OCI policies (from prerequisites). Test with `oci` CLI commands like `oci os ns get`.
* **Connection Issues:** Ensure port 8088 is open (firewall/OCI security lists). For Podman, use `--network=host` if needed.
* **Model Not Found:** List OCI models in Console under **Analytics & AI > Generative AI**. Ensure your tenancy has the required permissions for `generative-ai-family`.
* **Model Not Found:** List OCI models in Console under **Analytics & AI > Generative AI**. Ensure your tenancy has the required permissions for `generative-ai-family`.