Third-Party Models

AllySec Forge runs on any model provider that exposes an API. You control the backend. The platform is model-agnostic -- it sends prompts, receives completions, and adapts tool use to whatever model responds.

DeepSeek (Default, Recommended)

DeepSeek is the default provider (deepseek/deepseek-chat). It offers strong offensive-security reasoning at a low cost ceiling and needs no translation layer.

DEEPSEEK_API_KEY=your-key

The platform resolves deepseek/deepseek-chat automatically. Override the model with OPENAI_MODEL if you route DeepSeek through an OpenAI-compatible endpoint.

Anthropic (Native)

Direct Anthropic API. No translation layer. Use when you have an Anthropic subscription.

ANTHROPIC_AUTH_TOKEN=sk-ant-api03-...
ANTHROPIC_BASE_URL=https://api.anthropic.com
ANTHROPIC_MODEL=claude-sonnet-4-20250514

OpenAI

Standard OpenAI API. Any model in the catalog.

CLAUDE_CODE_USE_OPENAI=1
OPENAI_BASE_URL=https://api.openai.com/v1
OPENAI_API_KEY=sk-...
OPENAI_MODEL=gpt-4o

OpenRouter

Unified API with access to hundreds of models. Uses the Anthropic path with OpenRouter's base URL.

ANTHROPIC_AUTH_TOKEN=your-openrouter-key
ANTHROPIC_BASE_URL=https://openrouter.ai/api/v1
ANTHROPIC_MODEL=openrouter/auto

Ollama Cloud

Ollama's hosted API for open-weight models.

CLAUDE_CODE_USE_OPENAI=1
OPENAI_BASE_URL=https://ollama.com/v1
OPENAI_API_KEY=your-ollama-key
OPENAI_MODEL=llama4

LM Studio (Local)

Run models entirely on your machine. No API costs, no network egress. Useful for air-gapped engagements.

CLAUDE_CODE_USE_OPENAI=1
OPENAI_BASE_URL=http://localhost:1234/v1
OPENAI_API_KEY=not-needed
OPENAI_MODEL=local-model

Start LM Studio, load a model, and enable the local server. The platform connects over localhost.

Model Tier Overrides

Fine-tune which model handles each operational tier.

ANTHROPIC_DEFAULT_OPUS_MODEL=claude-opus-4-20250514
ANTHROPIC_DEFAULT_SONNET_MODEL=claude-sonnet-4-20250514
ANTHROPIC_DEFAULT_HAIKU_MODEL=claude-haiku-4-20250514

Opus-tier handles heavy reasoning (chain composition, attack planning). Sonnet handles routine operations. Haiku handles lightweight parallel tasks.

Switching Models at Runtime

Use the /model command during an active session to switch providers without restarting.

/model deepseek
/model anthropic
/model openai
/model local

Credential Pooling

For teams running multiple API accounts, define a credential pool.

ALLYSEC_CREDENTIAL_POOL='[
  {"provider":"deepseek","key":"key-1"},
  {"provider":"deepseek","key":"key-2"},
  {"provider":"anthropic","key":"sk-ant-..."}
]'
ALLYSEC_CREDENTIAL_STRATEGY=round_robin

Strategies:

• fill_first -- exhaust account 1 before switching
• round_robin -- rotate evenly across all accounts
• random -- random selection per request
• least_used -- prefer the account with the fewest recent requests

---

Environment Variables -- FAQ