Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion AGENTS.md
Original file line number Diff line number Diff line change
Expand Up @@ -77,7 +77,7 @@ All testing guidance (including "behavior changes require tests") lives in `TEST
- Add an external evaluator package:
1) copy `evaluators/contrib/template/` as a starting point
2) implement evaluator class extending `Evaluator` from `agent_control_evaluators`
3) add entry point using `org.name` format (e.g., `galileo.luna2`)
3) add entry point using `org.name` format (e.g., `galileo.luna`)
4) package is discovered automatically when installed alongside agent-control

## Git/PR workflow
Expand Down
1 change: 0 additions & 1 deletion docs/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -19,7 +19,6 @@ This repository keeps documentation concise. The full documentation lives on the
- [Agent Control Demo](https://docs.agentcontrol.dev/examples/agent-control-demo) — End-to-end demo with server-side controls
- [LangChain SQL](https://docs.agentcontrol.dev/examples/langchain-sql) — SQL injection protection for LangChain agents
- [CrewAI](https://docs.agentcontrol.dev/examples/crewai) — Guardrails combined with CrewAI orchestration
- [Galileo Luna-2](https://docs.agentcontrol.dev/examples/galileo-luna2) — AI-powered toxicity detection
- [DeepEval](https://docs.agentcontrol.dev/examples/deepeval) — Custom evaluator built on GEval metrics

## Component Docs
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -12,7 +12,7 @@

Naming convention:
- Built-in: "regex", "list", "json", "sql"
- External: "provider.name" (e.g., "galileo.luna2")
- External: "provider.name" (e.g., "galileo.luna")
- Agent-scoped: "agent:name" (custom code deployed with agent)

External evaluators are installed via separate packages (e.g., agent-control-evaluator-galileo).
Expand Down
2 changes: 1 addition & 1 deletion evaluators/builtin/src/agent_control_evaluators/_base.py
Original file line number Diff line number Diff line change
Expand Up @@ -43,7 +43,7 @@ class EvaluatorMetadata:
"""Metadata about an evaluator.

Attributes:
name: Unique evaluator name (e.g., "regex", "galileo.luna2")
name: Unique evaluator name (e.g., "regex", "galileo.luna")
version: Evaluator version string
description: Human-readable description
requires_api_key: Whether the evaluator requires an API key
Expand Down
2 changes: 1 addition & 1 deletion evaluators/contrib/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@

Contributed evaluators and templates for extending Agent Control.

- `galileo/` — Luna-2 evaluator integration
- `galileo/` — Luna evaluator integration
- `template/` — Starter template for adding new evaluators

Full guide: https://docs.agentcontrol.dev/concepts/evaluators/custom-evaluators
14 changes: 11 additions & 3 deletions evaluators/contrib/galileo/README.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,14 @@
# Galileo Luna-2 Evaluator
# Galileo Luna Evaluator

Integration package for Galileo Luna-2 evaluator.
Integration package for Galileo Luna evaluator.

## Migrating from Luna2

The `galileo.luna2` evaluator ID has been removed. Existing controls that use
`galileo.luna2` should migrate to `galileo.luna` and update their evaluator
configuration to the direct Luna scorer fields (`scorer_label`, `scorer_id`, or
`scorer_version_id`, plus `threshold` and `operator`). If you still need the
legacy Luna2 evaluator, pin `agent-control-evaluator-galileo <8`.

## Install

Expand All @@ -24,4 +32,4 @@ pip install agent-control-evaluator-galileo

See full documentation in: https://docs.agentcontrol.dev/concepts/evaluators/contributing-evaluator

Example with usage: https://docs.agentcontrol.dev/examples/galileo-luna2
Example with usage: https://docs.agentcontrol.dev/examples/galileo-luna
3 changes: 1 addition & 2 deletions evaluators/contrib/galileo/pyproject.toml
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
[project]
name = "agent-control-evaluator-galileo"
version = "7.10.0"
description = "Galileo Luna2 evaluator for agent-control"
description = "Galileo Luna evaluator for agent-control"
readme = "README.md"
requires-python = ">=3.12"
license = { text = "Apache-2.0" }
Expand All @@ -24,7 +24,6 @@ dev = [

[project.entry-points."agent_control.evaluators"]
"galileo.luna" = "agent_control_evaluator_galileo.luna:LunaEvaluator"
"galileo.luna2" = "agent_control_evaluator_galileo.luna2:Luna2Evaluator"

[build-system]
requires = ["hatchling"]
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,6 @@

Available evaluators:
- galileo.luna: Galileo Luna direct scorer evaluation
- galileo.luna2: Galileo Luna-2 runtime protection

Installation:
pip install agent-control-evaluator-galileo
Expand All @@ -29,13 +28,6 @@
ScorerInvokeRequest,
ScorerInvokeResponse,
)
from agent_control_evaluator_galileo.luna2 import (
LUNA2_AVAILABLE,
Luna2Evaluator,
Luna2EvaluatorConfig,
Luna2Metric,
Luna2Operator,
)

__all__ = [
"GalileoLunaClient",
Expand All @@ -45,9 +37,4 @@
"LunaEvaluatorConfig",
"LunaOperator",
"LUNA_AVAILABLE",
"Luna2Evaluator",
"Luna2EvaluatorConfig",
"Luna2Metric",
"Luna2Operator",
"LUNA2_AVAILABLE",
]

This file was deleted.

Loading
Loading