[feat]: annotation queues checkpoint 1#4015
Merged
bekossy merged 69 commits intorelease/v0.95.0from Mar 25, 2026
Merged
Conversation
- Add annotation schema with zod validation - Add annotation types and API functions - Add annotation molecule for state management
- Add evaluationQueue schema with zod validation - Add evaluationQueue types and API functions - Add evaluationQueue molecule for state management
- Add evaluationRun schema with zod validation - Add evaluationRun types and API functions - Add evaluationRun molecule for state management
- Add simpleQueue schema with zod validation - Add simpleQueue types and API functions - Add simpleQueue molecule and paginated stores
- Add queue controller for managing queue state - Add queue types - Add evaluator templates API and state
- Update shared user atoms and UserAuthorLabel component - Update trace state store exports - Update evaluator API and state exports - Update main index exports for new modules
- Add annotation session controller - Add annotation form controller - Add state types and exports
- Add AnnotationQueuesView with table cells - Add AnnotationSession components (FocusView, ConfigurationView, ScenarioListView) - Add AnnotationPanel and form field components - Add CreateQueueDrawer and AddToQueuePopover - Add ScenarioContent component - Add annotation hooks and context
- Add EvaluatorMetricBar component - Add LastInputMessageCell component (moved from oss) - Add MetricCellContent component and metricUtils - Add PageLayout component (moved from oss) - Update CellRenderers and components exports - Update createStandardColumns
- Update workflowRevisionRelationAdapter - Update UnifiedEntityPicker component and types - Update selection adapters exports
- Add AnnotationTraceContent component - Add annotation queue and session pages - Add EE annotation page stubs
- Update getObservabilityColumns to use new cell renderers - Update ObservabilityHeader component - Update FirstInputCell to use LastInputMessageCell from agenta-ui - Update TraceDrawer components (OverviewTabItem, TraceTypeHeader, TraceHeader) - Remove old LastInputMessageCell (moved to agenta-ui)
…ities - Update EvalRunDetails components (Page, MetricCell, chartData) - Update EvaluatorMetricBar and MetricDetailsPreviewPopover - Update Evaluators index - Update runMetrics formatters
- Update Layout to use PageLayout from agenta-ui - Remove old PageLayout (moved to agenta-ui) - Update TraceSpanDrillInView - Update VariantsComponents
- Update PlaygroundHeader and PlaygroundVariantConfigHeader - Remove useEvaluatorBrowseAdapter (no longer needed) - Update app-management, EvaluationsView, and PromptsPage
- Update app overview and settings pages - Update appState parse and url test - Update tailwind config
- Update agenta-entities, oss, and ee package.json - Update next.config.ts for oss and ee - Update pnpm-lock.yaml - Add tsconfig.tsbuildinfo
…//github.com/Agenta-AI/agenta into frontend-feat/annotation-queues-checkpoint-1
…end-feat/annotation-queues-checkpoint-1
added url state on details page fixes
…t stale Jotai atom state and remove redundant scenario progress invalidation.
…ort options for improved data presentation
…manage trace/span IDs via URL query parameters.
…remove link-based annotation fallback to prevent cross-queue/cross-scenario annotation bleed
…ep result matching and add debug logging to diagnose cross-queue annotation bleed
…ionTraceIdsAtomFamily for improved readability
- Changed evaluator output mapping to use dot notation (columnKey.fieldKey) - Each field in evaluator outputs now gets its own column key - Fixes data structure for proper testset sync preview rendering
…changes - Added invalidateEvaluatorsListCache calls in commitWorkflowRevisionAtom - Added invalidateEvaluatorsListCache calls in createWorkflowVariantAtom - Added invalidateEvaluatorsListCache calls in archiveWorkflowRevisionAtom - Added cache invalidation after evaluator create/update in CreateEvaluator Ensures evaluator list stays in sync when workflows or evaluators are modified
…an evaluators in queue creation and update human evaluation preview flags.
bekossy
approved these changes
Mar 25, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
No description provided.