Search results

Upgrading deepeval from 3.7.3 to 3.7.4 breaks Gemini judge model.

Status: Open.

#2377 In confident-ai/deepeval;

· Sliski opened on Dec 12, 2025

Can not find azure model deployment with AzureOpenAIModel since deepeval 3.7.5

bugSomething isn't workingSomething isn't working

Status: Open.

#2374 In confident-ai/deepeval;

· flansen opened on Dec 10, 2025

AttributeError: 'SummarizationAlignmentVerdict' object has no attribute 'verdicts' -- Async False

bugSomething isn't workingSomething isn't working

Status: Open.

#2366 In confident-ai/deepeval;

· dgrahn opened on Dec 8, 2025

ARC benchmark should have several "modes" per question

Status: Open.

#2352 In confident-ai/deepeval;

· edoardocontente opened on Dec 3, 2025

GPTModel does not support separate sync and async HTTP clients

awaiting investigation

Status: Open.

#2351 In confident-ai/deepeval;

· gchaperon opened on Dec 3, 2025

Issue: Useless Reasoning (Verdict Before Reason)

awaiting release

Status: Open.

#2333 In confident-ai/deepeval;

· RodionfromHSE opened on Nov 28, 2025

AttributeError: 'NoneType' object has no attribute 'verdict'

awaiting investigation

bugSomething isn't workingSomething isn't working

Status: Open.

#2327 In confident-ai/deepeval;

· nicolablago opened on Nov 27, 2025

ConversationRelevancyMetric Removed in DeepEval 3.7.x, Need Official Replacement & Clarification

awaiting clarification

Status: Open.

#2321 In confident-ai/deepeval;

· sacjha-star opened on Nov 24, 2025

Structured output for knowledge retention metric

bugSomething isn't workingSomething isn't working

Status: Open.

#2318 In confident-ai/deepeval;

· tasneem200 opened on Nov 21, 2025

Expose metric results of Step Efficiency

awaiting clarification

Status: Open.

#2313 In confident-ai/deepeval;

· AmaliMatharaarachchi opened on Nov 16, 2025

Supporting logprobs in benchmarks

awaiting clarification

Status: Open.

#2311 In confident-ai/deepeval;

· edoardocontente opened on Nov 16, 2025

Support Open Router

awaiting code fix

Status: Open.

#2303 In confident-ai/deepeval;

· MohamedAliRashad opened on Nov 12, 2025