Skip to content

feat: Proposed SIMBAUQ Sampling Strategy#785

Open
radum2275 wants to merge 4 commits intogenerative-computing:mainfrom
radum2275:feat/simba_uq
Open

feat: Proposed SIMBAUQ Sampling Strategy#785
radum2275 wants to merge 4 commits intogenerative-computing:mainfrom
radum2275:feat/simba_uq

Conversation

@radum2275
Copy link
Copy Markdown

@radum2275 radum2275 commented Apr 3, 2026

Sampling Strategy PR

Use this template when adding or modifying sampling strategies in mellea/stdlib/sampling/.

Description

Implementation Checklist

Base Class

  • Extends appropriate base class:
    • BaseSamplingStrategy if your changes are mostly modifying the repair and/or select_from_failure functions
    • SamplingStrategy if your changes involve a new sample method
    • Other defined sampling strategies if your implementation is similar to existing implementations

Return Value

  • Returns a properly typed SamplingResult. Specifically, this means:
    • ModelOutputThunks in sample_generations are properly typed from the Component and the parsed_repr is the expected type.

Integration

  • Strategy exported in mellea/stdlib/sampling/__init__.py

Testing

  • Tests added to tests/sampling/
  • New code has 100% coverage
  • Ensure existing tests and github automation passes (a maintainer will kick off the github automation when the rest of the PR is populated)

Radu Marinescu added 4 commits April 2, 2026 14:12
Signed-off-by: Radu Marinescu <radu.marinescu@ie.ibm.com>
Signed-off-by: Radu Marinescu <radu.marinescu@ie.ibm.com>
Signed-off-by: Radu Marinescu <radu.marinescu@ie.ibm.com>
Signed-off-by: Radu Marinescu <radu.marinescu@ie.ibm.com>
@radum2275 radum2275 requested a review from a team as a code owner April 3, 2026 16:39
@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 3, 2026

The PR description has been updated. Please fill out the template for your PR to be reviewed.

@jakelorocco jakelorocco changed the title Proposed SIMBAUQ Sampling Strategy feat: Proposed SIMBAUQ Sampling Strategy Apr 3, 2026
@github-actions github-actions bot added the enhancement New feature or request label Apr 3, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Proposal: Integrating Similarity‑Based Aggregation for Uncertainty Quantification into Mellea

1 participant