[FEATURE] Support for Bedrock Service Tiers

[rjourdan]

Problem Statement

I would like Strands to support the newly introduced Service Tiers on Amazon Bedrock. https://aws.amazon.com/blogs/aws/new-amazon-bedrock-service-tiers-help-you-match-ai-workload-performance-with-cost/

Proposed Solution

I'd like an optional field when creating an agent "service-tier" when using Bedrock models. There are three expected values: "priority", "standard", "flex". When the model does not support the service-tier, it will be gracefully handled with an warning message and won't be blocking.

Use Case

This would help lower the price for long workflows that are not time sensitive.

Alternatives Solutions

No response

Additional Context

No response

[mkmeral]

Hi, both Bedrock and OpenAI providers allow you to pass additional arguments to API calls through their configuration, e.g. see OpenAI config

Do we need something more to enable this use case? Or is this about adding a specific field to our API?

Here's a code sample that can allow you to use tiers with OpenAI provider (as shown in the blog)

from strands.models import OpenAIModel

model = OpenAIModel(
    model_id="gpt-4o",
    params={"service_tier": "priority"}
)

[mkmeral]

I'll take this issue as a DevX improvement for Bedrock model provider, i.e. adding this extra field to Bedrock Config. We can allow contributors to this change.

I don't think we should be adding Bedrock specific API parameters to OpenAI provider.