New LLM provider AWS bedrock - support converse and conversestream

[CsBigDataHub]

Happy new year,

These endpoints are different from openAI completion and openAI Response

https://docs.aws.amazon.com/bedrock/latest/APIReference/API_runtime_Converse.html
https://docs.aws.amazon.com/bedrock/latest/APIReference/API_runtime_ConverseStream.html

Also see this,
karthink/gptel#1200
https://github.com/karthink/gptel/blob/master/gptel-bedrock.el

They are multiple ways to authenticate, lets start up AWS_BEARER_TOKEN_BEDROCK, low hanging fruit for implementing this.

[ericdallo]

So this would be a new API for what providers? only for bedrock? I wonder if it's worth the complex addition vs what different models we would support that we don't support already

[CsBigDataHub]

The Converse and ConverseStream endpoints are specific to Amazon Bedrock.
Although LiteLLM supports the Bedrock Converse API for various model providers.

https://docs.litellm.ai/docs/bedrock_converse

I don't think this it is complex, we just expose a new provider. Let me create a draft PR, I have few constraints testing it due to my company proxy in front of bedrock access. I will make the PR available for review once I am able to test

[CsBigDataHub]

it is not about supporting new models but the provider, AWS bedrock like other LLM providers allows users to deploy models similar to Openrouter or Azure OpenAI in their infra.

[ericdallo]

Ok, I think it makes sense, but I have no way to test or maintain this feature, would you be willing to maintain it at least for some time?

I will take a look at the PR tomorrow

[CsBigDataHub]

Yes, as soon I can get it working through my company proxy.