Skip to content

Conversation

@Chittaranjans
Copy link

To enable seamless integration with additional LLMs. we propose updating the LLM client initialization in client_utils.py to accept custom endpoints and model parameters using LiteLLM’s unified interface.

@Chittaranjans
Copy link
Author

@microsoft-github-policy-service agree

@Chenglong-MS
Copy link
Collaborator

This looks great, I'm testing this right now, and I'll incorporate an UI update together today.

@Chittaranjans
Copy link
Author

Please let me know if you encounter any errors during testing , I’ll address them immediately.

@Chenglong-MS
Copy link
Collaborator

Thank you very much for your contribution, you implementation is fantastic!

There were quite a lot of dependencies in other parts of the codebase, so I had to do a bit of thorough work in the dev branch for this task (#81).

You are welcome to contribute on new features! 👍

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants