-
Notifications
You must be signed in to change notification settings - Fork 3.2k
Description
With the evolution of LLMs, we are seeing significantly improved semantic understanding of SDK code, especially when it comes to end-to-end service usage and scenario-driven flows rather than isolated API calls.
In the Azure SDK today:
The .NET SDK mgmt. SDK has relatively rich scenario test coverage that exercises real-world service workflows.
And the Python mgmt. SDK largely lacks equivalent scenario tests, which limits:
Confidence in SDK correctness from a user-workflow perspective
Cross-language consistency of SDK usage patterns
This also impacts LLMs in learning and explaining python SDK service scenarios.
Proposal:
Run an experiment to verify whether Azure SDK mgmt. plane scenario tests written in .NET can be translated into Python SDK scenario tests, with acceptable quality and maintainability.
The goal is to validate feasibility and identify constraints to build the base for large-scale adoption to fill the gap.
For the Initial Experiment, select 2-3 representative services that already have the well-defined .NET management-plane scenario tests and Python SDK support, then translate all their scenario tests into python.