Skip to content

Experiment: Translating Azure SDK mgmt. plane Scenario Tests from .NET to Python #44864

@lirenhe

Description

@lirenhe

With the evolution of LLMs, we are seeing significantly improved semantic understanding of SDK code, especially when it comes to end-to-end service usage and scenario-driven flows rather than isolated API calls.

In the Azure SDK today:

The .NET SDK mgmt. SDK has relatively rich scenario test coverage that exercises real-world service workflows.

And the Python mgmt. SDK largely lacks equivalent scenario tests, which limits:

Confidence in SDK correctness from a user-workflow perspective
Cross-language consistency of SDK usage patterns
This also impacts LLMs in learning and explaining python SDK service scenarios.

Proposal:
Run an experiment to verify whether Azure SDK mgmt. plane scenario tests written in .NET can be translated into Python SDK scenario tests, with acceptable quality and maintainability.
The goal is to validate feasibility and identify constraints to build the base for large-scale adoption to fill the gap.

For the Initial Experiment, select 2-3 representative services that already have the well-defined .NET management-plane scenario tests and Python SDK support, then translate all their scenario tests into python.

Metadata

Metadata

Assignees

Labels

MgmtThis issue is related to a management-plane library.test-enhancement

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions