[#11292][feat] use smg-grpc-proto package for gRPC proto definitions

[CatherineSue]

Summary by CodeRabbit

Release Notes

• Refactor
  • Migrated gRPC protobuf definitions to an external dependency package for improved maintainability and consistency.
  • Simplified build process by removing custom protobuf compilation steps during installation.
  • Updated imports to use centralized protobuf definitions from the dependency package.

Description

Replace local proto file, generated stubs, and compile script with the smg-grpc-proto PyPI package.

Proto definitions are now owned by SMG (Shepherd Model Gateway) and published as a versioned package, providing a single source of truth across SGLang, vLLM, and TensorRT-LLM. This is the same migration pattern already applied to SGLang and vLLM upstream.

Changes:

• Add smg-grpc-proto>=0.3.3 to requirements.txt (requires grpcio>=1.78.0, protobuf>=5.26.0)
• Remove local trtllm_service.proto and compile_protos.py from tensorrt_llm/grpc/
• Update tensorrt_llm/grpc/__init__.py to import pb2 modules from smg_grpc_proto.generated (all downstream files continue using from tensorrt_llm.grpc import ... unchanged)
• Remove BuildPyWithProtoCompile custom build hook from setup.py

What stays the same:

• grpc_servicer.py, grpc_request_manager.py, serve.py, test_grpc.py — zero code changes (imports resolve through __init__.py re-export)
• All gRPC server behavior is unchanged

Context: Follow-up to #11292 which added the gRPC server. See smg-grpc-proto on PyPI and the ownership plan.

Test Coverage

• Existing tests/unittest/llmapi/test_grpc.py covers proto message construction, sampling params conversion, and end-to-end gRPC service flow — all unchanged and passing
• Pre-commit hooks pass on all modified files

PR Checklist

Please review the following before submitting your PR:

• PR description clearly explains what and why. If using CodeRabbit's summary, please make sure it makes sense.

• PR Follows TRT-LLM CODING GUIDELINES to the best of your knowledge.

• Test cases are provided for new code paths (see test instructions)

• Any new dependencies have been scanned for license and vulnerabilities

• CODEOWNERS updated if ownership changes

• Documentation updated as needed

• Update tava architecture diagram if there is a significant design change in PR.

• The reviewers assigned automatically/manually are appropriate for the PR.

• Please check this after reviewing the above items as appropriate for this PR.

[coderabbitai]

📝 Walkthrough

Walkthrough

The changes migrate gRPC protobuf definitions from locally-managed source files to an external dependency package (smg-grpc-proto). The custom build process that compiled protobufs during setup is removed, and local proto definitions are replaced with imports from the external package.

Changes

Cohort / File(s)	Summary
Build and Dependency Management requirements.txt, setup.py	Added smg-grpc-proto>=0.3.3 as a runtime dependency; removed custom setuptools build_py command (BuildPyWithProtoCompile class) that previously compiled gRPC protobufs during package builds.
Proto Module Imports tensorrt_llm/grpc/__init__.py	Switched protobuf imports from locally-generated modules to smg_grpc_proto.generated package; removed local proto file path constants (GRPC_MODULE_DIR, PROTO_FILE) and runtime proto compilation/verification functions (compile_protos, ensure_protos_available).
Removed Local Proto Infrastructure tensorrt_llm/grpc/compile_protos.py, tensorrt_llm/grpc/trtllm_service.proto	Deleted proto compilation script and original proto definitions file, as these are now provided by the external smg-grpc-proto package.

Estimated code review effort

🎯 3 (Moderate) | ⏱️ ~22 minutes

🚥 Pre-merge checks | ✅ 3

✅ Passed checks (3 passed)

Check name	Status	Explanation
Title check	✅ Passed	The title accurately summarizes the main change: migrating from local gRPC proto definitions to using the smg-grpc-proto package.
Docstring Coverage	✅ Passed	No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Description check	✅ Passed	PR description comprehensively covers all required template sections with clear explanations of changes, rationale, test coverage, and checklist completion.

_{✏️ Tip: You can configure your own custom pre-merge checks in the settings.}

✨ Finishing Touches

• 📝 Generate docstrings

🧪 Generate unit tests (beta)

• Create PR with unit tests
• Post copyable unit tests in a comment

---

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

• X
• Mastodon
• Reddit
• LinkedIn

_{Comment @coderabbitai help to get the list of available commands and usage tips.}

[coderabbitai]

Caution

Some comments are outside the diff and can’t be posted inline due to platform limitations.

⚠️ Outside diff range comments (1)

tensorrt_llm/grpc/__init__.py (1)

1-1: ⚠️ Potential issue | 🟡 Minor

Update copyright year to 2026.

The file is meaningfully modified by this PR. Per coding guidelines, the NVIDIA copyright header must reflect the year of latest meaningful modification.

🛠️ Proposed fix

-# SPDX-FileCopyrightText: Copyright (c) 2024 NVIDIA CORPORATION & AFFILIATES. All rights reserved.
+# SPDX-FileCopyrightText: Copyright (c) 2024-2026 NVIDIA CORPORATION & AFFILIATES. All rights reserved.

As per coding guidelines: "All source files must contain an NVIDIA copyright header with the year of latest meaningful modification."

🤖 Prompt for AI Agents

Verify each finding against the current code and only fix it if needed.

In `@tensorrt_llm/grpc/__init__.py` at line 1, Update the SPDX copyright header in
tensorrt_llm/grpc/__init__.py to reflect the latest meaningful modification year
2026 by changing the year in the existing header line (the SPDX/ copyright
comment at the top of the file).

🤖 Prompt for all review comments with AI agents

Verify each finding against the current code and only fix it if needed.

Outside diff comments:
In `@tensorrt_llm/grpc/__init__.py`:
- Line 1: Update the SPDX copyright header in tensorrt_llm/grpc/__init__.py to
reflect the latest meaningful modification year 2026 by changing the year in the
existing header line (the SPDX/ copyright comment at the top of the file).

[juney-nvidia]

LGTM

[juney-nvidia]

/bot run

[tensorrt-cicd]

PR_Github #36225 [ run ] triggered by Bot. Commit: 92a6645 Link to invocation

[tensorrt-cicd]

PR_Github #36225 [ run ] completed with state SUCCESS. Commit: 92a6645
/LLM/main/L0_MergeRequest_PR pipeline #28005 completed with status: 'FAILURE'

⚠️ Action Required:

• Please check the failed tests and fix your PR
• If you cannot view the failures, ask the CI triggerer to share details
• Once fixed, request an NVIDIA team member to trigger CI again

Link to invocation

[tburt-nv]

/bot run --disable-fail-fast

[tensorrt-cicd]

PR_Github #36253 [ run ] triggered by Bot. Commit: 92a6645 Link to invocation

[tensorrt-cicd]

PR_Github #36253 [ run ] completed with state SUCCESS. Commit: 92a6645
/LLM/main/L0_MergeRequest_PR pipeline #28030 completed with status: 'FAILURE'

⚠️ Action Required:

• Please check the failed tests and fix your PR
• If you cannot view the failures, ask the CI triggerer to share details
• Once fixed, request an NVIDIA team member to trigger CI again

Link to invocation

[juney-nvidia]

/bot run --disable-fail-fast

[tensorrt-cicd]

PR_Github #36309 [ run ] triggered by Bot. Commit: 92a6645 Link to invocation

[tensorrt-cicd]

PR_Github #36309 [ run ] completed with state SUCCESS. Commit: 92a6645
/LLM/main/L0_MergeRequest_PR pipeline #28082 completed with status: 'SUCCESS'

Link to invocation