Fix too-many-pings on FnAPI runner under grpc mode #37013
Merged
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
GRPC error as in https://github.com/apache/beam/actions/runs/19958369481/job/57232567333. Notice Python Precommit ML is running on FnAPI runner not prism, as Go environment is not set up in the workflow:
beam/.github/workflows/beam_PreCommit_Python_ML.yml
Lines 109 to 113 in 6aab0af
The error message:
I also notice that the change on
sdks/python/apache_beam/utils/subprocess_server.pyin #36528 may not be effective. Even though the file and class name has "server", it is actually a grpc client which connects to the grpc server endpoint (https://github.com/liferoad/beam/blob/782a0e7cc26e582c31534253fa5a00018bce4c38/sdks/python/apache_beam/utils/subprocess_server.py#L202).If this fix works (getting rid of too-many-pings errors in precommits), we may also tune the setting on PrismRunner.
Some references: