Skip to content

[Feature Request]: Ability to override the endpoint for Google Cloud Storage #36836

@adamtracymartin

Description

@adamtracymartin

What would you like to happen?

Need ability to override the default endpoint for Google Cloud Storage when testing. I am using TestPipeline, and I am not able to override the GcsEndpoint. For one, setGcsEndpoint has @ JsonIgnore. When TestPipeline.run() is invoked, the following line will not return the GcsEndpoint that I set.
PipelineOptions updatedOptions = MAPPER.convertValue(MAPPER.valueToTree(options), PipelineOptions.class);
I am also not able to override TestPipeline because it has a private constructor.

Issue Priority

Priority: 2 (default / most feature requests should be filed as P2)

Issue Components

  • Component: Python SDK
  • Component: Java SDK
  • Component: Go SDK
  • Component: Typescript SDK
  • Component: IO connector
  • Component: Beam YAML
  • Component: Beam examples
  • Component: Beam playground
  • Component: Beam katas
  • Component: Website
  • Component: Infrastructure
  • Component: Spark Runner
  • Component: Flink Runner
  • Component: Samza Runner
  • Component: Twister2 Runner
  • Component: Hazelcast Jet Runner
  • Component: Google Cloud Dataflow Runner

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions