Beam is using both Google's auto/value and auto/service tools.
I want to run a pipeline with Dataflow runner and data is stored on Google Cloud Storage.
I've added a dependencies:
<dependency>
<groupId>org.apache.beam</groupId>
<artifactId>beam-runners-google-cloud-dataflow-java</artifactId>
<version>2.0.0</version>
</dependency>
<dependency>
<groupId>org.apache.beam</groupId>
<artifactId>beam-sdks-java-extensions-google-cloud-platform-core</artifactId>
<version>2.0.0</version>
</dependency>
I'm able to start the pipeline from the IntelliJ. But when the jar is compiled through a mvn package
and run with java -jar
it throws an error:
java.lang.IllegalStateException: Unable to find registrar for gs
The fatjar is package with maven-assembly-plugin
. GcsFileSystemRegistrar
class is in the jar.
See Question&Answers more detail:
os 与恶龙缠斗过久,自身亦成为恶龙;凝视深渊过久,深渊将回以凝视…