I have a crunch dofn which generates a Pcollection currently i m writing the pcollection to a single avro file i want to write the Pcollection to multiple files.
PCollection<String> generatedResults = results.parallelDo(new AvroGeneratorDofn(count),Avros.specifics(String.class));
//generatedResults.write(To.avroFile(outputPath));
pipeline.write(generatedResults,new AvroFileTarget(outputPath), Target.WriteMode.APPEND);
与恶龙缠斗过久,自身亦成为恶龙;凝视深渊过久,深渊将回以凝视…