My streaming dataflow job(2017-09-08_03_55_43-9675407418829265662
) using Apache Beam SDK for Java 2.1.0
will not scale past 1 Worker even with a growing pubsub queue (now 100k Undelivered messages) – do you have any ideas why?
Its currently running with autoscalingAlgorithm=THROUGHPUT_BASED
and maxNumWorkers=10
.
See Question&Answers more detail:
os 与恶龙缠斗过久,自身亦成为恶龙;凝视深渊过久,深渊将回以凝视…