pyspark - spark worker just cannot connect

Question

I am running a spark standalone cluster. My os is centos7 on master as well as on worker. Have set up SPARK_MASTER_HOST, able to start master by running spark-master, able to ssh login from one worker, but when running the command ./start-slave.sh 10.0.0.6:7077(master ip:port) am getting NoRouteToHostException on worker, any idea anybody? I am stuck for really long time, desperate for help.

Okay,I could manage to fix the above by disabling firewall(firewalld in centos) The issue was i have disabled the firewall on worker but the one on master was still alive. Should have realized earlier. Anyways, that could start the worker,but couldnt connect to master. Not able to see the workers in the cluster by http://10.0.0.6:7077,

The log on the worker shows the following:

21/01/22 22:55:21 INFO ResourceUtils: ==============================================================
21/01/22 22:55:21 INFO Utils: Successfully started service 'WorkerUI' on port 8081.
21/01/22 22:55:21 INFO WorkerWebUI: Bound WorkerWebUI to 0.0.0.0, and started at http://slave01:8081
21/01/22 22:55:21 INFO Worker: Connecting to master master:7077...
21/01/22 22:55:21 INFO TransportClientFactory: Successfully created connection to master/10.0.0.6:7077 after 36 ms (0 ms spent in bootstraps)
21/01/22 22:55:26 INFO Worker: Retrying connection to master (attempt # 1)
21/01/22 22:55:26 INFO Worker: Connecting to master master:7077...
21/01/22 22:55:31 INFO Worker: Retrying connection to master (attempt # 2)
21/01/22 22:55:31 INFO Worker: Connecting to master master:7077...
21/01/22 22:55:36 INFO Worker: Retrying connection to master (attempt # 3)
21/01/22 22:55:36 INFO Worker: Connecting to master master:7077...
21/01/22 22:55:41 INFO Worker: Retrying connection to master (attempt # 4)
21/01/22 22:55:41 INFO Worker: Connecting to master master:7077...
21/01/22 22:55:46 INFO Worker: Retrying connection to master (attempt # 5)
21/01/22 22:55:46 INFO Worker: Connecting to master master:7077...
21/01/22 22:55:51 INFO Worker: Retrying connection to master (attempt # 6)
21/01/22 22:55:51 INFO Worker: Connecting to master master:7077...
21/01/22 22:56:24 INFO Worker: Retrying connection to master (attempt # 7)
21/01/22 22:56:24 INFO Worker: Connecting to master master:7077...
21/01/22 22:56:57 INFO Worker: Retrying connection to master (attempt # 8)
21/01/22 22:56:57 INFO Worker: Connecting to master master:7077...
21/01/22 22:57:30 INFO Worker: Retrying connection to master (attempt # 9)
21/01/22 22:57:30 INFO Worker: Connecting to master master:7077...
21/01/22 22:58:03 INFO Worker: Retrying connection to master (attempt # 10)

Thanks and Regards,
Sudip

question from:https://stackoverflow.com/questions/65842650/spark-worker-just-cannot-connect

Answer 1

Waitting for answers