I'm trying to run a script in the pyspark environment but so far I haven't been able to.
How can I run a script like python script.py but in pyspark?
python script.py
You can do: ./bin/spark-submit mypythonfile.py
./bin/spark-submit mypythonfile.py
Running python applications through pyspark is not supported as of Spark 2.0.
pyspark
2.1m questions
2.1m answers
60 comments
57.0k users
