Welcome to OStack Knowledge Sharing Community for programmer and developer-Open, Learning and Share
Welcome To Ask or Share your Answers For Others

Categories

0 votes
729 views
in Technique[技术] by (71.8m points)

scala - How to access local files in Spark on Windows?

I am using Spark on Windows. I know in *nix, accessing local file code likes this:

val textFile = sc.textFile("file:///usr/local/spark/README.md") 

But how can I access a local file on Windows? I have tried following methods:

val logFile = "C:spark-1.3.1-bin-hadoop2.4README.md"
val logFile = "file\C:spark-1.3.1-bin-hadoop2.4README.md"

But all can't work.

See Question&Answers more detail:os

与恶龙缠斗过久,自身亦成为恶龙;凝视深渊过久,深渊将回以凝视…
Welcome To Ask or Share your Answers For Others

1 Answer

0 votes
by (71.8m points)

Unfortunately in windows you have to escape "".

Try:

"C:\spark-1.3.1-bin-hadoop2.4\README.md"

与恶龙缠斗过久,自身亦成为恶龙;凝视深渊过久,深渊将回以凝视…
Welcome to OStack Knowledge Sharing Community for programmer and developer-Open, Learning and Share
Click Here to Ask a Question

...