Monday, January 2, 2017

Setting up Spark-scala development environment

Pre-requisites:

1. Oracle Virtualbox
    Download and install from https://www.virtualbox.org/ and create a ubuntu VM

2. Java1.7 or 1.8

3. Scala 2.x.x (any version)
    Download and install scala. Setup home and PATH
    https://www.scala-lang.org/download/install.html

4. Install sbt from http://www.scala-sbt.org/0.13/docs/Using-sbt.html
    Setup home and path

5. Install and setup spark from
    http://creativelytechie.blogspot.ca/2016/07/steps-to-installing-spark.html
    Ensure version compatibility of spark with scala


5. Eclipse IDE in VM
    Install eclipse IDE (new or upgrade existing eclipse for scala) from 
    http://scala-ide.org/download/prev-stable.html



No comments:

Post a Comment