Ubuntu下搭建Spark+Scala+idea-IC+R+Rstudio实践记录
系统版本：ubuntu 14.04 LTS
一、基本命令
sudo -i
gksu nautilus
sudo -i gksu nautilus二、Ubuntu系统软件/插件安装
1、右键菜单添加在终端中打开
sudo apt-get install nautilus-open-terminal
sudo apt-get install nautilus-open-terminal2、“以管理员方式运行……”
sudo apt-get install gksu
sudo apt-get install gksu3、Vim
sudo apt-get install vim
sudo apt-get install vim三、安装JDK
1、官网下载 jdk1.7.0_71 -Linux-64.tar.gz
2、解压到/opt/jdk1.7.0_71，创建连接/opt/java
3、修改/etc/profile
export JAVA_HOME=/opt/java
export JRE_HOME=$JAVA_HOME/jre
export PATH=$PATH:$JAVA_HOME/bin
export CLASSPATH=.:$JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/tools.jar
source /etc/profile
export JAVA_HOME=/opt/java export JRE_HOME=$JAVA_HOME/jre export PATH=$PATH:$JAVA_HOME/bin export CLASSPATH=.:$JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/tools.jar source /etc/profile4、重新载入profile文件
source /etc/profile
source /etc/profile5、验证
java
javac
java -version
java javac java -version四、安装scala
1、官网下载scala-2.11.2.tgz
2、解压到/opt/scala-2.11.2，创建连接/etc/scala
3、修改/etc/profile
export SCALA_HOME=/opt/scala
export PATH=$PATH:$SCALA_HOME/bin
export SCALA_HOME=/opt/scala export PATH=$PATH:$SCALA_HOME/bin4、重新载入profile文件
source /etc/profile
source /etc/profile5、验证
scala
scala五、安装spark
1、官网下载spark-1.1.0-bin-hadoop2.4.tgz
2、解压到/opt/spark-1.1.0-bin-hadoop2.4，创建连接/etc/spark
3、修改/etc/profile
export SPARK_HOME=$HOME/spark-0.7.2
export PATH=$PATH:$SPARK_HOME/bin
export SPARK_HOME=$HOME/spark-0.7.2 export PATH=$PATH:$SPARK_HOME/bin4、修改/home/ypl/.bashrc
注：此处ypl为ubuntu系统用户名。
export PATH=$PATH:/opt/idea-IC/bin
export PATH=$PATH:/opt/idea-IC/bin六、安装R
1、修改/etc/apt/sources.list
deb http://mirror.bjtu.edu.cn/cran/bin/linux/ubuntu trusty/
deb http://mirror.bjtu.edu.cn/cran/bin/linux/ubuntu trusty/2、安装公钥
sudo apt-key adv --keyserver keyserver.ubuntu.com --recv-keys51716619E084DAB9
sudo apt-key adv --keyserver keyserver.ubuntu.com --recv-keys51716619E084DAB93、更新软件列表
sudo apt-get update
sudo apt-get update4、安装r-base
sudo apt-get r-base
sudo apt-get r-base5、测试
R
Rscript
R Rscript七、安装R-studio
1、官网下载rstudio-0.98.1087-amd64-debian.tar.gz
2、解压到/opt/rstudio-0.98.1087，创建连接/opt/rstudio
八、安装idea-IC
1、官网下载ideaIC-13.1.5.tar.gz
2、解压到/opt/idea-IC-135.1289，创建连接/opt/idea-IC
3、修改/home/ypl/.bashrc
export PATH=$PATH:/opt/idea-IC/bin
export PATH=$PATH:/opt/idea-IC/bin4、安装插件scala
6、新建scala工程
7、加入scala libs
8、编译运行