Requirements

Github account: blog deployed by GitHub Pages
Hexo: blog framework to generate static blog files
MWeb: Markdown writing tool

Setup Github

1. Create a new repository named username.github.io
2. https://username.github.io will be your personal blog address

Basic Functions

1
2
3
4
5
6

sc.parallelize(List(1,2,3,4,5,6)).map(_ * 2).filter(_ > 5).collect()
*** res: Array[Int] = Array(6, 8, 10, 12) ***
val rdd = sc.parallelize(List(1,2,3,4,5,6,7,8,9,10))
rdd.reduce(_+_)
*** res: Int = 55 ***

Apache Spark is an open source cluster computing system that aims to make data analytics fast — both fast to run and fast to write.

BDAS, the Berkeley Data Analytics Stack, is an open source software stack that integrates software components being built by the AMPLab to make sense of Big Data.