mirror of
https://github.com/linkedin/school-of-sre
synced 2026-01-06 16:48:02 +00:00
15 lines
840 B
Markdown
15 lines
840 B
Markdown
# Tasks and conclusion
|
|
|
|
## Post-training tasks:
|
|
|
|
1. Try setting up your own 3 node Hadoop cluster.
|
|
1. A VM based solution can be found [here](http://hortonworks.com/wp-content/uploads/2015/04/Import_on_VBox_4_07_2015.pdf)
|
|
2. Write a simple spark/MR job of your choice and understand how to generate analytics from data.
|
|
1. Sample dataset can be found [here](https://grouplens.org/datasets/movielens/)
|
|
|
|
## References:
|
|
1. [Hadoop documentation](http://hadoop.apache.org/docs/current/)
|
|
2. [HDFS Architecture](http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/HdfsDesign.html)
|
|
3. [YARN Architecture](http://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-site/YARN.html)
|
|
4. [Google GFS paper](https://storage.googleapis.com/pub-tools-public-publication-data/pdf/035fc972c796d33122033a0614bc94cff1527999.pdf)
|