GitHub/school-of-sre
1
0
Fork 0
mirror of https://github.com/linkedin/school-of-sre synced 2026-01-20 15:38:03 +00:00
Code Issues Packages Projects Releases Wiki Activity

Deployed 4239ecf with MkDocs version: 1.2.3

Browse Source
This commit is contained in:
github-actions
2024-07-28 12:08:43 +00:00
parent f44a0152c4
commit a6af87660e
61 changed files with 1686 additions and 1410 deletions
Download Patch File Download Diff File Expand all files Collapse all files

12
level101/big_data/intro/index.html
View File

@@ -2205,22 +2205,22 @@
<h2 id="course-contents">Course Contents</h2>
<ol>
<li><a href="https://linkedin.github.io/school-of-sre/level101/big_data/intro/#overview-of-big-data">Overview of Big Data</a></li>
<li><a href="https://linkedin.github.io/school-of-sre/level101/big_data/intro/#usage-of-big-data-techniques">Usage of Big Data techniques</a></li>
<li><a href="https://linkedin.github.io/school-of-sre/level101/big_data/intro/#usage-of-big-data-techniques">Usage of Big Data Techniques</a></li>
<li><a href="https://linkedin.github.io/school-of-sre/level101/big_data/evolution/">Evolution of Hadoop</a></li>
<li><a href="https://linkedin.github.io/school-of-sre/level101/big_data/evolution/#architecture-of-hadoop">Architecture of hadoop</a><ol>
<li><a href="https://linkedin.github.io/school-of-sre/level101/big_data/evolution/#architecture-of-hadoop">Architecture of Hadoop</a><ol>
<li>HDFS</li>
<li>Yarn</li>
</ol>
</li>
<li><a href="https://linkedin.github.io/school-of-sre/level101/big_data/evolution/#mapreduce-framework">MapReduce framework</a></li>
<li><a href="https://linkedin.github.io/school-of-sre/level101/big_data/evolution/#other-tooling-around-hadoop">Other tooling around hadoop</a><ol>
<li><a href="https://linkedin.github.io/school-of-sre/level101/big_data/evolution/#mapreduce-framework">MapReduce Framework</a></li>
<li><a href="https://linkedin.github.io/school-of-sre/level101/big_data/evolution/#other-tooling-around-hadoop">Other Tooling Around Hadoop</a><ol>
<li>Hive</li>
<li>Pig</li>
<li>Spark</li>
<li>Presto</li>
</ol>
</li>
<li><a href="https://linkedin.github.io/school-of-sre/level101/big_data/evolution/#data-serialisation-and-storage">Data Serialisation and storage</a></li>
<li><a href="https://linkedin.github.io/school-of-sre/level101/big_data/evolution/#data-serialisation-and-storage">Data Serialization and Storage</a></li>
</ol>
<h1 id="overview-of-big-data">Overview of Big Data</h1>
<ol>
@@ -2245,7 +2245,7 @@
<li>Take the example of the traffic lights problem.<ol>
<li>There are more than 300,000 traffic lights in the US as of 2018.</li>
<li>Let us assume that we placed a device on each of them to collect metrics and send it to a central metrics collection system.</li>
<li>If each of the IoT devices sends 10 events per minute, we have 300000x10x60x24 = 432x10^7 events per day.</li>
<li>If each of the IoT devices sends 10 events per minute, we have <code>300000 x 10 x 60 x 24 = 432 x 10 ^ 7</code> events per day.</li>
<li>How would you go about processing that and telling me how many of the signals were “green” at 10:45 am on a particular day?</li>
</ol>
</li>