mirror of
https://github.com/linkedin/school-of-sre
synced 2026-01-20 23:48:03 +00:00
Deployed 3bfbf06 with MkDocs version: 1.1.2
This commit is contained in:
@@ -36,6 +36,8 @@
|
||||
|
||||
|
||||
|
||||
<link rel="stylesheet" href="../../stylesheets/custom.css">
|
||||
|
||||
|
||||
|
||||
|
||||
@@ -552,13 +554,13 @@
|
||||
|
||||
<input class="md-nav__toggle md-toggle" data-md-toggle="nav-4-1" type="checkbox" id="nav-4-1" >
|
||||
<label class="md-nav__link" for="nav-4-1">
|
||||
NoSQL Concepts
|
||||
NoSQL
|
||||
<span class="md-nav__icon md-icon"></span>
|
||||
</label>
|
||||
<nav class="md-nav" aria-label="NoSQL Concepts" data-md-level="2">
|
||||
<nav class="md-nav" aria-label="NoSQL" data-md-level="2">
|
||||
<label class="md-nav__title" for="nav-4-1">
|
||||
<span class="md-nav__icon md-icon"></span>
|
||||
NoSQL Concepts
|
||||
NoSQL
|
||||
</label>
|
||||
<ul class="md-nav__list" data-md-scrollfix>
|
||||
|
||||
@@ -704,7 +706,7 @@
|
||||
|
||||
<li class="md-nav__item">
|
||||
<a href="../evolution/" class="md-nav__link">
|
||||
Evolution and Architecure of Hadoop
|
||||
Evolution and Architecture of Hadoop
|
||||
</a>
|
||||
</li>
|
||||
|
||||
@@ -996,7 +998,7 @@
|
||||
<li>Basic understanding of System Design.</li>
|
||||
</ul>
|
||||
<h2 id="what-to-expect-from-this-course">What to expect from this course</h2>
|
||||
<p>This course covers the basics of Big Data and how it has evolved to become what it is today. We will take a look at a few realistic scenarios where Big Data would be a perfect fit. An interesting assignment on designing a Big Data system is followed by understanding the architecture of Hadoop and the tooling around it. </p>
|
||||
<p>This course covers the basics of Big Data and how it has evolved to become what it is today. We will take a look at a few realistic scenarios where Big Data would be a perfect fit. An interesting assignment on designing a Big Data system is followed by understanding the architecture of Hadoop and the tooling around it.</p>
|
||||
<h2 id="what-is-not-covered-under-this-course">What is not covered under this course</h2>
|
||||
<p>Writing programs to draw analytics from data.</p>
|
||||
<h2 id="course-contents">Course Contents</h2>
|
||||
@@ -1021,7 +1023,7 @@
|
||||
</ol>
|
||||
<h1 id="overview-of-big-data">Overview of Big Data</h1>
|
||||
<ol>
|
||||
<li>Big Data is a collection of large datasets that cannot be processed using traditional computing techniques. It is not a single technique or a tool, rather it has become a complete subject, which involves various tools, techniques and frameworks.</li>
|
||||
<li>Big Data is a collection of large datasets that cannot be processed using traditional computing techniques. It is not a single technique or a tool, rather it has become a complete subject, which involves various tools, techniques, and frameworks.</li>
|
||||
<li>Big Data could consist of<ol>
|
||||
<li>Structured data</li>
|
||||
<li>Unstructured data</li>
|
||||
@@ -1042,12 +1044,12 @@
|
||||
<li>Take the example of the traffic lights problem.<ol>
|
||||
<li>There are more than 300,000 traffic lights in the US as of 2018.</li>
|
||||
<li>Let us assume that we placed a device on each of them to collect metrics and send it to a central metrics collection system.</li>
|
||||
<li>If each of the IOT devices sends 10 events per minute, we have 300000x10x60x24 = 432x10^7 events per day.</li>
|
||||
<li>If each of the IoT devices sends 10 events per minute, we have 300000x10x60x24 = 432x10^7 events per day.</li>
|
||||
<li>How would you go about processing that and telling me how many of the signals were “green” at 10:45 am on a particular day?</li>
|
||||
</ol>
|
||||
</li>
|
||||
<li>Consider the next example on Unified Payments Interface (UPI) transactions:<ol>
|
||||
<li>We had about 1.15 billion UPI transactions in the month of October, 2019 in India.</li>
|
||||
<li>We had about 1.15 billion UPI transactions in the month of October 2019 in India.</li>
|
||||
<li>If we try to extrapolate this data to about a year and try to find out some common payments that were happening through a particular UPI ID, how do you suggest we go about that?</li>
|
||||
</ol>
|
||||
</li>
|
||||
@@ -1091,7 +1093,7 @@
|
||||
<span class="md-footer-nav__direction">
|
||||
Next
|
||||
</span>
|
||||
Evolution and Architecure of Hadoop
|
||||
Evolution and Architecture of Hadoop
|
||||
</div>
|
||||
</div>
|
||||
<div class="md-footer-nav__button md-icon">
|
||||
|
||||
Reference in New Issue
Block a user