Hadoop MapReduce Due on 12/13/2020 11:59PM Assignment This project assignment covers the use of Yahoo’s MapReduce framework Hadoop to execute the WordCount application. This assignment will be broken...

Hadoop will be sent shortly



Hadoop MapReduce Due on 12/13/2020 11:59PM Assignment This project assignment covers the use of Yahoo’s MapReduce framework Hadoop to execute the WordCount application. This assignment will be broken down into two parts: 1) setup virtual cluster of 3 nodes and install Hadoop; 2) run 3 applications on Hadoop cluster: 1. Example 1: Calculate Π 2. Example 2: Distributed Grep 3. Example 3: Word Count in Python Instructions on building the Hadoop Cluster and executing all three example applications are provided in the slides. Requirements · Build a Hadoop cluster with one master node and two worker nodes · Successfully run application example 1 to calculate Π · Successfully run application example 2 to grep information from large amount of files · Successfully WordCount application using Hadoop MapReduce Please feel free to make any necessary modifications to the original source code to support your additional functionalities. · You need to submit a report, the report should include following sections: · Introduction · Implementation of your Hadoop cluster (Step by step configuration with screenshots) · Test: test your WordCount application with different input files. (with screenshots) Deliverables You need to submit an IEEE format report on BlackBoard You need to submit all the source code as a zip file on BlackBoard 1 Grading · Report format (10%) · Implementation (50%) • · Test (40%) 2