Introduction to Hadoop Administration

In this part of the MapReduce tutorial you will learn about the Hadoop administration aspects, MapReduce job monitoring and more.

What is Hadoop Administration?

Hdfs administration and MapReduce administration, both concepts come under hadoop admin online course

• Hdfs administration: It includes monitoring the HDFS file structure, location and updated files.
• Mapreduce administration: it includes monitoring the list of applications, configuration of nodes, application status.

We are using put and get commands for storing and fetching the data.

We can see the below screenshot using the url to the browser <http://localhost:50070> after passing the command “start-all.sh” on “/$HADOOP_HOME/sbin”.

Hdfs administration

We are using put and get commands for storing and fetching the data.

We can see the below screenshot using the url to the browser <http://localhost:50070> after passing the command “start-all.sh” on “/$HADOOP_HOME/sbin”.

We can see the files in the “/user/hadoop” directory in this screen shot.

Datanode information in a cluster

Mapreduce job monitoring:

The most two important things in this concept are

• Suitable datanode configuration in application
• For each application, number of datanodes and resources

We can see the below screen shot using the url to the browser http://localhost:8080/ after passing the command “start-all.sh” on “/$HADOOP_HOME/sbin”.

We can see the current running node information in the below screenshot.