Sistema para generar gráficas a partir de logs tcpdump usando hadoop

The size of the logs to be processed is relatively large, so we need a massive processing of these data, we use the schema for MapReduce through Hadoop Framework. A system that generates graphs from a processing and analyzing tcpdump logs. We analyzed the data to be processed by the system, there is...

Full description

Saved in:
Bibliographic Details
Main Author: Cruz, Ángel (author)
Other Authors: Torres, Pedro (author), Abad, Cristina (author)
Format: article
Language:spa
Published: 2009
Subjects:
Online Access:http://www.dspace.espol.edu.ec/handle/123456789/7732
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:The size of the logs to be processed is relatively large, so we need a massive processing of these data, we use the schema for MapReduce through Hadoop Framework. A system that generates graphs from a processing and analyzing tcpdump logs. We analyzed the data to be processed by the system, there is a brief description of the format of logs and convert them. We propose the design of the solution, the tools we use to develop the system, it explains how MapReduce works phases in our solution. We detail the implementation and operation of the system described tests on Amazon Web services and the results obtained. Finally, we present the conclusions obtained with the development of the scheme MapReduce system.