Sistema para generar gráficas a partir de logs tcpdump usando hadoop

The size of the logs to be processed is relatively large, so we need a massive processing of these data, we use the schema for MapReduce through Hadoop Framework. A system that generates graphs from a processing and analyzing tcpdump logs. We analyzed the data to be processed by the system, there is...

Descrición completa

Gardado en:
Detalles Bibliográficos
Autor Principal: Cruz, Ángel (author)
Outros autores: Torres, Pedro (author), Abad, Cristina (author)
Formato: article
Idioma:spa
Publicado: 2009
Subjects:
Acceso en liña:http://www.dspace.espol.edu.ec/handle/123456789/7732
Tags: Engadir etiqueta
Sen Etiquetas, Sexa o primeiro en etiquetar este rexistro!
Descripción
Summary:The size of the logs to be processed is relatively large, so we need a massive processing of these data, we use the schema for MapReduce through Hadoop Framework. A system that generates graphs from a processing and analyzing tcpdump logs. We analyzed the data to be processed by the system, there is a brief description of the format of logs and convert them. We propose the design of the solution, the tools we use to develop the system, it explains how MapReduce works phases in our solution. We detail the implementation and operation of the system described tests on Amazon Web services and the results obtained. Finally, we present the conclusions obtained with the development of the scheme MapReduce system.