Archivo de la etiqueta: fedora

Instalando Maven en instancia Amazon EC2

Maven es una herramienta de software para la gestión y construcción de proyectos Java Obtenemos maven: $ wget http://apache.saix.net/maven/maven-3/3.2.3/binaries/apache-maven-3.2.3-bin.tar.gz Descomprimimos: $ tar -xzvf apache-maven-3.2.3-bin.tar.gz Movemos la carpeta a un directorio de instalación permanente: $ sudo mv /home/ec2-user/apache-maven-3.2.3 /usr/local/maven Creamos link … Sigue leyendo

Publicado en Uncategorized | Etiquetado , , , | Deja un comentario

Hive: dealing with Out of Memory and Garbage Collector errors.

This is the common error: java.lang.OutOfMemoryError: GC overhead limit exceeded This error will occur in several Java environments, but, in particular, with Hive, is pretty common when big structures or several thousands objects are stored in memory. According to Sun, … Sigue leyendo

Publicado en Uncategorized | Etiquetado , , , | Deja un comentario

Mandus Momberg’s Blog ! – the beauty of BASH

I would like to share with you a new awesome blog from an awesome professional: http://blog.mandusmomberg.com/ And… as a first post, a nice one, about the beauty of BASH: http://blog.mandusmomberg.com/blog/2014/12/01/o-what-a-beautiful-bashing/ Enjoy !

Publicado en Uncategorized | Etiquetado , | Deja un comentario

vi sudo save with root permissions / grabar cambios con permisos de root

Just: :w !sudo tee % % is current file. !sudo tee calls tee with administrator privileges and writes to current file.  But not vi buffered file. That’s why you will see a warning like this when using the command: W12: … Sigue leyendo

Publicado en Uncategorized | Etiquetado , | Deja un comentario

MapReduce: Compression and Input Splits

This is something that always rise doubts: When considering compressed data that will be processed by MapReduce, it is important to check if the compression format supports splitting. If not, the number of map tasks may not be the expected. … Sigue leyendo

Publicado en Uncategorized | Etiquetado , , , | Deja un comentario

yarn: change configuration and restart resource manager on a live cluster

This procedure is to change Yarn configuration on a live cluster, propagate the changes to all the nodes and restart Yarn resource manager. Both commands are listing all the nodes on the cluster and then filtering the DNS name to … Sigue leyendo

Publicado en Uncategorized | Etiquetado , , , , , | Deja un comentario

Hadoop 1 vs Hadoop 2 – How many slots do I have per node ?

This is a topic that always rise a discussion… In Hadoop 1, the number of tasks launched per node was specified via the settings mapred.map.tasks.maximum and mapred.reduce.tasks.maximum. But this is ignored when set on Hadoop 2. In Hadoop 2 with … Sigue leyendo

Publicado en Uncategorized | Etiquetado , , | Deja un comentario