Archivo de la etiqueta: fedora

Adding a mount point to HDFS

Publicado el octubre 30, 2017 por

Before proceeding: This procedure considers that you don’t have any current useful data on HDFS. All the data will be lost after adding mount points with this method. This procedure should be applied to every datanode in the cluster. No … Seguir leyendo →

Publicado en Uncategorized | Etiquetado , , , | Deja un comentario

AWS EMR – Big Data in Strata New York

Publicado el septiembre 23, 2017 por

Will you be in New York next week (Sept 25th – Sept 28th)?                    Come meet the AWS Big Data team at Strata Data Conference, where we’ll be happy to answer your questions, hear about your requirements, and help you … Seguir leyendo →

Publicado en Uncategorized | Etiquetado , , , , , | Deja un comentario

Building and Deploying Apache Bigtop Applications

Publicado el agosto 9, 2016 por

If you want to explore how to build an application for Apache Bigtop and then deploy it using EMR, have a look at this blog post I wrote for Amazon AWS: http://blogs.aws.amazon.com/bigdata/post/TxNJ6YS4X6S59U/Building-and-Deploying-Custom-Applications-with-Apache-Bigtop-and-Amazon-EMR

Publicado en Mis Publicaciones, Uncategorized | Etiquetado , , , | Deja un comentario

Java change default version / cambiar la version Java por defecto

Publicado el agosto 5, 2016 por

If we have more than one Java version installed on your Linux server (Redhat flavor) you can change defaults using ‘alternatives’ command: [hadoop@ip-172-31-36-252 ~]$ sudo /usr/sbin/alternatives –config java There are 2 programs which provide ‘java’.   Selection    Command ———————————————– *+ … Seguir leyendo →

Publicado en Uncategorized | Etiquetado , , | Deja un comentario

monitoring HTTP requests on the fly

Publicado el julio 27, 2016 por

Install httpry: sudo yum install httpry or $ sudo yum install gcc make git libpcap-devel $ git clone https://github.com/jbittel/httpry.git $ cd httpry $ make $ sudo make install then run: sudo httpry -i eth0 Output will be like: httpry version … Seguir leyendo →

Publicado en Uncategorized | Etiquetado , | Deja un comentario

Control Characters on vi Linux editor

Publicado el julio 25, 2016 por

Show hidden/control characters on vi: :set list   Hide hidden/control characters on vi: :set nolist   Replace hidden/control characters on vi: :%s/^M//g :%s/.$//g  

Publicado en Uncategorized | Etiquetado , | Deja un comentario

Indexing Common Crawl Metadata on Elasticsearch using Cascading

Publicado el mayo 28, 2015 por

If you want to explore how to parallelize the data ingestion into Elasticsearch, please have a look to this post I have written for Amazon AWS: http://blogs.aws.amazon.com/bigdata/post/TxC0CXZ3RPPK7O/Indexing-Common-Crawl-Metadata-on-Amazon-EMR-Using-Cascading-and-Elasticsearch It explains how to index Common Crawl metadata into Elasticsearch using Cascading connector … Seguir leyendo →

Publicado en Mis Publicaciones, Uncategorized | Etiquetado , , , , , | Deja un comentario