Archiv der Kategorie: /dev/administration

Python murmur hash package mmh3 and „undefined symbol: __gxx_personality_v0“ [FIX]

Got this error while trying to use this package with pypy-2.2.1. Solved it by downloading the tar from here and building/installing it with:

Veröffentlicht unter /dev/administration | Hinterlasse einen Kommentar

Logstash webhdfs plugin

While working on my GambolPutty project, I also did some testing with the awesome logstash tool. One of the requirements here at dbap was that events should be analyzed at one single point, then stored in elasticsearch for real time … Weiterlesen

Veröffentlicht unter /dev/administration | Hinterlasse einen Kommentar

Collect, parse and visualize your logs with LumberMill, Elasticsearch and Kibana on CentOS, Part I

With the arrival of lucene as search platform for all kinds of data, Admins around the world started to put their log data into these datastores. Logshippers were created, that received raw logdata, parsed this data and then stored it … Weiterlesen

Veröffentlicht unter /dev/administration | Hinterlasse einen Kommentar

Make sure rpms from master are installed on clone (rpm based systems)

Get list of installed rpms on master (without version info) and rsync it to clone: rpm -qa –queryformat „%{NAME}\n“|sort -n > master_rpms.txt rsync -av ./master_rpms.txt $clone:/tmp/ Get list of installed rpms on clone (without version info): rpm -qa –queryformat „%{NAME}\n“|sort … Weiterlesen

Veröffentlicht unter /dev/administration | Verschlagwortet mit | Hinterlasse einen Kommentar

Oracle jre and CentOS alternatives

wget –no-cookies –no-check-certificate –header „Cookie: gpw_e24=http%3A%2F%2Fwww.oracle.com%2F; oraclelicense=accept-securebackup-cookie“ ‚http://download.oracle.com/otn-pub/java/jdk/8u20-b26/server-jre-8u20-linux-x64.tar.gz‘ tar -xvzf server-jre-8u20-linux-x64.tar.gz mkdir -p /usr/java && mv jdk1.8.0_20 /usr/java ln -fs /usr/java/jdk1.8.0_20 /usr/java/latest ln -fs /usr/java/jdk1.8.0_20 /usr/java/default alternatives –install /usr/bin/java java /usr/java/latest/bin/java 2000 alternatives –set java /usr/java/latest/bin/java

Veröffentlicht unter /dev/administration | Hinterlasse einen Kommentar

ClouderaManager hive „Class org.apache.hadoop.hive.contrib.serde2.RegexSerDe not found“

1. Select Service > Hive 2. Select Configuration Tab (View and edit) 3. Open service-wide 4. Select advanced 5. Select hive-site.xml safety valve 6. Copy paste (path to jars may differ): <property> <name>hive.aux.jars.path</name> <value>/opt/cloudera/parcels/CDH-4.2.1-1.cdh4.2.1.p0.5/lib/hive/lib/hive-contrib-0.10.0-cdh4.2.1.jar,/opt/cloudera/parcels/CDH-4.2.1-1.cdh4.2.1.p0.5/lib/hive/lib/hive-hbase-handler-0.10.0-cdh4.2.1.jar,/opt/cloudera/parcels/CDH-4.2.1-1.cdh4.2.1.p0.5/lib/hive/lib/hbase.jar,/opt/cloudera/parcels/CDH-4.2.1-1.cdh4.2.1.p0.5/lib/hive/lib/zookeeper.jar</value> <description>A comma separated list (with no … Weiterlesen

Veröffentlicht unter /dev/administration | Hinterlasse einen Kommentar

Impala Install on CentOS 6.4

On the main impala node which also runs the state store: curl ‚http://archive.cloudera.com/impala/redhat/6/x86_64/impala/cloudera-impala.repo‘ > /etc/yum.repos.d/cloudera-impala.repo; echo „enabled = 1“ >> /etc/yum.repos.d/cloudera-impala.repo yum -y inastall impala-state-store impala-server impala-shell The cloudera packages create a config directory in /etc/impala. As with all cloudera … Weiterlesen

Veröffentlicht unter /dev/administration | Hinterlasse einen Kommentar

Hadoop with pydoop on CentOS 6.4

Using pydoop instead of the streaming interface and MRJob results in a massive performance boost. I ran a simple wordcount job with a bit of regex matching on ~2GB of text data. Using the streaming interface the job took about … Weiterlesen

Veröffentlicht unter /dev/administration | Hinterlasse einen Kommentar

Black screen in HP Lo-100 virtual kvm on ELRepo.org 3.7.6 kernels [FIX]

Updated some HP Proliant-Server to a 3.7.6 Kernel. After booting, all was fine except that the Java KVM tool showed just a black login screen. To fix this, force the kernel to boot in textmode only: edit /etc/grub.conf and remove … Weiterlesen

Veröffentlicht unter /dev/administration | Hinterlasse einen Kommentar

Sieve vacation plugin: discarding vacation response for message implicitly delivered to [FIX]

This message shows up in the log when sieve vacation is enabled for an account but the mail was addressed to an alias rather than to the original address. This behaviour is not a bug, it’s an RFC (which in … Weiterlesen

Veröffentlicht unter /dev/administration | Verschlagwortet mit , , | 1 Kommentar