Impala Install on CentOS 6.4

On the main impala node which also runs the state store:

curl 'http://archive.cloudera.com/impala/redhat/6/x86_64/impala/cloudera-impala.repo' > /etc/yum.repos.d/cloudera-impala.repo; echo "enabled = 1" >> /etc/yum.repos.d/cloudera-impala.repo
yum -y inastall impala-state-store impala-server impala-shell

The cloudera packages create a config directory in /etc/impala. As with all cloudera packages, alternatives is used to select the config dir for the running services:

mkdir -p /etc/impala/conf.yourConfigDir; alternatives --install /etc/impala/conf impala-conf /etc/impala/conf.yourConfigDir 40 && alternatives --set impala-conf /etc/impala/conf.yourConfigDir

Now copy some files to the config dir:

rsync -av /etc/hadoop/conf/core-site.xml /etc/impala/conf/
rsync -av /etc/hadoop/conf/hdfs-site.xml /etc/impala/conf/
rsync -av /etc/hadoop/conf/log4j.properties /etc/impala/conf/
rsync -av /etc/hive/conf/hive-site.xml /etc/impala/conf/

Change some settings in
core-site.xml:

<property> 
<name>dfs.client.read.shortcircuit</name> 
<value>true</value> 
</property> 
<property> 
<name>dfsclient.read.shortcircuit.skip.checksum</name> 
<value>false</value> 
</property>

hdfs-site.xml:

<property>
  <name>dfs.datanode.data.dir.perm</name>
  <value>755</value>
</property>

<property>
  <name>dfs.block.local-path-access.user</name>
  <value>impala,mapred,your user name here</value>
</property>

On the impala worker nodes:
Enable cloudera impala repository as described above.
Install impala-server:

yum -y inastall impala-server

Create the configuration directory and update alternatives:

mkdir -p /etc/impala/conf.yourConfigDir; alternatives --install /etc/impala/conf impala-conf /etc/impala/conf.yourConfigDir 40 && alternatives --set impala-conf /etc/impala/conf.yourConfigDir

Rsync the configuration files from your master node to the worker:

rsync -av root@your_impala_master:/etc/impala/conf/ /etc/impala/conf/

Edit /etc/default/impala to connect to your impala state store server:

IMPALA_STATE_STORE_HOST=your_impala_master
Dieser Beitrag wurde unter /dev/administration veröffentlicht. Setze ein Lesezeichen auf den Permalink.

Schreibe einen Kommentar

Deine E-Mail-Adresse wird nicht veröffentlicht. Erforderliche Felder sind mit * markiert.