Hue Installation and Configuration

Hi,

Here is the outcome of the final exercise of Unit 2 of my training.

Hue is an open-source Web interface that supports Apache Hadoop and its ecosystem, licensed under the Apache v2 license.

This is one of the painful exercise we have done so far in the Hadoop eco system. Because it uses python compilation process as part of the installment. It has n number of dependencies as well. Hence we need to browse to find the right dependencies to make it working. I have given those dependencies below.

Download and extraction

hadoop@gandhari:~$ wget https://archive.cloudera.com/cdh5/cdh/5/hue-3.9.0-cdh5.5.1.tar.gz

hadoop@gandhari:~$ gunzip hue-3.9.0-cdh5.5.1.tar.gz

hadoop@gandhari:~$ tar -xvf hue-3.9.0-cdh5.5.1.tar

hadoop@gandhari:~$ ln -s hue-3.9.0-cdh5.5.1/ hue

Make process

hadoop@gandhari:~/hue$ sudo apt-get install libxml2-dev libxslt1-dev

hadoop@gandhari:~/hue$ sudo apt-get install lib32z1-dev

hadoop@gandhari:~/hue$ sudo apt-get install libssl-dev

hadoop@gandhari:~/hue$ sudo apt-get install python2.7-dev

hadoop@gandhari:~/hue$ sudo apt-get install python-dev

hadoop@gandhari:~/hue$ sudo apt-get install gcc libxml2-dev libxslt-dev libsasl2-dev libsasl2-modules-gssapi-mit libmysqlclient-dev python-dev python-setuptools python-simplejson libsqlite3-dev ant

hadoop@gandhari:~/hue$ sudo ln -s /usr/lib/python2.7/plat-*/_sysconfigdata_nd.py /usr/lib/python2.7/

hadoop@gandhari:~/hue$ make apps

Pls make sure the make process is completed successfully without any error.

Hue console configuration

hadoop@gandhari:~/hue$ ./build/env/bin/hue runserver

Starting development server at http://127.0.0.1:8000/

hadoop@gandhari:~/hue$ vi desktop/conf/hue.ini

[[yarn_clusters]]
[[[default]]]
resourcemanager_host=gandhari
submit_to=True
resourcemanager_api_url=http://gandhari:8088
history_server_api_url=http://gandhari:19888

[beeswax]

hive_server_host=gandhari

hadoop@gandhari:~/hive/bin$ hive –service metastore
hadoop@gandhari:~/hive/bin$ hive –service hiveserver2

[hadoop]

fs_defaultfs=hdfs://gandhari:9000
webhdfs_url=http://gandhari:50070/webhdfs/v1
resourcemanager_host=gandhari
resourcemanager_api_url=http://gandhari:8088
history_server_api_url=http://gandhari:19888