Hive install on Ubuntu，并以Mysql作为Metastore

安装配置Hive虽然比较简单，但是网上的资料各种坑，总结下来写下本文作为成功后的记录。

下载与放置

Hive

Hive下载地址

1
2
3
4
5
$ sudo tar xzvf apache-hive-2.1.1-bin.tar.gz -C /usr/local
$ cd /usr/local
$ sudo mv apache-hive-2.1.1-bin/ hive
$ sudo chown hadoop@hadoop -R hive
$

mysql

$ sudo apt-get install mysql-server

mysql Java连接

$ sudo apt-get install libmysql-java
并创建软连接
$ ln -s /usr/share/java/mysql-connector-java.jar $HIVE_HOME/lib/mysql-connector-java.jar

环境变量

在~/.profile里添加

1
2
export HIVE_HOME=/usr/local/hive
export PATH=$PATH:$HIVE_HOME/bin

并source ~/.profile

建表与连接

初始表格

在mysql里创建数据库，格式同hive-schema-2.1.0.mysql.sql ，这里依据你的版本号来

1
2
3
4
5
$ mysql -u root -p
Enter password:
mysql> CREATE DATABASE metastore;
mysql> USE metastore;
mysql> SOURCE /usr/local/hive/scripts/metastore/upgrade/mysql/hive-schema-2.1.0.mysql.sql;;

创建用户并给予权限

1
2
3
mysql> CREATE USER 'hiveuser'@'%' IDENTIFIED BY 'hivepassword'; 
mysql> GRANT all on *.* to 'hiveuser'@localhost identified by 'hivepassword';
mysql>  flush privileges;

hive-site.xml

在$HIVE_HOME/conf文件夹创建hive-site.xml文件，配置如下

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
<configuration>
   <property>
      <name>javax.jdo.option.ConnectionURL</name>
      <value>jdbc:mysql://localhost/metastore?createDatabaseIfNotExist=true</value>
      <description>metadata is stored in a MySQL server</description>
   </property>
   <property>
      <name>javax.jdo.option.ConnectionDriverName</name>
      <value>com.mysql.jdbc.Driver</value>
      <description>MySQL JDBC driver class</description>
   </property>
   <property>
      <name>javax.jdo.option.ConnectionUserName</name>
      <value>hiveuser</value>
      <description>user name for connecting to mysql server</description>
   </property>
   <property>
      <name>javax.jdo.option.ConnectionPassword</name>
      <value>hivepassword</value>
      <description>password for connecting to mysql server</description>
   </property>
</configuration>

OK，启动Hive Shell试试看吧

测试一下，在hive shell里建表
hive> create table saurzcode(id int, name string);

再在mysql里查看

1
2
3
4
5
mysql -u root -p
Enter password:                                                             
mysql> use metastore;
mysql> show tables ;
mysql> select * from TBLS;

若可以看见上面在hive里建的表saurzcode，恭喜你大功告成！😆😎🤠