Hive Window安装 (Hadoop)

2023年5月26日上午12:19 • 大数据 • 阅读 70

一、Hadoop安装

1)、启动

2)、创建hdfs目录

$ hadoop fs  -mkdir       /tmp$ hadoop fs  -mkdir       /user/$ hadoop fs  -mkdir       /user/hive/$ hadoop fs  -mkdir       /user/hive/warehouse $ hadoop fs  -chmod g+w   /tmp$ hadoop fs  -chmod g+w   /user/hive/warehouse

二、MySql 创建库Hive

三、Hive安装

1)、配置环境变量

2)、创建my_hive目录

3)、配置文件conf

hive-default.xml.template —–> hive-site.xml
hive-env.sh.template —–> hive-env.sh
hive-exec-log4j.properties.template —–> hive-exec-log4j2.properties
hive-log4j.properties.template —–> hive-log4j2.properties

hive-site.xml配置*************


  <property>
    <name>hive.metastore.warehouse.dirname>
    <value>/user/hive/warehousevalue>
    <description>location of default database for the warehousedescription>
  property>


  <property>
    <name>hive.exec.scratchdirname>
    <value>/tmp/hivevalue>
    <description>HDFS root scratch dir for Hive jobs which gets created with write all (733) permission. For each connecting user, an HDFS scratch dir: ${hive.exec.scratchdir}/<username> is created, with ${hive.scratch.dir.permission}.description>
  property>


  <property>
    <name>hive.exec.local.scratchdirname>
    <value>D:/temp/hadoop/apache-hive-2.1.1-bin/my_hive/scratch_dirvalue>
    <description>Local scratch space for Hive jobsdescription>
  property>
  <property>
    <name>hive.downloaded.resources.dirname>
    <value>D:/temp/hadoop/apache-hive-2.1.1-bin/my_hive/resources_dir/${hive.session.id}_resourcesvalue>            <description>Temporary local directory for added resources in the remote file system.description>  property>


<property>
    <name>hive.querylog.locationname>
    <value>D:/temp/hadoop/apache-hive-2.1.1-bin/my_hive/querylog_dirvalue>
    <description>Location of Hive run time structured log filedescription>
  property>


  <property>
    <name>hive.server2.logging.operation.log.locationname>
    <value>D:/temp/hadoop/apache-hive-2.1.1-bin/my_hive/operation_logs_dirvalue>
    <description>Top level directory where operation logs are stored if logging functionality is enableddescription>
  property>


  <property>
    <name>javax.jdo.option.ConnectionURLname>
    <value>jdbc:mysql://localhost:3306/hive?serverTimezone=UTC&useSSL=false&allowPublicKeyRetrieval=truevalue>
    <description>
      JDBC connect string for a JDBC metastore.
      To use SSL to encrypt/authenticate the connection, provide database-specific SSL flag in the connection URL.
      For example, jdbc:postgresql://myhost/db?ssl=true for postgres database.
    description>
  property>


 <property>
    <name>javax.jdo.option.ConnectionDriverNamename>
    <value>com.mysql.jdbc.Drivervalue>
    <description>Driver class name for a JDBC metastoredescription>
  property>


  <property>
    <name>javax.jdo.option.ConnectionUserNamename>
    <value>rootvalue>
    <description>Username to use against metastore databasedescription>
  property>


  <property>
    <name>javax.jdo.option.ConnectionPasswordname>
    <value>rootvalue>
    <description>password to use against metastore databasedescription>
  property>


  <property>
    <name>hive.metastore.schema.verificationname>
    <value>falsevalue>
    <description>
      Enforce metastore schema version consistency.
      True: Verify that version information stored in is compatible with one from Hive jars.  Also disable automatic
            schema migration attempt. Users are required to manually migrate schema after Hive upgrade which ensures
            proper metastore schema migration. (Default)
      False: Warn if the version information stored in metastore doesn't match with one from in Hive jars.
    description>
  property>



 <property>
<name>datanucleus.schema.autoCreateAllname>
<value>truevalue>
<description>Auto creates necessary schema on a startup if one doesn't exist. Set this to false, after creating it once.To enable auto create also set hive.metastore.schema.verification=false. Auto creation is not recommended for production use cases, run schematool command instead.description>
property>