离线安装Cloudera Manager 5和CDH5(最新版5.9.3) 完全教程（七）界面安装-白红宇

强烈建议你试试无所不能的chatGPT，快点击我

离线安装Cloudera Manager 5和CDH5(最新版5.9.3) 完全教程（七）界面安装

阅读量：5278 次

发布时间：2019-06-14

本文共 15103 字，大约阅读时间需要 50 分钟。

一、安装过程

1.1　登录

1.2　接受许可协议

1.3　选择免费版本

1.4　选择下一步

1.5　选择当前管理的主机

1.6　选择使用Parcel安装，选择CDH版本，点击继续

1.7　等待安装

此处安装需要等待一段时间，请耐心等待，安装过程可能需要30分钟时间，这和物理机器的磁盘读写速度和机器性能有关，如果中断请继续之前的步骤重新操作，下图是安装成功界面

1.8　集群检测

检测全部通过

1.9　选择自定义服务，选择要安装的组件

1.10　分配角色

1.11　数据库设置

选择对应的数据库，点击测试连接，通过之后，继续

1.12　集群设置

使用默认设置即可

1.13　首次安装组件

1.14　安装Spark报错

查看stderr查看报错信息，发现找不到JAVA_HOME

解决方法：需要每个节点都操作

在以下文件中手工添加JAVA_HOME

[root@master soft]# cd /opt/cloudera-manager/cm-5.9.3/lib64/cmf/service/client/[root@master client]# vi deploy-cc.sh

保存之后

[root@master client]# cat /etc/environment

点击重试

1.15　安装Hive报错

查看stderr查看报错信息，发现hive初始化失败

处理过程：

（1）拷贝jdbc驱动包

[root@master ~]# cp /root/soft/mysql-connector-java-5.1.26-bin.jar /opt/cloudera/parcels/CDH-5.9.3-1.cdh5.9.3.p0.4/lib/hive/lib/

点击重试，仍旧报错

点击查看完整日志

点击链接

在搜索框中搜索hive.metastore.schema.verification，把勾选去掉，保存更改，返回安装界面点击重试

继续报错，查看完整日志

1 Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=512M; support was removed in 8.0  2 Java HotSpot(TM) 64-Bit Server VM warning: Using incremental CMS is deprecated and will likely be removed in a future release  3 Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=512M; support was removed in 8.0  4 javax.jdo.JDOUserException: Could not create "increment"/"table" value-generation container hivedb.`SEQUENCE_TABLE` since autoCreate flags do not allow it.   5     at org.datanucleus.api.jdo.NucleusJDOHelper.getJDOExceptionForNucleusException(NucleusJDOHelper.java:549)  6     at org.datanucleus.api.jdo.JDOPersistenceManager.jdoMakePersistent(JDOPersistenceManager.java:732)  7     at org.datanucleus.api.jdo.JDOPersistenceManager.makePersistent(JDOPersistenceManager.java:752)  8     at org.apache.hadoop.hive.metastore.ObjectStore.setMetaStoreSchemaVersion(ObjectStore.java:7317)  9     at org.apache.hadoop.hive.metastore.ObjectStore.checkSchema(ObjectStore.java:7211) 10     at org.apache.hadoop.hive.metastore.ObjectStore.verifySchema(ObjectStore.java:7186) 11     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 12     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 13     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 14     at java.lang.reflect.Method.invoke(Method.java:498) 15     at org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:103) 16     at com.sun.proxy.$Proxy6.verifySchema(Unknown Source) 17     at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.getMS(HiveMetaStore.java:627) 18     at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.createDefaultDB(HiveMetaStore.java:679) 19     at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.init(HiveMetaStore.java:484) 20     at org.apache.hadoop.hive.metastore.RetryingHMSHandler.
      
       (RetryingHMSHandler.java:78) 21     at org.apache.hadoop.hive.metastore.RetryingHMSHandler.getProxy(RetryingHMSHandler.java:84) 22     at org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:5950) 23     at org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:5945) 24     at org.apache.hadoop.hive.metastore.HiveMetaStore.startMetaStore(HiveMetaStore.java:6197) 25     at org.apache.hadoop.hive.metastore.HiveMetaStore.main(HiveMetaStore.java:6122) 26     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 27     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 28     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 29     at java.lang.reflect.Method.invoke(Method.java:498) 30     at org.apache.hadoop.util.RunJar.run(RunJar.java:221) 31     at org.apache.hadoop.util.RunJar.main(RunJar.java:136) 32 NestedThrowablesStackTrace: 33 Could not create "increment"/"table" value-generation container hivedb.`SEQUENCE_TABLE` since autoCreate flags do not allow it.  34 org.datanucleus.exceptions.NucleusUserException: Could not create "increment"/"table" value-generation container hivedb.`SEQUENCE_TABLE` since autoCreate flags do not allow it.  35     at org.datanucleus.store.rdbms.valuegenerator.TableGenerator.createRepository(TableGenerator.java:261) 36     at org.datanucleus.store.rdbms.valuegenerator.AbstractRDBMSGenerator.obtainGenerationBlock(AbstractRDBMSGenerator.java:162) 37     at org.datanucleus.store.valuegenerator.AbstractGenerator.obtainGenerationBlock(AbstractGenerator.java:197) 38     at org.datanucleus.store.valuegenerator.AbstractGenerator.next(AbstractGenerator.java:105) 39     at org.datanucleus.store.rdbms.RDBMSStoreManager.getStrategyValueForGenerator(RDBMSStoreManager.java:2005) 40     at org.datanucleus.store.AbstractStoreManager.getStrategyValue(AbstractStoreManager.java:1386) 41     at org.datanucleus.ExecutionContextImpl.newObjectId(ExecutionContextImpl.java:3827) 42     at org.datanucleus.state.JDOStateManager.setIdentity(JDOStateManager.java:2571) 43     at org.datanucleus.state.JDOStateManager.initialiseForPersistentNew(JDOStateManager.java:513) 44     at org.datanucleus.state.ObjectProviderFactoryImpl.newForPersistentNew(ObjectProviderFactoryImpl.java:232) 45     at org.datanucleus.ExecutionContextImpl.newObjectProviderForPersistentNew(ExecutionContextImpl.java:1414) 46     at org.datanucleus.ExecutionContextImpl.persistObjectInternal(ExecutionContextImpl.java:2218) 47     at org.datanucleus.ExecutionContextImpl.persistObjectWork(ExecutionContextImpl.java:2065) 48     at org.datanucleus.ExecutionContextImpl.persistObject(ExecutionContextImpl.java:1913) 49     at org.datanucleus.ExecutionContextThreadedImpl.persistObject(ExecutionContextThreadedImpl.java:217) 50     at org.datanucleus.api.jdo.JDOPersistenceManager.jdoMakePersistent(JDOPersistenceManager.java:727) 51     at org.datanucleus.api.jdo.JDOPersistenceManager.makePersistent(JDOPersistenceManager.java:752) 52     at org.apache.hadoop.hive.metastore.ObjectStore.setMetaStoreSchemaVersion(ObjectStore.java:7317) 53     at org.apache.hadoop.hive.metastore.ObjectStore.checkSchema(ObjectStore.java:7211) 54     at org.apache.hadoop.hive.metastore.ObjectStore.verifySchema(ObjectStore.java:7186) 55     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 56     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 57     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 58     at java.lang.reflect.Method.invoke(Method.java:498) 59     at org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:103) 60     at com.sun.proxy.$Proxy6.verifySchema(Unknown Source) 61     at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.getMS(HiveMetaStore.java:627) 62     at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.createDefaultDB(HiveMetaStore.java:679) 63     at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.init(HiveMetaStore.java:484) 64     at org.apache.hadoop.hive.metastore.RetryingHMSHandler.
       
        (RetryingHMSHandler.java:78) 65     at org.apache.hadoop.hive.metastore.RetryingHMSHandler.getProxy(RetryingHMSHandler.java:84) 66     at org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:5950) 67     at org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:5945) 68     at org.apache.hadoop.hive.metastore.HiveMetaStore.startMetaStore(HiveMetaStore.java:6197) 69     at org.apache.hadoop.hive.metastore.HiveMetaStore.main(HiveMetaStore.java:6122) 70     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 71     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 72     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 73     at java.lang.reflect.Method.invoke(Method.java:498) 74     at org.apache.hadoop.util.RunJar.run(RunJar.java:221) 75     at org.apache.hadoop.util.RunJar.main(RunJar.java:136) 76 Exception in thread "main" javax.jdo.JDOUserException: Could not create "increment"/"table" value-generation container hivedb.`SEQUENCE_TABLE` since autoCreate flags do not allow it.  77     at org.datanucleus.api.jdo.NucleusJDOHelper.getJDOExceptionForNucleusException(NucleusJDOHelper.java:549) 78     at org.datanucleus.api.jdo.JDOPersistenceManager.jdoMakePersistent(JDOPersistenceManager.java:732) 79     at org.datanucleus.api.jdo.JDOPersistenceManager.makePersistent(JDOPersistenceManager.java:752) 80     at org.apache.hadoop.hive.metastore.ObjectStore.setMetaStoreSchemaVersion(ObjectStore.java:7317) 81     at org.apache.hadoop.hive.metastore.ObjectStore.checkSchema(ObjectStore.java:7211) 82     at org.apache.hadoop.hive.metastore.ObjectStore.verifySchema(ObjectStore.java:7186) 83     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 84     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 85     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 86     at java.lang.reflect.Method.invoke(Method.java:498) 87     at org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:103) 88     at com.sun.proxy.$Proxy6.verifySchema(Unknown Source) 89     at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.getMS(HiveMetaStore.java:627) 90     at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.createDefaultDB(HiveMetaStore.java:679) 91     at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.init(HiveMetaStore.java:484) 92     at org.apache.hadoop.hive.metastore.RetryingHMSHandler.
        
         (RetryingHMSHandler.java:78) 93     at org.apache.hadoop.hive.metastore.RetryingHMSHandler.getProxy(RetryingHMSHandler.java:84) 94     at org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:5950) 95     at org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:5945) 96     at org.apache.hadoop.hive.metastore.HiveMetaStore.startMetaStore(HiveMetaStore.java:6197) 97     at org.apache.hadoop.hive.metastore.HiveMetaStore.main(HiveMetaStore.java:6122) 98     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 99     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)100     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)101     at java.lang.reflect.Method.invoke(Method.java:498)102     at org.apache.hadoop.util.RunJar.run(RunJar.java:221)103     at org.apache.hadoop.util.RunJar.main(RunJar.java:136)104 NestedThrowablesStackTrace:105 Could not create "increment"/"table" value-generation container hivedb.`SEQUENCE_TABLE` since autoCreate flags do not allow it. 106 org.datanucleus.exceptions.NucleusUserException: Could not create "increment"/"table" value-generation container hivedb.`SEQUENCE_TABLE` since autoCreate flags do not allow it. 107     at org.datanucleus.store.rdbms.valuegenerator.TableGenerator.createRepository(TableGenerator.java:261)108     at org.datanucleus.store.rdbms.valuegenerator.AbstractRDBMSGenerator.obtainGenerationBlock(AbstractRDBMSGenerator.java:162)109     at org.datanucleus.store.valuegenerator.AbstractGenerator.obtainGenerationBlock(AbstractGenerator.java:197)110     at org.datanucleus.store.valuegenerator.AbstractGenerator.next(AbstractGenerator.java:105)111     at org.datanucleus.store.rdbms.RDBMSStoreManager.getStrategyValueForGenerator(RDBMSStoreManager.java:2005)112     at org.datanucleus.store.AbstractStoreManager.getStrategyValue(AbstractStoreManager.java:1386)113     at org.datanucleus.ExecutionContextImpl.newObjectId(ExecutionContextImpl.java:3827)114     at org.datanucleus.state.JDOStateManager.setIdentity(JDOStateManager.java:2571)115     at org.datanucleus.state.JDOStateManager.initialiseForPersistentNew(JDOStateManager.java:513)116     at org.datanucleus.state.ObjectProviderFactoryImpl.newForPersistentNew(ObjectProviderFactoryImpl.java:232)117     at org.datanucleus.ExecutionContextImpl.newObjectProviderForPersistentNew(ExecutionContextImpl.java:1414)118     at org.datanucleus.ExecutionContextImpl.persistObjectInternal(ExecutionContextImpl.java:2218)119     at org.datanucleus.ExecutionContextImpl.persistObjectWork(ExecutionContextImpl.java:2065)120     at org.datanucleus.ExecutionContextImpl.persistObject(ExecutionContextImpl.java:1913)121     at org.datanucleus.ExecutionContextThreadedImpl.persistObject(ExecutionContextThreadedImpl.java:217)122     at org.datanucleus.api.jdo.JDOPersistenceManager.jdoMakePersistent(JDOPersistenceManager.java:727)123     at org.datanucleus.api.jdo.JDOPersistenceManager.makePersistent(JDOPersistenceManager.java:752)124     at org.apache.hadoop.hive.metastore.ObjectStore.setMetaStoreSchemaVersion(ObjectStore.java:7317)125     at org.apache.hadoop.hive.metastore.ObjectStore.checkSchema(ObjectStore.java:7211)126     at org.apache.hadoop.hive.metastore.ObjectStore.verifySchema(ObjectStore.java:7186)127     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)128     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)129     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)130     at java.lang.reflect.Method.invoke(Method.java:498)131     at org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:103)132     at com.sun.proxy.$Proxy6.verifySchema(Unknown Source)133     at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.getMS(HiveMetaStore.java:627)134     at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.createDefaultDB(HiveMetaStore.java:679)135     at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.init(HiveMetaStore.java:484)136     at org.apache.hadoop.hive.metastore.RetryingHMSHandler.
         
          (RetryingHMSHandler.java:78)137     at org.apache.hadoop.hive.metastore.RetryingHMSHandler.getProxy(RetryingHMSHandler.java:84)138     at org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:5950)139     at org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:5945)140     at org.apache.hadoop.hive.metastore.HiveMetaStore.startMetaStore(HiveMetaStore.java:6197)141     at org.apache.hadoop.hive.metastore.HiveMetaStore.main(HiveMetaStore.java:6122)142     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)143     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)144     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)145     at java.lang.reflect.Method.invoke(Method.java:498)146     at org.apache.hadoop.util.RunJar.run(RunJar.java:221)147     at org.apache.hadoop.util.RunJar.main(RunJar.java:136)

View Code

报错原因：

mysql数据库的binlog_format参数设置不正确，原来设置的是STATEMENT，修改为MIXED，修改方法，在/usr/my.cnf文件中加上binlog_format=MIXED

然后重启mysql数据库,再次点击重试，全部通过。点击继续

1.16　完成安装

二、调试

2.1　安装完成

2.2　HDFS配置报警告

点击黄色的扳手，查看是NameNode的Java堆栈大小

修改为4吉字节点击保存，框中全部改为4吉字节

重启过时服务

2.2　启用HDFS的高可用

转载于:https://www.cnblogs.com/qingyunzong/p/9435192.html

你可能感兴趣的文章

Hadoop入门（一）：Hadoop伪分布安装

svn做目录访问控制（AuthzSVNAccessFile）

微信小程序之下拉刷新，上拉加载更多

[uva11137]立方数之和·简单dp

【Java】剑指offer(58-2) 左旋转字符串

Python List comprehension列表推导式

ajax插件生成WSDL后,vs访问出错

输出由几个无重复数字组成的三位数（内测第0届第3题）

关于报表开发代码示例

MyEclipse创建struts.xml

七层模型？ IP ，TCP/UDP ，HTTP ，RTSP ，FTP 分别在哪层？

Windows中"打开方式..."无法指定程序的解决办法

数据库设计经验

Crossing River（1700poj）

敏捷的最佳实践-3

map reduce filter

今天入住园子了

20162319 莫礼钟预备作业02

数字的可视化：python画图之散点图sactter函数详解

喝酒易醉，品茶养心，人生如梦，品茶悟道，何以解忧？唯有杜康！-- 愿君每日到此一游！

当前时间: 2024-11-26 02:18:36 当前IP: 18.118.162.8 联系邮箱:javaeecc@qq.com Copyright © 2020 - 2022 baihongyu.com 京ICP备2021015314号-2

强烈建议你试试无所不能的CHAT-GPT，快点击我

强烈建议你试试无所不能的CHAT-GPT，快点击我