objectrocket / ansible-hadoop Goto Github PK
View Code? Open in Web Editor NEWAnsible playbooks for deploying Hortonworks Data Platform
Ansible playbooks for deploying Hortonworks Data Platform
Hi,
Please consider reverting #87
The removed memory logic for namenodes now generates a JAVA out of heap error upon deployment, and the cluster fails to build.
e.g.
[root@master-01 log]# less hadoop/hdfs/hadoop-hdfs-namenode-master-01.uumo2ahfoh8oh0eijoh4.out
#
# java.lang.OutOfMemoryError: Java heap space
# -XX:OnOutOfMemoryError=""/usr/hdp/current/hadoop-hdfs-namenode/bin/kill-name-node"
"/usr/hdp/current/hadoop-hdfs-namenode/bin/kill-name-node"
"/usr/hdp/current/hadoop-hdfs-namenode/bin/kill-name-node""
If you run the task "Register the alert_targets with the Ambari server" more than once you get a 500 error like the following on subsequent runs:
failed: [master03] => {"content": "{\n "status": 500,\n "message": "Exception [EclipseLink-4002](Eclipse Persistence Services - 2.5.2.v20140319-9ad6abd): org.eclipse.persistence.exceptions.DatabaseException\nInternal Exception: org.postgresql.util.PSQLException: ERROR: duplicate key value violates unique constraint \"alert_target_target_name_key\"\nError Code: 0\nCall: INSERT INTO alert_target (target_id, DESCRIPTION, is_global, notification_type, PROPERTIES, target_name) VALUES (?, ?, ?, ?, ?, ?)\n\tbind => [6 parameters bound]\nQuery: DataModifyQuery(sql=\"INSERT INTO alert_target_states (target_id, alert_state) VALUES (?, ?)\")"\n}", "content_length": "622", "content_type": "text/plain;charset=ISO-8859-1", "failed": true, "redirected": false, "server": "Jetty(7.6.7.v20120910)", "set_cookie": "AMBARISESSIONID=xxx;Path=/", "status": 500}
msg: Status code was not [200, 201, 202]
If the "Fail if the cluster create task is in an error state" task in the ambari-server role fails because the cluster create is in a "FAILED" status we should retry the build on subsequent runs of the playbook.
The site_facts.yml playbook fails on single-node deployments because there are no nodes in the slave-nodes group to reference. Instead the first/only master node should be referenced in this situation. Additional changes may be necessary to ensure memory on the single node isn't over-allocated with both master and slave services on the same node.
add dynamic bonding based on interfaces provided
Plays are failing due to:
fatal: [172_23_0_203]: FAILED! => {"changed": false, "failed": true, "msg": "Package at https://dl.fedoraproject.org/pub/epel/7/x86_64/e/epel-release-7-5.noarch.rpm could not be installed", "rc": 1}
Updating to https://dl.fedoraproject.org/pub/epel/epel-release-latest-7.noarch.rpm
bootstrap_static.sh
is failing for me with the Destination /etc/sysconfig/iptables does not exist
error message on Vagrant with the bento/centos-6.7
box. Indeed /etc/sysconfig/iptables
does not exist on this system.
(This Vagrant box is expected to be fairly faithful to the real systems where we would want to deploy Hadoop, possibly with your playbooks.)
Grafana is hard coded into the blueprints but it's not supported prior to Ambari 2.2.2. We should have a conditional to verify that ambari_version is >= 2.2.2 before including METRICS_GRAFANA in the blueprints.
It looks like this might be a race condition since the component that causes the error seems to change. In this case it was MAPREDUCE2, but I've also seen it for ZOOKEEPER.
TASK: [ambari-server | Create the cluster instance] ***************************
failed: [hadoop-node3] => {"content": "{\n "status" : 500,\n "message" : "An internal system exception occurred: Invalid transition for servicecomponenthost, clusterName=hadoop-poc, clusterId=2, serviceName=MAPREDUCE2, componentName=HISTORYSERVER, hostname=hadoop-node2, currentState=INIT, newDesiredState=STARTED"\n}", "content_length": "277", "content_type": "text/plain", "expires": "Thu, 01 Jan 1970 00:00:00 GMT", "failed": true, "redirected": false, "server": "Jetty(7.6.7.v20120910)", "set_cookie": "AMBARISESSIONID=xxx;Path=/", "status": 500}
msg: Status code was not [200, 201, 202]
FATAL: all hosts have already failed -- aborting
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.