megamsys / megdc

A CLI based megam datacenter management interface

=============== Megdc

CLI based installer that sets up our datacenter based Megam cloud platform.

Requirements

Golang 1.5.1 > +

Usage

# To install package verticenilavu in your local system.

megdc verticeinstall --verticenilavu

Compile from source

mkdir -p code/megam/go/src/github.com/megamsys

cd code/megam/go/src/github.com/megamsys

git clone https://github.com/megamsys/megdc.git

cd megdc

make

Documentation

Refer [documentation] (http://www.docs.megam.io)

We are glad to help if you have questions, or request for new features..

twitter @megamsys email [email protected]

License

Author:	Rajthilak ([email protected])
	KishorekumarNeelamegam ([email protected])
	Thomas Alrin ([email protected])
Copyright:	Copyright (c) 2013-2015 Megam Systems.
License:	Apache License, Version 2.0

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.

megdc's Issues

cobbler script should be preseeded with inputs and shouldn't waits for the input to be provide when invoked from cibd daemon.

cobblerd script performs dpkg-reconfigure. This should be preseeded as we have no way to input the values during the install.

eg:

echo mysql-server mysql-server/root_password select PASSWORD | debconf-set-selections
echo mysql-server mysql-server/root_password_again select PASSWORD | debconf-set-selections

Refer links here. http://serverfault.com/questions/19367/scripted-install-of-mysql-on-ubuntu

failure megam install updates db

Megam install script fails to get package from get.megam.co, but still cib add a entry in database.

check whether files are exist or not

during cephinstall, it is doing ssh-keygen. It needs a condition for id_rsa file existence.

Load static dns from dhcp

To avoid entering manual network configuration

No error message on megam install, when it fails

worker node (second node) doesn't get connected to the external network and fails to download the preseed.

Fix

/etc/cobbler/dnsmasq.template
dhcp-option=3.192.168.2.1

/etc/dnsmasq.conf
dhcp-option=3,192.168.2.1

create flavors and regions, when setting up opennebula

more than one sqlite record for megam

sqlite> select * from servers;
1|MEGAM|1|||
2|COBBLER|1||Sep 9, 2014 at 12:01pm (EDT)|Sep 9, 2014 at 12:01pm (EDT)
4|MEGAM|1||Sep 12, 2014 at 6:08am (EDT)|Sep 12, 2014 at 6:08am (EDT)
5|MEGAM|1||Sep 12, 2014 at 6:08am (EDT)|Sep 12, 2014 at 6:08am (EDT)
6|MEGAM|1||Sep 12, 2014 at 6:09am (EDT)|Sep 12, 2014 at 6:09am (EDT)
8|MEGAM|1||Sep 12, 2014 at 6:15am (EDT)|Sep 12, 2014 at 6:15am (EDT)
9|MEGAM|1||Sep 12, 2014 at 7:34am (EDT)|Sep 12, 2014 at 7:34am (EDT)
10|MEGAM|1||Sep 12, 2014 at 7:35am (EDT)|Sep 12, 2014 at 7:35am (EDT)

Log dialog shows a dialog at the right hand side which isn't needed.

Remove the dialog at the right hand side of the dialog. This dialog is shown when the user logs in.

medc changes

1. Move the Help to appear as the first entry.
2. RMQ create a command for install
3. megamnilavu needs bundle update and bundle install

megdc : cepdump a new command needed

The command shall dump all the images from the default rbd pool "one" or the user provided pool.

All the dumped images shall be named as `<vmdescription_if_exists>.img

Then make it as a tarball and ship to a know location. (sftp, or another storage)

cobbler install script fails to install cobblerd

status command

This a feature for 1.0

Add a colored status output in a table format of the installation (host/port) and its status

cib ui index not scrolling

urknall support for centos

ceph_install.sh script run twice in opennebula host install step

scp_ssh.sh script not called

After installing opennebula_host, call scp_ssh.sh

on all removes, remove urknal cache files

apache and nginx are using same port(80)

Megamnilavu uses nginx and port 80. Cobbler uses apache2 and port 80. When cobbler installation, it shows an error address(80) already in use.

An scp action needs to get called after the OneHost(Node) is installed.

The action opennebulaSCPSSH just starts a script in Master which does a secure copy of the ssh key in to the ONE Host node.

@rajthilakmca Raj I created the action opennebulaSCPSSH but you need to wire it so that it gets called after the ONEHost is called.

Add prereq checking of ruby if available or openjdk-8 for some of the installs.

Show error message that it needs parameters, when doing megdc cephinstall

I tried megd cephinstall without any parameters, it shows the below error.

root@f484:~# megdc cephinstall

    ███╗   ███╗███████╗ ██████╗ ██████╗  ██████╗
    ████╗ ████║██╔════╝██╔════╝ ██╔══██╗██╔════╝
    ██╔████╔██║█████╗  ██║  ███╗██║  ██║██║
    ██║╚██╔╝██║██╔══╝  ██║   ██║██║  ██║██║
    ██║ ╚═╝ ██║███████╗╚██████╔╝██████╔╝╚██████╗
    ╚═╝     ╚═╝╚══════╝ ╚═════╝ ╚═════╝  ╚═════╝
starting install ⠏
Packages
CephInstall
Options
CephUser    megdc
CephPassword    megdc
PhyDev  eth0

---
panic: empty path given to mkdir

goroutine 1 [running]:
panic(0x703980, 0xc8200e8820)
    /home/ranjitha/software/go/src/runtime/panic.go:464 +0x3e6
github.com/megamsys/megdc/templates/ubuntu.Mkdir(0x0, 0x0, 0x0, 0x0, 0x1ed, 0x2)
    /home/ranjitha/code/megam/workspace/packager/megammegdc/build/trusty/megdc/src/github.com/megamsys/megdc/templates/ubuntu/cmd_fileutils.go:12 +0xae
github.com/megamsys/megdc/templates/ubuntu.(*UbuntuCephInstallTemplate).Render(0xc8200987d0, 0x7f84a8d4b420, 0xc8200710c0)
    /home/ranjitha/code/megam/workspace/packager/megammegdc/build/trusty/megdc/src/github.com/megamsys/megdc/templates/ubuntu/tpl_ceph_install.go:145 +0x164c
github.com/megamsys/urknall.(*packageImpl).AddTemplate(0xc820070f00, 0xc820074f40, 0x4, 0x7f84a8d4b458, 0xc8200987d0)
    /home/ranjitha/.go/src/github.com/megamsys/urknall/package_impl.go:47 +0x2e3
github.com/megamsys/megdc/templates/ubuntu.(*UbuntuCephInstall).Render(0xc820070e80, 0x7f84a8d4b420, 0xc820070f00)
    /home/ranjitha/code/megam/workspace/packager/megammegdc/build/trusty/megdc/src/github.com/megamsys/megdc/templates/ubuntu/tpl_ceph_install.go:84 +0x1be
github.com/megamsys/urknall.renderTemplate(0x7f84a8d4b3f8, 0xc820070e80, 0xc820070e40, 0x0, 0x0)
    /home/ranjitha/.go/src/github.com/megamsys/urknall/utils.go:16 +0x153
github.com/megamsys/urknall.(*Build).prepareBuild(0xc820070ec0, 0x8bdd9d, 0x0, 0x0)
    /home/ranjitha/.go/src/github.com/megamsys/urknall/build.go:78 +0x5c
github.com/megamsys/urknall.(*Build).Run(0xc820070ec0, 0x0, 0x0)
    /home/ranjitha/.go/src/github.com/megamsys/urknall/build.go:36 +0x45
github.com/megamsys/urknall.Run(0x7f84a8d4b3b8, 0xc820074e70, 0x7f84a8d4b3f8, 0xc820070e80, 0x0, 0x0)
    /home/ranjitha/.go/src/github.com/megamsys/urknall/build.go:16 +0x9a
github.com/megamsys/megdc/templates/ubuntu.(*UbuntuCephInstall).Run(0xc820070380, 0x7f84a8d4b3b8, 0xc820074e70, 0x0, 0x0)
    /home/ranjitha/code/megam/workspace/packager/megammegdc/build/trusty/megdc/src/github.com/megamsys/megdc/templates/ubuntu/tpl_ceph_install.go:93 +0x139
github.com/megamsys/megdc/templates.(*Template).Run(0xc8200986e0, 0x0, 0x0)
    /home/ranjitha/code/megam/workspace/packager/megammegdc/build/trusty/megdc/src/github.com/megamsys/megdc/templates/template.go:80 +0x420
github.com/megamsys/megdc/handler.(*Handler).Run.func1(0xc8200986e0, 0xc820072240, 0x0, 0x0)
    /home/ranjitha/code/megam/workspace/packager/megammegdc/build/trusty/megdc/src/github.com/megamsys/megdc/handler/handler.go:84 +0x2d
github.com/megamsys/megdc/templates.RunInTemplates.func1(0x0, 0x1, 0x0, 0x0)
    /home/ranjitha/code/megam/workspace/packager/megammegdc/build/trusty/megdc/src/github.com/megamsys/megdc/templates/template.go:104 +0xdf
github.com/megamsys/megdc/templates.RunInTemplates(0xc820080078, 0x1, 0x1, 0x8bef48, 0x0, 0xc8200c5900, 0x0, 0x0)
    /home/ranjitha/code/megam/workspace/packager/megammegdc/build/trusty/megdc/src/github.com/megamsys/megdc/templates/template.go:122 +0x3b1
github.com/megamsys/megdc/handler.(*Handler).Run(0xc820070d80, 0x0, 0x0)
    /home/ranjitha/code/megam/workspace/packager/megammegdc/build/trusty/megdc/src/github.com/megamsys/megdc/handler/handler.go:89 +0x66
github.com/megamsys/megdc/packages/ceph.(*Cephinstall).Run(0xc8200707c0, 0xc820098640, 0x0, 0x0)
    /home/ranjitha/code/megam/workspace/packager/megammegdc/build/trusty/megdc/src/github.com/megamsys/megdc/packages/ceph/cephinstall.go:68 +0x172
github.com/megamsys/libgo/cmd.(*Manager).Run(0xc8200bc000, 0x0, 0x0, 0x0)
    /home/ranjitha/.go/src/github.com/megamsys/libgo/cmd/cmd.go:184 +0x1ec6
main.main()
    /home/ranjitha/code/megam/workspace/packager/megammegdc/build/trusty/megdc/src/github.com/megamsys/megdc/cmd/megdc/main.go:79 +0xba

intelligence check whether ruby, java installed or not

Remove isc-dhcp-server from cobblerd install

We only use dnsmasq for both dhcp and dns.

So remove the isc-dhcp-server from the cobbler script

create our own /usr/share/one/install_gems

Currently we write https://github.com/OpenNebula/one/blob/master/share/install_gems/install_gems somewhere in our system. Ans in one_postinstall script we copy it to /usr/share/one/install_gems

Lines in the log file appear twice when its already invoked.

When you click Log it opens a new dialog box. First time invocation it work ok. Going back and clicking on the Log button again, shows the same line twice

Ability to choose a repository to install for a particular function.

The repository is hardcoded like 0.9/testing inside the code. As an user i need ability to install any type of repo (0.9) for megam.

For OpenNebula (14.04) etc.

install prereqs like riak, nsq from megdc

api server url shall be loaded from a configuration file.

currently cloudinabox/modules/utils/utils.go loads statically

cobblerd fails to start when the server is restarted.

When the server is restarted, cobblerd doesn't restart. It says its unable to proxy.

To fix this problem, we need an entry in the /etc/hosts

127.0.0.1 localhost
192.168.2.10 megamubuntu

where 192.168.2.10 is the ipaddress of the server (where cobbler is running)

exit on kvm-ok error

megdc megamremove removes /usr/share/megam directory

/usr/share/megam contains megdc binary

change ceph new installation

echo deb https://download.ceph.com/debian-infernalis/ $(lsb_release -sc) main | sudo tee /etc/apt/sources.list.d/ceph.list
wget -q -O- 'https://download.ceph.com/keys/release.asc' | sudo apt-key add -
sudo apt-get update && sudo apt-get install ceph ceph-mds ceph-deploy radosgw

mkdir /storage1/osd
mkdir /storage2/osd

chown -r ceph:ceph /storage1/osd
chown -r ceph:ceph /storage2/osd

Remove it, it show error
echo "public network = 91.194.84.0/32" >> ceph.conf
echo "cluster network = 91.194.84.0/32" >> ceph.conf

megdc doesnot support centos6

document chef-server post-install works

Before install megamd, chef-server needs to be run, and loaded with cookbooks.

sqllite insert error upon completion of successfully executing the megam.sh

• I logged into megamcib
• It started installing megam.
• I can see that it installed megam successfully.
• At the end cib attempted to insert into cloudinabox.db
  The follow error was shown.

cibadmin@megamubuntu:~$ tail -f /var/log/megam/megamcib/megamcib.log
Sat Sep 20 10:33:36 EDT 2014: Step1: megam installed successfully.
broadcast entry ========> 
2014/09/20 10:33:36 [I] Message from megam ;Content: Sat Sep 20 10:33:36 EDT 2014: Step1: megam installed successfully. 
2014/09/20 10:33:36 [I] Message from megam ;Content: Sat Sep 20 10:33:36 EDT 2014: Step1: megam installed successfully. 
2014/09/20 10:33:36 {Installing megam..
 %!s(int=0)   %!s(bytes.readOp=0)}
server insert error
2014/09/20 10:33:36 [pipeline] error running the Forward for the megamInstall action - no such table: servers
Error: Install error for [MEGAM]no such table: servers
no such table: servers2014/09/20 10:33:36 [D] | GET        | /servers/MEGAM                           | 2.599599782s     | match      | /servers/:servername 

@thomasalrin fyi.

2nd node boot problem

When Boot mode is UEFI, system boot from hard disk.

opennebula install message shows success and error

Move ruby-2.0.0 as a installable dependency for megamnilavu

• we have already documented this.

test ceph install in a vm and write install script based on that.

boot menu changes

Edit the script which boots a new node
/var/lib/tftpboot/pxelinux.cfg$ sudo nano default

install_post_cibnode.py doesn't get invoked when the second node finishes.

• I tried 2 runs, the python script doesn't get invoked. The script gets loaded though.

here is the log

DEBUG:root:08:17:03 09/23/14 EDT    Registered node install trigger

Empty ip-parameter in scp_ssh.sh script

To run scp_ssh.sh, a parameter has to be passed with an ip, to which the public_key has to be sent.

megamheka and megamanalytics fail to start

sudo status megamheka
is stop/waiting

sudo status megamanalytics
is stop/waiting

It seems that the upstart script has a problem with the cd directory maybe. Check both the upstarts.

createnetwork (openvswitch) to include customizable phydev and bridge.