fransham / torque_kvm Goto Github PK
View Code? Open in Web Editor NEWvirtualization extensions for torque
virtualization extensions for torque
torque_ltda: a package to create virtual machines from regular torque batch jobs. Assumptions: 1) A user home directory mounted on the baremetal worker nodes and on the virtual machines. 2) Hostnames for the virtual machines that are resolvable from the worker nodes. 3) Passwordless ssh between the worker nodes and VMs. Use either public keys or HostbasedAuthentication. 4) kvm, libvirt, python-libvirt, pysqlite2 (python <= 2.4) or sqlite3 (python > 2.4) installed on the worker nodes. 5) A virtual machine image of qcow2 type mounted on nfs space. Worker node install: git clone git://github.com/fransham/torque_kvm.git cd torque_kvm If you installed TORQUE somewhere other than /var/spool/torque, set the value of TORQUE_HOME in install.sh When you run the install script, it will copy torque-kvm.conf to /etc/torque-kvm.conf. Set the values in torque-kvm.conf for your local setup before running the install script. You can change these values in /etc/torque-kvm.conf anytime after. Run the install script: ./install.sh Now, initialize your databases. cd to $TORQUE_HOME/net/ and edit the network.conf file to replace the hostname/mac/ip settings with those that you want. Make sure you have unique hostname/mac/ip settings on each worker node. Or, you can place the entire net directory on nfs space if you want a single, global map of hostname/mac/ip for the vms. run ./initialize This will generate two files: network.db (queried by the prologue/epilogue scripts) and dhcpd.entries. The dhcpd.entries file is of the form that it can be included by your dhcpd server. A sample dhcp config looks like this: # # DHCP Server Configuration file. # ddns-update-style interim; subnet 172.23.0.0 netmask 255.255.0.0 { include "/etc/dhcpd.conf.d/wn001.dhcpd.entries"; include "/etc/dhcpd.conf.d/wn002.dhcpd.entries"; include "/etc/dhcpd.conf.d/wn003.dhcpd.entries"; } Where the conf files generated on three worker nodes are placed in a dhcpd.conf.d directory and included. Submit node install: The first few lines of bin/submit_filter contain site defaults. Edit these to reflect your local policies. On all submit nodes, copy bin/submit_filter to any directory you want. The file has to be owned and executable by root, and not writable by anyone else. Add the following line to /var/spool/torque/torque.cfg SUBMITFILTER /path/to/submit/filter
ssia
Needs to be passed to libvirt
if the user is using cshell, alias qsub to qsub -S
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.