Tag Archives: Beowulf

How to build Beowulf cluster aks HPC for Open MPI C++ apps like HFT with R with RCPP RInside package on Debian Linux #rstats #linux

How to build Beowulf cluster aks HPC for Open MPI C++ apps like HFT with R with RCPP RInside  package on Debian Linux #rstats #linux

Install Debian Etch from: and follow first CD install instructions:

http://www.debian.org/CD/http-ftp/

Install Debian Virtual Machines in Virtual Box as usual

http://www.wired.com/geekdad/2012/02/debian-linux-on-oracle-virtualbox/

Go with all default options.  You can always clone  a second  client VM to create a slave.

Set up hostname and configure network via: (choose the static address  not DHCP)

http://www.debian-administration.org/articles/254

Note that you could loose network connectivity soo add an additional Network Adapter with Bridged Adapter for each VM. within the Virtual Box setting. so see next step

Ensure each VM has network adapter setting to Virtual Box Host Only

http://christophermaier.name/blog/2010/09/01/host-only-networking-with-virtualbox

Create NFS for both virtual machines as server and client:

http://www.howtoforge.com/nfs-server-and-client-debian-etch

Note: When  editing exports on the server with:

/home           192.168.0.101(rw,sync,no_root_squash)

/var/nfs        192.168.0.101(rw,sync)

 

Note that 101 is the client!. ALso, I have when I try to auto mount during boot on the client, it would hang. I just created a shell script to do the mounts manually when you boot.  I just called this /etc/mountmaster.sh

 

If you need to add users do:

http://www.debian-administration.org/articles/2

You should be able to proceed with the following set up of your Beowulf cluster:

http://www.debian-administration.org/articles/2

To understand nad configure ssh connections with no passowrd, use:

SSH your Debian servers without password

This could be useful http://wiki.debian.org/SSH but note it uses RSA not DSA

If confused, use this next one but remember the ssh server is the Open MPI slave while client is the Open MPI since it logins into the Open MPI slave.

http://www.howtoforge.com/set-up-ssh-with-public-key-authentication-debian-etch

 

 

HOW DO YOU START A PROFITABLE TRADING BUSINESS? Read more NOW >>>

NOTE I now post my TRADING ALERTS into my personal FACEBOOK ACCOUNT and TWITTER. Don't worry as I don't post stupid cat videos or what I eat!

How to set up a C++ Beowulf cluster for Open MPI for Rinside with VirtualBox and Ubunutu Linux #linux

How to set up a C++ Beowulf cluster for Open MPI for Rinside with VirtualBox and Ubunutu Linux

It looks like to implement the RInside C++ call into the FastFlow will not be fun. As a result, I am revisiting OpenMPI as RInside’s sample code already includes a sample with it implemented. I now focus how build how to build a virtual home network Beowulf cluster with VirtualBox:

1. Set each virtual machine with Ubuntu Server slave nodes and a Ubuntu Desktop for your master node.

2. Set each with a static IP in Virtual Box.

http://www.coding4streetcred.com/blog/post/VirtualBox-Configuring-Static-IPs-for-VMs.aspx

3. Do the rest here:

http://byobu.info/wiki/Building_a_simple_Beowulf_Like_Cluster_with_Ubuntu

Find out more what I do

 

HOW DO YOU START A PROFITABLE TRADING BUSINESS? Read more NOW >>>

NOTE I now post my TRADING ALERTS into my personal FACEBOOK ACCOUNT and TWITTER. Don't worry as I don't post stupid cat videos or what I eat!