• How to build an basic image of redhat/centos on grid5000 from an iso

If the administrator has a basic image of Linux system. He can build a Hadoop-BSFS image from scratch.

After a VM is launched, the administrator needs to install BlobSeer in the machine.

Before install blobseer, several library has to be installed in root:

apt-get update
apt-get install cmake libssl-dev python-dev libopenmpi-dev 
apt-get install default-jdk default-jre
apt-get install ant libtool autoconf automake

To install BlobSeer, please follow the instructions below:

http://blobseer.gforge.inria.fr/doku.php?id=tutorial:main

Then, the administrator should build Hadoop-BSFS according to the guides given here:

http://blobseer.gforge.inria.fr/doku.php?id=tutorial:main

We get a folder hadoop-bsfs-1.2.1 and legacy hadoop-1.2.1.

cp BSFS-1.2.2/core-site.xml /home/demo-blobseer/hadoop-bsfs-1.2.1/bsfs-conf/

Then, please export the following environment varaibles:

export BLOBSEER_HOME=/home/demo-blobseer/blobseer-1.2.1
export HADOOP_HDFS_HOME=/home/demo-blobseer/hadoop-1.2.1
export HADOOP_BSFS_HOME=/home/demo-blobseer/hadoop-bsfs-1.2.1
export LD_LIBRARY_PATH=/home/demo-blobseer/deploy/lib:/home/demo-blobseer/hadoop-bsfs-1.2.1/blobseer-fsmeta/lib
export BSFS_SERVER_HOME=/home/demo-blobseer/hadoop-bsfs-1.2.1/blobseer-fsmeta
export JAVA_HOME=/usr/lib/jvm/java-6-openjdk
export HADOOP_CLASSPATH=/home/demo-blobseer/benchmark-tests
export LOGGING_PORT=9030
export DEMO_OUTPUT_PATH=/home/demo-blobseer/hadoop-test-result
export SCRIPT_HOME=/home/demo-blobseer/benchmark-scripts
export DEMO_INPUT_PATH=/home/demo-blobseer/hadoop-input

 	
export http_proxy="http://proxy:3128" ; export https_proxy="http://proxy:3128"
export LDFLAGS=-Wl,--no-as-needed
export HADOOP_HOME=/home/demo-blobseer/hadoop-1.2.1
export LD_LIBRARY_PATH="$HADOOP_HOME/blobseer-fsmeta/lib:$LD_LIBRARY_PATH"
export ANT_OPTS="-Dhttp.proxyHost=proxy -Dhttp.proxyPort=3128"

and put them into the ~/.bashrc file.

add file /user/games/env

demo-blobseer@parapide-3:~$ cat /usr/games/env 
#!/bin/bash
export BLOBSEER_HOME=/home/demo-blobseer/blobseer-1.2.1
export HADOOP_HDFS_HOME=/home/demo-blobseer/hadoop-1.2.1
export HADOOP_BSFS_HOME=/home/demo-blobseer/hadoop-bsfs-1.2.1
export LD_LIBRARY_PATH=/home/demo-blobseer/deploy/lib:/home/demo-blobseer/hadoop-bsfs-1.2.1/blobseer-fsmeta/lib
export BSFS_SERVER_HOME=/home/demo-blobseer/hadoop-bsfs-1.2.1/blobseer-fsmeta
export JAVA_HOME=/usr/lib/jvm/java-6-openjdk
export HADOOP_CLASSPATH=/home/demo-blobseer/benchmark-tests
export LOGGING_PORT=9030
export DEMO_OUTPUT_PATH=/home/demo-blobseer/hadoop-test-result
export SCRIPT_HOME=/home/demo-blobseer/benchmark-scripts
export DEMO_INPUT_PATH=/home/demo-blobseer/hadoop-input

In this folder, copy scripts from Blobseer-Demo/demo-sbin.

cp /home/Blobseer-Demo/demo-sbin/* /usr/games/

Thereafter, copy the privided 'sbin' repository to the '/usr/local/sbin' folder.

Finally, try to use

$hb-single-clustest.sh

command to deploy BlobSeer and Hadoop-BSFS. If both of them are successfully deployed, then congratulation to the administrator! The image is well created and please do not forget to save it.