User Tools

Site Tools


Sidebar

Navigation

Join us by

user mailing list
devel mailing list


More news...

RSS

bswan:main

Table of Contents

SVN location

You can find Blobseer-wan here

The main directory is “newscript” folder.

Some informations about launch are in file “README” of newscript folder.

How to use

The experiments are done on grid5000.

  1. You have to have a grid5000 account.
  2. Retrieve back files/folder needed: /home/rsaxena/big_4MB_gcc472.env, /home/rsaxena/big_4MB_gcc472.tgz, /home/rsaxena/deploy
  3. Make a grep to change “rsaxena” user in your user name
  4. Make two reservations:

(warning about guillemet below)

  • oargridsub -t allow_classic_ssh -w 3:30:00 rennes:rdef=“/nodes=4”,lyon:rdef=“/nodes=4”
  • oargridsub -t deploy -t destructive -w 3:30:00 rennes:rdef=“/nodes=3”,lyon:rdef=“/nodes=3”

Example:

lcloatre@frennes:~$ oargridsub -t allow_classic_ssh -w 1:30:00 rennes:rdef="/nodes=6",nancy:rdef="/nodes=6"
rennes:rdef=/nodes=6,nancy:rdef=/nodes=6
[OAR_GRIDSUB] [nancy] Date/TZ adjustment: 0 seconds
[OAR_GRIDSUB] [nancy] Reservation success on nancy : batchId = 558210
[OAR_GRIDSUB] [rennes] Date/TZ adjustment: 0 seconds
[OAR_GRIDSUB] [rennes] Reservation success on rennes : batchId = 674256
[OAR_GRIDSUB] Grid reservation id = 49231
[OAR_GRIDSUB] SSH KEY : /tmp/oargrid//oargrid_ssh_key_lcloatre_49231
You can use this key to connect directly to your OAR nodes with the oar user.
lcloatre@frennes:~$ 
lcloatre@frennes:~$ 
lcloatre@frennes:~$ 
lcloatre@frennes:~$ oargridsub -t deploy -t destructive  -w 1:30:00 rennes:rdef="/nodes=5",nancy:rdef="/nodes=5"
rennes:rdef=/nodes=5,nancy:rdef=/nodes=5
[OAR_GRIDSUB] [nancy] Date/TZ adjustment: 0 seconds
[OAR_GRIDSUB] [nancy] Reservation success on nancy : batchId = 558211
[OAR_GRIDSUB] [rennes] Date/TZ adjustment: 0 seconds
[OAR_GRIDSUB] [rennes] Reservation success on rennes : batchId = 674257
[OAR_GRIDSUB] Grid reservation id = 49232
[OAR_GRIDSUB] SSH KEY : /tmp/oargrid//oargrid_ssh_key_lcloatre_49232
You can use this key to connect directly to your OAR nodes with the oar user.
  1. In your home create a directory exp_dir, and copy/paste file “exp_config.yaml”, then update it with “previous Grid reservation id” and sites
vi ~/exp_dir/exp_config.yaml

# Use it only for hgmds experiments
ssh_job_id: 49231
dep_job_id: 49232
sites:
   rennes
   nancy
  1. Go into your folder “/home/lcloatre/deploy/blobseer-merged/newscripts”
  2. launch script:

ruby hgmds_exp_conductor.rb ~/exp_dir

if script is bloqued on exec_taktuk function, may be nodes are first time communicating (so we should do manual taktuk):
taktuk -f /home/lcloatre/exp_dir/test_001_001_001/conf/lyon/usablenodes.txt broadcast exec [ date ]
taktuk -f /home/lcloatre/exp_dir/test_001_001_001/conf/rennes/usablenodes.txt broadcast exec [ date ]

Results

ruby hgmds_post_process.rb ~/exp_dir

Then retrieve results on your local laptop, create a exp_dir directory and retrieve source code of blobseer-wan. for example:

scp -r lcloatre@rennes.g5k:/home/lcloatre/exp_dir .
scp -r lcloatre@rennes.g5k:/home/lcloatre/deploy/blobseer-merged .
cd blobseer-merged/newscript
python plot_script.py
bswan/main.txt · Last modified: 2014/12/17 09:29 (external edit)