Resource Manager/Job scheduler

[jaysantos]

Hi all,

We have a here a standalone machine running CentOS 6.2 minimal install. 48 core CPU and 512GB of RAM. I'm looking for a resource manager/job scheduler for our server. I've search upon the web and found Torque + Maui. Though it has a guide on how to install. But I'm not quite confident to install it in the server. Is there anyone of you installed this resource manager? Can someone give me a step by step guide on how to install this resource manager? How it works? and how to administer it?

I'm sorry for being newbie here. Any help from you is highly Appreciated.

Thank you.

[Wallysb01]

I put Torque on my 12 core workstation running Ubuntu 12.04 (note the host name is miniopterus). It was really quite easy thanks to aptitude.

Here's my install notes and good luck adapting them to CentOS:

## This is the readme for the setup procedure for Torque on Miniopterus ##

## To install the programs needed:
sudo aptitude install torque-server torque-scheduler torque-client


## To configure torque for miniopterus:

qterm

sudo qmgr -c 'set server mom_job_sync = true'
sudo qmgr -c 'create queue batch'
sudo qmgr -c 'set queue batch queue_type = execution'
sudo qmgr -c 'set queue batch started = true'
sudo qmgr -c 'set queue batch enabled = true'
sudo qmgr -c 'set queue batch resources_default.walltime = 240:00:00'
sudo qmgr -c 'set queue batch resources_default.nodes = 1'
sudo qmgr -c 'set server default_queue = batch'
sudo qmgr -c 'set server managers = walter@miniopterus'
sudo qmgr -c 'set server managers = [email protected]'
sudo qmgr -c 'set server operators = [email protected]'

sudo aptitude install torque-client torque-mom
sudo pbs_mom
sudo pbs_server
sudo pbs_sched


## Torque looks for /etc/profile to add directories to your path for use with qsub
## However Ubuntu now likes /etc/enviornment so I added the following lines at the bottom of /etc/profile (this doesn't seem to have solved the path issues completely however):

PATH="/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/RepeatMasker:/home/walter/tools/augustus.2.5.5/bin"
export ZOE=/usr/local/bin/Zoe/
export AUGUSTUS_CONFIG_PATH=/home/walter/tools/augustus.2.5.5/config/

## make sure /var/spool/torque/mom_priv/config has the following line:

$pbs_server = 127.0.0.1

## make sure /var/spool/torque/server_priv/nodes has the following line:

miniopterus np=12

## make sure /var/spool/torque/server_name has the following line:

miniopterus


## That should do it.  But the torque manual is a great reference: http://www.clusterresources.com/torquedocs21/
## Good luck!

[GenoMax]

This is a link to build open grid scheduler for CentOS: http://bioteam.net/2012/01/building-...ntos-rhel-6-2/

An older version of SGE (Sun/Oracle Grid Engine) would be another option. If you google for "SGE install Cent OS" there are several links with instructions.

[jaysantos]

Sorry for late reply. Been busy for another project. and this resource manager/job scheduler are still pending for me.

Torque and Maui are the one I started with, but I'm not confident to try it. (lack of training). Are there any other Resource manager/Job Scheduler you can suggest. Even if it's has a license?

Any inputs are highly appreciated.

Thank you very much.

Cheers,