Queue configuration

Useful documentation for configuring PBS queues: http://www.clusterresources.com/torquedocs21/4.1queueconfig.shtml

Prior to maintenance or downtime you should set the queues in draining mode, i.e. they will finish their jobs and not accept any more:
qmgr -c "set queue grid enabled = false"

To reconfigure other queue parameters dump the queue configurations to a file:
qmgr -c "print server" > output

Edit this file:



#
# Create and define queue cert
#

create queue enmr.eu
set queue enmr.eu queue_type = Execution
set queue enmr.eu Priority = 100
set queue enmr.eu max_running = 2
set queue enmr.eu resources_max.cput = 01:00:00
set queue enmr.eu resources_max.walltime = 00:30:00
set queue enmr.eu acl_group_enable = True
set queue enmr.eu acl_groups = ops
set queue enmr.eu acl_groups =+=
sgmops
set queue enmr.eu acl_groups + dteam
set queue enmr.eu acl_groups += sgmdteam
set queue enmr.eu acl_groups += prddteam
set queue enmr.eu acl_groups += infngrid
set queue enmr.eu acl_groups += sgminfngrid
set queue enmr.eu enabled = True
set queue enmr.eu started = True==

etc etc........



For example, if you want to decrease the priority of the "enmr.eu" queue above, change the line:
set queue enmr.eu Priority = 50

After editing the "output" file to meet your needs pipe it to the qmgr file:

cat output | qmgr

Caution
Whenever you re-yaim a CE profile, the settings for the queues change. Thus, after you have a queue configuration done, save it to a file, such that you can then run this:

cat output | qmgr


Creating ad-hoc queues

One can use the above technique to create an ad-hoc queue, separate to the gLite queues. This queue will only be available to local users. However if the queue variable

acl_group_enable = True

is set then only the primary user's group is examined for authorization. This is a problem in ad-hoc user creations as their primary queues are their names as well.

In order to get PBS to look at all the user's groups for authorization the following needs to be set in qmgr:

set queue <queue> acl_group_sloppy = True

-- AndrewLewis - 24 Mar 2010

Topic revision: r1 - 24 Mar 2010 - 08:53:20 - AndrewLewis
 
This site is powered by the TWiki collaboration platformCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback