Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Last revisionBoth sides next revision
wiki:disk_reservation [2016/11/29 23:08] – [Limits] neyronwiki:disk_reservation [2016/11/30 10:26] neyron
Line 2: Line 2:
 E.g. Each node has "cpus" and "disks", we want to allow users to create jobs to reserve disks for a long period, and eventually request smaller compute jobs on resources on which those disks are reserved. E.g. Each node has "cpus" and "disks", we want to allow users to create jobs to reserve disks for a long period, and eventually request smaller compute jobs on resources on which those disks are reserved.
 This would give users the capability of keeping data on disk for a longer time than the compute time, e.g. a more persistent storage for data. This would give users the capability of keeping data on disk for a longer time than the compute time, e.g. a more persistent storage for data.
 +
 ===== Setup ===== ===== Setup =====
 We create //disk// resources, then setup some coupling so that a //compute// resource is **tagged** when a user has disks reserved on it. Tagging in done in the //disk// property of the //compute// resource (type //default//), with the syntax: ''/userid1:#disks/userid2:#disks/''. We create //disk// resources, then setup some coupling so that a //compute// resource is **tagged** when a user has disks reserved on it. Tagging in done in the //disk// property of the //compute// resource (type //default//), with the syntax: ''/userid1:#disks/userid2:#disks/''.
Line 277: Line 278:
   * Users may want to select specific disks/hosts when using only a part of the reserved disks for a given compute job. This mechanism does not allow it.   * Users may want to select specific disks/hosts when using only a part of the reserved disks for a given compute job. This mechanism does not allow it.
   * The ''reserve_disk'' and ''with_disk'' job types do not allow to reserve at once (in a single ''oarsub'' command) both the disk and compute resources.   * The ''reserve_disk'' and ''with_disk'' job types do not allow to reserve at once (in a single ''oarsub'' command) both the disk and compute resources.
 +  * A //with_disk// compute job could easily suffer from starvation since it will only be scheduled once the disk job is started:
 +    * While batch jobs which are not started yet will be move with regard to previous scheduling decisions, some may have started before the disk property of the resources is changed, making resources whose disks are reserved unavailable for the duration of those jobs.
 +    * Advance reservations could also be accepted on the resources: resources are //booked// upon submission acceptation for an advance reservation, possibly before the disk property is changed.
wiki/disk_reservation.txt · Last modified: 2016/12/02 18:33 by neyron
Recent changes RSS feed GNU Free Documentation License 1.3 Donate Powered by PHP Valid XHTML 1.0 Valid CSS Driven by DokuWiki