Job running options
There are three general categories of tools on the CLC Server: non-exclusive, streaming and exclusive. These are described below. Non-exclusive or streaming jobs can run concurrently alongside others of the non-exclusive type on a given machine. Those defined as exclusive cannot be run on the same server or node at the same time as other jobs of any type.
- Non-exclusive algorithms Tools with low demands on system resources. They can be alongside others in this category, as well with a job of the streaming category, described below. An example of a non-exclusive algorithm is "Convert from tracks".
- Streaming algorithms Tools with high I/O demands, that is, much reading from and writing to disk is needed. These cannot be run with others in the streaming category but can be run alongside jobs running non-exclusive algorithms. An example of streaming algorithms are the NGS data import tools.
- Exclusive algorithms Tools optimized to utilize the machine they are running on. They have very high I/O bandwidth, memory, or CPU requirements and therefore should not be run at the same time as other jobs on the same machine. An example of this sort is "Map Reads to Reference".
See Appendix Non-exclusive Algorithms for a list of CLC Genomics Server algorithms that can be be run alongside others on a given machine.
The rest of this section discusses the configuration options relevant for concurrent jobs on a single server or on a job node. Information about concurrent job processing on grid nodes is in Multi-job processing on grid.
Subsections