We have spent significant time optimizing the run time and memory allocation of the pipeline processes. On Compute Canada clusters reducing the time and memory allocation of a job submission will reduce the time spent on the queue and therefore improve throughput all other things remaining equal. Over committing time and memory can be a huge waste of resources.
We have spent significant time optimizing the run time and memory allocation of the pipeline processes. On Compute Canada clusters reducing the time and memory allocation of a job submission will reduce the time spent on the queue and therefore improve throughput all other things remaining equal. Over committing time and memory can be a huge waste of resources.
