Konduktor lets you submit multiple jobs which are enqueued until capacity is available for the job. This is useful for performing batch jobs, hyperparameter sweeps, or data processing.
Consider the following use case where we set which shard of data we want to perform work on via an environment variable. For example, our job might be defined as